Tagged with llms
Prompting changes the instructions at inference time, while fine-tuning changes model weights using additional training data.
Fine-tuning vs prompting
RAG retrieves relevant external context and supplies it to the model at generation time.
RAG basics
Tokens are the chunks of text a model processes, and they drive both context window limits and usage cost.
What are tokens in LLM systems?
An AI agent is a system that uses a model plus tools, memory, and control flow to take multi-step actions toward a goal.
What is an agent in AI applications?
A hallucination is a confident-looking model output that is unsupported, fabricated, or wrong.
What is hallucination in generative AI?
The context window is the maximum amount of tokenized input and working context a model can handle in one interaction.
What is model context window?
Model routing chooses different models or configurations based on task complexity, latency needs, cost, or safety requirements.
What is model routing?
Prompt engineering is the practice of structuring instructions and context so a model produces more reliable outputs.
What is prompt engineering?
Tool calling lets a model request an external function or service when the answer requires real actions or fresh data.
What is tool calling in LLM apps?