System Prompt
A system prompt is the set of instructions given to a language model before the user's input—defining the model's persona, constraints, output format, and behavioral rules. In the OpenAI and Anthropic APIs, it occupies the "system" role in the message array. The user never sees it, but it shapes everything the model does. System prompts are where enterprises encode their business logic: "You are a customer support agent for Acme Corp. You may only reference information from the provided knowledge base. Never discuss competitor pricing. Always respond in the customer's language." A well-written system prompt is the cheapest, fastest way to control model behavior. A poorly written one is why your AI chatbot told a customer they could get a full refund on a non-refundable ticket. System prompt engineering is a core skill that most teams underinvest in.
Related terms:
Context Window
A context window is the maximum amount of text a language model can process in a single call—input and output combined—measured in tokens.
Embeddings
Embeddings are numerical representations of text—vectors of hundreds or thousands of floating-point numbers—that capture semantic meaning in a form machines...
Agentic AI
Agentic AI refers to systems that autonomously pursue goals—planning actions, employing tools, and adapting based on feedback—without waiting for human...