Structured Output
Structured output is when a language model returns data in a predictable, machine-readable format—JSON, XML, typed objects—rather than free-form prose. This is what makes LLMs usable as components in software systems rather than just conversational interfaces. If you need the model to extract a name, date, and dollar amount from an invoice, you need those values in fields your code can parse, not embedded in a sentence. Most model providers now support constrained generation—forcing the model's output to conform to a JSON schema—which eliminates the parsing failures that plagued early integrations. OpenAI's structured output mode, Anthropic's tool use, and open-source libraries like Instructor all solve this problem. Structured output is the bridge between AI as a chat feature and AI as a system component, and getting it right is prerequisite to any serious automation.
Related terms:
Few-Shot Prompting
Few-shot prompting leverages AI’s pattern recognition by providing a handful of examples in the prompt, enabling the model to identify patterns and generate...
AI Strategy
AI strategy is an organization’s plan for how it will use—and what it will not use—AI to achieve business outcomes, answering concrete questions about...
Inference
Inference is the process of running a trained model on new input to generate a prediction or output—such as sending a prompt to GPT-4 and receiving a...