RAG (Retrieval-Augmented Generation)
Retrieval-augmented generation (RAG) is an architecture pattern that connects a large language model to external knowledge sources—documents, databases, APIs—so its responses draw on real, current information rather than relying solely on what it memorized during training. The model retrieves relevant context at query time, then generates an answer grounded in that evidence. RAG is one way enterprises make general-purpose AI useful for their specific business, though the approach is not without its limitations and has been surpassed by simpler read/write/grep tools in many instances.
Related terms:
Pace Layers
Pace layers separate complex systems into fast-changing parts that learn and slow-moving parts that stabilize, helping teams choose experiments vs. strategy.
Inference
Inference is the process of running a trained model on new input to generate a prediction or output—such as sending a prompt to GPT-4 and receiving a...
Private-Token Sovereignty
Private-token sovereignty is the strategic imperative for organizations to maintain control over their unique data and institutional knowledge while...