In-Context Learning — Technology Wiki

Overview

Direct Answer

In-context learning is the ability of large language models to adapt behaviour and perform new tasks by conditioning on examples or instructions embedded directly in the input prompt, without modifying the model's underlying parameters. This represents a fundamental departure from traditional machine learning approaches that require retraining or fine-tuning.

How It Works

When relevant examples, instructions, or few-shot demonstrations are provided at the beginning of a prompt, transformer-based models leverage their attention mechanisms to recognise patterns and apply implicit learning directly during inference. The model's internal representations shift to accommodate the new task context, with later token predictions influenced by earlier contextual information through learned attention weights.

Why It Matters

This capability dramatically reduces deployment friction and cost by eliminating the need for task-specific fine-tuning cycles, which require labelled data, computational resources, and model versioning overhead. Organisations can iterate rapidly on use cases, adapt to domain shifts, and deploy generalised models across diverse applications without retraining.

Common Applications

Practical applications include zero-shot and few-shot classification in customer support (routing queries by providing category examples), legal document analysis where domain-specific terminology is demonstrated in-prompt, and cross-lingual translation tasks where bilingual examples guide behaviour. Content moderation systems and domain-specific question-answering similarly rely on contextual demonstration.

Key Considerations

Performance remains sensitive to example selection, ordering, and prompt formulation; there is no guarantee of task mastery regardless of in-prompt guidance. Context window length constraints and potential brittleness with complex reasoning tasks necessitate careful validation before production deployment.

Referenced By2 terms mention In-Context Learning

Other entries in the wiki whose definition references In-Context Learning — useful for understanding how this concept connects across Artificial Intelligence and adjacent domains.

Emergent Capabilities·Artificial Intelligence Few-Shot Learning·Artificial Intelligence

Related in Prompting & Interaction

Prompt Engineering

The practice of designing and optimising input prompts to elicit desired outputs from large language models.

Few-Shot Prompting

A technique where a language model is given a small number of examples within the prompt to guide its response pattern.

Zero-Shot Prompting

Querying a language model to perform a task it was not explicitly trained on, without providing any examples in the prompt.

Chain-of-Thought Prompting

A prompting technique that encourages language models to break down reasoning into intermediate steps before providing an answer.

Few-Shot Learning

A machine learning approach where models learn to perform tasks from only a small number of labelled examples, often achieved through in-context learning in large language models.

Zero-Shot Learning

The ability of AI models to perform tasks they were not explicitly trained on, using generalised knowledge and instruction-following capabilities.

Emergent Capabilities

Abilities that appear in large language models at certain scale thresholds that were not present in smaller versions, such as in-context learning and complex reasoning.

Tool Use in AI

The capability of AI agents to invoke external tools, APIs, databases, and software applications to accomplish tasks beyond the model's intrinsic knowledge and abilities.

System Prompt

An initial instruction set provided to a language model that defines its persona, constraints, output format, and behavioural guidelines for a given session or application.

More in Artificial Intelligence

Symbolic AI

Foundations & Theory

An approach to AI that uses human-readable symbols and rules to represent problems and derive solutions through logical reasoning.

Neural Processing Unit

Models & Architecture

A specialised processor designed to accelerate neural network computations in edge devices and mobile platforms.

AI Governance

Safety & Governance

The frameworks, policies, and regulations that guide the responsible development and deployment of AI technologies.

AI Accelerator

Infrastructure & Operations

Specialised hardware designed to speed up AI computations, including GPUs, TPUs, and custom AI chips.

Turing Test

Foundations & Theory

A measure of machine intelligence proposed by Alan Turing, where a machine is deemed intelligent if it can exhibit conversation indistinguishable from a human.

Artificial Narrow Intelligence

Foundations & Theory

AI systems designed and trained for a specific task or narrow range of tasks, such as image recognition or language translation.

ROC Curve

Evaluation & Metrics

A graphical plot illustrating the diagnostic ability of a binary classifier as its discrimination threshold is varied.

AI Watermarking

Safety & Governance

Techniques for embedding imperceptible statistical patterns in AI-generated content to enable reliable detection and provenance tracking of synthetic outputs.