Few-Shot Prompting

Overview

Direct Answer

Few-shot prompting is a technique in which a language model receives a small number of demonstration examples (typically 2–10) embedded directly within a prompt to establish a pattern for generating contextually appropriate responses. This method leverages in-context learning without requiring model retraining or fine-tuning.

How It Works

The model observes the provided input–output pairs and infers the desired task structure, tone, and format from those examples. During inference, the model applies this learned pattern to new, unseen inputs within the same prompt. The proximity and ordering of examples significantly influence the model's behaviour, as the demonstrations provide implicit instruction through pattern recognition rather than explicit algorithmic rules.

Why It Matters

Organisations adopt this approach to reduce engineering overhead and deployment latency—no retraining cycles or specialised datasets are required. It enables rapid adaptation to domain-specific tasks, improved accuracy on niche problems, and cost-effective customisation without infrastructure investment.

Common Applications

Applications include customer service chatbots performing intent classification, legal document analysis extracting specific clause types, financial services automating transaction categorisation, and healthcare systems interpreting clinical notes for structured data extraction.

Key Considerations

Performance gains plateau with model size and task complexity; some tasks benefit minimally from additional examples. Token consumption increases linearly with demonstration count, raising inference costs for resource-constrained deployments.

Cross-References(1)

Natural Language Processing

Language Model

Related in Prompting & Interaction

Prompt Engineering

The practice of designing and optimising input prompts to elicit desired outputs from large language models.

Zero-Shot Prompting

Querying a language model to perform a task it was not explicitly trained on, without providing any examples in the prompt.

Chain-of-Thought Prompting

A prompting technique that encourages language models to break down reasoning into intermediate steps before providing an answer.

In-Context Learning

The ability of large language models to learn new tasks from examples provided within the input prompt without parameter updates.

Few-Shot Learning

A machine learning approach where models learn to perform tasks from only a small number of labelled examples, often achieved through in-context learning in large language models.

Zero-Shot Learning

The ability of AI models to perform tasks they were not explicitly trained on, using generalised knowledge and instruction-following capabilities.

Emergent Capabilities

Abilities that appear in large language models at certain scale thresholds that were not present in smaller versions, such as in-context learning and complex reasoning.

Tool Use in AI

The capability of AI agents to invoke external tools, APIs, databases, and software applications to accomplish tasks beyond the model's intrinsic knowledge and abilities.

System Prompt

An initial instruction set provided to a language model that defines its persona, constraints, output format, and behavioural guidelines for a given session or application.

More in Artificial Intelligence

Inference Engine

Infrastructure & Operations

The component of an AI system that applies logical rules to a knowledge base to derive new information or make decisions.

AI Model Registry

Infrastructure & Operations

A centralised repository for storing, versioning, and managing trained AI models across an organisation.

AI Fairness

Safety & Governance

The principle of ensuring AI systems make equitable decisions without discriminating against any group based on protected attributes.

AI Bias

Training & Inference

Systematic errors in AI outputs that arise from biased training data, flawed assumptions, or prejudicial algorithm design.

Artificial Narrow Intelligence

Foundations & Theory

AI systems designed and trained for a specific task or narrow range of tasks, such as image recognition or language translation.

Planning Algorithm

Reasoning & Planning

An AI algorithm that generates a sequence of actions to achieve a specified goal from an initial state.

AI Interpretability