Chain-of-Thought Prompting — Technology Wiki

Overview

Direct Answer

Chain-of-thought prompting is a technique that instructs language models to articulate intermediate reasoning steps explicitly before reaching a final answer, mimicking human problem-solving behaviour. This approach significantly improves model performance on tasks requiring multi-step logic, arithmetic, and complex inference.

How It Works

The method works by adding phrases such as 'Let me think step by step' or 'First I will...' to prompts, which triggers the model to generate a visible reasoning chain rather than jumping directly to conclusions. The model then uses these self-generated intermediate steps as context to inform its final response, allowing errors to accumulate less readily across reasoning stages.

Why It Matters

Organisations benefit from improved accuracy on complex problem-solving tasks without requiring model retraining or fine-tuning, reducing deployment costs and time-to-value. Transparency in reasoning steps also enhances auditability and trustworthiness in high-stakes domains such as financial analysis, legal research, and clinical decision support.

Common Applications

Applications include mathematical problem-solving in educational technology, multi-step question answering in customer support systems, logical reasoning in enterprise knowledge work, and structured analysis in consulting and research domains.

Key Considerations

The technique increases token consumption and latency due to longer outputs, which impacts operational costs and response times. Performance gains diminish on tasks that do not inherently benefit from step-by-step reasoning, requiring practitioners to evaluate task suitability before implementation.

Related in Prompting & Interaction

Prompt Engineering

The practice of designing and optimising input prompts to elicit desired outputs from large language models.

Few-Shot Prompting

A technique where a language model is given a small number of examples within the prompt to guide its response pattern.

Zero-Shot Prompting

Querying a language model to perform a task it was not explicitly trained on, without providing any examples in the prompt.

In-Context Learning

The ability of large language models to learn new tasks from examples provided within the input prompt without parameter updates.

Few-Shot Learning

A machine learning approach where models learn to perform tasks from only a small number of labelled examples, often achieved through in-context learning in large language models.

Zero-Shot Learning

The ability of AI models to perform tasks they were not explicitly trained on, using generalised knowledge and instruction-following capabilities.

Emergent Capabilities

Abilities that appear in large language models at certain scale thresholds that were not present in smaller versions, such as in-context learning and complex reasoning.

Tool Use in AI

The capability of AI agents to invoke external tools, APIs, databases, and software applications to accomplish tasks beyond the model's intrinsic knowledge and abilities.

System Prompt

An initial instruction set provided to a language model that defines its persona, constraints, output format, and behavioural guidelines for a given session or application.

More in Artificial Intelligence

Artificial Narrow Intelligence

Foundations & Theory

AI systems designed and trained for a specific task or narrow range of tasks, such as image recognition or language translation.

Confusion Matrix

Evaluation & Metrics

A table used to evaluate classification model performance by comparing predicted classifications against actual classifications.

AI Red Teaming

Safety & Governance

The systematic adversarial testing of AI systems to identify vulnerabilities, failure modes, harmful outputs, and safety risks before deployment.

BLEU Score

Evaluation & Metrics

A metric for evaluating the quality of machine-generated text by comparing it to reference translations or texts.

AI Memory Systems

Infrastructure & Operations

Architectures that enable AI agents to store, retrieve, and reason over information from past interactions, providing continuity and personalisation across conversations.

AutoML

Training & Inference

Automated machine learning that automates the end-to-end process of applying machine learning to real-world problems.

Tensor Processing Unit

Models & Architecture

Google's custom-designed application-specific integrated circuit for accelerating machine learning workloads.

AI Alignment

Safety & Governance

The research field focused on ensuring AI systems act in accordance with human values, intentions, and ethical principles.