---
title: Single-hop & Multi-hop QA
url: https://www.emergentmind.com/topics/single-hop-and-multi-hop-qa
type: topic
---

# Single-hop & Multi-hop QA

Single-hop and multi-hop question answering (QA) represent distinct paradigms in automated and human information seeking and reasoning, distinguished by the number of inference steps—or “hops”—required to integrate evidence sources and produce an answer. In single-hop QA, an answer is derived from a single atomic fact retrieved from one passage or source; in multi-hop QA, the answer emerges from synthesizing two or more facts—often spread across multiple documents—via a chain of intermediate reasoning comprising reading comprehension, logical inference, and knowledge integration. The latter imposes higher cognitive and algorithmic demands, introduces unique sources of error, and has catalyzed a wealth of research on pipelines, model architectures, dataset construction, and evaluation methodologies.

## 1. Core Definitions and Distinctions

**Single-hop QA** entails mapping a question $q$ and a local evidence context $C$ (typically a paragraph or document) to an answer $a$ such that $a$ can be extracted directly from $C$ or inferred in a single reasoning step. Canonical datasets include SQuAD, NewsQA, and TriviaQA. Formal task definition:
\[
a^* = \arg\max_{a \subseteq C} P(a \mid q, C)
\]
Single-hop extraction and span prediction dominate; the challenge is primarily reading comprehension.

**Multi-hop QA** requires traversing a reasoning chain involving $T \geq 2$ hops:
- $Q_1 \rightarrow Q_2 \rightarrow \dots \rightarrow Q_T$
- Each $Q_t$ is a sub-question whose resolution requires information from the previous hop's answer $a_{t-1}$ or supporting fact.
- The answer $a_T$ synthesizes facts from at least two distinct contexts.

Examples:
- Single-hop: “Who wrote The Great Gatsby?”
- Multi-hop: “Where was the spouse of the third Prime Minister of Canada born?”

Multi-hop QA tasks necessitate decomposition (splitting the complex query into simpler sub-questions), iterative retrieval, reasoning over distributed evidence, and final answer synthesis [2510.04493], [1906.02900], [2108.00573].

Key differences:
- **Cognitive/algorithmic load**: Multi-hop requires planning and chaining, error compounding over hops, and complex integration.
- **System design**: Single-hop architectures rely on span extractors; multi-hop pipelines require iterative retrieval, decomposition, knowledge integration, and mechanisms to track intermediate entities or facts.

## 2. Dataset Construction and Benchmarking

Early multi-hop QA benchmarks (e.g., HotpotQA, 2WikiMultihopQA) attempted to enforce compositional reasoning by crowdsourcing questions designed to require multiple paragraphs. Analyses revealed, however, that compositionality does not guarantee genuine multi-hop reasoning; single-hop models can answer a large fraction of nominally multi-hop examples due to weak distractors or redundant evidence [1906.02900]. For instance, a BERT-based single-hop model achieves 67.1 F1 on HotpotQA’s distractor validation set—rivaling multi-hop-specific models.

MuSiQue-Ans introduced a bottom-up construction paradigm: single-hop RC instances are composed into directed acyclic graphs, guaranteeing that every hop’s answer depends on a predecessor by masking sub-answers and controlling context overlap. This filtering—combined with adversarial distractors and unanswerable contrast pairs (MuSiQue-Full)—enforces connected multi-hop reasoning and virtually eliminates shortcut solutions, exposing a larger human–machine gap [2108.00573].

In the scientific domain, AIM-SciQA extracts hundreds of thousands of single-hop QAs from PMC articles and composably links them into over 13,000 multi-hop pairs—using both semantic similarity and explicit citation graphs—to differentiate retrieval and synthesis abilities under both oracle and realistic settings [2603.14257].

## 3. Model Architectures: From Single-hop to Multi-hop

**Single-hop QA**: Span-extraction models (BiDAF, BERT- or ELECTRA-based) dominate, leveraging token-level attention and direct answer prediction based on the concatenated [question; context] [1906.02900], [2205.11729], [2101.05988].

**Multi-hop QA**:
- **Pipeline approaches**: Iterative retrieval and reasoning pipelines, such as paragraph retrievers coupled with multi-task readers (answer and supporting fact prediction), can be trained with separate losses at each hop [(1906.06606)].
- **Graph-based models**: Graph neural networks (GNNs) and entity-centric architectures explicitly model relationships between entities, sentences, and documents to enable evidence aggregation ([2203.09073], [1909.05803], [2307.00335]).
- **Modular and decomposable networks**: Self-assembling modular networks assemble “Find,” “Relocate,” “Compare,” and “NoOp” primitives dynamically per-question, with controllers softly decomposing queries into interpretable sub-questions ([1909.05803]).
- **Generative and sequence-prediction models**: Fusion-in-Decoder (FiD), PathFID, and SEQGRAPH model not only the final answer but also the stepwise reasoning path, outputting linearized sequences over passage titles, sentence indices, and answers, with integrated graph constraints enhancing faithfulness and interpretability ([2205.09226], [2307.00335]).
- **Prompt-based and parameter-conserving models**: Prompt-based Conservation Learning (PCL) freezes single-hop model backbones, appending learnable, type-specific prompts and lateral expansion to encode distinct multi-hop reasoning patterns without catastrophic forgetting of single-hop skills ([2209.06923]).

**End-to-end question-generation (QG) models** jointly learn to ask and answer explicit sub-questions as latent variables, improving both interpretability and answer robustness while mitigating error cascades inherent in straightforward question decomposition pipelines ([2203.09073], [2002.12344]).

## 4. Human and Machine Performance Characteristics

A comprehensive human study [2510.04493] revealed the following:

| Task                          | Human Accuracy (mean)         |
|-------------------------------|-------------------------------|
| Single-hop QA                 | 84.1% [76.9–89.7%]            |
| Direct Multi-hop QA           | 80.2% [70.1–91.9%]            |
| Query-Type Recognition        | 67.9% [51.3–77.8%]            |
| Answer Integration            | 97.3% [94.1– — ]              |

**Key findings**:
- Humans excel at knowledge integration (97.3%) but often fail to recognize whether a question requires multi-hop reasoning (68%).
- Semantic-type mismatch, entity confusion, omission of required integration steps in decomposition, and rare synthesis errors are prevalent error types.
- AI and hybrid AI–human systems benefit by assigning sub-tasks based on these strengths and weaknesses: machines automate complexity detection and decomposition; humans focus on nuanced reading and integration.

Multi-hop models, even when correctly answering the global question, often fail to answer explicit sub-questions as evaluated by diagnostic metrics—revealing that shortcut solutions persist without explicit stepwise reasoning supervision ([2002.09919], [2210.04234]). On MuSiQue, single-hop models suffer a 30-point F1 drop relative to multihop-aware models, highlighting task difficulty when genuine composition is enforced ([2108.00573]).

## 5. Systemic Challenges, Error Modes, and Design Recommendations

**Shortcut problem**: Many multi-hop QA benchmarks can be artificially solved by locating the unique entity of the desired type among distractors, thus circumventing true multi-hop reasoning ([1906.02900], [2108.00573], [2210.04234]).

**Error propagation**: Decomposition pipelines—where a complex question is partitioned into sub-questions—are susceptible to cascading errors and accumulation of noise, especially when sub-question boundaries are ambiguous or machine-generated sub-questions lack interpretive clarity ([2002.09919], [2203.09073], [2510.04493]).

**Semantic misalignment**: Humans and models alike make errors by returning an answer of the wrong semantic type (“where”/“when” swaps), or by confusion over similarly named entities ([2510.04493]).

**Adversarial robustness**: Most architectures suffer significant accuracy drops when distractors are constructed adversarially to mask shortcut patterns or when unanswerable “contrast” examples are added ([2108.00573], [2203.09073]).

**System design recommendations**:
- Automate complexity assessment to triage queries as single- or multi-hop [2510.04493].
- Decompose queries into explicit, semantic-sub-questions, minimizing ambiguity [2510.04493], [2203.09073], [2002.12344].
- Supervise or regularize intermediate sub-question answering [2210.04234], [2002.09919].
- Freeze and conserve single-hop skills while expanding multi-hop capabilities to prevent forgetting [2209.06923].
- For open-domain settings, prioritize joint retrieval+reasoning evaluation as retrieval often becomes the primary bottleneck [1906.06606], [1906.02900], [2603.14257].

## 6. Open Research Directions and Broader Implications

Developing scalable, trustworthy, and faithful multi-hop QA systems remains a major challenge:
- **Dataset design** must enforce connected reasoning via rigorous construction and filtering (e.g., DAGs, masking, adversarial distractors, unanswerable contrast sets) [2108.00573], [2603.14257].
- **Modeling advances** include modular networks, prompt-tuning, graph-augmented generation, joint reasoning with sub-question supervision, and dynamic adaptation to variable-hop complexity [2307.00335], [2209.06923], [2203.09073], [2002.09919].
- **Hybrid and collaborative systems** can exploit the complementary strengths of humans (integration, nuanced reading) and AI (retrieval, decomposition, consistency checking) for robust, high-accuracy pipelines [2510.04493].
- **Explainability and evaluation**: Judging stepwise reasoning fidelity via explicit chain outputs (fact pointers, reasoning paths, or generated sub-questions) is critical for both error analysis and AI trustworthiness [2205.09226], [2002.12344].
- **Scientific and enterprise applications**: Retrieval-augmented multi-document QA (as in IM-SciQA, CIM-SciQA) enables fine-grained evaluation of document retrieval versus evidence synthesis, with implications for fact-checking, legal, and biomedical domains [2603.14257].

A plausible implication is that future QA systems will dynamically route queries along pipelines tailored to the complexity of compositional reasoning required, with integrated support for decomposition, retrieval, cross-passage inference, and final synthesis—leveraging interpretability and robustness as core design imperatives.

Source: https://www.emergentmind.com/topics/single-hop-and-multi-hop-qa