---
title: Tight Lower Bounds for Query Processing on Streaming and External Memory Data
url: https://www.emergentmind.com/papers/0505002
type: paper
arxiv_id: '0505002'
arxiv_url: https://arxiv.org/abs/0505002
published: '2005-04-29'
categories:
- cs.DB
- cs.CC
---

# Tight Lower Bounds for Query Processing on Streaming and External Memory Data

## Abstract

We study a clean machine model for external memory and stream processing. We show that the number of scans of the external data induces a strict hierarchy (as long as work space is sufficiently small, e.g., polylogarithmic in the size of the input). We also show that neither joins nor sorting are feasible if the product of the number $r(n)$ of scans of the external memory and the size $s(n)$ of the internal memory buffers is sufficiently small, e.g., of size $o(\sqrt[5]{n})$. We also establish tight bounds for the complexity of XPath evaluation and filtering.