# Context rot | IonBin

> Context rot describes less reliable model performance as inputs grow, particularly when useful information competes with distractors.

Canonical page: https://ionbin.com/wiki/concepts/context-rot/
Agent guide: https://ionbin.com/llms.txt

This is a readable version of the published page. Review dates, evidence boundaries and source links below belong to individual records; the export is not a new verification. Examples are reference material, not instructions to execute.

Concept

## Context rot

Context rot describes less reliable model performance as inputs grow, particularly when useful information competes with distractors. Research has demonstrated length and position effects in specific models and tasks. Relevant context and task-specific testing can help; there is no universal token threshold or guaranteed fix.

Verified Oct 18, 2026 Review by Apr 16, 2027 2 sources

### What it is

Longer context can add useful evidence, but it can also add distractors or conflicting instructions. The effect depends on the task, model and arrangement of the input.

### How it works

- **Lost in the Middle (Liu et al., 2023)** found that performance was often highest when the relevant information was at the beginning or end of the input, and dropped significantly when it was in the middle. That held even for long-context models.

- **Chroma’s July 2025 technical report** tested 18 models, including GPT-4.1, Claude 4, Gemini 2.5 and Qwen3. It found performance grew increasingly unreliable as input length increased, even on simple tasks, and that how information is presented matters as much as whether it’s there. Chroma sells a vector database, so weigh that interest.

### Benefits

- **A possible quality improvement without changing models.** Measure the result on representative tasks.

- **Lower cost.** Less irrelevant input means fewer billed tokens.

### Limits and risks

- **Relevant and non-redundant helps. Irrelevant and contradictory hurts.** Curate the context and put the key instruction and facts at the start or end.

- **Summaries can lose facts.** IonBin recommends preserving decisions and source references before compacting or starting a fresh conversation (see [agent memory](https://ionbin.com/wiki/questions/give-an-agent-memory/)). Test that essential constraints survive.

- **Evidence date.** The 2025 report covers newer long-context models, but neither study tested every current model, so test yours on your own material.

### Best-fit stacks

Stack 07

#### [Research & market intelligence](https://ionbin.com/use-cases/research-intelligence/)

Competitor, market and search research with sources you can cite.

Stack 01

#### [SOPs & process documentation](https://ionbin.com/use-cases/sops-process/)

Turn how your team actually works into SOPs people can follow and agents can use.

### Agent compatibility

Not tool-specific. See [Agent-ready](https://ionbin.com/agent-ready/) for connector support by tool.

Levels come from each tool's recorded, sourced compatibility. [How the levels work](https://ionbin.com/wiki/questions/connect-a-tool-to-an-ai-agent/).

### Related entries

[Context window · Concept](https://ionbin.com/wiki/concepts/context-window/)[Retrieval-augmented generation (RAG) · Concept](https://ionbin.com/wiki/concepts/rag/)[How do I write a prompt that gets usable work? · Question](https://ionbin.com/wiki/questions/how-to-write-a-prompt-that-works/)[How do I give an AI agent memory of our business? · Question](https://ionbin.com/wiki/questions/give-an-agent-memory/)[How do I cut AI API costs without hurting quality? · Question](https://ionbin.com/wiki/questions/cut-ai-api-costs/)[How should we organize AI projects so the context is always there? · Question](https://ionbin.com/wiki/questions/how-to-set-up-ai-project-workspaces/)[Should I use RAG or put everything in the context window? · Question](https://ionbin.com/wiki/questions/rag-or-full-context/)

### Sources

- [Lost in the Middle: How Language Models Use Long Contexts](https://arxiv.org/abs/2307.03172) · Liu et al., 2023reference accessed Oct 18, 2026

- [Context Rot: How Increasing Input Tokens Impacts LLM Performance](https://www.trychroma.com/research/context-rot) · Chroma (Hong, Troynikov, Huber), 2025-07-14reference accessed Oct 18, 2026

Practitioner views are restated in our words and labeled as views, not measured results. Product facts come from official sources dated above.

### Suggest an edit

IonBin's wiki isn't user-edited. Corrections go to our Directory Curator, who checks them against primary sources before anything changes. Spot something wrong or out of date on “Context rot”? Email us with a link to a primary source.

[Suggest an edit by email](mailto:contact@ionbin.com?subject=Suggest%20an%20edit%3A%20Context%20rot%20%5Bcontext-rot%5D&body=Page%3A%20https%3A%2F%2Fionbin.com%2Fwiki%2Fconcepts%2Fcontext-rot%2F%0AEntry%3A%20concepts%2Fcontext-rot%0A%0AWhat%20should%20change%3A%0A%0A%0APrimary%20source%20(link)%3A%0A) or write to [contact@ionbin.com](mailto:contact@ionbin.com)

Entry facts

**Type**: [Concepts & glossary](https://ionbin.com/wiki/concepts/)

**Status**: Reviewed

**Verified**: Oct 18, 2026

**Review by**: Apr 16, 2027 (every 180 days)

**Sources**: [0 official · 2 other](https://ionbin.com/wiki/concepts/context-rot/#sources)

The wiki carries no sponsored placements or affiliate links. [Editorial policy](https://ionbin.com/editorial-policy/).
