IonBin
All pages
Search
Concept

Context rot

Context rot describes less reliable model performance as inputs grow, particularly when useful information competes with distractors. Research has demonstrated length and position effects in specific models and tasks. Relevant context and task-specific testing can help; there is no universal token threshold or guaranteed fix.

Verified Oct 18, 2026 Review by Apr 16, 2027 2 sources

What it is

Longer context can add useful evidence, but it can also add distractors or conflicting instructions. The effect depends on the task, model and arrangement of the input.

How it works

  • Lost in the Middle (Liu et al., 2023) found that performance was often highest when the relevant information was at the beginning or end of the input, and dropped significantly when it was in the middle. That held even for long-context models.
  • Chroma’s July 2025 technical report tested 18 models, including GPT-4.1, Claude 4, Gemini 2.5 and Qwen3. It found performance grew increasingly unreliable as input length increased, even on simple tasks, and that how information is presented matters as much as whether it’s there. Chroma sells a vector database, so weigh that interest.

Benefits

  • A possible quality improvement without changing models. Measure the result on representative tasks.
  • Lower cost. Less irrelevant input means fewer billed tokens.

Limits and risks

  • Relevant and non-redundant helps. Irrelevant and contradictory hurts. Curate the context and put the key instruction and facts at the start or end.
  • Summaries can lose facts. IonBin recommends preserving decisions and source references before compacting or starting a fresh conversation (see agent memory). Test that essential constraints survive.
  • Evidence date. The 2025 report covers newer long-context models, but neither study tested every current model, so test yours on your own material.

Best-fit stacks

Agent compatibility

Not tool-specific. See Agent-ready for connector support by tool.

Levels come from each tool's recorded, sourced compatibility. How the levels work.

Sources

  1. Lost in the Middle: How Language Models Use Long Contexts · Liu et al., 2023reference accessed Oct 18, 2026
  2. Context Rot: How Increasing Input Tokens Impacts LLM Performance · Chroma (Hong, Troynikov, Huber), 2025-07-14reference accessed Oct 18, 2026

Practitioner views are restated in our words and labeled as views, not measured results. Product facts come from official sources dated above.

Suggest an edit

IonBin's wiki isn't user-edited. Corrections go to our Directory Curator, who checks them against primary sources before anything changes. Spot something wrong or out of date on “Context rot”? Email us with a link to a primary source.

Suggest an edit by email or write to contact@ionbin.com