Can short-context compaction match long-context agent accuracy with lower real-world serving costs?
The November 3 arXiv technical report 'You don't need long context' describes a compaction strategy under which selected frontier open-weight models maintained much of their performance across reported tasks. The authors estimate later tokens can be as much as seven times costlier than earlier tokens under their studied serving assumptions. The experiment includes long-horizon software engineering tasks.
What the primary sources establish
The November 3 arXiv technical report 'You don't need long context' describes a compaction strategy under which selected frontier open-weight models maintained much of their performance across reported tasks. The authors estimate later tokens can be as much as seven times costlier than earlier tokens under their studied serving assumptions. The experiment includes long-horizon software engineering tasks.
What cannot yet be concluded
Evidence limit: The sevenfold figure is an upper-bound cost comparison in a particular compute model, not a universally measured API bill reduction. Task selection, model architecture, inference configuration and compaction strategy may affect conclusions. The report is not an independently replicated cost study.
Category: independent replication. A reported benchmark or demonstration is not independent reproduction or real-world validation.
Dated evidence history
Authors report selected short-context task performance and up-to-sevenfold later-token cost effects.
Independent provider-level cost and accuracy replication outstanding.
Inspect the primary sources
Original publisher rights are retained. URLs are source attributions, not third-party audits of each claim.
Trace what happens next
The Evidence Graph timeline connects this new case to its original sources, topic and any corresponding Cortist article. Future material changes require a new dated version, not edits to this baseline.