Cache Engineering for Agents
In the authors' cost breakdown, KV cache reads account for 82.4% of total API cost for agents.
82.4%share of total API cost taken by KV cache reads in the authors' agent cost breakdown
Caching
Week 43 · 19-25 Oct
2 sources filed · EN 2
B A Understanding KV Residency in Production-Scale Agentic LLM Workloads
In Deep Research the application, not the person, issues 89% of model calls; median context grows from about 10K tokens to 68K by the 30th call.
~10K to 68Kmedian context tokens at the first call vs the 30th call in Deep Research
Week 42 · 12-18 Oct
2 sources filed · EN 2
B Why harnesses matter for energy (and token) efficiency
Uncached input ranged from 1.6% to 11.1% by client over 30 days.
1.6% to 11.1%uncached input share across agent clients, 8 September to 7 October 2026
A TurnCost: Turns, Not Observations: Cache-Aware Loop Engineering for Coding Agents
Median tool observations are 118-286 tokens.
7.1xaverage overstatement of loop cost under flat input pricing, assuming near-ideal caching