LLM Agent Cost Optimization

Prompt caching cuts agent API costs 41-80%, but only if tool results stay out of the cache

An arXiv evaluation across OpenAI, Anthropic and Google reports that naive full-context caching can raise latency, while excluding dynamic tool results gives more consistent gains.