what we learned to keep coding agents fast in Claude Code, Codex, Pi, and more:
– a single timestamp in the system prompt can break the cache
– changing reasoning effort can wipe the whole cache
– telling the agent its output was cut off will get it to read what it missed
coding agents resend the whole conversation on every turn. prefix caching keeps long sessions fast, but only if the harness and the inference engine both do their part.
@zainhas from Together and @parthsareen from @ollama wrote down what each side needs to get right.


