Have you ever had a local coding agent flying at the start of a session and crawling an…
This is a dev post classified by Jev as AI dev tools (a tutorial), kept by the Dev Radar because it carries real work, not commentary.
Have you ever had a local coding agent flying at the start of a session and crawling an hour later? It's not heat or RAM but the KV cache. The agent appends everything to the context every turn: files, tool outputs, all of it. The server caches that prefix, so normally only the new tokens get processed. But when something early in the chat changes (e.g. the agent trims old tool outputs) or the request lands on a different cache slot, that cache is useless. It rereads the whole conversation from scratch. With 200k+ tokens that can be a ~2 minutes read before it even starts replying. How to
Posted by Javier • priv/acc (4.4k followers) 1 h ago · 4 likes · 210 views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- Did you know @DevinAI can test your changes inside the app and send you a recording? — @markfenner
- Try more shots with Seedance 2.5 Draft Mode. — @BytePlusGlobal
- Google ha publicado AX, un orquestador de agentes de IA programado en Go. — @midudev
- 君の名は。— Your Name, but by Opus 5.5 🔥 — @mrfanduu
- 🚨 THIS IS WHAT A “SECOND BRAIN” FOR AI AGENTS LOOKS LIKE. — @hrswatigupta
- Bring CUDA-accelerated transport to existing ROS 2 nodes with an AI coding agent. ⚡ — @NVIDIARobotics
- OMG Opus 5.5 just made this — @notjazii
- InclusionAI just open sourced a design model that can create a finished graphic, and a… — @aijoey
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 22.5k posts from 5k X accounts over the last 21 days, 2.6k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-23 13:29 UTC. Full method.