๐๐จ๐ฎ๐ซ ๐ข๐ง๐๐๐ซ๐๐ง๐๐ ๐ฌ๐ญ๐๐๐ค ๐ก๐๐ฌ ๐๐ฆ๐ง๐๐ฌ๐ข๐.
This is a dev post classified by Jev as Hosting & infra (a launch), kept by the Dev Radar because it carries real work, not commentary.
๐๐จ๐ฎ๐ซ ๐ข๐ง๐๐๐ซ๐๐ง๐๐ ๐ฌ๐ญ๐๐๐ค ๐ก๐๐ฌ ๐๐ฆ๐ง๐๐ฌ๐ข๐. Before a model can answer, it has to read your prompt, and that reading is most of the GPU work in the request. Almost every setup throws the result away the moment it sends the response, so the next request reads it all over again. Same system prompt, same retrieved documents, same conversation history. That discarded work is the KV cache. Today we're launching ๐๐๐ง๐ฌ๐จ๐ซ๐ฆ๐๐ฌ๐ก ๐๐ฅ๐๐ญ๐๐จ๐ซ๐ฆ, a KV cache that remembers. It tiers cached context across GPU memory, host RAM, and storage you already run, so when memory fills up or a pod restarts, state moves down a tier i
Posted by Tensormesh (340 followers) 4 days ago ยท 9 likes ยท 83.2k views ยท view the original post on X. Kept by the Dev Radar as Hosting & infra.
More dev work like this
- Last chance: 4 days left to get your ticket to @WeAreDevs! โ @Docker
- #MachineLearning with #AmazonSageMaker Cookbook! #BigData #Analytics #DataScience #AIโฆ โ @gp_pulipaka
- GSP644: Build a Serverless App with Cloud Run that Creats PDF Files ๐โ๏ธ โ @orbitofops
- One cluster. Multiple workloads. ๐ฅ โ @k8sAMD
- i need a usa vpn like 3 times per year so paying for any vpn monthly/annually doesntโฆ โ @thekitze
- The OpenInfra community in East Africa is expanding with the launch of the OpenInfraโฆ โ @openinfradev
- Kubernetes Pod Anti-Affinity for better replica distribution โ @twtayaan
- Just 3 days to go! The stage is set for #ApsaraConference2026. โ @alibaba_cloud
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 12.2k posts from 4.7k X accounts over the last 21 days, 1.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour โ last update 2026-09-19 18:06 UTC. Full method.