⚠️Did Microsoft just MOG llama.cpp?
This is a dev post classified by AGK Intelligence as AI dev tools (a launch), kept by the Dev Radar because it carries real work, not commentary.
⚠️Did Microsoft just MOG llama.cpp? It dropped a local inference bombshell. Qwen3.8-27B running at 266 tps on a 1x RTX 5090. ... and at 260K cx, still 187 tps. Microsoft's Foundry Local is challenging llama.cpp in a big way. 🇺🇸 Using the same 27B model at 4-bit, Microsoft's reported RTX 5090 results Context → Foundry / llama.cpp ⚡ 4K → 265.8 / 150.6 tps ⚡ 16K → 260.2 / 164.5 tps ⚡ 32K → 234.3 / 151.7 tps ⚡ 65K → 200.4 / 146.9 tps ⚡ 131K → 212.4 / 109.7 tps ⚡ 260K → 187.2 / 96.1 tps That's almost 2× faster at 260K context. And on the NVIDIA DGX Spark? At 260K context 🔵 Foundry Local →
Posted by David Hendrickson (12.7k followers) 1 h ago · 30 likes · 1.7k views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- 🚨 STOP INSTALLING MOVING TARGETS INTO HERMES AGENT. 🪽 — @tonysimons
- TensorFold 1.2.3 is out. 🚀 — @ashxhart
- Hello, XLA Serving Engine! 👋 — @Arm
- 这款翻译工具被不少人直接封神，如今总算开源了！ — @bkdgiffug
- NEAR co-founder Illia Polosukhin opens a public contest to improve AI models — @BSCNews
- Agentic AI For Platform Engineering: Rethinking Developer Platforms With Agentic AI,… — @gp_pulipaka
- Agentic Architectural Patterns for Building Multi-Agent Systems: Proven Design Patterns… — @gp_pulipaka
- SGD and #DeepLearning Optimizers! #BigData #Analytics #DataScience #AI #MachineLearning… — @gp_pulipaka
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.7k posts from 5k X accounts over the last 21 days, 9.4k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-05 21:43 UTC. Full method.