your gaming gpu can run a 27 billion parameter model at home, free, no account, nothing…
This is a dev post classified by Jev as Other (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
your gaming gpu can run a 27 billion parameter model at home, free, no account, nothing leaving the machine, and since tonight it runs at twice the speed it did yesterday. i went into the code that serves it, found the kernel leaving two thirds of the card's threads idle on the biggest matrices, fixed that, then grafted the draft head back on top. 25 tok/s stock, 50 tok/s now, on an rtx 3060, a card people bought to play games. it writes faster than you can read it, it holds a 262k context window, and it is a 7 gb download. 3060, 3070, 4060, 4070, 4080, 4090, 8gb and up, it is yours tonight
Posted by Sudo su (36.4k followers) 19 h ago · 192 likes · 19.9k views · view the original post on X. Kept by the Dev Radar as Other. Tools mentioned: ternary-bonsai-2-27b-ptq1_0-mtp-gguf.
More dev work like this
- Dev Ojha (@zkDragon) explains how Zakura is rebuilding Zcash infrastructure for scale: — @arjunkhemani
- Anthropic’s new Mythos class model SVG — @HarshithLucky3
- 1.0-release了，增加了mqtt控制。利用小爱音响系统内自带的MQTT… — @eastwoodnet
- 🔥腾讯混元 Hy-Image 3.5 Preview 正式上线！内部几百名设计师 GSB 盲测，直接对标一线生图模型！ — @NFT_Chen
- 很有意思的图啊，MiMo 是想一步一个脚印靠自己爬～ — @Fei2411
- Maps the world's infrastructure using data from OpenStreetMap. — @tom_doerr
- emergency services? … yes, I’d like to report a chart crime 🚔 — @theaaron
- So you like Bonsai, — @Mr_WestCoast
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 20.7k posts from 4.9k X accounts over the last 21 days, 2.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-22 08:21 UTC. Full method.