Note that to benchmark Qwen 3.8 27b (and its quantizations such as Bonsai 2 27b) more…
This is a dev post classified by Jev as AI dev tools (a tutorial), kept by the Dev Radar because it carries real work, not commentary.
Note that to benchmark Qwen 3.8 27b (and its quantizations such as Bonsai 2 27b) more fairly, you might need to build some custom harness features, mainly to work around the overthinking issue E.g. inject </think> when the 16k token budget is spent and continue generation In my runs on vanilla pi, model fails some tasks because it finishes its thinking budget and the session just dies with stopReason: length I am building support in my osolmaz/localpi pi distribution so that the harness can recover from such issues automatically, and other potential issues with small models such as looping.
Posted by Onur Solmaz (10.1k followers) 1 h ago · 7 likes · 522 views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- 🚨 3D Games With Opus 5.5 On The Abacus AI Supercomputer — @bindureddy
- AI Engineer Shanghai | Nov 5-6, 2026 — @aiDotEngineer
- 🎉 More ways to create with Hy Image3.5 preview — @tencentcloud
- Claude Opus 5.5 drew each frame of this animation in JavaScript. Here's "how browsers… — @addyosmani
- Most teams rush to build AI agents before asking the most important question: — @AiswaryaVenkit1
- If your agent can touch real systems, random governance reading won’t cut it. — @DanKornas
- damn, GitHub has an absurd amount of free projects. — @kyronis_talks
- This is Space Bunny. A new stealth model in @Opencode. — @superalesha
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 23.3k posts from 5k X accounts over the last 21 days, 2.7k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-24 06:46 UTC. Full method.