Bonsai 2 27B Mac recipe: Studio & Mini
This is a dev post classified by Jev as Other (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
Bonsai 2 27B Mac recipe: Studio & Mini PrismML's ternary quant of Qwen3.8-27B, 1.72 bits/weight. Measured today, same harness as my full-size Qwen3.8-27B recipe: Mac Studio M4 Max 128 GB • 34.5 tok/s prose, 34.3 code, 242 tok/s prefill • Spark Bench 82.4/100, grade B Mac mini M4 24 GB (base, 10-core GPU) • 11.0 tok/s decode, 33 tok/s prefill • Same score trajectory as the Studio The 3.1× decode gap is exactly the memory-bandwidth ratio. Full Qwen3.8-27B on the Studio does 53/72 tok/s at ~90 TrueScore in 17 GB, so Bonsai is ~65% of the speed, ~90% of the score, 42% of the size. Recipe + r
Posted by Wësche (2.9k followers) 1 days ago · 28 likes · 2k views · view the original post on X. Kept by the Dev Radar as Other. Tools mentioned: bonsai-2-27b-mac.
More dev work like this
- You can run locally Uncensored Ternary Bonsai 2-27B Same 5.9GB file. — @0x0SojalSec
- dear rtx 3060 owners, and every 12gb card behind it. bonsai 2 27b dense went from 26 to… — @sudoingX
- Nice: banked codex reset for all of us. — @kimmonismus
- Convolutional Neural Networks. #BigData #Analytics #DataScience #AI #MachineLearning… — @gp_pulipaka
- Reinforcement Learning and Optimal Control! #BigData #Analytics #DataScience #AI… — @gp_pulipaka
- The #Mathematical #Programming - #FPGA. #BigData #Analytics #DataScience #AI… — @gp_pulipaka
- A Constraint Based Approach, ML. #BigData #Analytics #DataScience #AI #MachineLearning… — @gp_pulipaka
- FBX対応も問題無さそう — @koguGameDev
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 14.4k posts from 4.7k X accounts over the last 21 days, 1.6k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 21:10 UTC. Full method.