uzu
uzu is A high-performance inference engine for AI models. Contribute to trymirai/uzu development by creating an account on GitHub.. It is ranked #119 on the Dev Radar, in AI dev tools, first seen 21 days ago and shared in 5 posts (63.3k views).
GitHub - trymirai/uzu: A high-performance inference engine for AI models · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation…
What people said about uzu on X
Big win for local LLM inference! This new inference engine runs LLMs 4x faster than llama.cpp: I ran Qwen3.5 9B on a base M5 MacBook Pro with three engines: - llama.cpp: 22.0 tokens/s - MLX: 25.1 tokens/s - uzu: 92.1 tokens/s The video below shows all three runs side by side. The first two numbers don't mean…
— @_avichawla, 3 days ago · 562 likes · see the post
Before buying more hardware for local AI, check the engine. Avi's Qwen3.5 9B test on a base M5 MacBook: llama.cpp: 22 tok/s MLX: 25.1 uzu: 92.1 uzu uses its own checkpoint and speculative decoding here. Same laptop though 🤯
— @ashxhart, 3 days ago · 176 likes · see the post
Gosh almighty, this local rust based inference engine absolutely rips! Uzu. https://github.com/trymirai/uzu
— @Dan_Jeffries1, 18 days ago · 115 likes · see the post
Alternatives to uzu
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- Baseten — This session is our most in-demand yet. See you there
- project-maya — Checkout Maya
- deepinfer — You gotta love Deepseek. This is awesome stuff!
uzu in numbers
- Rank on the Dev Radar: #119 of 8798
- Shared in 5 posts by 5 accounts: @_avichawla, @ashxhart, @Dan_Jeffries1, @NFT_Chen
- 63.3k views on those posts
- First seen 21 days ago, last shared 2 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI dev tools
FAQ
What is uzu?
A high-performance inference engine for AI models. Contribute to trymirai/uzu development by creating an account on GitHub. It was first shared on X 21 days ago and is ranked #119 on the Dev Radar.
Is uzu free?
It is open source.
Who shared uzu?
5 accounts on X, including @_avichawla, @ashxhart, @Dan_Jeffries1, in 5 posts totalling 63.3k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 20:22 UTC. Full method.