llama.cpp-omni
llama.cpp-omni is 💻 Technical Details. It is ranked #1502 on the Dev Radar, in AI dev tools, first seen 13 days ago and shared in 3 posts (11.8k views).
What llama.cpp-omni says about itself
Omni inference in C/C++. Contribute to tc-mb/llama.cpp-omni development by creating an account on GitHub.
llama.cpp-omni/docs/les/lookahead-expert-scheduling.md at master · tc-mb/llama.cpp-omni · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation Files Expand file tree master / lookahead-expert-scheduling.md Copy path Blame More file actions Blame More file actions Latest commit History History History 32 lines…
What people said about llama.cpp-omni on X
35B multimodal AI. Running locally on an iPhone. Now at over 20 tokens/sec. 🚀 MiniCPM-V 4.7 achieves 20.51 tokens/sec average decoding speed on iPhone 18 Pro Max (12GB) — a 6.07× speedup over the same device’s unoptimized SSD expert-loading baseline. ⚡ Behind the speed: Lookahead Expert Scheduling (LES), optimized…
— @OpenBMB, 10 days ago · 139 likes · see the post
📱 A 35B MoE model running on a phone at over 20 tokens/s. Meet Lookahead Expert Scheduling (LES), the inference technology behind MiniCPM-V 4.7’s efficient on-device performance. 🧠The challenge: 35B total parameters, 3B activated per token, and limited device memory. Keeping experts in flash storage makes the…
— @OpenBMB, 9 days ago · 60 likes · see the post
I was featured!! This is me showcasing Mini CPM-V 4.7 running on my iPhone 17 Pro Max.
— @aijoey, 13 days ago · 13 likes · see the post
Alternatives to llama.cpp-omni
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- Baseten — This session is our most in-demand yet. See you there
- project-maya — Checkout Maya
- deepinfer — You gotta love Deepseek. This is awesome stuff!
llama.cpp-omni in numbers
- Rank on the Dev Radar: #1502 of 8801
- Shared in 3 posts by 2 accounts: @OpenBMB, @aijoey
- 11.8k views on those posts
- First seen 13 days ago, last shared 9 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI dev tools
FAQ
What is llama.cpp-omni?
💻 Technical Details It was first shared on X 13 days ago and is ranked #1502 on the Dev Radar.
Is llama.cpp-omni free?
It is open source.
Who shared llama.cpp-omni?
2 accounts on X, including @OpenBMB, @aijoey, in 3 posts totalling 11.8k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 21:12 UTC. Full method.