tiny-llm
tiny-llm is learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen - skyzh/tiny-llm. It is ranked #193 on the Dev Radar, in AI dev tools, first seen 1 days ago and shared in 1 post (56.1k views).
GitHub - skyzh/tiny-llm: learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation tiny-llm Public Notifications You must be signed in to change notification settings Fork 411 ( 411 ) Star 4.8k ( 4.8k ) You must be signed in to star a…
What people said about tiny-llm on X
Someone turned the hardest parts of LLM inference engineering into a course where you have to fix the performance problems yourself. And you can do it on a Mac. The project is called tiny-llm, an open-source course for building a miniature vLLM-style inference engine around Qwen3. It starts with a simple…
— @techNmak, 1 days ago · 1.5k likes · see the post
Alternatives to tiny-llm
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- project-maya — Checkout Maya
- Baseten — This session is our most in-demand yet. See you there
- unsloth.ai — Guide and Notebooks
tiny-llm in numbers
- Rank on the Dev Radar: #193 of 8810
- Shared in 1 post by 1 account: @techNmak
- 56.1k views on those posts
- First seen 1 days ago, last shared 1 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI dev tools
FAQ
What is tiny-llm?
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen - skyzh/tiny-llm It was first shared on X 1 days ago and is ranked #193 on the Dev Radar.
Is tiny-llm free?
It is open source.
Who shared tiny-llm?
1 account on X, including @techNmak, in 1 post totalling 56.1k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 22:12 UTC. Full method.