airllm
airllm is Runs 405B LLMs on 8GB VRAM. Contribute to 0xSojalSec/airllm development by creating an account on GitHub.. It is ranked #1918 on the Dev Radar, in AI dev tools, first seen 8 days ago and shared in 1 post (14.7k views).
GitHub - 0xSojalSec/airllm: Runs 405B LLMs on 8GB VRAM · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation airllm Public forked from lyogavin / airllm Notifications You must be signed in to change notification settings Fork 239 ( 239 ) Star 3.1k ( 3.1k ) You must be signed in to star a repository About Runs…
What people said about airllm on X
4GB显存跑70B大模型，这事还真被AirLLM办成了。 它玩的招叫分层推理：不把整个模型一股脑塞进显存，而是一层一层往里加载，算完一层就甩掉，硬是把巨无霸塞进小破卡。 更骚的是100%开源，白蹭警告。 🔗 https://github.com/0xSojalSec/airllm
— @bkdgiffug, 8 days ago · 199 likes · see the post
Alternatives to airllm
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- Baseten — This session is our most in-demand yet. See you there
- project-maya — Checkout Maya
- deepinfer — You gotta love Deepseek. This is awesome stuff!
airllm in numbers
- Rank on the Dev Radar: #1918 of 8798
- Shared in 1 post by 1 account: @bkdgiffug
- 14.7k views on those posts
- First seen 8 days ago, last shared 8 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI dev tools
FAQ
What is airllm?
Runs 405B LLMs on 8GB VRAM. Contribute to 0xSojalSec/airllm development by creating an account on GitHub. It was first shared on X 8 days ago and is ranked #1918 on the Dev Radar.
Is airllm free?
It is open source.
Who shared airllm?
1 account on X, including @bkdgiffug, in 1 post totalling 14.7k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 20:27 UTC. Full method.