💥疯了!2.78万亿参数的Kimi K3,仅需8.24GB内存就能在普通电脑上本地跑通!



This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
💥疯了!2.78万亿参数的Kimi K3,仅需8.24GB内存就能在普通电脑上本地跑通! 纯C99引擎,无GPU、无BLAS、无任何重框架,176KB二进制,MoE架构+磁盘流式加载,让万亿级模型真正“民主化”,普通笔记本也能跑完整模型,输出与官方一致! 核心亮点 🔹峰值内存仅8.24GB(laptop预设),磁盘需约1.56TB权重 🔹纯CPU推理,支持Linux/macOS/Windows • 内存越大越快:8GB约26-33s/token,128GB+可到5.6s/token 🔹输出字节级一致,更多内存只换速度不换答案 📌 关键上手步骤 1️⃣克隆仓库:git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git && cd kimi-k3-in-c 2️⃣检查环境:./scripts/k3-doctor.sh(自动检测CPU/内存/磁盘) 3️⃣编译测试:make -j && make test(无需模型,1分钟内完成) 4️⃣下载模型(需HF Token):export HF_TOKEN=你的token && ./scripts/download-model.sh ~/k3model 5️⃣打包主干:./scripts/pack-trunk.sh ~/k3model ~/k3trunk 6️⃣
Posted by SuSu_酥酥👅 (27.1k followers) 1 h ago · 21 likes · 3.1k views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: kimi-k3-in-c.git, kimi-k3-in-c, NVIDIA NIM.
More dev work like this
- Build an AI Discord bot without wiring every server feature from scratch. — @DanKornas
- new stealth model has appeared — @notjazii
- Lookout 4.0 is out. It lines up my Claude Code, Codex, Grok and Kimi windows in Warp or… — @kevintheo
- 🤩牛逼!Qwen3.8-Flash-Next 性能再次突破,Mac 提速 31%,Strix Halo Windows 翻倍,低显存几乎 3 倍! — @NFT_Chen
- just got my test order and was delightfully surprised to find that this client is open… — @swyx
- New update of Strata is out! 👀 — @coldniko
- Use a second Antigravity Pro account in Paseo—without replacing the built-in provider. — @DanKornas
- I set up multiple grokbots with their own Mnemos identities, and every morning I get… — @RileyRalmuto
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.9k posts from 5k X accounts over the last 21 days, 9.6k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 10:42 UTC. Full method.