Custom inference engines are on the rise. Here's a new one.
This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
Custom inference engines are on the rise. Here's a new one. Pithos is a C inference engine for Liquid AI’s LFM models. The developer tested LFM2.5-24B-A2B Q4_K_M on 💻 Intel i5-10500H 🧠 16GB RAM 🎮 GTX 1650 Max-Q with 4GB VRAM Reported generation speed ⚙️ llama.cpp CUDA: 11.2–11.3 tps 🚀 Pithos: 17.5–21.9 tps The model doesn’t fit entirely in that GPU’s memory. Pithos keeps frequently used experts in VRAM, computes others on the CPU, and reads weights from disk when needed. It also includes chat, an OpenAI-compatible server and agent tools. These are developer-reported results from a speci
Posted by David Hendrickson (12.6k followers) 2 h ago · 7 likes · 588 views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- Give your agent web-data tools without wiring up each platform. — @DanKornas
- 🚨重磅！美团龙猫正式发布 LongCat-2.5 — @NFT_Chen
- TensorFold engine 1.2.1 is out. — @ashxhart
- 每天白送的 AI 额度，最容易被忘掉的反而是“签到”。 — @bkdgiffug
- 𝗛𝗲𝗿𝗺𝗲𝘀 Agent can turn a whole book into a skill. 📚🤯 — @BkashJosi
- Stop collecting random agent papers. Start with a research map. — @DanKornas
- DeepSeek just open-sourced a prototype that lets multiple AI coding agents work on… — @akshay81844
- Andrej Karpathy called YouTube "an enshittified wall of slop." — @heynavtoor
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.4k posts from 5k X accounts over the last 21 days, 9k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-02 05:02 UTC. Full method.