Dev Radar
Support
LiveUpdated 2026-09-21 06:12 UTC

微调自己的 LLM,最烦的往往不是训练,而是配环境。

微调自己的 LLM,最烦的往往不是训练,而是配环境。 Soup 直接把流程压成三步: pip install "soup-cli[train]" soup init --template chat soup train 一个 YAML…

This is a dev post classified by Jev as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.

微调自己的 LLM,最烦的往往不是训练,而是配环境。 Soup 直接把流程压成三步: pip install "soup-cli[train]" soup init --template chat soup train 一个 YAML 管完训练配置,聊天、代码、工具调用、推理、视觉、RLHF 等模板也都有。 更狠的是低显存方案:4GB 显存也能微调 8B 模型,通过 layer streaming 把冻结参数逐层送进 GPU,峰值约 3.32GB,官方测试最高约 119 tokens/s。 训练完还能导出 GGUF,直接丢进 Ollama,也能上传 HuggingFace。 🔗 https://github.com/MakazhanAlpamys/Soup

Posted by lumxss (24.7k followers) 2 h ago · 1 likes · 374 views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: soup.

More dev work like this

Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 18.9k posts from 4.9k X accounts over the last 21 days, 2.1k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-21 06:12 UTC. Full method.