💥牛了!将任意 LLM 秒变 Jev 模型实现本地化决策引擎!


This is a dev post classified by Jev as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
💥牛了!将任意 LLM 秒变 Jev 模型实现本地化决策引擎! LLM2Jev 把 Jev 同一套 Choice / Score / Noul 搬到本地:现成 HuggingFace 因果模型,不调云、不买商业 API。 关键亮点 🔹运行时定义题型,直接拿带概率的类型化答案 🔹Prefill-only,不算自回归,输出稳、好批量 🔹对接 Transformers / SGLang,适合私有数据和高并发 操作步骤 1️⃣git clone https://github.com/Yinsongxu/LLM2Jev.git 2️⃣uv sync --extra sglang(或 transformers) 3️⃣写 JevRequest:state + Choice / Score / Noul 4️⃣LLM2Jev(...).evaluate(request) 拿概率结果 5️⃣要服务就 llm2jev-serve,打 /v1/systemone 仓库:https://github.com/Yinsongxu/LLM2Jev #LLM2Jev #Jev #SystemOne #本地LLM #结构化决策 #开源AI #SGLang
Posted by SuSu_酥酥👅 (15.6k followers) 19 h ago · 293 likes · 64.5k views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: llm2jev.git, llm2jev, openjev-vision.git, openjev-vision.
More dev work like this
- 架构设计: — @mylifcc
- Multi-agent prototypes stall when orchestration becomes the project. — @DanKornas
- Rebuilding a site you own shouldn’t mean starting from a blank Next.js app. — @DanKornas
- NVIDIA wants coding agents to stop wasting tokens on repeated work. — @agenticgirl
- Runs 69 product management skills and 42 workflows in Claude Code and Cowork. — @tom_doerr
- Zai bros just opensourced their ZCode harness 🔥🔥 — @zainhas
- Your AI agents keep rediscovering work. This repo gives them a shared folder. — @DanKornas
- We made an easy image loader for Qwen Image 2.1. Now you can generate your images on the… — @Blackfrost_AI
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 17.6k posts from 4.9k X accounts over the last 21 days, 2k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-21 02:20 UTC. Full method.