you can make any open source model behave like jev with just a bit of inference…
This is a dev post classified by Jev as AI dev tools (a tutorial), kept by the Dev Radar because it carries real work, not commentary.
you can make any open source model behave like jev with just a bit of inference engineering. it's shockingly easy. to prove it, we built a new endpoint we're calling deepseek-v4.1-flash-jev. see the demo below. here's how it's done: sglang (an inference engine) offers a scoring endpoint in addition to the normal generation one. in scoring mode, given an input & set of possible answers, it forces the model to produce probabilities for each one. example: > input: what is most common letter in abcccde? > possible answers: a, b, c > output: (c, 0.9), (b, 0.0.5), (a, 0.05) getting the above b
Posted by Nick Khami (17.7k followers) 10 h ago · 806 likes · 52k views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- Nimble is able to process images! — @madiator
- Your agent already solved this. Finding the session is the problem. — @DanKornas
- Trains your own large language model from scratch using plain PyTorch. — @tom_doerr
- gpt 5.6 terra = gpt 6 astra — @notjazii
- your rtx 3060 was running bonsai 2 at 26 tok/s this morning and now does 40 tok/s, i… — @sudoingX
- Turning a novel into a game is more than turning chapters into dialogue. — @DanKornas
- Meet DeepSeek-V4.1-Flash: a blazing fast image-text-to-text model. It takes both images… — @HuggingModels
- How to use Jev, and where it gives you the most advantage: — @0x_rody
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 12.2k posts from 4.7k X accounts over the last 21 days, 1.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:06 UTC. Full method.