Dev Radar
Support
LiveUpdated 2026-11-01 10:02 UTC

Flint 40B decodes a code prompt 1.3x faster than Qwen3.8-27B on one RTX 5090. With 8…

Flint 40B decodes a code prompt 1.3x faster than Qwen3.8-27B on one RTX 5090. With 8 requests at once the order flips.…

This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.

Flint 40B decodes a code prompt 1.3x faster than Qwen3.8-27B on one RTX 5090. With 8 requests at once the order flips. RTX 5090, Flint 40B on llama.cpp: Decode, code prompt: 224.8 tok/s Decode, prose prompt: 224.9 tok/s First token, 32K: 5.7 s 1 at once: 193.9 tok/s 2 at once: 198.6 tok/s 8 at once: 198.5 tok/s RTX 5090, Qwen3.8-27B on NInfer: Decode, code prompt: 169.0 tok/s Decode, prose prompt: 150.1 tok/s First token, 32K: 3.6 s 1 at once: 148.3 tok/s 2 at once: 274.5 tok/s 8 at once: 711.9 tok/s Flint's recipe runs 1 slot, so extra requests wait in line, while NInfer's own line runs 2

Posted by Niklas (2.4k followers) 2 h ago · 0 likes · 234 views · view the original post on X. Kept by the Dev Radar as AI dev tools.

More dev work like this

Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.3k posts from 5k X accounts over the last 21 days, 8.9k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-01 10:02 UTC. Full method.