Dev Radar
Support
LiveUpdated 2026-11-03 18:17 UTC

Flint 40B runs fully inside one 16 GB RTX 5060 Ti at 115.8 tok/s, about half the speed…

Flint 40B runs fully inside one 16 GB RTX 5060 Ti at 115.8 tok/s, about half the speed of my RTX 5090 RTX 5060 Ti, 16…

This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.

Flint 40B runs fully inside one 16 GB RTX 5060 Ti at 115.8 tok/s, about half the speed of my RTX 5090 RTX 5060 Ti, 16 GB Decode, code prompt: 116.0 tok/s Decode, prose prompt: 115.8 tok/s Decode, prose, 32K prompt filled: 90.7 tok/s First token at 32K: 15.6 s RTX 5090, 32 GB Decode, code prompt: 224.8 tok/s Decode, prose prompt: 224.9 tok/s First token at 32K: 5.7 s 5060 Ti: Unsloth UD-Q2_K_XL, 13.6 GB, 2.7 bpw, llama.cpp b11972, 64K context, 1 slot 5090: Recursive's NVFP4, 22.9 GB, llama.cpp b11803, 262,144 context, 1 slot, my run from Oct 22 Speed test, median of 2 runs, 512 tokens, tempe

Posted by Niklas (2.7k followers) 3 h ago · 9 likes · 532 views · view the original post on X. Kept by the Dev Radar as AI dev tools.

More dev work like this

Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.3k posts from 5k X accounts over the last 21 days, 9.2k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-03 18:17 UTC. Full method.