Introducing JetSpec++: we find causal parallel drafting paired with hidden states…
This is a dev post classified by AGK Intelligence as AI dev tools (a launch), kept by the Dev Radar because it carries real work, not commentary.
Introducing JetSpec++: we find causal parallel drafting paired with hidden states predictor and anchor token decoder can effectively draft the next future block before the current one is verified, and spending the freed time on self refinement. This allows drafting to be pipelined with verification, hiding almost all of its drafting cost. JetSpec++ reaches up to 1.54x end-to-end speedup over DSpark and 7.45x over autoregressive decoding while keeping lossless, at 1,361 TPS on Qwen3-8B and 367 TPS on Qwen3.8-27B in BF16. With NVFP4 and kernel optimizations, JetSpec++ further reaches over 4,0
Posted by Hao AI Lab (9k followers) 2 h ago · 51 likes · 3.6k views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: jetspec-project.github.io.
More dev work like this
- Rust port of pi, a minimal coding-agent harness: single native binary with full… — @rustaceans_rs
- 🤯天呐！Pi 和 Claude Code 用户狂喜！工具Token调用狂砍 40%！LiquidAI LFM2.5-24B-A2B + HF 专属 LoRA 适配器来了！ — @NFT_Chen
- Mistral Large 4, aka Le Chonk, is now live on llama.cpp (a 1T-parameter model). — @TeksEdge
- 🎃Dario给中国人民带来的极致恐怖从Claude无情封号开始 — @NFT_Chen
- Mia's Qwen3.8-Flash-Next recipe on a DGX Spark: one command, first try, 2 min to the… — @niklaslenz_ai
- Meet Audio8-TTS-Realistic-0.6b: a 0.6B text-to-speech model that clones voices from just… — @HuggingModels
- We're happy to announce our Ruby sponsor: @Superconductor, the multiplayer AI workspace… — @sfrubyconf
- THIS IS ABSOLUTE F*CKING GOLD — @marfinxx
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 21:12 UTC. Full method.