nexrt
nexrt is Ultra-low-latency autoregressive decoding engine using whole-step CUDA graph replay - nex-agi/NexRT. It is ranked #2772 on the Dev Radar, in AI dev tools, first seen 20 days ago and shared in 2 posts (8.9k views).
GitHub - nex-agi/NexRT: Ultra-low-latency autoregressive decoding engine using whole-step CUDA graph replay · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation NexRT Public Notifications You must be signed in to change notification settings Fork 0 ( 0 ) Star 0 ( 0 ) You must be signed in to star a repository…
What people said about nexrt on X
Congrats to the @NexEcosystem on launching NexRT! SGLang runs prefill and NexRT takes over decode for low-latency single-request inference on Nex-N2.5-Pro. - The two engines share routed MoE weights - DFlash builds on target feature capture in SGLang v0.5.15 Try NexRT with SGLang: https://github.com/nex-agi/NexRT
— @sgl_project, 20 days ago · 41 likes · see the post
⚡ Meet NexRT, the low-latency decode engine behind Nex-N2.5. 💡 Built for single-request inference on Nex-N2.5-Pro. • 1,000+ tokens/s at 8K context on 8×H100 with DFlash* • Standard decoding, MTP and DFlash • Context parallelism for long contexts, up to 256K SGLang handles prefill; NexRT handles decode. The two…
— @NexEcosystem, 20 days ago · 38 likes · see the post
Alternatives to nexrt
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- Baseten — This session is our most in-demand yet. See you there
- project-maya — Checkout Maya
- deepinfer — You gotta love Deepseek. This is awesome stuff!
nexrt in numbers
- Rank on the Dev Radar: #2772 of 8801
- Shared in 2 posts by 2 accounts: @sgl_project, @NexEcosystem
- 8.9k views on those posts
- First seen 20 days ago, last shared 20 days ago
- Pricing seen by AGK Intelligence: open source
- Market: AI dev tools
FAQ
What is nexrt?
Ultra-low-latency autoregressive decoding engine using whole-step CUDA graph replay - nex-agi/NexRT It was first shared on X 20 days ago and is ranked #2772 on the Dev Radar.
Is nexrt free?
It is open source.
Who shared nexrt?
2 accounts on X, including @sgl_project, @NexEcosystem, in 2 posts totalling 8.9k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 21:12 UTC. Full method.