Kinference
Kinference is Kinference turns any GPU-enabled Kubernetes cluster into a fully-featured inference platform, with token rate limits, routing policies, cache-aware load …. It is ranked #978 on the Dev Radar, in Hosting & infra, first seen 1 h ago and shared in 1 post (50 views).
Kinference The inference control plane for Kubernetes and vLLM Kinference [kay-inference] turns Kubernetes and vLLM into a fully-featured distributed inference platform, with token rate limits, routing policies, cache-aware load balancing, and everything else needed to serve multiple models, tenants, and SLOs. Get started → Talk to us Solve routing, limiting, and balancing in one layer Scalable inference across multiple workers requires routing, rate limiting, load balancing, and more. Kinference provides a unified layer that plugs into any existing vLLM deployment and combines these capabilities in a principled manner. Build a scalable…
What people said about Kinference on X
Today we launched Kinference, a new open source project I've been working on for building scalable inference platforms on top of @vllm_project. Self-hosted inference is such a fascinating and crazy space and I did not really expect to ship a project here, but this is probably the most excited I've felt about anything…
— @wm, 1 h ago · 2 likes · see the post
Alternatives to Kinference
- boat — omfg @theo just released a video that talks about
- NVIDIA Technical Blog — Announced at GTC Berlin
- Model catalog — Evaluate it on your workload
- vllm-ascend — What this PR does / why we need it? Add the Hy4 W8A8-MXFP8 deployment guide for Ascend 950DT, covering single-node,…
- Alchemy — Run Kimi, GLM and DeepSeek models on Alchemy Inference. Low latency, high throughput and zero data retention. Sign up…
- Vercel — Diagnose Vercel CLI setup problems with vercel doctor. It checks your CLI version, login, team, project link, and…
Kinference in numbers
- Rank on the Dev Radar: #978 of 9303
- Shared in 1 post by 1 account: @wm
- 50 views on those posts
- First seen 1 h ago, last shared 1 h ago
- Pricing seen by AGK Intelligence: open source
- Market: Hosting & infra
FAQ
What is Kinference?
Kinference turns any GPU-enabled Kubernetes cluster into a fully-featured inference platform, with token rate limits, routing policies, cache-aware load … It was first shared on X 1 h ago and is ranked #978 on the Dev Radar.
Is Kinference free?
It is open source.
Who shared Kinference?
1 account on X, including @wm, in 1 post totalling 50 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.4k posts from 5k X accounts over the last 21 days, 9.3k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-04 22:20 UTC. Full method.