open-infra
open-infra is Harvard MadSys Lab project and part of FreeInference. GPU, SGLang, and vLLM infrastructure dashboard.. It is ranked #1837 on the Dev Radar, in Hosting & infra, first seen 14 days ago and shared in 1 post (1.3k views).
Visit openinfra.freeinference.org
open-infra | agentic-system.org | Harvard MaDSys Group open-infra agentic-system.org · Harvard MaDSys Group connecting — cached 5m Refresh Export Served Requests and tokens delivered · last hour and last 24 hours Host CPU and system memory CPU util % load1 Host RAM used GB GPU SM, memory, power, and interconnect GPU SM util % GPU VRAM used % GPU memory bandwidth util % GPU power watts GPU temp °C GPU clocks SM MHz DCGM tensor pipe active % DCGM DRAM HBM active % DCGM NVLink TX RX GB/s DCGM PCIe TX RX GB/s GPU fleet Engine SGLang and vLLM serving Requests running queued Requests / min completed KV cache fill % Cache hit hit % Total…
What people said about open-infra on X
FreeInference serves 400 billion tokens/month and 100+ agents. And now, a window into the infrastructure behind it. We are building four open initiatives around agentic systems: open-source, free LLM API service, open infrastructure, and open data. Today, we are launching the open-infrastructure component:…
— @1a1a11a, 14 days ago · 17 likes · see the post
Alternatives to open-infra
- boat by ASCII — ascii box is now boat ( )
- mimo-v2.6-flash-2x-dgx-spark — It's Ready For 2 x DGX Sparks
- Railway — Bring context from your work and personal accounts into the same conversation. Connect your accounts in the plugin…
- qwen3.8-flash-next-exl3-dgx-spark-recipe — Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with vLLM + vllm-exl3 -…
- GitLab — GitLab brings the context, guardrails, and visibility agents need to ship safely at their own speed. See how
- ax — 🥳 Excited to start revealing what we've been working on in the last few months. First, we decided to reinvent…
open-infra in numbers
- Rank on the Dev Radar: #1837 of 2352
- Shared in 1 post by 1 account: @1a1a11a
- 1.3k views on those posts
- First seen 14 days ago, last shared 14 days ago
- Pricing seen by Jev: free
- Market: Hosting & infra
FAQ
What is open-infra?
Harvard MadSys Lab project and part of FreeInference. GPU, SGLang, and vLLM infrastructure dashboard. It was first shared on X 14 days ago and is ranked #1837 on the Dev Radar.
Is open-infra free?
Yes, it is free to use.
Who shared open-infra?
1 account on X, including @1a1a11a, in 1 post totalling 1.3k views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 20.7k posts from 4.9k X accounts over the last 21 days, 2.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-22 08:21 UTC. Full method.