optillm
optillm is Optimizing inference proxy for LLMs. Contribute to algorithmicsuperintelligence/optillm development by creating an account on GitHub.. It is ranked #505 on the Dev Radar, in AI dev tools, first seen 2 days ago and shared in 1 post (386 views).
GitHub - algorithmicsuperintelligence/optillm: Optimizing inference proxy for LLMs · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} algorithmicsuperintelligence / optillm Public Notifications You must be signed in to change notification settings Fork 388 Star 4.3k <div class="OverviewContent-mo
What people said about optillm on X
OptiLLM is an OpenAI-compatible inference proxy that adds test-time compute without retraining the model. Instead of sending a prompt through one ordinary generation pass, it can wrap the call with 20+ reasoning strategies such as Best-of-N, Mixture of Agents, MCTS, PlanSearch, self-consistency, reflection, Z3…
— @agenticgirl, 2 days ago · 6 likes · see the post
Alternatives to optillm
- muse.ai — New connectors are live today. Come build with us.
- classifier.dev — now outperforms jev and is free
- mimo-v2.6 RL — Streaming the run
- academy.dair.ai — Chat with Paper
- Union Alpha — Union Alpha is a multimodal model built for research, coding, and agentic workflows, while delivering frontier-level…
- cua — Draft #3943
optillm in numbers
- Rank on the Dev Radar: #505 of 1353
- Shared in 1 post by 1 account: @agenticgirl
- 386 views on those posts
- First seen 2 days ago, last shared 2 days ago
- Pricing seen by Jev: open source
- Market: AI dev tools
FAQ
What is optillm?
Optimizing inference proxy for LLMs. Contribute to algorithmicsuperintelligence/optillm development by creating an account on GitHub. It was first shared on X 2 days ago and is ranked #505 on the Dev Radar.
Is optillm free?
It is open source.
Who shared optillm?
1 account on X, including @agenticgirl, in 1 post totalling 386 views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 12.2k posts from 4.7k X accounts over the last 21 days, 1.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:06 UTC. Full method.