litellm
litellm is The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr.... It is ranked #729 on the Dev Radar, in Backend & APIs, first seen 32 days ago and shared in 16 posts (237.1k views).
GitHub - BerriAI/litellm: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository…
What people said about litellm on X
ANTHROPIC 🔥: Claude Fable 5.5 traces have been spotted in Azure configs. If this model drops today, it would be a new SOTA across many areas. Soon? 👀
— @testingcatalog, 17 days ago · 1.6k likes · see the post
Fable 5.5 has appeared in Azure’s model API, according to LiteLLM. Following the strong performance of Meta Muse Wonder Full and the upcoming Gemini 4, everything is probably being prepared for Anthropic's IPO and subsequent rollout.
— @kimmonismus, 17 days ago · 1.4k likes · see the post
Fable 5.5 showing up in Azure’s East US 2 catalog with a GenerallyAvailable status ! However one thing I’m seeing is people thinking that the note of 1M context window, 128K max output, and $10/$50 per million token pricing is what it will be for Fable 5.5 in LiteLLM it’s inherited from Fable 5.1, so those aren’t…
— @ChrisGPT, 17 days ago · 314 likes · see the post
Alternatives to litellm
- Kimi API Platform — Kimi API Platform, providing the 2.8-trillion-parameter Kimi K3 large language model API with a 1M-token context…
- OrcaRouter — Cyber Tier API
- Particle — Particle is building a new AI inference layer for open weight models—fast, low-cost, and reliable. Use our API to…
- treg.to — $0.20 per candidate is actually crazy. >
- opencommerce — today we are announcing openrouter for commerce
- context.dev — came out #1 (by a lot)
litellm in numbers
- Rank on the Dev Radar: #729 of 8798
- Shared in 16 posts by 16 accounts: @testingcatalog, @kimmonismus, @ChrisGPT, @Angaisb_
- 237.1k views on those posts
- First seen 32 days ago, last shared 17 days ago
- Pricing seen by AGK Intelligence: open source
- Market: Backend & APIs
FAQ
What is litellm?
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr... It was first shared on X 32 days ago and is ranked #729 on the Dev Radar.
Is litellm free?
It is open source.
Who shared litellm?
16 accounts on X, including @testingcatalog, @kimmonismus, @ChrisGPT, in 16 posts totalling 237.1k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 20:27 UTC. Full method.