llama-rpc-rdma
llama-rpc-rdma is Ready-to-use client: Llama-RPC-RDMA — a llama.cpp fork whose RPC backend speaks RDMA natively. Auto-negotiates RDMA vs TCP on the same -rpc CLI. That's what mov. It is ranked #1823 on the Dev Radar, in AI dev tools, first seen 9 days ago and shared in 1 post (213 views).
What llama-rpc-rdma says about itself
LLM inference in C/C++. Contribute to b-ostrov/Llama-RPC-RDMA development by creating an account on GitHub.
GitHub - b-ostrov/Llama-RPC-RDMA: LLM inference in C/C++ · GitHub Skip to content Navigation Menu Sign in Appearance settings Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} b-ostrov / Llama-RPC-RDMA Public forked from ServeurpersoCom/llama.cpp Notifications You must be signed in to change notification settings Fork 0 Star 1 master Branches Tags Go to file Code Open more actions menu Latest…
What people said about llama-rpc-rdma on X
Ready-to-use client: Llama-RPC-RDMA — a llama.cpp fork whose RPC backend speaks RDMA natively. Auto-negotiates RDMA vs TCP on the same -rpc CLI. That's what moved the KV cache in the Mac <> Spark runs. https://github.com/denmrnngp-cloud/Llama-RPC-RDMA rdma is launched together with…
— @b_ostrov, 9 days ago · 1 likes · see the post
Alternatives to llama-rpc-rdma
- muse.ai — New connectors are live today. Come build with us.
- classifier.dev — now outperforms jev and is free
- StepFun Open Platform — Step API · Stable · High-Performance · Easy Integration. Leading models and tools to accelerate the deployment of your…
- zcode — Z.ai's coding agent harness. Powerful, intelligent, extensible. - zai-org/ZCode
- qwen-image-2.1 — Hugging Face
- academy.dair.ai — Chat with Paper
llama-rpc-rdma in numbers
- Rank on the Dev Radar: #1823 of 2143
- Shared in 1 post by 1 account: @b_ostrov
- 213 views on those posts
- First seen 9 days ago, last shared 9 days ago
- Pricing seen by Jev: open source
- Market: AI dev tools
FAQ
What is llama-rpc-rdma?
Ready-to-use client: Llama-RPC-RDMA — a llama.cpp fork whose RPC backend speaks RDMA natively. Auto-negotiates RDMA vs TCP on the same -rpc CLI. That's what mov It was first shared on X 9 days ago and is ranked #1823 on the Dev Radar.
Is llama-rpc-rdma free?
It is open source.
Who shared llama-rpc-rdma?
1 account on X, including @b_ostrov, in 1 post totalling 213 views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 18.9k posts from 4.9k X accounts over the last 21 days, 2.1k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-21 06:12 UTC. Full method.