SRE-Bench
SRE-Bench is SRE-Bench is a realistic, contamination-free benchmark for agentic reverse engineering, hosted by Columbia University.. It is ranked #4201 on the Dev Radar, in AI dev tools, first seen 14 days ago and shared in 1 post (1.8k views).
SRE-Bench Skip to content SRE-Bench Reverse engineering benchmark / Hosted by Columbia University SRE-Bench A realistic, contamination-free benchmark for agentic reverse engineering. A few weeks ago, we released SRE-Bench: The Next Challenge for Agentic Cybersecurity , a realistic, contamination-free benchmark designed to evaluate one of the most challenging capabilities in agentic cybersecurity: reverse engineering complex binary software. Since then, we have been working with OpenAI to evaluate GPT-6 Astra , its strongest model. The results were striking: the model achieves a nearly 100% solve rate on SRE-Bench, while the other models we…
What people said about SRE-Bench on X
A good reminder that keeping your code closed-source for security purpose is a bad strategy If you distribute a binary, treat it as if attackers have the source code
— @Montyly, 14 days ago · 34 likes · see the post
Alternatives to SRE-Bench
- goo.gle — Officially in beta, the AppFunctions API is opening up powerful new ways to integrate your functionality.
- Kimi AI with K3.1 Pro — Try Kimi K3.1 Pro to tackle complex coding projects, build 3D models, conduct financial research, and take on more…
- Agents in flight — Give it a try
- Baseten — This session is our most in-demand yet. See you there
- project-maya — Checkout Maya
- deepinfer — You gotta love Deepseek. This is awesome stuff!
SRE-Bench in numbers
- Rank on the Dev Radar: #4201 of 8801
- Shared in 1 post by 1 account: @Montyly
- 1.8k views on those posts
- First seen 14 days ago, last shared 14 days ago
- Pricing seen by AGK Intelligence: not stated
- Market: AI dev tools
FAQ
What is SRE-Bench?
SRE-Bench is a realistic, contamination-free benchmark for agentic reverse engineering, hosted by Columbia University. It was first shared on X 14 days ago and is ranked #4201 on the Dev Radar.
Is SRE-Bench free?
Pricing is not stated on the page we read.
Who shared SRE-Bench?
1 account on X, including @Montyly, in 1 post totalling 1.8k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 21:12 UTC. Full method.