The best coding-agent harnesses solve half the tasks per attempt, but only a third every…
This is a dev post classified by AGK Intelligence as AI dev tools (a launch), kept by the Dev Radar because it carries real work, not commentary.
The best coding-agent harnesses solve half the tasks per attempt, but only a third every time. @jeffweisbein asked on my launch post how often each harness solves the same task on all three attempts. That matters when an agent runs without anyone watching. The Harness Leaderboard now shows it. It compares nine coding-agent harnesses on the same open models. Averaged over three open models, mini-swe-agent (@KLieret) solves 51.4% of tasks per attempt, 68.6% at least once in three tries, and 33.0% every time. Five harnesses solve 32.0% to 33.3% every time, too close to call. @openclaw solves
Posted by Joël Niklaus (3.4k followers) 1 h ago · 7 likes · 326 views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: harness-leaderboard.
More dev work like this
- 💥细节感拉满！Qwen 4.0 蜜蜂向日葵测试炸了！ — @NFT_Chen
- Introducing Keras Core! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT… — @gp_pulipaka
- ReRun Viewer! Visualize, Query, And Stream To Train On Multimodal Robotics Data.… — @gp_pulipaka
- #Keras with #PyTorch! @Yampeleg #BigData #Analytics #DataScience #AI #MachineLearning… — @gp_pulipaka
- I Know but Falls Short of Its Promise! Insight Into LLM Context Failures! #BigData… — @gp_pulipaka
- Weight Initialization in Neural Networks. #BigData #Analytics #DataScience #AI… — @gp_pulipaka
- 不想反复截图发 K 线？试试 tradingview-mcp。 — @bkdgiffug
- 🫢绝了！让你的AI Agent 3步变身逆向专家！Awesome-REA正式上线！AI代理有了一个专用逆向工程的武器库！ — @NFT_Chen
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.8k posts from 5k X accounts over the last 21 days, 9.6k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 16:42 UTC. Full method.