A few of my smartest friends in AI called me a "idiot" for not deeply understanding evals.
This is a dev post classified by Jev as AI dev tools (a tutorial), kept by the Dev Radar because it carries real work, not commentary.
A few of my smartest friends in AI called me a "idiot" for not deeply understanding evals. So...I found the smartest person I know on evals & made them teach me. @Vtrivedy10 (leads Labs at @LangChain) took me from easy mode to god mode for a 38-minute masterclass on all things evals. Easy Mode: what an eval actually is Definition: did the AI agent do the job correctly? You need two building blocks: 1) Tasks. The checkable jobs you care about. Log the meeting. Draft the email. Find Acme across the right Salesforce tables. 2) Verifiers. Something that can say right or wrong after the t
Posted by Alex Lieberman (315.3k followers) 5 days ago · 1k likes · 126.1k views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- Hallmark has been installed 50k+ times! — @nutlope
- Your AI coding agents need a workflow, not more babysitting. — @DanKornas
- Register by October 7 and save >> https://bit.ly/4vkntyD — @linuxfoundation
- Nimble is able to process images! — @madiator
- Your agent already solved this. Finding the session is the problem. — @DanKornas
- Trains your own large language model from scratch using plain PyTorch. — @tom_doerr
- gpt 5.6 terra = gpt 6 astra — @notjazii
- your rtx 3060 was running bonsai 2 at 26 tok/s this morning and now does 40 tok/s, i… — @sudoingX
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 12.2k posts from 4.7k X accounts over the last 21 days, 1.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-19 18:39 UTC. Full method.