deepeval
deepeval is The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.. It is ranked #2741 on the Dev Radar, in Testing & observability, first seen 49 days ago and shared in 5 posts (7.8k views).
GitHub - confident-ai/deepeval: The LLM Evaluation Framework · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation deepeval Public Notifications You must be signed in to change notification settings Fork 2.2k ( 2.2k ) Star 19.2k ( 19.2k ) You must be signed in to star a repository About The LLM Evaluation Framework deepeval.com…
What people said about deepeval on X
💥我靠！LLM评估终于不用再靠另一个“爱飘”的生成式裁判了！ DeepEval正式推出 JevEval：用Jev当自定义评估裁判，而不是每次都让另一个LLM去“生成”评分。 对比传统LLM-as-a-Judge： 🔹传统：模型自己解读标准 + 推理 + 生成结果（易飘、贵、慢、JSON还容易炸） 🔹JevEval：决策结构你定好，权重你配，strict_mode一开就是硬门槛。支持Yes/No、分级Score、Choice三种题型 特别适合Agent：直接评执行轨迹（trace），工具选对没、动作顺序对不对、任务到底完成没。 关键操作步骤（3分钟上手）： 1️⃣安装依赖：pip install -U deepeval…
— @NFT_Chen, 10 days ago · 42 likes · see the post
🔥牛逼！d3改良版决策模型d3-turbox一张图255问只要2.12秒，提速15.5倍！ 27B多模态决策模型d3-turbo直接把多问题场景干爆。 核心亮点 🔹State Once：输入只读一次，批量回答。255问同一张图仅需2.12秒，比d3-flash快15.5倍。 🔹结构化决策：Choice / Yes-No / Score / Box定位 / Track跟踪，零文本生成，直接出概率。 🔹更强性能：公开Jev套件71.7（前代d3为65.5），支持128K长上下文，图也能塞进问题里。 使用步骤 1️⃣免费试玩：打开 https://decision.vllm-sr.ai 拿Key，直接调API。…
— @NFT_Chen, 8 days ago · 33 likes · see the post
Alternatives to deepeval
- Introducing Vercel CI — Vercel CI is in Beta. It runs only the checks your change affects, on compute sized to the push, using the Turborepo…
- Dagger — After five years of v0, Dagger 1.0 is in beta: official modules, test-native CI, remote execution and native GitHub…
- e2e — Next generation e2e testing framework for web and mobile apps. - tester-army/e2e
- Welcome — Welcome - cargo-mutants
- Buildkite — Buildkite’s core app is built on Rails, and they’re longtime supporters of the Ruby community. Get to know Buildkite
- mutant-cafe — mutation testing for @EffectTS_
deepeval in numbers
- Rank on the Dev Radar: #2741 of 9203
- Shared in 5 posts by 5 accounts: @NFT_Chen
- 7.8k views on those posts
- First seen 49 days ago, last shared 8 days ago
- Pricing seen by AGK Intelligence: open source
- Market: Testing & observability
FAQ
What is deepeval?
The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub. It was first shared on X 49 days ago and is ranked #2741 on the Dev Radar.
Is deepeval free?
It is open source.
Who shared deepeval?
5 accounts on X, including @NFT_Chen, in 5 posts totalling 7.8k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.3k posts from 5k X accounts over the last 21 days, 9.2k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-03 23:11 UTC. Full method.