Judgment Labs (Judgeval)
Open-source SDK and hosted platform that traces agents and scores their behaviour with prompt-based judges and live monitoring.
By Judgment, Inc. · www.judgmentlabs.ai
Package download activity
Each package is shown on its own; packages that can be installed together are never added up. Week 2026-W40 (2026-09-28 to 2026-10-04).
npmjudgeval · headline (ranked)
34,312 downloads in the week, -5.8% vs prior week · rank 15 on npm
Reproduce this number (npm API) · registry metadata (mapping checked 2026-10-07)
PyPIjudgeval · headline (ranked)
19,443 downloads in the week, +39.3% vs prior week · rank 27 on PyPI
Cross-check 2026-W40 vs PyPI Stats (mirrors excluded): mismatch (+11.1%). PyPI Stats query
Reproduce this number (ClickHouse SQL) · registry metadata (mapping checked 2026-10-07)
GitHub stars
JudgmentLabs/judgeval: 1,063 stars (rank 33). Stars are a point-in-time count of a repository's bookmarks, not people using the tool.
Series starts 2026-W40 (1,063).
Facts
| Categories | Tracing & observability, Evaluation | |
|---|---|---|
| Status | Generally available | |
| Licence | Apache-2.0 (open core) | source, checked 2026-10-07 |
| Self-host | No | source, checked 2026-10-07 |
| OpenTelemetry | Native (OTLP) | source, checked 2026-10-07 |
| Pricing model | contact | |
| Entry price | Contact sales; no public pricing page (judgmentlabs.ai/pricing renders only a back link); billing docs describe JUs and PAYGO without prices | source, checked 2026-10-07 |
| Free tier | Not stated | |
| Measurability | Measured (mapped SDK packages) |
Facts last verified 2026-10-07 on first-party pages. Prices as published, taxes excluded; non-USD prices are not converted.
Compare
Spotted an outdated fact? The methodology page explains how facts are checked; corrections are applied at the next weekly build.