OpenEvals
LangChain's open-source collection of ready-made evaluator functions for scoring LLM application outputs in Python and TypeScript.
By LangChain, Inc. · github.com/langchain-ai/openevals
Package download activity
Each package is shown on its own; packages that can be installed together are never added up. Week 2026-W40 (2026-09-28 to 2026-10-04).
npmopenevals · headline (ranked)
161,288 downloads in the week, +13.3% vs prior week · rank 7 on npm
Reproduce this number (npm API) · registry metadata (mapping checked 2026-10-07)
Packages not measured
The vendor's docs name these packages, but their registry metadata does not link the vendor's domain or GitHub organisation, so under our mapping rule they are not counted. No download number is shown for them.
- PyPI
openevals: registry metadata has no project/repository/homepage link (registry metadata, checked 2026-10-07)
GitHub stars
langchain-ai/openevals: 1,216 stars (rank 30). Stars are a point-in-time count of a repository's bookmarks, not people using the tool.
Series starts 2026-W40 (1,216).
Facts
| Categories | Evaluation | |
|---|---|---|
| Status | Generally available | |
| Licence | MIT | source, checked 2026-10-07 |
| Self-host | Yes | source, checked 2026-10-07 |
| OpenTelemetry | Unknown | source, checked 2026-10-07 |
| Pricing model | free | |
| Entry price | Free; Open-source library; optional LangSmith integration is a separate LangChain product not priced here | source, checked 2026-10-07 |
| Free tier | Yes | |
| Measurability | Measured (mapped SDK packages) |
Facts last verified 2026-10-07 on first-party pages. Prices as published, taxes excluded; non-USD prices are not converted.
Compare
Spotted an outdated fact? The methodology page explains how facts are checked; corrections are applied at the next weekly build.