Inspect AI
Python framework for writing and running LLM and agent evaluations, with 200+ prebuilt evals and a log viewer.
By UK AI Security Institute · inspect.aisi.org.uk
Package download activity
Each package is shown on its own; packages that can be installed together are never added up. Week 2026-W40 (2026-09-28 to 2026-10-04).
PyPIinspect-ai · headline (ranked)
907,448 downloads in the week, +33.1% vs prior week · rank 8 on PyPI
Cross-check 2026-W40 vs PyPI Stats (mirrors excluded): within 5% (+1.4%). PyPI Stats query
Reproduce this number (ClickHouse SQL) · registry metadata (mapping checked 2026-10-07)
GitHub stars
UKGovernmentBEIS/inspect_ai: 2,953 stars (rank 26). Stars are a point-in-time count of a repository's bookmarks, not people using the tool.
Series starts 2026-W40 (2,953).
Facts
| Categories | Evaluation | |
|---|---|---|
| Status | Generally available | |
| Licence | MIT | source, checked 2026-10-07 |
| Self-host | Yes | source, checked 2026-10-07 |
| OpenTelemetry | Unknown | source, checked 2026-10-07 |
| Pricing model | free | |
| Entry price | Free; Open-source framework; no paid plan found | source, checked 2026-10-07 |
| Free tier | Yes | |
| Measurability | Measured (mapped SDK packages) |
Facts last verified 2026-10-07 on first-party pages. Prices as published, taxes excluded; non-USD prices are not converted.
Compare
Spotted an outdated fact? The methodology page explains how facts are checked; corrections are applied at the next weekly build.