Portkey vs DeepEval / Confident AI
Facts come from each vendor's own pages; download numbers are the headline package of each tool in 2026-W40.
| Fact | Portkey | DeepEval / Confident AI |
|---|---|---|
| PyPI downloads, week (rank) | 765,740 (#9)portkey-ai | 686,214 (#10)deepeval |
| npm downloads, week (rank) | 280,520 (#6)portkey-ai | SDK not mapped |
| GitHub stars (rank) | 13,144 (#10)Portkey-AI/gateway | 18,682 (#7)confident-ai/deepeval |
| PyPI series (12 weeks) | ||
| npm series (12 weeks) | no npm SDK | |
| Categories | Gateways with observability, Tracing & observability, Guardrails & safety, Prompt management | Evaluation, Tracing & observability, Prompt management |
| Status | Generally available | Generally available |
| Licence | MIT (open core) | Apache-2.0 (open core) |
| Self-host | Yes | Enterprise only |
| OpenTelemetry | Native (OTLP) | Native (OTLP) |
| Pricing model | usage | flat |
| Entry price | $49/mo; Production plan $49/month with 100k recorded logs per month, +$9 per additional 100k requests; Developer plan free forever (10K requests); Enterprise custom | $200/mo; Confident AI platform: Free $0 forever (2 seats, 1 project, 1 GB-month traces); Starter $200/month (5 GB-months traces, then $1 per GB-month); Team $2,000/month; Enterprise custom. DeepEval library itself is free/open source. |
| Free tier | Yes | Yes |
| Measurability | Measured (mapped SDK packages) | Measured (mapped SDK packages) |
| Sources | pricing · licence · self-host · OTel (checked 2026-10-07) | pricing · licence · self-host · OTel (checked 2026-10-07) |
More downloads means more package installs (including CI and dependencies), not a better product. See the methodology.