Portkey alternatives
Portkey covers gateways with observability, tracing & observability, guardrails & safety, prompt management and starts at $49/mo; its headline PyPI package had 765,740 downloads in the latest measured week (rank 9). 55 other listed tools share at least one category; 27 of them can be self-hosted on any plan and 42 ingest OpenTelemetry natively. The table is ordered by PyPI package downloads, not by payment.
Week 2026-W40 (2026-09-28 to 2026-10-04, UTC), measured 2026-10-07 20:16 UTC.
Same categories as Portkey
| # | Tool | Package | PyPI downloads (week) | 12 weeks | vs prior week | Licence | Self-host | OTel | Entry price |
|---|---|---|---|---|---|---|---|---|---|
| 1 | LiteLLMGateways with observability | litellmbundled | 22,710,323 | -0.1% | MIT (open core) | Yes | Exporter / bridge | Contact sales | |
| 2 | LangSmithTracing & observability | langsmithbundled | 18,866,051 | +8.1% | Proprietary | Enterprise only | Native (OTLP) | $39/seat/mo | |
| 3 | LangfuseTracing & observability | langfuse | 6,306,471 | +12.7% | MIT (open core) | Yes | Native (OTLP) | $29/mo | |
| 4 | MLflowTracing & observability | mlflow-tracingbundled | 3,616,315 | +3.7% | Apache-2.0 | Yes | Native (OTLP) | Free | |
| 5 | Pydantic LogfireTracing & observability | logfirebundled | 3,488,038 | +14.3% | Proprietary | Enterprise only | Native (OTLP) | $49/mo | |
| 7 | BraintrustTracing & observability | braintrust | 1,650,096 | 0.0% | Proprietary | Enterprise only | Native (OTLP) | $249/mo | |
| 10 | DeepEval / Confident AIEvaluation | deepeval | 686,214 | +9.7% | Apache-2.0 (open core) | Enterprise only | Native (OTLP) | $200/mo | |
| 11 | Traceloop / OpenLLMetryTracing & observability | traceloop-sdk | 455,110 | +7.6% | Apache-2.0 (open core) | Enterprise only | Native (OTLP) | Contact sales | |
| 12 | OpikTracing & observability | opik | 437,574 | +2.0% | Apache-2.0 | Yes | Native (OTLP) | $19/mo | |
| 15 | W&B WeaveTracing & observability | weave | 239,276 | +28.3% | Apache-2.0 (open core) | Yes | Native (OTLP) | $60/mo | |
| 16 | Evidently AIEvaluation | evidently | 198,068 | +7.3% | Apache-2.0 (open core) | Yes | Native (OTLP) | Free | |
| 17 | Arize PhoenixTracing & observability | arize-phoenix | 161,687 | +13.6% | Elastic-2.0 (source-available) | Yes | Native (OTLP) | Free | |
| 18 | NeMo GuardrailsGuardrails & safety | nemoguardrails | 148,111 | +64.0% | Apache-2.0 | Yes | Exporter / bridge | Free | |
| 19 | Arize AXTracing & observability | arize-otel | 84,266 | -5.1% | Proprietary | Enterprise only | Native (OTLP) | $50/mo | |
| 20 | OpenLITTracing & observability | openlit | 72,503 | +14.5% | Apache-2.0 | Yes | Native (OTLP) | Free | |
| 21 | LunaryTracing & observability | lunary | 49,317 | +22.9% | Unknown | Enterprise only | Native (OTLP) | $20/seat/mo | |
| 22 | OpenlayerEvaluation | openlayer | 37,719 | -16.7% | Proprietary | Enterprise only | Native (OTLP) | Contact sales | |
| 24 | Orq.aiGateways with observability | orq-ai-sdk | 30,379 | +14.1% | Proprietary | Enterprise only | Native (OTLP) | not published in USD | |
| 25 | AgentOpsTracing & observability | agentops | 28,508 | +84.6% | MIT | Yes | Native (OTLP) | $40/mo | |
| 26 | PromptLayerPrompt management | promptlayer | 23,137 | +10.5% | Proprietary | Enterprise only | Native (OTLP) | $49/mo | |
| 27 | Judgment Labs (Judgeval)Tracing & observability | judgeval | 19,443 | +39.3% | Apache-2.0 (open core) | No | Native (OTLP) | Contact sales | |
| 28 | garakEvaluation | garak | 11,417 | +25.8% | Apache-2.0 | Yes | Unknown | Free | |
| 29 | AgentaPrompt management | agenta | 10,423 | +38.6% | MIT (open core) | Yes | Native (OTLP) | $29/mo | |
| 30 | GalileoEvaluation | galileo | 9,821 | +46.8% | Proprietary | Enterprise only | Native (OTLP) | Contact sales | |
| 31 | TruLensEvaluation | trulens | 6,198 | +28.0% | MIT | Yes | Native (OTLP) | Free | |
| 32 | GiskardEvaluation | giskard | 5,667 | +93.3% | Apache-2.0 (open core) | Yes | Unknown | Contact sales | |
| 33 | HeliconeTracing & observability | helicone-helpers | 4,840 | +20.7% | Apache-2.0 | Yes | Unknown | $79/mo | |
| 34 | PromptfooEvaluation | promptfoo | 3,451 | +13.7% | MIT (open core) | Yes | Native (OTLP) | Contact sales | |
| 35 | HoneyHiveTracing & observability | honeyhive | 3,245 | +38.9% | Proprietary | Enterprise only | Native (OTLP) | Contact sales | |
| 36 | LatitudeTracing & observability | latitude-telemetry | 2,379 | -18.5% | MIT | Yes | Native (OTLP) | $99/mo | |
| 37 | GalteaEvaluation | galtea | 2,373 | +23.0% | Proprietary | Enterprise only | Native (OTLP) | Contact sales | |
| 38 | OkareoEvaluation | okareo | 2,051 | +0.3% | Proprietary | Enterprise only | Native (OTLP) | $199/mo | |
| 39 | LlamaFirewallGuardrails & safety | llamafirewall | 1,471 | +53.9% | MIT | Yes | Unknown | Free | |
| 40 | Last9 (AI / LLM observability)Tracing & observability | last9-genai | 918 | -16.0% | Proprietary | Unknown | Native (OTLP) | not published in USD | |
| 41 | Fiddler AITracing & observability | fiddler-otel | 791 | -21.0% | Proprietary | Enterprise only | Native (OTLP) | not published in USD | |
| 42 | ScorecardEvaluation | scorecard-ai | 621 | +3.8% | Proprietary | Unknown | Native (OTLP) | $299/mo | |
| 44 | AI Verify MoonshotbetaEvaluation | aiverify-moonshot | 370 | +65.9% | Apache-2.0 | Yes | Unknown | Free | |
| 45 | Scorable (formerly Root Signals)Evaluation | scorable | 118 | +57.3% | Proprietary | Enterprise only | Native (OTLP) | $19/seat/mo | |
| – | Arthur EngineEvaluation | – | SDK not mapped | MIT (open core) | Yes | Native (OTLP) | $60/mo | ||
| – | Cloudflare AI GatewayGateways with observability | – | SDK-less | Proprietary | Unknown | Exporter / bridge | Free | ||
| – | Coralogix AI Observability (AI Center)Tracing & observability | – | SDK-less | Proprietary | Unknown | Native (OTLP) | not published in USD | ||
| – | Datadog LLM ObservabilityTracing & observability | – | proxy-only | Proprietary | Unknown | Native (OTLP) | $160/mo | ||
| – | Deepchecks LLM EvaluationEvaluation | – | no PyPI SDK | Proprietary | Enterprise only | Unknown | Contact sales | ||
| – | Future AGIEvaluation | – | SDK not mapped | Apache-2.0 (open core) | Yes | Native (OTLP) | $250/mo | ||
| – | Guardrails AIGuardrails & safety | – | SDK not mapped | Apache-2.0 | Yes | Exporter / bridge | Free | ||
| – | Invariant GuardrailsGuardrails & safety | – | SDK not mapped | Apache-2.0 | Yes | Unknown | Free | ||
| – | Lakera GuardGuardrails & safety | – | no PyPI SDK | Proprietary | Enterprise only | Unknown | Contact sales | ||
| – | LaminarTracing & observability | – | SDK not mapped | Apache-2.0 (open core) | Yes | Native (OTLP) | $30/mo | ||
| – | LangWatchTracing & observability | – | SDK not mapped | Apache-2.0 (open core) | Yes | Native (OTLP) | not published in USD | ||
| – | Maxim AIEvaluation | – | SDK not mapped | Proprietary | Enterprise only | Native (OTLP) | Contact sales | ||
| – | OpenObserve (LLM observability)Tracing & observability | – | SDK-less | AGPL-3.0 (open core) | Yes | Native (OTLP) | not published in USD | ||
| – | Patronus AIEvaluation | – | no PyPI SDK | Proprietary | Enterprise only | Unknown | not published in USD | ||
| – | RaindropTracing & observability | – | SDK not mapped | Proprietary | Unknown | Native (OTLP) | $299/mo | ||
| – | RespanTracing & observability | – | SDK not mapped | Proprietary | Enterprise only | Native (OTLP) | $199/mo | ||
| – | SigNoz (LLM observability)Tracing & observability | – | SDK-less | MIT (open core) | Yes | Native (OTLP) | $49/mo |
Other categories
- Pydantic Evals (Evaluation)
- Inspect AI (Evaluation)
- Ragas (Evaluation)
- lm-evaluation-harness (Evaluation)
- Azure AI Evaluation SDK (Microsoft Foundry) (Evaluation)
- UpTrain (Evaluation)
- AgentEvals (Evaluation)
- OpenEvals (Evaluation)