LiteLLM alternatives
LiteLLM covers gateways with observability and starts at Contact sales; its headline PyPI package had 22,710,323 downloads in the latest measured week (rank 1). 9 other listed tools share at least one category; 5 of them can be self-hosted on any plan and 7 ingest OpenTelemetry natively. The table is ordered by PyPI package downloads, not by payment.
Week 2026-W40 (2026-09-28 to 2026-10-04, UTC), measured 2026-10-07 20:16 UTC.
Same categories as LiteLLM
| # | Tool | Package | PyPI downloads (week) | 12 weeks | vs prior week | Licence | Self-host | OTel | Entry price |
|---|---|---|---|---|---|---|---|---|---|
| 4 | MLflowTracing & observability | mlflow-tracingbundled | 3,616,315 | +3.7% | Apache-2.0 | Yes | Native (OTLP) | Free | |
| 5 | Pydantic LogfireTracing & observability | logfirebundled | 3,488,038 | +14.3% | Proprietary | Enterprise only | Native (OTLP) | $49/mo | |
| 9 | PortkeyGateways with observability | portkey-ai | 765,740 | -26.5% | MIT (open core) | Yes | Native (OTLP) | $49/mo | |
| 24 | Orq.aiGateways with observability | orq-ai-sdk | 30,379 | +14.1% | Proprietary | Enterprise only | Native (OTLP) | not published in USD | |
| 33 | HeliconeTracing & observability | helicone-helpers | 4,840 | +20.7% | Apache-2.0 | Yes | Unknown | $79/mo | |
| – | Cloudflare AI GatewayGateways with observability | – | SDK-less | Proprietary | Unknown | Exporter / bridge | Free | ||
| – | Future AGIEvaluation | – | SDK not mapped | Apache-2.0 (open core) | Yes | Native (OTLP) | $250/mo | ||
| – | LangWatchTracing & observability | – | SDK not mapped | Apache-2.0 (open core) | Yes | Native (OTLP) | not published in USD | ||
| – | RespanTracing & observability | – | SDK not mapped | Proprietary | Enterprise only | Native (OTLP) | $199/mo |
Other categories
- LangSmith (Tracing & observability)
- Langfuse (Tracing & observability)
- Pydantic Evals (Evaluation)
- Braintrust (Tracing & observability)
- Inspect AI (Evaluation)
- DeepEval / Confident AI (Evaluation)
- Traceloop / OpenLLMetry (Tracing & observability)
- Opik (Tracing & observability)
- Ragas (Evaluation)
- lm-evaluation-harness (Evaluation)
- W&B Weave (Tracing & observability)
- Evidently AI (Evaluation)
- Arize Phoenix (Tracing & observability)
- NeMo Guardrails (Guardrails & safety)
- Arize AX (Tracing & observability)
- OpenLIT (Tracing & observability)
- Lunary (Tracing & observability)
- Openlayer (Evaluation)
- Azure AI Evaluation SDK (Microsoft Foundry) (Evaluation)
- AgentOps (Tracing & observability)
- PromptLayer (Prompt management)
- Judgment Labs (Judgeval) (Tracing & observability)
- garak (Evaluation)
- Agenta (Prompt management)
- Galileo (Evaluation)
- TruLens (Evaluation)
- Giskard (Evaluation)
- Promptfoo (Evaluation)
- HoneyHive (Tracing & observability)
- Latitude (Tracing & observability)
- Galtea (Evaluation)
- Okareo (Evaluation)
- LlamaFirewall (Guardrails & safety)
- Last9 (AI / LLM observability) (Tracing & observability)
- Fiddler AI (Tracing & observability)
- Scorecard (Evaluation)
- UpTrain (Evaluation)
- AI Verify Moonshot (Evaluation)
- Scorable (formerly Root Signals) (Evaluation)
- AgentEvals (Evaluation)
- Arthur Engine (Evaluation)
- Coralogix AI Observability (AI Center) (Tracing & observability)
- Datadog LLM Observability (Tracing & observability)
- Deepchecks LLM Evaluation (Evaluation)
- Guardrails AI (Guardrails & safety)
- Invariant Guardrails (Guardrails & safety)
- Lakera Guard (Guardrails & safety)
- Laminar (Tracing & observability)
- Maxim AI (Evaluation)
- OpenEvals (Evaluation)
- OpenObserve (LLM observability) (Tracing & observability)
- Patronus AI (Evaluation)
- Raindrop (Tracing & observability)
- SigNoz (LLM observability) (Tracing & observability)