Guardrails & safety
Check prompts and responses at runtime for injection, leakage, toxicity or policy violations. 19 listed tools are in this category (a tool can be in several). Tables are ordered by package downloads or stars, never by payment.
Week 2026-W40 (2026-09-28 to 2026-10-04, UTC), measured 2026-10-07 20:16 UTC.
PyPI weekly downloads
| # | Tool | Package | PyPI downloads (week) | 12 weeks | vs prior week | Entry price |
|---|---|---|---|---|---|---|
| 9 | PortkeyGateways with observability | portkey-ai | 765,740 | -26.5% | $49/mo | |
| 18 | NeMo GuardrailsGuardrails & safety | nemoguardrails | 148,111 | +64.0% | Free | |
| 20 | OpenLITTracing & observability | openlit | 72,503 | +14.5% | Free | |
| 22 | OpenlayerEvaluation | openlayer | 37,719 | -16.7% | Contact sales | |
| 24 | Orq.aiGateways with observability | orq-ai-sdk | 30,379 | +14.1% | not published in USD | |
| 28 | garakEvaluation | garak | 11,417 | +25.8% | Free | |
| 30 | GalileoEvaluation | galileo | 9,821 | +46.8% | Contact sales | |
| 32 | GiskardEvaluation | giskard | 5,667 | +93.3% | Contact sales | |
| 34 | PromptfooEvaluation | promptfoo | 3,451 | +13.7% | Contact sales | |
| 39 | LlamaFirewallGuardrails & safety | llamafirewall | 1,471 | +53.9% | Free | |
| 41 | Fiddler AITracing & observability | fiddler-otel | 791 | -21.0% | not published in USD | |
| 44 | AI Verify MoonshotbetaEvaluation | aiverify-moonshot | 370 | +65.9% | Free | |
| – | Arthur EngineEvaluation | – | SDK not mapped | $60/mo | ||
| – | Cloudflare AI GatewayGateways with observability | – | SDK-less | Free | ||
| – | Coralogix AI Observability (AI Center)Tracing & observability | – | SDK-less | not published in USD | ||
| – | Future AGIEvaluation | – | SDK not mapped | $250/mo | ||
| – | Guardrails AIGuardrails & safety | – | SDK not mapped | Free | ||
| – | Invariant GuardrailsGuardrails & safety | – | SDK not mapped | Free | ||
| – | Lakera GuardGuardrails & safety | – | no PyPI SDK | Contact sales |
npm weekly downloads
| # | Tool | Package | npm downloads (week) | 12 weeks | vs prior week | Entry price |
|---|---|---|---|---|---|---|
| 4 | PromptfooEvaluation | promptfoo | 1,020,946 | +26.9% | Contact sales | |
| 6 | PortkeyGateways with observability | portkey-ai | 280,520 | +29.2% | $49/mo | |
| 13 | Orq.aiGateways with observability | @orq-ai/node | 43,521 | -41.8% | not published in USD | |
| 21 | GalileoEvaluation | galileo | 1,810 | +32.3% | Contact sales | |
| 22 | OpenLITTracing & observability | openlit | 1,231 | -43.1% | Free | |
| 23 | OpenlayerEvaluation | openlayer | 308 | -50.0% | Contact sales | |
| 27 | Future AGIEvaluation | @future-agi/ai-evaluation | 3 | -66.7% | $250/mo | |
| – | AI Verify MoonshotbetaEvaluation | – | no npm SDK | Free | ||
| – | Arthur EngineEvaluation | – | no npm SDK | $60/mo | ||
| – | Cloudflare AI GatewayGateways with observability | – | SDK-less | Free | ||
| – | Coralogix AI Observability (AI Center)Tracing & observability | – | SDK-less | not published in USD | ||
| – | Fiddler AITracing & observability | – | no npm SDK | not published in USD | ||
| – | garakEvaluation | – | no npm SDK | Free | ||
| – | GiskardEvaluation | – | no npm SDK | Contact sales | ||
| – | Guardrails AIGuardrails & safety | – | no npm SDK | Free | ||
| – | Invariant GuardrailsGuardrails & safety | – | no npm SDK | Free | ||
| – | Lakera GuardGuardrails & safety | – | no npm SDK | Contact sales | ||
| – | LlamaFirewallGuardrails & safety | – | no npm SDK | Free | ||
| – | NeMo GuardrailsGuardrails & safety | – | no npm SDK | Free |
GitHub stars
| # | Tool | Repository | GitHub stars | 12 weeks | Entry price |
|---|---|---|---|---|---|
| 4 | PromptfooEvaluation | promptfoo/promptfoo | 25,794 | series starts 2026-W40 | Contact sales |
| 10 | PortkeyGateways with observability | Portkey-AI/gateway | 13,144 | series starts 2026-W40 | $49/mo |
| 12 | garakEvaluation | NVIDIA/garak | 9,490 | series starts 2026-W40 | Free |
| 14 | Guardrails AIGuardrails & safety | guardrails-ai/guardrails | 7,495 | series starts 2026-W40 | Free |
| 16 | NeMo GuardrailsGuardrails & safety | NVIDIA-NeMo/Guardrails | 7,260 | series starts 2026-W40 | Free |
| 19 | GiskardEvaluation | Giskard-AI/giskard-oss | 5,869 | series starts 2026-W40 | Contact sales |
| 27 | OpenLITTracing & observability | openlit/openlit | 2,829 | series starts 2026-W40 | Free |
| 29 | Future AGIEvaluation | future-agi/future-agi | 2,116 | series starts 2026-W40 | $250/mo |
| 36 | Invariant GuardrailsGuardrails & safety | invariantlabs-ai/invariant | 467 | series starts 2026-W40 | Free |
| 37 | AI Verify MoonshotbetaEvaluation | aiverify-foundation/moonshot | 355 | series starts 2026-W40 | Free |
| 38 | Arthur EngineEvaluation | arthur-ai/arthur-engine | 91 | series starts 2026-W40 | $60/mo |
| 41 | OpenlayerEvaluation | openlayer-ai/openlayer-python | 18 | series starts 2026-W40 | Contact sales |
| – | Cloudflare AI GatewayGateways with observability | – | SDK-less | Free | |
| – | Coralogix AI Observability (AI Center)Tracing & observability | – | SDK-less | not published in USD | |
| – | Fiddler AITracing & observability | – | no public repo | not published in USD | |
| – | GalileoEvaluation | – | no public repo | Contact sales | |
| – | Lakera GuardGuardrails & safety | – | closed-source | Contact sales | |
| – | LlamaFirewallGuardrails & safety | – | no public repo | Free | |
| – | Orq.aiGateways with observability | – | no public repo | not published in USD |