AI Assurance Directory

Promptfoo vs NVIDIA garak

Both listings are open-source generative-AI scanners. Promptfoo’s cited docs name 50+ vulnerability types and maps to NIST AI RMF, ISO/IEC 42001 and the EU AI Act. garak’s cited page names hallucination, leakage, prompt injection and jailbreak probes.

Built only from the cited fields already on Promptfoo and garak. Not a ranking, certification or recommendation. Public summary columns stay on this page. Quoted evidence, who-it-is-for, deployment, caveats and coverage-cell quotes are Pro.

All comparison landings and the picker · Pricing

Side-by-side comparison of Promptfoo and garak from cited public listing fields
Field Promptfoogarak
Vendor / publisher Promptfoo NVIDIA
Type Open source · AI assurance & verification Open source · AI assurance & verification
Official site https://www.promptfoo.dev/docs/red-team/ https://garak.ai/
Industries (cited page) Cross-industry Cross-industry
Frameworks named on cited source NIST AI RMF, ISO/IEC 42001, EU AI Act None tagged
Open source (OSI license on official repo) Open source · MIT Open source · Apache-2.0
Summary (from listing) Open-source gen-AI red-teaming tool that scans 50+ vulnerability types and maps plugins to the NIST AI RMF, ISO/IEC 42001 and EU AI Act. Runs locally against HTTP APIs, browsers or models. MIT-licensed. NVIDIA LLM vulnerability scanner (Generative AI Red-teaming & Assessment Kit). Probes hallucination, leakage, prompt injection, jailbreaks and more. Generators include Hugging Face, OpenAI, Bedrock, NIM and REST. pip or conda, Python 3.11–3.13. Apache-2.0.
Last verified 2026-10-14 2026-10-14
Cited coverage (counts only) Maps to 8 NIST AI RMF functions or subcategories — see which with Pro Maps to 2 EU AI Act articles — see which with Pro No cited coverage cells in this bundle
Analyst assessments (counts only) Analyst assessment: 1 ISO/IEC 42001 clause — see which with Pro Analyst assessment: 1 NIST AI RMF function or subcategory — see which with Pro

Quoted evidence, who-it-is-for, deployment and caveats (Pro)

Included on Pro, Team and Enterprise. Public summaries, tags and official links on this page stay free.

See plans · Sign in

Questions

Which scanner names directory frameworks on the cited page?

Promptfoo. The cited red-team docs name NIST AI RMF, ISO/IEC 42001 and the EU AI Act. The garak listing has no framework tag from the cited NVIDIA page.

What license does each cited page name?

Promptfoo’s listing records MIT. garak’s listing records Apache-2.0. Those are the licenses on the official repos used for the listings.

Does a framework tag mean Promptfoo is certified to those instruments?

No. It means the cited docs name those instruments when describing plugin maps. Cell quotes stay on Pro.