AI Assurance DirectoryAI assurance tools for Cross-industry
General enterprise tools with no sector-specific claim on the cited page. Industry tags come from the cited public pages, not from our judgment.
-
Advai
UK AI testing and monitoring platform for performance, safety, security and robustness, with Defence & Government among named sectors. Platform covers agents, LLMs, computer vision, time series and multimodal systems; Model Arena for vendor selection.
-
Adversarial Robustness Toolbox (ART)
Python library hosted by LF AI & Data for evaluating and defending ML models against evasion, poisoning, extraction and inference. PyPI 1.20.1 (7 July 2025) lists Python 3.10–3.12. Supports TensorFlow, Keras, PyTorch and similar frameworks. MIT-licensed. DARPA HR001120C0013 acknowledgment.
-
AI Verify Testing Framework
Testing framework of 11 internationally recognised AI governance principles for Traditional and Generative AI. Mapped to NIST AI RMF (13 Oct 2023), NIST AI 600-1 (29 May 2025) and ISO/IEC 42001 (21 July 2025). IMDA/PDPC MVP 25 May 2022; GitHub 7 June 2023.
-
Algorithmic Impact Assessment (Canada AIA)
Treasury Board Secretariat questionnaire (65 risk and 41 mitigation questions) that scores automated decision systems into Levels I–IV under the Directive on Automated Decision-Making. Developed in the open under an MIT licence. Mandatory for in-scope Government of Canada systems.
-
Amazon Bedrock Guardrails
Configurable AWS safeguards for generative AI: content filters, denied topics, word lists, PII/sensitive-information filters, contextual grounding and Automated Reasoning checks. ApplyGuardrail can run those filters without invoking a foundation model.
-
Apptega (ISO 42001)
ISO 42001 compliance software with pre-built questionnaires, evidence collection, Audit Manager and harmonized multi-framework controls. Assigns tasks to internal teams and shares updates with auditors. The page names 12,000+ compliance programs and a Foresite Cybersecurity customer quote.
-
Arthur (Agent Security & Governance)
Discovers agents across endpoints, cloud and private data centers; traces tool calls; enforces policies and guardrails. Official page names fully hosted SaaS, on-prem, or hybrid. An Arthur column maps product evidence to ISO 42001, the EU AI Act and NIST AI RMF.
-
Asenion AI Control System
Asenion AI Control System turns EU AI Act, ISO/IEC 42001 and NIST AI RMF requirements into Assess, Verify and Witness controls with audit-grade evidence. Asenion is ISO/IEC 42001 certified for the Control System. A homepage quote names the former Fairly brand.
-
Azure AI Content Safety
Azure service with text and image APIs that detect sexual content, violence, hate and self-harm, plus Prompt Shields, groundedness detection, protected-material scanning and a Task adherence API. F0 and S0 tiers.
-
Check Point AI Guardrails
Check Point AI Guardrails (Guard API at api.lakera.ai/v2/guard) screens LLM and agent traffic for prompt attacks, data leakage, content violations and off-policy tool use. Model-agnostic; 100+ languages. Available as SaaS or self-hosted.
-
CISA Software Bill of Materials for AI — Minimum Elements
May 2026 joint CISA/G7 guidance on supplemental SBOM elements for SI software, plus general SBOM minimum elements. Live heading uses Super Intelligence (SI); the guidance title still says AI. Not exhaustive or mandatory. July 2026 general elements add no AI-only fields.
-
Cisco AI Defense
Cisco AI Defense: algorithmic red teaming across 200+ threat subcategories, AI Runtime Protection guardrails, and network-layer enforcement across cloud, VPC and on-premises AI POD. Datasheet maps findings to NIST AI-RMF.
-
Cloudflare AI Security for Apps
Cloudflare WAF detections for LLM apps (formerly Firewall for AI; docs updated 8 September 2026): PII, unsafe-topic and prompt-injection scanning of JSON requests to cf-llm endpoints. Model-agnostic. Enterprise paid add-on; the WAF must be enabled.
-
Collibra AI Command Center
Collibra AI Command Center (evolved from AI Governance; docs dated 7 October 2026): unified registry for AI agents, models and use cases, AI Trust Score, guardian agents and agent contracts. Out-of-the-box EU AI Act, NIST AI RMF and AI UC-1 assessment templates.
-
ControlMap (ISO 42001)
MSP-native GRC platform with ISO/IEC 42001 in a 63+ framework library: mapped controls, evidence and reporting. Partners import the framework to client tenants and cross-map against current frameworks. 2026 release notes add ISO 42001 Jump Start and an ISO 27001 crosswalk.
-
Counterfit
MIT-licensed CLI (banner Version 1.1.0) that wraps Adversarial Robustness Toolbox, TextAttack and AugLy to assess ML-system security. Linux or Windows WSL; optional Azure Container Instance. Python 3.8+. Windows and macOS native support is still listed as work in progress.
-
Credo AI
Enterprise AI governance with GAIA assistant, Agent Registry, 300+ integrations and ready-to-deploy policy packs for the EU AI Act, NIST AI RMF and ISO 42001. Named sectors: insurance, financial services, federal and healthcare.
-
Croissant (MLCommons)
MLCommons metadata format and Apache-2.0 Python library (pip install mlcroissant; Python 3.10+) that describes ML datasets in four layers, plus a v1.0 RAI vocabulary (dataBiases, dataLimitations, dataUseCases). Discoverable via Google Dataset Search; loaders for TensorFlow, JAX and PyTorch.
-
Drata (ISO 42001)
Compliance automation that maps ISO 42001 AI-management-system controls, evidence, ownership and risk so enterprises can run an AIMS and stay audit-ready. Help Center also names an AIMS policy template and automated evidence collection. Not a model-assurance tool.
-
EU AI Act Service Desk
Official Commission Service Desk and Single Information Platform for the AI Act (in force 1 August 2024). Explorer and Compliance Checker. Annex I civil-aviation entry is unmanned-aircraft-limited. Consolidated text as at 27 July 2026.
-
Fiddler AI
AI control plane for agentic and predictive models: continuous evaluations, inline guardrails and governance. Government page names DoD ML/LLM deployment, AWS GovCloud, and air-gapped options. Homepage FAQ names SaaS, VPC or on-premises.
-
garak
NVIDIA LLM vulnerability scanner (Generative AI Red-teaming & Assessment Kit). Probes hallucination, leakage, prompt injection, jailbreaks and more. Generators include Hugging Face, OpenAI, Bedrock, NIM and REST. pip or conda, Python 3.11–3.13. Apache-2.0.
-
Giskard
LLM-agent testing (Python SDK and Hub UI), red-teaming and runtime Guards with an EU AI Act Policy Pack (OPA/Rego). On-premise Hub for public-sector and defense workloads. Named sectors: banking and insurance.
-
Google Cloud Model Armor
Google Cloud service that screens LLM prompts and responses for responsible-AI safety categories, prompt injection and jailbreak, and sensitive data. Templates set confidence thresholds. Works on Google Cloud or other cloud providers.
-
Guardrails AI
Apache-2.0 Python framework (pip install guardrails-ai; Python 3.10–3.13) that runs Input/Output Guards of Hub validators on LLM traffic and can emit structured LLM output. Optional Flask server via guardrails start. Version 0.11.0.
-
HiddenLayer AI Security Platform
AI security platform with government and defense pages: NIST AI RMF alignment, contractor and open-source model scanning, real-time monitoring, and air-gapped options for classified disconnected environments. The homepage also names AI Discovery, supply-chain, attack simulation and runtime security.
-
Holistic AI
Identify, Protect and Enforce platform: shadow-AI discovery, agentic red-teaming and framework assessments for the EU AI Act, NIST AI RMF and ISO 42001. Guardian Agents (Sentinel watch/detect; Operative act/enforce) via the HAI Guardian SDK. 15+ read-only integrations.
-
Hugging Face Dataset Cards
Hub dataset documentation: each dataset README.md is a dataset card with YAML metadata. Force-modality tags (3d, audio, geospatial, image, tabular, text, timeseries, video) and RL-environment tags describe compatibility; they do not create a new repository type.
-
Hugging Face Model Cards
Hub model cards are README.md files with YAML metadata (license, datasets, library_name, pipeline_tag, model-index evals). CDAO's Generative AI RAI Toolkit names the Hugging Face model-card template as a documentation tool for traceability.
-
Hyperproof (ISO 42001)
Compliance operations platform with an out-of-the-box ISO 42001 AIMS template (Annex A) in a 160+ framework library. Guide covers Clauses 4–10, Annexes A–D and AI risk vs impact assessments. Crosswalks name NIST AI RMF. Audit Module for inviting the auditor.
-
IBM watsonx.governance
IBM AI governance product: enterprise inventory, shadow-AI detection, policy enforcement, and Compliance Accelerators that name the EU AI Act, ISO/IEC 42001 and NIST AI RMF. Sold for cloud and on-prem. Infosys 2,700+ use cases; US Open court-fairness case.
-
Inspect (UK AI Security Institute)
UK AISI MIT-licensed LLM evaluation framework (pip install inspect-ai; Python ≥3.10). 200+ ready-to-run evals, 20+ model providers, and sandboxes for Docker, Kubernetes, Modal, Proxmox and Vagrant.
-
ISMS.online (ISO 42001)
ISMS.online ISO 42001 page (Updated 14 July 2026): pre-configured templates and frameworks, dynamic risk management and document management. Certification described as valid three years with annual surveillance. ARM path from gap analysis to certification.
-
Llama Guard 4
Meta Llama Guard 4 (12B): natively multimodal safety classifier pruned from Llama 4 Scout. Classifies LLM prompts and responses against MLCommons hazard categories S1–S14. Runs on a single GPU; documented as a drop-in for Llama Guard 3 8B/11B. First output line is safe or unsafe.
-
Llama Prompt Guard 2
Meta Llama Prompt Guard 2 BERT classifiers (86M and 22M) that label a prompt string benign or malicious for prompt injection and jailbreaks. Drop-in replacement for Prompt Guard. Designed for Llama 4 Scout/Maverick and Llama 3. Llama 4 Community License.
-
MITRE ATLAS
MITRE public knowledge base of adversary tactics, techniques, mitigations and case studies against AI systems. Monthly YAML from atlas-data: latest content 2026.09 (15 September 2026), format 6.0.0, plus STIX, Excel and ATT&CK Navigator layers.
-
Model Card Toolkit
Archived Python toolkit (pip model-card-toolkit, Python 3.7+) that generates Model Cards as HTML from proto/JSON. The TFX ModelCardGenerator moved to tfx-addons from v2.0.0. Apache-2.0.
-
ModelOp
Enterprise AI Command Center (Center 3.3) that maps each use case to the EU AI Act, NIST AI RMF and ISO 42001, orchestrates reviews, generates model cards, and adds inline agent prompt-injection blocking. MADE integrates 50+ technologies.
-
Monitaur
AI governance for inventory, a 33-control library, FlightSim pre-deployment simulation (vendor: AI pen test) and Automate Record production logging mapped to NIST AI RMF, ISO 42001 and the EU AI Act.
-
NIST AI RMF Playbook
NIST AI RMF Playbook of suggested actions aligned to Govern, Map, Measure and Manage sub-categories in AI RMF 1.0. Neither a checklist nor a set of steps. Suggestions are voluntary. Downloadable as PDF, CSV, Excel and JSON. The Playbook will be updated after AI RMF 1.0 is revised.
-
NIST ARIA (Assessing Risks and Impacts of AI)
NIST ITL evaluation (Assessing Risks and Impacts of AI): sector- and task-agnostic model testing, red-teaming and field testing. LLM pilot. Schedule Kickoff May 2024 through Summer 2025 Pilot Summary Report Out. That report is still listed as coming soon.
-
NIST Dioptra
NIST test platform (docs and release 1.2.1) for assessing trustworthy characteristics of AI models. The official README says it supports the Measure function of the NIST AI RMF. Docker images for nginx, MLflow, REST API and CPU workers. Public source under CC BY 4.0.
-
NVIDIA NeMo Guardrails
Open-source Python toolkit (pip nemoguardrails; Python 3.10–3.13) that adds programmable input, dialog, retrieval, execution and output rails to LLM applications. Library plus optional FastAPI server. Apache-2.0.
-
OneTrust AI Governance
AI governance that inventories systems, agents, models, datasets and vendors; applies EU AI Act, NIST AI RMF and ISO 42001 templates; and describes runtime guardrails plus a Python AI Guard SDK on Amazon Bedrock, Microsoft Foundry, Databricks and Gemini.
-
Optro AI Governance
Enterprise AI governance that inventories models, agents and third-party apps and automates 25+ frameworks including the EU AI Act, ISO 42001 and NIST AI RMF. Shadow AI; agents draft and recommend, the team decides. fairnow.ai currently serves this product.
-
Palo Alto Prisma AIRS
Prisma AIRS AI Runtime Security: Network Intercept (inline firewall) and API Intercept (REST API/Python SDK) for prompt injection, jailbreak, memory poisoning and tool misuse. Network Intercept deploys on public cloud or on-premises microperimeter.
-
Portkey Guardrails
Guardrails on the Portkey AI Gateway: input and output checks with deny, log, fallback and retry. Failed checks can pass with HTTP 246 or kill the request with 446. Feature comparison names Portkey-Managed SaaS; new fully air-gapped deployments are no longer offered.
-
Promptfoo
Open-source gen-AI red-teaming tool that scans 50+ vulnerability types and maps plugins to the NIST AI RMF, ISO/IEC 42001 and EU AI Act. Runs locally against HTTP APIs, browsers or models. MIT-licensed.
-
PyRIT
Microsoft AI Red Team framework for automated and human-led generative-AI red teaming. Python 3.13 recommended; pip install pyrit. Ships Crescendo, TAP and Skeleton Key, CoPyRIT GUI, pyrit_scan/pyrit_shell, and SQLite or Azure SQL memory. MIT-licensed.
-
QuantPi
Enterprise AI validation layer that tests models, agents and physical AI before and after deployment. Public cloud, on-premises via HPE Private Cloud AI, and air-gapped. MCP integration; SSO/RBAC and zero data retention. TÜV Süd’s first CARAT partner laboratory worldwide.
-
Saidot
Graph-based AI governance platform: 260+ risks, 620+ controls, 110+ policies and 170+ third-party models. Product page: meet 110+ policies including ISO/IEC 42001 and NIST AI RMF, plus the EU AI Act workflow. Homepage names Azure Marketplace; ISO 27001 is the vendor ISMS.
-
Scytale (ISO 42001)
Compliance hub for an ISO 42001 AIMS: automated evidence collection, 24/7 continuous control monitoring, auditor-approved policy templates, vendor risk management and an audit dashboard. Cross-maps common controls with ISO 27001.
-
ServiceNow AI Control Tower
ServiceNow AI Control Tower inventories agents, models, copilots, MCP servers and datasets against the CMDB. Out-of-the-box content packs named for the EU AI Act and NIST AI RMF. Built on the ServiceNow AI Platform. Not an airborne runtime.
-
Sigstore model-transparency
Python CLI and API (model_signing) that signs ML models with Sigstore, keys or certificates so users can verify integrity and provenance. DSSE in-toto bundle; optional PKCS #11. Apache-2.0.
-
SPDX AI Profile
SPDX 3.0.1 AI Profile for documenting AI packages, models and datasets. Conformant AIPackage elements must carry hasConcludedLicense and hasDeclaredLicense. Records training, limitations, safety-risk level (serious/high/medium/low) and energy use by stage.
-
Sprinto (ISO 42001)
Autonomous trust platform for an audit-ready ISO/IEC 42001 AIMS. Heading: Get ISO 42001 ready, minus the grunt work. 4,000+ customers; AI discovery across extensions, devices, integrations and SSO; real-time policy-drift reviews; one-click Trust Centre.
-
Strike Graph (ISO 42001)
Compliance platform for ISO 42001 AIMS: pre-loaded mapped controls, 100% pre-built AIMS policy and procedure templates, Verify AI documentation checks, gap analysis, evidence dashboards and export to an external assessor.
-
Thoropass (ISO 42001)
ISO 42001 compliance and audit platform with pre-built policy templates, an AI System Impact Assessment, automated evidence collection, a Risk Register, continuous monitoring, and one-audit-multiple-frameworks evidence reuse from a single platform.
-
Trustible
AI governance platform for regulated enterprises: intake, inventory, risk triaging and continuous monitoring. Maps controls to the EU AI Act, NIST AI RMF and ISO 42001. Official 10 April 2026 Leidos story covers defense, intelligence, civil and health programs.
-
Vanta
Compliance automation covering ISO 42001, NIST AI RMF and CMMC (mapped to NIST SP 800-171/172). The ISO 42001 product page also maps evidence to the EU AI Act. Not an AI-model assurance tool.
Questions
Why are only these tools tagged Cross-industry?
Industry tags come from the cited public pages, not from our judgment. If a vendor page does not name this industry, the listing does not get the tag.
Where is the cited industry overview?
This filter is built from tool tags only. Cited industry overviews cover aerospace, defense, space, safety-critical work, automotive, medical devices, industrial machinery and process industries.