Tool directory
Each listing cites a public source and quotes what that page says. Framework tags appear only when the cited page names the framework. The open-source badge is used only when the official repository shows an OSI license. Compare two to four listings using that cited data. The Arthur listing is a free Sample Pro unlock.
No listed tool matches these filters. That can be a real gap: we only list tools whose public pages name the framework or industry.
-
6clicks (ISO 42001)
GRC with a pre-configured ISO/IEC 42001:2023 AIMS, Hailey AI mapping, SoA and Hub & Spoke. Cross-maps ISO 27001 and the EU AI Act. Homepage names SaaS, sovereign cloud or on-prem, and cloud, on-premises, air-gapped or hybrid.
-
AADvance Control System
Distributed, scalable safety instrumented system with fail-safe to TMR architectures. Official page: IEC 61508 certified (TÜV and Exida); TÜV-suitable for IEC 61508 up to SIL 3 and IEC 61511-1. SIL 1–3 in the same system. Not an AI-management platform.
-
ABB High Integrity I/O (S800 and Select I/O)
ABB SIL3 I/O for System 800xA High Integrity. Select I/O High Integrity is listed as certified for IEC 61508-SIL3 and compatible with AC 800M controllers using SM812. Page does not name IEC 61511. Not an AI-management platform.
-
ABB System 800xA High Integrity
ABB describes System 800xA High Integrity as a TÜV-certified SIL3 safety system and a complete SIS, deployable with System 800xA or independently. Page says it gives flexibility to meet IEC 61508 and IEC 61511 requirements. Not an AI-management platform.
-
Adelard ASCE
Assurance-case software with CAE (including ASCAD 2.0 for autonomous systems and AI-driven machine-learning behaviour) and GSN Version 3 plus a Modular GSN plugin. Node-locked and floating licences; both can operate with limited or no Internet. Customer stories name MoD DE&S QEC ATM and aerospace.
-
Advai
UK AI testing and monitoring platform for performance, safety, security and robustness, with Defence & Government among named sectors. Platform covers agents, LLMs, computer vision, time series and multimodal systems; Model Arena for vendor selection.
-
Adversarial Robustness Toolbox (ART)
Python library hosted by LF AI & Data for evaluating and defending ML models against evasion, poisoning, extraction and inference. PyPI 1.20.1 (7 July 2025) lists Python 3.10–3.12. Supports TensorFlow, Keras, PyTorch and similar frameworks. MIT-licensed. DARPA HR001120C0013 acknowledgment.
-
AdvoCATE
NASA Ames Assurance Case Automation Toolset for GSN arguments, hazard analysis, bow-tie risk models and verification artifacts. NTRS User Guide 1.4 covers safety risk management. DARPA Assured Autonomy acknowledgment.
-
aeShield
Functional-safety documentation platform for IEC 61511 SIL calculations, SRS, cause-and-effect and test plans. Official page heading: IEC 61511 Functional Safety Compliance Made Simple. Not an AI-management platform.
-
AI Practitioner's Handbook (AIPH)
UK MOD Part 2-style handbook (BETA) to comply with JSP 936 Part 1. Guidance for leaders, developers and users. DAIC AI Assurance Framework (Published 27 February 2026) covers people, process, evidence and technology; names SROs and RAISOs.
-
AI Verify Testing Framework
Testing framework of 11 internationally recognised AI governance principles for Traditional and Generative AI. Mapped to NIST AI RMF (13 Oct 2023), NIST AI 600-1 (29 May 2025) and ISO/IEC 42001 (21 July 2025). IMDA/PDPC MVP 25 May 2022; GitHub 7 June 2023.
-
Algorithmic Impact Assessment (Canada AIA)
Treasury Board Secretariat questionnaire (65 risk and 41 mitigation questions) that scores automated decision systems into Levels I–IV under the Directive on Automated Decision-Making. Developed in the open under an MIT licence. Mandatory for in-scope Government of Canada systems.
-
Aligned Elements
Medical-device ALM and eQMS for design-control and technical-file work. Homepage names pre-defined IEC 62304 Design Control templates. Regulatory-compliance page names IEC 62304-1:2015 software safety classification. Not an FDA PCCP product.
-
Amazon Bedrock Guardrails
Configurable AWS safeguards for generative AI: content filters, denied topics, word lists, PII/sensitive-information filters, contextual grounding and Automated Reasoning checks. ApplyGuardrail can run those filters without invoking a foundation model.
-
Ansys medini analyze
Model-based safety analysis (HAZOP, HARA, FTA, FMEA/FMEDA) for E/E and software. Named standards: ISO 26262, IEC 61508, ARP 4761, ISO 21448 (SOTIF) and MIL-STD-882E. SOTIF covers hazards from sensor and perception-algorithm limitations. Not a model verifier.
-
Ansys SCADE Suite
Model-based development environment for critical embedded software. KCG C/Ada code generator is qualified as a development tool for DO-178B up to Level A and DO-178C/DO-330 at TQL-1. Avionics and Flight Controls named. Not a neural-network verifier.
-
Apptega (ISO 42001)
ISO 42001 compliance software with pre-built questionnaires, evidence collection, Audit Manager and harmonized multi-framework controls. Assigns tasks to internal teams and shares updates with auditors. The page names 12,000+ compliance programs and a Foresite Cybersecurity customer quote.
-
Arthur (Agent Security & Governance)
Discovers agents across endpoints, cloud and private data centers; traces tool calls; enforces policies and guardrails. Official page names fully hosted SaaS, on-prem, or hybrid. An Arthur column maps product evidence to ISO 42001, the EU AI Act and NIST AI RMF.
-
Asenion AI Control System
Asenion AI Control System turns EU AI Act, ISO/IEC 42001 and NIST AI RMF requirements into Assess, Verify and Witness controls with audit-grade evidence. Asenion is ISO/IEC 42001 certified for the Control System. A homepage quote names the former Fairly brand.
-
Astah System Safety (GSN)
GSN modeling in Astah System Safety. Names GSN Community Standard version 1.0 and OMG SACM (ARM) import/export, plus SysML Requirement-to-Goal sync, STPA/STAMP, Auto-Layout and an in-app Script Editor. Marketing page lists automotive (ISO 26262), aerospace (DO-178B), rail, nuclear and defense.
-
Astrée
Sound static analyzer for safety-critical C and C++. Names hazard identification against ISO 26262, DO-178C, IEC-61508 and EN-50128, plus Qualification Support Kits for those standards. Bosch Automotive Steering and Airbus are named users. Not a neural-network verifier.
-
Azure AI Content Safety
Azure service with text and image APIs that detect sexual content, violence, hate and self-harm, plus Prompt Shields, groundedness detection, protected-material scanning and a Task adherence API. F0 and S0 tiers.
-
BTC TestStack
Testing stack (successor to BTC EmbeddedPlatform / EmbeddedTester) for model-based, hand-written and AI-generated code. TÜV Süd certificate names ISO 26262 (automotive), IEC 61508-3 (industrial) and IEC 62304 (medical). ISO 26262 TCL including ASIL D.
-
CAISAR
CEA List open-source platform (CAISAR 6.0, June 2026) for characterizing AI safety and robustness. WhyML specifications discharged by PyRAT, Marabou, nnenum, alpha-beta-CROWN and others. Examples include functional properties of ACAS Xu.
-
CDAO AI Assurance (AIA) Toolkit
CDAO self-evaluation toolkit that operationalizes DoW AI Ethical Principles. Released November 2023 as the RAI Toolkit; the live Tradewinds page titles it AIA Toolkit. For Program Managers, AI Developers, Acquisition Teams, Legal/Compliance and End Users; IL2 and IL5.
-
CDAO Joint AI Test Infrastructure Capability (JATIC)
CDAO program (funded FY23–FY29) of Python AI T&E libraries, the RAVEN MLOps platform and the maite types/protocols. Focused on CV classification and object detection for UAV, satellite and autonomous-driving missions. Public packages on GitHub, Conda and PyPI. Not a certification.
-
CDAO Test and Evaluation of Artificial Intelligence Models Framework
April 2024 public CDAO primer on what to consider in a T&E strategy for AI models in a Defense context. Four focus areas, a performance iceberg beyond correctness, and named links to the DoD Ethical AI Principles and NIST AI RMF. Explicitly not binding policy.
-
Check Point AI Guardrails
Check Point AI Guardrails (Guard API at api.lakera.ai/v2/guard) screens LLM and agent traffic for prompt attacks, data leakage, content violations and off-policy tool use. Model-agnostic; 100+ languages. Available as SaaS or self-hosted.
-
CISA Software Bill of Materials for AI — Minimum Elements
May 2026 joint CISA/G7 guidance on supplemental SBOM elements for SI software, plus general SBOM minimum elements. Live heading uses Super Intelligence (SI); the guidance title still says AI. Not exhaustive or mandatory. July 2026 general elements add no AI-only fields.
-
Cisco AI Defense
Cisco AI Defense: algorithmic red teaming across 200+ threat subcategories, AI Runtime Protection guardrails, and network-layer enforcement across cloud, VPC and on-premises AI POD. Datasheet maps findings to NIST AI-RMF.
-
Cloudflare AI Security for Apps
Cloudflare WAF detections for LLM apps (formerly Firewall for AI; docs updated 8 September 2026): PII, unsafe-topic and prompt-injection scanning of JSON requests to cf-llm endpoints. Model-agnostic. Enterprise paid add-on; the WAF must be enabled.
-
CODESYS Virtual Safe Control SL
Virtual safety controller in a Linux container. Official page: certified according to IEC 61508 for SIL 3 applications, without IEC 61508 hardware certification of the host. TÜV SÜD. Diversified Encoding dual-channel. Not a trained-model SIL.
-
Collibra AI Command Center
Collibra AI Command Center (evolved from AI Governance; docs dated 7 October 2026): unified registry for AI agents, models and use cases, AI Trust Score, guardian agents and agent contracts. Out-of-the-box EU AI Act, NIST AI RMF and AI UC-1 assessment templates.
-
ComplianceQuest Medical Device QMS
Salesforce-native QMS and PLM for medical device manufacturers. Official SaMD page names FDA Predetermined Change Control Plans (PCCP), IEC 62304 lifecycle requirements, cybersecurity documentation and IMDRF SaMD guidance. Not a model verifier.
-
ControlMap (ISO 42001)
MSP-native GRC platform with ISO/IEC 42001 in a 63+ framework library: mapped controls, evidence and reporting. Partners import the framework to client tenants and cross-map against current frameworks. 2026 release notes add ISO 42001 Jump Start and an ISO 27001 crosswalk.
-
Counterfit
MIT-licensed CLI (banner Version 1.1.0) that wraps Adversarial Robustness Toolbox, TextAttack and AugLy to assess ML-system security. Linux or Windows WSL; optional Azure Container Instance. Python 3.8+. Windows and macOS native support is still listed as work in progress.
-
Credo AI
Enterprise AI governance with GAIA assistant, Agent Registry, 300+ integrations and ready-to-deploy policy packs for the EU AI Act, NIST AI RMF and ISO 42001. Named sectors: insurance, financial services, federal and healthcare.
-
Croissant (MLCommons)
MLCommons metadata format and Apache-2.0 Python library (pip install mlcroissant; Python 3.10+) that describes ML datasets in four layers, plus a v1.0 RAI vocabulary (dataBiases, dataLimitations, dataUseCases). Discoverable via Google Dataset Search; loaders for TensorFlow, JAX and PyTorch.
-
CycloneDX (AI/ML-BOM)
OWASP/Ecma TC54 BOM standard (CycloneDX 1.7, released 21 October 2025) published as ECMA-424 2nd edition (10 December 2025). Homepage names 260+ tools, the defense industrial base, satellite and space systems, and medical-device HBOM/SBOM. The ML-BOM guide names the EU AI Act and NIST AI RMF.
-
DeltaV SIS
Safety instrumented system used across process industries for ESD, burner management, fire and gas and pipeline. Official brochure: meets IEC 61508 and IEC 61511 requirements for physical separation; built for IEC 61511 compliance; TÜV and exida certified for SIL 3 without restriction.
-
Drata (ISO 42001)
Compliance automation that maps ISO 42001 AI-management-system controls, evidence, ownership and risk so enterprises can run an AIMS and stay audit-ready. Help Center also names an AIMS policy template and automated evidence collection. Not a model-assurance tool.
-
Edge Case
Safety-as-a-Service: Guardian Digital Safety Twin plus AI/ML software-safety, system-safety engineering, T&E and certification practices. The homepage names AUSA 2025 defense programs and quotes Aurora on third-party safety expertise.
-
ENVOLOK
Command-line program that checks a modification against an FDA-authorized Predetermined Change Control Plan before it ships. Official page: DEPLOY, BLOCK or UNKNOWN; offline; no network calls during evaluation. Not a QMS or model verifier.
-
ERAN
ETH SRI Lab Apache-2.0 analyzer (DeepZ, DeepPoly, GPUPoly) for complete and incomplete verification of feedforward, convolutional and residual networks, including ACAS Xu. Python 3.6+ and TensorFlow 1.11+. Uses ELINA; Gurobi for RefineZono/RefinePoly.
-
EU AI Act Service Desk
Official Commission Service Desk and Single Information Platform for the AI Act (in force 1 August 2024). Explorer and Compliance Checker. Annex I civil-aviation entry is unmanned-aircraft-limited. Consolidated text as at 27 July 2026.
-
exSILentia
Modular safety-lifecycle suite for process-safety management and SIS functional-safety work. Official module table includes IEC 61511 Compliance Documentation and SILver, an IEC 61508 compliant SIL-verification calculation engine. Not an AI-management platform.
-
Fiddler AI
AI control plane for agentic and predictive models: continuous evaluations, inline guardrails and governance. Government page names DoD ML/LLM deployment, AWS GovCloud, and air-gapped options. Homepage FAQ names SaaS, VPC or on-premises.
-
Foretellix Foretify
Foretify Physical AI Development Toolchain for training and validation of AI-powered autonomous-vehicle stacks: data curation, synthetic scenario generation, and coverage and safety-evidence evaluation. Not an aviation AMC.
-
garak
NVIDIA LLM vulnerability scanner (Generative AI Red-teaming & Assessment Kit). Probes hallucination, leakage, prompt injection, jailbreaks and more. Generators include Hugging Face, OpenAI, Bedrock, NIM and REST. pip or conda, Python 3.11–3.13. Apache-2.0.
-
Giskard
LLM-agent testing (Python SDK and Hub UI), red-teaming and runtime Guards with an EU AI Act Policy Pack (OPA/Rego). On-premise Hub for public-sector and defense workloads. Named sectors: banking and insurance.
-
Google Cloud Model Armor
Google Cloud service that screens LLM prompts and responses for responsible-AI safety categories, prompt injection and jailbreak, and sensitive data. Templates set confidence thresholds. Works on Google Cloud or other cloud providers.
-
Greenlight Guru (SiMD/SaMD)
QMS and product-development software for software-enabled medical devices (SiMD/SaMD). Official page says the solution auto-generates audit-ready records to stay compliant with IEC 62304, linking tests and design changes to the DHF. Not an FDA PCCP authoring product.
-
GRIF SIL module
SIL calculation and verification software in the GRIF suite. Page headline: assessment of the availability level according to IEC 61508 and IEC 61511. Lists PFD and PFH computation and HFT and architectural constraints. Not an AI-management platform.
-
Guardrails AI
Apache-2.0 Python framework (pip install guardrails-ai; Python 3.10–3.13) that runs Input/Output Guards of Hub validators on LLM traffic and can emit structured LLM output. Optional Flask server via guardrails start. Version 0.11.0.
-
HEART (Hardened Extension of ART)
MIT-licensed Python 3.9–3.11 library (pip install heart-library; 0.7.0) that extends ART for DoD T&E. Modules: attacks, estimators, metrics. Aligns to MAITE; depends on ART ≥1.20.1. CDAO contract W519TC-23-9-2037. Optional Gradio front end.
-
HiddenLayer AI Security Platform
AI security platform with government and defense pages: NIST AI RMF alignment, contractor and open-source model scanning, real-time monitoring, and air-gapped options for classified disconnected environments. The homepage also names AI Discovery, supply-chain, attack simulation and runtime security.
-
HIMA HIMax
Fault-tolerant safety controller for process-industry SIS including fire-and-gas. Official fire-and-gas page: TÜV-certified HIMax suitable for use up to SIL 3 and certified in accordance with IEC 61511 up to SIL 3. Not an AI-management platform.
-
Holistic AI
Identify, Protect and Enforce platform: shadow-AI discovery, agentic red-teaming and framework assessments for the EU AI Act, NIST AI RMF and ISO 42001. Guardian Agents (Sentinel watch/detect; Operative act/enforce) via the HAI Guardian SDK. 15+ read-only integrations.
-
Honeywell Safety Manager SC
Third-generation QMR (2oo4D) safety platform for ESD/SIS applications in the Process Control industry. TÜV Rheinland certified up to SIL 3. Official standards list includes IEC 61508/61511. Not an AI-management platform.
-
Hugging Face Dataset Cards
Hub dataset documentation: each dataset README.md is a dataset card with YAML metadata. Force-modality tags (3d, audio, geospatial, image, tabular, text, timeseries, video) and RL-environment tags describe compatibility; they do not create a new repository type.
-
Hugging Face Model Cards
Hub model cards are README.md files with YAML metadata (license, datasets, library_name, pipeline_tag, model-index evals). CDAO's Generative AI RAI Toolkit names the Hugging Face model-card template as a documentation tool for traceability.
-
Hyperproof (ISO 42001)
Compliance operations platform with an out-of-the-box ISO 42001 AIMS template (Annex A) in a 160+ framework library. Guide covers Clauses 4–10, Annexes A–D and AI risk vs impact assessments. Crosswalks name NIST AI RMF. Audit Module for inviting the auditor.
-
IARPA TrojAI
IARPA program (BAA W911NF-19-S-0012, closed) and NIST T&E resources for detecting Trojan/backdoor attacks in trained AIs before deployment. T&E partners: JHU APL, NIST, SEI and Sandia. NIST still hosts a leaderboard and baseline detector; that page is no longer updated.
-
IBM watsonx.governance
IBM AI governance product: enterprise inventory, shadow-AI detection, policy enforcement, and Compliance Accelerators that name the EU AI Act, ISO/IEC 42001 and NIST AI RMF. Sold for cloud and on-prem. Infosys 2,700+ use cases; US Open court-fairness case.
-
IEC Certification Kit (for ISO 26262 and IEC 61508)
MathWorks kit of TÜV SÜD certificates and qualification work products for ISO 26262 (ASIL A–D), IEC 61508 (SIL 1–4) and IEC 62304. Supported-products table names IEC 61511:2016 for PLC Coder. ISO 26262 guidance covers AI-assisted model editing, review and test generation.
-
Inspect (UK AI Security Institute)
UK AISI MIT-licensed LLM evaluation framework (pip install inspect-ai; Python ≥3.10). 200+ ready-to-run evals, 20+ model providers, and sandboxes for Docker, Kubernetes, Modal, Proxmox and Vagrant.
-
INTEGRITY RTOS
Separation-kernel RTOS with integrated platforms for automotive, industrial safety, medical devices and avionics. Certifications named: ISO 26262 ASIL D, IEC 61508 SIL 3, FDA Class II and Class III medical device approval, and DO-178B/C DAL A for INTEGRITY-178. Not an AI model verifier.
-
ISMS.online (ISO 42001)
ISMS.online ISO 42001 page (Updated 14 July 2026): pre-configured templates and frameworks, dynamic risk management and document management. Certification described as valid three years with annual surveillance. ARM path from gap analysis to certification.
-
Jama Connect for Medical Device & Life Sciences
Requirements, risk and V&V platform for medical device and life-sciences teams. Official frameworks list includes Medical Software Development: IEC 62304, plus FDA 21 CFR 820.30, EU MDR and ISO 14971. Suitably validated by TÜV SÜD for safety-related development. Not an FDA PCCP product.
-
Kenexis SIS
Safety-lifecycle tool formerly named Vertigo. Page heading: ISA/IEC 61511 SIS Lifecycle Management and SIL Verification. Lists a SIL verification calculation engine, failure rate database, SRS documentation and dashboards. Not an AI-management platform.
-
KUKA iiQKA.OS2
Operating system and virtual robot controller for KUKA industrial robots. Official page: AI-capable, ready for ISO 10218:2025 and new machinery regulations; compliant with the machinery regulations (MACH REG). LINUX-based. Not a trained-model SIL.
-
LDRA (AI and machine learning capability)
LDRA AI/ML capability page covering test generation, change-impact analysis and AI/ML in safety-critical sectors. The aviation section names EASA guidance for Level 1 and 2 machine-learning applications. Not a neural-network verifier.
-
Llama Guard 4
Meta Llama Guard 4 (12B): natively multimodal safety classifier pruned from Llama 4 Scout. Classifies LLM prompts and responses against MLCommons hazard categories S1–S14. Runs on a single GPU; documented as a drop-in for Llama Guard 3 8B/11B. First output line is safe or unsafe.
-
Llama Prompt Guard 2
Meta Llama Prompt Guard 2 BERT classifiers (86M and 22M) that label a prompt string benign or malicious for prompt injection and jailbreaks. Drop-in replacement for Prompt Guard. Designed for Llama 4 Scout/Maverick and Llama 3. Llama 4 Community License.
-
LYNX MOSA.ic.AI
Deterministic CPU and GPU runtime for AI at the mission-critical edge. Combines MOSA.ic with CoreSuite; not a training platform. The 8 April 2026 launch names a path to DO-178C, not a completed product certificate.
-
Marabou
SMT-based neural-network verifier (Marabou 2.0). ONNX main format; also .nnet, TensorFlow and VNNLIB. pip install maraboupy (Python 3.8–3.11). Default: DeepPoly bound tightening and DeepSoI. Optional Gurobi, parallelism and Split-and-Conquer. ACAS Xu example. Research product.
-
MathWorks AI Verification Library for Deep Learning Toolbox
Formal robustness verification, output bounds, adversarial examples and out-of-distribution detection for MATLAB, ONNX and PyTorch networks, with airborne runway-sign and ACAS Xu worked examples.
-
MathWorks DO Qualification Kit
Documentation, test cases and procedures to qualify supported Simulink and Polyspace tools for DO-178C, DO-278A, DO-254 and DO-330. The FAQ says the kit does not prequalify tools; qualification is project-specific.
-
MITRE ATLAS
MITRE public knowledge base of adversary tactics, techniques, mitigations and case studies against AI systems. Monthly YAML from atlas-data: latest content 2026.09 (15 September 2026), format 6.0.0, plus STIX, Excel and ATT&CK Navigator layers.
-
Model Card Toolkit
Archived Python toolkit (pip model-card-toolkit, Python 3.7+) that generates Model Cards as HTML from proto/JSON. The TFX ModelCardGenerator moved to tfx-addons from v2.0.0. Apache-2.0.
-
ModelOp
Enterprise AI Command Center (Center 3.3) that maps each use case to the EU AI Act, NIST AI RMF and ISO 42001, orchestrates reviews, generates model cards, and adds inline agent prompt-injection blocking. MADE integrates 50+ technologies.
-
Monitaur
AI governance for inventory, a 33-control library, FlightSim pre-deployment simulation (vendor: AI pen test) and Automate Record production logging mapped to NIST AI RMF, ISO 42001 and the EU AI Act.
-
NASA ProgPy
NASA ProgPy 1.8.0 (2024 NASA Software of the Year): pip install progpy; Python ≥3.9,<3.14. PHM and remaining-useful-life research with an optional LSTM datadriven extra and a prog_server SOA. Partners named: DLR, Northrop Grumman and Vanderbilt. NASA-1.3 — no OSI badge.
-
NASA SWEHB Artificial Intelligence topics (7.25 and 8.25)
NASA SWEHB AI/ML topics under NPR 7150.2. Official titles: 7.25 - Artificial Intelligence And Software Engineering and 8.25 - Artificial Intelligence And Software Assurance. Topic 7.25 names OCE, OSMA, OCHMO and OCIO and keeps AI non-safety-critical without an approved AI safety case.
-
Neural Network Dependability Kit (NNDK)
Open-source fortiss toolbox for engineering neural networks in safety-critical domains: dependability metrics, test-case generation, formal verification and runtime neuron-activation-pattern monitoring. Jupyter examples on GTSRB, MNIST, KITTI. Used in driving, medical imaging and space navigation.
-
NIST AI RMF Playbook
NIST AI RMF Playbook of suggested actions aligned to Govern, Map, Measure and Manage sub-categories in AI RMF 1.0. Neither a checklist nor a set of steps. Suggestions are voluntary. Downloadable as PDF, CSV, Excel and JSON. The Playbook will be updated after AI RMF 1.0 is revised.
-
NIST ARIA (Assessing Risks and Impacts of AI)
NIST ITL evaluation (Assessing Risks and Impacts of AI): sector- and task-agnostic model testing, red-teaming and field testing. LLM pilot. Schedule Kickoff May 2024 through Summer 2025 Pilot Summary Report Out. That report is still listed as coming soon.
-
NIST Dioptra
NIST test platform (docs and release 1.2.1) for assessing trustworthy characteristics of AI models. The official README says it supports the Measure function of the NIST AI RMF. Docker images for nginx, MLflow, REST API and CPU workers. Public source under CC BY 4.0.
-
nnenum
Python 3.9+ neural-network verifier (pip install .; nnenum 1.0.1, GPL-3.0-or-later) for ReLU networks. Combines zonotopes with star sets, uses the ImageStar trick through ONNX Runtime, and ships ACAS Xu ONNX/vnnlib examples. VNN-COMP 2020: only tool to verify all ACAS-Xu benchmarks.
-
NNV (Neural Network Verification Toolbox)
MATLAB toolbox for set-based neural-network verification using Star sets and zonotopes. 10+ architectures and 48 layer types; ONNX and VNNLIB. Official aerospace domain and all 45 ACAS Xu networks. AFOSR, DARPA and NSF.
-
NVIDIA NeMo Guardrails
Open-source Python toolkit (pip nemoguardrails; Python 3.10–3.13) that adds programmable input, dialog, retrieval, execution and output rails to LLM applications. Library plus optional FastAPI server. Apache-2.0.
-
OneTrust AI Governance
AI governance that inventories systems, agents, models, datasets and vendors; applies EU AI Act, NIST AI RMF and ISO 42001 templates; and describes runtime guardrails plus a Python AI Guard SDK on Amazon Bedrock, Microsoft Foundry, Databricks and Gemini.
-
Optro AI Governance
Enterprise AI governance that inventories models, agents and third-party apps and automates 25+ frameworks including the EU AI Act, ISO 42001 and NIST AI RMF. Shadow AI; agents draft and recommend, the team decides. fairnow.ai currently serves this product.
-
Palo Alto Prisma AIRS
Prisma AIRS AI Runtime Security: Network Intercept (inline firewall) and API Intercept (REST API/Python SDK) for prompt injection, jailbreak, memory poisoning and tool misuse. Network Intercept deploys on public cloud or on-premises microperimeter.
-
Parasoft C/C++test
Unified C/C++ static analysis, unit testing, MC/DC coverage and requirements traceability. TÜV SÜD–certified C/C++test names automotive (ISO 26262), medical (IEC 62304), industrial (IEC 61508) and aerospace/defense (DO-178C DAL A). Badges also list ISO/PAS 8800.
-
Perforce QAC
Static analyzer for C, C++ and Rust (formerly Helix QAC). TÜV SÜD certified for ISO 26262 (automotive) up to ASIL D, IEC 61508 (general industry) up to SIL 4, and IEC 62304 (medical devices) up to Software Safety Class C. Also names a DO-330 pack for DO-178C. Not a neural-network verifier.
-
Portkey Guardrails
Guardrails on the Portkey AI Gateway: input and output checks with deny, log, fallback and retry. Failed checks can pass with HTTP 246 or kill the request with 446. Feature comparison names Portkey-Managed SaaS; new fully air-gapped deployments are no longer offered.
-
PREMIS
Web assurance-case tool for modular GSN arguments, including Eliminative Argumentation defeaters, an AI Assistant, Safety Performance Indicators, and CI/CD or API integration. Supports Core GSN and partially Modular and Argument Pattern Extensions. Metamodel named OMG SACM and ISO/IEC 15026.
-
Promptfoo
Open-source gen-AI red-teaming tool that scans 50+ vulnerability types and maps plugins to the NIST AI RMF, ISO/IEC 42001 and EU AI Act. Runs locally against HTTP APIs, browsers or models. MIT-licensed.
-
PyRAT
CEA List neural-network verifier (Python Reachability Assessment Tool) using abstract interpretation. Site: VNN-COMP 2024 second place, all 12 regular-track benchmarks, more than 1700 properties, ACAS-XU collision-avoidance example. CAISAR news ranks PyRAT third at VNN-Comp 2026.
-
PyRIT
Microsoft AI Red Team framework for automated and human-led generative-AI red teaming. Python 3.13 recommended; pip install pyrit. Ships Crescendo, TAP and Skeleton Key, CoPyRIT GUI, pyrit_scan/pyrit_shell, and SQLite or Azure SQL memory. MIT-licensed.
-
QNX OS for Safety
Safety-certified microkernel RTOS (QOS 8.0) certified by TÜV Rheinland to ISO 26262 ASIL D, IEC 61508 SIL 3, IEC 62304 Class C and ISO/SAE 21434. C/C++ toolchains classified TCL3/T3. FAQ names car, surgical robot, drone, power plant, machinery and control systems. Not an airborne runtime.
-
QuantPi
Enterprise AI validation layer that tests models, agents and physical AI before and after deployment. Public cloud, on-premises via HPE Private Cloud AI, and air-gapped. MCP integration; SSO/RBAC and zero data retention. TÜV Süd’s first CARAT partner laboratory worldwide.
-
Rapita Verification Suite (RVS)
Rapita Verification Suite for requirements-based testing, MC/DC coverage, WCET timing and scheduling visualization. Qualification kits for DO-178C; kits have supported more than 20 DO-178B and C projects up to DAL A. Rapi Coupling is in development (expected H1 2027).
-
Re:In (Moasoftware)
Data-quality platform the vendor maps to ARP6983/ED-324 §§6.2–6.5 (bias, diversity, sufficiency, balance, augmentation, reliability reports). W-Shape four stages. Dated 25 August 2026; updated 6 October 2026.
-
Resaro Approved Intelligence Platform
On-premise, air-gapped TEVV platform that produces ASQI-structured deployment evidence for civil and defence AI. CI/CD-native workflows over text and image; used in the IMDA/AI Verify Global AI Assurance Pilot.
-
Saidot
Graph-based AI governance platform: 260+ risks, 620+ controls, 110+ policies and 170+ third-party models. Product page: meet 110+ policies including ISO/IEC 42001 and NIST AI RMF, plus the EU AI Act workflow. Homepage names Azure Marketplace; ISO 27001 is the vendor ISMS.
-
Saimple
Static analyzer that uses abstract interpretation to assess neural-network robustness, citing ISO/IEC 24029. Sold as SaaS and on-premises. Numalis names Article 15 explainability reports and EASA MLEAP work.
-
Scytale (ISO 42001)
Compliance hub for an ISO 42001 AIMS: automated evidence collection, 24/7 continuous control monitoring, auditor-approved policy templates, vendor risk management and an audit dashboard. Cross-maps common controls with ISO 27001.
-
Secureframe (defense contractor offering)
CMMC and CUI platform for the Defense Industrial Base. Secureframe Defense automates enclave, documentation and monitoring; the CMMC page names GCC High, Defense Navigator, FedRAMP Moderate MDM and a CyberAB RPO listing. Not an AI-model assurance tool.
-
ServiceNow AI Control Tower
ServiceNow AI Control Tower inventories agents, models, copilots, MCP servers and datasets against the CMDB. Out-of-the-box content packs named for the EU AI Act and NIST AI RMF. Built on the ServiceNow AI Platform. Not an airborne runtime.
-
Sigstore model-transparency
Python CLI and API (model_signing) that signs ML models with Sigstore, keys or certificates so users can verify integrity and provenance. DSSE in-toto bundle; optional PKCS #11. Apache-2.0.
-
SILability
SIL verification software for SIFs. Page title: SIL Verification Software for IEC 61508/61511. Supports architectural constraint models for IEC 61508 (Route 1H and 2H) and IEC 61511 (2003 and 2016 editions), low, high and continuous demand. Not an AI-management platform.
-
SILcet
SIL verification tool for safety instrumented functions, offered as SILcet Cloud and SILcet Pro Plus. Official page says it complies with IEC 61508, IEC 61511 and ISA TR84.00.02. Not an AI-management platform.
-
SIMATIC PCS 7 Safety
Process-industry safety integrated with SIMATIC PCS 7. SIMATIC S7 Safety Matrix (Engineering Tool and Viewer) is described as a holistic approach to functional safety in accordance with IEC 61511 across the safety lifecycle. Architectures certified up to SIL 3. Not an AI-management platform.
-
SPDX AI Profile
SPDX 3.0.1 AI Profile for documenting AI packages, models and datasets. Conformant AIPackage elements must carry hasConcludedLicense and hasDeclaredLicense. Records training, limitations, safety-risk level (serious/high/medium/low) and energy use by stage.
-
Sprinto (ISO 42001)
Autonomous trust platform for an audit-ready ISO/IEC 42001 AIMS. Heading: Get ISO 42001 ready, minus the grunt work. 4,000+ customers; AI discovery across extensions, devices, integrations and SSO; real-time policy-drift reviews; one-click Trust Centre.
-
Stages Process Management Software
Process-management software with bidirectional traceability between process models and standard objectives. Official table names ISO 26262, ISO/PAS 8800 and UL 4600 under Automotive; IEC 62304 under Medical devices; IEC 61508 and IEC 61511-1 under Industrial.
-
Strike Graph (ISO 42001)
Compliance platform for ISO 42001 AIMS: pre-loaded mapped controls, 100% pre-built AIMS policy and procedure templates, Verify AI documentation checks, gap analysis, evidence dashboards and export to an external assessor.
-
TESSY
Automated unit, module and integration testing of embedded C/C++. Official page: qualified for IEC 61508, IEC 62304, ISO 26262 and EN 50128. Call Pair Coverage is named as an ISO 26262 alternative for integration tests. TÜV SÜD certificate names ISO 26262-8:2018.
-
Thoropass (ISO 42001)
ISO 42001 compliance and audit platform with pre-built policy templates, an AI System Impact Assessment, automated evidence collection, a Risk Register, continuous monitoring, and one-audit-multiple-frameworks evidence reuse from a single platform.
-
Trustible
AI governance platform for regulated enterprises: intake, inventory, risk triaging and continuous monitoring. Maps controls to the EU AI Act, NIST AI RMF and ISO 42001. Official 10 April 2026 Leidos story covers defense, intelligence, civil and health programs.
-
Universal Robots PolyScope
Software platform for Universal Robots cobots, from simple cells to AI-ready systems. Safety FAQ: PolyScope 5 and PolyScope X certified to EN ISO 10218-1:2011; targeting ISO 10218-1:2025 by January 2027 aligned with EU Machinery Regulation 2023/1230.
-
Vanta
Compliance automation covering ISO 42001, NIST AI RMF and CMMC (mapped to NIST SP 800-171/172). The ISO 42001 product page also maps evidence to the EU AI Act. Not an AI-model assurance tool.
-
VectorCAST
Embedded unit, integration and coverage test automation for C, C++ and Ada. Used in aerospace, automotive, medical device, industrial and railway programs. Tool validation packages for IEC 61508, ISO 26262 and IEC 62304 include TÜV SÜD certificates. Reqs2x AI tests require engineer review.
-
Yokogawa ProSafe-RS
TÜV SIL3 safety instrumented system described as a safety PLC for the process industries. Complied functional-safety standards listed: IEC 61508, IEC 61511-1 and IEC 62061. Used in over 3,500 projects. Not an AI-management platform.
Browse by framework or industry
Framework
- ISO/IEC 42001 (24)
- NIST AI RMF (26)
- FAA AI Safety Assurance Roadmap (0)
- DO-178C / DO-330 (10)
- SAE G-34 (1)
- EASA AI Concept Paper (3)
- CMMC / NIST SP 800-171 (2)
- DoD Responsible AI (4)
- EU AI Act (20)
- ISO/IEC 23894 (0)
- ISO/IEC TR 5469 (0)
- UK MOD JSP 936 (1)
- NATO PRUAI (0)
- UL 4600 (1)
- ARP4754B (1)
- DO-330 (3)
- DO-200B (0)
- DoD Directive 3000.09 (1)
- DoD RAI Strategy (2)
- CDAO RAI Toolkit (2)
- NIST SP 800-218A (0)
- ISO 26262 (14)
- ISO/PAS 8800 (2)
- FDA AI-DSF / PCCP (2)
- IEC 62304 (12)
- EU MDR + AI Act (0)
- IEC 61508 (23)
- Machinery Regulation 2023/1230 (2)
- ISO 10218 (2)
- IEC 61511 (15)
Industry
Questions
Why is a tool missing from these filters?
We only list a tool when a public page describes it and we can quote that page. Framework and industry tags appear only when that cited page names them. Absence is a verification gap, not a ranking.
Does the open-source badge mean the product is free to use on a program?
No. The badge means the official repository LICENSE or COPYING file is an OSI-approved license. It is not a certification, a CMMC level, or permission to use the tool with controlled information.