Methodology and verification policy
The rule for this site is simple: if we cannot cite a public source for it, it does not appear.
What gets listed
- The tool or resource is real and publicly reachable at an official URL.
- A public page from the vendor or publisher describes it as supporting AI assurance, verification, safety, governance or compliance.
- We can cite that page, and the listing quotes or closely paraphrases what it says.
The directory is not exhaustive. It lists a small number of general governance platforms as a baseline and concentrates on tools with a stated link to aerospace, defense, space, safety-critical use, or one of the frameworks we cover.
How tags are assigned
- Framework tags appear only when the cited page names the framework in connection with the product. A framework mentioned only as a topic, a blog category or a marketing keyword does not count. We never infer that a tool "supports" a framework.
- Industry tags appear only when the cited page names the industry, a customer story in it, or an offering aimed at it. Everything else is tagged cross-industry.
- Who it's for and Deployment (on-prem, air-gapped, or SaaS) appear only when the cited vendor page states them in those terms. If the page does not say, the fields stay blank. We do not infer SaaS from a marketing homepage.
- Open source is a badge and a filter, not the same as the Type field. The badge appears only when the official repository LICENSE or COPYING file is an OSI-approved license (the SPDX id is recorded on the listing). Public source under CC BY 4.0, Community Specification License 1.0, or no license file does not get the badge. Marketing use of the words "open source" is not enough.
- Listings show the evidence text next to its source link so readers can check it.
What we do not claim
- We do not say a tool is certified, qualified, accredited or approved by any authority unless the cited page says so, and we say who said it.
- We do not rank, score or recommend tools.
- A listing is not an endorsement. A framework tag is the vendor's statement, not our evaluation.
Coverage cells are a separate layer. Cited mapping versus analyst assessment explains when a source names a requirement and when we add an editorial judgment from a documented capability.
Sources for explainers and articles
- Framework explainers cite the issuing body or official legal text (for example EUR-Lex, eCFR, FAA, EASA, NIST, ISO, DoD CIO).
- Every factual statement in an article carries a link. Sentences that are our analysis are labeled "Analysis" or "Our reading".
- Where a standard is sold, we describe it from the publisher's own public page and do not reproduce it.
- Statuses that change (CMMC phases, EU AI Act dates, ED-324 / ARP6983) carry an "as of" date. Where two sources disagree, we show both.
- We state when we searched for something and found nothing, instead of asserting a negative.
- U.S. federal terminology. Where this site speaks in its own voice about current U.S. federal executive-branch policy, it uses Super Intelligence (SI) and notes that those systems were formerly called artificial intelligence (AI). Official titles of cited documents, standards, frameworks, and sources stay exactly as published. Official names of statutes, regulations, historical documents, and non-federal standards stay exactly as published. The cited explainer is Executive Order 14434.
What we reviewed and did not list
Absence from the directory means we could not verify a qualifying claim, not that a tool is unsuitable.
- Conventional DO-178C verification tools. VectorCAST stays out: the pages we reviewed describe verification of conventionally written software and do not claim assurance of machine-learning models. LDRA's AI and machine learning capability page is listed separately because it names EASA guidance for Level 1 and 2 machine-learning applications. Rapita Verification Suite is listed from the product page's DO-178C qualification-kit sentences (more than 20 DO-178B and C projects up to DAL A); that listing is not an ML-model verifier.
- F5 AI Guardrails (the page at calypsoai.com). The "defense" wording on the page we reviewed refers to defending AI systems against threats such as prompt injection, not to the defense industry.
- Daedalean. Its former web address now serves the Destinus site, and we found no current product page documenting ML certification tooling.
- Thales AI Toolkit. The official catalogue page exists, but our retrieval of it was blocked, so we could not quote evidence from the page itself.
- Galois AI + formal methods. The public page describes a practice, not a named product we could list as a tool.
- Ansys SCADE Vision and Applied Intuition. SCADE Suite is listed because the product page names KCG as qualified for DO-178C/DO-330 at TQL-1 and names Avionics and Flight Controls. A webinar titled “AI-Driven Solutions for Embedded Software Design and V&V” is not treated as a product claim that SCADE verifies machine-learning models. SCADE Vision stays out. Applied Intuition pages we reviewed describe automotive or physical-AI verification without a cited aerospace or defense offering that met the listing rule. Ansys medini analyze remains a separate listing because the safety-analysis pages name SOTIF hazards from perception-algorithm limitations.
- Commercial tools naming JSP 936, NATO PRUAI, UL 4600, ISO/IEC 23894 or ISO/IEC TR 5469. Official product pages we fetched still do not name those five. The JSP 936 filter now lists the official MOD AI Practitioner's Handbook. The other four stay Resources-only.
- optro.ai homepage versus Optro AI Governance. Optro AI Governance is listed from the product page at optro.ai/product/ai-governance (fairnow.ai currently redirects there). The optro.ai homepage is a separate GRC Intelligence surface (formerly AuditBoard) and is not mixed into that listing.
- CISA AI landing and UK Government AI Playbook HTML.
cisa.gov/aitimed out again this pass, so it is not listed. The GOV.UK AI Playbook listing page exists; its HTML sibling 404ed, so it is not listed. Canada’s Algorithmic Impact Assessment is listed this round as a government-resource questionnaire (65 risk and 41 mitigation questions; MIT-licensed prototype). - Eclipse OpenCert. The Eclipse project page still names DO178C, ISO 26262 and EN 50128/50126/50129 for standards knowledge management, but the latest release is 1.0.0 (Neon 3) dated 2019-06-30 and the GitLab project note we fetched is 16 June 2021, so it was not listed. CAISAR and PyRAT are the neural-network safety-engineering listings this round (PyRAT is the CEA AISER verifier; CAISAR orchestrates it among other provers).
- Llama Prompt Guard 2 versus Llama Guard 4. Llama Prompt Guard 2 is a BERT prompt-attack classifier (benign/malicious). Llama Guard 4 is a separate 12B multimodal content-safety classifier. Both are under the Llama 4 Community License, so neither has an OSI badge. Prompt Guard is not on the aircraft path.
- Saidot ISO 27001. Saidot is tagged EU AI Act, ISO/IEC 42001 and NIST AI RMF from the product and homepage policy sentences. The homepage ISO/IEC 27001:2022 badge is Saidot’s own ISMS certificate, not a customer AIMS template, so it is not tagged. Azure Marketplace is not the word SaaS.
- Portkey versus Prisma AIRS Network Intercept. Portkey Guardrails is listed from the Gateway Guardrails docs (input/output checks, HTTP 246/446). The homepage now says Portkey is PRISMA AIRS AI Gateway; that rebrand is not mixed into the separate Prisma AIRS Network Intercept listing. New fully air-gapped Portkey deployments are documented as no longer offered, so air-gapped is not tagged.
- Arthur Policy Templates versus the ISO 42001 column. Arthur’s docs name four built-in Policy Templates without EU AI Act / NIST AI RMF / ISO 42001 titles. Those three frameworks are tagged from the official column that maps Arthur traces, evals and guardrail telemetry to ISO 42001 auditor evidence and says the same evidence base supports an EU AI Act risk assessment and a NIST AI RMF self-attestation.
- Collibra’s own ISO 42001 certificate. Collibra AI Command Center is tagged EU AI Act and NIST AI RMF from the product and docs pages. Collibra’s January 2025 ISO 42001 certification (vendor AIMS) is not treated as a customer 42001 template, so that framework is not tagged.
- D-RisQ Modelworks. Official pages name DO-178C/DO-333 and autonomous vehicles in air. The product is Simulink/Stateflow formal-methods design verification, not a neural-network toolbox, so it was not listed. NNDK and CAISAR are the neural-network safety-engineering listings.
- CISA SBOM-for-AI HTML. The May 2026
software-bill-materials-ai-minimum-elementspage timed out on this pass. The provenance article keeps that URL from the existing citation and uses the live 29 July 2026 general SBOM HTML page for the new “may require additional elements” sentence. - IMDA AI Verify portal.
aiverify.imda.gov.sgreturned HTTP 500 this pass. The AI Verify Testing Framework listing uses the AI Verify Foundation pages instead. - α,β-CROWN. The official repository is a VNN-COMP winner under BSD-3-Clause. The pages we fetched do not name aerospace or defense, so it is not listed. It is cited in the formal-verification article as a tool we read and left out.
- TensorFlow Model Card Toolkit. Listed from the GitHub README (Apache-2.0). The repository is archived. The TensorFlow.org guide currently redirects unauthenticated clients to Google sign-in, so the listing does not cite that guide. Official pages do not name aerospace, defense, NIST AI RMF, ISO/IEC 42001 or DoD Responsible AI, so those tags are omitted.
- NASA IV&V Program page. The official IV&V services page we fetched does not name AI, so it is not listed as an AI-assurance tool.
- Commercial eVTOL or powered-lift AI-assurance products. Official product pages we fetched do not name eVTOL or powered-lift together with AI assurance, so none are listed.
- NASA ProgPy OSI badge. ProgPy is listed. The GitHub license metadata is Other / NOASSERTION, so it does not get the OSI badge.
- AdaCore QGen. Official pages name DO-330 / TQL-1 for a Simulink/Stateflow code generator. They do not name machine-learning model assurance, so it stays with other conventional DO-178C verification tools we left out.
- MAITE as a separate listing. JATIC documents name the
maitelibrary. The GitHub LICENSE file was not fetchable on this pass (404), so we did not list MAITE as its own tool or award an OSI badge. The CDAO JATIC program listing covers that ecosystem. - Protect AI LLM Guard. The official GitHub repository we fetched is archived, so we did not list that runtime product. Check Point AI Guardrails (the Lakera Guard API) is listed separately from Check Point docs.
- Argevide NOR-STA. Official pages describe a second Argevide product. PREMIS is already listed for Core GSN; we did not add a second listing from the same vendor on this pass.
- Frameworks with no listed tools: FAA AI Safety Assurance Roadmap, ISO/IEC 23894, ISO/IEC TR 5469, NATO PRUAI, DO-200B, NIST SP 800-218A, EU MDR + AI Act. We found no tool whose public page names these as supported, so we list none. Those filter pages still list official documents and working-group pages and stay indexable once that content is present.
Verification log
Independent fact-check of the directory, explainers and articles. Review date: 15 October 2026.
| Check | Count |
|---|---|
| Tool listings re-verified against the cited official page | 25 existing listings, plus 2 added after the same rule |
| Listings corrected (name, summary, tags or evidence) | 7 |
| Listings removed | 0 |
| Listings added after a fully supported official page | 2 |
| Factual claims spot-checked in articles and explainers | 44 |
| Claims corrected (overstatement, stale name or date mismatch) | 6 |
Each tool was checked for product name, what the cited page says it does, framework tags and industry tags. Vendor rename, acquisition and shutdown were searched on official or primary pages. Article and explainer claims prioritized dates, version numbers, CMMC phase status, EU AI Act dates, ED-324 status, and “must” / “required” language. Where a cited URL returned 403, an official mirror was used (EUR-Lex HTML for Regulation (EU) 2026/1744; DoD CIO for CMMC; EUROCAE WG-114 for ED-324; NIST publication pages for AI 600-1 and SP 800-171).
Corrections and remaining risks are recorded on the updates page for this pass.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 8–10 articles, paths, matrix cells and listings | 30 |
| Claims or tags corrected (overstatement or industry tag without a vendor page) | 7 |
| Listings removed | 0 |
| Official service added after a fully supported Commission page that names Annex I / aviation | 1 (EU AI Act Service Desk) |
The 30-claim pass prioritized “must” / “required” / “usable” / “paused” language, CMMC Phase I vs Phase II wording, HMT “requirements,” ACAS Xu as if certified, EASA “first-class” data language, RTA ancestry, the Hugging Face “defense” industry tag, and matrix cells attributed to official catalogs. Before/after wording is on the updates page for this pass.
| # | Claim checked | Verdict |
|---|---|---|
| 1 | FAA roadmap is not a standard, advisory circular or means of compliance | Kept |
| 2 | ED-324 / ARP6983 is still Draft on EUROCAE WG-114 | Kept |
| 3 | EASA Issue 2 “does not constitute final detailed guidance” | Kept |
| 4 | EASA “treats data as a first-class assurance object” | Corrected |
| 5 | Issue 2 “places an emphasis on data management aspects and learning processes” | Kept |
| 6 | CMMC Phase II was suspended on 13 July 2026 | Kept |
| 7 | CMMC Phase I self-assessment requirements remain in place | Kept |
| 8 | CUI path “paused in Phase 1 after the Phase II suspension” | Corrected |
| 9 | 32 CFR Part 170 has no AI-specific CMMC clause | Kept (search found none) |
| 10 | Official pages do not rank a subset of SP 800-171 for AI | Kept |
| 11 | DoD Directive 3000.09 applies to weapon systems, not all DoD AI | Kept |
| 12 | 3000.09 excludes autonomous systems that are not weapon systems | Kept |
| 13 | 3000.09 requires appropriate levels of human judgment over the use of force | Kept |
| 14 | HMT article titled as “requirements” | Corrected |
| 15 | HMT description “actually require” | Corrected |
| 16 | ACAS Xu artifacts presented as if certified airborne software / “usable today” | Corrected |
| 17 | NN verifiers are not an FAA AC or EASA AMC | Kept |
| 18 | 1998 Simplex paper as factual ancestor of NASA RTA | Corrected |
| 19 | NASA RTA does not relieve assurance on the system under observation | Kept |
| 20 | ASTM F3269-21 is the cited runtime-assurance practice | Kept |
| 21 | Hugging Face Hub page supports a “defense” industry tag | Corrected |
| 22 | CDAO GenAI RAI Toolkit names the Hugging Face model-card template | Kept |
| 23 | ISO/IEC 42001 “does not replace laws or regulations” | Kept |
| 24 | 42001 certification is voluntary; ISO does not certify organizations | Kept |
| 25 | ISO 42001 matrix cell “Not a product-level assurance method” as catalog text | Corrected |
| 26 | NIST AI RMF is voluntary and not a certification scheme | Kept |
| 27 | Annex I / Article 108 name civil aviation and EASA Basic Regulation | Kept |
| 28 | High-risk dates moved by Regulation (EU) 2026/1744 | Kept |
| 29 | CISA/NIST/NTIA pages do not create a CMMC or DFARS “AIBOM” clause | Kept |
| 30 | Article 73 is not matched by a public DoD equivalent instrument | Kept |
| Check | Count |
|---|---|
| Factual claims spot-checked in the space, eVTOL, MRO and EO 14434 articles | 10 |
| Claims corrected (attribution or truncated quote) | 3 |
| Listings removed | 0 |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | Executive Order 14434 is dated 29 September 2026 | Kept |
| 2 | To the maximum extent permitted by law, the executive branch shall use Super Intelligence and SI in place of Artificial Intelligence and AI | Kept |
| 3 | Section 2(a) names official correspondence, public communications, websites, reports, policy documents, and other non-statutory documents | Kept |
| 4 | Section 2(b) “does not require the alteration of previously issued” (quote stopped before the instrument list) | Corrected |
| 5 | Section 3(a): SI means 15 U.S.C. 9401(3) unless superseded | Kept |
| 6 | Live NASA SWEHB titles use Super Intelligence “after” EO 14434, as if NASA named the Order | Corrected |
| 7 | Space / industry FAQs omitted “to the maximum extent permitted by law” | Corrected |
| 8 | AC 21.17-4: special class under 14 CFR 21.17(b); § 21.16 special conditions are not used; search found no AI/ML words | Kept |
| 9 | EASA SC-VTOL-02 search found no artificial intelligence or machine learning words | Kept |
| 10 | ForMuLA public extract “shall not constitute any binding advice” and creates no expectation of future certification | Kept |
Before/after wording for the three corrections is on the updates page for this pass.
| Check | Count |
|---|---|
| Factual claims spot-checked in the DO-330, SAE G-34, CDAO T&E, NIST AI 600-1, CMMC Program scoping and JSP 936 supplier articles | 10 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass (kept from the cited article quote) | 2 (CDAO T&E PDF HTTP 500; eCFR Part 170 CAPTCHA) |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | FTP1055: if tool outputs are verified independently of the tool, then no qualification is necessary | Kept |
| 2 | FTP1055: most tools are TQL-5 (14 DO-330 objectives) versus TQL-1 (76) | Kept |
| 3 | MathWorks DO Qualification Kit does not “prequalify” tools; qualification is project-specific | Kept |
| 4 | EUROCAE WG-114 still lists ED-324 / ARP6983 as Draft, target publication 31/12/2026 | Kept |
| 5 | CDAO Test and Evaluation of Artificial Intelligence Models Framework does not provide binding policy and requirements | Kept (PDF HTTP 500 this pass; quote remains on the 14 October article sourced to the public CDAO PDF) |
| 6 | In that CDAO document, SI T&E means Systems Integration, not Super Intelligence | Kept (same PDF; 500 this pass) |
| 7 | JATIC FAQ: use of the products will not currently provide any certification or accreditation | Kept |
| 8 | NIST AI RMF / 600-1 profile is for voluntary use; GV-6.1-009 names GAI acquisition and procurement vendor assessments | Kept (NIST crosswalks page restates the AI RMF is intended to be voluntary; 600-1 action codes kept from the Round 15 PDF quotes) |
| 9 | 32 CFR Part 170 is titled CMMC Program; “CMMC 2.0” is a live resource-page title, not the legal name in the rule text we cited | Kept (DoD CIO “Overview of the CMMC Program” live; eCFR CAPTCHA this pass) |
| 10 | GOV.UK: industry partners can align by reading JSP 936 part 1; Part 1 is the principal MOD policy framework | Kept |
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 1–10 articles (glossary, DoD RAI vs NIST, EASA levels, CMMC L2/L3 mapping context, DO-178C mapping, NIST AI 600-1, red-teaming/GSN/AMLAS, JSP 936, extra-territorial AI Act) | 15 |
| Claims corrected (truncated official quote) | 1 |
| Live re-fetch blocked this pass (kept from the cited official text via an archived snapshot of the same release) | 1 (war.gov DoD ethical-principles release HTTP 403; Wayback Machine copy of the 24 February 2020 defense.gov release) |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | DoD adopted five AI ethical principles on 24 February 2020: Responsible, Equitable, Traceable, Reliable and Governable | Kept (live war.gov 403 this pass; Wayback snapshot of the official 24 February 2020 defense.gov release confirms the five names) |
| 2 | NIST AI RMF Core is composed of four functions — Govern, Map, Measure and Manage — and the actions do not constitute a checklist | Kept |
| 3 | ISO/IEC 42001 manages AI-related risks across an organization rather than looking at details of specific AI applications | Kept |
| 4 | EASA published Concept Paper Issue 2 on 6 March 2024 | Kept |
| 5 | Proposed Issue 03 was released 3 June 2026; comments due no later than 12 August 2026 | Kept |
| 6 | Proposed Issue 03 covers Level 0–3 AI applications but not covering ‘autonomy’ (quote stopped before “or ‘autonomous systems’”) | Corrected |
| 7 | FAA roadmap: an aircraft with a standard airworthiness certificate must be certified again to incorporate AI | Kept |
| 8 | FAA roadmap: existing software and complex-hardware guidance is not adequate to address learned AI implementations | Kept |
| 9 | FAA roadmap: for learning AI it is not possible to qualify each version; those implementations are ongoing research topics | Kept |
| 10 | NIST AI 600-1 was published 26 July 2024 as a cross-sectoral profile of AI RMF 1.0 for generative AI | Kept |
| 11 | FAA AC 20-115D is an acceptable means, but not the only means, and does not constitute a regulation | Kept |
| 12 | GSN Community Standard Version 3 is dated 4 May 2021 | Kept |
| 13 | AMLAS Version 1.1 (March 2021) has six stages, from ML safety assurance scoping through model deployment | Kept |
| 14 | JSP 936 Part 1, published 13 November 2024, is the principal policy framework governing the safe and responsible adoption of AI in MOD | Kept |
| 15 | EU AI Act Article 22: prior to making high-risk AI systems available on the Union market, providers established in third countries shall appoint an authorised representative established in the Union | Kept |
Before/after wording for the Issue 03 correction is on the updates page for this pass. Round 11 already covered thirty claims from rounds 8–10; this pass sampled remaining dated, “must”, and taxonomy claims from rounds 1–7 plus FAA/EASA wording those earlier tables did not re-open.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 11–18 articles (FedRAMP vs IL, NATO PRUAI, ISO/IEC 23894/5338, IAQG 9100 vs 42001, UKAS AIMS, DFARS 7012 flow-down, EASA NPA 2025-07, Canada DND/CAF, DAF AI Strategy, Japan MOD compass, DST ethical-AI method, FAA Part 108 fact sheet) | 15 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass (kept from a different official page of the same instrument, or from a cited article quote) | 2 (Federal Register CAPTCHA on the Part 108 NPRM and the BIS AI Diffusion rule; Australia Defence Policy Settings HTML HTTP 500) |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | FedRAMP Consolidated Rules take effect 4 July 2026; historical “FedRAMP authorization” replaced with “FedRAMP Certification” so it is not confused with an agency ATO | Kept |
| 2 | RFC-0020 / NTC-0004: FedRAMP will not use the term “levels” or numbers for new baseline labels to avoid confusion with the DOD/DOW Impact Level/IL system; Certification Class A–D | Kept |
| 3 | NATO 2021: six Principles of Responsible Use (Lawfulness; Responsibility and Accountability; Explainability and Traceability; Reliability; Governability; Bias Mitigation); the Principles do not affect or supersede existing national and international obligations | Kept |
| 4 | NATO 2024 revised strategy restates the same six PRUs; takes account of generative AI; the TEV&V landscape will utilize the network of DIANA affiliated Test Centres | Kept |
| 5 | ISO/IEC 23894:2023 edition 1, published 2023-02-06, 26 pages, JTC 1/SC 42; guidance for organizations that develop, produce, deploy or use AI products, systems and services | Kept |
| 6 | ISO/IEC 5338:2023 edition 1, published 2023-12-20, 39 pages; based on ISO/IEC/IEEE 15288 and 12207; traditional software or system elements can use 12207 / 15288 | Kept |
| 7 | IAQG 9100-series consists of 9100, 9110 and 9120, based on ISO 9001 plus aerospace supplements; the live certification page does not name ISO/IEC 42001 | Kept |
| 8 | UKAS granted BSI the first accreditation for certification of AIMS to ISO/IEC 42001:2023 on 15 January 2026 | Kept |
| 9 | DFARS 252.204-7012 (MAY 2024) paragraph (m): include this clause, including this paragraph (m), in subcontracts for operationally critical support or covered defense information, without alteration except to identify the parties | Kept |
| 10 | EASA NPA 2025-07 dated 10 November 2025, comments through 10/02/2026; first step of RMT.0742, to be followed by a second NPA in 2026 | Kept |
| 11 | Canada DM/CDS message of 7 March 2024: first-ever DND/CAF Artificial Intelligence Strategy; five lines of effort | Kept |
| 12 | Air Force News Service 22 April 2026: Office of the CDAO announced 20 April the public release of the DAF Data and AI Strategies; Secretary Meink: “not on developing AI for its own sake, but on rapidly delivering tangible, combat-ready capabilities” | Kept |
| 13 | Japan MOD 2 July 2024 press conference: formulated for the first time 防衛省AI活用推進基本方針 as a 羅針盤 (compass) | Kept |
| 14 | DST A Method for Ethical AI in Defence: workshop 30 July–1 August 2019; five facets; three tools (checklist, risk matrix, LEAPP); “does not represent the views of the Australian Government” | Kept (live DST publication page; the later Defence Policy Settings HTML returned HTTP 500 this pass) |
| 15 | FAA BVLOS fact sheet: proposed rule; aircraft “would not require traditional FAA airworthiness certificates”; process for accepting airworthiness based on industry consensus standards; lower-risk operations would require an FAA permit, higher-risk an operating certificate | Kept (live FAA fact sheet; Federal Register NPRM HTML CAPTCHA this pass) |
Round 11 already covered thirty claims from rounds 8–10, Round 13 the space/eVTOL/MRO/EO 14434 articles, and Round 16 the DO-330 / G-34 / CDAO T&E / 600-1 / CMMC scoping / JSP 936 supplier articles. This pass sampled remaining dated and “must” claims from the FedRAMP, NATO, Allied-policy, ISO engineering, IAQG/UKAS, DFARS, EASA NPA, DAF, Japan MOD and Part 108 pages those tables did not re-open. Zero corrections.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 19–22 (UL 4600 catalog, ISO/IEC 42005, ISO/IEC 24029-1/2/3, EU AI Act Chapter V / Art. 3(63) / 51 / 54, GPAI Code of Practice, nnenum VNN-COMP 2020, Dioptra Measure/CC BY 4.0, DAIC AI Assurance Framework date) | 15 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass | 0 |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | UL 4600 published date 17 March 2023; ANSI approval the same day | Kept |
| 2 | UL 4600 public scope: vehicles that can operate in an autonomous mode; operation without human supervision of the dynamic driving task | Kept |
| 3 | ISO/IEC 42005:2025 edition 1, 39 pages, International Standard published 2025-05-28 | Kept |
| 4 | ISO/IEC 42005 complements 42001, 38507 and 23894; catalogued as guidance, not a certifiable AIMS | Kept |
| 5 | ISO/IEC TR 24029-1:2021 Technical Report, edition 1, 31 pages, published 2021-03-10 | Kept |
| 6 | ISO/IEC 24029-2:2023 International Standard, 23 pages, published 2023-08-01; methodology for formal methods | Kept |
| 7 | ISO/IEC FDIS 24029-3 still Under development; stage 50.00 (Final text received or FDIS registered for formal approval) | Kept |
| 8 | Article 113(b): Chapter V applies from 2 August 2025; Chapter III Sections 1–3 from 2 December 2027 (Annex III) and 2 August 2028 (Annex I) | Kept |
| 9 | Article 3(63) defines a general-purpose AI model (significant generality; wide range of distinct tasks; except research/development/prototyping before placing on the market) | Kept |
| 10 | Article 51(2): a GPAI model is presumed to have high-impact capabilities when training compute exceeds 10^25 FLOP | Kept |
| 11 | GPAI Code of Practice published 10 July 2025; the Commission and the AI Board confirmed it is an adequate voluntary tool | Kept |
| 12 | Article 54(1): prior to placing a GPAI model on the Union market, providers established in third countries shall appoint an authorised representative established in the Union | Kept |
| 13 | nnenum README: only tool to verify all the ACAS-Xu benchmarks in VNN-COMP 2020 (each in under 10 seconds) | Kept |
| 14 | Dioptra README: supports the Measure function of the NIST AI RMF; license CC BY 4.0 (Release 1.2.1) | Kept |
| 15 | DAIC AI Assurance Framework page dated Published: 27 February 2026; relates to JSP 936 Part 1 – Section 9 | Kept |
Rounds 19 and 20 already covered thirty claims from rounds 1–18. This pass sampled dated catalog, entry-into-application, and listing claims from the Round 21 UL 4600 and ISO/IEC 42005 articles, the Round 22 ISO/IEC 24029 and GPAI articles, and three Round 21–22 listings (nnenum, Dioptra, UK MOD AIPH / DAIC). Zero corrections. The MathWorks ACAS Xu “45 different networks” sentence was also live on the cited example page this pass; it is not a sixteenth table row.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 23–24 listings (Trustible FAQ/Leidos/30–60–90, Saimple SaaS/on-premises/ISO/IEC 24029, QuantPi cloud/HPE/air-gapped/CARAT/CISPA, LYNX MOSA.ic.AI 8 April 2026/DO-178C path/Vulkan SC, ART v1.20/DARPA, AIA Toolkit IL2/IL5/DoW principles, SPDX 3.0.1 AIPackage licenses, PyRIT Crescendo/TAP/CoPyRIT, Promptfoo 50+/157 plugins, Hugging Face Dataset Cards mlcroissant) | 15 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass | 0 |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | Trustible FAQ: maps AI governance controls to the EU AI Act, NIST AI RMF, ISO 42001; on-page Framework Readiness UI names those three | Kept |
| 2 | Trustible Leidos customer story dated 10 April 2026; AI portfolio “expanded across defense, intelligence, civil, and health programs” | Kept |
| 3 | Saimple product page: ISO/IEC 24029 robustness techniques; available as a SaaS solution; deployable on-premises | Kept |
| 4 | QuantPi: public cloud and on-premises via HPE Private Cloud AI, including air-gapped; TÜV Süd’s first CARAT partner laboratory worldwide | Kept |
| 5 | LYNX MOSA.ic.AI general availability 8 April 2026; “not a training platform”; DO-178C named as a certification path, not a completed product certificate | Kept |
| 6 | ART README heading v1.20; hosted by LF AI & Data; DARPA Contract No. HR001120C0013 | Kept |
| 7 | AIA Toolkit (Tradewinds): Program Managers, AI Developers, Acquisition Teams, Legal/Compliance and End Users; IL2 and IL5; DoW AI Ethical Principles | Kept |
| 8 | SPDX 3.0.1 AI Profile: for every AIPackage there MUST exist exactly one hasConcludedLicense and exactly one hasDeclaredLicense relationship | Kept |
| 9 | PyRIT docs: multi-turn strategies Crescendo, TAP and Skeleton Key; CoPyRIT GUI via pyrit_backend on localhost:8000 | Kept |
| 10 | Promptfoo getting-started: “Automatically scans 50+ vulnerability types”; plugins page IDs nist:ai:measure, iso:42001, eu:ai-act | Kept |
| 11 | Hugging Face Dataset Cards: each dataset README.md is a dataset card; YAML metadata for license, language and size; supported library tags include mlcroissant | Kept |
| 12 | QuantPi homepage: “a spin-off from CISPA Helmholtz Center for Information Security” | Kept |
| 13 | Lynx 8 April 2026 launch: CoreSuite “built on Vulkan SC and open Khronos standards” | Kept |
| 14 | Trustible 30–60–90 plan, days 31–60: “Map controls to EU AI Act, NIST, ISO 42001, & industry leading frameworks” | Kept |
| 15 | Promptfoo plugins page: “Promptfoo supports 157 plugins across 6 categories” | Kept |
Rounds 19, 20 and 23 already covered forty-five claims from rounds 1–22. This pass sampled dated, audience, deployment and “MUST” claims from the Round 23 Trustible / Saimple / QuantPi / LYNX listings and the Round 24 ART / AIA Toolkit / SPDX / PyRIT / Promptfoo / Dataset Cards listings. Zero corrections. Zero live re-fetches blocked this pass. The Saimple homepage Article 15 sentence was not re-fetched here; claim 3 is the product-page 24029 / SaaS / on-premises wording only.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 25–26 listings (HiddenLayer NIST AI RMF/EO 14110/air-gapped, Resaro ASQI/IMDA on-prem air-gapped, MathWorks DO-178C/278A/254/330 no-prequalify, garak Python 3.11–3.13 nmap/msf, NeMo Guardrails pip/Python 3.10–3.13, PREMIS Core GSN locally-or-cloud, nnenum Python ≥3.9 GPL-3.0 VNN-COMP 2020, HEART 0.7.0 Python 3.9–3.11 W519TC-23-9-2037, Guardrails AI 0.11.0 Apache-2.0, Bedrock ApplyGuardrail without invoking an FM) | 10 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass | 0 |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | HiddenLayer government-services page: NIST AI RMF, Executive Order 14110, and air-gapped options for fully classified, disconnected environments | Kept |
| 2 | Resaro AIP: ASQI-structured deployment evidence (homepage); Air-gapped. On-premise. IMDA/AI Verify Global AI Assurance Pilot (platform page) | Kept |
| 3 | MathWorks DO Qualification Kit: DO-178C, DO-278A, DO-254 and DO-330; FAQ “does not ‘prequalify’ tools” | Kept |
| 4 | garak README: nmap/msf analogy; conda Python ≥3.11, ≤3.13; Hugging Face, OpenAI, Bedrock, NIM and REST generators | Kept |
| 5 | NeMo Guardrails README: pip install nemoguardrails; Python 3.10, 3.11, 3.12 or 3.13 | Kept |
| 6 | PREMIS: supports Core GSN; “can be deployed locally or in a cloud environment, such as Azure or AWS” | Kept |
| 7 | nnenum: Python ≥3.9; GPL-3.0-or-later; only tool to verify all ACAS-Xu benchmarks in VNN-COMP 2020 (each in under 10 seconds) | Kept |
| 8 | HEART pyproject: heart-library 0.7.0; python ≥3.9, <3.12; CDAO contract W519TC-23-9-2037 on the README | Kept |
| 9 | Guardrails AI pyproject: guardrails-ai 0.11.0; Apache License 2.0; requires-python ≥3.10, <3.14 | Kept |
| 10 | Amazon Bedrock Guardrails: ApplyGuardrail API can run filters without invoking the foundation models | Kept |
Rounds 19, 20, 23 and 25 already covered sixty claims from rounds 1–24. This pass sampled dated, version, language and deployment claims from the Round 25 HiddenLayer / Resaro / MathWorks / garak / NeMo / PREMIS listings and the Round 26 nnenum / HEART / Guardrails AI / Bedrock Guardrails listings. Zero corrections. Zero live re-fetches blocked this pass. The MathWorks DO Qualification Kit page was live on this editorial fetch (it has been 403-blocked on some automated checker runs). HEART contract number W519TC-23-9-2037 was confirmed on the IBM/heart-library README in the Round 26 listing evidence; this pass re-fetched pyproject.toml for the 0.7.0 / Python range and kept the contract sentence from that already-cited README.
| Check | Count |
|---|---|
| Factual claims spot-checked in rounds 26–27 listings (Croissant pip/Python 3.10+/four layers, ERAN DeepZ/DeepPoly/ACAS Xu property 9, ATLAS content 2026.05 / format 6.0.0, Inspect inspect_ai ≥3.10 MIT, Hyperproof ISO 42001 template/Annex A/NIST AI RMF, Azure Prompt Shields/Task adherence/F0 S0, CycloneDX 260+ tools, NNV Star/zonotope/10+ architectures/48 layers, Astah GSN 1.0/DO-178B/OMG SACM, Drata Help Center 1 April 2025 AIMS) | 10 |
| Claims corrected | 0 |
| Live re-fetch blocked this pass | 0 |
| # | Claim checked | Verdict |
|---|---|---|
| 1 | Croissant README: pip install mlcroissant; Python 3.10+; four layers (Metadata, Resources, Structure, ML semantics) | Kept |
| 2 | ERAN README: DeepZ and DeepPoly; python3.6+ and tensorflow 1.11+; documented ACAS Xu property 9 command | Kept |
| 3 | MITRE ATLAS atlas-data README: content version example 2026.05; format-version example 6.0.0 | Kept |
| 4 | Inspect pyproject.toml: project inspect_ai; requires-python ≥3.10; MIT License | Kept |
| 5 | Hyperproof ISO 42001 guide: out-of-the-box ISO 42001 template including Annex A; control crosswalks including NIST AI RMF | Kept |
| 6 | Azure AI Content Safety overview: Prompt Shields; Task adherence API; F0 and S0 pricing tiers | Kept |
| 7 | CycloneDX homepage: compatible with over 260 tools; trusted by enterprises, governments, and open source projects | Kept |
| 8 | NNV docs: Star sets and zonotopes; 10+ architecture types; 48 layer types | Kept |
| 9 | Astah GSN: GSN Community Standard version 1.0; aerospace (DO-178B); OMG SACM (ARM) import/export | Kept |
| 10 | Drata Help Center ISO 42001 overview dated April 1, 2025: AIMS aligned with ISO/IEC 42001 | Kept |
Rounds 19, 20, 23, 25 and 27 already covered seventy claims from rounds 1–26. This pass sampled version, language, audience and template claims from the Round 26 Croissant / Drata / Astah listings and the Round 27 ERAN / CycloneDX / NNV / ATLAS / Inspect / Hyperproof / Azure Content Safety listings — none of which sat in the Round 27 table. Zero corrections. Zero live re-fetches blocked this pass. The Drata Help Center article is JavaScript-heavy; the 1 April 2025 date and AIMS / ISO/IEC 42001 sentences were present on the live HTTP 200 body. The Drata marketing product page remains 403-blocked on some automated checker runs.
Round 18 (14 October 2026): added cited articles on proposed FAA Part 108 BVLOS versus DoD Directive 3000.09, ISO/IEC 23894 and 5338 for engineering teams, and DFARS/FAR supplier flow-down (no AI- or Super Intelligence-titled clause found in live Part 252 text). Folded the aviation publisher-map into the FAA/EASA timelines page and expanded thin Australia Defence, EASA levels, ISO/IEC 23894 and NIST AI RMF pages. The Model Card Toolkit listing note above replaces an earlier “not listed” sentence from before that GitHub README listing.
Questions
Why does this site say Super Intelligence (SI) on some U.S. federal pages and AI on others?
Executive Order 14434 (29 September 2026) directs the U.S. executive branch, to the maximum extent permitted by law, to use Super Intelligence and SI — formerly called Artificial Intelligence and AI — in new non-statutory documents. Official titles of cited documents, standards, and sources stay exactly as published. Official names of statutes, regulations, historical documents, and non-federal standards stay as published.
Keeping it current
Each listing and explainer shows the date its sources were last checked. Tool and framework pages also show a Last verified date from src/data/freshness.json, written by npm run check:freshness when that check is run in an editorial pass. Directory changes are recorded on the updates page, the What changed this month digest generated from that log, and the RSS feed. A corrections and submission process will be published at launch; none is open yet.
Between editorial passes, npm run check:freshness re-fetches every cited URL and every tool evidence quote. It reports DRIFT when a quoted phrase is no longer on the live page, and BLOCKED or UNCHECKABLE when the page cannot be read (403, PDF, empty body, CAPTCHA). HTTP 500 and network timeouts are blocked, not failed, so a flaky issuer site does not fail the weekly job. The script does not rewrite listings. A weekly GitHub Action runs the same check and opens or updates a single Freshness review issue; it reopens that issue when there is drift or a hard failure and closes it when the run is clean. If the check does not write a report, the issue still posts so the standing ticket does not go silent. The workflow does not edit content and does not commit freshness.json (CI skips writing that file). How to run the check locally is documented in this repository's README. Go-live steps that a human must not run from a pull request are in the repository file docs/LAUNCH.md.
Site search is a static Pagefind index built at build time and queried in the browser. It does not call an external search API and it does not refresh issuer documents by itself.
Sponsorship
Sponsored placements will be labeled "Sponsored", kept visually separate from listings, and will not change which tools are listed or how they are described. That rule is in the listing policy. The sponsor media kit restates the audience and those rules and does not publish traffic or prices. No sponsor is placed today. The sponsor slots on this site are placeholders. To point us at a public URL, use the suggest a tool placeholder (not connected yet).