Methodology and verification policy

The rule for this site is simple: if we cannot cite a public source for it, it does not appear.

Last verification pass: 15 October 2026. 126 tools listed.

What gets listed

  • The tool or resource is real and publicly reachable at an official URL.
  • A public page from the vendor or publisher describes it as supporting AI assurance, verification, safety, governance or compliance.
  • We can cite that page, and the listing quotes or closely paraphrases what it says.

The directory is not exhaustive. It lists a small number of general governance platforms as a baseline and concentrates on tools with a stated link to aerospace, defense, space, safety-critical use, or one of the frameworks we cover.

How tags are assigned

  • Framework tags appear only when the cited page names the framework in connection with the product. A framework mentioned only as a topic, a blog category or a marketing keyword does not count. We never infer that a tool "supports" a framework.
  • Industry tags appear only when the cited page names the industry, a customer story in it, or an offering aimed at it. Everything else is tagged cross-industry.
  • Who it's for and Deployment (on-prem, air-gapped, or SaaS) appear only when the cited vendor page states them in those terms. If the page does not say, the fields stay blank. We do not infer SaaS from a marketing homepage.
  • Open source is a badge and a filter, not the same as the Type field. The badge appears only when the official repository LICENSE or COPYING file is an OSI-approved license (the SPDX id is recorded on the listing). Public source under CC BY 4.0, Community Specification License 1.0, or no license file does not get the badge. Marketing use of the words "open source" is not enough.
  • Listings show the evidence text next to its source link so readers can check it.

What we do not claim

  • We do not say a tool is certified, qualified, accredited or approved by any authority unless the cited page says so, and we say who said it.
  • We do not rank, score or recommend tools.
  • A listing is not an endorsement. A framework tag is the vendor's statement, not our evaluation.

Coverage cells are a separate layer. Cited mapping versus analyst assessment explains when a source names a requirement and when we add an editorial judgment from a documented capability.

Sources for explainers and articles

  • Framework explainers cite the issuing body or official legal text (for example EUR-Lex, eCFR, FAA, EASA, NIST, ISO, DoD CIO).
  • Every factual statement in an article carries a link. Sentences that are our analysis are labeled "Analysis" or "Our reading".
  • Where a standard is sold, we describe it from the publisher's own public page and do not reproduce it.
  • Statuses that change (CMMC phases, EU AI Act dates, ED-324 / ARP6983) carry an "as of" date. Where two sources disagree, we show both.
  • We state when we searched for something and found nothing, instead of asserting a negative.
  • U.S. federal terminology. Where this site speaks in its own voice about current U.S. federal executive-branch policy, it uses Super Intelligence (SI) and notes that those systems were formerly called artificial intelligence (AI). Official titles of cited documents, standards, frameworks, and sources stay exactly as published. Official names of statutes, regulations, historical documents, and non-federal standards stay exactly as published. The cited explainer is Executive Order 14434.

What we reviewed and did not list

Absence from the directory means we could not verify a qualifying claim, not that a tool is unsuitable.

  • Conventional DO-178C verification tools. VectorCAST stays out: the pages we reviewed describe verification of conventionally written software and do not claim assurance of machine-learning models. LDRA's AI and machine learning capability page is listed separately because it names EASA guidance for Level 1 and 2 machine-learning applications. Rapita Verification Suite is listed from the product page's DO-178C qualification-kit sentences (more than 20 DO-178B and C projects up to DAL A); that listing is not an ML-model verifier.
  • F5 AI Guardrails (the page at calypsoai.com). The "defense" wording on the page we reviewed refers to defending AI systems against threats such as prompt injection, not to the defense industry.
  • Daedalean. Its former web address now serves the Destinus site, and we found no current product page documenting ML certification tooling.
  • Thales AI Toolkit. The official catalogue page exists, but our retrieval of it was blocked, so we could not quote evidence from the page itself.
  • Galois AI + formal methods. The public page describes a practice, not a named product we could list as a tool.
  • Ansys SCADE Vision and Applied Intuition. SCADE Suite is listed because the product page names KCG as qualified for DO-178C/DO-330 at TQL-1 and names Avionics and Flight Controls. A webinar titled “AI-Driven Solutions for Embedded Software Design and V&V” is not treated as a product claim that SCADE verifies machine-learning models. SCADE Vision stays out. Applied Intuition pages we reviewed describe automotive or physical-AI verification without a cited aerospace or defense offering that met the listing rule. Ansys medini analyze remains a separate listing because the safety-analysis pages name SOTIF hazards from perception-algorithm limitations.
  • Commercial tools naming JSP 936, NATO PRUAI, UL 4600, ISO/IEC 23894 or ISO/IEC TR 5469. Official product pages we fetched still do not name those five. The JSP 936 filter now lists the official MOD AI Practitioner's Handbook. The other four stay Resources-only.
  • optro.ai homepage versus Optro AI Governance. Optro AI Governance is listed from the product page at optro.ai/product/ai-governance (fairnow.ai currently redirects there). The optro.ai homepage is a separate GRC Intelligence surface (formerly AuditBoard) and is not mixed into that listing.
  • CISA AI landing and UK Government AI Playbook HTML. cisa.gov/ai timed out again this pass, so it is not listed. The GOV.UK AI Playbook listing page exists; its HTML sibling 404ed, so it is not listed. Canada’s Algorithmic Impact Assessment is listed this round as a government-resource questionnaire (65 risk and 41 mitigation questions; MIT-licensed prototype).
  • Eclipse OpenCert. The Eclipse project page still names DO178C, ISO 26262 and EN 50128/50126/50129 for standards knowledge management, but the latest release is 1.0.0 (Neon 3) dated 2019-06-30 and the GitLab project note we fetched is 16 June 2021, so it was not listed. CAISAR and PyRAT are the neural-network safety-engineering listings this round (PyRAT is the CEA AISER verifier; CAISAR orchestrates it among other provers).
  • Llama Prompt Guard 2 versus Llama Guard 4. Llama Prompt Guard 2 is a BERT prompt-attack classifier (benign/malicious). Llama Guard 4 is a separate 12B multimodal content-safety classifier. Both are under the Llama 4 Community License, so neither has an OSI badge. Prompt Guard is not on the aircraft path.
  • Saidot ISO 27001. Saidot is tagged EU AI Act, ISO/IEC 42001 and NIST AI RMF from the product and homepage policy sentences. The homepage ISO/IEC 27001:2022 badge is Saidot’s own ISMS certificate, not a customer AIMS template, so it is not tagged. Azure Marketplace is not the word SaaS.
  • Portkey versus Prisma AIRS Network Intercept. Portkey Guardrails is listed from the Gateway Guardrails docs (input/output checks, HTTP 246/446). The homepage now says Portkey is PRISMA AIRS AI Gateway; that rebrand is not mixed into the separate Prisma AIRS Network Intercept listing. New fully air-gapped Portkey deployments are documented as no longer offered, so air-gapped is not tagged.
  • Arthur Policy Templates versus the ISO 42001 column. Arthur’s docs name four built-in Policy Templates without EU AI Act / NIST AI RMF / ISO 42001 titles. Those three frameworks are tagged from the official column that maps Arthur traces, evals and guardrail telemetry to ISO 42001 auditor evidence and says the same evidence base supports an EU AI Act risk assessment and a NIST AI RMF self-attestation.
  • Collibra’s own ISO 42001 certificate. Collibra AI Command Center is tagged EU AI Act and NIST AI RMF from the product and docs pages. Collibra’s January 2025 ISO 42001 certification (vendor AIMS) is not treated as a customer 42001 template, so that framework is not tagged.
  • D-RisQ Modelworks. Official pages name DO-178C/DO-333 and autonomous vehicles in air. The product is Simulink/Stateflow formal-methods design verification, not a neural-network toolbox, so it was not listed. NNDK and CAISAR are the neural-network safety-engineering listings.
  • CISA SBOM-for-AI HTML. The May 2026 software-bill-materials-ai-minimum-elements page timed out on this pass. The provenance article keeps that URL from the existing citation and uses the live 29 July 2026 general SBOM HTML page for the new “may require additional elements” sentence.
  • IMDA AI Verify portal. aiverify.imda.gov.sg returned HTTP 500 this pass. The AI Verify Testing Framework listing uses the AI Verify Foundation pages instead.
  • α,β-CROWN. The official repository is a VNN-COMP winner under BSD-3-Clause. The pages we fetched do not name aerospace or defense, so it is not listed. It is cited in the formal-verification article as a tool we read and left out.
  • TensorFlow Model Card Toolkit. Listed from the GitHub README (Apache-2.0). The repository is archived. The TensorFlow.org guide currently redirects unauthenticated clients to Google sign-in, so the listing does not cite that guide. Official pages do not name aerospace, defense, NIST AI RMF, ISO/IEC 42001 or DoD Responsible AI, so those tags are omitted.
  • NASA IV&V Program page. The official IV&V services page we fetched does not name AI, so it is not listed as an AI-assurance tool.
  • Commercial eVTOL or powered-lift AI-assurance products. Official product pages we fetched do not name eVTOL or powered-lift together with AI assurance, so none are listed.
  • NASA ProgPy OSI badge. ProgPy is listed. The GitHub license metadata is Other / NOASSERTION, so it does not get the OSI badge.
  • AdaCore QGen. Official pages name DO-330 / TQL-1 for a Simulink/Stateflow code generator. They do not name machine-learning model assurance, so it stays with other conventional DO-178C verification tools we left out.
  • MAITE as a separate listing. JATIC documents name the maite library. The GitHub LICENSE file was not fetchable on this pass (404), so we did not list MAITE as its own tool or award an OSI badge. The CDAO JATIC program listing covers that ecosystem.
  • Protect AI LLM Guard. The official GitHub repository we fetched is archived, so we did not list that runtime product. Check Point AI Guardrails (the Lakera Guard API) is listed separately from Check Point docs.
  • Argevide NOR-STA. Official pages describe a second Argevide product. PREMIS is already listed for Core GSN; we did not add a second listing from the same vendor on this pass.
  • Frameworks with no listed tools: FAA AI Safety Assurance Roadmap, ISO/IEC 23894, ISO/IEC TR 5469, NATO PRUAI, DO-200B, NIST SP 800-218A, EU MDR + AI Act. We found no tool whose public page names these as supported, so we list none. Those filter pages still list official documents and working-group pages and stay indexable once that content is present.

Verification log

Independent fact-check of the directory, explainers and articles. Review date: 15 October 2026.

Round 6 outside-reviewer check
Check Count
Tool listings re-verified against the cited official page 25 existing listings, plus 2 added after the same rule
Listings corrected (name, summary, tags or evidence) 7
Listings removed 0
Listings added after a fully supported official page 2
Factual claims spot-checked in articles and explainers 44
Claims corrected (overstatement, stale name or date mismatch) 6

Each tool was checked for product name, what the cited page says it does, framework tags and industry tags. Vendor rename, acquisition and shutdown were searched on official or primary pages. Article and explainer claims prioritized dates, version numbers, CMMC phase status, EU AI Act dates, ED-324 status, and “must” / “required” language. Where a cited URL returned 403, an official mirror was used (EUR-Lex HTML for Regulation (EU) 2026/1744; DoD CIO for CMMC; EUROCAE WG-114 for ED-324; NIST publication pages for AI 600-1 and SP 800-171).

Corrections and remaining risks are recorded on the updates page for this pass.

Round 11 skeptical fact-check of rounds 8–10
Check Count
Factual claims spot-checked in rounds 8–10 articles, paths, matrix cells and listings 30
Claims or tags corrected (overstatement or industry tag without a vendor page) 7
Listings removed 0
Official service added after a fully supported Commission page that names Annex I / aviation 1 (EU AI Act Service Desk)

The 30-claim pass prioritized “must” / “required” / “usable” / “paused” language, CMMC Phase I vs Phase II wording, HMT “requirements,” ACAS Xu as if certified, EASA “first-class” data language, RTA ancestry, the Hugging Face “defense” industry tag, and matrix cells attributed to official catalogs. Before/after wording is on the updates page for this pass.

Round 11 — 30 spot-checked claims from rounds 8–10
# Claim checked Verdict
1FAA roadmap is not a standard, advisory circular or means of complianceKept
2ED-324 / ARP6983 is still Draft on EUROCAE WG-114Kept
3EASA Issue 2 “does not constitute final detailed guidance”Kept
4EASA “treats data as a first-class assurance object”Corrected
5Issue 2 “places an emphasis on data management aspects and learning processes”Kept
6CMMC Phase II was suspended on 13 July 2026Kept
7CMMC Phase I self-assessment requirements remain in placeKept
8CUI path “paused in Phase 1 after the Phase II suspension”Corrected
932 CFR Part 170 has no AI-specific CMMC clauseKept (search found none)
10Official pages do not rank a subset of SP 800-171 for AIKept
11DoD Directive 3000.09 applies to weapon systems, not all DoD AIKept
123000.09 excludes autonomous systems that are not weapon systemsKept
133000.09 requires appropriate levels of human judgment over the use of forceKept
14HMT article titled as “requirements”Corrected
15HMT description “actually require”Corrected
16ACAS Xu artifacts presented as if certified airborne software / “usable today”Corrected
17NN verifiers are not an FAA AC or EASA AMCKept
181998 Simplex paper as factual ancestor of NASA RTACorrected
19NASA RTA does not relieve assurance on the system under observationKept
20ASTM F3269-21 is the cited runtime-assurance practiceKept
21Hugging Face Hub page supports a “defense” industry tagCorrected
22CDAO GenAI RAI Toolkit names the Hugging Face model-card templateKept
23ISO/IEC 42001 “does not replace laws or regulations”Kept
2442001 certification is voluntary; ISO does not certify organizationsKept
25ISO 42001 matrix cell “Not a product-level assurance method” as catalog textCorrected
26NIST AI RMF is voluntary and not a certification schemeKept
27Annex I / Article 108 name civil aviation and EASA Basic RegulationKept
28High-risk dates moved by Regulation (EU) 2026/1744Kept
29CISA/NIST/NTIA pages do not create a CMMC or DFARS “AIBOM” clauseKept
30Article 73 is not matched by a public DoD equivalent instrumentKept
Round 13 skeptical fact-check of the newest articles
Check Count
Factual claims spot-checked in the space, eVTOL, MRO and EO 14434 articles 10
Claims corrected (attribution or truncated quote) 3
Listings removed 0
Round 13 — 10 spot-checked claims from the newest articles
# Claim checked Verdict
1Executive Order 14434 is dated 29 September 2026Kept
2To the maximum extent permitted by law, the executive branch shall use Super Intelligence and SI in place of Artificial Intelligence and AIKept
3Section 2(a) names official correspondence, public communications, websites, reports, policy documents, and other non-statutory documentsKept
4Section 2(b) “does not require the alteration of previously issued” (quote stopped before the instrument list)Corrected
5Section 3(a): SI means 15 U.S.C. 9401(3) unless supersededKept
6Live NASA SWEHB titles use Super Intelligence “after” EO 14434, as if NASA named the OrderCorrected
7Space / industry FAQs omitted “to the maximum extent permitted by law”Corrected
8AC 21.17-4: special class under 14 CFR 21.17(b); § 21.16 special conditions are not used; search found no AI/ML wordsKept
9EASA SC-VTOL-02 search found no artificial intelligence or machine learning wordsKept
10ForMuLA public extract “shall not constitute any binding advice” and creates no expectation of future certificationKept

Before/after wording for the three corrections is on the updates page for this pass.

Round 16 skeptical fact-check of rounds 14–15 articles
Check Count
Factual claims spot-checked in the DO-330, SAE G-34, CDAO T&E, NIST AI 600-1, CMMC Program scoping and JSP 936 supplier articles 10
Claims corrected 0
Live re-fetch blocked this pass (kept from the cited article quote) 2 (CDAO T&E PDF HTTP 500; eCFR Part 170 CAPTCHA)
Round 16 — 10 spot-checked claims from rounds 14–15
# Claim checked Verdict
1FTP1055: if tool outputs are verified independently of the tool, then no qualification is necessaryKept
2FTP1055: most tools are TQL-5 (14 DO-330 objectives) versus TQL-1 (76)Kept
3MathWorks DO Qualification Kit does not “prequalify” tools; qualification is project-specificKept
4EUROCAE WG-114 still lists ED-324 / ARP6983 as Draft, target publication 31/12/2026Kept
5CDAO Test and Evaluation of Artificial Intelligence Models Framework does not provide binding policy and requirementsKept (PDF HTTP 500 this pass; quote remains on the 14 October article sourced to the public CDAO PDF)
6In that CDAO document, SI T&E means Systems Integration, not Super IntelligenceKept (same PDF; 500 this pass)
7JATIC FAQ: use of the products will not currently provide any certification or accreditationKept
8NIST AI RMF / 600-1 profile is for voluntary use; GV-6.1-009 names GAI acquisition and procurement vendor assessmentsKept (NIST crosswalks page restates the AI RMF is intended to be voluntary; 600-1 action codes kept from the Round 15 PDF quotes)
932 CFR Part 170 is titled CMMC Program; “CMMC 2.0” is a live resource-page title, not the legal name in the rule text we citedKept (DoD CIO “Overview of the CMMC Program” live; eCFR CAPTCHA this pass)
10GOV.UK: industry partners can align by reading JSP 936 part 1; Part 1 is the principal MOD policy frameworkKept
Round 19 skeptical fact-check of rounds 1–10 articles
Check Count
Factual claims spot-checked in rounds 1–10 articles (glossary, DoD RAI vs NIST, EASA levels, CMMC L2/L3 mapping context, DO-178C mapping, NIST AI 600-1, red-teaming/GSN/AMLAS, JSP 936, extra-territorial AI Act) 15
Claims corrected (truncated official quote) 1
Live re-fetch blocked this pass (kept from the cited official text via an archived snapshot of the same release) 1 (war.gov DoD ethical-principles release HTTP 403; Wayback Machine copy of the 24 February 2020 defense.gov release)
Round 19 — 15 spot-checked claims from rounds 1–10
# Claim checked Verdict
1DoD adopted five AI ethical principles on 24 February 2020: Responsible, Equitable, Traceable, Reliable and GovernableKept (live war.gov 403 this pass; Wayback snapshot of the official 24 February 2020 defense.gov release confirms the five names)
2NIST AI RMF Core is composed of four functions — Govern, Map, Measure and Manage — and the actions do not constitute a checklistKept
3ISO/IEC 42001 manages AI-related risks across an organization rather than looking at details of specific AI applicationsKept
4EASA published Concept Paper Issue 2 on 6 March 2024Kept
5Proposed Issue 03 was released 3 June 2026; comments due no later than 12 August 2026Kept
6Proposed Issue 03 covers Level 0–3 AI applications but not covering ‘autonomy’ (quote stopped before “or ‘autonomous systems’”)Corrected
7FAA roadmap: an aircraft with a standard airworthiness certificate must be certified again to incorporate AIKept
8FAA roadmap: existing software and complex-hardware guidance is not adequate to address learned AI implementationsKept
9FAA roadmap: for learning AI it is not possible to qualify each version; those implementations are ongoing research topicsKept
10NIST AI 600-1 was published 26 July 2024 as a cross-sectoral profile of AI RMF 1.0 for generative AIKept
11FAA AC 20-115D is an acceptable means, but not the only means, and does not constitute a regulationKept
12GSN Community Standard Version 3 is dated 4 May 2021Kept
13AMLAS Version 1.1 (March 2021) has six stages, from ML safety assurance scoping through model deploymentKept
14JSP 936 Part 1, published 13 November 2024, is the principal policy framework governing the safe and responsible adoption of AI in MODKept
15EU AI Act Article 22: prior to making high-risk AI systems available on the Union market, providers established in third countries shall appoint an authorised representative established in the UnionKept

Before/after wording for the Issue 03 correction is on the updates page for this pass. Round 11 already covered thirty claims from rounds 8–10; this pass sampled remaining dated, “must”, and taxonomy claims from rounds 1–7 plus FAA/EASA wording those earlier tables did not re-open.

Round 20 skeptical fact-check of rounds 11–18 articles
Check Count
Factual claims spot-checked in rounds 11–18 articles (FedRAMP vs IL, NATO PRUAI, ISO/IEC 23894/5338, IAQG 9100 vs 42001, UKAS AIMS, DFARS 7012 flow-down, EASA NPA 2025-07, Canada DND/CAF, DAF AI Strategy, Japan MOD compass, DST ethical-AI method, FAA Part 108 fact sheet) 15
Claims corrected 0
Live re-fetch blocked this pass (kept from a different official page of the same instrument, or from a cited article quote) 2 (Federal Register CAPTCHA on the Part 108 NPRM and the BIS AI Diffusion rule; Australia Defence Policy Settings HTML HTTP 500)
Round 20 — 15 spot-checked claims from rounds 11–18
# Claim checked Verdict
1FedRAMP Consolidated Rules take effect 4 July 2026; historical “FedRAMP authorization” replaced with “FedRAMP Certification” so it is not confused with an agency ATOKept
2RFC-0020 / NTC-0004: FedRAMP will not use the term “levels” or numbers for new baseline labels to avoid confusion with the DOD/DOW Impact Level/IL system; Certification Class A–DKept
3NATO 2021: six Principles of Responsible Use (Lawfulness; Responsibility and Accountability; Explainability and Traceability; Reliability; Governability; Bias Mitigation); the Principles do not affect or supersede existing national and international obligationsKept
4NATO 2024 revised strategy restates the same six PRUs; takes account of generative AI; the TEV&V landscape will utilize the network of DIANA affiliated Test CentresKept
5ISO/IEC 23894:2023 edition 1, published 2023-02-06, 26 pages, JTC 1/SC 42; guidance for organizations that develop, produce, deploy or use AI products, systems and servicesKept
6ISO/IEC 5338:2023 edition 1, published 2023-12-20, 39 pages; based on ISO/IEC/IEEE 15288 and 12207; traditional software or system elements can use 12207 / 15288Kept
7IAQG 9100-series consists of 9100, 9110 and 9120, based on ISO 9001 plus aerospace supplements; the live certification page does not name ISO/IEC 42001Kept
8UKAS granted BSI the first accreditation for certification of AIMS to ISO/IEC 42001:2023 on 15 January 2026Kept
9DFARS 252.204-7012 (MAY 2024) paragraph (m): include this clause, including this paragraph (m), in subcontracts for operationally critical support or covered defense information, without alteration except to identify the partiesKept
10EASA NPA 2025-07 dated 10 November 2025, comments through 10/02/2026; first step of RMT.0742, to be followed by a second NPA in 2026Kept
11Canada DM/CDS message of 7 March 2024: first-ever DND/CAF Artificial Intelligence Strategy; five lines of effortKept
12Air Force News Service 22 April 2026: Office of the CDAO announced 20 April the public release of the DAF Data and AI Strategies; Secretary Meink: “not on developing AI for its own sake, but on rapidly delivering tangible, combat-ready capabilities”Kept
13Japan MOD 2 July 2024 press conference: formulated for the first time 防衛省AI活用推進基本方針 as a 羅針盤 (compass)Kept
14DST A Method for Ethical AI in Defence: workshop 30 July–1 August 2019; five facets; three tools (checklist, risk matrix, LEAPP); “does not represent the views of the Australian Government”Kept (live DST publication page; the later Defence Policy Settings HTML returned HTTP 500 this pass)
15FAA BVLOS fact sheet: proposed rule; aircraft “would not require traditional FAA airworthiness certificates”; process for accepting airworthiness based on industry consensus standards; lower-risk operations would require an FAA permit, higher-risk an operating certificateKept (live FAA fact sheet; Federal Register NPRM HTML CAPTCHA this pass)

Round 11 already covered thirty claims from rounds 8–10, Round 13 the space/eVTOL/MRO/EO 14434 articles, and Round 16 the DO-330 / G-34 / CDAO T&E / 600-1 / CMMC scoping / JSP 936 supplier articles. This pass sampled remaining dated and “must” claims from the FedRAMP, NATO, Allied-policy, ISO engineering, IAQG/UKAS, DFARS, EASA NPA, DAF, Japan MOD and Part 108 pages those tables did not re-open. Zero corrections.

Round 23 skeptical fact-check of rounds 19–22 articles and listings
Check Count
Factual claims spot-checked in rounds 19–22 (UL 4600 catalog, ISO/IEC 42005, ISO/IEC 24029-1/2/3, EU AI Act Chapter V / Art. 3(63) / 51 / 54, GPAI Code of Practice, nnenum VNN-COMP 2020, Dioptra Measure/CC BY 4.0, DAIC AI Assurance Framework date) 15
Claims corrected 0
Live re-fetch blocked this pass 0
Round 23 — 15 spot-checked claims from rounds 19–22
# Claim checked Verdict
1UL 4600 published date 17 March 2023; ANSI approval the same dayKept
2UL 4600 public scope: vehicles that can operate in an autonomous mode; operation without human supervision of the dynamic driving taskKept
3ISO/IEC 42005:2025 edition 1, 39 pages, International Standard published 2025-05-28Kept
4ISO/IEC 42005 complements 42001, 38507 and 23894; catalogued as guidance, not a certifiable AIMSKept
5ISO/IEC TR 24029-1:2021 Technical Report, edition 1, 31 pages, published 2021-03-10Kept
6ISO/IEC 24029-2:2023 International Standard, 23 pages, published 2023-08-01; methodology for formal methodsKept
7ISO/IEC FDIS 24029-3 still Under development; stage 50.00 (Final text received or FDIS registered for formal approval)Kept
8Article 113(b): Chapter V applies from 2 August 2025; Chapter III Sections 1–3 from 2 December 2027 (Annex III) and 2 August 2028 (Annex I)Kept
9Article 3(63) defines a general-purpose AI model (significant generality; wide range of distinct tasks; except research/development/prototyping before placing on the market)Kept
10Article 51(2): a GPAI model is presumed to have high-impact capabilities when training compute exceeds 10^25 FLOPKept
11GPAI Code of Practice published 10 July 2025; the Commission and the AI Board confirmed it is an adequate voluntary toolKept
12Article 54(1): prior to placing a GPAI model on the Union market, providers established in third countries shall appoint an authorised representative established in the UnionKept
13nnenum README: only tool to verify all the ACAS-Xu benchmarks in VNN-COMP 2020 (each in under 10 seconds)Kept
14Dioptra README: supports the Measure function of the NIST AI RMF; license CC BY 4.0 (Release 1.2.1)Kept
15DAIC AI Assurance Framework page dated Published: 27 February 2026; relates to JSP 936 Part 1 – Section 9Kept

Rounds 19 and 20 already covered thirty claims from rounds 1–18. This pass sampled dated catalog, entry-into-application, and listing claims from the Round 21 UL 4600 and ISO/IEC 42005 articles, the Round 22 ISO/IEC 24029 and GPAI articles, and three Round 21–22 listings (nnenum, Dioptra, UK MOD AIPH / DAIC). Zero corrections. The MathWorks ACAS Xu “45 different networks” sentence was also live on the cited example page this pass; it is not a sixteenth table row.

Round 25 skeptical fact-check of rounds 23–24 listings
Check Count
Factual claims spot-checked in rounds 23–24 listings (Trustible FAQ/Leidos/30–60–90, Saimple SaaS/on-premises/ISO/IEC 24029, QuantPi cloud/HPE/air-gapped/CARAT/CISPA, LYNX MOSA.ic.AI 8 April 2026/DO-178C path/Vulkan SC, ART v1.20/DARPA, AIA Toolkit IL2/IL5/DoW principles, SPDX 3.0.1 AIPackage licenses, PyRIT Crescendo/TAP/CoPyRIT, Promptfoo 50+/157 plugins, Hugging Face Dataset Cards mlcroissant) 15
Claims corrected 0
Live re-fetch blocked this pass 0
Round 25 — 15 spot-checked claims from rounds 23–24 listings
# Claim checked Verdict
1Trustible FAQ: maps AI governance controls to the EU AI Act, NIST AI RMF, ISO 42001; on-page Framework Readiness UI names those threeKept
2Trustible Leidos customer story dated 10 April 2026; AI portfolio “expanded across defense, intelligence, civil, and health programs”Kept
3Saimple product page: ISO/IEC 24029 robustness techniques; available as a SaaS solution; deployable on-premisesKept
4QuantPi: public cloud and on-premises via HPE Private Cloud AI, including air-gapped; TÜV Süd’s first CARAT partner laboratory worldwideKept
5LYNX MOSA.ic.AI general availability 8 April 2026; “not a training platform”; DO-178C named as a certification path, not a completed product certificateKept
6ART README heading v1.20; hosted by LF AI & Data; DARPA Contract No. HR001120C0013Kept
7AIA Toolkit (Tradewinds): Program Managers, AI Developers, Acquisition Teams, Legal/Compliance and End Users; IL2 and IL5; DoW AI Ethical PrinciplesKept
8SPDX 3.0.1 AI Profile: for every AIPackage there MUST exist exactly one hasConcludedLicense and exactly one hasDeclaredLicense relationshipKept
9PyRIT docs: multi-turn strategies Crescendo, TAP and Skeleton Key; CoPyRIT GUI via pyrit_backend on localhost:8000Kept
10Promptfoo getting-started: “Automatically scans 50+ vulnerability types”; plugins page IDs nist:ai:measure, iso:42001, eu:ai-actKept
11Hugging Face Dataset Cards: each dataset README.md is a dataset card; YAML metadata for license, language and size; supported library tags include mlcroissantKept
12QuantPi homepage: “a spin-off from CISPA Helmholtz Center for Information Security”Kept
13Lynx 8 April 2026 launch: CoreSuite “built on Vulkan SC and open Khronos standards”Kept
14Trustible 30–60–90 plan, days 31–60: “Map controls to EU AI Act, NIST, ISO 42001, & industry leading frameworks”Kept
15Promptfoo plugins page: “Promptfoo supports 157 plugins across 6 categories”Kept

Rounds 19, 20 and 23 already covered forty-five claims from rounds 1–22. This pass sampled dated, audience, deployment and “MUST” claims from the Round 23 Trustible / Saimple / QuantPi / LYNX listings and the Round 24 ART / AIA Toolkit / SPDX / PyRIT / Promptfoo / Dataset Cards listings. Zero corrections. Zero live re-fetches blocked this pass. The Saimple homepage Article 15 sentence was not re-fetched here; claim 3 is the product-page 24029 / SaaS / on-premises wording only.

Round 27 skeptical fact-check of rounds 25–26 listings
Check Count
Factual claims spot-checked in rounds 25–26 listings (HiddenLayer NIST AI RMF/EO 14110/air-gapped, Resaro ASQI/IMDA on-prem air-gapped, MathWorks DO-178C/278A/254/330 no-prequalify, garak Python 3.11–3.13 nmap/msf, NeMo Guardrails pip/Python 3.10–3.13, PREMIS Core GSN locally-or-cloud, nnenum Python ≥3.9 GPL-3.0 VNN-COMP 2020, HEART 0.7.0 Python 3.9–3.11 W519TC-23-9-2037, Guardrails AI 0.11.0 Apache-2.0, Bedrock ApplyGuardrail without invoking an FM) 10
Claims corrected 0
Live re-fetch blocked this pass 0
Round 27 — 10 spot-checked claims from rounds 25–26 listings
# Claim checked Verdict
1HiddenLayer government-services page: NIST AI RMF, Executive Order 14110, and air-gapped options for fully classified, disconnected environmentsKept
2Resaro AIP: ASQI-structured deployment evidence (homepage); Air-gapped. On-premise. IMDA/AI Verify Global AI Assurance Pilot (platform page)Kept
3MathWorks DO Qualification Kit: DO-178C, DO-278A, DO-254 and DO-330; FAQ “does not ‘prequalify’ tools”Kept
4garak README: nmap/msf analogy; conda Python ≥3.11, ≤3.13; Hugging Face, OpenAI, Bedrock, NIM and REST generatorsKept
5NeMo Guardrails README: pip install nemoguardrails; Python 3.10, 3.11, 3.12 or 3.13Kept
6PREMIS: supports Core GSN; “can be deployed locally or in a cloud environment, such as Azure or AWS”Kept
7nnenum: Python ≥3.9; GPL-3.0-or-later; only tool to verify all ACAS-Xu benchmarks in VNN-COMP 2020 (each in under 10 seconds)Kept
8HEART pyproject: heart-library 0.7.0; python ≥3.9, <3.12; CDAO contract W519TC-23-9-2037 on the READMEKept
9Guardrails AI pyproject: guardrails-ai 0.11.0; Apache License 2.0; requires-python ≥3.10, <3.14Kept
10Amazon Bedrock Guardrails: ApplyGuardrail API can run filters without invoking the foundation modelsKept

Rounds 19, 20, 23 and 25 already covered sixty claims from rounds 1–24. This pass sampled dated, version, language and deployment claims from the Round 25 HiddenLayer / Resaro / MathWorks / garak / NeMo / PREMIS listings and the Round 26 nnenum / HEART / Guardrails AI / Bedrock Guardrails listings. Zero corrections. Zero live re-fetches blocked this pass. The MathWorks DO Qualification Kit page was live on this editorial fetch (it has been 403-blocked on some automated checker runs). HEART contract number W519TC-23-9-2037 was confirmed on the IBM/heart-library README in the Round 26 listing evidence; this pass re-fetched pyproject.toml for the 0.7.0 / Python range and kept the contract sentence from that already-cited README.

Round 28 skeptical fact-check of rounds 26–27 listings
Check Count
Factual claims spot-checked in rounds 26–27 listings (Croissant pip/Python 3.10+/four layers, ERAN DeepZ/DeepPoly/ACAS Xu property 9, ATLAS content 2026.05 / format 6.0.0, Inspect inspect_ai ≥3.10 MIT, Hyperproof ISO 42001 template/Annex A/NIST AI RMF, Azure Prompt Shields/Task adherence/F0 S0, CycloneDX 260+ tools, NNV Star/zonotope/10+ architectures/48 layers, Astah GSN 1.0/DO-178B/OMG SACM, Drata Help Center 1 April 2025 AIMS) 10
Claims corrected 0
Live re-fetch blocked this pass 0
Round 28 — 10 spot-checked claims from rounds 26–27 listings
# Claim checked Verdict
1Croissant README: pip install mlcroissant; Python 3.10+; four layers (Metadata, Resources, Structure, ML semantics)Kept
2ERAN README: DeepZ and DeepPoly; python3.6+ and tensorflow 1.11+; documented ACAS Xu property 9 commandKept
3MITRE ATLAS atlas-data README: content version example 2026.05; format-version example 6.0.0Kept
4Inspect pyproject.toml: project inspect_ai; requires-python ≥3.10; MIT LicenseKept
5Hyperproof ISO 42001 guide: out-of-the-box ISO 42001 template including Annex A; control crosswalks including NIST AI RMFKept
6Azure AI Content Safety overview: Prompt Shields; Task adherence API; F0 and S0 pricing tiersKept
7CycloneDX homepage: compatible with over 260 tools; trusted by enterprises, governments, and open source projectsKept
8NNV docs: Star sets and zonotopes; 10+ architecture types; 48 layer typesKept
9Astah GSN: GSN Community Standard version 1.0; aerospace (DO-178B); OMG SACM (ARM) import/exportKept
10Drata Help Center ISO 42001 overview dated April 1, 2025: AIMS aligned with ISO/IEC 42001Kept

Rounds 19, 20, 23, 25 and 27 already covered seventy claims from rounds 1–26. This pass sampled version, language, audience and template claims from the Round 26 Croissant / Drata / Astah listings and the Round 27 ERAN / CycloneDX / NNV / ATLAS / Inspect / Hyperproof / Azure Content Safety listings — none of which sat in the Round 27 table. Zero corrections. Zero live re-fetches blocked this pass. The Drata Help Center article is JavaScript-heavy; the 1 April 2025 date and AIMS / ISO/IEC 42001 sentences were present on the live HTTP 200 body. The Drata marketing product page remains 403-blocked on some automated checker runs.

Round 18 (14 October 2026): added cited articles on proposed FAA Part 108 BVLOS versus DoD Directive 3000.09, ISO/IEC 23894 and 5338 for engineering teams, and DFARS/FAR supplier flow-down (no AI- or Super Intelligence-titled clause found in live Part 252 text). Folded the aviation publisher-map into the FAA/EASA timelines page and expanded thin Australia Defence, EASA levels, ISO/IEC 23894 and NIST AI RMF pages. The Model Card Toolkit listing note above replaces an earlier “not listed” sentence from before that GitHub README listing.

Questions

Why does this site say Super Intelligence (SI) on some U.S. federal pages and AI on others?

Executive Order 14434 (29 September 2026) directs the U.S. executive branch, to the maximum extent permitted by law, to use Super Intelligence and SI — formerly called Artificial Intelligence and AI — in new non-statutory documents. Official titles of cited documents, standards, and sources stay exactly as published. Official names of statutes, regulations, historical documents, and non-federal standards stay as published.

Keeping it current

Each listing and explainer shows the date its sources were last checked. Tool and framework pages also show a Last verified date from src/data/freshness.json, written by npm run check:freshness when that check is run in an editorial pass. Directory changes are recorded on the updates page, the What changed this month digest generated from that log, and the RSS feed. A corrections and submission process will be published at launch; none is open yet.

Between editorial passes, npm run check:freshness re-fetches every cited URL and every tool evidence quote. It reports DRIFT when a quoted phrase is no longer on the live page, and BLOCKED or UNCHECKABLE when the page cannot be read (403, PDF, empty body, CAPTCHA). HTTP 500 and network timeouts are blocked, not failed, so a flaky issuer site does not fail the weekly job. The script does not rewrite listings. A weekly GitHub Action runs the same check and opens or updates a single Freshness review issue; it reopens that issue when there is drift or a hard failure and closes it when the run is clean. If the check does not write a report, the issue still posts so the standing ticket does not go silent. The workflow does not edit content and does not commit freshness.json (CI skips writing that file). How to run the check locally is documented in this repository's README. Go-live steps that a human must not run from a pull request are in the repository file docs/LAUNCH.md.

Site search is a static Pagefind index built at build time and queried in the browser. It does not call an external search API and it does not refresh issuer documents by itself.

Sponsorship

Sponsored placements will be labeled "Sponsored", kept visually separate from listings, and will not change which tools are listed or how they are described. That rule is in the listing policy. The sponsor media kit restates the audience and those rules and does not publish traffic or prices. No sponsor is placed today. The sponsor slots on this site are placeholders. To point us at a public URL, use the suggest a tool placeholder (not connected yet).

Free next step: take the AI assurance readiness self-check or create a free account. Quoted evidence stays on Pro.