How AI models perform when asked for figures reported in SEC filings, with every claim verified against the primary source as filed, and every grade sealed, provable, and reproducible. Nothing on this page asks for trust.
Artizar's own accuracy is measured by adversarial probes, not by the models under test: every run injects known-answer probes (true controls plus deliberate falsehoods) and the engine is graded on catching them.
| Run | Probes as expected | False greens | False alarms |
|---|---|---|---|
| claude-haiku-4-5 | 93 / 93 | 0 | 0 |
| claude-sonnet-5 | 93 / 93 | 0 | 0 |
| gpt-5.4-mini | 93 / 93 | 0 | 0 |
| gpt-5.4 | 93 / 93 | 0 | 0 |
A false green is the failure this system exists to not have.
Each model is asked for exactly the fact the engine verifies and may abstain. The headline is supported / asserted; abstentions are honest and excluded from the denominator. A low headline is not an engine failure: it is the engine catching a model's errors, with a sealed record for each catch.
| Model (version as served) | Supported | Contradicted | Abstained | Headline | Elicitation cost |
|---|---|---|---|---|---|
| claude-haiku-4-5-20251001 (anthropic) | 7 | 23 | 0 | 23.3% (7/30) | $0.011168 |
| claude-sonnet-5 (anthropic) | 22 | 6 | 2 | 78.6% (22/28) | $0.038463 |
| gpt-5.4-mini-2026-03-17 (openai) | 15 | 14 | 1 | 51.7% (15/29) | $0.00770775 |
| gpt-5.4-2026-03-05 (openai) | 24 | 2 | 4 | 92.3% (24/26) | $0.0238475 |
Each model's run ships as a complete fcbundle/v1 bundle. One command per bundle checks, offline, every sealed grade's full chain: the Ed25519 seal signature, the commitment recompute, the audit-log entry hash, the witnessed inclusion proof, report ↔ sealed-verdict consistency, and the prompt-version label against the claims. Any failure is a named error.
python -m artizar verify-bundle bundles/anthropic-claude-haiku-4-5 python -m artizar verify-bundle bundles/anthropic-claude-sonnet-5 python -m artizar verify-bundle bundles/openai-gpt-5.4-mini python -m artizar verify-bundle bundles/openai-gpt-5.4
Key provenance, stated plainly: deployed (operator-published; https://artizar.ai/.well-known/artizar-keys.json; S74 ceremony 2026-07)
Comparisons across editions are apples-to-oranges unless these match; the edition assembler refuses mixed-version bundles structurally, and each label below is read from the sealed artifacts, never typed by hand.
| Surface | Version |
|---|---|
| Taskset | taskset-v6 |
| Elicitation prompt | v2 · template sha256 fb0029a26d6e91aea980639ce2e4b3b8cb2f2ed7c663d22bcc6f4875a9dfa6a7 |
| Scoring policy | policy-v7 |
| Period binding | binding-v3 |
| Metric lexicon | lexicon-v1 |
| Harness / report | filingscheck/v2 |
| Verdict schema | verdict-v3 |
| Context notes | absent (pre-verdict-v4) |
| Pricing table | prices-2026-06-24 |
| Bundle format | fcbundle/v1 |