3. Schemas and compatibility
Every structured artifact is checked against its bundled JSON Schema. Breaking public-schema changes require an explicit site-contract update.
Browse leaderboard schemaDownload and verify
A versioned, answer-safe release bundle for independent analysis, citation, and reproducible site builds.
Results 0.1.0Data through Aug 17, 2026
Published release
1. Release bundle
| File | Format | SHA-256 | Size | Download |
|---|---|---|---|---|
| category-summary.json | JSON | 47885dbcf6…d8f3504c | 3.4 KB | |
| CHANGELOG.md | Text | 3d3ee08d9e…f5f6d1a4 | 716 B | |
| CITATION.cff | Text | 067571a725…6ff7d3e7 | 887 B | |
| configuration-manifests.json | JSON | fbc42209da…62e4ed8b | 583.2 KB | |
| coverage-gaps.json | JSON | e0d13ea339…64c5b3a7 | 5.6 KB | |
| leaderboard.csv | CSV | e131ef3376…2723b52d | 90.0 KB | |
| leaderboard.json | JSON | 5d4c4f02b6…539486fb | 225.6 KB | |
| LICENSES.md | Text | 8d877963d5…a21898fc | 1.4 KB | |
| methodology.json | JSON | 6eda59d2e2…06d084a4 | 4.2 KB | |
| README.md | Text | 13ae678098…c69c918b | 3.3 KB | |
| schemas/category-summary.schema.json | JSON | 4c39481af7…33409f20 | 1.8 KB | |
| schemas/configuration-manifests.schema.json | JSON | 94a5227759…e45f40a6 | 12.5 KB | |
| schemas/coverage-gaps.schema.json | JSON | fa141ea846…24d1b712 | 1.4 KB | |
| schemas/leaderboard.schema.json | JSON | 6cdfe7692e…57551543 | 4.3 KB | |
| schemas/methodology.schema.json | JSON | 63ab847693…2096b790 | 6.8 KB | |
| schemas/release-manifest.schema.json | JSON | a814944ad3…5c061968 | 7.2 KB | |
| schemas/score-changes.schema.json | JSON | 27b238c82b…8e321f3b | 3.8 KB | |
| schemas/uncertainty.schema.json | JSON | 5c7cec3ced…96a3bac3 | 2.6 KB | |
| score-changes.json | JSON | 0e6b127e6c…721b23f8 | 105.5 KB | |
| uncertainty.json | JSON | 9a37d47c92…adbda0f6 | 90.5 KB |
Manifest SHA-256: 39e9c3f05fefe47e57fda1b3cdd4c29df5e3cde17b31729e300762c3f52c7e14
Immutable published storage revision: v0.1.0. Downloads on this path are checksum-bound and are never replaced in place.
2. Verify locally
cd data/releases/v0.1.0
shasum -a 256 -c checksums.sha256
cd ../../..
node scripts/verify-release.mjs --release v0.1.0The release timestamp is pinned; reproducible builds do not use wall-clock time.
4. Cite this release
- Title
- GPQA Diamond Clean Results
- Bundle version
- 0.1.0
- Data through
- 2026-08-17
- Results DOI
- Not assigned
- Clean membership
- gpqa-diamond-clean 1.2.2
5. Distribution status
- This website serves the published, checksum-bound results bundle.
- The corrected benchmark is available from GitHub and Hugging Face.
- A separate results DOI has not yet been assigned.
- The paper DOI remains separate from the dataset identity.
6. Licensing and attribution
- Release data and documentation: CC BY 4.0.
- Website dependencies: notices bundled locally.
- GPQA benchmark: upstream attribution retained.
- Evaluation evidence: provenance and source attribution retained.
Coverage gaps
These are evidence gaps, not model-quality judgments.
| Source rank | Configuration | Organization | Status | Note |
|---|---|---|---|---|
| 1 | gpt-5.4-pro-2026-03-05_xhigh | OpenAI | no_public_source_artifact | No completed exact-configuration project run or accepted equivalent evidence was available by the data-through cutoff. |
| 8 | claude-opus-5_max | Anthropic | no_public_source_artifact | The completed provider-default or high-equivalent Opus 5 run is not an Opus 5 max score. |
| 10 | grok-4.5_high | xAI | no_public_source_artifact | No completed exact-configuration project run or accepted equivalent evidence was available by the data-through cutoff. |
| 13 | kimi-k3_max | Moonshot | no_public_source_artifact | Skipped for this release candidate because a full Kimi K3 run is too expensive. |
| 16 | qwen3.8-max_xhigh | Alibaba | no_public_source_artifact | No completed exact-configuration project run or accepted equivalent evidence was available by the data-through cutoff. |
| 19 | glm-5.2_max | Z.ai (Zhipu AI) | no_public_source_artifact | Deferred until GLM-5.3 is available through the API. |
| 22 | claude-opus-4-8_max | Anthropic | no_public_source_artifact | Completed Opus 4.8 low or default runs are distinct from this max configuration. |
| 23 | deepseek-v4-flash-0731_max | DeepSeek | no_public_source_artifact | The fresh DeepSeek V4 Flash max result is not bound to the dated 0731 configuration. |
| 30 | claude-sonnet-5_xhigh | Anthropic | no_public_source_artifact | The xhigh configuration was skipped; the completed Sonnet 5 max run was the selected comparison configuration. |
| 35 | muse-spark | Meta AI | no_public_source_artifact | No completed exact-configuration project run or accepted equivalent evidence was available by the data-through cutoff. |
| 38 | grok-4.20-0309-reasoning | xAI | no_public_source_artifact | Grok 4.20 was skipped; Grok 4.3 was the selected xAI run. |
| 46 | Inkling_xhigh | Thinking Machines | no_public_source_artifact | Skipped; Inkling-small is not a GPQA run and does not cover this exact configuration. |