Updated 27 Jul 2026
OFFICIAL BENCHMARK RESULTS2023 TO PRESENT
AI model
benchmark scores
Official results for major AI models, with the source and test settings for each score.
108models
59benchmarks
785results
12labs
01
Benchmark scores
Compare scores reported by model developers.
Green marks the highest score when the visible results use the same recorded test settings. Amber marks the largest published number when the settings differ, so it is a reference rather than a direct win. Select a score to see its source and settings.59 benchmarks · 108 models · newest → oldest
| BenchmarkTest set / measure | AnthropicClaude Opus 524 Jul 2026 | xAIGrok 4.516 Jul 2026 | Thinking MachinesInkling15 Jul 2026 | OpenAIGPT-5.6 Luna9 Jul 2026 | OpenAIGPT-5.6 Sol9 Jul 2026 | OpenAIGPT-5.6 Terra9 Jul 2026 | AnthropicClaude Sonnet 530 Jun 2026 | Z.aiGLM-5.216 Jun 2026 | AnthropicClaude Fable 59 Jun 2026 | AnthropicClaude Mythos 59 Jun 2026 | MiniMaxMiniMax-M31 Jun 2026 | AnthropicClaude Opus 4.821 May 2026 | DeepSeekDeepSeek-V4-Pro24 Apr 2026 | OpenAIGPT-5.523 Apr 2026 | Moonshot AIKimi K2.620 Apr 2026 | AnthropicClaude Opus 4.716 Apr 2026 | Z.aiGLM-5.17 Apr 2026 | MiniMaxMiniMax-M2.718 Mar 2026 | Mistral AIMistral Small 416 Mar 2026 | OpenAIGPT-5.45 Mar 2026 | Google DeepMindGemini 3.1 Pro Preview19 Feb 2026 | Z.aiGLM-512 Feb 2026 | MiniMaxMiniMax-M2.512 Feb 2026 | OpenAIGPT-5.3-Codex5 Feb 2026 | Moonshot AIKimi K2.527 Jan 2026 | MiniMaxMiniMax-M2.123 Dec 2025 | Z.aiGLM-4.722 Dec 2025 | OpenAIGPT-5.2 Thinking11 Dec 2025 | Mistral AIMistral Large 32 Dec 2025 | DeepSeekDeepSeek-V3.21 Dec 2025 | AnthropicClaude Opus 4.524 Nov 2025 | Google DeepMindGemini 3 Pro18 Nov 2025 | OpenAIGPT-5.1 Thinking12 Nov 2025 | Moonshot AIKimi K2 Thinking6 Nov 2025 | MiniMaxMiniMax-M227 Oct 2025 | AnthropicClaude Haiku 4.515 Oct 2025 | Z.aiGLM-4.630 Sept 2025 | AnthropicClaude Sonnet 4.529 Sept 2025 | xAIGrok 4 Fast19 Sept 2025 | DeepSeekDeepSeek-V3.121 Aug 2025 | OpenAIGPT-57 Aug 2025 | AnthropicClaude Opus 4.15 Aug 2025 | OpenAIgpt-oss-120b5 Aug 2025 | Z.aiGLM-4.528 Jul 2025 | QwenQwen3-Coder22 Jul 2025 | Moonshot AIKimi K211 Jul 2025 | xAIGrok 49 Jul 2025 | MiniMaxMiniMax-M116 Jun 2025 | Mistral AIMagistral Medium10 Jun 2025 | Mistral AIMagistral Small10 Jun 2025 | DeepSeekDeepSeek-R1-052828 May 2025 | AnthropicClaude Opus 422 May 2025 | AnthropicClaude Sonnet 422 May 2025 | QwenQwen3-235B-A22B29 Apr 2025 | Google DeepMindGemini 2.5 Flash17 Apr 2025 | OpenAIo316 Apr 2025 | OpenAIo4-mini16 Apr 2025 | OpenAIGPT-4.114 Apr 2025 | MetaLlama 4 Maverick5 Apr 2025 | MetaLlama 4 Scout5 Apr 2025 | DeepSeekDeepSeek-V3-032425 Mar 2025 | Google DeepMindGemini 2.5 Pro25 Mar 2025 | Mistral AIMistral Small 3.117 Mar 2025 | Google DeepMindGemma 312 Mar 2025 | OpenAIGPT-4.527 Feb 2025 | AnthropicClaude 3.7 Sonnet24 Feb 2025 | xAIGrok-319 Feb 2025 | OpenAIo3-mini31 Jan 2025 | Mistral AIMistral Small 330 Jan 2025 | QwenQwen2.5-Max28 Jan 2025 | DeepSeekDeepSeek-R120 Jan 2025 | MiniMaxMiniMax-Text-0115 Jan 2025 | DeepSeekDeepSeek-V326 Dec 2024 | Google DeepMindGemini 2.0 Flash11 Dec 2024 | MetaLlama 3.3 70B6 Dec 2024 | OpenAIo15 Dec 2024 | QwenQwQ-32B28 Nov 2024 | AnthropicClaude 3.5 Haiku22 Oct 2024 | MetaLlama 3.2 90B Vision25 Sept 2024 | QwenQwen2.5-72B19 Sept 2024 | OpenAIo1-preview12 Sept 2024 | DeepSeekDeepSeek-V2.55 Sept 2024 | xAIGrok-213 Aug 2024 | Mistral AIMistral Large 224 Jul 2024 | MetaLlama 3.1 405B23 Jul 2024 | OpenAIGPT-4o mini18 Jul 2024 | AnthropicClaude 3.5 Sonnet20 Jun 2024 | QwenQwen2-72B7 Jun 2024 | Google DeepMindGemini 1.5 Flash14 May 2024 | OpenAIGPT-4o13 May 2024 | DeepSeekDeepSeek-V27 May 2024 | MetaLlama 3 70B18 Apr 2024 | xAIGrok-1.528 Mar 2024 | AnthropicClaude 3 Haiku13 Mar 2024 | AnthropicClaude 3 Opus4 Mar 2024 | AnthropicClaude 3 Sonnet4 Mar 2024 | Mistral AIMistral Large26 Feb 2024 | Google DeepMindGemini 1.5 Pro15 Feb 2024 | QwenQwen1.5-72B4 Feb 2024 | Mistral AIMixtral 8×7B11 Dec 2023 | Google DeepMindGemini 1.0 Pro6 Dec 2023 | Google DeepMindGemini 1.0 Ultra6 Dec 2023 | OpenAIGPT-4 Turbo6 Nov 2023 | xAIGrok-14 Nov 2023 | Mistral AIMistral 7B27 Sept 2023 | MetaLlama 2 70B18 Jul 2023 | AnthropicClaude 211 Jul 2023 | OpenAIGPT-414 Mar 2023 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| General knowledgeMMLUPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||||||||||||||||||||||
| General knowledgeMMLU-ProPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||||||||||||||
| General knowledgeMMMLU14-language average · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||
| Reasoning & mathsGPQA DiamondPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Reasoning & mathsGSM8KPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||||
| Reasoning & mathsMATHPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||||||||||||
| Reasoning & mathsMATH-500Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||
| Reasoning & mathsMGSMPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||
| CodingHumanEvalFirst-attempt pass rate | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||||||||||||
| CodingLiveCodeBenchFirst-attempt pass rate | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||||||||||
| General knowledgeDROPF1 score | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||
| Reasoning & mathsBIG-Bench HardPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||
| General knowledgeARC-ChallengePercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||
| General knowledgeHellaSwagPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||
| CodingSWE-bench VerifiedIssues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||||||||||||||
| CodingSWE-Bench ProIssues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||
| CodingDeepSWEv1.1 · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||
| CodingDeepSWEv1.0 · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||
| CodingFrontier-Benchv0.1 · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||
| CodingFrontierCodev1.1 Main · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||
| CodingTerminal-BenchVersion 2.0 · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||
| MultimodalCharXiv ReasoningPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||
| MultimodalMMMUValidation set · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||||||||||
| Reasoning & mathsFrontierMathTier 1–3 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| Reasoning & mathsFrontierMathTier 4 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| Reasoning & mathsFrontierMathTier 1–3 v2 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||
| Reasoning & mathsFrontierMathTier 4 v2 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||
| Reasoning & mathsAIME2024 test · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||
| Reasoning & mathsAIME2025 test · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||||||||
| Reasoning & mathsAIME2026 test · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||
| Reasoning & mathsARC-AGIVersion 1 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||
| Reasoning & mathsARC-AGIVersion 2 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||
| Reasoning & mathsARC-AGIVersion 3 · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| ProfessionalGDPvalWin or tie rate | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||
| ProfessionalGDPval-AAv2 · Rating | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||
| Agents & toolsBrowseCompPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||||||
| Reasoning & mathsHumanity’s Last ExamPercentage correct | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —With tools | —No tools —With tools | —With tools | —No tools —With tools | —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —With tools | —No tools —With tools | —No tools —With tools | —With tools | —With tools | —No tools —With tools | —No tools —With tools | —With tools | —With tools | —No tools —With tools | —With tools | —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —With tools | —With tools | —With tools | —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | ||||||||||||||||||
| Agents & toolsOSWorldVersion 2.0 · Tasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||
| Agents & toolsOSWorld-VerifiedTasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||
| Agents & toolsAutomationBenchTasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||
| ProfessionalLegal Agent BenchmarkHeld-out set · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||
| ProfessionalHealthBench ProfessionalPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||
| Reasoning & mathsBioMysteryBenchHard set · Tasks solved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| Reasoning & mathsBioMysteryBenchHuman-solved comparison · Tasks solved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| MultimodalMMMU ProPercentage correct | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | —No tools —With tools | ||||||
| MultimodalMMMU ProStandard 10 protocol · Percentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||
| Agents & toolsToolathlonTasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||||||
| CodingTerminal-BenchVersion 2.1 · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||
| Agents & toolsMCP-AtlasPublic test set · Tasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||
| General knowledgeSimpleQA VerifiedPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||
| General knowledgeSimpleQAPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | ||||||||||||||
| General knowledgeIFBenchPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||||||||||
| CodingTerminal-BenchHard set · Issues resolved | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |
| Agents & toolsτ²-benchTelecom subset · Tasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |
| CodingFullStackBenchPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |
| SafetyFirefox 147 exploit developmentTasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |
| ProfessionalFinanceAgentv1.1 · Tasks completed | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| ProfessionalOfficeQAPercentage correct | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | |||
| CodingSWE MarathonFirst-attempt pass rate | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported | —not reported |