SimpleQA Verified 6.0%
SimpleQA Verified 12.7%
SimpleQA Verified 31.1%
SimpleQA Verified 15.3%
SimpleQA Verified 41.1%
SimpleQA Verified 57.8%
SimpleQA Verified 12.6%
GPQA diamond 28.3% · OTIS Mock AIME 2024-2025 2.8% · Chess Puzzles 0.0%
GPQA diamond 71.5%
GPQA diamond 54.1% · OTIS Mock AIME 2024-2025 23.1% · OTIS Mock AIME 2024-2025 66.9%
GPQA diamond 70.1% · OTIS Mock AIME 2024-2025 70.3% · Chess Puzzles 8.0%
GPQA diamond 55.6% · OTIS Mock AIME 2024-2025 62.2% · Chess Puzzles 2.0%
GPQA diamond 50.4% · GPQA diamond 61.7% · OTIS Mock AIME 2024-2025 25.6% · Chess Puzzles 1.0%
GPQA diamond 35.5% · OTIS Mock AIME 2024-2025 2.5% · Chess Puzzles 0.0%
GPQA diamond 41.9% · OTIS Mock AIME 2024-2025 3.9% · Chess Puzzles 1.0%
GPQA diamond 47.3% · OTIS Mock AIME 2024-2025 6.7% · Chess Puzzles 0.0%
GPQA diamond 47.6% · OTIS Mock AIME 2024-2025 28.1% · Chess Puzzles 3.0%
GPQA diamond 23.9% · OTIS Mock AIME 2024-2025 0.6% · Chess Puzzles 0.0%
GPQA diamond 45.1% · GPQA diamond 60.5% · OTIS Mock AIME 2024-2025 58.3%
GPQA diamond 95.8% · FrontierMath-Tiers-1-3-v2-Private 93.7% · FrontierMath-Tier-4-v2-Private 97.6% · OTIS Mock AIME 2024-2025 100.0%
FrontierMath-Tiers-1-3-v2-Private 22.5% · FrontierMath-Tiers-1-3-v2-Private 27.7%
FrontierMath-Tiers-1-3-v2-Private 20.4%
FrontierMath-Tiers-1-3-v2-Private 38.2%
FrontierMath-Tiers-1-3-v2-Private 31.2%
FrontierMath-Tiers-1-3-v2-Private 18.9%
FrontierMath-Tier-4-v2-Private 82.9%
FrontierMath-Tier-4-v2-Private 87.8%
FrontierMath-Tier-4-v2-Private 97.6%
FrontierMath-Tier-4-v2-Private 97.6%
OTIS Mock AIME 2024-2025 0.8% · Chess Puzzles 0.0%
OTIS Mock AIME 2024-2025 70.0% · OTIS Mock AIME 2024-2025 54.4% · Chess Puzzles 10.0%
OTIS Mock AIME 2024-2025 25.8% · Chess Puzzles 0.0% · Chess Puzzles 4.0%
OTIS Mock AIME 2024-2025 30.3% · Chess Puzzles 1.0%
OTIS Mock AIME 2024-2025 0.3% · Chess Puzzles 0.0%
OTIS Mock AIME 2024-2025 1.9%
Chess Puzzles 0.0%
Chess Puzzles 0.0%
Chess Puzzles 0.0%
Mystery Game Puzzles 33.0%
Mystery Game Puzzles 16.0%