OTIS Mock AIME 2024-2025 67.5% · Chess Puzzles 13.0%
OTIS Mock AIME 2024-2025 55.8%
OTIS Mock AIME 2024-2025 62.8%
OTIS Mock AIME 2024-2025 82.2%
OTIS Mock AIME 2024-2025 25.0% · Chess Puzzles 0.0%
OTIS Mock AIME 2024-2025 50.6% · Chess Puzzles 1.0%
SimpleQA Verified 41.0%
Chess Puzzles 0.0%
Chess Puzzles 1.0%
Chess Puzzles 0.0%
Chess Puzzles 0.0%
Mystery Game Puzzles 8.0%
Mystery Game Puzzles 15.0%
Mystery Game Puzzles 10.0%
Mystery Game Puzzles 22.0%
Mystery Game Puzzles 28.0%
Mystery Game Puzzles 17.0%
Mystery Game Puzzles 28.0%
Mystery Game Puzzles 12.0%
GPQA diamond 27.0% · OTIS Mock AIME 2024-2025 1.7% · Chess Puzzles 0.0%
GPQA diamond 78.9% · GPQA diamond 79.0% · OTIS Mock AIME 2024-2025 61.7% · OTIS Mock AIME 2024-2025 42.8%
GPQA diamond 47.5% · GPQA diamond 56.8% · OTIS Mock AIME 2024-2025 22.2% · OTIS Mock AIME 2024-2025 56.1%
GPQA diamond 47.7% · OTIS Mock AIME 2024-2025 22.5% · Chess Puzzles 0.0%
GPQA diamond 60.8% · GPQA diamond 53.2% · OTIS Mock AIME 2024-2025 50.8% · OTIS Mock AIME 2024-2025 65.3%
FrontierMath-Tiers-1-3-v2-Private 8.4%
FrontierMath-Tiers-1-3-v2-Private 10.2%
FrontierMath-Tiers-1-3-v2-Private 33.3% · SimpleQA Verified 49.4% · Mystery Game Puzzles 29.0%
FrontierMath-Tiers-1-3-v2-Private 29.8% · Mystery Game Puzzles 23.0%
FrontierMath-Tiers-1-3-v2-Private 37.2% · Mystery Game Puzzles 16.0%
FrontierMath-Tiers-1-3-v2-Private 6.7% · Mystery Game Puzzles 7.0%
FrontierMath-Tiers-1-3-v2-Private 0.0% · Mystery Game Puzzles 3.0%
FrontierMath-Tiers-1-3-v2-Private 0.7% · Mystery Game Puzzles 12.0%
FrontierMath-Tiers-1-3-v2-Private 19.3%
FrontierMath-Tiers-1-3-v2-Private 6.0%
FrontierMath-Tiers-1-3-v2-Private 0.7%
FrontierMath-Tiers-1-3-v2-Private 0.4%
FrontierMath-Tiers-1-3-v2-Private 16.1% · SimpleQA Verified 19.6%
FrontierMath-Tiers-1-3-v2-Private 28.8%
FrontierMath-Tiers-1-3-v2-Private 10.5%
FrontierMath-Tiers-1-3-v2-Private 6.0% · Mystery Game Puzzles 10.0%