MGSM
GSM8K translated into 10 typologically diverse languages. Tests cross-lingual mathematical reasoning.
Best results
Frontier over time
All results
| # | Model | Score | Conditions | Eval date | Source | Flags |
|---|---|---|---|---|---|---|
| 1 | Llama 3.3 | 91.1% | 0-shot | 06 Dec 2024 | Self-reported | Primary |
| 2 | Claude Opus 3 | 90.7% | 0-shot | 22 Oct 2024 | Self-reported | Primary |
| 3 | GPT-4o | 90.5% | — | 16 Apr 2025 | Self-reported | Primary |
| 4 | Nemotron 3 Super | 87.5% | 8-shot | 03 Apr 2026 | Self-reported | Primary |
| 5 | Llama 3.2 | 58.2% | 0-shot · CoT | 25 Oct 2024 | Self-reported | Primary |
