GitLab Transcend - Intelligent orchestration
Mini toolsTriviaQA
Open-domain question answering over 650k trivia question/answer pairs. Long-tail world knowledge.
Knowledge
Text
exact match
Max 100.0%
Released May 2017
Saturated
3
Results
3
Models scored
85.0%
Top: LLaMA 2
71.5%
Median
Best results
Top primary scores; one row per model.
Frontier over time
Each dot is one model result; the line traces the running best score.
All results
Showing all configurations including non-primary alternates. · Show only primary
| # | Model | Score | Conditions | Eval date | Source | Flags |
|---|---|---|---|---|---|---|
| 1 | Claude 2 | 87.5% | 5-shot · standard | Jul 11, 2023 | self reported | |
| 2 | LLaMA 2 | 85.0% | 1-shot | Jul 19, 2023 | paper | primary verified |
| 3 | LLaMA 2 70B | 85.0% | 1-shot | Jul 11, 2023 | paper | |
| 4 | Mixtral 8x7B | 71.5% | — | Jan 8, 2024 | self reported | primary |
| 5 | Mistral 7B | 69.9% | 5-shot | Oct 10, 2023 | paper | |
| 6 | Gemma 2 | 59.4% | 5-shot | Feb 25, 2025 | self reported | primary |
