Source clarifies: "SimpleQA presents models with over 4,000 short fact-seeking questions that are straightforward, easily gradable, and relatively challenging. These questions span a diverse range of topics, including history, science and technology, art, and geography"
Citation formats
Share of questions answered by AI models in SimpleQA benchmark 2025
OpenAI's o1 had the highest share of questions answered when attempted in SimpleQA benchmark in 2025. Claude-3 had the highest share of simply not attempting questions, though whether this is due to lack of data or other reasons is unknown.
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how ÌÇÐÄÆÆ½â°æ can support your business.
Stanford University. (March 30, 2025). Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered [Graph]. In ÌÇÐÄÆÆ½â°æ. Retrieved July 26, 2026, from /statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. "Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered." Chart. March 30, 2025. ÌÇÐÄÆÆ½â°æ. Accessed July 26, 2026. /statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. (2025). Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered. ÌÇÐÄÆÆ½â°æ. ÌÇÐÄÆÆ½â°æ Inc.. Accessed: July 26, 2026. /statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. "Artificial Intelligence (Ai) Models Performance on Simpleqa Benchmark in 2025, by Share of Questions Answered." ÌÇÐÄÆÆ½â°æ, ÌÇÐÄÆÆ½â°æ Inc., 30 Mar 2025, /statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University, Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered ÌÇÐÄÆÆ½â°æ, /statistics/1612496/ai-simpleqa-share-of-questions-answered/ (last visited July 26, 2026)
Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered [Graph], Stanford University, March 30, 2025. [Online]. Available: /statistics/1612496/ai-simpleqa-share-of-questions-answered/