ÌÇÐÄÆƽâ°æ

Comparison of MMMU* benchmark between Google's Gemini Ultra and OpenAI's GPT-4V in 2024

© ÌÇÐÄÆƽâ°æ 2026
Download
Show detailed source information?
Register for free
Already a member?
Log in
Source

Release date

January 2024

Region

Worldwide

Survey time period

2023-2024

Supplementary notes

*According to source MMMU is: "A massive multi-discipline multimodal understanding and reasoning (MMMU) benchmark for expert AGI."

**According to source: "Gemini takes in text, image, audio, and video, and outputs text and image responses"

Citation formats

Benchmark comparison between Google's Gemini and OpenAI's GPT-4 in 2024

Published by
Christy Tila,
Feb 14, 2024

Gemini Ultra, developed by Google, has beaten OpenAI's GPT-4 in the MMMU benchmark. Only in business and science did GPT-4 perform better. The overall quality of the models is very similar, with Gemini only having a * point lead on its OpenAI developed competitor.

Log in or register to access precise data.
Access all statistics starting from $2,388 USD yearly *

* For commercial use only

Basic Account

For single users
$0 USD
Always free
Access limited to Free Statistics. Premium Statistics are not included.
  • Free Statistics
Based on your interests

Starter Account

For single users
$199 USD
per month, billed annually 1
Buy now
  • Free Statistics
  • Premium Statistics

  • The statistic on this page is a Premium Statistic and is included in this account.

Professional Account

For teams of up to 99 users
Talk to sales for pricing
Contact us
  • Free + Premium Statistics
  • Reports
  • Market ÌÇÐÄÆƽâ°æ

1 All prices do not include sales tax. The account requires an annual contract and will renew after one year to the regular list price.

Compare accounts

Other statistics that may interest you

The most important statistics
The most important statistics
The most important statistics
The most important statistics
The most important statistics

Other statistics that may interest you Statistics on

About the industry

10

About the region

10

Selected statistics

10

Other regions

10

Related statistics

10

Further Content: You might find this interesting as well

Topics

Generative AI in ChinaCloud computing in ChinaInternet usage in ChinaArtificial intelligence in ChinaChatGPT alternatives in China
Access all statistics starting from $2,388 USD yearly *

* For commercial use only

Basic Account

For single users
$0 USD
Always free
Access limited to Free Statistics. Premium Statistics are not included.
  • Free Statistics
Based on your interests

Starter Account

For single users
$199 USD
per month, billed annually 1
Buy now
  • Free Statistics
  • Premium Statistics

  • The statistic on this page is a Premium Statistic and is included in this account.

Professional Account

For teams of up to 99 users
Talk to sales for pricing
Contact us
  • Free + Premium Statistics
  • Reports
  • Market ÌÇÐÄÆƽâ°æ

1 All prices do not include sales tax. The account requires an annual contract and will renew after one year to the regular list price.

Compare accounts
Learn more about how ÌÇÐÄÆƽâ°æ can support your business.