portrait of Barack Obama
The Quest
Question: Who is the primary figure in this image?
Correct Answer: Obama
Overall Results
8 correct (80%)
0 incorrect (0%)
2 not found (20%)
0 refusal (0%)
Model-by-Model Breakdown
Google: google/gemma-3-27b-it
- Result: Correct
-
Full Response:
Barack Obama.
- Stats: 397 Tokens, $0.000036 Cost, 1.23 seconds
Qwen: qwen/qwen3-vl-8b-instruct
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1332 Tokens, $0.000242 Cost, 1.46 seconds
Qwen: qwen/qwen3-vl-235b-a22b-instruct
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1332 Tokens, $0.000404 Cost, 4.51 seconds
Google: google/gemini-2.5-flash
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1416 Tokens, $0.000431 Cost, 1.43 seconds
xAI: x-ai/grok-4
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1226 Tokens, $0.004162 Cost, 4.79 seconds
Anthropic: anthropic/claude-sonnet-4.5
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1709 Tokens, $0.005187 Cost, 3.89 seconds
Google: google/gemini-2.5-pro
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1785 Tokens, $0.005486 Cost, 7.06 seconds
Anthropic: anthropic/claude-opus-4.1
- Result: Correct
-
Full Response:
Barack Obama
- Stats: 1709 Tokens, $0.025935 Cost, 6.19 seconds
OpenAI: openai/gpt-5-mini
- Result: Not Found
-
Full Response:
Information not available.
- Stats: 1894 Tokens, $0.001051 Cost, 7.31 seconds
OpenAI: openai/gpt-5
- Result: Not Found
-
Full Response:
I don’t know.
- Stats: 1020 Tokens, $0.003611 Cost, 10.97 seconds