Stop Sign
The Quest
Question: What is the text on the main sign in this image?
Correct Answer: stop
Overall Results
10 correct (100%)
0 incorrect (0%)
0 not found (0%)
0 refusal (0%)
Model-by-Model Breakdown
Google: google/gemma-3-27b-it
- Result: Correct
-
Full Response:
STOP
- Stats: 397 Tokens, $0.000047 Cost, 1.35 seconds
Qwen: qwen/qwen3-vl-8b-instruct
- Result: Correct
-
Full Response:
STOP
- Stats: 793 Tokens, $0.000144 Cost, 1.18 seconds
Qwen: qwen/qwen3-vl-235b-a22b-instruct
- Result: Correct
-
Full Response:
STOP
- Stats: 793 Tokens, $0.000240 Cost, 3.32 seconds
OpenAI: openai/gpt-5-mini
- Result: Correct
-
Full Response:
STOP
- Stats: 962 Tokens, $0.000253 Cost, 5.80 seconds
Google: google/gemini-2.5-flash
- Result: Correct
-
Full Response:
STOP
- Stats: 1933 Tokens, $0.000582 Cost, 1.25 seconds
OpenAI: openai/gpt-5
- Result: Correct
-
Full Response:
STOP
- Stats: 827 Tokens, $0.001655 Cost, 7.39 seconds
Anthropic: anthropic/claude-sonnet-4.5
- Result: Correct
-
Full Response:
STOP
- Stats: 1058 Tokens, $0.003234 Cost, 3.18 seconds
xAI: x-ai/grok-4
- Result: Correct
-
Full Response:
STOP
- Stats: 1217 Tokens, $0.003995 Cost, 6.59 seconds
Google: google/gemini-2.5-pro
- Result: Correct
-
Full Response:
STOP
- Stats: 802 Tokens, $0.004651 Cost, 17.63 seconds
Anthropic: anthropic/claude-opus-4.1
- Result: Correct
-
Full Response:
STOP
- Stats: 1058 Tokens, $0.016170 Cost, 9.17 seconds