Chicago Park District Building Entrance
The Quest
Question: What does the building sign say?
Correct Answer: Chicago Park District
Overall Results
9 correct (90%)
1 incorrect (10%)
0 not found (0%)
0 refusal (0%)
Model-by-Model Breakdown
Qwen: qwen/qwen3-vl-8b-instruct
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 1600 Tokens, $0.000291 Cost, 3.45 seconds
Google: google/gemini-2.5-flash
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 1930 Tokens, $0.000586 Cost, 2.03 seconds
OpenAI: openai/gpt-5-mini
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 2005 Tokens, $0.000746 Cost, 7.65 seconds
Qwen: qwen/qwen3-vl-235b-a22b-instruct
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 3047 Tokens, $0.000920 Cost, 3.61 seconds
OpenAI: openai/gpt-5
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 827 Tokens, $0.001699 Cost, 6.81 seconds
Anthropic: anthropic/claude-sonnet-4.5
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 1711 Tokens, $0.005241 Cost, 2.91 seconds
Google: google/gemini-2.5-pro
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 2408 Tokens, $0.007219 Cost, 8.02 seconds
xAI: x-ai/grok-4
- Result: Correct
-
Full Response:
Chicago Park District
- Stats: 1668 Tokens, $0.010814 Cost, 18.66 seconds
Anthropic: anthropic/claude-opus-4.1
- Result: Correct
-
Full Response:
CHICAGO PARK DISTRICT
- Stats: 1711 Tokens, $0.026205 Cost, 8.63 seconds
Google: google/gemma-3-27b-it
- Result: Incorrect
-
Full Response:
PARK DISTRICT CHICAGO
- Stats: 395 Tokens, $0.000036 Cost, 4.00 seconds