Model Rankings
Vision models ranked by overall accuracy (exact + variant matches) out of 89 tests per model
| Rank | Model | Model Type | Accuracy | Avg Score | Cost per Run | Response Time |
|---|---|---|---|---|---|---|
⚛ claude-opus-4.6-fast | Proprietary | 91.0% | 92 | $6.02 | - | |
#2 | ✦︎ gemini-3.1-pro-preview-customtools | Proprietary | 90.0% | 89 | $1.94 | - |
#3 | bytedance-seed/seed-2.0-mini | Open | 88.8% | 90 | $0.03 | - |
#4 | ֎ gpt-5.1-chat | Proprietary | 88.3% | 81 | $0.12 | - |
#5 | ⚛ claude-opus-4.5 | Proprietary | 87.6% | 89 | $0.93 | - |
#6 | ✦︎ gemini-3.1-pro-preview | Proprietary | 87.6% | 87 | $1.76 | - |
#7 | moonshotai/kimi-k2.5 | Proprietary | 87.6% | 86 | $0.27 | - |
#8 | ⚛ claude-opus-4.7 | Proprietary | 87.5% | 90 | $1.16 | - |
#9 | ⚛ claude-opus-4.7-fast | Proprietary | 87.4% | 89 | $6.87 | - |
#10 | ✦︎ gemini-3-flash-preview | Proprietary | 87.4% | 88 | $0.07 | - |
#11 | ֎ gpt-5-codex | Proprietary | 86.7% | 87 | $0.80 | - |
#12 | ⚛ claude-opus-4.6 | Proprietary | 86.5% | 86 | $0.89 | - |
#13 | z-ai/glm-5v-turbo | Proprietary | 86.5% | 83 | $0.36 | - |
#14 | ֎ o3 | Proprietary | 85.7% | 82 | $0.55 | - |
#15 | ⚛ claude-opus-4.1 | Proprietary | 85.4% | 85 | $2.60 | - |
#16 | ⚛ claude-sonnet-4.6 | Proprietary | 85.4% | 87 | $0.62 | - |
#17 | ✦︎ gemini-3.1-flash-image-preview | Proprietary | 85.4% | 86 | $0.05 | - |
#18 | bytedance-seed/seed-2.0-lite | Open | 85.2% | 89 | $0.11 | - |
#19 | ֎ gpt-4.1-mini | Proprietary | 84.4% | 84 | $0.07 | - |
#20 | moonshotai/kimi-k2.6 | Proprietary | 84.3% | 84 | $0.51 | - |
#21 | ֎ gpt-5 | Proprietary | 84.3% | 81 | $0.86 | - |
#22 | ֎ gpt-5-pro | Proprietary | 84.0% | 76 | $17.99 | - |
#23 | ֎ gpt-5.4-image-2 | Proprietary | 83.3% | 81 | $1.21 | - |
#24 | ֎ o4-mini-high | Proprietary | 83.0% | 80 | $0.62 | - |
#25 | ֎ gpt-5-image-mini | Proprietary | 82.0% | 79 | $0.45 | - |
#26 | ✦︎ gemini-3.1-flash-lite-preview | Proprietary | 81.6% | 85 | $0.03 | - |
#27 | ֎ o3-pro | Proprietary | 81.4% | 78 | $5.70 | - |
#28 | ֎ gpt-5.3-chat | Proprietary | 81.1% | 81 | $0.36 | - |
#29 | ⚛ claude-3.5-haiku | Proprietary | 80.9% | 84 | $0.14 | - |
#30 | ֎ gpt-5-mini | Proprietary | 80.9% | 80 | $0.11 | - |
#31 | ⚛ claude-opus-4 | Proprietary | 79.8% | 82 | $2.61 | - |
#32 | ✦︎ gemini-3-pro-image-preview | Proprietary | 79.8% | 82 | $1.03 | - |
#33 | ֎ gpt-5.4-mini | Proprietary | 79.8% | 82 | $0.11 | - |
#34 | ֎ gpt-5.5 | Proprietary | 79.6% | 80 | $1.39 | - |
#35 | ✦︎ gemini-2.5-pro | Proprietary | 79.5% | 83 | $0.90 | - |
#36 | ֎ gpt-5.1 | Proprietary | 79.0% | 78 | $0.44 | - |
#37 | ֎ gpt-5.3-codex | Proprietary | 78.9% | 82 | $0.68 | - |
#38 | baidu/ernie-4.5-vl-424b-a47b | Proprietary | 78.8% | 80 | $0.05 | - |
#39 | ⚛ claude-sonnet-4.5 | Proprietary | 78.7% | 80 | $0.54 | - |
#40 | ֎ gpt-5-image | Proprietary | 78.7% | 78 | $1.61 | - |
#41 | ֎ gpt-5.1-codex-max | Proprietary | 78.7% | 82 | $1.36 | - |
#42 | ֎ gpt-5.5-pro | Proprietary | 78.7% | 80 | $39.95 | - |
#43 | ֎ o1 | Proprietary | 78.7% | 81 | $5.80 | - |
#44 | x-ai/grok-4.20-multi-agent | Proprietary | 78.7% | 80 | $3.48 | - |
#45 | ֎ o4-mini | Proprietary | 78.4% | 81 | $0.36 | - |
#46 | ✦︎ gemini-2.5-flash | Proprietary | 78.3% | 81 | $0.05 | - |
#47 | ✦︎ gemini-3.1-flash-lite | Proprietary | 78.0% | 82 | $0.03 | - |
#48 | ֎ o3-deep-research | Proprietary | 78.0% | 79 | $39.23 | - |
#49 | ✦︎ gemini-2.5-flash-image | Proprietary | 77.9% | 81 | $0.03 | - |
#50 | ✦︎ gemini-2.0-flash-lite-001 | Proprietary | 77.8% | 78 | $0.01 | - |
#51 | ֎ gpt-4o-2024-08-06 | Proprietary | 77.3% | 79 | $0.20 | - |
#52 | ✦︎ gemini-2.5-pro-preview-05-06 | Proprietary | 76.9% | 82 | $0.94 | - |
#53 | ֎ o4-mini-deep-research | Proprietary | 76.7% | 80 | $27.01 | - |
#54 | ֎ gpt-5.1-codex | Proprietary | 76.6% | 82 | $0.43 | - |
#55 | z-ai/glm-4.6v | Proprietary | 76.5% | 78 | $0.07 | - |
#56 | bytedance-seed/seed-1.6-flash | Open | 76.4% | 76 | $0.03 | - |
#57 | z-ai/glm-4.5v | Proprietary | 76.4% | 77 | $0.09 | - |
#58 | ֎ gpt-5.1-codex-mini | Proprietary | 76.3% | 78 | $0.07 | - |
#59 | ⚛ claude-sonnet-4 | Proprietary | 76.1% | 79 | $0.53 | - |
#60 | ✦︎ gemini-2.5-pro-preview | Proprietary | 76.1% | 81 | $0.94 | - |
#61 | ֎ gpt-5.4 | Proprietary | 75.9% | 80 | $0.35 | - |
#62 | ✦︎ gemini-2.5-flash-lite-preview-09-2025 | Proprietary | 75.3% | 79 | $0.02 | - |
#63 | ֎ gpt-5.4-pro | Proprietary | 75.3% | 80 | $31.36 | - |
#64 | ֎ gpt-chat-latest | Proprietary | 75.3% | 81 | $0.76 | - |
#65 | openrouter/auto | Proprietary | 74.4% | 78 | $0.02 | - |
#66 | ֎ gpt-4o-2024-11-20 | Proprietary | 74.4% | 81 | $0.22 | - |
#67 | ֎ gpt-5.2 | Proprietary | 73.8% | 79 | $0.62 | - |
#68 | ֎ gpt-4o-mini-2024-07-18 | Proprietary | 73.2% | 74 | $0.35 | - |
#69 | ֎ gpt-4o | Proprietary | 73.0% | 77 | $0.20 | - |
#70 | ֎ gpt-5-chat | Proprietary | 73.0% | 79 | $0.14 | - |
#71 | ✦︎ gemini-2.0-flash-001 | Proprietary | 72.9% | 75 | $0.02 | - |
#72 | qwen/qwen3-vl-30b-a3b-thinking | Open | 72.9% | 76 | $0.05 | - |
#73 | ֎ gpt-4o-2024-05-13 | Proprietary | 72.7% | 78 | $0.40 | - |
#74 | ֎ gpt-4.1 | Proprietary | 72.2% | 82 | $0.19 | - |
#75 | ֎ gpt-5.2-chat | Proprietary | 71.9% | 78 | $0.45 | - |
#76 | qwen/qwen3-vl-235b-a22b-thinking | Open | 71.6% | 78 | $0.17 | - |
#77 | ֎ gpt-5.2-pro | Proprietary | 71.3% | 77 | $7.27 | - |
#78 | ֎ gpt-4o-mini | Proprietary | 71.1% | 77 | $0.35 | - |
#79 | ✦︎ gemma-4-31b-it | Proprietary | 71.1% | 76 | $0.01 | - |
#80 | qwen/qwen2.5-vl-72b-instruct | Open | 69.7% | 78 | $0.05 | - |
#81 | qwen/qwen3-vl-235b-a22b-instruct | Open | 69.7% | 79 | $0.06 | - |
#82 | bytedance-seed/seed-1.6 | Open | 67.8% | 76 | $0.10 | - |
#83 | ⚛ claude-3-haiku | Proprietary | 67.4% | 74 | $0.04 | - |
#84 | x-ai/grok-4.20 | Proprietary | 67.4% | 73 | $0.15 | - |
#85 | ✦︎ gemini-2.5-flash-lite | Proprietary | 67.1% | 73 | $0.02 | - |
#86 | amazon/nova-premier-v1 | Proprietary | 66.3% | 74 | $0.80 | - |
#87 | ֎ gpt-4-turbo | Proprietary | 65.9% | 71 | $0.81 | - |
#88 | qwen/qwen3.6-plus | Open | 65.5% | 76 | $0.74 | - |
#89 | qwen/qwen3.5-plus-02-15 | Open | 65.2% | 77 | $0.52 | - |
#90 | ֎ gpt-5.2-codex | Proprietary | 64.5% | 70 | $0.54 | - |
#91 | ✦︎ gemma-3-27b-it | Proprietary | 64.0% | 73 | $0.01 | - |
#92 | 🦙 llama-4-maverick | Open | 64.0% | 72 | $0.06 | - |
#93 | mistralai/mistral-medium-3 | Open | 64.0% | 75 | $0.07 | - |
#94 | mistralai/pixtral-large-2411 | Open | 62.9% | 71 | $0.77 | - |
#95 | qwen/qwen3-vl-30b-a3b-instruct | Open | 61.8% | 74 | $0.03 | - |
#96 | ֎ gpt-5-nano | Proprietary | 61.4% | 67 | $0.05 | - |
#97 | qwen/qwen3.5-35b-a3b | Open | 61.2% | 74 | $0.97 | - |
#98 | qwen/qwen3.5-397b-a17b | Open | 61.2% | 74 | $1.36 | - |
#99 | qwen/qwen3.5-flash-02-23 | Open | 60.7% | 71 | $0.13 | - |
#100 | baidu/ernie-4.5-vl-28b-a3b | Proprietary | 60.5% | 69 | $0.02 | - |
#101 | qwen/qwen3.5-122b-a10b | Open | 60.3% | 71 | $2.54 | - |
#102 | qwen/qwen3.6-flash | Open | 60.2% | 71 | $0.61 | - |
#103 | ✦︎ gemma-4-26b-a4b-it | Proprietary | 59.8% | 72 | $0.01 | - |
#104 | ⚛ claude-haiku-4.5 | Proprietary | 59.6% | 71 | $0.18 | - |
#105 | perplexity/sonar-reasoning-pro | Proprietary | 59.6% | 74 | $1.13 | - |
#106 | xiaomi/mimo-v2.5 | Proprietary | 57.3% | 73 | $0.16 | - |
#107 | ֎ gpt-4.1-nano | Proprietary | 55.2% | 65 | $0.03 | - |
#108 | amazon/nova-pro-v1 | Proprietary | 55.1% | 67 | $0.22 | - |
#109 | perplexity/sonar-pro-search | Proprietary | 55.1% | 71 | $1.85 | - |
#110 | qwen/qwen3.6-35b-a3b | Open | 53.4% | 70 | $0.54 | - |
#111 | xiaomi/mimo-v2-omni | Proprietary | 52.8% | 64 | $0.18 | - |
#112 | qwen/qwen3.5-27b | Open | 52.5% | 68 | $2.40 | - |
#113 | ✦︎ gemma-3-12b-it | Proprietary | 52.4% | 64 | $0.01 | - |
#114 | 🦙 llama-3.2-11b-vision-instruct | Open | 52.2% | 65 | $0.04 | - |
#115 | mistralai/mistral-medium-3-5 | Open | 51.7% | 67 | $0.28 | - |
#116 | ֎ gpt-5.4-nano | Proprietary | 51.7% | 62 | $0.03 | - |
#117 | qwen/qwen3-vl-8b-instruct | Open | 51.7% | 66 | $0.03 | - |
#118 | amazon/nova-lite-v1 | Proprietary | 50.6% | 66 | $0.02 | - |
#119 | qwen/qwen3-vl-32b-instruct | Open | 50.6% | 64 | $0.08 | - |
#120 | qwen/qwen3.6-27b | Open | 50.6% | 64 | $1.03 | - |
#121 | perplexity/sonar | Proprietary | 49.4% | 69 | $0.60 | - |
#122 | x-ai/grok-4.3 | Proprietary | 49.3% | 52 | $0.49 | - |
#123 | 🦙 llama-4-scout | Open | 48.3% | 62 | $0.03 | - |
#124 | perplexity/sonar-pro | Proprietary | 48.3% | 67 | $1.18 | - |
#125 | qwen/qwen3-vl-8b-thinking | Open | 48.3% | 61 | $0.11 | - |
#126 | mistralai/mistral-medium-3.1 | Open | 47.7% | 65 | $0.07 | - |
#127 | perceptron/perceptron-mk1 | Proprietary | 46.1% | 57 | $0.02 | - |
#128 | ✦︎ gemma-3-4b-it | Proprietary | 44.9% | 60 | $0.01 | - |
#129 | qwen/qwen3.5-9b | Open | 42.3% | 64 | $0.11 | - |
#130 | mistralai/mistral-small-3.2-24b-instruct | Open | 41.6% | 56 | $0.02 | - |
#131 | mistralai/mistral-large-2512 | Open | 40.4% | 54 | $0.08 | - |
#132 | bytedance/ui-tars-1.5-7b | Open | 38.2% | 55 | $0.02 | - |
#133 | mistralai/ministral-14b-2512 | Open | 36.0% | 51 | $0.03 | - |
#134 | mistralai/ministral-8b-2512 | Open | 32.6% | 48 | $0.03 | - |
#135 | mistralai/mistral-small-3.1-24b-instruct | Open | 32.6% | 54 | $0.05 | - |
#136 | amazon/nova-2-lite-v1 | Proprietary | 31.5% | 52 | $0.07 | - |
#137 | nvidia/nemotron-nano-12b-v2-vl:free | Free | 29.4% | 53 | $0.00 | - |
#138 | mistralai/ministral-3b-2512 | Open | 29.2% | 47 | $0.02 | - |
#139 | baidu/qianfan-ocr-fast | Proprietary | 29.1% | 45 | $0.17 | - |
#140 | rekaai/reka-edge | Proprietary | 10.1% | 37 | $0.01 | - |
#141 | mistralai/mistral-small-2603 | Open | 9.0% | 19 | $0.03 | - |