Coding LLM Benchmark

โ† Back to leaderboard

Pricing & capacity

Avg cost
$0.44 per run
Input price
$0.38 / 1M tokens
Output price
$1.75 / 1M tokens
Context window
203K

Capabilities

Vision
Yes
Reasoning
Yes
Tool calls
Yes
Cursor
No
OpenRouter
No

Agent scores

Overall
41.0%
Issue Resolution
73.4%
Frontend
22.1%
Greenfield
6.2%
Testing
49.4%
Information Gathering
53.9%

Notes

Open-source from Zhipu AI. SWE-bench 73.4% on OpenHands. Cheapest input pricing in the leaderboard ($0.38/1M).