CursorBench 4.0
We evaluate agents on ambiguous, multi-file tasks from real Cursor sessions. Higher scores are better.
More about CursorBenchChangelog
Reporting
- Updated Sonnet 5.5 results to account for adjusted pricing.
Tasks
- CursorBench 4.0
- Introduced new long-horizon problems focused on edit, refactor, investigation, intent understanding, managing jobs, and design adherence.
Reporting
- Updated Sonnet 5 results to account for adjusted pricing.
Reporting
- Updated GPT-5.6 Terra and Luna results to account for adjusted pricing.
Reporting
- Updated GPT-5.6 Sol, Terra, and Luna results to account for cache write costs.
Tasks
- CursorBench 3.2
- Introduced instruction following and advanced tool use problems.
Tasks
- CursorBench 3.1
- Introduced problems focused on codebase understanding, bugfinding, planning, and code review.
- Improved grading criteria for some edit tasks.
Tasks
- CursorBench 3.0
- Initial set of tasks focused on edit, refactor, and bugfix problems.
Avg cost / task is computed by applying each model's published per-million-token pricing (input, cache read, cache write, and output) to the tokens it used on each task. Results are subject to variance; small differences in scores may not be statistically meaningful.
CursorBench 4.0
We evaluate agents on ambiguous, multi-file tasks from real Cursor sessions. Higher scores are better.
More about CursorBenchChangelog
Reporting
- Updated Sonnet 5.5 results to account for adjusted pricing.
Tasks
- CursorBench 4.0
- Introduced new long-horizon problems focused on edit, refactor, investigation, intent understanding, managing jobs, and design adherence.
Reporting
- Updated Sonnet 5 results to account for adjusted pricing.
Reporting
- Updated GPT-5.6 Terra and Luna results to account for adjusted pricing.
Reporting
- Updated GPT-5.6 Sol, Terra, and Luna results to account for cache write costs.
Tasks
- CursorBench 3.2
- Introduced instruction following and advanced tool use problems.
Tasks
- CursorBench 3.1
- Introduced problems focused on codebase understanding, bugfinding, planning, and code review.
- Improved grading criteria for some edit tasks.
Tasks
- CursorBench 3.0
- Initial set of tasks focused on edit, refactor, and bugfix problems.
Avg cost / task is computed by applying each model's published per-million-token pricing (input, cache read, cache write, and output) to the tokens it used on each task. Results are subject to variance; small differences in scores may not be statistically meaningful.
