rank | offering | model | provider | agent_edit_seconds_per_case | solve_rate_2 | edit_format | aider_version | benchmark_date | pass_num_2 | commit_hash | reasoning_effort -----+------------------------------------------------------------+------------------------------------------+----------+-----------------------------+--------------------------------------+-------------+---------------+----------------+------------+-------------+----------------- 1 | aider-polyglot/2025-03-29-05-24-55--chatgpt4o-mar28-diff | chatgpt-4o-latest (2025-03-29) | unknown | 10.3 | 0.4533333333333333333333333333333333 | diff | 0.79.3.dev | 2025-03-29 | 102 | 0decbad | 2 | aider-polyglot/2025-01-17-19-44-33--sonnet-baseline-jan-17 | claude-3-5-sonnet-20241022 | unknown | 21.4 | 0.5155555555555555555555555555555556 | diff | 0.71.2.dev | 2025-01-17 | 116 | 6451d59 | 3 | aider-polyglot/2025-02-24-19-54-07--sonnet37-diff | claude-3-7-sonnet-20250219 (no thinking) | unknown | 28.3 | 0.6044444444444444444444444444444444 | diff | 0.74.4.dev | 2025-02-24 | 136 | 75e9ee6 | 4 | aider-polyglot/2025-05-25-19-57-20--opus4-diff-exuser | claude-opus-4-20250514 (no think) | unknown | 42.5 | 0.7066666666666666666666666666666667 | diff | 0.83.3.dev | 2025-05-25 | 159 | 9ef3211 | 5 | aider-polyglot/2025-05-25-20-40-51--opus4-diff-exuser | claude-opus-4-20250514 (32k thinking) | unknown | 44.1 | 0.72 | diff | 0.83.3.dev | 2025-05-25 | 162 | 9ef3211 | 6 | aider-polyglot/2025-08-25-14-16-37--gpt-5-low | gpt-5 (low) | unknown | 62.4 | 0.8133333333333333333333333333333333 | diff | 0.86.2.dev | 2025-08-25 | 183 | 32faf82 | low 7 | aider-polyglot/2025-08-25-13-23-27--gpt-5-medium | gpt-5 (medium) | unknown | 118.7 | 0.8666666666666666666666666666666667 | diff | 0.86.2.dev | 2025-08-25 | 195 | 32faf82 | medium 8 | aider-polyglot/2025-08-23-15-47-21--gpt-5-high | gpt-5 (high) | unknown | 194 | 0.88 | diff | 0.86.2.dev | 2025-08-23 | 198 | 32faf82 | high