Posts tagged benchmark
-
AI coding agents: is the model or the harness the bottleneck?
I held the model fixed and swapped the harness around it across a 12-task suite. On easy tasks it barely mattered; on hard, structured tasks the harness decided the outcome. Plus the first results I got wrong and had to correct.