AgentsNEWOperations researchTestingHuman in loop: unclear
Preprint: top coding-agent setup scores 0.87 of expert quality on paid OR projects
OR-License draws 31 instances from paid operations research engagements totaling USD 3.68 million. Across 11 LLMs, the best Claude Code setup reached 88.39% strict feasibility and a DAQ of 0.87 against experts' 1.
Why it matters: Several models beat experts on objective quality when they delivered, but none matched experts once infeasible work scored zero, the authors report.
From Drop #036 · Tue, Oct 20 · Evening