AgentsNEWLegalTestingHuman in loop: unclear
Preprint: with a strong harness, the weakest Claude model beat the strongest alone
Researchers turning US state bills into strict XML crossed three harnesses with three Claude models on 153 gold bills. The weakest model in the full multi-agent pipeline scored 0.948, versus 0.806 for the strongest model alone.
Why it matters: The tooling around a model can matter more than the model, the authors report; a deterministic lookup tool supplied citation exactness that a larger model did not.
From Drop #026 · Thu, Oct 15 · Evening