AgentsNEWManufacturingTestingHuman in loop: unclear
NVIDIA: a trace-to-test loop cut malformed tool calls from 142 to zero in a CAD agent
NVIDIA says its NeMo Compass and Eval Author tools turn agent traces into tests and harness fixes. In a Dassault Systèmes car door example, it reports a 28% relative score gain and 35% fewer tool calls across six scenarios.
Why it matters: Many fixes sit in prompts and tool validation, not the model. As NVIDIA advises, keep held-out tests your coding agent never sees before accepting a harness change.
From Drop #067 · Thu, Nov 5, 2026 · Morning