Agents in Data science

Preprint: most data science agent solutions hide at least one methodological failure

Across 220 data science tasks, researchers report most agent solutions contain at least one failure mode, such as data leakage, and that leakage correlates with higher predictive scores.

Why it matters: A model that scores well may be leaking data. Check how an agent validated its work, not just its accuracy.