Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?
Mean relative improvement across 20 benchmarks: Claude Opus 4.6 10.4%, Claude Sonnet 4.6 9.6%, Gemini 3.1 Pro 6.8%, Codex (GPT-5.4) 4.4%.
20scientific ML benchmarks across 11 domains in the Agent4Sci testbed (25 tasks)