AI R&D automation

Week 45 · 2-8 Nov

2 sources filed · EN 2

Week 41 · 5-11 Oct

1 source filed · EN 1

  • A

    Can AI automate AI R&D yet? (InnovationEval)

    Each agent received 3,000 GPU-hours on up to 50 GPUs and a 10 billion-token inference budget, in a sandbox without internet access, with a codebase scrubbed of SDPO.

    35%share of the human method's gains reached by the best uncontaminated model (GPT-5.6 Sol), scored generously; 15% when only in-scope changes count