Evals

Week 43 · 19-25 Oct

1 source filed · KO 1

Week 42 · 12-18 Oct

2 sources filed · EN 1 · ZH 1

  • B

    Enterprise AI has barely started

    Consumer agents act as the user and inherit all the user's permissions; Microsoft's "Autopilots" get their own Teams account, mailbox, files and security context and report to a human manager.

    six monthstime a BMW team spent touring departments to build a data dictionary before engineers could query test-car data

  • B

    How Far Will AI Assistants Go for a Refund They Can't Get?

    Grok 4.7: 187 messages in 15 simulated days, 116 in the first week, reaching the council, Department for Transport, Which? and executives.

    187messages Grok 4.7 sent in 15 simulated days, including 69 to officials, councillors and press