Enterprise AI is entering an evaluation gap: Agents are gaining autonomy faster than companies can verify them

Companies are increasingly granting AI agents more autonomy, yet their ability to rigorously test and verify these systems is waning. A recent survey reveals that half of enterprises have deployed AI features that passed internal tests but led to customer-facing failures, with some experiencing multiple incidents. This gap in evaluation raises significant concerns about the reliability and safety of AI in critical business operations, highlighting the urgent need for better testing protocols and oversight.