⚙️ AI Hardware

EnterpriseOps-Gym Exposes Why AI Agents Crumble in Real Offices

Imagine your AI assistant botching an IT ticket, leaving orphaned records everywhere. ServiceNow's EnterpriseOps-Gym proves even elite models struggle in real enterprise chaos.

Chart of AI model performance on EnterpriseOps-Gym benchmark with success rates and costs

⚡ Key Takeaways

  • Top AI agents hit just 37% success in enterprise benchmarks, failing hardest on planning.
  • Human-provided plans boost performance 14-35 points, proving strategy as the bottleneck.
  • Cost-performance favors cheap models like Gemini-3-Flash for practical deployment.

🧠 What's your take on this?

Cast your vote and see what theAIcatchup readers think

Aisha Patel
Written by

Aisha Patel

Former ML engineer turned writer. Covers computer vision and robotics with a practitioner perspective.

Worth sharing?

Get the best AI stories of the week in your inbox — no noise, no spam.

Originally reported by MarkTechPost

Stay in the loop

The week's most important stories from theAIcatchup, delivered once a week.