Week 35 · 2025 · Post
The 95% AI failure rate, and making the 5% count
The 95% AI Failure Rate? I'll Make Those 5% Count and Scale It Forward
Fresh MIT NANDA research dropped in July with an uncomfortable truth: 95% of business GenAI initiatives deliver zero ROI. I'd say it's not a bug, but feature of new technology - this is the learning tax you pay to reach the 5% that actually transform.
I'm ready for 19 failures to get that 20th success - then 21st, 22nd, 23rd... because that's how you build knowledge around what actually works and how to make transformation happen.
Organizations succeeding today never skipped the failure phase. They found ways to accelerate through it.
The data is brutal but illuminating:
• ChatGPT adoption: 80%+ explored, 40% deployed
• Custom enterprise AI: 60% evaluated, only 5% reached production
• Shadow AI economy: 90% of employees use personal AI tools while official initiatives stall
The myth busting: GenAI isn't transforming business, only 5% of enterprises integrate AI in workflows at scale, with 7 of 9 sectors showing no real structural change. Current solutions lack continuous learning, making them "digital amnesiacs" asking for full context every single time.
The architectural reality: GenAI isn't deus ex machina. It has specific use cases. You wouldn't use GenAI for math or predictions, that's Machine Learning territory. You wouldn't put Agentic AI on constant workflows, but to orchestrate pre-set workflows.
Research shows internal builds fail twice as often as external partnerships (33% vs 66% success). Despite my belief in internal capabilities, data suggests strategic partnerships over pure building everything in-house
I'm placing my bets to use Knowledge Management as a stepping stone to build trust, and scale up with advanced and agentic capabilities. Knowledge is often overlooked, but I believe it's the stepping stone for trust, adoption, and experience. Vectorized data and personalized answers leverage exactly what LLMs do best - find and contextualize information that can be actively updated, realizing continuous learning.
Skeptical note: This research has agenda, NANDA pushes the "Agentic Web" forward. But deep research like this helps navigate hype cycles.
Bottom line:
Bridging GenAI to realization requires abandoning familiar failures and embracing the discomfort of learning, adapting, evolving.
The question isn't whether AI will transform business, it's whether business will transform to leverage new technologies beyond just the LLM/Gen part.
Time to get comfortable with being uncomfortable.