Four reasons your AI pilot isn’t delivering ROI (yet)

Rick LevinePartner / CEO

Why better decisions matter more than faster builds

AI has fundamentally changed the economics of product development. It’s never been easier—or faster—to build. But in the enterprise, that speed is exposing a new reality: bad decisions scale just as quickly as good ones.

Recently, at the Product-Led Summit in NYC, I shared a perspective that’s becoming increasingly clear in our work with clients: achieving ROI with AI comes down to decision-making discipline far more than technology selection.

Across industries, we’re seeing the same pattern. Teams are producing impressive pilots and proofs of concept. But when those same solutions meet real-world conditions—messy data, legacy systems, unpredictable user behavior, and cost constraints—the results fall short of expectations.

The gap shows up in execution, not capability.

The four roadblocks to AI ROI

In practice, most AI initiatives that struggle to deliver value run into four common issues.

1. Data unreadiness

Enterprises don’t lack data—they lack usable data. Feeding unstructured or poorly governed data into large language models leads to inconsistent, unreliable outcomes. Structuring data properly—and increasingly, combining approaches like vector databases for contextual recall and knowledge graphs for precision—can significantly improve performance. AI maturity begins with data discipline, well before model selection enters the conversation.

2. Unrealistic expectations

We often see AI judged against an impossible standard of perfection. But in many enterprise contexts, 80–85% accuracy can still deliver meaningful business impact. The key is reframing what success looks like: moving from "Is this perfect?" to "Does this move the needle?" One client initially viewed their conversational AI as underperforming—until we reframed the outcome. Improving self-service rates from 25% to 50% represents a step-change in efficiency, not a marginal gain.

3. Unthoughtful user experience

Too often, AI is bolted onto products as a feature—a chatbot in the corner, disconnected from the core experience. The more effective approach is to embed AI into the flow of the product itself, using it to guide users, anticipate needs, and reduce friction. In this model, UX becomes a control surface for both experience and cost, shaping how—and how much—AI is used.

4. Unseen costs

AI doesn’t fail loudly in the enterprise—it erodes margins quietly. Token usage, infrastructure, vendor dependencies, and specialized talent all add up. At scale, every interaction has a cost. The most successful teams treat FinOps as part of product strategy, making deliberate choices about models, routing, and experience design to ensure that growth doesn’t outpace profitability.

From experimentation to impact

What separates organizations that achieve AI ROI from those that don't comes down to the ability to make better bets, not access to better tools.

That means structuring data before scaling models. Designing experiences that guide behavior instead of leaving it open-ended. Aligning success metrics to business outcomes rather than technical benchmarks. And investing in platforms and architectures that create multiple paths to value, beyond a single use case.

One example we’ve seen work well is in domain-specific AI agents. Rather than relying on scraped website content, teams are leveraging structured data from headless CMS platforms to power more accurate, reliable interactions. The immediate benefit is improved discoverability and user experience. The longer-term advantage is a foundation that can participate in emerging ecosystems, including agent-to-agent interactions.

A shift in mindset

AI offers no shortcut to ROI. If anything, it raises the bar.

In a world where everyone can build quickly, the advantage shifts to those who can decide clearly—what to build, where to invest, and just as importantly, what not to pursue.

The organizations that succeed won’t be the ones doing the most with AI. They’ll be the ones doing the right things, in the right order, with a clear understanding of how value is created and sustained.

That’s the real reset.

Tags: Technology