Learning Must Keep up With the Speed of AI

Long-term value depends on investing in strategy, research and human judgment alongside AI-powered products.
Article

The rise of AI-driven product development has dramatically reduced the cost of building digital products, while the speed at which products can be built has also accelerated significantly. Features that once sat on roadmaps for months can now move from idea to production in days. Most organizations see this as a productivity breakthrough. In practice, however, it has exposed a gap in how organizations learn from what they build.

Teams are shipping more—and faster—often without pausing to understand what those outputs deliver. This shift has created a clear imbalance: organizations overinvest in building while underinvesting in learning. The result is constant motion without clear direction.

What matters now is not just producing AI-driven products at scale but ensuring that every build generates knowledge that informs what comes next. Learning must keep pace with creation. Otherwise, rapid delivery becomes noise rather than value.

 

AI is accelerating output—but not understanding

As AI amplifies the pace of development, organizations face growing pressure to keep up with competitors. Teams focus on output, assuming that understanding will follow. Often, it does not.

A few months after a product ships, the same question emerges: did it actually work?

Not in the narrow sense of whether it shipped successfully or scaled reliably, but whether it created meaningful value. Did it solve the right problem? Did it change behavior? Did it produce an outcome anyone can clearly connect to the effort invested? Unfortunately, these questions often remain unanswered.

The fact that many organizations cannot confidently answer the question “Did it actually work?” reflects how they are investing in AI products.

Most organizations are investing heavily in building—the work of generating, shipping and scaling products—because it is the most visible opportunity for AI automation. But the activities that happen before and after execution have not accelerated at the same rate.

This means that organizations are becoming highly efficient at producing output while underinvesting in the activities that create understanding. In AI-driven product development the competitive advantage is shifting from implementation to judgment. The teams that pull ahead will not be those that build the most, but those that make better decisions before building and learn faster after shipping.

 

How to gain a competitive advantage in AI-powered product design

The clearest way to understand this shift—away from solely building-focused and toward deeper understanding—is to look beyond roles and titles and focus on the underlying modes of work that shape every product organization:

  • Framing defines what should be built, for whom and under what constraints.
  • Building transforms those decisions into working products and experiences.
  • Sensemaking interprets what users actually do and turns those signals into better decisions for the next cycle.

Historically, the cost of building constrained how quickly poor decisions could spread. AI changes that dynamic. As prototypes, features and interfaces become easier to generate, the work of framing the right problem and making sense of results is increasingly compressed, postponed or skipped entirely. When teams build faster than they learn, they amplify assumptions rather than insights.

 

Framing

Framing defines what gets built, for whom, with what trade-offs and in what form. The output is not a requirements document. It is a decision architecture: a set of constraints, priorities and validated assumptions that provide the baseline clarity needed to guide building without losing direction.

Strong decision architecture makes hard trade-offs explicit before building begins. It answers questions such as: which user segment are we solving for and which are we deliberately not? What does success look like in measurable terms? What existing behavior are we displacing and why would someone switch?

It also includes the structural design decisions that shape how users experience the product, including the information architecture, the primary user flows and the interaction model that determines whether the product feels coherent or fragmented.

Weak decision architecture defers these questions or worse, assumes alignment that does not exist. It forces the team to uncover disagreements mid-build, when the cost of changing direction has already increased significantly.

This level of precision matters more than ever. When you send a vague prompt to an AI coding agent, it does not pause to ask for clarification. It builds confidently in the wrong direction. In a world of autonomous agents, ambiguity is the most expensive input in the system. It leads to repeated cycles, token overages and environmental impact. Framing reduces this ambiguity.

AI makes it easier than ever to build directionless products at scale. Most teams will not resist this temptation. They will use AI to scale unclear thinking, generating more output without increasing value. The teams that succeed are those that become more selective, not less, as building becomes cheaper.

 

The planning trap

When framing, it is important not to fall into the planning trap. Done well, framing creates clarity, alignment and direction. It ensures teams are solving the right problem before they start building.

The risk emerges when framing becomes disconnected from progress. A team can spend six weeks aligning on a strategy document, while a competitor tests and learns from a working version of the same idea. The work may be thorough, but its impact is reduced if it arrives too late.

AI makes this tension more visible. Prototyping is now fast and accessible. When a working version can be created in an afternoon, the role of framing shifts. Its value is no longer in depth alone, but in how quickly it enables informed action.

Strong framing is therefore measured by what it unlocks. It should guide teams toward smarter decisions and faster learning, not delay them. The goal is not to move faster at the expense of thinking, but to ensure that thinking translates into progress.

 

Building

Building has shifted from a problem of implementation toward managing direction under conditions of rapid generation. It operates within constraints defined in Framing, translating intent into working systems and iterating as new information emerges.

The core challenge is no longer whether something can be built, but whether what’s built remains true to its intent and solves the problems it sought to address.

AI systems can reliably generate outputs that compile correctly, follow the standards of good product design and appear—much like a movie set—to look complete and convincing from the right angle while lacking the structure behind the facade. Very quickly, problems emerge through accumulation: how features interact, how decisions compound and how progress in a consistent direction is preserved across repeated changes.

 

The doom loop

During any building phase, organizations should beware of the doom loop. A team may be tempted to begin prompting before it has clarified what it wants, changes direction mid-build and produces output so layered with conflicting decisions that no agent can untangle it. Starting over becomes cheaper than debugging. This is the clearest signal that the upstream work was skipped.

 

Sensemaking

Sensemaking links outcomes to action by interpreting what occurred, why it occurred and what should change as a result. This function is one that organizations often underestimate until it is too late.

AI can surface what happened, but it cannot yet adequately explain why. Why did adoption stall? Why does a feature resonate in one segment but not another? A designer who can read the gap between the story the team intended to tell and the story users are actually experiencing is doing the same sensemaking work as a researcher conducting interviews, but in a different medium. Without someone who can read those signals and translate them back into planning priorities, the team does not merely lose touch with the market, it also loses the ability to know whether it is succeeding. Internal metrics drift from external reality. The organization optimizes for numbers that no longer correspond to value.

 

The narrative lock

Sensemaking involves building compelling explanations for why things are working, and over time the organization stops questioning them. A product narrative that resonated six months ago can persist even as user behavior shifts.

New data that contradicts the story gets dismissed as noise because the story already has buy-in. Good stories are sticky. And sticky stories resist revision.

By the time someone says, “Wait, that’s not what we’re seeing anymore,” the roadmap is already built on an outdated interpretation.

This is the narrative lock. When sensemaking, it’s important to be actively aware of it—and deliberately work to avoid it.

 

Rebalancing the system

When execution becomes cheaper and faster, clarity becomes the limiting factor. For decades, software organizations were constrained by the cost of implementation. AI removes that constraint and exposes a new one: the capacity to learn fast enough to direct increasingly powerful systems.

The teams pulling ahead are those rebalancing their systems rather than chasing new tools. They strengthen framing to make trade-offs explicit before building begins, and they elevate sensemaking to interpret outcomes without falling into narrative traps. They treat tools like synthetic personas as accelerators of thinking, never replacements for human judgment.

The goal is not additional process, but a tighter feedback loop: framing defines the problem, building tests the experience and sensemaking anchors the next cycle in reality.

 


 

The new competitive advantage

Speed alone should never signal progress. True advantage belongs to organizations that can turn AI acceleration into sustained, compounding knowledge.

Authors
Rustin Afshordi
Director of Product Management, frog North America
Rustin Afshordi
Rustin Afshordi
Director of Product Management, frog North America

Rustin is a leader in frog’s product management practice, where he balances strategy with execution to help teams cut through ambiguity and build net new products and experiences.

He holds a bachelor’s degree in economics from UC Santa Barbara and an MBA from NYU Stern. Outside of work, he’s a casual golfer, wannabe musician, and can usually be found hiking in the Oakland hills with his adopted mutt, Phife Dog.

Emma Brennan
Associate Design Director, frog North America
Emma Brennan
Emma Brennan
Associate Design Director, frog North America

Emma is a design lead specializing in interactions across physical and digital environments. Her work combines research, systems thinking, and experimentation to explore emerging forms of engagement with intelligent technologies, with projects spanning top organizations in tech, aviation, finance and online marketplaces.

Erica Efstratoudakis
Associate Design Director, frog North America
Erica Efstratoudakis
Erica Efstratoudakis
Associate Design Director, frog North America

Erica is a multidisciplinary design lead with over a decade of experience at the intersection of strategy, UX, and visual craft. She specializes in turning ambiguous, early-stage opportunities into clear, scalable product experiences that drive meaningful user and business outcomes.

Currently an Associate Design Director at frog, she leads end-to-end design programs, from vision and alignment through to delivery. Erica thrives in complex spaces, using concepts, prototypes, and strategic rigor to help teams define what to build and why, and to create experiences that are both intuitive and emotionally resonant.

Cookies settings were saved successfully!