In Q4 2025, Forrester’s Wave™ on Autonomous Testing Platforms spotlighted 15 vendors leading the charge toward AI-powered, self-healing, and adaptive testing. These platforms promised to break through the long-standing 25% automation ceiling that has constrained software quality and speed for years (that customers only automate 25% of their tests). But how are these platforms performing in the real world? To find out, during the Wave we spoke with 37 enterprise customers using these tools. The findings, published in our new report, “Buyers Guide: How Customers Experience Autonomous Testing Platforms,” reveal a nuanced picture: real progress tempered by uneven adoption and evolving expectations.

Automation Is Up — But Not Fully Autonomous

The good news: customers report meaningful gains. On average, they’ve automated 51% to 60% of their tests — a significant jump from the industry’s historical plateau. Some advanced teams even surpassed 80% automation, leveraging reusable components and optimized workflows. But autonomy — the promise of platforms that generate, maintain, and execute tests with minimal to no human input — remains aspirational. Customers rated current levels of full autonomy at just 2.2 out of 5. While features like self-healing and AI-assisted test generation are delivering value, they’re not yet replacing human testers. Instead, they’re acting as copilots — reducing maintenance, accelerating test creation, and improving resilience with humans in the loop.

AI’s Impact Is Real, But Uneven

AI is beginning to amplify productivity. Some teams reported double-digit reductions in scripting and maintenance effort. Others, particularly those early in their automation journey or dealing with legacy systems, saw more modest benefits. On average, customers estimated AI increased automation by 21% to 30% over traditional tools. The takeaway? AI’s impact is real, but it’s not automatic. Success depends on a team’s maturity, willingness to adopt new practices, and the platform’s ability to integrate into existing workflows.

Vendor Partnership Is a Differentiator

Perhaps the most consistent theme across interviews was the importance of vendor relationships. Every customer said they would choose their platform again — a rare feat in enterprise tech. Why? Trust. Customers praised vendors who responded quickly to support requests, communicated roadmap updates, and demonstrated a commitment to solving problems. One QA leader shared, “Our vendor doesn’t give up — they try until they get it right.” Another highlighted the value of quarterly roadmap sessions and proactive outreach. This level of partnership often made the difference between a good tool and a great experience. For technology leaders, it’s a reminder: Don’t just evaluate features — evaluate the vendor’s ability to support your journey.

Capabilities Are Broad — But Underused

Autonomous testing platforms are versatile. Beyond UI testing, they support API testing, SaaS and packaged apps like SAP and Salesforce, and even IoT and mainframe environments. Yet, many teams haven’t tapped into these advanced features. Those who did were impressed. Customers using their platform for SaaS testing rated satisfaction at 4.8 out of 5. API testing and service virtualization also scored highly — when used. But adoption remains limited, often due to lack of time, skills, or immediate need. This suggests untapped value. Leaders should ensure they’re not leaving capabilities on the shelf. As needs evolve, these features can unlock new efficiencies and coverage.

What This Means

Autonomous testing platforms are no longer a futuristic concept — they’re delivering real value today. But to maximize ROI, leaders must:

  • Set realistic expectations: AI will augment, not replace, testers — at least for now.
  • Invest in adoption: Training, process change, and gradual rollout are key.
  • Evaluate vendor partnership: Support, transparency, and commitment matter.
  • Explore the full platform: Don’t stop at UI testing — look at APIs, packaged apps, and analytics.

The journey to autonomous testing is just beginning. But for those willing to invest, the rewards — faster releases, higher quality, and empowered teams — are already within reach.

If you’re a Forrester client and you’d like to dig deeper into the current and future state of autonomous testing, you can reach out to me by scheduling a guidance session or an inquiry.