Forrester: Automated Testing Still Challenges Organizations
July 22, 2022
global study, conducted by Forrester surveyed test operations
decision-makers to understand the state of test strategies and
The primary technical challenges resulting from testing complexities are long cycles, accurately capturing bugs and issues, and then fixing them. These problems directly impact business results and the product development process.
Respondents ranked the outcomes as:
48% - Increased expenses
42% - Slower time to market
36% - Defective product
34% - Loss of revenue
Given the emphasis placed on the risk of data security breaches and slow delivery times in automated testing, Bloor Research suggests the integration of production data masking or test data synthesis as part of system testing design. In his article IRI Voracity and Test Design Automation, analyst Daniel Howard cites examples of seamless invocations of these fast-executing jobs in popular DevOps pipelines to substantially ameliorate or remove the test data bottlenecks involving sensitive data which increase product development costs.
However, enterprises recognize that manual and partially automated
testing strategies cannot keep pace with the increasing complexity of
products. As a result, 45% will consider using a fully automated
approach in the next three years, a 409% growth. Over half (52%) stated
they would look at AI for integrating complex test suites, a 325%
A weak link in your testing lifecycle will often lead to bottlenecks.
Source: Bloor Research
In this study, Forrester conducted an online survey of 406 test operations decision-makers at organizations in North America, EMEA and APAC to evaluate current testing capabilities and to hear their thoughts on investing in automation (including AI). Questions provided to the participants asked about their organizations' current testing environments, future investments, challenges and expected outcomes from testing automation.