Most Organizations Utilize Manual Testing to Validate Apps
July 26, 2022
State of UI/UX Testing Report pinged
Testers, developers, QA managers and UI/UX
designers from nearly 1,000 companies.
Manual testing is still rampant – most organizations automated less than half of their testing despite test coverage for every device being critical.
More than 40% of test suites take more than an hour to run, creating a bottleneck for software delivery. However, respondents from companies that are using Applitools Ultrafast Test Cloud reported an average of 4x faster execution times.
Across the industry, companies are seeing less than 50% test coverage and test suites that take more than an hour to run. However, based on survey data, Applitools customers report 75% test coverage on average and test suite execution takes less than 15-20 minutes on average (or 4x faster than non-customers using traditional methods).
Another challenge reported by nearly 70% of respondents is that the UI is constantly changing across applications and device types causing constant test maintenance and stability issues for engineering teams.
"Achieving higher rates of automation for
testing digital experiences is vital for
companies to stay ahead of the competition
and ensure that their users are getting a
great experience on every device," said
Moshe Milman, co-founder and COO of
Applitools. "Automating a single test case
initially is fairly simple, but maintaining
it over time in a CD environment and
implementing cross-device testing and
improving test coverage to cover all the
critical user flows is more challenging and
important than ever today."
The priority of the types of testing is changing – while unit, functional and API testing remain the most important, usability and UI testing are now more important than load, performance and security testing, according to respondents.
Visual testing and test execution are two key areas where the majority of organizations are looking to implement AI-augmented technology.
Applitools customers are better equipped to handle the challenges of UI/UX testing and quality engineering.
Marianne Epstein, Director of UX design at EVERFI explains: "The number of permutations is overwhelming and was impossible for the UX team to navigate. Applitools provides instant access and validation to the massive inventory of screens and the peace of mind knowing that every regression is immediately spotted across all screen variations ensuring the user experience is exactly as it was intended to be. I feel like it is a transformative tool for our UX team and how we partner with development to drive user experience."