Best practices and challenges in adopting continuous software testing
Businesses must accelerate the shift to comprehensive continuous software testing in order to remain competitive, according to a report released by Capgemini and Broadcom.
The report, based on a survey of 500 senior decision makers in corporate IT reveals that most businesses find it challenging to adapt their quality assurance and testing processes to the Agile way of working.
The crux of the challenge is that organizations find it difficult to frequently deploy a large number of releases faster into production, while also implementing an adequate, continuous, and fast validation process to prevent serious issues in production. In the absence of this balance, business performance and growth are at risk.
The report indicates that without full adoption of continuous software testing, businesses will reach a point where they will be unable to meet customer needs, making them vulnerable to more successful Agile competitors.
Orgs must invest in skilled pros and quality test solutions
While 55% of the enterprises surveyed have now adopted a continuous software testing approach, its slow increase in maturity (compared to last year) demonstrates a critical challenge for organizations to overcome.
Up to 56% of the organizations admitted they have challenges with in-sprint testing. Respondents said their teams spend 44% of their time searching, managing and generating test data, while 36% stated that their teams spend more than half their time building and managing test environments.
62% of respondents said they are struggling to find skilled professionals to build their continuous software testing strategy and a third said developing skills in testing AI systems was a priority.
These factors are compounded by the issue of larger teams being held back by legacy systems, applications and hierarchies which can make applying new ways of working more challenging. To overcome these challenges, companies must focus on embracing the orchestration of quality engineering in Agile and DevOps.
“Continuous software testing is a critical element for gaining competitive advantage in an environment where companies must deliver products faster and faster to market in order to remain relevant.
“Organizations must accelerate their investment in quality engineering skills and continuous test solutions within their Agile and DevOps teams to ensure that Agile at scale does not fail,” said Mark Buenen, Global leader of digital assurance and quality engineering services, at the Capgemini.
“To achieve this, they must empower cross-functional Agile teams with sufficient quality engineering expertise and enable the QA culture, QA automation and test environment provisioning with a flexible quality support team.”
Creating visibility over quality levels and meaningful KPIs
78% of respondents said that “getting visibility throughout the development lifecycle” is a challenge when implementing continuous software testing.
The report suggests that the entire software development lifecycle needs to be brought together in a single source of truth, from release management through to deployment, with integrated tooling, quality checks, and metrics, to meet business needs.
Leveraging more intelligent solutions
According to the report, teams need to make more use of intelligent solutions to ensure they are selecting the right test cases and validating correctly. At present only 42% make use of AI for predictive analytics, just 36% are deploying code coverage and 39% using analytics from operations.
Investment in quality assurance skills
To leverage those intelligent solutions, businesses need to invest in new skills, including knowledge of business processes, automation, data analysis and machine learning.
Most respondents (62%) said they are struggling to find skilled professionals to build their continuous software testing strategy. A third said developing skills in testing AI systems was a priority.
Test organization and environments
36% of respondents stated that they spend over half their time managing test environments – the same proportion as last year. Companies need to take a different approach, cites the report, building test environments that can be spun up, replicated, decommissioned, and managed at scale. This will involve practices included cloud provisioning (currently used by 53% of respondents), service virtualization (45%), and containerization (37%).
“Continuous quality is critical for Agile, DevOps, and digital transformation. Besides making test automation a priority, organizations also need to think of embedding quality into every phase of their software development lifecycle.
“This requires modern, developer-friendly, AI-powered tools that make continuous quality easy to adopt and practice for every stakeholder and every team— from business to technical users.
“Teams need to overcome traditional barriers to quality at scale with tools that enable shift left and shift right, and leverage AI to provide proactive, actionable insights to maximize quality,” said Sushil Kumar, head of DevOps and Continuous Testing Business, Enterprise Software Division, Broadcom.