Database management enters a new era of complexity
Increasing complexity, the rapid adoption of emerging technologies and a growing skills gap are the biggest concerns facing IT leaders in 2024, according to Redgate.
30% of development teams now deploy database changes to production in a day or less, up by 50% from just two years ago. Further complicating the scenario, the survey showed that 79% of IT teams are now using more than one database platform, with 29% of respondents using more than five.
“Catering for different use cases, adding flexibility and achieving cost savings are the driving factors behind the escalating pace of change toward a multi-platform database landscape,” said David Gummer, Redgate CPO.
“However, the sheer volume of platform choices, with respondents citing usage of 16 different database types, highlights why it’s critical that IT teams are upskilled and have the right tools in place. It’s clear that organizations are currently scrambling to keep up with increased complexity, the pressures of compliance and emerging technologies like AI and the cloud, and are seeking solutions to narrow the skills gap,” added Gummer.
Increased skills demand for individuals and teams
Despite the many benefits of employing multiple databases, an increased skills requirement for individuals and teams is cited as the number one challenge people face, with 38% of respondents naming this as a problem. Skill diversification is also cited as a top need by 31% when dealing with data management processes across multiple database types.
While Database DevOps is well established, with 73% of respondents stating they have already adopted it across all or some of their projects, or are planning to do so in the next two years, issues remain. 42% of respondents state there is a lack of critical skills in their teams, while 29% also cite a limited understanding of DevOps as a major obstacle.
“It’s good to see the database now included as a natural partner in DevOps, with the alignment of people, technology and processes leading to faster, more efficient and stable application development,” Gummer continued. “However, to keep pace with business demands, we have to overhaul our thinking and invest in cross-team education as well as tools across the entire database development lifecycle, particularly if we hope to be ready for yet more new technologies which are already at our doors.”
AI gains traction in database development
The use of AI in database development is also on the rise with 20% of respondents to the survey currently using AI for database management and a further 35% considering doing so. For respondents putting AI to work in database management, 57% confirmed using AI to analyze and optimize database queries or code, 48% said they used it for automating testing scenarios, and 55% confirmed using AI to generate sample data or code.
While there are advantages to be gained, respondents also raised concerns about AI, including worries about data security (42%), the accuracy of the results AI tools produce (37%), as well as concerns over a lack of training and expertise (28%).
The move to cloud is firmly established, with 88% of organizations now using cloud in some way. Although the survey revealed that 36% of respondents favored a hybrid approach, it’s clear cloud adoption is poised to gain further momentum with those hosting databases mostly or all in the cloud growing from 18% to 36% over the last three years.
While cost is typically seen as the biggest driver to the cloud, respondents noted that the scalability and flexibility it offers (48%) followed closely by high availability and reliability (45%) were the two biggest reasons for migrating workloads and data.
“2024 will bring a renewed need for DBAs (database administrators) and developers to acquire new skills so they can best understand and control costs, manage security more effectively, and monitor databases for performance issues when estates are spread across one or more cloud providers as well as on-premises,” Gummer continued.
“In effect, database professionals need to double their skillset to manage the range of database types that are now used by nearly 80% of all respondents in the survey. As an industry, we must work together and rise to the challenge of narrowing these skills gaps – whether that means upskilling internally or finding external solutions to address the needs across the Database DevOps landscape,” he concluded.