Cybersecurity pros predict rise of malicious AI

76% of cybersecurity professionals believe the world is very close to encountering malicious AI that can bypass most known cybersecurity measures, according to Enea.

malicious AI

26% see this happening within the next year, and 50% in the next 5 years.

Worries about rogue AI among security professionals

In addition to the concern about offensive AI outpacing defensive AI, a significant 77% of professionals express serious worries about rogue AI, where AI behavior veers away from its intended purpose or objectives and becomes unpredictable and dangerous.

Phishing, social engineering and malware attacks are seen as the top threats that will be strengthened by AI, but identity fraud, data privacy breaches, and DDoS attacks were also cited as likely to become more effective.

Respondents are nonetheless optimistic about AI’s positive impact on cybersecurity. AI is anticipated to bolster threat detection and vulnerability assessments, with intrusion detection and prevention identified as the domain most likely to benefit from AI. Deep learning for detecting malware in encrypted traffic holds the most promise, with 48% of cybersecurity professionals anticipating a positive impact from AI.

Cost savings emerged as the top KPI for measuring the success of AI-enhanced defenses, while 72% of respondents believe AI automation will play a key role in alleviating cybersecurity talent shortages.

AI adoption remains low in cybersecurity

61% of organizations are yet to deploy AI in any meaningful way as part of their cybersecurity strategy, 41% consider AI as a high or top priority for their organization. And a hopeful 68% of respondents expect a budget increase for AI initiatives over the next two years.

50% of cybersecurity leaders report that their organization has “extensive knowledge” regarding AI/ML in cybersecurity, and another 19% report “moderate knowledge,” with the remaining roughly one-third reporting no-to-minimal knowledge. When asked what steps organizations should take to prepare for sophisticated or overwhelming AI attacks, 68% cited increased cybersecurity training and awareness for employees.

Developing AI-specific incident response plans followed close behind (65%), and 61% said regular security assessments and audits. Over half of all respondents said that strengthening traditional security controls such as zero-trust protocols, multi-factor authentication, next-gen firewalls, and threat intelligence were key to preparing for sophisticated AI attacks.

“Understanding the profound impact of AI on cybersecurity is crucial for navigating the evolving threat landscape,” said Laura Wilber, Sr. Industry Analyst at Enea. “That begins by listening closely to the concerns and hopes of cybersecurity leaders and their teams on the front lines.”

“This report confirms growing concerns around the malicious use of AI, but it also highlights some remarkable innovations in the use of AI to streamline and automate defenses. Significant gains have already been made, such as a reduction in the average time it takes to detect and contain threats. However, AI is not a one-size-fits-all solution – it’s essential that businesses take a clear and methodical approach to implementing AI strategies in order to achieve maximum readiness and resilience. As we say at Enea – don’t be surprised, be ready.”

Don't miss