Explore the intersection of AI and cybersecurity. Stay informed on AI-driven security trends, tools, and threats in the ever-evolving digital landscape.
Search across headline titles and summaries.
Background for this topic.
Artificial intelligence (AI) describes computer systems that perform tasks such as recognizing patterns, making predictions, understanding language, or generating content. In security reporting, the term commonly includes machine-learning models used for detection and analysis, as well as generative AI applications that produce text, code, images, or other outputs.
AI can help analyze security telemetry, prioritize vulnerabilities, and support investigations, but its outputs can be wrong or manipulated. Important attack surfaces include prompt injection that steers an application into unintended actions, sensitive data being exposed through prompts or model outputs, and excessive permissions granted to AI systems that use external tools. Models can also be degraded by poisoned training data or evaded with carefully crafted inputs. Practitioners should protect training and operational data, limit model access and tool permissions, test for adversarial behavior, and require appropriate human validation before high-impact decisions.
Also: How Leading Cybersecurity Firms are Gearing up for 2025In the latest weekly update, ISMG editors discussed the shooting death of the UnitedHealthcare CEO and its wider implications for AI-driven decision-making, market strategies for the top cybersecurity companies in 2025 and they are reflecting industry trends.
Businesses deploying large language models and other GenAI systems have a growing collection of open source tools for testing AI security.
A new side-channel attack method is a computationally practical way to infer the structure of a convolutional neural network — meaning that cyberattackers or rival companies can plagiarize AI models and take their data for themselves.
Open Questions: What's Next Killer Use Case? Can Output Be Better Validated?The topic of AI reality versus hype, as well as what the next killer use cases might be, dominated the wrap-up "Locknote" panel at this year's annual Black Hat Europe in London, comprised of conference Review Board members detailing this year's hot topics, with AI taking top place.
Run by the team at orchestration, AI, and automation platform Tines, the Tines library contains pre-built workflows shared by real security practitioners from across the community, all of which are free to import and deploy via the Community Edition of the platform. Their bi-annual “You Did What with Tines?!” competition highlights some of the most interesting workflows submitted by their
Open source Prometheus servers and exporters are leaking plaintext passwords and tokens, along with API addresses of internal locations.
Checkmarx's Sandeep Johri Details Malicious Code, AI Risks in Application SecurityAs software complexities grow, supply chain security is now essential to application security, according to Sandeep Johri, Checkmarx CEO. Johri discusses the challenges of malicious code, adversarial AI and the market's call for consolidated security platforms.
Cybersecurity researchers are warning that thousands of servers hosting the Prometheus monitoring and alerting toolkit are at risk of information leakage and exposure to denial-of-service (DoS) as well as remote code execution (RCE) attacks
Multimodal Agentic AI Delivers Speed, Tools, and Research PrototypesGoogle's latest AI model can natively process and output text, images and audio in the search giant's push toward more autonomous reasoning, planning and action. The company said Gemini 2.0 is designed for applications ranging from development and gaming to research and everyday assistance.
LexisNexis Combines AI-Driven Document Authentication With Its Fraud SolutionsTo counter AI-driven fraud, LexisNexis acquired IDVerse, a London-based startup focused on document authentication and regulatory compliance. This acquisition aims to seamlessly integrate advanced tools into LexisNexis' fraud and identity platforms, enhancing global operations.
Defense Bill Targets Key Investments in AI, Cybersecurity and Quantum TechnologiesAn $895 billion National Defense Authorization Act features key provisions for significant investments in artificial intelligence, cybersecurity and quantum technology, including initiatives aimed at enhancing the Pentagon’s technological capabilities.
Sarvant Singh of Penske Transportation Solutions on AI-Powered Fleet OptimizationPredictive AI solutions can now anticipate maintenance needs before issues arise, enabling fleet operators to schedule timely repairs and prevent disruptions, said Sarvant Singh, vice president, data and emerging digital solutions at Penske Transportation Solutions.
Druva CTO Stephen Manley on AI's Role in Modern Data SecurityHistorically, IT and security teams have operated in silos, creating gaps in knowledge and response. Gen AI bridges this gap through natural language interfaces, enabling better communication and understanding between departments, said Druva CTO Stephen Manley.
Copilot Enhancements and Other Key Announcements From Microsoft Ignite 2024Advanced AI took the center stage at Microsoft Ignite 2024. Reflecting on AI as the "most transformative technology of our time," CEO Satya Nadella set the tone for Microsoft's future where every facet of technology is integrated with AI in all key aspects - productivity, collaboration and security.
Startup Aims to Secure AI Agents, Expand Global Reach, Do User Access ManagementAstrix raises $45 million to advance AI agent security and expand its global presence. The company plans to double its workforce, focusing on anomaly detection and fingerprinting techniques for non-human identities along the correlating information about human and non-human identities.
Startup Aims to Secure AI Agents, Expand Global Reach, Do User Access ManagementAstrix raises $45 million to advance AI agent security and expand its global presence. The company plans to double its workforce, focusing on anomaly detection and fingerprinting techniques for non-human identities along the correlating information about human and non-human identities.
Autodesk and AWS Are Driving the Next Generation of AI-Powered Design InnovationAt AWS re:Invent 2024, Autodesk unveiled its innovative vision for generative AI in design. From Project Bernini's billion-parameter foundation model to sustainable workflows powered by AWS, the company is transforming 3D CAD design and shaping the future of creativity.
Prompt injection exploits vulnerabilities in generative AI to manipulate its behavior, even without extensive permissions. This attack can expose sensitive data, making awareness and preventive measures essential. Learn how it works and how to stay protected.
From Automotive Exploits and Bootloader Bugs to Cybercrime and 'LLMbotomy' TrojansBlack Hat Europe returns to London with more than 45 keynotes and briefings tackling everything from bootloader bugs and flaws in artificial intelligence and large language model tools, to disrupting fake online brokerages and remotely hacking Volkswagen entertainment systems to track vehicles.
The compromised ultralytics AI library delivered XMRig miner via GitHub Actions exploit