OpenAI Bans Accounts Misusing ChatGPT for Surveillance and Influence Campaigns
OpenAI on Friday revealed that it banned a set of accounts that used its ChatGPT tool to develop a suspected artificial intelligence (AI)-powered surveillance tool
Explore the intersection of AI and cybersecurity. Stay informed on AI-driven security trends, tools, and threats in the ever-evolving digital landscape.
Search across headline titles and summaries.
Background for this topic.
Artificial intelligence (AI) describes computer systems that perform tasks such as recognizing patterns, making predictions, understanding language, or generating content. In security reporting, the term commonly includes machine-learning models used for detection and analysis, as well as generative AI applications that produce text, code, images, or other outputs.
AI can help analyze security telemetry, prioritize vulnerabilities, and support investigations, but its outputs can be wrong or manipulated. Important attack surfaces include prompt injection that steers an application into unintended actions, sensitive data being exposed through prompts or model outputs, and excessive permissions granted to AI systems that use external tools. Models can also be degraded by poisoned training data or evaded with carefully crafted inputs. Practitioners should protect training and operational data, limit model access and tool permissions, test for adversarial behavior, and require appropriate human validation before high-impact decisions.
OpenAI on Friday revealed that it banned a set of accounts that used its ChatGPT tool to develop a suspected artificial intelligence (AI)-powered surveillance tool
Also: AI Benchmark Hype, Trump's Cybersecurity Shake-Up, Musk's Growing InfluenceIn this week's update, ISMG editors analyze motives behind Russia's sudden crackdown on ransomware gangs and discuss whether AI benchmark scores are more hype than reality and whether President Donald Trump's policies and Elon Musk's influence pose security risks - or just more political theater.
Researchers say there's dissent in the ranks. Plus: An AI tool lets you have a go yourself at analysing the data Hundreds of thousands of internal messages from the Black Basta ransomware gang were leaked by a Telegram user, prompting security researchers to bust out their best Russian translations post haste.…
Wherever there’s been conflict in the world, propaganda has never been far away. Travel back in time to 515 BC and read the Behistun Inscription, an autobiography by Persian King Darius that discusses his rise to power. More recently, see how different newspapers report on wars, where it’s said, ‘The first casualty is the truth.’ While these forms of communication
Large Language Models (LLMs) can provide many benefits to security professionals by helping them analyze logs, detect phishing attacks, or offering threat intelligence. Learn from Wazuh how to incorporate an LLM, like ChatGPT, into its open source security platform. [...]
EIT Oxford's Dr. Laura Gilbert on AI Accountability and Responsible AI AdoptionAI adoption demands a balance between ethics, regulation and compliance. Dr. Laura Gilbert, head of AI for government at EIT Oxford and Tony Blair Institute for Global Change, and AI expert advisor for the British government, discusses how AI can enhance decision-making in public and private sectors.
Regulators Cite Privacy Concerns Over DeepSeek's Data Collection PracticesThe Personal Information Protection Commission, South Korea's data protection regulator, has directed Chinese artificial intelligence company DeepSeek AI to withdraw its chatbot application from official app stores pending an inquiry into the chatbot's compliance with data protection rules.
CDR, DLP Provider Will Help Safeguard Cloud-Based Applications, Collaboration ToolsMenlo Security bought a data and file security vendor led by a longtime IBM executive to secure cloud-based applications and collaboration tools. Votiro's CDR and DLP tools will neutralize threats in real time and facilitate AI-driven data protection without disrupting user workflows.
Information-Stealing Malware Continues to Feed Markets for Stolen CredentialsDefense sector and military agency employees, and artificial intelligence service users, all show signs of having been infected by information-stealing malware, as the market for buying and selling stolen credentials continues to thrive, experts warn.
While AI-generation services and major camera makers are adopting the specification for digitally signed metadata, creating a workflow around the nascent ecosystem is still a challenge.
Thinking Machines Lab Looks to Build Multimodal, Safe AIFormer OpenAI CTO Mira Murati launched a new artificial intelligence startup with an aim to bridge the gap between rapidly advancing AI technologies and the public's understanding of them. The startup is an attempt to create AI systems that can adapt to individual user needs.
Acquisition strengthens Deepwatch Platform capabilities with actionable insights and risk-based prioritization.
Investment Led by Bain Capital to Enhance Predictive Threat Detection CapabilitiesDream raised $100 million in Series B funding from Bain Capital on a $1.1 billion valuation to enhance its proprietary Cyber Language Model and expand globally, with a focus on U.S. market entry to address growing national security threats through AI-driven cybersecurity and predictive solutions.
Grok 3 Aims to Close Gap With GPT-4o, Gemini, Touting 'Truth-Seeking' AIElon Musk-owned artificial intelligence company xAI released a new model late Monday night, its answer to OpenAI's GPT-4o and Google Gemini. The "Grok 3" model can analyze images and respond to questions like its counterparts, and powers features on Musk's social network X, formerly Twitter.
Acquisition Boosts Speed With Agentic AI for Analysts and Automated Risk ReportingDeepwatch’s acquisition of Dassana enhances its security offerings with agentic AI and automated threat exposure management. CEO John DiLullo highlights benefits including automated compliance reporting, faster detection capabilities for customers, and rapid integration with existing MDR services.
Is AI really reshaping the cyber threat landscape, or is the constant drumbeat of hype drowning out actual, more tangible, real-world dangers? According to Picus Labs’ Red Report 2025 which analyzed over one million malware samples, there's been no significant surge, so far, in AI-driven attacks. Yes, adversaries are definitely continuing to innovate, and while AI will certainly start playing a
Leaderboard Race May be More Marketing than MeritArtificial intelligence model makers routinely publish benchmark scores of their performance, but the leaderboard race may be more an exercise in marketing than an accurate reflection of the models' abilities. Understanding model failures can be more valuable than celebrating high scores.
South Korea’s Personal Information Protection Commission is blocking DeepSeek AI downloads over privacy concerns