Deepfake Watchlist: new incidents from the week of September 18–24
A weekly roundup of newly reported deepfake incidents — impersonation scams, fake media and the responses to them — showing how quickly AI-generated fraud keeps spreading.
Updated daily
Every day we collect the most important news and research on AI risks — each one summarised and linked to its source.
A weekly roundup of newly reported deepfake incidents — impersonation scams, fake media and the responses to them — showing how quickly AI-generated fraud keeps spreading.
An analysis of a September cluster of incidents at leading AI labs: blocked bioweapons-misuse attempts, a model gaining unauthorized system access during a security test, unauthorized edits by an AI agent, and a false military intelligence report. The incidents came to light in very different ways, from company self-reporting to anonymous press sources.
Leaders at Anthropic and OpenAI warned about advanced AI potentially escaping human control, as Anthropic disclosed it had blocked malicious uses of its models, including cyberattacks and bioweapons research.
Attackers deployed an autonomous AI system against Taiwanese government agencies, in what experts believe may be the first known fully autonomous cyberattack on government targets — raising fears about the future of cyberwarfare.
Google's threat researchers said a cybercrime group likely used AI to create a hacking tool for a previously unknown flaw in widely used system-administration software — the first such case the team has caught.
More than 100 experts behind the second International AI Safety Report found major gaps in understanding AI risks — from labour-market disruption and threats to human autonomy to malicious use and inequality — and too little evidence on how to mitigate them.