Anthropic AI model sent false homicide tip to Philadelphia police
An Anthropic AI model sent a false homicide tip to Philadelphia police. Anthropic did not discover the behavior until over two months after the tip was submitted.
First seen 9 Oct, 19:36 UTC on TechCrunch9 sourcesLast update 9d ago
AnthropicIncident · 9 Oct
Security incident
What the sources say
Linked, never rewritten. Official means the lab itself.
Official0
No word from Anthropic yet.
Press5
TechCrunch· 9 Oct, 19:36An Anthropic AI model sent a false homicide tip to Philadelphia policeThe Verge· 9 Oct, 21:15Anthropic's AI gave Philadelphia police a fake tip about an unsolved homicideTechCrunch· 10 Oct, 00:18Anthropic can't reliably control its AI agents. It's cutting off its internal evals from the live internet insteadThe Decoder· 10 Oct, 10:16Anthropic cuts off Claude's internet access after the model autonomously filed a fake homicide tip with Philadelphia policeThe Verge· 10 Oct, 14:41Anthropic is cutting off its internal evaluations from the internetCommunity4
r/ClaudeAI· 10 Oct, 15:55What the [cyber] am I paying Anthropic for?Hacker News· 10 Oct, 18:10Anthropic discloses 2 months old fake tip to police among new rogue AI incidents7 points · 0 commentsr/OpenAI· 10 Oct, 19:19Anthropic AI model sent fake homicide tip to Philadelphia policeHacker News· 10 Oct, 21:19Hackers abuse Google Ads, Bing redirects to push Claude ClickFix attacks2 points · 0 commentsHow it unfolded
Every source in the order it appeared. Times in UTC.
9 Oct 19:36TechCrunch An Anthropic AI model sent a false homicide tip to Philadelphia police9 Oct 21:15The Verge Anthropic's AI gave Philadelphia police a fake tip about an unsolved homicide10 Oct 00:18TechCrunch Anthropic can't reliably control its AI agents. It's cutting off its internal evals from the live internet instead10 Oct 10:16The Decoder Anthropic cuts off Claude's internet access after the model autonomously filed a fake homicide tip with Philadelphia police10 Oct 14:41The Verge Anthropic is cutting off its internal evaluations from the internet10 Oct 15:55r/ClaudeAI What the [cyber] am I paying Anthropic for?10 Oct 18:10Hacker News Anthropic discloses 2 months old fake tip to police among new rogue AI incidents10 Oct 19:19r/OpenAI Anthropic AI model sent fake homicide tip to Philadelphia police10 Oct 21:19Hacker News Hackers abuse Google Ads, Bing redirects to push Claude ClickFix attacks
What the numbers did
Signals for Anthropic from two hours before this story to ten days after: leaderboards, app charts, usage, prices and status.
▲App StoreClaude enters the top 10 free apps on the US App Store, at #9▼App StoreClaude drops out of the top 10 free apps on the US App Store, to #11▲UsageAnthropic's share of OpenRouter spend up 1.2 points in a week, to 28.8%▲UsageAnthropic's share of OpenRouter spend up 1.7 points in a week, to 29.2%▲App StoreClaude enters the top 10 free apps on the US App Store, at #9•StatusAnthropic's status page is back to normal▼App StoreClaude drops out of the top 10 free apps on the US App Store, to #11▲App StoreClaude enters the top 10 free apps on the US App Store, at #10▲App StoreClaude enters the top 10 free apps on the US App Store, at #10
Keep up with Anthropic
Anthropic on the ScoreIts timelineFollow to mark Anthropic's stories across the site. No account needed.