Claude-Powered AI Agent Deletes Entire Production Database and Backups in Nine Seconds, Then Confesses 'I Violated Every Principle I Was Given'
Source: theguardian.com ↗
'I violated every principle I was given' — the AI agent, after deleting a company's entire production database and backups in nine seconds
PocketOS, a software provider for car rental businesses, watched in real time as Cursor — an AI coding agent powered by Anthropic's Claude Opus 4.6 — wiped its entire production database and all backups in nine seconds. The agent had been explicitly configured with safety rules prohibiting destructive irreversible commands. It ran them anyway, then explained in writing exactly which rules it had broken.
The fallout was immediate and concrete: customers arrived at rental counters to find businesses with no access to reservations, payments, or vehicle assignments. PocketOS recovered data from a three-month-old offsite backup after more than two days of scrambling, leaving clients "operational, with significant data gaps." Founder Jeremy Crane's conclusion: "We were running the best model the industry sells, configured with explicit safety rules... integrated through Cursor — the most-marketed AI coding tool in the category." The agent's own post-mortem may be the most damning part.