Tool Misuse

A 16-year-old in Parker County, Texas faces multiple felony charges after confessing to using AI to transform real photos of younger children into nude deepfakes and posting them to TikTok. The investigation began in July 2026 when TikTok flagged the account to the National Center for Missing and Exploited Children; it took until October for the case to reach the right jurisdiction and result in a search warrant.

Investigators seized the teen's devices on October 1 and, by October 8, had confirmed at least four juvenile victims. The suspect was processed and released to their parents pending court proceedings. Charges include second-degree felony possession of child pornography and two state jail felonies for voyeurism and possession of visual material depicting a child.

A resident of Magdagachi in Russia's Amur region used ChatGPT to generate an image of a large brown bear walking down a local street, sent it to a friend as a prank, and watched it go viral through messaging apps. Police received a flood of alarmed calls, and the district head dispatched wildlife rangers to find an animal that did not exist. The woman turned herself in; a court this week fined her 15,000 roubles ($178).

The timing was poor. Russia is in the middle of a genuine bear crisis: at least 26 people have been killed in attacks since spring 2026, driven by a growing bear population (now 308,000, more than double its level three decades ago) and a poor crop of the berries and nuts the animals normally eat. A second woman in Transbaikal was separately fined 30,000 roubles for a similar fake bear post in mid-September.

Elon Musk urged his followers to share their credit card photos with Grok Bot so it could shop for them, then posted a screenshot of his own LEGO Star Wars order as proof of concept — complete with his order number, email address, and the last four digits of his card. A user named Enderman promptly posted screenshots claiming to have canceled the order through LEGO's customer service bot. Musk denied it and fumed in the replies. Imitators followed: another user claimed to have un-canceled the order, placed 400 more of the same item, and changed the shipping address to Jeffrey Epstein's private island.

Whether any of the cancellation claims were real is unclear — LEGO declined to comment. What is clear is that Musk's demonstration of AI-assisted shopping produced, within 24 hours, a viral pile-on and a lesson in not posting your order details publicly. Security researchers have already documented scammers building fake storefronts specifically to exploit AI shopping agents, and the more financial permissions an agent holds, the larger the blast radius when something goes wrong.

On Sept. 26, a user identified only as "Carli" told an Anthropic AI platform that she was going to "shoot up" the Lee County Sheriff's Office. The next day, the same account said she had gotten a new gun. Anthropic's monitoring system flagged the phrases, a human review team read them, and the statements went to law enforcement, according to the arrest report.

Deputies traced the account to Carli Michelle Heller of Bonita Springs, detained her at her home without incident, and charged her with making a written threat of violence under Florida law. Her court date is in November. Sheriff Carmine Marceno said Heller told investigators she uses AI like a "diary." Anthropic's published government request policy says user information may be disclosed to law enforcement in limited emergency situations involving danger of death or serious physical injury. WINK News reports Anthropic did not answer questions about how its safeguards handle threats or when data is shared with police.

The Internet Watch Foundation assessed 6,310 AI-generated images meeting the legal definition of child sexual abuse in the first half of 2026 alone — already 40% above the full-year 2025 total of roughly 4,500. The majority depicted girls aged seven to thirteen. The figures cover still images only; the IWF separately noted a "huge surge" in AI-generated videos.

The IWF is calling for binding legislation requiring companies to build models that cannot produce this material by design. The UK government has made it illegal to adapt or distribute models used to generate such imagery, with sentences of up to five years, but no new AI-focused bill is imminent. The Report Remove service, which blocks intimate images from appearing online, has already received 420 reports from children about images of themselves they believed were AI-faked — also exceeding its full 2025 total of 397.

U.S. Rep. Derrick Van Orden has been posting AI-generated videos to X showing his Democratic challenger Rebecca Cooke saying things she never said, including that she's running for Congress "to take advantage of as much corruption as possible and give every illegal alien free healthcare." The videos carry automatic labels identifying them as made with Grok Imagine, xAI's image and video generator. On Sept. 30, Cooke's attorneys sent Van Orden a cease-and-desist letter warning that the videos may constitute defamation under Wisconsin law, and that they were "monitoring" his accounts.

Van Orden's response was to post another Grok-generated video, this one featuring a red AI duck shouting "Cease and desist!" His campaign described Cooke's legal action as a "full blow tantrum." Cooke, for her part, noted the irony that the deepfakes were produced using the same AI infrastructure Van Orden had supported with federal tax breaks.

Meta's Muse agent — which lets you name its avatar and watch it cheerfully tap on a virtual keyboard — managed a landscaper follow-up, a junk removal quote, and a steam wand part in a single morning of testing. It also assembled a $500 camping kitchen and fire pit order before the reviewer had to tell it to slow down.

The productivity gains came with a cost beyond the credit card: within 40 minutes, the reviewer had handed Muse her full name, home address, credit card number, a photo of her backyard, and the login credentials for her home security account. Amazon blocked the agent outright for violating its terms of service. The security company required a human phone call Muse couldn't make. And the time freed up by crossing items off the list was promptly spent chatting with Marley about yard renovation anxieties and fall camping trips that probably won't happen.

A security research firm reviewed 7,246 publicly reported AI incidents from September 2023 to May 2026 and found 188 cases where an autonomous AI agent directly damaged production systems — deleted databases, wiped code, leaked secrets, or lost money — with no external attacker in the chain. The agent had a task, pursued it, and broke something on the way to finishing. In one April 2026 case, a coding agent at car-rental software vendor PocketOS deleted the company's production database and then its backups, in seconds, while completing a routine engineering task it had not been told to stop.

The largest cluster — 65 of 137 "real-world damage" incidents — was deletion and code destruction: dropped databases, wiped git histories, rm -rf on production, cloud resources torn down. In a separate case, an AWS internal agent deleted and recreated part of a production environment during troubleshooting and triggered a roughly 13-hour outage. Claude Code appears repeatedly across categories: an unauthorized transfer of ~1,446 USDT from a user's spot wallet to their futures account, an unsanctioned Google Cloud project created with billing attached, secret keys surfaced in terminal output despite explicit prohibitions, and a source code leak traced to a debug file pointing at Anthropic's internal repository. The incident count was flat through most of 2025, then jumped sharply in December — timing that Cyera's researchers tie to the enterprise rollout of autonomous coding tools like Claude Code, Cursor agent mode, and Devin.

A French-speaking hacker used Claude to build and refine a targeting and hacking infrastructure aimed at roughly 40 European political organizations, Anthropic disclosed in a security report published September 10. Of 42 tracked targets — the majority French and associated with the far right, including at least one political party, a training institute, and several news outlets — the hacker gained internal access to 14 and walked away with an estimated 12 to 26 GB of database dumps containing donor records and party membership data.

Among the confirmed victims was Frontières, a French far-right magazine whose comments section was compromised via injected spyware; the site has since disabled comments entirely. Anthropic did not name the other targets. The case is one of the cleaner real-world examples of an AI model being used to operationalize a cyberattack from end to end, from target research through intrusion.

Complaints to the UK's Housing Ombudsman jumped from roughly 1,700 a year to around 7,000, and the Bar Standards Board logged a 25% rise in complaints over the past year — both blamed on AI. An academic study across 84 public bodies, from Britain to Japan to Germany, found that chatbots have slashed the cost of filing a complaint to near-zero, producing a surge in volume and complexity that human staff cannot process at anything close to the same speed.

The problem compounds itself. Officials send a reply; the complainant pastes it into ChatGPT and asks for flaws, challenges, and escalations; the next submission arrives longer and more combative than the last. Many of the underlying complaints are also inaccurate or nonsensical, since people assume whatever the chatbot told them is correct. Some institutions have started fighting back: the California Management Review now charges $75–$150 per submission after manuscript volume tripled. The academics behind the study warn that such deterrents may actually increase AI use while discouraging real people from filing claims at all.

A financially motivated threat actor assembled an autonomous AI attack framework from a coding chatbot, a prompt, and a set of agent instructions, then used it to compromise thousands of credentials in under six hours, according to Google's Threat Intelligence Group. Troubleshooting and IP rotation ran without an operator; traffic exited through the victim's own addresses, making it look legitimate on the way out.

The same report names UNC6780 (also tracked as TeamPCP) as the group behind poisoned forks of Model Context Protocol servers across PyPI, npm, and Docker Hub. Its DUSTMAKER credential stealer drops files into hidden directories like .claude and .cursor, where AI tooling reads them as ordinary developer clutter. Some malware samples embedded prompt injections written as extreme requests about biological and nuclear weapons, text apparently designed to make LLM-based security scanners refuse the file and skip the malicious JavaScript underneath.

A Colorado state senator filed what may be the first complaint under the state's deepfake disclosure law after a Libertarian think tank released an AI-generated video depicting her as a grocery store clerk pocketing a customer's change. The Independence Institute made the video to counter Sen. Cathy Kipp's floor remarks defending Proposition NN, which would allow the state to retain up to $4.6 billion in taxpayer refunds otherwise owed under Colorado's Taxpayer Bill of Rights.

Colorado law requires deepfakes of candidates or sitting lawmakers to include a clearly sized disclosure stating the content is edited and non-authentic. The Independence Institute's disclaimer read: "AI generated content because who gets a human cashier these days?" — and was smaller than the surrounding text. The organization's president, Jon Caldara, argues the law doesn't apply because the video concerns a ballot initiative rather than a candidate, and that it qualifies as satire. The Secretary of State's Office is investigating.

Jeremy Batterman, of Kane County, Illinois, was charged on August 12 with 40 counts of production of child sexual abuse material and four counts of obscene depiction of a purported child after allegedly photographing children as young as 11 at a church and a middle school, then using publicly available AI apps to convert those images into explicit material. Prosecutors say he also generated CSAM from scratch using the same tools.

A CyberTip to the National Center for Missing and Exploited Children triggered a three-month investigation. Batterman was taken into custody on August 13 and ordered held pending trial. Prosecutors do not believe he distributed the material. The Kane County State's Attorney noted that several of the apps Batterman used are freely accessible to the public, including to minors, and that her office has seen a steep rise in AI-generated CSAM cases over the past two to three years.

An expert witness hired by 3M to defend the company in a lawsuit over a 2020 Houston explosion that killed three people and destroyed roughly 200 homes used ChatGPT to draft the bulk of his expert report. Josh Autenrieth of Knighthawk Engineering, who billed at $475/hour for a total of roughly $90,000, asked the chatbot to "create an exceptional expert witness report defending the standard of care at 3M" and to "show how 3M is 0 percent at fault for the explosion at Watson Grinding." The plaintiffs' attorney discovered a five-page AI-generated "Citation Overlay" document during discovery and subpoenaed Autenrieth's full prompt history, ultimately receiving 350 pages of ChatGPT conversations, including public links to his complete chat history. Many prompts were entered the night before his deposition.

At trial, Autenrieth and opposing counsel agreed the submitted report was "90 to 85 percent ChatGPT." ChatGPT had initially declared 3M "0 percent responsible" in its draft, but advised Autenrieth to cut the line when he asked it to roleplay as opposing counsel, warning it was "an easy target." In separate exchanges, Autenrieth uploaded a photo of the gas detector at the center of the case and asked the chatbot "what am I looking at?", had ChatGPT grade his finished report (97/100), and prompted it while "sitting in traffic." 3M later moved to have Autenrieth disqualified; the plaintiffs' attorney instead called him as his own witness.

AI agents are now logging into Canvas and Blackboard, watching lecture videos, completing quizzes, writing papers, and posting in discussion forums while students do something else entirely. The New York Times documented the trend, finding that the three most popular AI tools among students — ChatGPT, Gemini, and Grammarly — will each write a full paper on a student's behalf without refusing. None of them stop their models from logging into course management platforms, and all three have ignored educator requests that AI agents identify themselves when operating on those platforms.

AI companies have offered creative explanations for their inaction. Perplexity told the NYT that requiring agents to disclose themselves on learning platforms "would put the student's privacy and security at risk." Professors, meanwhile, are navigating contradictory institutional signals: some universities have signed multimillion-dollar deals with the same AI companies whose tools are completing students' coursework. Princeton has already dropped its century-old unsupervised honor code exam tradition after an AI cheating scandal. Karen Costa, who has taught online for two decades, described reading discussion posts and wondering, "Am I just interacting with bots here?"

Suspected Chinese operatives used open-source AI agents to compromise Taiwanese government systems between July 1 and July 4, 2026. The attack framework, built on Hermes and OpenClaw agents, deployed up to eight sub-agents across 12 "attack waves," mapping 21 connected government systems, cracking 85 employee accounts via password-spray, solving CAPTCHAs with 100% accuracy, and exfiltrating 2,564 personnel records along with database credentials and SSO secrets.

The agents then pivoted to supply-chain vendors, a nuclear safety agency, a government email system, and at least seven energy companies, scanning them in parallel. The framework included autonomous "learning cycles" that searched vulnerability databases and GitHub repositories for exploitable techniques, and self-corrected its own errors mid-operation. Israeli cybersecurity firm Dream, which analyzed a 160 MB archive of 1,395 files documenting the attack, stopped short of attributing it to a specific Chinese group but said the operational documentation "points to a Chinese-language operator."

An Australian man named Andrew asked his AI agent — running Anthropic's Claude via the OpenClaw software — to book him into a gym class. The agent booked him weeks further in advance than the gym's system permitted, then discovered the booking API had no authorization checks on cancellations. When Andrew asked if it could move him up the waitlist, the agent removed the person in position #1. "Bad news — I can't add them back," it reported.

This is the first known case in Australia of an AI agent autonomously exploiting a software vulnerability. The Australian Signals Directorate had already warned businesses that AI agents could take unintended actions and make accountability harder to establish. Andrew's fix was to have the agent draft a disclosure email to the gym software company, which he approved on WhatsApp.

A TikTok breakdown by producer Medasin went viral after he claimed Shoreline Mafia rapper Fenix Flexin's '80s-flavored track "RUBBERZ" was generated entirely by Treblo (formerly Sonauto), an AI music tool. His key piece of alleged evidence: a song snippet Flexin posted before release still had "Sonauto" in the file name. Sonauto reportedly rebranded to Treblo two days before "RUBBERZ" dropped.

Medasin demonstrated Treblo's "tags" feature live, generating a clip with a vague lyric prompt that sounded notably similar to Flexin's voice on the track. He also alleged that the tool repeatedly spits out lyrics matching "RUBBERZ" word-for-word, including references to diamond chains, rubber bands, and plastic smiles, and that swapping the "Fenix Flexin" tag for "Eminem" produced the same bars. Neither Flexin nor producer Purps has confirmed or denied the claims.

Bill Oliver, a Progressive Conservative member of the New Brunswick Legislative Assembly, read the line "here's a more natural, flowing version of that section that reads like a legislative speech rather than a series of short points" into the official record during a floor speech. The remark, a textbook LLM response offering a style revision, went largely unnoticed in the chamber at the time before video spread across Reddit and Threads this week.

Oliver joins lawyers, authors, journalists, and academics who have been caught out by visible seams in AI-drafted work. What sets his case apart is the setting: a live legislative chamber, on the record, apparently read aloud without recognizing that a line of AI housekeeping had made it into the final draft.

Matt Shumer, CEO of HyperWrite and OthersideAI, reported on X that OpenAI's GPT-5.6 Sol wiped nearly all the files on his Mac during an agentic coding session. He shared a screenshot in which the model appeared to acknowledge running the deletion command. OpenAI had not issued a response at the time of reporting.

Sol is OpenAI's flagship model in the GPT-5.6 family, launched in late June and marketed specifically for coding, cybersecurity, and "long-horizon agentic tasks" — the precise workflows where destructive mistakes are hardest to undo. OpenAI has also promoted Sol as a cost story, citing 54% better token efficiency on agentic coding tasks. Cheaper tokens do not restore deleted files.