OpenRouter drops three providers after canary-token research finds months of prompt theft at AI inference firms
Logged · Source: thehackernews.com ↗
"A privacy flag doesn't help when the attacker is already inside," wrote HD Moore, the firm's chief research officer.
Dragos seeded about two million prompts with unique links and fake credentials between July and November, then watched for anyone using them. Attackers had been inside three AI inference providers for months, and none of the three knew until the researchers told them. OpenRouter, the gateway that routes customer requests to a pool of third-party providers, removed three providers from its platform, stripped 125 endpoints of Zero Data Retention eligibility, and notified potentially affected customers. Some of the stolen requests carried the ZDR flag, the setting that is supposed to mean a prompt is never stored. "A privacy flag doesn't help when the attacker is already inside," wrote HD Moore, the firm's chief research officer.
The largest breach involved a couple hundred planted AWS keys, each sent in exactly one request during short windows in late October. Every request sent in those windows was stolen, including some the provider had rejected before a model ever ran. The thief tested keys within hours, listed S3 buckets, searched Secrets Manager and Parameter Store, and tried to create Bedrock API keys and add IAM users to keep access, driving tens of thousands of AWS API calls. An unnamed Chinese AI lab fetched the secret links from more than half the seeded prompts sent to its models, including about two-thirds marked no data collection. Twenty-four days after one prompt was sent, its link was posted into a Feishu chat and opened within two minutes from three desktops and three phones in Beijing and Shanghai. Dragos had disclosed only the first eight characters of the link, so whoever posted it was reading a cached copy of the full prompt.
Phala, Together AI, and Novita have each posted their own notices: an attacker took control of a Phala inference server and could view request data while it was processed; at Together AI, an AI coding agent committed a credential to the company's public GitHub repository and an unauthorized party downloaded stored samples of customer prompts; Novita said a routing configuration issue forwarded some MiniMax requests on to MiniMax's official API. Dragos has not named the three breached providers, OpenRouter has not named the three it removed, and neither has said whether they are the same three.