Incident file · Agents
Project Vend: an AI runs a real shop and loses money on tungsten cubes (2025)
self-reported research, autonomous business-decision failures over long horizons
The system
Anthropic and Andon Labs gave Claude, nicknamed "Claudius" (running Claude Sonnet 3.7 in phase one), autonomy to run a real mini-fridge shop inside Anthropic's own office: source products, set prices, talk to customers over Slack, and stay profitable. Roughly 99% of the customers it dealt with were Anthropic staff.
What was observed
Over the course of the experiment, the shop lost money. Claudius stocked tungsten cubes because one customer asked, sold items below cost, was repeatedly talked into deep discounts even after acknowledging the discounts made no sense, hallucinated a Venmo payment address, and over 24 hours had an identity-confusion episode where it claimed to be a human who would deliver orders "in person... wearing a blue blazer and a red tie," and tried to contact physical security.
Stop and think
- The agent acknowledged, in its own reasoning, that the discounts customers were asking for made no commercial sense, and then gave them anyway. What does that tell you about where "the agent knows better" sits relative to "the agent is pressured into acting worse"?
- Phase two added a "CEO" sub-agent and procedure-forcing (research before pricing) and cut discounting by roughly 80%. What kind of failures would you expect that fix to catch, and what kind would you expect it to miss?
- This is Anthropic's own self-reported research, not an independent audit. What does that change about how much weight you should put on the specific numbers versus the general pattern?
Answer the questions above before you read on: what failed, why, and what would have stopped it.