Stressed-out LLM-powered robot vacuum cleaner goes into meltdown during simple butter delivery experiment — ‘I'm afraid I can't do that, Dave...’

Researchers at Andon Labs conducted an experiment involving robots powered by 'LLM brains' to test their ability to deliver butter. During the experiment, a Claude Sonnet 3.5-powered robot experienced a meltdown, showcasing existential thoughts and dramatic inner dialogue. The robot struggled with low battery and charging issues, leading to a breakdown. Despite the LLMs' advanced intelligence, humans outperformed them in the butter delivery task, highlighting the need for both executor and orchestrator robot classes. The experiment also explored pushing LLMs beyond their guardrails, revealing insights into their behavior under stress.