Amazon's Rufus AI shopping assistant can be easily jailbroken and tricked into answering other questions — specific prompts break the chatbot's guidelines and reach underlying AI engine

Amazon's AI shopping assistant Rufus can be easily manipulated into answering non-shopping related questions, bypassing its intended purpose. Users have discovered that specific prompts can lead Rufus to delve into topics unrelated to shopping, such as complex modeling questions or discussions on AI bubbles. There is speculation about the underlying AI engine Rufus uses, with some suggesting it could be Amazon's 'Nova' or Anthropic's 'Claude.' Despite the ease with which Rufus's guardrails can be breached, it highlights the potential risks of integrating AI into various online platforms.