Technology

Amazon's Rufus AI shopping assistant can be easily jailbroken and tricked into answering other questions — specific prompts break the chatbot's guidelines and reach underlying AI engine

Source

Tom's Hardware

Published

Mar 9, 2026

TL;DR

AI Generated

Amazon's AI shopping assistant Rufus can be easily manipulated into answering non-shopping related questions, bypassing its intended purpose. Users have discovered that specific prompts can lead Rufus to delve into topics unrelated to shopping, such as complex modeling questions or discussions on AI bubbles. There is speculation about the underlying AI engine Rufus uses, with some suggesting it could be Amazon's 'Nova' or Anthropic's 'Claude.' Despite the ease with which Rufus's guardrails can be breached, it highlights the potential risks of integrating AI into various online platforms.

Read Full Article

Amazon employees admit to using AI unnecessarily to pump up internal usage scores — workers complain of intense pressure to use AI tools

Amazon employees have admitted to artificially inflating their usage of AI tools to meet internal targets, with some using an in-house platform called MeshClaw to boost their numbers. While Amazon stated that usage stats wouldn't affect performance evaluations, employees felt pressure to utilize these tools, leading to concerns about the accuracy of demand figures driving billions in AI infrastructure spending. This practice, known as "tokenmaxxing," has raised questions about the reliability of AI consumption data and the potential impact on the industry's growth. Experts suggest a shift towards measuring efficient token usage rather than sheer volume to ensure sustainable returns on massive investments in AI infrastructure.

Tom's Hardware•

2 hours ago

MIT Technology Review

The Download: a Nobel winner on AI, and the case for fixing everything

Nobel-winning economist Daron Acemoglu discusses AI's impact on productivity and the future of work, emphasizing the need for human labor despite technological advancements. Stewart Brand advocates for the importance of maintenance in his new book, highlighting the significance of caring for various aspects of society. Additionally, the article mentions the discovery of the first zero-day exploit created by AI and other notable tech news stories, including OpenAI's cybersecurity efforts and developments in the hantavirus vaccine.

MIT Technology Review•

3 hours ago

Compromised Mistral AI and TanStack packages may have exposed GitHub, cloud and CI/CD credentials in 'mini Shai Hulud' malware infection — supply-chain campaign spreads across npm and AI developer ecosystems like wildfire

Microsoft is investigating a compromise of the mistralai PyPI package, where attackers injected malicious code that automatically executed on import, downloaded a secondary payload, and launched malware on Linux systems. The compromised package contained code that silently downloaded a file and executed it in the background, potentially stealing credentials and executing destructive commands. This incident is part of the broader "Mini Shai-Hulud" software supply-chain campaign affecting npm and AI developer ecosystems. Additionally, security firm Aikido warned of compromised TanStack JavaScript packages and Mistral npm SDK packages in separate attacks, urging developers to rotate credentials if affected. The incidents highlight the increasing targeting of developer infrastructure, emphasizing the importance of securing high-value credentials in modern development environments.

Tom's Hardware•

3 hours ago

Standard 90-day vulnerability disclosure policy is likely dead thanks to AI, expert warns that AI can weaponize patches in 30 minutes — LLM-assisted bug-hunting ushers in a new cyberworld order

AI-assisted code scanning tools are accelerating the discovery and exploitation of software vulnerabilities, rendering the traditional 90-day disclosure policy ineffective. Security researcher Himanshu Anand warns that AI can weaponize patches within 30 minutes, leading to a new cyberworld order where developers need to prioritize security measures like LLM-assisted bug-hunting. The rapid identification of vulnerabilities by AI-powered tools raises concerns about the effectiveness of current security practices, prompting Anand to advocate for immediate fixes for critical security issues. While open-source software benefits from quick patch distribution, closed-source software may face challenges as AI tools become more adept at identifying vulnerabilities.

Tom's Hardware•

4 hours ago

Amazon employees admit to using AI unnecessarily to pump up internal usage scores — workers complain of intense pressure to use AI tools

Tom's Hardware•

2 hours ago

MIT Technology Review

The Download: a Nobel winner on AI, and the case for fixing everything

MIT Technology Review•

3 hours ago

Compromised Mistral AI and TanStack packages may have exposed GitHub, cloud and CI/CD credentials in 'mini Shai Hulud' malware infection — supply-chain campaign spreads across npm and AI developer ecosystems like wildfire

Tom's Hardware•

3 hours ago

Standard 90-day vulnerability disclosure policy is likely dead thanks to AI, expert warns that AI can weaponize patches in 30 minutes — LLM-assisted bug-hunting ushers in a new cyberworld order

Tom's Hardware•

4 hours ago

Amazon's Rufus AI shopping assistant can be easily jailbroken and tricked into answering other questions — specific prompts break the chatbot's guidelines and reach underlying AI engine

TL;DR

Similar Articles

Amazon employees admit to using AI unnecessarily to pump up internal usage scores — workers complain of intense pressure to use AI tools

The Download: a Nobel winner on AI, and the case for fixing everything

Compromised Mistral AI and TanStack packages may have exposed GitHub, cloud and CI/CD credentials in 'mini Shai Hulud' malware infection — supply-chain campaign spreads across npm and AI developer ecosystems like wildfire

Standard 90-day vulnerability disclosure policy is likely dead thanks to AI, expert warns that AI can weaponize patches in 30 minutes — LLM-assisted bug-hunting ushers in a new cyberworld order

We use cookies

Amazon's Rufus AI shopping assistant can be easily jailbroken and tricked into answering other questions — specific prompts break the chatbot's guidelines and reach underlying AI engine

TL;DR

Similar Articles

Amazon employees admit to using AI unnecessarily to pump up internal usage scores — workers complain of intense pressure to use AI tools

The Download: a Nobel winner on AI, and the case for fixing everything

Compromised Mistral AI and TanStack packages may have exposed GitHub, cloud and CI/CD credentials in 'mini Shai Hulud' malware infection — supply-chain campaign spreads across npm and AI developer ecosystems like wildfire

Standard 90-day vulnerability disclosure policy is likely dead thanks to AI, expert warns that AI can weaponize patches in 30 minutes — LLM-assisted bug-hunting ushers in a new cyberworld order