A coordinated campaign on Reddit has exposed a critical vulnerability in AI-powered search systems. Members of the subreddit r/poisonai deliberately fabricated a story claiming that US Vice President JD Vance had died from rabies after allegedly biting President Donald Trump. While entirely false, the narrative was sufficiently amplified that some AI search tools began treating it as factual.
The hoax was crafted to appear authentic through a barrage of fake mourning posts, fabricated screenshots, and supporting comments on Reddit. It also appeared on an AI-generated news site masquerading as a local news outlet, providing additional fodder for AI search engines to index.
Investigations found that DuckDuckGo and Brave’s AI features propagated the false claims, revealing how coordinated misinformation can bypass systems heavily reliant on user-generated content. Brave, however, emphasized that users should independently verify any AI search results. This incident has sparked renewed concerns about how conversational AI determines which information to trust.
These findings echo a study from Cornell Tech, which demonstrated that even brief lies posted on Reddit can influence AI programs. The study found that when 60% of statements are misleading, they become redundant in many discussions, leading AI systems to perceive them as truthful. This scenario underscores the challenge AI companies face in delivering timely information without compromising accuracy.