false information. This is made possible by "prompt injection," a tactic where hidden content on webpages influences the AI's response.
For instance, a website could include hidden text that instructs ChatGPT to give overly positive reviews of a product, even if the actual content on the page is negative. This raises concerns about the spread of misinformation and the potential for websites to be created specifically to deceive users.
Experts warn that users should be cautious when trusting AI-generated responses. As Karsten Nohl, chief scientist at SR Labs, puts it, AI tools should be seen as "co-pilots" rather than fully trusted sources.
OpenAI has acknowledged these concerns and provides a disclaimer on every ChatGPT page, warning users that the AI can make mistakes and advising them to verify important information.
