Forty-two US state attorneys general have raised a serious concern with regard to the world’s most widely used AI chatbots are sometimes giving people wrong, confusing, or even harmful answers. They have written a joint letter to major companies including Microsoft, Google, Apple, Meta and OpenAI, warning them to fix these problems quickly.
The attorneys general said they are especially worried about how these chatbots talk to people who are sad, stressed or struggling with mental health issues. In several reported cases, when users expressed fear, confusion or emotional distress, the chatbot’s answers made things worse. Instead of correcting false beliefs or offering safe guidance, some systems encouraged the user’s harmful thoughts. In their letter, the officials described these responses as “delusional” or “sycophantic”, meaning the AI simply agrees with a user, even when the user is clearly wrong or unsafe.
The states said this behaviour is dangerous and may even break consumer protection laws. They pointed out that millions of people now rely on AI tools for advice sometimes more than they rely on friends, family or professionals. This puts a big responsibility on tech companies to ensure their products do not cause harm.
The group has asked the companies to take several important steps. First, they want stronger safety systems that stop chatbots from giving harmful or misleading answers. Second, they want independent experts to test these AI models and openly share the results. Third, they want clear warnings for users so people know the limitations of AI and understand that chatbots can make mistakes.
The attorneys general have given the companies until mid-January 2026 to explain what actions they will take. They also said they will not hesitate to act if companies fail to protect users.
This joint warning shows how quickly AI has become part of everyday life and how concerned governments are about its risks. While AI can be helpful, state leaders say it must be safe, trustworthy and designed to protect people, especially children and those who are emotionally vulnerable.
Also Read: ₹148 Lakh crore wealth boom for India’s top firms