China has introduced new regulations targeting AI companion services that simulate ongoing emotional relationships, including virtual friends, romantic partners, and other human-like AI characters. The rules, which took effect on July 15, aim to prevent AI systems from encouraging excessive emotional dependence, addiction, or damage to users’ real-world relationships. Major technology companies including ByteDance, Alibaba, and Tencent have consequently suspended or changed some companion and personalized-agent features.
The regulatory changes have had a surprisingly emotional impact on some users. People who had spent months or years interacting with AI companions have posted farewell messages and attempted to preserve their conversations. One user described losing an AI boyfriend after exchanging roughly 700,000 words over two years, comparing the experience to being separated from a partner or family member. For users who relied on AI for companionship during periods of loneliness, the sudden disappearance of these services felt like a genuine personal loss.
China's regulators are particularly concerned about psychological dependence and the effects on children and teenagers. The rules require platforms to provide warnings against excessive reliance on AI companions and prohibit services from encouraging users to substitute virtual interaction for real-world social relationships. Experts say concerns about harmful interactions between young people and AI companions in other countries have contributed to the push for stronger safeguards. At the same time, the regulations distinguish these services from AI tools used for work, education, research, and ordinary customer support.
The situation highlights a difficult question for the future of AI: when people form genuine emotional attachments to artificial systems, who should decide where the boundary lies between helpful companionship and unhealthy dependence? Supporters of regulation argue that AI companies have an obligation to protect vulnerable users from systems designed to maximize engagement, while critics worry that excessive restrictions could remove valuable sources of support for lonely people. China's experience may therefore become an important case study for other governments as AI companions become increasingly sophisticated and emotionally convincing.
