Across hundreds of schools in the United States and potentially other countries, administrators are experimenting with artificial intelligence (AI)-powered counselling tools to monitor and support student mental health. These systems typically take the form of AI chatbots or automated assistants that interact with students via text or digital interfaces to collect information about emotional states, stress levels and well-being trends. Supporters say that some students — especially teenagers — may find it easier or more natural to open up to a non-judgmental AI than a human counsellor.
Proponents argue that these tools can help schools identify at-risk students earlier than traditional referral systems might allow, offering real-time responses and flagging patterns that suggest anxiety, depression or other concerns. Because many schools are under-resourced and can’t provide one-on-one support to every student, AI systems could theoretically supplement overworked school counsellors and alert human staff when a student’s responses indicate potential distress.
However, the rapid deployment of AI counsellors also raises serious questions about safety, privacy, accuracy and ethical oversight. Critics worry that automated systems may misinterpret nuanced human emotions or fail to handle sensitive disclosures appropriately — potentially giving students misleading or harmful guidance. There are also concerns about how the data collected will be stored, who can access it, and whether students fully understand that their responses could be monitored by algorithms.
Many educators and mental-health professionals emphasise that AI should augment, not replace, human support. While chatbots can play a role in early engagement or follow-up, the human dimension — empathy, judgement and the ability to respond to crises — remains crucial in school counselling. Ensuring clear policies, robust safeguards and strong human oversight will be key if these AI systems are to be used ethically and safely in educational settings.
