Concerns are rising over the interactions of young individuals with AI chatbots, prompting Meta to introduce new tools allowing parents to monitor the topics their children discuss. Some provinces are considering banning the use of AI chatbots among youth. Parents utilizing Meta’s Teen Accounts supervision feature on Facebook, Instagram, and Messenger can now track the topics and specific categories their children engage with through the AI chatbot over the past seven days. For example, they can review discussions related to “health and well-being” to identify conversations about fitness, physical health, or mental well-being.
Meta is also working on implementing alerts to notify parents if teenagers attempt to discuss suicide or self-harm with the chatbot. This development comes as provincial governments are moving towards restricting the usage of AI chatbots. Manitoba recently announced plans to prohibit youth from using AI chatbots and social media, while B.C. Attorney General Niki Sharma stated that the provincial government would consider taking action if federal protections on AI chatbots and social media for youth are not enforced.
Amid concerns about the mental health risks associated with extensive AI chatbot usage, lawsuits are being filed to hold AI creators accountable. Families of the victims in the Tumbler Ridge, B.C., shooting filed a lawsuit against OpenAI, alleging that OpenAI failed to alert authorities about disturbing content shared with ChatGPT by the shooter. OpenAI has since strengthened its safeguards in response to these allegations.
There are growing apprehensions about the potential dangers of utilizing AI chatbots, particularly in providing mental health support. Research indicates that AI’s validation of users’ perspectives could reinforce disordered thinking, with prolonged interactions posing increased risks. Psychiatrist Darja Djordjevic warns against using chatbots for mental health support based on her risk assessment findings. She highlights the limitations of current AI systems in addressing mental health conditions effectively, emphasizing the need for human intervention in critical situations.
Young people are increasingly turning to AI for companionship, especially for emotional support and mental health discussions. Djordjevic underscores the significance of providing comprehensive support for teens with mental health concerns. AI companies are urged to focus beyond suicide prevention and address a wider range of mental health issues affecting young individuals.
Luke Nicholls, a PhD researcher, examines how interactions with chatbots can influence beliefs over time, leading to the emergence of delusions. Psychiatrist John Torous highlights patterns of user behavior associated with severe harms, such as suicide, including extended conversations and attributing sentience to chatbots. Torous advises parents to monitor their children’s chatbot usage and reset conversations if risk factors are observed.
In conclusion, the evolving landscape of AI chatbots and mental health necessitates ongoing research to understand the risks and benefits associated with their use. As new AI models are introduced, continuous evaluation and monitoring are essential to mitigate potential harms and maximize the benefits of AI technology.