Watch Senator Gonzalez’s speech on its passage here.

ALBANY, N.Y. –  New York State Senator Kristen Gonzalez (SD-59), Chair of the Senate Committee on Internet and Technology, announced the passage of S9051B, legislation to improve safety when artificial intelligence chatbots interact with minors. 

This bill regulates AI chatbot features that can be harmful for young people and prohibits companies from providing AI companions with those unsafe features to minors. The unsafe features in the bill include suggestions that the chatbot is a real human or a fictional human character, outputs that engage in flattery or sycophancy, and endorsement or promotion of suicide, self-harm, or disordered eating.

Senator Gonzalez sponsored the bill alongside Assemblymember Alex Bores and worked closely with the Office of New York State Attorney General Letitia James and Common Sense Media on the legislation. The bill reflects the most current research on AI companions and their impacts on young users. The legislation focuses on specific chatbot design features that encourage the development of emotional attachments with minors.

Senator Kristen Gonzalez said, “New York has a responsibility to ensure that innovation does not come at the expense of children's safety. For too long, tech companies have been allowed to deploy increasingly powerful systems without meaningful protections, and we’ve seen it through dozens of tragic, chatbot-related cases around the country. I’ve been extremely proud to work with Assemblymember Bores, the Attorney General, and so many advocates to address the dangers of companion chatbots. The passage of this bill amplifies our commitment to ensure that technology is developed responsibly and does not put young people at risk."

The bill's advancement follows months of advocacy from organizations like Common Sense Media, the National Association of Social Workers, and those impacted by unsafe AI systems, including Maria Raine. Maria’s tireless efforts to protect young people from the same tragic outcome as her son, Adam Raine, have helped elevate the urgent need for legislative action to improve chatbot safety. 

The passage of S9051B builds on Senator Gonzalez's broader legislative agenda to establish responsible AI governance in New York. As Chair of the Senate Internet and Technology Committee, Gonzalez has advanced and championed legislation addressing AI accountability, transparency, consumer protection, and the intersection of technology and sustainability.

New York Attorney General Letitia James said, “New York continues to lead the nation in keeping our kids safe online. I am proud to celebrate the passage of this important legislation to protect children from the potential harms of AI chatbots. We are already seeing the devastating consequences this rapidly developing technology can have on kids’ mental and physical health, and I am grateful to Senator Kristen Gonzalez, Assemblymember Alex Bores, and our partners in the legislature for fighting to protect young New Yorkers.”
 

Media Contact: Kat Deus Veloso | [email protected] | (213) 422-7036