Chatbots and companion AI need to be regulated to avoid harm to vulnerable users, like kids and the mentally impaired.
The anthropomorphic and sycophantic design of chatbots creates a lethal cocktail when mixed with the unchecked use of the vulnerable.
The tragic cases of Sewell and Adam resulting in suicides after interacting with these trending tech calls for urgent and decisive action by policymakers and AI actors.
https://centerforhumanetechnology.substack.com/p/reckless-race-for-ai-market-share