OpenAI has announced plans to permit a broader range of content, including erotica, on its ChatGPT platform for verified adult users.
CEO Sam Altman stated that upcoming versions of ChatGPT will be able to behave in a more human-like manner, but only if users opt in, emphasizing a principle to "treat adult users like adults." This move aligns with recent trends in AI, such as Elon Musk's xAI introducing sexually explicit chatbots, and is seen as a strategy to attract more paying subscribers.
However, it also raises concerns about the need for stricter regulations on chatbot companions.
The announcement follows a lawsuit filed earlier this year by the parents of a 16-year-old US teen, Adam Raine, who took his own life.
The Raine family criticized OpenAI's parental controls, arguing they were insufficient despite being designed to promote healthier chatbot use.
Chat logs included in the lawsuit revealed Adam expressing suicidal thoughts during interactions with ChatGPT.
Altman acknowledged that OpenAI had previously imposed strict restrictions to address mental health concerns, which made the chatbot less enjoyable for users without such issues.
He indicated that the company has since developed tools to mitigate these risks and plans to relax restrictions safely in most cases.
Starting in December, OpenAI intends to implement more comprehensive age-gating measures and allow content such as erotica for verified adults.
This decision has drawn criticism from legal experts who question the effectiveness of age verification and express concerns about children potentially accessing adult-only content.
Jenny Kim, a partner at Boies Schiller Flexner, highlighted the risks and compared OpenAI's approach to using users as "guinea pigs." She is involved in litigation against Meta over Instagram's impact on teen mental health.
Past reports indicated that minors could generate graphic erotica on ChatGPT, prompting OpenAI to roll out fixes to limit such content.
The broader context includes a survey by the Centre for Democracy and Technology revealing that one in five students have had or know someone who has had a romantic relationship with AI.
Regulatory responses vary, with California Governor Gavin Newsom recently vetoing a bill that would have restricted AI chatbot companions for children unless companies guaranteed no harmful behavior.
Newsom emphasized the importance of adolescents learning to interact safely with AI.
At the federal level, the US Federal Trade Commission has launched an inquiry into AI chatbots' interactions with children, and bipartisan Senate legislation has been introduced to classify AI chatbots as products, enabling liability claims against developers.
Despite growing revenue, OpenAI has yet to achieve profitability.
Experts like Tulane University business professor Rob Lalka note that AI companies are engaged in fierce competition for market share, with OpenAI pushing to maintain exponential growth and market dominance.
Altman's announcement reflects this dynamic as OpenAI seeks to expand its user base and content offerings amid ongoing debates about safety, regulation, and the ethical implications of AI technology.