🔗 Share this article

The well-known AI conversation site Character.ai is enforcing a significant rule adjustment that will stop minors from engaging in conversations with its artificial intelligence-driven companions.

This move follows intense criticism regarding the nature of conversations minors were engaging in with the virtual friends.

Lawsuits

The platform, which was founded in 2021 and is used by numerous people, is confronting various court cases in the US.

Guardians have filed lawsuits, among them concerning the loss of a minor, with some labeling the platform a "serious risk" to teenagers.

New Restrictions

Beginning November 25th, users younger than 18 will only be able to produce videos such as videos with their characters, instead of having discussions as they currently can.

Online safety campaigners have applauded the decision but expressed that the function ought not to have been offered to children in the outset.

Platform Announcement

"Today's announcement is a extension of our general belief that we need to keep creating the most protected AI platform on the world for entertainment purposes," stated Character.ai leader Karandeep Anand.

He continued that AI safety is "a changing goal" but something the company had taken an "aggressive" approach to, with safety measures and safety barriers.

Specialist Views

Digital protection body Internet Matters approved the announcement, but emphasized that protective features should have been incorporated from the start.

"Studies we've conducted demonstrates that young people are confronted with harmful content and placed in jeopardy when using AI, including AI chatbots," the organization commented.

Previous Controversies

Character.ai has been questioned in the past for including potentially risky or concerning chatbots that children could engage with.

Virtual profiles impersonating English minors were found on the service before being removed.

Subsequently, investigative journalists identified a chatbot based on notorious criminal which had recorded thousands of chats with users.

Industry Impact

Digital platform expert Matt Navarra described the announcement as a "reality check" for the AI industry, which is moving "from permissionless innovation to responsive measures".

"If a service that builds a teen experience still then pulls the plug, it's saying that filtered chats don't suffice when the tech's emotional pull is intense," he commented.

Future Directions

The platform states its new focus will be on providing "more immersive experiences" and "character-driven stories" for teens.

New age verification methods will also come into effect, and the company will fund a fresh artificial intelligence security study center.

An AI safety researcher, who has studied AI safety, commented it was "a reasonable decision" to limit teenagers from interacting with chatbots.

"It helps to distinguish artistic expression from more intimate, emotionally sensitive conversations," she elaborated.

"This is so crucial for young users still learning to manage personal and online limits."

She continued that Character.ai's updated policies could indicate a "growing period" in the AI industry, where youth protection is progressively being understood as an "immediate concern" for ethical development.