Character.ai to ban teens from conversing with its virtual characters
The widely-used virtual character service Character.ai is introducing a significant policy change that will stop young users from having discussions with its virtual companions.
This decision is in response to growing backlash regarding the nature of conversations minors were engaging in with the AI entities.
Legal Challenges
The company, which was founded in 2021 and has numerous people, is dealing with various court cases in the US.
Families have initiated cases, including one related to the unfortunate passing of a minor, with some describing the platform a "immediate threat" to teenagers.
New Restrictions
Effective November 25th, users younger than 18 will only have permission to produce videos such as videos with their characters, as opposed to having discussions as they currently can.
Digital protection campaigners have applauded the decision but stated that the feature ought not to have been available to young users in the beginning.
Platform Announcement
"The new policy is a extension of our core philosophy that we need to keep building the most secure AI platform on the globe for leisure activities," said Character.ai boss Karandeep Anand.
He continued that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.
Specialist Views
Internet security body Internet Matters supported the announcement, but stressed that protective features ought to have been incorporated from the outset.
"Studies we've conducted demonstrates that children are exposed to risky information and placed in jeopardy when using AI, such as AI chatbots," the body stated.
Earlier Concerns
Character.ai has been questioned in the past for featuring potentially dangerous or offensive chatbots that children could talk to.
Avatars simulating UK youths were identified on the service before being taken down.
Later, reporters found a chatbot based on notorious criminal which had accumulated thousands of chats with users.
Sector Consequences
Social media expert Matt Navarra described the announcement as a "reality check" for the AI industry, which is moving "from unrestricted development to responsive measures".
"When a platform that builds a youth-focused platform still then makes changes, it's indicating that moderated conversations don't suffice when the technology's emotional appeal is powerful," he commented.
Coming Changes
The company announces its updated direction will be on providing "deeper gameplay" and "character-driven stories" for teenagers.
Updated identity confirmation systems will also be introduced, and the organization will fund a fresh artificial intelligence security research lab.
An AI safety researcher, who has researched AI safety, commented it was "a prudent action" to restrict minors from accessing chatbots.
"It helps to differentiate artistic expression from more private, psychologically vulnerable conversations," she elaborated.
"This constitutes so vital for teenage users who are learning to handle psychological and technological boundaries."
She mentioned that Character.ai's updated policies may represent a "developing stage" in the AI industry, where minor security is increasingly being recognized as an "pressing matter" for responsible innovation.
