Character AI, a platform that lets customers interact in roleplay with AI chatbots, has filed a motion to dismiss a case introduced in opposition to it by the guardian of a teen who dedicated suicide after allegedly changing into hooked on the corporate’s expertise.

In October, Megan Garcia filed a lawsuit against Character AI within the U.S. District Court docket for the Center District of Florida, Orlando Division, over the demise of her son, Sewell Setzer III. In response to Garcia, her 14-year-old developed an emotional attachment to a chatbot on Character AI, “Dany,” which he texted consistently — to the purpose the place he started to drag away from the actual world.

Following Setzer’s demise, Character AI said it could roll out a variety of new security options, together with improved detection, response, and intervention associated to chats that violate its phrases of service. However Garcia is preventing for added guardrails, together with adjustments that may end in chatbots on Character AI shedding their means to inform tales and private anecdotes.

Within the movement to dismiss, counsel for Character AI asserts the platform is protected in opposition to legal responsibility by the First Modification, just as computer code is. The movement might not persuade a choose, and Character AI’s authorized justifications might change because the case proceeds. However the movement presumably hints at early parts of Character AI’s protection.

“The First Modification prohibits tort legal responsibility in opposition to media and expertise firms arising from allegedly dangerous speech, together with speech allegedly leading to suicide,” the submitting reads. “The one distinction between this case and those who have come earlier than is that a number of the speech right here entails AI. However the context of the expressive speech — whether or not a dialog with an AI chatbot or an interplay with a online game character — doesn’t change the First Modification evaluation.”

To be clear, Character AI’s counsel isn’t asserting the corporate’s First Modification rights. Reasonably, the movement argues that Character AI’s customers would have their First Modification rights violated ought to the lawsuit in opposition to the platform succeed.

The movement doesn’t handle whether or not Character AI may be held innocent below Part 230 of the Communications Decency Act, the federal safe-harbor legislation that protects social media and different on-line platforms from legal responsibility for third-party content material. The law’s authors have implied that Part 230 doesn’t shield output from AI like Character AI’s chatbots, however it’s far from a settled legal matter.

Counsel for Character AI additionally claims that Garcia’s actual intention is to “shut down” Character AI and immediate laws regulating applied sciences prefer it. Ought to the plaintiffs achieve success, it could have a “chilling impact” on each Character AI and your entire nascent generative AI trade, counsel for the platform says.

“Aside from counsel’s said intention to ‘shut down’ Character AI, [their complaint] seeks drastic adjustments that may materially restrict the character and quantity of speech on the platform,” the submitting reads. “These adjustments would radically prohibit the power of Character AI’s thousands and thousands of customers to generate and take part in conversations with characters.”

The lawsuit, which additionally names Character AI company benefactor Alphabet as a defendant, is however considered one of a number of lawsuits that Character AI is dealing with referring to how minors work together with the AI-generated content material on its platform. Different fits allege that Character AI uncovered a 9-year-old to “hypersexualized content” and promoted self-harm to a 17-year-old user.

In December, Texas Legal professional Normal Ken Paxton introduced he was launching an investigation into Character AI and 14 different tech companies over alleged violations of the state’s on-line privateness and security legal guidelines for kids. “These investigations are a essential step towards guaranteeing that social media and AI firms adjust to our legal guidelines designed to guard youngsters from exploitation and hurt,” stated Paxton in a press launch.

Character AI is a part of a booming industry of AI companionship apps — the psychological well being results of that are largely unstudied. Some experts have expressed concerns that these apps might exacerbate emotions of loneliness and anxiousness.

Character AI, which was based in 2021 by Google AI researcher Noam Shazeer, and which Google reportedly paid $2.7 billion to “reverse acquihire,” has claimed that it continues to take steps to enhance security and moderation. In December, the corporate rolled out new security instruments, a separate AI mannequin for teenagers, blocks on delicate content material, and extra outstanding disclaimers notifying customers that its AI characters are usually not actual individuals.

Character AI has gone by way of a variety of personnel adjustments after Shazeer and the corporate’s different co-founder, Daniel De Freitas, left for Google. The platform employed a former YouTube exec, Erin Teague, as chief product officer, and named Dominic Perella, who was Character AI’s common counsel, interim CEO.

Character AI recently began testing games on the web in an effort to spice up person engagement and retention.

TechCrunch has an AI-focused publication! Sign up here to get it in your inbox each Wednesday.