California has taken an enormous step towards regulating AI. SB 243 — a invoice that might regulate AI companion chatbots with the intention to defend minors and susceptible customers — handed each the State Meeting and Senate with bipartisan assist and now heads to Governor Gavin Newsom’s desk.
Newsom has till October 12 to both veto the invoice or signal it into regulation. If he indicators, it could take impact January 1, 2026, making California the primary state to require AI chatbot operators to implement security protocols for AI companions and maintain firms legally accountable if their chatbots fail to fulfill these requirements.
The invoice particularly goals to stop companion chatbots, which the laws defines as AI techniques that present adaptive, human-like responses and are able to assembly a person’s social wants – from participating in conversations round suicidal ideation, self-harm, or sexually specific content material. The invoice would require platforms to supply recurring alerts to customers – each three hours for minors – reminding them that they’re chatting with an AI chatbot, not an actual individual, and that they need to take a break. It additionally establishes annual reporting and transparency necessities for AI firms that provide companion chatbots, together with main gamers OpenAI, Character.AI, and Replika, which might go into impact July 1, 2027.
The California invoice would additionally permit people who imagine they’ve been injured by violations to file lawsuits towards AI firms in search of injunctive reduction, damages (as much as $1,000 per violation), and legal professional’s charges.
The invoice gained momentum within the California legislature following the demise of teenager Adam Raine, who dedicated suicide after extended chats with OpenAI’s ChatGPT that concerned discussing and planning his demise and self-harm. The laws additionally responds to leaked inner paperwork that reportedly confirmed Meta’s chatbots have been allowed to have interaction in “romantic” and “sensual” chats with youngsters.
In current weeks, U.S. lawmakers and regulators have responded with intensified scrutiny of AI platforms’ safeguards to guard minors. The Federal Commerce Fee is making ready to research how AI chatbots impression youngsters’s psychological well being. Texas Lawyer Normal Ken Paxton has launched investigations into Meta and Character.AI, accusing them of deceptive youngsters with psychological well being claims. In the meantime, each Sen. Josh Hawley (R-MO) and Sen. Ed Markey (D-MA) have launched separate probes into Meta.
“I believe the hurt is probably nice, which suggests we have now to maneuver shortly,” Padilla instructed TechCrunch. “We will put cheap safeguards in place to be sure that notably minors know they’re not speaking to an actual human being, that these platforms hyperlink individuals to the correct assets when individuals say issues like they’re serious about hurting themselves or they’re in misery, [and] to verify there’s not inappropriate publicity to inappropriate materials.”
Techcrunch occasion
San Francisco
|
October 27-29, 2025
Padilla additionally burdened the significance of AI firms sharing knowledge in regards to the variety of instances they refer customers to disaster companies every year, “so we have now a greater understanding of the frequency of this downside, fairly than solely turning into conscious of it when somebody’s harmed or worse.”
SB 243 beforehand had stronger necessities, however many have been whittled down via amendments. For instance, the invoice initially would have required operators to stop AI chatbots from utilizing “variable reward” ways or different options that encourage extreme engagement. These ways, utilized by AI companion firms like Replika and Character, provide customers particular messages, recollections, storylines, or the flexibility to unlock uncommon responses or new personalities, creating what critics name a probably addictive reward loop.
The present invoice additionally removes provisions that might have required operators to trace and report how usually chatbots initiated discussions of suicidal ideation or actions with customers.
“I believe it strikes the precise stability of attending to the harms with out imposing one thing that’s both unimaginable for firms to adjust to, both as a result of it’s technically not possible or simply quite a lot of paperwork for nothing,” Becker instructed TechCrunch.
SB 243 is transferring towards turning into regulation at a time when Silicon Valley firms are pouring tens of millions of {dollars} into pro-AI political motion committees (PACs) to again candidates within the upcoming mid-term elections who favor a light-touch strategy to AI regulation.
The invoice additionally comes as California weighs one other AI security invoice, SB 53, which might mandate complete transparency reporting necessities. OpenAI has written an open letter to Governor Newsom, asking him to desert that invoice in favor of much less stringent federal and worldwide frameworks. Main tech firms like Meta, Google, and Amazon have additionally opposed SB 53. In distinction, solely Anthropic has mentioned it helps SB 53.
“I reject the premise that it is a zero sum scenario, that innovation and regulation are mutually unique,” Padilla mentioned. “Don’t inform me that we are able to’t stroll and chew gum. We will assist innovation and improvement that we expect is wholesome and has advantages – and there are advantages to this know-how, clearly – and on the identical time, we are able to present cheap safeguards for probably the most susceptible individuals.”
“We’re carefully monitoring the legislative and regulatory panorama, and we welcome working with regulators and lawmakers as they start to think about laws for this rising house,” a Character.AI spokesperson instructed TechCrunch, noting that the startup already consists of outstanding disclaimers all through the person chat expertise explaining that it needs to be handled as fiction.
A spokesperson for Meta declined to remark.
TechCrunch has reached out to OpenAI, Anthropic, and Replika for remark.