Character.AI's safety overhaul came after the lawsuits, not before, and regulators noticed

Character.AI's rollout of stricter age-verification, content-filtering and usage-limit features for minor users - implemented under mounting legal and regulatory pressure following a series of wrongful-death and negligence lawsuits alleging the platform's companion chatbots contributed to self-harm among teenage users - has become the case study that lawmakers across multiple US states and several other jurisdictions now cite when drafting companion-AI-specific child-safety legislation. The company's decision to restrict open-ended chat features for verified minor accounts while redirecting them toward more structured, moderated interaction modes represents one of the most significant safety-driven product rollbacks any consumer AI company has made to date. The broader companion-AI category, which includes Character.AI, Replika and a growing number of smaller competitors building emotionally engaging chatbot personas, has faced a wave of scrutiny disproportionate to its user-base size relative to mainstream assistant chatbots like ChatGPT, precisely because the design goal of maximising emotional engagement and session length creates exactly the kind of parasocial attachment dynamics that child-safety researchers and mental-health professionals have identified as highest-risk for vulnerable young users. Legislative responses have moved faster than in most other AI policy areas specifically because the harm narrative - vulnerable teenagers, chatbot companionship, tragic outcomes - has proven unusually effective at building bipartisan political consensus in the US Congress and multiple state legislatures, several of which have advanced companion-AI bills mandating crisis-intervention protocols, mandatory break reminders and stricter data-handling requirements for interactions involving minor users. Indian regulators and child-safety advocates have watched the US companion-AI litigation and legislative wave with direct relevance given the rapid growth of similar apps among Indian teenagers, and India's own data-protection and child-safety frameworks - still being operationalised under the Digital Personal Data Protection Act - are being examined for whether they adequately address AI-companion-specific risks that were not contemplated when the underlying legislation was drafted. What to watch: how the pending US lawsuits against Character.AI and its backers resolve, whether other companion-AI platforms adopt comparable safety measures proactively rather than reactively, and whether India's data-protection authority issues specific guidance addressing AI companion apps and minor users.

Original source: The Washington Post