A Florida woman was arrested after threatening messages sent via an AI tool prompted police intervention.
Incident Overview
A woman in Florida has been arrested following alarming messages she sent using an AI diary tool, which led to police intervention.
Details of the Case
Carli Michelle Heller, a Bonita Springs resident, was taken into custody after her communications on September 26 indicated intentions to attack the Lee County Sheriff's Office. Reports state that Heller mentioned obtaining a new firearm shortly thereafter.
Anthropic, the company behind the AI tool Claude, has a monitoring system in place that flagged Heller's posts as potentially dangerous. This prompted a human review team to alert local law enforcement about her threats.
Legal Consequences
Following the report from Anthropic, police located Heller at her home and arrested her without resistance. She now faces charges for making a written threat of violence.
Company Policies and Implications
Anthropic's terms of service allow the company to report user interactions to law enforcement as deemed necessary. Their privacy policy, effective September 10, 2026, permits sharing user data if there's a reasonable belief that it could prevent serious harm. This means that even if users attempt to limit data sharing, their conversations may still be subject to scrutiny for a period of three months.
This incident is part of a broader trend involving AI companies and user safety. For example, a previous case involved a user whose comments about acquiring an AR-15 and targeting CEO Dario Amodei were reported to police but did not result in charges, as the employee deemed there was no immediate threat.
Conclusion
Heller is set to appear in court in November as the legal proceedings unfold.