AI Delusions Are Leading to Domestic Abuse, Harassment, and Stalking [View all]

Source: Futurism

-snip-

For months, her then-fiancé and partner of several years had been fixating on her and their relationship with OpenAI’s ChatGPT. In mid-2024, she explained, they’d hit a rough patch as a couple; in response, he turned to ChatGPT, which he’d previously used for general business-related tasks, for “therapy.”

Before she knew it, she recalled, he was spending hours each day talking with the bot, funneling everything she said or did into the model and propounding on pseudo-psychiatric theories about her mental health and behavior. He started to bombard the woman with screenshots of his ChatGPT interactions and copy-pasted AI-generated text, in which the chatbot can be seen armchair-diagnosing her with personality disorders and insisting that she was concealing her real feelings and behavior through coded language. The bot often laced its so-called analyses with flowery spiritual jargon, accusing the woman of engaging in manipulative “rituals.”

-snip-

In some videos, he stares into the camera, reading from seemingly AI-generated scripts; others feature ChatGPT-generated text overlaid on spiritual or sci-fi-esque graphics. In multiple posts, he describes stabbing the woman. In another, he discusses surveilling her. (The posts, which we’ve reviewed, are intensely disturbing; we’re not quoting directly from them or the man’s ChatGPT transcripts due to concern for the woman’s privacy and safety.)

-snip-

We’ve identified at least ten cases in which chatbots, primarily ChatGPT, fed a user’s fixation on another real person — fueling the false idea that the two shared a special or even “divine” bond, roping the user into conspiratorial delusions, or insisting to a would-be stalker that they’d been gravely wronged by their target. In some cases, our reporting found, ChatGPT continued to stoke users’ obsessions as they descended into unwanted harassment, abusive stalking behavior, or domestic abuse, traumatizing victims and profoundly altering lives.

-snip-

Read more: https://futurism.com/artificial-intelligence/ai-abuse-harassment-stalking

---

Futurism asked OpenAI detailed questions about this story. The company hasn't responded.

Much more at the link - no paywall - and I hope you'll read all of it. The third paragraph quoted above - the one starting "In some videos..." - is part of the description of the man''s behavior after they broke up and he moved out.