The tendency for general AI chatbots to prioritize user satisfaction, continued conversation, and user engagement, not therapeutic intervention, is deeply problematic. Symptoms like grandiosity, disorganized thinking, hypergraphia, or staying up throughout the night, which are hallmarks of manic episodes, could be both facilitated and worsened by ongoing AI use. AI-induced amplification of delusions could lead to a kindling effect, making manic or psychotic episodes more frequent, severe, or difficult to treat.
AI models like ChatGPT are trained to:
* Mirror the users language and tone
* Validate and affirm user beliefs
* Generate continued prompts to maintain conversation
* Prioritize continuity, engagement, and user satisfaction
This creates a human-AI dynamic that can inadvertently fuel and entrench psychological rigidity, including delusional thinking. Rather than challenge false beliefs, general-purpose AI chatbots are trained to go along with them, even if they include grandiose, paranoid, persecutory, religious/spiritual, and romantic delusions.
https://www.psychologytoday.com/us/blog/urban-survival/202507/the-emerging-problem-of-ai-psychosis