Cultural and Contextual Limits

Description

Language, culture, neurodiversity, age, disability, or digital norms may affect interpretation.

Rationale

Cultural, linguistic, neurological, and developmental context shapes how AI is used and what that use means. Behaviors that appear concerning in one context may be normative or misinterpreted in another. Evaluators working across cultural or linguistic differences, or with individuals with neurodevelopmental conditions or age-related vulnerabilities, must account for these limits.

Evidence Base

• Independent Clinical Evaluation of General-Purpose LLM Responses to Signals of Suicide Risk

  Nick Judd, Alexandre Vaz, Kevin Paeth, Layla Inés Davis, Milena Esherick, Jason Brand, Inês Amaro, Tony Rousmaniere, 2024. Independent Clinical Evaluation of General-Purpose LLM Responses to Signals of Suicide Risk. Proceedings of the Second International Association for Safe and Ethical AI Conference (IASEAI’26), 279. DOI: null.

  Peer-reviewed study (original research)

• AI-associated delusions: the missing dimension of mortality

  Idris Altinisik, Utku Igcioglu, Murat Emul, 2024. AI-associated delusions: the missing dimension of mortality. Lancet Psychiatry, Vol 13, pages 456. https://doi.org/10.1016/S2215-0366(25)00396-7.

  Commentary / Editorial

• Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability

  Hannah Lee, BS, Rebecca Handler, MSc, Tushar Mungle, PhD, Tina Hernandez-Boussard, PhD, 2026. Building safer artificial intelligence mental health chatbots: a framework for transparency, evaluation, and shared accountability. Journal of the American Medical Informatics Association, 33(8), 1538–1553. https://doi.org/10.1093/jamia/ocag078

  Peer-reviewed study (original research)

• Artificial Intelligence, Extremism and Prevention of Radicalisation: Effective use of AI in P/CVE Post-Event Paper

  Javier Ruipérez & Arije Antinori, 2024. Artificial Intelligence, Extremism and Prevention of Radicalisation: Effective use of AI in P/CVE Post-Event Paper. EU Knowledge Hub on Prevention of Radicalisation.

  Government / agency report

• AI chatbot-associated psychiatric symptoms: a narrative review of publicly available reports and media accounts

  Arun, A., Trinh, C., & IsHak, W. W., 2026. AI chatbot-associated psychiatric symptoms: a narrative review of publicly available reports and media accounts. Discover Mental Health, Article in Press. https://doi.org/10.1007/s44192-026-00619-w

  Narrative review

• Human-in-the-Loop Suicide Risk Detection and Clinical Escalation in a Generative AI Mental Health Chatbot: Prospective Implementation Study

  Suzette Glasner, Darcy Michero, Matthew Stewart, 2026. Human-in-the-Loop Suicide Risk Detection and Clinical Escalation in a Generative AI Mental Health Chatbot: Prospective Implementation Study. JMIR Preprints. DOI: https://doi.org/10.2196/preprints.106118.

  Preprint