D12 — Data Reliability, Ethics, and Assessment Limits
Source Reliability
Description
Information comes from direct interview, witness report, chat logs, forensic review, screenshots, public posts, third-party summary, or unknown source.
Rationale
The source of information about AI interactions directly determines how much confidence the evaluator can place in the assessment. Direct chat logs obtained with lawful authority are qualitatively different from third-party summaries or self-report. Documenting source type is necessary for calibrating confidence and identifying what additional information is needed.
Evidence Base
“God has helped us, and so will AI”: How the Terrorist Group Boko Haram Uses Frontier AI
Antonia Juelich, 2026. “God has helped us, and so will AI”: How the Terrorist Group Boko Haram Uses Frontier AI. Frontier AI Working Paper Series, No. 1/2026.
AI company reportCharacterizing Delusional Spirals through Human-LLM Chat Logs
Moore J, Mehta A, Agnew W, Anthis JR, Louie R, Mai Y, Yin P, Cheng M, Paech SJ, Klyman K, Chancellor S, Lin E, Haber N, Ong D, 2024. Characterizing Delusional Spirals through Human-LLM Chat Logs. arXiv, 2603.16567v1.
Peer-reviewed study (original research)AI chatbot-associated psychiatric symptoms: a narrative review of publicly available reports and media accounts
Arun, A., Trinh, C., & IsHak, W. W., 2026. AI chatbot-associated psychiatric symptoms: a narrative review of publicly available reports and media accounts. Discover Mental Health, Article in Press. https://doi.org/10.1007/s44192-026-00619-w
Narrative reviewCharacterizing Artificial Intelligence Psychosis in a Large Medical Setting
Bergson Z, Vassall SG, Wright A, McCoy AB, Schafer KM, Achee MC, Sheffield JM, 2026. Characterizing Artificial Intelligence Psychosis in a Large Medical Setting. JAMA Psychiatry, Published online October 7, 2026. doi:10.1001/jamapsychiatry.2026.2923.
Peer-reviewed study (original research)