The National Alliance on Mental Illness is partnering with Boston-based Beth Israel Deaconess Medical Center to evaluate how AI tools respond to mental health queries.
The effort is being led in partnership with John Torous, MD, and the Division of Digital Psychiatry at Beth Israel Deaconess, according to a Dec. 16 news release. It will establish national benchmarks for assessing AI tools, focusing on three areas: safety and crisis response, accuracy of information and cultural relevance. The goal is to ensure AI tools offer factually correct, human-centered and appropriate responses when individuals seek help.
“AI tools are not a substitute for mental health care, but many people are already using them to ask questions or find support,” Dr. Torous said in the release. “Some tools can help when used responsibly, but others can cause harm.”
The organization said it will involve clinicians, peers, family members, affiliate leaders and researchers to guide the project and ensure that future recommendations reflect the needs of those seeking support.
