If a therapy bot walks like a duck and talks like a duck then it is a medically regulated duck.

Ostermann, Max; Freyer, Oscar; Verhees, F Gerrik; Kather, Jakob Nikolas; Gilbert, Stephen · NPJ Digit Med · 2025

expert_opinion · Level V

Where this comes from

Abstract

Large language models (LLMs) are increasingly used for mental health interactions, often mimicking therapeutic behaviour without regulatory oversight. Documented harms, including suicides, highlight the urgent need for stronger safeguards. This manuscript argues that LLMs providing therapy-like functions should be regulated as medical devices, with standards ensuring safety, transparency and accountability. Pragmatic regulation is essential to protect vulnerable users and maintain the credibility of digital health interventions.