Preventing unrestricted and unmonitored AI experimentation in healthcare through transparency and accountability.
expert_opinion · Level V
Where this comes from
- Record sourced from PubMed, PMID 39827300.
- Also identified by DOI 10.1038/s41746-025-01443-2 and PMC identifier 11743128.
- Licence recorded as CC BY-NC-ND.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
The integration of large language models (LLMs) into electronic health records offers potential benefits but raises significant ethical, legal, and operational concerns, including unconsented data use, lack of governance, and AI-related malpractice accountability. Sycophancy, feedback loop bias, and data reuse risk amplifying errors without proper oversight. To safeguard patients, especially the vulnerable, clinicians must advocate for patient-centered education, ethical practices, and robust oversight to prevent harm.