Artificial Intelligence in Gastroenterology Education: DeepSeek Passes the Gastroenterology Board Examination and Outperforms Legacy ChatGPT Models.
basic_science · Level V
Where this comes from
- Record sourced from PubMed, PMID 40392256.
- Also identified by DOI 10.14309/ajg.0000000000003552.
- No licence information is recorded for this record.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
DeepSeek was evaluated in gastroenterology board examination performance against legacy ChatGPT offline models, which previously showed failing performance. The performances of the DeepSeek base R1 model and search-augmented R1 model were assessed using American College of Gastroenterology self-assessments (455 questions). DeepSeek exceeded the passing threshold. Search-augmented DeepSeek scored 81.5% across all questions, and the R1 base model scored 77.1%. Both search-augmented and offline DeepSeek models surpassed offline ChatGPT-3 (65.1%) and ChatGPT-4 (62.4%) ( P < 0.001). DeepSeek exhibited passing performance on the gastroenterology board examination but had gaps in niche topics and image exclusion limit utility. It may supplement education if validated by specialists.
Medical subject headings
- Gastroenterology
- Educational Measurement
- Artificial Intelligence