An automated electronic system for managing radiation treatment plan peer review reduces missed reviews at a large, high-volume academic center.

Abstract

Assuring quality in cancer care through peer review has become increasingly important in radiation oncology. In 2012, our department implemented an automated electronic system for managing radiation treatment plan peer review. The purpose of this study was to compare the overall impact of this electronic system to our previous manual, paper-based system. In an effort to improve management, an automated electronic system for case finding and documentation of review was developed and implemented. The rates of missed initial reviews, late reviews, and missed re-reviews were compared for the pre- versus postelectronic system cohorts using Pearson χ² test and relative risk. Major and minor changes or recommendations were documented and shared with the assigned clinical provider. The overall rate of missed reviews was 7.6% (38/500) before system implementation versus 0.4% (28/6985) under the electronic system (P < .001). In terms of relative risk, courses were 19.0 times (95% confidence interval, 11.8-30.7) more likely to be missed for initial review before the automated system. Missed re-reviews occurred in 23.1% (3/13) of courses in the preelectronic system cohort and 6.6% (10/152) of courses in the postelectronic system cohort (P = .034). Late reviews were more frequent during high travel or major holiday periods. Major changes were recommended in 2.2% and 2.8% in the pre- versus postelectronic systems, respectively. Minor changes were recommended in 5.3% of all postelectronic cases. The implementation of an automated electronic system for managing peer review in a large, complex department was effective in significantly reducing the number of missed reviews and missed re-reviews when compared to our previous manual system.