Building lean improvement sckills at scale: an evaluation of a massive open online course in the English NHS.

Abstract

Internationally, healthcare systems face challenges from population demographics and rising care costs. Systematic methods of quality improvement (QI) are considered key to delivering needed transformation and change. Large-scale training in QI skills is required.Massive open online courses (MOOCs) are an inexpensive strategy for QI training across large regions and countries. The <i>Lean Fundamentals</i> MOOC was developed in the English NHS to train health and care staff in Lean QI methods. It supported participants to learn and apply process improvement skills through a free-to-access, practical, learning-in-action approach. <i>Lean Fundamentals'</i> cost-effectiveness and its impact on participants' knowledge and confidence to apply Lean to improve processes were assessed. Using the Kirkpatrick framework, participant reaction, knowledge and confidence change, results and overall return-on-investment (ROI) were evaluated. Quantitative data were collected via pre and postcourse surveys to analyse participants' knowledge and confidence change using the Wilcoxon signed rank test. Qualitative learning platform and postcourse survey data demonstrated participants' results from application. Over 18 months, <i>Lean Fundamentals</i> attracted 6617 enrolments and supported 3462 active participants. 97.6% (n=829) of participants completing the postcourse survey indicated <i>Lean Fundamentals</i> met their expectations and 97.2% (n=823) indicated they would recommend it. Self-reported changes in knowledge and confidence to apply Lean showed significant differences (p<0.001). Learning was applied to operational healthcare priorities (such as post-COVID recovery of services) and participants shared 511 project improvement reports. <i>Lean Fundamentals</i> helped large numbers of participants to develop Lean process improvement skills-avoiding costs associated with commercial Lean training in the range £1.7 m to £3.4 m and generating ROI of between £11 and £23 per every pound spent on delivery. This demonstrates that massive online is an effective and efficient method for building improvement knowledge and skills at scale.