Evaluating the impact of a maternity and neonatal emergencies education programme in Australian regional and rural health services on clinician knowledge and confidence: a pre-test post-test study.

Abstract

Almost 78 000 women gave birth in the state of Victoria, Australia, in 2019. While most births occurred in metropolitan Melbourne and large regional centres, a significant proportion of women birthed in rural services. In late 2016, to support clinicians to recognise and respond to clinical deterioration, the Victorian government mandated provision of an emergency training programme, called Maternity and Newborn Emergencies (MANE), to rural and regional maternity services across the state. This paper describes the evaluation of MANE. A quasi-experimental study design was used; the Kirkpatrick Evaluation Model provided the framework. Participants came from the 17 rural and regional Victorian maternity services who received MANE in 2018 and/or 2019. Baseline data were collected from MANE attendees before MANE delivery, and at four time points up to 12 months post-delivery. Clinicians' knowledge of the MANE learning objectives, and confidence ratings regarding the emergencies covered in MANE were evaluated. The Safety Attitudes Questionnaire (SAQ) assessed safety climate pre-MANE and 6 months post-MANE among all maternity providers at the sites. Immediately post-MANE, most attendees reported increased confidence to escalate clinical concerns (n=251/259). Knowledge in the non-technical and practical aspects of the programme increased. Management of perinatal emergencies was viewed as equally stressful pre-MANE and post-MANE, but confidence to manage these emergencies increased post-delivery. Pre-MANE SAQ scores showed consistently strong and poor performing services. Six months post-MANE, some services showed improvements in SAQ scores indicative of improved safety climate. MANE delivery resulted in both short-term and sustained improvements in knowledge of, and confidence in, maternity emergencies. Further investigation of the SAQ across Victoria may facilitate identification of services with a poor safety climate who could benefit from frequent targeted interventions (such as the MANE programme) at these sites.