Development and validation of an observational tool to measure engagement in telepractice early intervention.

Abstract

To develop and validate an evidence-based observational tool to measure engagement in telepractice early intervention (EI). The Engagement in Telepractice Observational Tool (eTOT) was developed based on a previous e-Delphi study. Two independent raters used a set of 50 items to score 45 videorecorded telepractice EI sessions with young children with communication difficulties and their family. Principal component analysis (PCA) and reliability measures were conducted. PCA identified six key components related to the measurement of engagement in telepractice. The components representing professional behaviours were (1) interacting directly with the parent; (2) getting to know the child and family to keep them motivated; (3) maximising the telepractice environment; and (4) demonstrating and practising the parent's role as agent of therapy. The two remaining components represented family behaviours: (5) parent interacting and supporting their child; and (6) family collaborating directly with the professional. The eTOT was found to have good reliability (α = .86), with very good test-retest and inter-rater reliability scores (κ_w = .85 and .94 respectively). There is preliminary evidence that the eTOT is a valid and reliable tool to measure engagement during telepractice EI. The eTOT can be used as a self-reflection tool to identify and provide engagement-building opportunities in family-centred telepractice EI.