FY2021 Program Evaluation of the Child Protection Training Academy for New DCFS Investigators
Ted Cross, Yu-Ling Chiu, Shufen Wang, Laura Lee, Steve Tran, and Kirsten Havig
In FY2021, the Children and Family Research Center’s (CFRC) evaluation team again used multiple sub-studies to examine the implementation and outcomes of simulation training for new child protection investigators in the Illinois Department of Children and Family Service. This is an important time historically to study simulation training because of the effect of COVID-19 on trainees, their work and the training itself. Chapter 1 summarizes CTPA’s implementation in 2021: adapting to the COVID-19 pandemic through virtual methods, training supervisors in problem-based learning, and re-formatting investigator training. Chapter 2 presents results from the Daily Experience of Simulation Training (DEST) measure. The measure was designed to examine change in trainees’ confidence over the course of simulation training. This is an important time to assess DEST results, because of changes in simulation training during FY2021, as discussed in the Introduction. Chapter 3 offers updated results from a post-training satisfaction survey. The chapter reports trainees’ satisfaction ratings for simulation training over this time period. It also provides qualitative results from the analysis of open-ended items in the post-training satisfaction survey. Chapter 4 examines whether simulation training is related to employee turnover. Using two different analytic methods, it asks whether investigators trained using simulation training have stayed in their jobs longer than investigators who were not provided simulation training. Chapter 5 examines the relationship of simulation training to child safety. We compared sim-trained and non-sim-trained investigators on the likelihood that children in their investigations were involved in re-reports to DCFS. The last chapter provides the conclusion of this year’s evaluation and recommendations for improving the program.