Integrating Process Evaluation as Best Practice in the Assessment of Statewide Trainings in Suicide Prevention

Introduction

This presentation highlights the significance of process evaluation as best practice in the planning, implementation, and assessment of statewide trainings in suicide prevention. Integration of process evaluation to existing evaluations of mental health trainings has been key to implementation improvement and development of a comprehensive evaluation. Two New York State suicide prevention trainings, Link to Hope and Suicide Safety Planning Intervention, were developed by the Suicide Prevention Center of New York State and the Suicide Prevention-Training, Implementation and Evaluation Initiative at the Center for Practice Innovations, for both non-clinical and clinical stakeholders. These two trainings will be presented as examples of how process evaluation has guided implementation by monitoring quality of delivery and allowing for improvements in real time.

Goals and Methods

A participatory formative and process evaluation approach with an emphasis on qualitative research data was selected to assess the fidelity of implementation and effectiveness of these two trainings. Multiple mixed methods, including pre-, post-, and follow-up training surveys, trainer reports, a fidelity of implementation observation checklist, and biweekly and monthly debriefing meetings field notes have been regularly implemented. Data collection through these multiple tools has allowed for triangulation of data and analysis from different sources, including training participants, trainers, and evaluators. Narrative data analysis has been particularly valuable in the deeper understanding of implementation, need of change, and cultural considerations.

Results

As a result, improvements in the logistics and delivery of trainings, as well as a positive impact on participants’ learning outcomes and satisfaction have been reported. This presentation will also provide lessons learned in the importance of transforming the training culture by embracing process evaluation in the delivery of instruction.

Conclusions

Process evaluation, particularly narrative data, has been pivotal in the sustainability, improvement, and expansion of these two statewide suicide prevention trainings by strengthening their evaluation.