The ESTEEM Safety Evaluation Device has been developed according to realist evaluation, concerned with asking “what works for whom in which circumstances?”
This involves understanding the context in which workers can use what they have learned during their training, and understanding whether using this learning brings about changes in their safety behaviours.
The Safety Training Evaluation Device aims to identify: –
- Whether workers are able to apply knowledge and skills learned during training in their daily job on the construction site
- The contextual factors which influence whether knowledge and skills are transferred, i.e., the barriers and facilitators to training transfer
- The outcomes of training
It is an easy-to-use tool, incorporating a series of online surveys administered before training, immediately after training, three months post-training and six months post-training. These can be applied to assess the effectiveness of the training undertaken as part of the ESTEEM Safety Training Package.
Please see the Safety Training Evaluation Device Structure for further details.
At each of the four time points, the surveys include different measures to capture: –
- The contextual factors that influence whether trained workers apply what they have learned during training (e.g., work demands, management support)
- The mechanisms which support training (e.g., intent to transfer)
- The outcomes of training (e.g., non-technical skills, safety performance)
Please see Safety Training Evaluation Device Survey Measures for further details.
We have also produced the Safety Training Evaluation Device User Guide, which provides step-by-step instructions for how to evaluate the training.