Evaluation of the disability workforce and frontline worker program

The eSafety Women training program was independently evaluated 12 months after its launch, to assist in shaping its strategic direction and future policy development.

The program provides professional development training to workers supporting women who are experiencing or at risk of experiencing technology-facilitated abuse. It is specifically aimed at workers who provide support to women with intellectual or cognitive disability.

The capacity-building training is informed by research and offers case studies, strategies and resources to identify and address online risks such as harassment and intimidation, stalking, and image-based abuse. 

Evaluation process

Orima Research conducted qualitative and quantitative research with program participants to evaluate the impact of the program, based on three criteria: 

  • Awareness of technology-facilitated abuse
  • Evidence of learning 
  • Behaviour change

The quantitative research component involved a survey of program participants before and after the presentation. 

The qualitative research component involved eight interviews with program participants, four to six weeks after the presentation. 

Summary of key findings

Almost all interview participants and survey respondents reported they were satisfied with the training program content (97%) and delivery (97%). Furthermore, almost all follow-up survey respondents (94%) reported that they were extremely or very likely to recommend the training to colleagues.

The program met or exceeded expectations against all three criteria:

  • Awareness of technology-faciltated abuse: 74% of respondents reported they had strong understanding of technology-facilitated abuse, a significant increase from the 39% who said they had a strong understanding before the training. Most interview participants reported the training increased their perception of the relevance of technology-facilitated abuse to their work. 
  • Evidence of learning: 97% of respondents reported learning something new in the training. This included knowing where to get resources for technology-facilitated abuse (97%), understanding technology-facilitated abuse (94%) and image-based abuse (91%), and knowing how to refer a client to get support for technology-facilitated abuse (89%) and domestic and family violence (69%). 
  • Behaviour change: The program demonstrated evidence of behaviour change among the participants – 97% of respondents indicated they intended to use at least one of the eSafety resources mentioned in the training. At longer term follow up, most interview participants reported they had used something from their training as part of their work. This included using the training to update processes used to support the management of clients' devices, discussing technology-facilitated abuse with clients and searching the eSafety website for additional information.