External evaluation carried out by:
This external evaluation aligns with the ITCILO's vision to be the global centre of excellence for ILO constituents to source capacity development services on social justice for decent work, and with its mission to provide people across the world of work directly and via ILO constituents with access to digitally enhanced capacity development services to successfully manage their Future Work transitions.
The ITCILO continues to expand its base of beneficiaries and attracts more participants for its training activities each year, with total participant numbers in 2022 nearing 100.000. Most of this increase is due to the strong growth in the number of distance learners, which comprised around 92.000 participants in 2022.
The evaluation criteria were based on the OECD DAC evaluation principles, encompassing relevance of the sampled activities to beneficiaries' needs, their coherence, efficiency, effectiveness, impact and sustainability. It also provided a comparative analysis of the different modalities of training offered by the ITCILO, namely face-to-face, blended and online.
The evaluation aimed to assess the design, implementation, and quality of training activities carried out by the ITCILO, and focused on 50 sampled training activities and a diploma programme conducted by the ITCILO in 2022.
The methodology for this evaluation was carefully designed to gather a wide range of data and insights to address specific evaluation questions and comprehensively assess the organization's performance.
The methodology included quantitative and qualitative evaluation methods to provide conclusions and recommendations from the findings substantiated with desk research, statistical data and 5 case studies documenting good practice. 626 responses were collected from a participant’s survey, and in-depth interviews were conducted with 56 ITCILO staff members, 6 institutional partners, and focus group discussions were held with 9 former participants.
This evaluation adopted a longitudinal approach by taking into account the findings of the two previous external evaluation reports, and it was aligned as much as possible with the methods that have been consistently applied in previous years.
Review previous evaluations:
the main findings of the external evaluation were presented in accordance with the OECD DAC evaluation criteria.
The finding that all the relevant sources of feedback perceive the ITCILO as highly effective in delivering the planned learning objectives is best explained by two (intertwined) characteristics of the ITCILO:
1. Its robust internal quality assurance system, but also the quality culture and commitment to enhancement noted across different programme teams.
2. Its proximity and sensitivity to the needs of the beneficiary organizations and individual learners
Participating in this training has provided me with valuable insights. I have been able to exert influence in such a way that the organization of informal economy workers has seen significant improvements across the entire country. We've successfully established national unions originating from the informal economy and extended our impact to neighbouring countries like Malawi, Zambia, Mozambique, and Namibia. The knowledge gained from these training activities has empowered me to also influence Zimbabwe's national Social Security Authority, resulting in the consideration of social protection services for those within the informal economy. This achievement brings me immense satisfaction and a sense of accomplishment, as I contribute positively to my country, employment, and the trade union as a whole.
Evaluation findings underscore a remarkable uptake of ITC training activity outcomes. Participants exhibit strong enthusiasm for disseminating their acquired knowledge within their immediate circles, and the evaluation team has observed numerous instances of such initiatives, alongside those targeting organizational or societal impact.
Pros of the Diploma Track:
Overall, the evaluation team is convinced that the ITCILO delivers an excellent learning experience to the participants of its training activities, for whom these are relevant, useful and applicable in their own work and in their wider personal context.
Considering our high level of confidence in the ITCILO's level of success, based on this external evaluation, the suggested areas of improvement should be perceived precisely as potential improvements that can further enrich an already well-functioning system. ITCILO's course design achieves strong results in all three domains: teaching, cognitive and social presence. However, there are some aspects that are comparatively stronger than the rest.
It is recommended to stop offering pure face-to-face training activities, and to include some elements of blended learning in all courses.
Extend the scope of outreach by setting up a platform, such as an alumni network, which would foster continuous engagement post course completion, long-term networking, and knowledge/experience exchange among past participants.