The Developmental Evaluation of a COVID-19 vaccination program was an early response to assess a complex emergent mass vaccination program to support learning and adaptation.


The primary objective of a multi-disciplinary team of researcher-evaluators was to facilitate organizational learning among key stakeholders to improve decision-making and increase vaccine uptake in Saskatchewan, Canada.


Aligned with the Developmental Evaluation approach, data collection was rooted in adjustment and flexibility to meet the evolving needs of the vaccination program. Data were primarily collected using meeting observations and program documentation. As the program progressed, the data collection was adjusted, and two surveys were conducted targeting COVID-19 vaccine recipients and vaccine immunizers. Data were analyzed iteratively in consultation with stakeholders.


Nine feedback reports were generated over a nine-month evaluation period. Seven reports highlighted meeting observation results that revealed the program issues, probable causes, and implications. The evolving issues ranged from vaccine shortage, delay, and supply fluctuation to inter-organizational miscommunication and vaccine hesitancy. Two reports were produced from survey findings to delve into the persistent issue of vaccine hesitancy.


Effective solutions to complex issues of Saskatchewan’s COVID-19 mass immunization require a systems approach based on new ways of thinking and collective decision-making.

Keywords: Developmental evaluation, COVID-19 vaccination program, Saskatchewan, Decision-making, Collaboration, Vaccine hesitancy.
Fulltext HTML PDF ePub