Mifras sought Q’s help to revamp their organization’s impact evaluation model to properly determine the effectiveness of its program and to provide useful insights for the Mifras team.
Mifras now has a clear understanding of their core impact model and is able to track KPIs. The KPIs provide an understanding as to where extra support is needed, as well as offer insights for process improvement. Furthermore, the impact model is being used to generate more donor support as the data speaks for itself. Mifras has plans to run through this evaluation process annually with Q’s guidance.
Through interviews with the Mifras team and the review of existing materials, Q understood the first required task was to clearly define Mifras’ core value proposition. The Q team conducted a workshop for the organization’s management, in which a model was written and accepted.
Q then validated the accepted impact model with principals who had already culminated the program by conducting interviews and comparing the impact model described by the team with the actual impact experienced by Mifras’ alumni. Q revised and refined the impact model to fit more closely with the experiences of the alumni.
With a validated model in hand, Q designed measurement tools that included a combination of interviews and surveys to be conducted once a year across four different cohorts in time. The measurement tools were designed to focus on behaviors, rather than subjective evaluations about how participants in the program feel about their own projects. This was done to reduce biased answers and help Mifras, as well as its partners and supporters, to better understand the actual change experienced within participating schools.
After the first round of measurement and evaluation in summer 2022, Q was able to test the newly designed model and ensure its accuracy.
The measurement system was created using behavioral thinking best practices.
By combining qualitative and quantitative research questions as part of the surveys and interviews, the new measurement system is not only more accurate, but it is also multi-functional.
Mifras can use qualitative information to tell stories and create narratives about the projects, and the quantitative data uncovers the projects’ effectiveness in practice.