Euro Health Group, in consortium with Itad, UK, was awarded a contract to implement the midterm evaluation and the ex-post evaluation of the Millennium Development Goal Initiative (MDGi) programme in Zambia, as well as to organise high-quality dissemination seminars / workshops. The purpose of the evaluations is: to improve the performance and impact of the MDGi programme in the short term; and to make available to policy-makers and stakeholders relevant findings on the impact and sustainability of the programme in the longer-term.
Midterm: The team assessed the design (relevance) of the MDGi programme and attempted to measure, in the midterm evaluation, the performance (efficiency and effectiveness) at activity and output level against the key indicators contained in the programme logical framework. The evaluation assessed the adequacy of the monitoring and evaluation framework, including the overall theory of change for the MDGi programme, and made recommendations, where appropriate, for its improvement. With a view to the broader context, the midterm evaluation assessed the quality and coherence of the MDGi programme linkages and synergies with the government's existing investments and health activities as well as those of other development partners in the field of Reproductive Maternal Newborn, Child and Adolescent Health and Nutrition (RNMCH&N). The evaluation team also studied the extent of coordination/ partnerships forged with other donors active in the health sector.
The midterm evaluation used a mixed-method approach, combining qualitative and quantitative methods, triangulating the data from different sources with a focus was on qualitative methods, with the only primary quantitative data collection exercise being the satisfaction survey among clients exiting sampled health facilities. Secondary data, collected by the MDGi programme itself, were used to analyse progress on key output and outcome indicators. Qualitative methods provided the evaluation with a deeper insight into the operations of the MDGi Programme and its potential contribution to outcomes in RMNCH&N.
Ex-post: The purpose of the ex-post evaluation was to provide an independent assessment of the overall impact and sustainability of the MDGi Programme. The evaluation objectives were to examine 1) the extent to which the higher-level objectives and results of the programme were achieved at end point; and 2) the extent to which results had been sustained or eroded since the closure of the programme. The evaluation assessed the performance of the MDGi programme across its five expected result areas:
§ 1: A package of effective nutrition services, aligned to the national strategy, is available and ready for use by the most vulnerable populations in all targeted districts
§ 2: Increased availability of a continuum of reproductive maternal, newborn and child health and nutrition services of good quality
§ 3: Increased knowledge, demand for services and cultural, geographic access to RMNCAH&N care and services
§ 4: Improve coverage and accessibility of adolescent and youth friendly services in the targeted districts
§ 5: The capacity for planning, implementation, and coordination of the Ministry of Health and other stakeholders at national, provincial and district level is improved.