Final Evaluation for Access to Primary Health Care - Consultant
Save the Children Alliance
Save the Children has a long history of engagement in Somalia and in Somaliland stretching as far back as 1954. In more recent times (since 1992) Save the Children UK has maintained an operational office in Hiran Region in what is now called the Central South Zone of Somalia and since 2000, both Save the Children Denmark and UK have been working in what is now the self proclaimed republic of Somaliland. In response to the Tsunami that hit the coast of Puntland in 2004 Save the Children UK established an office in Puntland State and continues to undertake programmes from this office while Save the Children Denmark in Puntland works through partners. In the past two years Save the Children Finland has been supporting both Save the Children Denmark and UK with funding.
Closing date: 05 Feb 2010
Location: Somalia
TERMS OF REFERENCE (TOR) FOR FINAL EVALUATION OF THE “ACCESS to Primary Health Care for Rural Children” PROJECT IN KARKAAR REGION OF PUNTLAND STATE OF SOMALIA.
1. INTRODUCTION AND PURPOSE OF EVALUATION
The overall purpose of this evaluation is to provide a comprehensive and independent evaluation of the Access to Primary Health Care for Rural Children Project in Karkaar Region of Puntland implemented by Save the Children (SC) and funded by the European Commission (EC). This will assess the project outcomes, quality and impact, identify lessons learned and will provide information to allow for improved decision making for future projects.
2. BACKGROUND
The EC has been funding the Access to Primary Health Care for Rural children in Karkaar Region project in Puntland (Somalia) over 24 months with a total eligible cost of EUR 999,080. The overall objective of the project is to attain a reduction in under 5 childhood mortality in Karkaar region of Puntland by the end of 2009. The specific objectives are to enhance access to quality primary health care by 60% of the children and their mothers in Karkaar region of Puntland, and increase community awareness and capacity to effectively address the local primary health care. The target population of the project is 130,000, of which about 70,620 are children. Of these children almost 29,000 are under 5 years of age.
The project sought to achieve improved healthcare delivery by providing training of trainers in the integrated management of childhood illness (IMCI), establishing partnership with teaching institutions and by supporting the Ministry of Health (MoH) with training on health systems management, procurement, health financing and setting up and managing health information systems.
Save the Children works with a rights based approach, which puts special emphasis on promoting the Convention on the Rights of the Child and on the promotion of gender equality and the empowerment of women. In the Somali context this means the action deals with harmful traditional practices such as early marriages and female genital mutilation (both known to cause high infant and maternal mortality).
The project is implemented in a partnership between SCUK and the MoH of Puntland at national, regional and district levels in collaboration with other stakeholders including Community Health Committees (CHC), youth groups, women and local authorities
3. EVALUATION CRITERIA AND QUESTIONS
The evaluation approach and methodology should follow and observe the EC guidelines for evaluations (See EuropeAid’s guidance for evaluation methodology website and the ‘’Aid Delivery Methods’, Volume 1 ‘Project Cycle Management Guidelines (EuropeAid, March 2004)) and is expected to verify, analyse and assess in detail the project in relation to the five OECD-DAC evaluation criteria: relevance, effectiveness, efficiency, sustainability and impact. Furthermore, the EC-specific evaluation criteria of added value and coherence should be assessed along with the integration and impact of cross cutting issues in the project (i.e. HIV/AIDS, FGM and Gender). In addition the evaluation is expected to identify the strengths and weaknesses of the project and come up with lessons learned and recommendations to guide, inform and improve future programme design and management. The evaluation findings will be shared with key stakeholders of the project, importantly the donor (EC), MoH, local health authorities, training centres and other health actors in Puntland.
In relation to the evaluation criteria, the evaluation should answer the following questions:
- Relevance: How appropriate was the project design? To what extent did the stated objectives correctly address the problems and real needs of the target groups?
- Efficiency: Identify the extent to which the project was value for money; how economical were project inputs (funds, expertise, time, etc) converted into results in required quantity and quality and in good time? Was the use of the project resources cost-effective? Could they have been done more cost efficiently?
- Effectiveness: To what extent did the stated project results and purpose been achieved? Ascertain the quality of the outcomes.
- Impact: What changes – positive/negative, intended/un-intended – did the project produce?
- Sustainability: What is the likelihood of the project to continue after end of the project? What sustainability measures have been put in place? Sustainability should be reviewed against capacity and systems (technical and institutional sustainability), financial, environmental and the sustainability of the benefits.
- Accountability: To what extent were the activities of the project implemented in participatory and empowering manner? How involved were the key stakeholders of the project in planning and execution of activities, and steering the project? How effective was our accountability to the beneficiaries?
The evaluation should cover and assess all activities and expected results as outlined in project document from the inception of the project in Jan 2008 to its completion in March 2010.
The evaluator is expected to work closely with the SC Project Manager and the SC Puntland Team with the assistance of project partners and the EC. The PM and the SC Puntland Team will assist the evaluator in accessing to all relevant information (sources and documents) related to the project, to provide responses to questions and to discuss and comment on all notes and draft reports delivered by the evaluation team.
4. EVALUATION METHODOLOGY
The evaluation methodology is expected to combine qualitative and quantitative data collection and analysis techniques that will be used to gather data and information from main stakeholders, including appropriate staff from the MoH as well as other stakeholders in the sector including Community Health Committees (CHC), project officers, other actors in similar projects like a Aktion Afrika Hilfe (AAH) and Somali Red Cresset Society (SRCS), and the beneficiaries themselves including children and young people. The data and information gathered will be systematically analyzed and presented following the five evaluation criteria mentioned above.
It is expected that the consultant will directly collect information during field visits to Garowe, and Gardo in Puntland.
The methodology should include at least the following elements:
- Literature review. The consultant will need to be familiar with project documentation, as well as related literature on similar projects and the program area.
- Meetings/ in-depth interviews/focus group discussions with key stakeholders, including SC employees, MoH, local authorities, elders, other actors, beneficiaries etc. SC sees as fundamental the participation of beneficiaries in the evaluation.
- Observation of SC implemented activities in Karkaar Region.
- Quantitative research techniques- review monthly HMIS reports at the regional, district and health facility level and quarterly project reports to analyze coverage/utilisation of services.
- Feedback from key stakeholders- Key stakeholders are given the opportunity to comment and provide feedback to the draft report.
5. EVALUATION OUTPUTS/DELIVERABLES
The evaluator is expected (as a minimum) to produce the following:
- An inception report that encompasses a detailed methodology and the tools to be used for the evaluation will be produced and agreed on with the SC team. This will be done after the primary literature review and before field visits/work commences.
- To facilitate a one day validation workshop to share and confirm findings with Puntland SC team, local partners and relevant stakeholders in the field.
- A one day workshop to present the key findings of the evaluation to SC team, EC and other relevant stakeholders in Nairobi.
- Prepare and submit final report to SC in three hard copies (bounded) and CD-ROM. The evaluation report will be written in English with a maximum of 50 pages inclusive of the executive summary and conclusion and remarks (annexes can be separate).
6. EVALUATOR REQUIREMENTS
- The consultancy company or individual consultant must have extensive
Experience with health programming and in particular in monitoring and
Evaluation
- Postgraduate qualification (Masters or above) in Public health, epidemiology or in a discipline relevant to this assignment with a minimum of 8 years of professional experience
- Experience in project management processes and systems (logistics, finance and human resources management).
- Experience in the evaluation of technical assistance projects, preferably EC-funded and particularly those under the health portfolio
- Excellent report writing skills
- Expertise in a fragile state/post conflict environment is an advantage
- Knowledge of the health sector in international humanitarian and development work and in particular proven experience in projects in support to primary health care
- Demonstrated competence in conducting qualitative research including the development of interview schedules and qualitative data analysis
7. CONDITIONS AND TIME FRAME
- The evaluation is expected to commence on the 26th February 2010 and run for 32 consecutive days. The final report should be submitted on the 29th March 2010.
- Costs of the consultant’s travel from base to the field and back after the end of the contract (including airport tax), and accommodation will be covered by SC.
- The consultant shall be responsible for income tax but travel and medical insurance while in the field are covered.
- Data collection and data processing costs are on the account of the Consultant.
- The Consultant should also use his/her own laptop computer.
- The consultant is bound by the principles and conditions of Save the Children’s Code of Conduct.
8. APPLICATION REQUIREMENTS
Applicants need to submit a short application, including:
- A cover letter (max two pages) stating why they are qualified to do the evaluation addressing the evaluator requirements
- A brief methodology paper that addresses the evaluation criteria, methodology and work plan
- CV of the proposed evaluator
- Fee and other cost requirements
How to apply
Applications with non returnable copies of CVs, testimonials and with at least two samples of previous work should be submitted on or before February 5, 2010 via email to [
s.abdullahi@scuk.or.ke] AND [
vacancies@scuk.or.ke]
Reference Code: RW_7ZYG97-40