To
ToR: IFRC & CaLP Project Final Evaluation.
ECHO funded action to ‘buildcapacity in the use of cash and vouchers in the humanitarian sector’.
January – March 2012
Background
There is a growing recognition that in an emergency, cash and voucher transfers can be appropriate and effective tools to support populations affected by disasters in a way that maintains dignity and choice for beneficiaries while stimulating local economies and markets. The positive effects gained from using the cash modality were recognised by key NGO agencies, especially following their concerted efforts during the Tsunami operational response. This led in part to the establishment ofthe Cash and Learning Partnership (CaLP) - founded by the British Red Cross (BRC), Save the Children UK (SCUK) and Oxfam GB (OGB), who have been working together since 2006 to document and disseminate evidence based learning and support capacity buildingof practitioners in their use of cash and vouchers. The consortium expanded its steering committee further in early 2010 to include the Norwegian Refugee Council (NRC) and ACF International.
CaLP is a networking and knowledge creating/sharing platform aimed to broaden the capacity and support the adoption of cash transfer programming where appropriate in response to humanitarian crises.CaLP’s 2011-2015 strategic vision is that ‘Humanitarian preparedness and response is more effective at meeting the diverse needs of affected people and promoting recovery’.
ECHO initially funded CaLP directly through Oxfam GB (as the hosting agency) and later entered into a negotiation in 2010 with IFRC as a means to enable CaLP access to increased resources to scale up activities. IFRC signed a direct ECHO contract in mid 2010 in support of CaLP with a level of institutional support for training. The purpose of the grant has been to build capacity of humanitarian actors in the appropriate use of cash and vouchers in humanitarian assistance. The principal objective has been to ‘mainstream the use of cash and voucher programming in disaster prone areas through capacity building of key humanitarian stakeholders in the sector’. A plan was developed evolving around three support strategies which included the roll-out of a strengthened training programme, investment into evidence based learning through research/case studies and influence of key stakeholders through advocacy and communication efforts.
The signing of this capacity building partnership, a new model of operating for IFRC, was a broad recognition of the expertise available within this expanded network of agencies and a commitment to support the continued growth and relevance to this networkto humanitarian actors. During the lifespan of the 18 month action (July 2010 – December 2011), key monitoring and learning reviews have been conducted between the partners. These are: first Joint Monitoring Mission (JMM) with ECHO & partners in February 2011, a Mid Term Review in May 2011, a second JMM in September 2011 and a partnership review in August – September 2011. Monitoring against logframe commitments has been further supported on an on-going basis between IFRC and CaLP. The numerous reviews have identified that the committed outputs within the action logframe have been delivered. The two partners (IFRC and CaLP) are now commissioning a final evaluation to review and determine levels of effectiveness and efficiency of the project in its over-arching aim to mainstream the use of cash and voucher programming in disaster prone areas through capacity building of key humanitarian stakeholders in the sector.
Evaluation objective
Against the specific objective and results of the action logical framework (annex one), evaluateand determine how effective the projecthas been in:
Implementing an effective and targeted capacity building strategy, with specific reference to: the CTP training strategies of CaLP & IFRC, tools and knowledge management, communications and advocacy (including review of cost efficiency);
supporting targeted CaLP agency institutionalisation efforts;
influencing humanitarian practitioners through learning events and dissemination of good practise and evidence based learning;
identifying sector capacity building needs and gaps in line with the CaLP overall strategy;
country level coordination support and provision of technical guidance to agencies and national level actors;
The findings of the evaluation will be used by CaLP and IFRC to feed into their on-going capacity building plan for the improved, expanded and appropriate use of cash based interventions by targeted humanitarian actors.
Output
The outputs of this review are as follows:
- Delivery of a draft report March 16th 2012.
- Presentation of the key findings to IFRC and CaLP during a project meeting, between March 21-22nd 2012.
- Revision and submission of final evaluation report March 28th 2012
Methodology
Desk based evaluation from project documentation and key stakeholder interviews. Consider consultation/use of survey through the CaLP Community of Practise to directly engage stakeholder feedbackagainst evaluation objectives above - including those directly benefitting from CaLP activities. Further to evaluation methodology, DAC criteria from OEDC should be incorporated.
Allocation of 16 review days:
- 5 days – Reading key project documentsof the project (Single Form, Mid Term Review, JMM mission reports, country final evaluation reports, training evaluation & analysis, training monitoring & evaluation methodology, learning event evaluations & communication bulletins)
- 4 days – conducting interviews
- 5 days – report drafting
- 1 day – Attending IFRC and CaLP project meeting to present findings - March 21
- 1 day – report revision and delivery of final version.
Suggested Key informants / to be further informed by partners.
IFRC
-Emma Delo, Senior Recovery Officer
-Heidi Gilert, CTP Coordinator
-Simon Eccleshall, Head, Disaster Services Department
-Nigel Ede, Recovery Delegate, Asia-Pacific Zone.
CaLP
-Nicolas Barrouillet, CaLP Coordinator
-Frederic Vignoud, CaLP Trainer
-Breanna Ridsdel, Communications and advocacy officer
-GeraudDevred, Desire Amougou, Glenn Hughson, Cash Focal points
-5 CaLP Steering Committee members, Oxfam GB, British Red Cross, Save UK, ACF International, Norwegian Refugee Council + agency senior management to be determined by the Steering Committee members.
ECHO
- DevrigVelly, Food Assistance Coordinator
- Sara McHattie, Regional Food Expert, Kenya & others as determined by ECHO F.A Coordinator
Person Specification
Should bring technical experience of having worked directly in cash based programme initiatives, have demonstrable capacity building and programme management skills together with a sound understanding of the humanitarian sector.
Availability
Consultancy to start as soon as possible.
IFRC – CaLP final evaluation February - March 2012
Title of the Action / Building capacity in the use of cash and vouchers in the humanitarian sectorPrincipal Objective / To mainstream the use of cash and voucher programming in disaster prone areas through capacity building of key humanitarian stakeholders in the sector.
Intervention Logic / Objectively Verifiable Indicators / Sources of Verification / Risks and Assumptions
Specific Objective / To build capacity of key humanitarian stakeholders[1]to implement cash and voucher programming by knowledge transfer activities, develop good practice, evidence based research, and advocacy to influence key stakeholders by 2011. / At least 60% of participants surveyed incorporate cash and voucher feasibility into project assessments /
Capacity Building impact analysis exercise conducted with trainers and participants in Q3 2011 / Willingness at country level to support cash and voucher based humanitarian programming.
Humanitarian emergencies that occur in 2010/2011 do not divert attention and resources away at country and regional level from important capacity building initiatives.
Emergencies are in contexts where market systems are functioning, allowing for cash and vouchers to be a viable alternative modality for delivery of support.
Results / 1.Practitioners in the humanitarian sector, across a range of institutions, acquire the skills and capacity required to design and implement cash and voucher programming. / 1.1 35 trainings are completed[2]
1,2 At least 875 participants are trained[3]
1,3 At least 50% improvement in skills and knowledge for all participants from the training event
1.4 At least 60% of trained participants are applying acquired skills in focus countries after at least 6 months.
1.5 At least 60% of assessments involving training participants use market analysis tools in the assessment phase of Humanitarian operations
1.6 1 map of stakeholders priorities, gaps and capacity building needs related to cash and voucher programming completed / Training lists
Training lists
Training pre and post test
Capacity building impact analysis exercise conducted with trainers and participants in Q3 2011
Capacity building impact analysis exercise conducted with trainers and participants in Q3 2011
Mapping report
2.Practitioners in the humanitarian sector, across a range of institutions and sectors, can access tools, good practice, and programme guidance for cash and voucher programming that meets their requirements. / 2.1 Two learning events are conducted
2.2 At least 50 participants attend each learning event
2.3 At least 4 cash and voucher research/guidance products produced by end 2011
2.4 At least 10% increase in new members of the CTP community of practice
2.5 At least 10 new discussion threads commenced in 2010
2.6 At least 2 journal articles or publications produced by the Federation and CaLP
2.7 At least 60% of practitioners are satisfied with the tools, good practice and guidance.
2.8 At least two major humanitarian publications centring on standards and good practice have included cash and voucher considerations / Learning event lists
Learning event lists
Federation, CaLP and others (e.g. ALNAP, ODI) publication and resource catalogues
CaLP website and Dgroup usage data
CaLP website and Dgroup usage data
Humanitarian journals and publications
Community of Practice satisfaction survey Q3 2010
ODI publications including the Good Practice Review on cash and vouchers, the Sphere handbook and potential companions and Seep Economic Recovery Standards
3.Federation, CaLP members and community of practice members support and effectively advocate for the appropriate adoption of cash and voucher programming to the humanitarian and donor community. / 3.1At least 3 meetings with key donors, UN agencies, clusters at global, regional and country levels and NGOs
3.2At least two new donors fund CaLP projects
3.3Advocacy strategy is developed, implemented and evaluated
3.4CaLP quarterly newsletter is developed and disseminated
3.5Specific strategy developed for engagement with cluster system both globally and operationally on the ground in focus countries / Trip reports and event records
Signed proposals
Federation and CaLP Advocacy strategies and plans
Survey of key humanitarian stakeholders – Q3 2010
Survey of key clusters agencies and individuals leads at the global levels and in focus countries – Q3 2010
Activities / Result 1 ;
1.1Development of a CaLP capacity building strategy in Q2 of 2010
1.2CaLP develops, pilots (3 events) and finalises new capacity building products and tools with translation into French
1.3EMMA training incorporated into CaLP training portfolio
1.4Conduct an impact assessment exercise in Q3 2011
1.5Deliver 23 Federation and CaLP Interagency Trainings for stakeholder organisations:
- 3 Federation global disaster response tools training events for at least 75 individuals
- Organise and deliver 20 training events for a wide range of humanitarian practitioners primarily in the focus countries, in cash and voucher programming and EMMA. With up to 5 ToTs delivered based upon demand.
1.7 Initial development of an online CaLP cash experts register and resources for one 3-month deployment to a large scale rapid onset disaster (that do not occur in the focus countries)
Result 2 :
2.1 Co-hosting (Federation and CALP) two global annual learning events and Development and support to the CaLP Community of Practice via the website and Dgroup
2. 2Complete and disseminate 4 pieces of action research on cash and voucher and market assessment
2.3 Publication of 2 articles relating to cash and vouchers and market assessment and analysis in key humanitarian journals
2.4 A ODI HPN Good Practice Review on the use of cash and vouchers is completed by end of 2010
2.5 Development of a proposal for a Sphere companion on cash and vouchers is completed and submitted.
2.6 Development of 5 case studies highlighting learning and good practice
Result 3 :
3.1Communications material (e.g. a CaLP quarterly newsletter) is developed and disseminated through established websites for CaLP and EMMA
3.2Additional donors are mobilised to implement Phase 2 of this action
3.3Representation of CaLP in at least 2 major global fora relating to the use of cash and vouchers in humanitarian preparedness and response.
3.4 Development of an advocacy strategy in Phase I and in preparation for Phase II, to outline engagement and entry points for collaboration and influencing with major donors, the cluster system and UN agencies (e.g. WFP) regarding the appropriate use of cash adn vouchers.
Pre-conditions
High interest among key humanitarian stakeholders to engage in building capacity in use of cash and vouchers
Time available of country and regional humanitarian practitioners to engage, especially in reoccurring emergency contexts
Legal framework exists in target countries for humanitarian stakeholders to use cash and voucher transfer programming in emergency response.
IFRC – CaLP final evaluation February - March 2012
[1] Humanitarian stakeholders here include: National Governments, RC/RC Movement, UN Agencies, INGOs, NGOS and local partners
[2] Reference to Table 4.2.1. Number of trainings equals 3+3+20+9 =35
[3] Reference to table 4.2.1 Number of participants trained equals: 75+75+500+225 = 875