Annual evaluation report
2023 in review

A YEAR IN EVALUATION

In a world of crisis, evidence is needed more than ever to tackle hunger.

Evaluations deliver the evidence that helps tell us what works, what doesn’t and why, contributing to greater accountability, improved learning and enlightened decision making.

This report – the second produced under the WFP Evaluation Policy 2022 – maps evaluations conducted, presents evidence insights and measures the performance of WFP’s evaluation function in 2023.

1

Introduction

The evaluation was a door opener to start having a neutral conversation on what WFP can do to support the Government in the Dominican Republic (More)

Gabriela Alvarado
Country Director
WFP Dominican Republic

Not only did the government acknowledge WFP’s role in Cuba, the evaluation results and the importance of the partnership, they also valued the evaluation process: the way it was done, and the transparency with which the results were presented.

Etienne Labande
Country Director
WFP Cuba

Evidence gives you a believable story…Our evaluations really lend themselves to putting evidence behind the things we do; the how of it, and the explaining of it (More)

Barbara Clemens
Country Director
WFP Ghana

Evaluation findings gives us that neutral and independent lens that we can go to any of our partners and other stakeholders and they would have greater confidence in WFP’s contribution in a country like the Philippines.

Dipayan Bhattacharyya
Country Director ad interim
WFP Philippines

Evaluations give us the assurance that our programmes are achieving the intended outcomes. More than ever communities we support, donors and governments are asking us to show the impact of what we do.

Christine Mendes
Deputy Country Director
WFP Zimbabwe

Evaluation is very much worth the investment because without it we really cannot sharpen up our interventions. When we have the evidence of previous interventions, we get smarter with subsequent ones.

Housainou Taal
Country Director
WFP Central African Republic

We need more evaluations that help change the dialogue with big donors (More)

Lauren Landis
Country Director
WFP Kenya

Evaluation becomes very critical in a context like Iraq where I need to be able to explain to donors about our impact, but also understand as a manager where we are falling short and fixing it.

Ally Raza Qureshi
Country Director
WFP Iraq

Our vision

to ensure the WFP culture of accountability and learning is supported by evaluative thinking, behaviour and systems which strengthen its contribution to achieving zero hunger.

INDIPENDENCE

All WFP evaluations are conducted by independent professionals in accordance with United Nations Evaluation Group norms and standards.

1

Overview

44

evaluations
completed

49

countries
covered

311

recommendations
due to be
implemented

Centralized
evaluations

Centralized evaluations are commissioned and managed by OEV and presented to the Executive Board for consideration. They focus on corporate strategies and policies, global programmes, strategic issues and themes, corporate emergencies and CSPs

Decentralized
evaluations

Decentralized evaluations are commissioned and managed by country offices, regional bureaux and headquarters-base ddivisions other than OEV. They can cover activities, pilots, themes, transfer modalities or any other area of action at the subnational, national or multi-country level. They are not presented to the Board

Impact
evaluations

Impact evaluations are managed by OEV at the request of country offices. They measure changes in development outcomes of interest for a target population that can be attributed to a specific programme or policy through a credible counterfactual. They are not presented to the Executive Board

This map shows where evaluations on WFP and partner activities happened in 2023 and their subject of focus. WFP evaluations are conducted by independent professionals in accordance with United Nations Evaluation Group (UNEG) norms and standards. The three categories of evaluation at WFP are centralized, decentralized and impact.

The buttons allow you to view the map by evaluation category. Clicking on a country presents greater detail on completed and ongoing evaluations.
2

Part 1:Insights

Centralized evaluations

Centralized evaluations are commissioned and managed by the Office of Evaluation. They are presented to the Executive Board and designed to be relevant to the dynamic programming of WFP.

27

completed

31

ongoing

14

new evaluations
in 2023

Centralized
evaluations

Centralized evaluations are commissioned and managed by OEV and presented to the Executive Board for consideration. They focus on corporate strategies and policies, global programmes, strategic issues and themes, corporate emergencies and CSPs

Decentralized
evaluations

Decentralized evaluations are commissioned and managed by country offices, regional bureaux and headquarters-base ddivisions other than OEV. They can cover activities, pilots, themes, transfer modalities or any other area of action at the subnational, national or multi-country level. They are not presented to the Board

Impact
evaluations

Impact evaluations are managed by OEV at the request of country offices. They measure changes in development outcomes of interest for a target population that can be attributed to a specific programme or policy through a credible counterfactual. They are not presented to the Executive Board

Key evidence and lessons from centralized evaluations in 2023

STRATEGIC
evaluations

POLICY
evaluations

COUNTRY strategic plan
evaluations

Evaluations of corporate emergency responses

Inter-agency humanitarian evaluations

Evaluation syntheses

JOINT EvaluatioNS

REviewS

STRATEGIC evaluations

Strategic evaluations assess strategic, systemic or emerging corporate issues and programmes and initiatives with global or regional coverage

Read more

POLICY evaluations

Policy evaluations examine particular WFP policies and the systems, guidance and activities for implementing them.

Read more

Country strategic plan evaluations

Country strategic plan evaluations focus on assessing WFP’s contributions to strategic outcomes at the country level.

Read more

Evaluations of corporate emergency evaluations

Evaluations of corporate emergency responses assess the coverage, coherence and connectedness of the response.

Read more

INter-agency humanitarian evaluations

Inter-agency humanitarian evaluations are an independent assessment of results of the collective humanitarian response by member organizations of the Inter Agency Standing Committee.

Read more

Evaluation syntheses

Evaluations syntheses combine data from multiple evaluations that are analysed to produce general conclusions.

Read more

JOINT EvaluationS

Joint evaluations examine a topic of mutual interest or a programme or set of activities that are co-financed and implemented.

Read more

ReviewS

Reviews focus on operational issues, and are typically managed internally to enable timely decision-making and potential adjustments to an ongoing programme.

Read more

HOW HAS WFP’S STRATEGIC POSITIONING EVOLVED?

A successful strategic shift. Evaluations in 2023 found that in many countries WFP has successfully transitioned from largely directly implementing food and nutrition security programmes to a more enabling role, supporting national partners to provide hunger solutions while maintaining its traditional emergency response capacity. Approaches contributing to the strategic shift included:

  • supporting policy and strategy development, for example in social protection and school meals
  • country capacity strengthening including for disaster risk reduction, emergency preparedness/response and food security monitoring
  • shifting from short-term assistance, for example in food transfers or livelihoods, to a medium-term approach, for example in social protection or resilience programming

National stakeholders welcomed this shift, which helped to bring WFP closer to central decision making. However, evaluations found that systemic and structural barriers remain. Specifically:

  • heavily earmarked funding constrained WFP’s ability to adapt to contextual changes and plan for the medium term
  • insufficient number and skills of staff resulted in staff overload/inability to engage in certain technical areas/poor alignment with country strategic plan (CSP) strategic needs
  • non-optimized country office organizational structures impeded timely decision making/working across the full portfolio of activities
  • a tendency toward “silos” and fragmentation constrained results

Volatile contexts and sudden emergencies have required WFP to adapt swiftly. In all the operational settings evaluated, plans for the strong enabling role envisioned in CSPs were threatened by emergencies such as natural disasters, conflict and political and economic shocks. 

Country offices accordingly needed to engage in various forms of crisis response alongside existing CSP activities. To support adaptation, WFP used the CSP budget revision tool and added emergency-focused strategic objectives. However, this did not always result in fully cohesive CSP implementation. Crisis response activities were not always aligned with other areas of work and exit strategies.

Evaluations revealed that the urgency of emergency responses sometimes overtook planned CSP strategic or programmatic work, resulting in non-alignment of activities. Moreover, some CSPs separated emergency preparedness activities from emergency response, which impeded crisis response when needed. Other CSPs lacked clear exit strategies from emergency interventions.

Evaluations recommend

  • aligning human resource capacity to the strategic visions and directions of CSPs
  • strengthening country office emergency preparedness and response capacity and simplifying the budget revision process for CSPs
  • where WFP adopts a largely enabling role in CSPs, retaining a dormant emergency response strategic objective that can be activated as needed 
  • ensuring that ongoing programmatic work is fully integrated into any new crisis response activity

HOW HAS WFP’S STRATEGIC POSITIONING EVOLVED?

What results were delivered?

What results were delivered?

Strategic outcome 1: People are better able to meet their urgent food and nutrition needs
Evaluations found that:

  • While WFP largely met coverage needs for general food assistance and nutrition activities, it did not always achieve its food security and nutrition aims
  • Funding shortfalls led to reduced volumes or durations of rations and cash-based transfers and limited coverage of nutrition interventions
  • As a result, when cash or food transfers did not meet beneficiaries’ needs, their use of crisis coping strategies increased 

Strategic outcome 2: People have better nutrition, health and education outcomes
Evaluations found positive results for both school meals and nutrition activities:

  • Children’s enrolment, attendance, retention and academic performance improved under school meals programmes and dropout rates fell
  • Home-grown school feeding activities enhanced the consumption of locally available nutritious foods and increased smallholder farmer incomes 
  • Nutrition activities reduced mortality and enhanced nutritional status for target populations, as well as aiding recovery from moderate acute malnutrition 

However, activities were not always well-integrated, and pilot projects were not always analysed to inform their potential scale-up.

Strategic outcome 3: People have improved and sustainable livelihoods
Policy evaluations found that WFP’s conceptual framework for resilience was strong, but not fully up to date with current practice. Achievements and gaps were:

  • Resilience activities such as smallholder farmer support helped increase incomes for beneficiaries, diversify livelihoods and enhance crop yields – and supported women’s participation in the labour market
  • A lack of funding and limited multi-year or predictable financing resulted in short-term or small-scale interventions. These could not counter the impact of shocks and/or address the underlying causes of food insecurity and malnutrition
  • Limited multisectoral and/or interlinked approaches impeded results

Strategic outcome 4: National programmes and systems are strengthened
All the evaluations found that the CSP approach improved the alignment between WFP activities and national systems and programmes. WFP actions, especially in school meals, nutrition and social protection, helped to:

  • improve national policy frameworks and create road maps to realize national food security and nutrition aims 
  • enhance national and local programme design and delivery capacities 
  • build greater institutional effectiveness
  • improve national monitoring systems for food and nutrition security 

However, WFP did not always analyse national capacities from a systems perspective, nor plan or strategize adequately for capacity strengthening. Corporate monitoring indicators for capacity strengthening were inadequate to capture WFP’s results in that area.

Strategic outcome 5: Humanitarian and development actors are more efficient and effective
WFP provided high-quality and highly valued on-demand logistics and supply chain services. Key results included:

  • effects of crises alleviated on beneficiary populations through technical expertise and specialist experience
  • capacity of local first responders strengthened
  • national emergency responses facilitated through personnel transport and last-mile support
  • government emergency preparedness and response capacity enhanced

DID TARGETING AND PRIORITIZATION
ENABLE WFP TO MEET BENEFICIARIES’ NEEDS?

Targeting has room to improve.
As WFP increasingly uses national targeting systems, evaluations found that WFP did not consistently ensure those most in need were targeted. Post-distribution monitoring did not always check the most vulnerable people (identified for targeting) were actually reached. Other limitations included:

  • Activities using WFP’s own targeting systems did not always focus on the most food-insecure areas of the country  
  • There was insufficient attention to targeting young people and people living with disabilities
  • Opting for breadth over depth enabled wider reach of affected populations but impeded food security gains 
  • Participatory approaches to community and individual targeting were hampered by inconsistent consultation with local communities

Prioritization posed difficult choices.
Under funding pressure to prioritise, evaluations found that WFP made three main choices: 

  • Reducing transfer values to beneficiaries while maintaining the number of beneficiaries as far as feasible
  • Reducing the breadth of coverage where necessary 
  • Shifting from status-based to vulnerability-based targeting, applying criteria relevant to each operating environment 

All evaluations found these changes necessary but extremely difficult, leading to rising food insecurity for vulnerable populations.

Evaluations recommend

  • verifying the vulnerability focus of national targeting systems 
  • ensuring that all targeting systems – whether national or WFP – are focused on equity and inclusion 
  • adopting an evidence-based approach to prioritization

DID TARGETING AND PRIORITIZATION
ENABLE WFP TO MEET BENEFICIARIES’ NEEDS?

What results were delivered?

How well did WFP address cross-cutting issues in programming?

Performance was mixed:

WFP mostly addressed protection issues, including ensuring beneficiaries’ dignity - for example by conducting risk assessments and then tailoring intervention modalities accordingly. However, the protection needs of some marginalized populations, such as people living with HIV, people with disabilities, young people, women and victims of violence, were not always addressed.

Efforts to address environmental sustainability and climate change concerns were substantial – for example using climate-responsive agricultural practices and "clean cooking" in school canteens. However, they were not always systematic, with CSP and programme designs not always incorporating them. Evaluations found notable staffing and skills gaps in this area.

Attention to gender equality and women’s empowerment was uneven and lacked a transformative lens.  Evaluations found variable attention to gender within CSP design and implementation. Gender was successfully mainstreamed across activities in around half of the country programmes evaluated. Factors supporting gender mainstreaming included country office participation in WFP’s corporate gender transformation programme; the development and use of a gender action plan or strategy; dedicated staffing; and the use of a gender resource network. Weaknesses included insufficient staff capacity and expertise; a lack of gender analysis at design stage, and ad hoc rather than systemic or strategic approaches. There was also a focus on achieving equal participation rather than adopting gender-transformative approaches.

There was insufficient focus on disability concerns overall, though some country offices, like that in Malawi, had developed comprehensive disability and social inclusion strategies and approaches. 

Significant gaps arose in accountability to affected populations (AAP)
including insufficient beneficiary engagement and consultation and/or limited information provided to beneficiaries. Community feedback mechanisms were extensively developed, but often incomplete or underutilized.

Evaluations recommend

  • building skills and capacity for addressing cross-cutting issues, including gender transformative approaches and disability inclusion
  • conveying a clear message that gender equality does not equate to “including women”
  • enhancing attention to AAP, with a focus on how systems are used as well as their development

How well did partnerships work?

Evaluations found that CSPs helped strengthen partnerships with national authorities, enhancing WFP’s role in policy and strategy formulation and increasing its potential to inform national decisions. 

However, some country offices lacked a strategic or comprehensive approach to partnerships. Operational partnerships, particularly at the decentralized level, could be broadened and deepened.

Evaluations identified examples of successful WFP advocacy with national or de facto authorities, such as expanding humanitarian access in Burkina Faso and Myanmar, and integrating vulnerable groups into national social protection strategies in the Dominican Republic.

CSPs also helped position WFP strategically within coordinated United Nations engagement on food security and nutrition. However, this strategic coordination did not always translate into strengthened operational collaboration, given the often diverse operational capacities and approaches of the entities involved. 

Evaluations found that partnerships with cooperating partners were strong and collaborative and engagement with the private sector increased. 

Evaluations recommend

  • generating clear partnership strategies based on an ethos of shared goals and mutual benefits
  • ensuring attention to subnational partnerships as part of localization
  • expanding operational coordination through a “partnership first” approach

DID TARGETING AND PRIORITIZATION
ENABLE WFP TO MEET BENEFICIARIES’ NEEDS?

What results were delivered?

What factors supported the achievement of results?

Evaluations identified eight factors – all highly valued by partners – that helped WFP achieve results:

  • technical expertise, in areas such as nutrition, adaptive/shock-responsive social protection, climate change, agricultural insurance and supply chain/logistics
  • a principled approach, in particular for humanitarian assistance, earning WFP the trust and respect of national partners
  • advocacy capacity, especially with regard to humanitarian access and the strategic and political priority of food and nutrition security
  • knowledge generation capability, in particular with regard to vulnerability, market conditions and other areas of food and nutrition security
  • leveraging capacity, for example the ability to leverage private sector capacity to address humanitarian and development challenges
  • convening power, with regard to multisectoral dialogue on food security and nutrition
  • willingness and ability to innovate, with a high capacity to design and implement digital and technical solutions
  • brokering skills, such as the ability to enhance dialogue between governments and the wider United Nations system and engagement with South–South and triangular cooperation

Digital innovation

Evaluations identified a series of digital innovations that benefited government partners in their search for food security and hunger solutions, such as:

  • a geospatial platform in Egypt that strengthened government capacity to undertake geographical analysis of statistical data on social protection and monitor the supply chain for wheat
  • digitalization of social cash transfers in Namibia and Zambia, paving the way for scale up in Zambia and helping to address registration challenges in Namibia
  • digital monitoring for the school meals programme in Ghana and humanitarian interventions in Haiti, providing real-time data to government 
  • a mobile communications platform to support emergency response in the Philippines, which helped to improve coordination and communications in the response to Typhoon Rai

What hampered WFP’s success in achieving results?

Four main factors impeded WFP’s ability to achieve results:

  • heavily earmarked and short-term funding constrained the intended shift to an enabling role under CSPs and limited WFP’s ability to deliver food and nutrition security solutions for all those in need
  • a fragmented or “siloed” approach to CSP design and implementation, for example in social protection, reduced the transformative potential of CSPs
  • gaps in monitoring capacity and/or coverage such as inadequate monitoring frameworks and systems, a lack of baselines and data gaps due to reliance on external sources 
  • limited use of available evidence and weak knowledge management systems to inform CSP design and activities, such as limited gender analyses

Evaluations recommend

  • building a clear programme logic and theory of change into each new CSP, including linkages across the humanitarian–development–peace nexus
  • adopting integrated staffing and organizational structures within country offices and sub-offices, in alignment with CSP needs
  • fostering and adequately resourcing innovation, including knowledge-sharing on models and approaches to innovation
  • investing in monitoring for learning and accountability, expanding the use of digital systems where feasible
  • making maximum use of evidence products to inform planning and implementation
  • prioritizing knowledge management within and across programme areas

DID TARGETING AND PRIORITIZATION
ENABLE WFP TO MEET BENEFICIARIES’ NEEDS?

3

Part 2: Performance

WFP assesses the performance of the evaluation function through indicators covering the five outcome areas of the evaluation policy.

Highlights are here presented.

OUTCOME 1

Evaluations are independent,
credible and useful

Of the 42 WFP-led evaluations conducted in 2023, one third were rated “highly satisfactory” and two-thirds “satisfactory”. It was the first year that 100 percent of both centralized and decentralized evaluations met satisfaction requirements.

Post-hoc quality assessment of evaluation reports completed, 2020–2023

Highly satisfactory

Satisfactory

Partly satisfactory

Unsatisfactory

OUTCOME 2

Evaluation coverage is balanced and relevant and serves both accountability and learning purposes

70 percent of all evaluations originally planned for 2023 were contracted.

Policy evaluations
By the end of 2023, 77 percent of active WFP policies had been or were being evaluated.

Strategic evaluations
While there was no completed strategic evaluation in 2023, 3 strategic evaluations were underway.

CSP evaluations
93 percent of country strategic plans (CSPs) or interim country strategic plans (ICSPs) due for evaluation were evaluated.

Corporate emergency evaluations
80 percent of corporate emergency responses due for evaluation in 2023 were evaluated, rising from 40 percent the previous year.

Evaluation syntheses
An evaluation synthesis drawing evidence from centralized and decentralized evaluations on WFP’s role in the management of, and strategic engagement with, cooperating partners was launched in 2023.

Joint evaluation initiatives and system wide evaluations
In 2023, OEV contributed to two global joint evaluations: on social protection, managed by the Joint United Nations Programme on HIV and AIDS (UNAIDS); WFP; the International Labour Organization (ILO) and UNICEF; and the system-wide strategic joint evaluation of the collective international development and humanitarian assistance response to COVID-19 led by the COVID-19 Global Evaluation Coalition of the Development Assistance Committee of the Organisation for Economic Co-operation and Development (OECD-DAC). Both will be finalized in 2024.

Decentralized evaluations
Of the 18 country offices ending an ICSP or CSP cycle in 2023, 83 percent had commissioned at least one decentralized evaluation during their planning cycle.

Completed decentralized evaluations by region/headquarters and year of completion, 2022-2023

Total 2022-2023

2022

2023

Abbreviations: HQ = headquarters; RBB = Regional Bureau for Asia and the Pacific; RBC = Regional Bureau for the Middle East, Northern Africa and Eastern Europe; RBD = Regional Bureau for Western Africa; RBJ = Regional Bureau for Southern Africa; RBN = Regional Bureau for Eastern Africa; RBP = Regional Bureau for Latin America and the Caribbean

Impact evaluations
While impact evaluations are not subject to coverage norms and cover anything from 1 to 3-4 years of activities, the first impact evaluation from the cash-based transfer and gender window, in El Salvador, was finalised and published in 2023. WFP Evaluation also met its indicative target of starting six new impact evaluations.

OUTCOME 3

Evaluation evidence is systematically available and accessible to meet the needs of WFP and partners

Compared with the previous year, there was a 31.2 percent increase in unique downloads of evaluation products from the WFP website.

Evaluation products accessed (Percentage increase/decrease of unique downloads of evaluation products from previous year)

9 summaries of evaluation evidence were produced across thematic and geographic lines, continuing an upward trend, while 95 percent of WFP draft policies and CSPs developed in 2023 included explicit reference to evaluation evidence. 

WFP draft policies and draft CSPs that refer explicitly to evaluation evidence

Almost two-thirds of evaluation recommendations due in 2023 were implemented on time, slightly lower from centralized evaluations (57 percent) compared with those from decentralized evaluations (69 percent).

Implementation status of evaluation recommendations
due in 2023 (as of 3 April 2024)

OUTCOME 4

WFP has enhanced capacity to commission, manage and use evaluations

For all evaluations completed in 2023, 296 independent evaluator consultants were hired, of whom 43 percent were men and 57 percent were women.

On geographical diversity, the proportion of consultants from developing countries was higher for decentralized evaluations (51 percent) than for centralized evaluations (38 percent).

Composition of evaluation teams by United Nations regional group of Member States, 2023

African States

Latin America and Caribbean States

Asia-Pacific States

Western Europe and other States

Eastern Europe States

OUTCOME 5

Partnerships contribute to a strengthened environment for evaluation at the global, regional and national levels and to United Nations coherence

WFP continued to work on a wide range of initiatives on evaluation capacity development, at global, regional and country level.  A significant milestone was the adoption of the United Nations General Assembly Resolution on strengthening Voluntary National Reviews through country-led evaluation. Through the resolution, Member States are encouraged to use evidence from evaluations for decision-making and for reporting on their progress towards achieving the 2030 Agenda.

The System-Wide Evaluation Office was established with the objective of strengthening the oversight, transparency, accountability and collective learning across the UN Sustainable Development Group. WFP Evaluation pledged support for the revision and finalization of the UN system-wide evaluation policy and continued to engage in supporting UNSDCF initiatives at country level.

Cross-cutting
Workstreams

FINANCIAL RESOURCES

In 2023, the overall financial resources available for the evaluation function amounted to US$34.30 million, representing 0.41 percent of total contribution income (US$8.3 billion). The actual expenditure on evaluation in 2023 was US$27.62 million, 0.33 percent of WFP total contribution income.

Expenditure on evaluation as a percentage of WFP total contribution income

Programme funds from country portfolio budgets (totalling US$2.25 million) were made available to OEV for CSP evaluations. US$1.99 million was received through the multi-donor trust fund for impact evaluations, adding to a balance on the fund from previous contributions at the start of the year of US$1.54 million. In addition, US$1.48 million was allocated from country portfolio budgets and US$1 million was received in the School Based Programmes Trust Fund as a multi-year contribution for impact evaluation (2023-2025).

US$8.14 million was budgeted for the decentralized evaluation function in 2023.

The contingency evaluation fund provided essential support to two countries for conducting country strategic plan evaluations and ten countries and one regional bureau for conducting decentralized evaluations.

HUMAN RESOURCES

The share of employees from developing countries rose to 25 percent in OEV at headquarters and 62 percent in WFP regional bureaux. In terms of gender diversity, women make up 67 percent of the evaluation function workforce in OEV at headquarters and 76 percent in the regional bureaux.

Composition of OEV and the regional evaluation units by United Nations regional group of Member States, 2023

African States

Latin America and Caribbean States

Asia-Pacific States

Western Europe and other States

Eastern Europe States

Institutional arrangements and managements

The compliance rate in the Executive Director’s annual assurance statements regarding evaluation rose to 97%

Compliance rate in the Executive Director’s annual assurance statement regarding evaluation

AVAILABLE RESOURCES in 2022:

34.39 million

2023 © World Food Programme