Assignment Name: Endline Evaluation of ‘Strengthening Resilience Through Child-Centered Programming: An Integrated Approach to Protecting Displaced Rohingya Children and Families and Surrounding Host Communities in Cox’s Bazar District, Bangladesh’

Country: Bangladesh

Client Name: Save the Children

The project, “Strengthening resilience through child-centred programming: an integrated approach to protecting displaced Rohingya children and families and surrounding host communities in Cox’s Bazar District, Bangladesh,” was implemented by Save the Children with funding from the Swedish International Development Cooperation Agency (Sida). The project ran from December 1, 2018, to January 31, 2021, and targeted Rohingya refugee children and families as well as host communities in Ukhiya and Teknaf, areas severely affected by the Rohingya refugee crisis.

The primary goal of the project was to protect children affected by the Rohingya Refugee crisis from abuse, neglect, exploitation, and other forms of violence. To achieve this, the project utilized an integrated multi-sector approach that focused on Child Protection (CP), Mental Health and Psychosocial Support (MHPSS), Food Security and Livelihoods (FSL), and Water, Sanitation, and Hygiene (WASH). The interventions were designed to address both immediate humanitarian needs and the longer-term resilience of children and families by strengthening protective factors and reducing risk factors across the individual, household, community, and systemic levels. The project targeted approximately 64,548 children and 34,701 adults across both the Rohingya refugee camps and the surrounding host communities.

In the Child Protection area, the project aimed to improve safety and reduce risks of abuse, neglect, and exploitation. It provided support through case management, family tracing, and reunification, as well as support for survivors of gender-based violence (GBV). MHPSS interventions helped address the psychological distress faced by children and families, while FSL activities aimed at enhancing food security and providing livelihoods through vocational training and self-reliance programs. The WASH component focused on improving access to clean water and proper sanitation facilities, with a strong emphasis on hygiene promotion.

As part of the project, DM WATCH conducted the Endline Evaluation Study to assess the impact and effectiveness of the interventions implemented over the two years and two months of the project. The purpose of this evaluation was to analyze the project’s performance against its objectives, specifically in terms of relevance, effectiveness, efficiency, sustainability, coverage, and coordination, in line with the OECD/DAC evaluation criteria.

The assignment aimed to evaluate whether the project successfully contributed to the following key results:

• Reduction of risk factors and increase in protective factors at the individual, household, community, and systems levels.
• Improvement in the safety and well-being of children, including reduced exposure to violence, exploitation, and neglect.
• Effectiveness of multi-sector interventions, including child protection, mental health support, food security, and access to clean water and sanitation.
• Long-term sustainability of the project’s outcomes, particularly focusing on the local capacity to continue child protection and community resilience efforts.

The specific objectives included:

• To assess whether risk factors decreased and protective factors increased at the individual, household, community, and systems levels.
• To evaluate the setup and evolution of the project, its components, and effects on the expected results.
• To assess the value added by the multi-sectoral approach of the project for the supported children.
• To determine to what extent children affected by the Rohingya refugee crisis (both Rohingya and host communities) were protected from abuse, neglect, exploitation, and other forms of violence in accordance with the Minimum Standards for Child Protection in Humanitarian Action and the Sphere Standards.
• To assess the project’s contribution to longer-term results and sustainability.
• To evaluate the adequacy of the project’s monitoring, accountability, and quality functions, including Monitoring, Evaluation, and Learning (MEAL), quality assurance, and feedback mechanisms, in accordance with the Core Humanitarian Standard on Quality and Accountability (CHS).
• To present lessons and operational recommendations that would aid future programming and management decisions in the child protection, FSL, and WASH sectors

The study team conducted the Endline Evaluation Study for the project, “Strengthening resilience through child-centred programming: an integrated approach to protecting displaced Rohingya children and families and surrounding host communities in Cox’s Bazar District, Bangladesh.” The services we provided during the evaluation phase were focused on assessing the outcomes and effectiveness of the interventions, as well as ensuring the final evaluation report and its findings were appropriately disseminated.

Planning and Consultation:

• Engaged in briefing meetings with key stakeholders, including Save the Children staff and the donor, Sida, to finalize the evaluation approach, methodology, and scope.
• Consulted with project teams (including Child Protection, FSL, WASH, and MHPSS teams) to ensure the evaluation objectives aligned with the goals of the project.
• Worked closely with local partners and government representatives to understand the context and ensure alignment with the project’s objectives.

Desk Review and Inception Report:

• Conducted comprehensive desk review of project documents and data.
• Developed a comprehensive methodology that integrated the diverse needs of children and families within the refugee camps and host communities.

Data Collection and Fieldwork:

• Designed and pre-tested data collection tools, such as quantitative surveys, interview guides, and checklists for Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs).
• Conducted quantitative data collection using stratified random sampling, interviewing 724 beneficiaries, including both Rohingya refugees and host community members, to assess the impact on child protection, food security, livelihoods, and hygiene practices.
• Facilitated qualitative data collection, including 6 FGDs, 23 KIIs, 2 in-depth interviews (IDIs), and 40 observations. These activities provided in-depth insights into the community’s experiences with the project and its effectiveness.

Data Analysis:

• Collected, processed, and analyzed both quantitative and qualitative data to assess the relevance, effectiveness, efficiency, sustainability, and coverage of the project’s interventions.
• Triangulated data from different sources (surveys, FGDs, KIIs) to cross-verify findings and ensure a comprehensive understanding of the project’s impact.
• Applied relevant statistical and thematic analysis techniques to evaluate the changes in risk and protective factors at individual, household, community, and systems levels.

Reporting and Recommendations:

• Compiled the endline evaluation findings into a detailed evaluation report, which was designed in InDesign for a professional presentation. The report included clear sections on methodology, findings, lessons learned, and recommendations for future programming.
• Developed slide decks to present the key findings and recommendations in a concise and visually engaging format for stakeholders and partners.
• Organized a consultation workshop where the findings were presented to key stakeholders, including Save the Children, Sida, government representatives, and local partners. This workshop also served as a platform to validate findings and refine recommendations based on stakeholder feedback.

Dissemination of Findings:

• Presented the evaluation results through the consultation workshop, engaging stakeholders in discussions about the project’s achievements, challenges, and recommendations.
• Provided stakeholders with the final evaluation report, slide decks, and other related documents to ensure that the findings were accessible and actionable.
• Shared the report and findings with relevant project teams, donor agencies, and government officials to inform future programming and policy decisions.

Through this evaluation, our team was able to assess the overall success of the project in improving the safety and well-being of children and families affected by the Rohingya crisis, providing key insights and actionable recommendations for ongoing and future interventions.