Assignment Name: Endline Evaluation of “Children and Youth initiative towards Better Life in Slum (CYIBL)”

Country: Bangladesh

Client Name: Social and Economic Enhancement Program (SEEP)

DM WATCH was engaged in the end-line evaluation of the “Children and Youth Initiative Towards Better Life in Slum (CYIBL)” project implemented by Plan International Bangladesh and its partner, the Social and Economic Enhancement Programme (SEEP). The project, funded by Plan International, aimed to address three major issues in the Dhaka match colony in Shyampur, Dhaka: identifying local problems, improving conditions through local authority engagement, and building the capacity of children and youths for advocacy to foster a disaster-resilient community. The project adopted a child-centered approach, integrating youth in decision-making processes and equipping them with the tools to act as change agents in their communities.

The endline evaluation focused on assessing the impact of various interventions on improving disaster resilience and waste management practices within the community. It aimed to document changes in the lives of the slum dwellers, achievements relative to the project’s log frame, constraints encountered, lessons learned, and to provide recommendations for enhancing sustainability and effectiveness.

Objectives of the study included:

• To document the changes that occurred in the lives of the dwellers of Dhaka Match Colony through project interventions.
• To document the achievements and strategies adopted against the approved log frame and set indicators of the project.
• To document the constraints and lessons generated from project interventions.
• To analyze and document the added value of the project, highlighting any unintended outcomes that have been beneficial so far.
• To provide an opinion on the extent to which the results of the project are sustainable and offer recommendations, if appropriate, on how sustainability can be improved.
• To identify institutional capacities and gaps in minimizing urban disaster risks, particularly those related to earthquakes and fires

The endline evaluation applied five evaluation criteria, namely Relevance, Effectiveness, Efficiency/Value for Money, Impact, and Sustainability to evaluate the objectives of the project. It focused on three major components:

• Assessing the project’s contribution to building disaster-resilient communities.
• Documenting progress in youth and children’s capacity to advocate for safer and healthier living environments.
• Identifying lessons learned, sustainability measures, and gaps to inform future programming.

The evaluation provided a comprehensive analysis of project interventions, their relevance, effectiveness, impact, and sustainability, ensuring alignment with national disaster risk reduction frameworks and global urban resilience objectives.

DM WATCH study team conducted the following activities:

Inception and Planning:

• Conducted inception meetings with Plan International and SEEP to finalize the evaluation objectives, methodologies, and deliverables.
• Reviewed the project log frame, midline evaluation reports, and other relevant documents to design a robust evaluation framework.

Survey Design and Tool Development:

• Developed qualitative and quantitative tools, including structured questionnaires, Focus Group Discussion (FGD) guides, and Key Informant Interview (KII) protocols.
• Piloted the tools to ensure reliability, validity, and contextual appropriateness.

Capacity Building and Training:

• Trained enumerators and field supervisors on data collection protocols, ethical considerations, and the use of digital tools for efficient data gathering.
• Conducted mock interviews and simulations to ensure data collectors were well-prepared for fieldwork.

Data Collection:

• Conducted FGDs with youth, children, and slum community members to understand their experiences with the CYIBL project interventions.
• Carried out KIIs with project stakeholders, including local government officials, disaster management committees, and SEEP representatives.
• Administered household surveys to capture quantitative data on socio-economic and environmental changes resulting from the project.

Participatory Rural Appraisal (PRA):

• Engaged community members in PRA sessions to map hazards, assess vulnerabilities, and evaluate the effectiveness of disaster mitigation measures.

Data Analysis and Reporting:

• Analyzed quantitative data using statistical software to calculate outcome indicators such as the proportion of community members trained in disaster preparedness.
• Conducted thematic analysis of qualitative data to derive insights into project effectiveness, community engagement, and capacity-building outcomes.
• Prepared GIS maps highlighting areas of significant project impact and locations requiring further intervention.

Validation and Stakeholder Engagement:

• Presented preliminary findings to Plan International, SEEP, and community stakeholders for validation and feedback.
• Facilitated a workshop to discuss lessons learned, identify best practices, and ensure alignment with future urban resilience initiatives.

Final Report and Recommendations:

• Delivered a detailed endline evaluation report, including a comprehensive assessment of project achievements against the log frame, an analysis of unintended outcomes and challenges encountered during implementation, and evidence-based recommendations for improving future urban resilience projects, focusing on sustainability, youth engagement, and disaster risk reduction.
• Delivered a summary report (5-page) in English and Bangla
• Delivered a slide-deck based on the final endline report

This endline evaluation provided valuable insights into the CYIBL project’s success in empowering slum communities and building urban resilience. The findings and recommendations will guide future programming and policy development for disaster-prone urban areas in Bangladesh.