The project titled “Improved access to health services and services to prevent and address gender-based violence, as well as emergency assistance for refugees and vulnerable people from communities in Cox’s Bazar, Bangladesh” aimed to address the urgent needs of both host and Rohingya refugee communities. This intervention, funded by the German Federal Foreign Office (GFFO) and implemented by the International Rescue Committee (IRC) in collaboration with local partners, focused on enhancing health outcomes and protection measures.
The initiative targeted critical areas, including Sexual and Reproductive Health (SRH), Gender-Based Violence (GBV), and child protection. It utilized multiple components to ensure comprehensive service delivery. Key interventions included the establishment of referral hubs for emergency transportation, Women and Girls Safe Spaces (WGSS) for GBV response, and adolescent development programs. These programs aimed to mitigate risks, empower women and girls, and address broader health and protection challenges in the Cox’s Bazar region, particularly in Teknaf, Ukhiya, and Chakaria Upazilas.
A mixed-method endline evaluation conducted by DM WATCH LIMITED assessed the relevance, effectiveness, efficiency, impact, and sustainability of these interventions. The study provided critical insights into program outcomes, community acceptance, and lessons for future programming.
Specific objectives of the assignment included:
- To establish to what extent the GFFO funded “Improved access to health services and services to prevent and address gender-based violence, as well as emergency assistance for refugees and vulnerable people from communities in Cox’s Bazar Bangladesh” project has delivered effective, efficient, and timely activities to beneficiaries as set in the project log frame.
- To assess the relevance of project activities under each sector including Health, Women’s Protection and Empowerment (WPE), and WASH.
- To establish to what extent cross-cutting issues such as gender age and disability inclusion have been addressed.
- To document challenges, key lessons learned, and best practices.
- To determine different stakeholders’ satisfaction with the program and its interventions.
Key Highlights of the Assignment
DM WATCH LIMITED executed the following tasks as part of the endline evaluation:
1.Planning and Preparation:
-
- Conducted initial discussions with IRC to define the scope and objectives of the evaluation.
- Conducted a comprehensive desk review to inform evaluation design.
- Developed and finalized an inception report detailing the evaluation methodology, tools, and work plan, incorporating feedback from IRC.
2. Design and Development:
-
- Prepared data collection tools, including structured surveys, Key Informant Interview (KII) guides, Focus Group Discussion (FGD) protocols, and In-Depth Interview (IDI) checklists.
- Organized a validation workshop to refine the study design and methodologies.
- Finalized tools following field testing and stakeholder feedback.
3. Field Implementation:
-
- Trained enumerators on digital and qualitative data collection methods.
- Conducted quantitative surveys with 240 households in host communities and 160 in Rohingya camps.
- Facilitated 15 KIIs, 12 FGDs, and 12 IDIs with key stakeholders, including project beneficiaries and service providers.
- Ensured rigorous field supervision, cross-validation, and quality control during data collection.
4. Data Management and Analysis:
-
- Undertook data cleaning, coding, and transcription for both qualitative and quantitative datasets.
- Applied robust analytical methods, including descriptive and inferential statistics for quantitative data, and thematic coding for qualitative insights.
- Conducted specialized analyses such as gender, bottleneck, and GEDI (Gender Equality, Diversity, and Inclusion) frameworks to evaluate project impacts.
5. Reporting and Dissemination:
-
- Prepared a draft evaluation report detailing findings against the OECD-DAC criteria of relevance, effectiveness, efficiency, impact, and sustainability.
- Facilitated a result validation workshop with IRC and stakeholders to refine insights.
- Finalized the evaluation report incorporating feedback from IRC and other stakeholders.
- Prepared a visually engaging summary report with infographics and key highlights.
- Developed slide decks for presenting findings at a national dissemination workshop.
6. Ethical Considerations and Risk Mitigation:
-
- Adhered to ethical guidelines, ensuring informed consent and confidentiality for all respondents.
- Implemented COVID-19 protocols during data collection to safeguard both participants and field teams.
- Addressed language barriers and cultural sensitivities within the FDMN (Forcibly Displaced Myanmar Nationals) community.
- Collected authorization letter from Office of the Refugee Relief and Repatriation Commissioner (RRRC) to conduct the study in the Rohingya camps.