Assignment Name: Endline Evaluation for the Communication Component (Output-4) of the Sustainability in the Textile and Leather Sector (STILE) Project

Country: Bangladesh

Client Name: Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ)

The Sustainability in the Textile and Leather Sector (STILE) program, implemented by German Corporation for International Cooperation (GIZ) on behalf of The Federal Ministry for Economic Cooperation and Development (BMZ), aimed to enhance stakeholders’ capacity to ensure compliance with social and environmental standards in Bangladesh’s textile, garment, and leather industry. Output 4, the STILE-Communication component, focused on empowering workers to advocate for these standards actively. The project was implemented from April 2021 to December 2023. The endline study evaluated the project’s impact on achieving project indicator 4 and output indicator 4.1. The evaluation was conducted from November 2023 to January 2024, covering both Dhaka and Chattogram zones where the project interventions were carried out.

The end-line evaluation followed OECD-DAC criteria, covering Relevance, Coherence, Effectiveness, Efficiency, Impact, and Sustainability. Employing a consultative, participatory, and adaptable approach, it integrated qualitative and quantitative techniques. Quantitative surveys targeted women café-based and factory training recipients, and factory focal persons. Qualitative methods included Key Informant Interviews, Focus Group Discussions, and case studies. Meticulous sample selection ensured representation across sectors, regions, and genders, facilitating a comprehensive assessment of the program’s impact and effectiveness.

Overall, the assignment concluded how the STILE-Communication project represented a significant step towards empowering workers in the textile and leather industries and contributed valuable knowledge and lessons to the field.

DM WATCH LIMITED carried out a structured evaluation comprising qualitative and quantitative research, ensuring a holistic assessment of the communication component of the STILE project. The specific services provided included:

Inception and Planning:

• Conducted a detailed review of project documents, including the M&E framework, operational plans, and midline evaluation results.
• Developed and submitted an inception report detailing the methodology, sampling strategy, and evaluation framework, aligning it with the OECD-DAC evaluation criteria.
• Finalized evaluation tools, including surveys, KIIs, FGDs, and case study templates, through iterative consultations and pilot testing.

Data Collection:

• Implemented a mixed-methods approach, collecting data through:
• 796 quantitative surveys with workers and factory representatives using CAPI (Computer-Assisted Personal Interviewing) via KoboToolbox.
• 35 KIIs with key stakeholders, including representatives from BGMEA, BKMEA, LFMEAB, and Women Café managers.
• 12 FGDs to capture insights on behavioral changes and advocacy impacts.
• 10 case studies focusing on conflict resolution and gender-focused outcomes.
• Collected GPS-coordinated data for transparency and spatial analysis.

Data Management and Quality Assurance:

• Established rigorous quality control mechanisms, including spot checks, daily reviews, and logical data validation.
• Cleaned and coded data for quantitative analysis using SPSS and Excel and qualitative analysis using content and thematic coding.

Analysis and Reporting:

• Conducted comprehensive data analysis using descriptive statistics, inferential methods (e.g., proportion z-tests), and triangulation to align qualitative and quantitative findings.
• Drafted a detailed end-line report, incorporating key findings, recommendations, and lessons learned, and aligned with OECD-DAC criteria.
• Created a set of deliverables, including:
• A comprehensive report with executive summaries and infographics.
• Data transcripts and cleaned datasets for project use.
• Slide decks for dissemination workshops.

Stakeholder Engagement:

• Facilitated a validation workshop to present findings and gather feedback from stakeholders.
• Incorporated feedback to refine the final report, ensuring actionable recommendations.

Knowledge Dissemination:

• Designed and delivered a strategic communication plan, presenting evaluation findings through workshops, infographics, and executive summaries.

This rigorous evaluation not only assessed the outcomes of the STILE project but also provided strategic insights for enhancing the sustainability and inclusivity of communication and advocacy initiatives in Bangladesh’s textile and leather sectors.