Evaluation type: Final external
Evaluator: Dr. C. Inayatullah, Team Leader
Commissioned by: Concern Worldwide [CWW]
Donor: USAID/BHA
PROJECT SUMMARY
The “Building Institutional and Community Resilience” [BICR] was developed by Concern Worldwide based on its learnings from the USAID/BHA funded project “Sindh Drought Resilience Program” [SDRP], FCDO funded project “Community-Based Disaster Risk Management- Phase II” and several Start Network funded projects on capacity building drought and flood resilience. The project duration was for 18 months [June 2022 to November 2024], and the budget outlay was USD one million.
The project purpose was “to build institutional capacities [of government and national NGOs in KP and GB] and resilience of highly vulnerable communities in Sindh to recurring hazards through improved preparedness and response capacities”. In response to the identified needs, the project proposed a two-pronged strategy focusing on both community and institutions for better coherence of interventions, optimization of impact and greater sustainability. The project had the following two main sub-purposes:
1. Sub-Purpose 1: Institutional Capacity Building – To enhance institutional and disaster response capacity of government officials, disaster management authorities [DMAs] and local NGOs in GB, tribal and other vulnerable districts in KP.
2. Sub-Purpose-2: Community Resilience Building – To build the resilience of drought affected communities and structures in Sindh through Community Based Disaster Risk Management [CBDRM]. This component was implemented in two drought-stricken districts, viz., Tharparkar and Umerkot through CWW’s partners [Sukaar Foundation in Tharparkar, and Sami Foundation in Umerkot].
Evaluation criteria: relevance, efficiency, effectiveness, coherence, cross-cutting issues, impact and sustainability.
Evaluation methodology: document analysis, household survey, online survey of participating NGOs, KIIs, and FGDs
KEY FINDINGS AND CONCLUSIONS
Besides evaluation relevance, efficiency, effectiveness, sustainability an impact, the evaluation conducted an in-depth tracer study to document the increase in income of the males and females who had received tailoring/ embroidery training in SDRP and BICR. It was found that the average monthly income of tailors of SDRP [operationalized in 2021] in Umerkot was the highest [PRs. 17,333], followed by female tailors of SDRP in the same district [PRs. 10,778]. One transgender of BICR beneficiaries in Umerkot, reported monthly income of Rs. 7,000. The average monthly income of male tailors of BICR [training and tool kits provided in September 2023] in Umerkot was PRs. 4,391, whereas it was PRs. 5,845 for female tailors. This indicates that the persons trained by BICR will be able to establish their business over time.
The beneficiaries reported that this income is sufficient to meet their monthly expenses. It was further found that the earned income was spent on children education, health, groceries, house maintenance, purchase of livestock and livestock care. Some 67% female respondents reported that they save money, compared with 33% males, and their priority is to spend on children education. The increase in cash flow/income of households is a major impact towards their sustenance and resilience. Tailoring and traditional embroidery [caps, bedsheets, pillow covers, wedding dresses, wall hangings, etc.] is a big business in Sindh and the finished goods are sold in markets of big cities as well as overseas. The impact of other livelihood interventions is yet to be seen; it is too early to conclude anything but though it appears a small thing like motorbike repair/tyre puncture training, a community notable informed that previously if one’s motorcycle breaks down or tyre is punctured then they have to carry it on a donkey cart at nearby city or shop which was a cumbersome process.
Regarding resilience to disasters, the evaluation found that 84% respondents in Tharparkar and 99% in Umerkot now believe that the disaster risk could be reduced by taking early actions. They further reported [47% respondents in Tharparkar and 75% in Umerkot] that early preparations at the family and community levels could reduce disasters.
Overall, it was found that cumulatively 71% of the respondents of Tharparkar and 70% of Umerkot follow WASH practices to an acceptable level after WASH training. Water availability is an issue in both the districts, and in general women, men, girls, and boys are seen running all around to fetch water, either on foot, on donkeys, donkey/camel carts in drums or tyre-tubes of trucks. This is a major household chore that keeps the people away from education, cleanliness, and productive livelihood activities.
In a short period of time, the program has produced impressive results, and it successfully reached 66,119 beneficiaries [men/boys 30,647, women/girls 35,472], and 20,824 animals. Therefore, rating 5 [Outstanding Performance] was assigned to the project.
CROSS CUTTING ISSUES
The project provided support to the households in Tharparkar and Umarkot districts, and the approach was inclusive. Nearly 40% of the beneficiaries were women and girls. Skill trainings and tool kits were provided to the disabled persons, and special attention was given to the most vulnerable households [having elderly, disabled, orphans and widows]. The capacity building component of NGOs is likely to improve their delivery in humanitarian aid.
GOOD PRACTICES
The project attempted to improve the systems and procedures of the 28 NGOs in efficient and effective humanitarian aid delivery, while providing skills, knowledge and tools at the household level to better manage the disasters.
LESSONS LEARNED
The DRM structures established at the village, Union Council, Sub-district and District levels need continuous support for their viability.
KEY RECOMMENDATIONS
- GBDMA and CWW should explore possibilities of refresher courses in DRM for the Disaster Management Authorities DMAs of GB and extend it to AJK as well.
- CWW should work with the service provider to remove the bugs in MIS.
- The geographical and sectoral coverage should be commensurate with the financial resources and project duration for having an effective implementation and impact.
- Conduct a tracer study for the trainees of motorbike repairing, solar system installation/ repair, etc., to document impact of interventions.
- Develop linkages between the research and extension institutions and line departments. Besides Arid Zone Research Institute, Umarkot, the IPs must interact with the Arid Zone Research Centre, Quetta, and Bakhar [Punjab] to obtain seeds of drought resistant crop and fodder species for replication in Thar. Likewise, they should develop linkages with the neighboring institutions in Rajasthan [India] and other countries having similar ecosystem.
- Launch aggressive advocacy for tree plantation in premises of public institutions.
- Promote digital resilience for effective disaster management.