ILO

Back to index

South East Asia regional programme for labour migration in the fishing sector - Midterm evaluation

eval_number:

3297

eval_url:

https://webapps.ilo.org/ievaldiscovery/eval/3297

location:

country:

Asia and the Pacific - regional

region:

Asia and the Pacific

---

eval_title:

South East Asia regional programme for labour migration in the fishing sector - Midterm evaluation

recommendations:

date:

2023-07-09 00:00:00.0

themes:

theme:

Organizational issues

category:

Monitoring and evaluation

---

action_plan:

It should be noted that it is extremely difficult to directly assess the impact of MRC services through quantitative surveys. A practical challenge is that MRC beneficiaries are simply unavailable for interviews in countries of origin if they decide to migrate. Moreover, as they are migrating under temporary migration schemes, migrants typically do not remain for a long period of time in the same location within destination countries – making them difficult to reach for surveys. The broader conceptual problem is that the MRC services are not one specific standardized form of intervention with an outcome that can be clearly anticipated, which makes measurement through a quantitative survey very challenging. Lesson learned from nearly a decade of M&E support for MRCs have clearly indicated that qualitative “outcome harvesting” is a more strategic way to measure the MRC results because they better capture the complexity of migration experiences and avoid the logistical challenges of trying to trace a large sample of migrant beneficiaries. Outcome harvesting is currently required of all MRC partners. In addition, the Ship to Shore Rights SEA programme has plans to include control sites in the end-line survey to support a difference-in-difference analysis. This will provide the programme with a credible way of measuring causality for the affected intervention areas, a portion of whom will be direct beneficiaries and a portion of whom will have indirectly benefitted from the circulation of improved information about safe migration within their communities.

management_response:

Partially Completed

progress:

Partially achieved

admin_units:

RO-Asia and the Pacific

title:

11. Work to ensure the endline survey can measure the impact of the programme on migrant and country of origin workers who utilised the programme’s services by ensuring they are included in the endline sample. If the endline follows the same methodology as the baseline, it will survey a sample of migrants who have returned, but not specifically capture migrants who used the programmes’ services. While this approach would be relevant for longitudinal study over several phases, the length of time of this phase will probably mean many of the workers in the survey migrated before the programme began its services or did not receive any information or orientation. This issue could be addressed by having a control group of general population migrants and a comparison group of migrants drawn randomly from the MRC’s beneficiary cards. Expanding the volume of outcome harvesting stories or collection stories of most significant change from the users of the MRCs, could also contribute to this.

project_symbols:

RAS/20/01/EUR

url:

https://webapps.ilo.org/ievaldiscovery/recommendations/16799

information_source:

Regional Office

---