Project Summary
In May 2015, the United States Agency for International Development (USAID) awarded a five-year contract to Management Systems International (MSI) to provide performance management support to USAID-sponsored development programs throughout Pakistan. The Performance Management Support Contract (PERFORM) will serve as a centralized management support mechanism supporting USAID/Pakistan’s mission to increase stability, democracy, and prosperity for the men and women of Pakistan through the implementation of the Mission Strategic Framework (MSF). PERFORM will provide data and information to help project managers improve project results through better implementation and design, as well as services that support the Mission’s learning and adaptive process, enabling it to better target its programming and achieve its goals and objectives. The performance components will include: (1) Monitoring Services; (2) Evaluation Services; (3) Assessment Services; and (4) Learning Support Services.
Position Summary
MSI will conduct a midterm evaluation of two USAID youth workforce development projects being implemented in Karachi. The evaluation will assess the extent to which the projects are effectively targeting localities and individuals that are consistent with project objectives and the effect the projects have had on beneficiaries’ economic opportunities and status. Additionally the evaluation will assess the effect of the projects on levels of crime and violence, and perceptions of insecurity in the neighborhoods and town from which the projects select beneficiaries.
MSI is seeking a Researcher to collect, document and analyze primary and secondary qualitative data for the evaluation. The Researcher should have extensive experience of conducting in depth interviews and focus group discussions.
The Researcher will provide input on the design of data collection instruments during the team planning workshop. S/he will work with the evaluation team to collect and collate secondary qualitative data. S/he will process secondary data to be able to use it in conjunction with primary data collected.
S/he will take part in primary data collection activities, and will be required to pilot data collection instruments and suggest modifications to refine the instruments for fieldwork. S/he will be heavily involved in training and monitoring subcontractor staff in order to obtain quality data. S/he will assess quality of data, and flag inconsistencies for review by the subcontractor. S/he will write a data analysis report which will be incorporated into the final evaluation report.
The evaluation will use a mixed methods approach, leveraging primary and secondary data to answer the evaluation questions. Qualitative data will be collected through semi structured interviews of key stakeholders. We expect to conduct at least 150 in depth interviews, the vast majority of these will be conducted across various neighborhoods in Karachi. The evaluation team will use MaxQDA for coding and analysis of qualitative data. A non-equivalent groups design is expected to be used for assessing project outcomes quantitatively. We envisage conducting a stratified random sample survey of about 2000 individuals. The evaluation team will use STATA or SPSS to collate and analyze survey data.
The position requires about 58 days of effort, approximately 25 of which will be based in Islamabad. The remainder will be spent conducting fieldwork in Karachi. The Researcher will work within a six person evaluation team composed of subject-matter experts, a statistician and data analysts. S/he will report to the Team Leader.
Responsibilities
- Developing and piloting data collection instruments.
- Developing a data collection and analysis plan.
- Participating fully in a data rehearsal with USAID staff prior to field work.
- Guiding the fieldwork and putting in place necessary mechanisms for data quality assurance.
- Conduct semi-structured in-depth interviews in Karachi and prepare detailed notes and/or transcripts in English.
- Fully participate in qualitative data processing and analysis.
- Presenting results to USAID and implementing partners.
- Writing reports and briefing papers.
- Any other task related to the assignment and the position.
Qualifications
- At least a Master’s degree in a relevant field and 7 years of professional experience.
- Demonstrated experience evaluating projects with a quantitative focus.
- In depth knowledge of qualitative data analysis. Prior experience of using qualitative data analysis software such as MaxQDA or NVivo etc. is preferred.
- An in-depth understanding and prior experience of issues related to youth development, technical and vocational skills development, or peace and tolerance focused interventions will be preferred.
- Familiarity with USAID programming and evaluation requirements.
- Excellent analytical and personal communication skills.
- Excellent English writing skills.
- Experience working in complex and conflict-affected environments.
Only candidates who have been selected for an interview will be contacted. No phone calls, please.
MSI is an EEO/AA/ADA Veterans Employer.
“Position will be filled on a rolling basis”