Project Summary
In May 2015, the United States Agency for International Development (USAID) awarded a five-year contract to Management Systems International (MSI) to provide performance management support to USAID-sponsored development programs throughout Pakistan. The Performance Management Support Contract (PERFORM) will serve as a centralized management support mechanism supporting USAID/Pakistan’s mission to increase stability, democracy, and prosperity for the men and women of Pakistan through the implementation of the Mission Strategic Framework (MSF). PERFORM will provide data and information to help project managers improve project results through better implementation and design, as well as services that support the Mission’s learning and adaptive process, enabling it to better target its programming and achieve its goals and objectives. The performance components will include: (1) Monitoring Services; (2) Evaluation Services; (3) Assessment Services; and (4) Learning Support Services.
Position Summary
MSI will conduct a midterm evaluation of two USAID youth workforce development projects being implemented in Karachi. The evaluation will assess the extent to which the projects are effectively targeting localities and individuals that are consistent with project objectives and the effect the projects have had on beneficiaries’ economic opportunities and status. Additionally the evaluation will assess the effect of the projects on levels of crime and violence, and perceptions of insecurity in the neighborhoods and town from which the projects select beneficiaries.
MSI is seeking a short-term Statistician with strong quantitative skills and extensive experience evaluating projects in conflict prone areas. Experience of workforce development projects, especially with a focus on youth workforce development would be ideal.
The Statistician will provide input on the design of data collection instruments during the team planning workshop, ensuring instruments developed are collecting sufficient information in order to measure and construct outcome variables. S/he will perform power and sample size calculations for primary outcome variables allowing the evaluation to make recommendations based on robust estimates of effect sizes.
S/he will work with the evaluation team to collect and collate secondary data. S/he will process secondary data to be able to use it in conjunction with primary data collected. S/he will be required to pilot data collection instruments and suggest modifications to refine the instruments for fieldwork. S/he will be heavily involved in training subcontractor staff in order to obtain quality primary data. S/he will assess quality of data, and flag inconsistencies for review by the subcontractor.
The Statistician should be comfortable using quasi-experimental designs and calculating double difference estimates. S/he will analyze collected data to ensure treatment and comparison groups are similar at baseline as measured by demographic and socio-economic variables. S/he will write a data analysis report which will be incorporated into the final evaluation report.
The evaluation will use a mixed methods approach, leveraging primary and secondary data to answer the evaluation questions. Qualitative data will be collected through semi structured interviews of key stakeholders. We expect to conduct at least 150 in depth interviews, the vast majority of these will be conducted across various neighborhoods in Karachi. The evaluation team will use MaxQDA for coding and analysis of qualitative data. A non-equivalent groups design is expected to be used for assessing project outcomes quantitatively. We envisage conducting a stratified random sample survey of about 2000 individuals. The evaluation team will use STATA or SPSS to collate and analyze survey data.
The position requires about 58 days of effort, approximately 25 of which will be based in Islamabad. The remainder will be spent conducting fieldwork in Karachi. The Statistician will work within a six person evaluation team composed of subject-matter experts, a qualitative researcher, and data analysts. S/he will report to the Team Leader.
Responsibilities
- Refining the evaluation approach and methods.
- Developing and piloting data collection instruments.
- Developing a data collection and analysis plan.
- Participating fully in a data rehearsal with USAID staff prior to field work.
- Guiding and participating in fieldwork and putting in place necessary mechanisms for data quality assurance.
- Training data collection teams.
- Leading quantitative data analysis.
- Presenting results to USAID and implementing partners.
- Writing reports and briefing papers.
- Any other task related to the assignment and the position.
Qualifications
- At least a Master’s degree in a relevant field and 7-10 years of professional experience, or a PhD in a relevant field and 5 years of professional experience.
- Demonstrated experience evaluating projects with a quantitative focus. Prior experience with impact evaluations will be preferred.
- In depth knowledge of statistical software for quantitative data analysis, either STATA, SPSS, R or SAS is required.
- An in-depth understanding and prior experience of issues related to youth development, technical and vocational skills development, or peace and tolerance focused interventions will be preferred.
- Familiarity with USAID programming and evaluation requirements.
- Excellent analytical and personal communication skills.
- Excellent English writing skills.
- Experience working in complex and conflict-affected environments.
Only candidates who have been selected for an interview will be contacted. No phone calls, please.
MSI is an EEO/AA/ADA Veterans Employer.
“Position will be filled on a rolling basis”