Registered Users
1,878,997
Posted Jobs
103,235

Final Evaluation

Terms of Reference (ToR)

 

“An innovative model for strengthening community based measures to curb violence against women and girls (VAWG) in Mansehra, Nawabshah and Mirpurkhas districts, Pakistan”

(March 2015 to June 2017)

 

An international development organization working on Gender Based Violence (GBV) issues is helping local partners in different areas of Pakistan to prevent and advocate to reduce the effects of gender-based violence. It reach out to influential faith actors through local partners to raise awareness and sensitize them to denounce GBV in their congregations and community. In addition through local partner organisations it promotes a collaborative effort between civil society organisations, faith actors and the relevant Government Departments to create enabling environment for implementation of pro-women legislation to end GBV in Pakistan.

 

1.    Context and Project Description

A three year project titled “An innovative model for strengthening community based measures to curb violence against women and girls (VAWG) in Mansehra, Nawabshah (now Shaheed Benazirabad) and Mirpurkhas districts of Pakistan” was implemented by two local partners.  The project had contributed to address violation of basic human rights of women and girls by focusing on prevention and response through a two-tiered approach: 1) Survivors of VAWG have enhanced access to justice and safety, through response services, referrals and adherence to applicable laws; and 2) Community measures prevention and act against domestic violence and forced marriages, by empowering women through facilitation of inheritance. The overall objective of the project is to contribute to enhanced social and collective action in local communities to detect, prevent and respond to VAWG, specifically domestic violence (DV) and forced marriages.

 

Specific Objective 1 ensures that the state upholds its responsibility to ensure the safety of its female citizens, particularly survivors of VAWG or religiously motivated violence against non-Muslim women and girls, through the implementation of relevant laws. In cases where there is a violation of women and girls’ rights, the state must ensure they have access to justice. The project also aims to improve the quality of GBV response provided by duty bearers.

 

Specific Objective 2 is based on the realization that top down legislative change alone does not reduce prevalence of VAWG until there is accompanying behavioural change at the local level. Rather than wait for a trickle down process, the project proactively engages rights holders as well as their communities in order to promote sustainable change based on ground realities.

 

Location of Project: Nawabshah (now Shaheed Benazirabad) and Mirpurkhas districts of Sindh and Mansehra district of Khyber Pakhtunkhwa (KP) provinces.  

 

2.    Purpose of the Final Evaluation

Purpose of the final evaluation is to assess project’s design and implementation of innovative methods, and overall progress with emphasis on results, and achievements focusing to:

  • ·         Provide all parties involved in project an understanding of achievements, challenges and successes;
  • ·         The extent possible, assess whether the project has had any positive or negative impact for the targeted communities, intended or unintended changes on policy level in public and private sectors and in communities;
  • ·         Assess learning from this project to capture opportunities and innovations that may be sustainable in terms of planning and implementing similar projects in the future;
  • ·         Assess whether the project was optimally implemented with regards to effective use of available resources;
  • ·         Assess level of coordination between funding partners, local partners and target groups and other stakeholders involved.

 

4. Scope of Work

While all OECD/DAC five criteria for evaluation are pertinent, the evaluation should focus on relevance, effectiveness, efficiency, sustainability and impact. Addressing the evaluation purpose will require that the consultant provide answers to following specific questions – which could be refined in inception phase of the evaluation:

 

Relevance:

  • Have local partners taken advantage of available knowledge and experience within targeted community groups (men and women, boys and girls); among district stakeholders and structures such as the District Watch Group, representatives of Government Line Agencies (GLAs) including police officials, revenue officials and Lady Health Workers (LHWs), that can be replicated in other projects.
  • Consider the project’s intended and actual expected results and assess whether these have practical relevance to the trend of national and provincial level legislations and other services being offered by the Government to address GBV related issues in Pakistan. The evaluation should specify what this relevance is, and if there is a major relevance, whether and how scope of the project could and should be expanded in future.
  • How does strategy used in the project fit into provincial and national development plans, if such exist, to combat GBV
  • Analyse how project approach fits within other work being done on GBV by other CSOs at the national and provincial levels.

 

Effectiveness:

  • ·         Assess to what extent have the project objectives been achieved?
  • ·         What were the possible major factors or constraints influencing achievements or non- achievements of the overall goal and the objectives of project?
  • Assess project design as outlined in application and in view of the project’s implementation to consider whether the design could have offered more in terms of efficiency and effectiveness for the project. If the evaluators are of the opinion that alternative designs would have been preferable to the one chosen, then those should be presented and promoted.  
  • Assess project implementation and monitoring approach to see if the methods and resources applied worked as intended with regards to efficiency and effectiveness. Were expected results from the planned project activities produced? If not, what were the factors that prevented them from being produced? What were the main challenges of implementing the activities? 

 

Efficiency:

  • Assess cost- efficiency of project by comparing allocated resources with results achieved. The evaluation should present a measured opinion on whether results obtained justified costs incurred.
  • To what extent management of funding organization and local partners influenced efficiency?
  • To what extent were the local partners able to undertake the project?
  • Give an opinion on possible strengths and weaknesses in funding organization’s management routines and administrative procedures implemented effectively by the local partners.
  • Examine delivery of project’s expected results in terms of quality and quantity. Were they delivered in a timely manner?  To what extent did factors outside the control of the project design and management affected project implementation and attainment of objectives?
  • Has funding partner of the project utilised other available resources and available networks to continue the implementation of the project.

 

Sustainability

  • Asses project in terms of phase out strategy and institutional sustainability, e.g., community structures and propose how they could expand the activities beyond the support from the funding partners.
  • To what extent can the benefits of the project continue after the funding ends?
  • Are there any major factors influencing achievements or non-achievements of project sustainability?
  • Suggest measures to improve work of funding and implementing partners in future projects in light of lessons learnt from the past experience.
  • What has been funding organization’s added value in sustainability of the project?

 

Impact

  • Give a measured opinion on impact of the project on target communities. Has the project been able to measure, either directly or indirectly, its achievements during the project’s planed duration?  Alternatively, if impact has not been measured, consider whether it is possible to define a methodology for doing this?

 

Additional issues to be addressed by the evaluation

 

Risk Management:

  • Give a measured opinion on whether the project has dealt effectively with all matters related to risk management and consider what risks were involved in producing the expected results? 
  • Were there any major factors (security, dominant social norms, resistance, etc.) influencing the achievement or non-achievement of the objectives?

 

Cross-cutting themes:

  • Review project from a gender perspective and consider whether all aspects of funding partners’ policy relating to gender equality/mainstreaming in development programs adequately used in project.
  • ·         Consider whether project contributes to observance of specific national laws, e.g., Sindh Child Marriage Restraint Act 2013, Women Protection Bill, DV Bill, Hindu Marriage Act and Human Rights generally in Pakistan as an implicit goal of the project.
  • ·         Consider if project contributes to good governance in the country, either at federal or provincial levels.

 

Finance:

  • Consider whether all matters related to financial management, including procurement procedures for goods and services and possible concerns relating to a zero tolerance to corruption policy of applicant, have been adequately observed when the project was implemented.
  • Consider all aspects related to the project’s cost effectiveness and evaluate whether alternative implementing methods could have been applied to increase the cost effectiveness.

 

3.    Implementation of the Evaluation:
  • ·         Composition of the Consultant Evaluation Team: The INGO will hire local consultant (s) having sufficient knowledge/experience in the field of gender based violence and women empowerment work in Pakistan in addition to sufficient experience in finance and administration.
  • ·         Terms and Conditions:  The funding organization will offer a daily consultancy fee commensurate with the background and experience of the consultants. Travel and logistical arrangements will be made by the consultants themselves within the consultancy fee in an economical fashion.
  • ·         Sources of information and methodology to be employed: The funding organization shall provide necessary documentation to the Consultant, and work out a programme for coordination at the field.   
  • ·         Division of responsibility between the consultant/team, the applicant and the co-applicantsThe consultant is expected to recommend scope for improvements at institutional as well as the programmatic level. The team shall be encouraged to apply a participatory and inclusive approach throughout their evaluation work. The consultant will arrange division of labour between themselves, but the team leader will be responsible for production of the report. The consultants will partly work in Islamabad and partly travel to and visit the field offices and geographic areas of interventions of the local partners. The consultants will be encouraged to arrange for their office facilities and work independently and away from the funding organization and local partners’ offices. The consultants will need to make all arrangements for travel, meetings and other practical matters related to logistics and working contacts on their own and with minimal assistance from funding organization. The team members will be using their own personal computers and other relevant equipment for the assignment.

 

4.    Reporting

The consultant shall be responsible for:

  • ·         Desk study, field work including meetings with the funding organization, partners and beneficiaries.
  • ·         Submit draft report simultaneously to the funding organization for comments on factual issues and for clarifications;
  • ·         Consolidate comments received from the funding organization and submit final report within the timeframe agreed. The final approved report shall be submitted in hard copy as well as in electronic format by October 07, 2017.
  • ·         Debriefing the funding organization and local partners upon completion of work, if required.

 

Description of required report format:

  • ·         Table of contents and acronyms
  • ·         Executive Summary
  • ·         Methodology and constraints
  • ·         Clearly identified findings
  • ·         Clearly identified conclusions and recommendations- and connection between them.
  • ·         Lessons learned
  • ·         Sustainability
  • ·         Recommendations
  • ·         Appropriate Annexes including tools and present TORs
  • ·         The report shall be submitted in 2 hard copies and also in electronic form.

 

The report shall be in English with maximum limit of 18 pages, i.e., 2 page executive summary, 16 page report according to the above mentioned format. The annexes should contain references and information about any literature consulted, data collection instruments, project LFA with end of project evaluation value entered, funding organization’s GBV programme Results Framework, the ToRs, and list of interviewees and any additional information required.

 

5.    Budget

The detailed budget and terms and conditions for the consultant will be separately spelt out in the respective contract. The funding organization shall make the payments as agreed in the contract with consultant including deduction of taxes. Preferably 50% of the payment will be given at signing of the contract, while 25% on completion of field activities and rest of the 25% on approval of the report. The funding organization will cover consultancy fees and other related expenses in PKR for the entire evaluation study.

 

6.     Skills and Qualifications of the Consultant or Firm/Organization

The selection of the consultant/firm will be based on the quality of their proposal (including, methodologies, tools, quantifications, and time schedule), their financial offer, the relevant educational background and experience of consultant, their familiarity with GBV and women’s empowerment approaches and program related topics.  In addition the consultant should have the following qualifications:

•        At least five years’ experience of conducting project baselines, evaluations and researches, particularly related to GBV and women’s empowerment programmes.

•        Strong qualitative data entry and analysis skills (consultants with previous experience of using statistical analysis software will be preferred)

•        Ability to respond to comments and questions in a timely and appropriate manner

•        Ability to write high quality, clear, concise reports in English

 

7.     Consultancy process and timeline

Interested consultancy firms should submit detailed technical and financial proposals covering:

•        Capacity statement

•        Demonstrated understanding of the terms of reference

•        Proposed methodology

•        A detailed work plan

•        A financial proposal detailing consultant’s fees, data collection and administrative costs

•        CV of principal consultant and team members

•        Electronic copies of two recently concluded similar assignments by the consultant

•        Two references of recent clients with contact details of the referees

 

Tasks/outputs

Max. days of work required

Deadlines

Orientation meeting between funding organization, local partners and selected consultant to discuss scope of work, tools, and methodologies of evaluation

1

 

Data collection and entry

7

 

Data analysis and draft of end of project evaluation report submitted in person

12

 

Funding organization’s staff comment on the draft end of project evaluation report

5

 

Submission of final project evaluation report with funding organization

5

 

Total days

30 days

 

 

8.    Communication

Send EOI and Proposals at following email address not later than September 3, 2017:

[email protected]