Consultancy - Project End Evaluation | PAK-NGOs
Background & Description

OiP in close collaboration of Oxfam America has launched a 03 year project with core objective of “Young girls emerge as future leaders leading lives of dignity by making informed choices, claiming rights and control over equitable opportunities”. The very idea of WLT aims to build a strong and diverse network of aspiring young students to become future leaders across a range of different schools and communities previously targeted under project GEM. Through a series of leadership workshops and mentoring opportunities, the project seeks to connect young girls from different schools and encourage a culture of leadership and active participation. Primarily through a carefully chalked out scholarship support initiative, the goal of the Women Leaders of Tomorrow is to prepare promising female students for success in their future career pathways. The basic aim is to make young girls learn and understand not to let their background, faith, race or gender affect their choices, ambitions and career in their lives rather lead the trajectory of their lives by making informed choices. With this particular approach, Women Leaders of Tomorrow (WLT) will unfold and promote range of opportunities for young girls to live their ambitions. The project aims to remind female students their intrinsic strength and power to be and bring the change within and around them and that is all about this project

The project has faced numerous changes during course of its implementation therefore come up with different outcomes and output each year to cope with changes and ensure effective delivery. In this backdrop this assignment will evaluate the impact on target beneficiary as well as change at large especially in attitudes, behaviours and practices of stakeholders. This evaluation needs innovation to capture impact and lesson learnt by using innovative methodology contributing into overall objective of 03 year project titled “Women Leaders of Tomorrow. Following are year wise project outcomes and outputs.  

S.No

Year

Outcomes

Outputs

01

Year – 1

Outcome – 1: At least 60 girls are mobilized, organized and well-equipped with demonstrated academic and leadership skills leading their course of education beyond primary and secondary levels as future leaders

Output 1.1        70 identified girls are formally registered for 3 years’ WLT scholarship having Individual Education Profiles (IEPs) readily available

 

Output 1.2        04 Specialised trainings (in a year) are organised for teachers and girls with exclusive periodic mentoring support for scholarship holders

02

Year – 2

 

 

 

 

 

 

 

 

 

 

 

 

Outcome – 1: At least 60 girls are mobilized, organized

 

 

 

 

 

 

 

 

 

 

 

Outcome – 2: Targeted school teachers act as change makers for student and their respective communities in improving quality of life

 

Output 1.1: 70 scholarship holder’s girls have proofed academic excellence throughout second year of the project

 

Output 1.2: 70 scholarship holders and young girls in 08 schools are well equipped on life skills based education for improved leadership and confidence building.

 

Output 1.3: Young girls in 08 schools have improved campaigning skills to advocate for community level issues in their respective areas

 

Output 2.1: Teachers in selected schools have improved subject wise knowledge

 

Output 2.2: Teachers, students and community members in selected schools have improved knowledge and awareness on quality life standards

 

03

Year -3

Outcome – 1: At least 60 girls are mobilized, organized and well-equipped with demonstrated academic and leadership skills leading their course of education beyond primary and secondary levels as future leaders

 

 

 

 

 

 

 

 

Outcome – 2: Targeted school teachers act as changemakers for students and their respective communities in improving quality of life

Output 1.1: Scholarship holders at post-secondary level are well equipped on entrepreneurial skills for improved life standards and empowered to support their higher education

 

Output 1.2: Young girls in partner schools have access to improved environment and leadership skills to advocate for their rights and demand for improved financing on Girls Education women development. 

 

Output 1.3: Promoting better health and hygiene environment in schools to minimize incidence of water-borne diseases

 

Output 2.1: Teachers in selected schools have improved knowledge on Gender Responsive Pedagogical skills to enable gender responsive delivery of lessons in schools

 

Output 2.2: Teachers in selected schools have improved knowledge and awareness of self-protection

 

 

Particulars of the Project Partners:

Partner Organisation(s):                         Idara-e-Taleem-o-Agahai (ITA)

Project Duration:                                   April 2016 – May 2019

Geographical Coverage:                        District Multan only

  1. PURPOSE OF THE EVALUATION

The overall purpose of this assignment is to conduct an independent end of project evaluation to explore sufficient details on project relevance, effectiveness, efficiency, sustainability, impact and project contribution towards key project results and bringing positive change at personal, community and school level. In addition, the findings of evaluation will inform OiP’s girls education program with adequate evidence (quantitative and qualitative) on outcomes and impact of projects and areas that needs to be improved for future programming. The specific objectives of the evaluation will be:

  • To evaluate the contribution of project towards outcomes and impact in line with project theory of change and log frame
  • To assess project contribution towards improving trends in enrolments, learning, retention and enrolment of children in target schools particularly in view of Gender Responsive Budgeting and Planning
  • To evaluate that how relevant, effective and sustainable are project activities related to gender responsive budgeting and evaluation.
  • To explore learning and recommend suggestions for future programming
  1. Key Focus Areas

The Consultant/firm will evaluate the project according to the standard evaluation and impact assessment criteria (but not limited to) below:

I)  Relevance

  • Assess the contribution of the project towards the achievement of the project’s overall objectives.
  • Assess the relevance of the tools / instruments / inputs applied by the project given the context.

II) Effectiveness

  • Review whether the project activities have accomplished their outputs and outcomes or not.
  • Any emerging effect of the project on beneficiaries including both male and female.
  • Assess performance with particular reference to qualitative and quantitative achievements of outputs.
  • Develop 35 Individual Education Profile with interactive trajectory to track performance.

III) Efficiency

  • Assess the qualitative and quantitative aspects of management and other inputs (such as monitoring and review and other technical assistance and budgetary inputs) provided by the project vis-à-vis achievement of outputs and targets.
  • Value for Money (VFM)

IV) Sustainability and Impact

  • Assess the degree to which the project results are likely to be sustainable beyond the projects’ lifetime and provide recommendations for strengthening sustainability
  • Analyze emerging impact on the communities for both men and women in terms of awareness on Right to Education (RTE); percentage increase in enrollment, learning and retention and gender responsive budgeting in terms of bringing more girls to schools.
  • Based on the findings (relating to relevance, efficiency, effectiveness, sustainability and impact) identify the potential for scaling up, as well as suggest new activities to build upon the achievements of the project.

V) Lessons learnt/ Conclusions

  • Identify significant lessons or conclusions which can be drawn from the project in terms of effectiveness, efficiency, sustainability and networking.
  • Collect case studies to demonstrate change in the lives of people
  1. SCOPE OF WORK

An independent technical expert/consulting firm will be appointed for a short-term period to conduct the end project evaluation. The Project End Evaluation Report draws on quantitative and qualitative information for a comprehensive assessment of the situation. The research methodology used to conduct this evaluation is a combination of desk reviews and field work (Key informant interviews, focus groups discussion and score card/assessment of 70 stipends in Multan districts. Moreover, the study population should include all stakeholders mentioned and identified in the execution plan/LFA/MEL framework including Education department, local government representatives, parliamentarians, direct and indirect beneficiaries as well as, civil society representatives.

The selected agency/consultant must design their study and plan their fieldwork considering the partners involvement and required field visits. Whatever methodology is used, the study design, the data collection and analysis should be done in a way that is able to generate findings and recommendations consistent with the study.

  1. LOCATION OF CONDUCTING EVALUATION

The project is being implemented in two (02) union councils of districts Multan in South Punjab, which ranks among the poorest provinces in terms of girls access to education and educational performance overall. In total, we anticipate the project will reach: 70 direct beneficiaries (stipend Holders) and 800 girls enrolled in schools following approximately 100 individuals (parents, teachers, local government representatives, school council members etc.). In addition, we expect approximately 1,200 people will indirectly benefit from the project.

  1. INFORMAITON GATHERING AND ANALYSIS

Oxfam Pakistan seeks to ensure the following process for commissioning project end evaluation:

  • Evaluation teams must ensure an ability to integrate participatory approaches and strong gender analysis into their evaluation approach and methodology.
  • Technical feedback from experts and team leads at Oxfam in Pakistan.
  • Evaluation team will critically assess the qualitative as well as quantitative impact of project on Gender Responsiveness in project cycle.

The data will be collected through primary and secondary sources.

Secondary data: All the relevant secondary sources will be reviewed for better understanding of the context and type information is already available. That includes: Project Proposal, Project Logframe, Narrative Progress Report, MEL frameworks etc.

Primary data: Primary source of information will be all stakeholders including direct and indirect beneficiaries of the project in all focused districts. The consultant/firm will propose best suitable methodology for primary data including KII, FGDs and any other, however, will be mutually agreed after contract signing among Oxfam Pakistan and the expert (s).

The type of analysis will depend on the nature of the indicators, reflected in result framework and MEL plans. The quantitative analysis will include percentage, comparisons and averages. Qualitative data will be analyzed using the any of statistical packages for social sciences.

Consultant should propose methodology for the quantitative and qualitative data collection in the proposal.

  • The results, along with the narration, will be presented in the form of tables and graphs for ease of understanding but it should be assured that narration should not be limited to the description of the graphs only but also contain the analytical interpretation of the results. Detail analysis of the report against the outcomes should be given by the triangulation of qualitative and quantitative findings.
  • Recommendations will be drawn based on observations and findings. These recommendations will help in the effective implementation of the project.
  1. ESSENTIAL QUALITY CHECK

For ensuring quality of the mid-term term project evaluation, It is preferred that that the consultant (s) will incorporate essentially the control group method as well as achievement rating (scale method) in addition to the other proposed methods for the end term project evaluation/impact assessment.

  1. KEY DELIVERABLES

It includes:

  • Inception report with detailed implementation plan, finalized sample size, data collection tools and outline of final report
  • A presentation of initial evaluation findings/first draft for face to face discussion with the Oxfam Pakistan team.
  • One Executive Summary of the project with clear indication of key achievements of the project , stand alone, ‘communicable’, 2 pages with the project specific recommendations and learning.
  • Pictorial record of the project activities.
  • One Project Evaluation Reports approx. 25 pages, of publishable quality with the project specific recommendations and learning (excluding annexes).
  1. BUDGET

Oxfam Pakistan will be responsible to release payment on time after confirming and receiving deliverables.

Logistics: Logistics arrangement will be the responsibility of consultant.

  1. PAYMENT SCHEDULE

Payment will be made in three instalments as follows:

  • 20 % upon submission final plan for field activities
  • 30 % after completion of data collection;
  • The remaining 50 % upon successful completion and endorsement/acceptance of the final report by Oxfam in Pakistan’s Financing for Gender Justice team.
  1. COPYRIGHT

The above assignment will have Oxfam’s sole ownership and copyright. The organization or consultant will have to get Oxfam’s written permission that she/he wants to use these reports, otherwise it will be illegal.

  1. TIME FRAME

Total duration of this evaluation study will be one month and consultants/firm will ensure to submit final report by mid-June 2019. However, if, the finally submitted report is deemed unsatisfactory, the timeframe might be extended till approval of the final report by Oxfam in Pakistan.

Requirements and Skills

Interested parties will be asked to tender a comprehensive methodology on the basis of above approaches and process that how they would tackle this evaluation, both on a theoretical and practical basis.  Oxfam in Pakistan and aforementioned project partners will facilitate to link the third party to provincial focal persons for further coordination/focus group discussions (FGDs)/interviews/consultations etc. with different stakeholder. Following main activities could be carried out:

  • Significant amount of desk research (plans, monitoring data, internal evaluation)
  • Interviews with key internal stakeholders and target beneficiaries to document case stories (Implementing partners, enrolled girls, representatives of School Councils, Teachers, community etc.)
  • Sample survey/ visits to field areas
  • Collation of evidence and stories for both evaluation and communication work.
How to Apply
  1. Application Process

The financial and narrative proposals including detailed workplan, reports of 2 similar past assignments and CVs of key team members should be forwarded to HR department in separate sealed envelopes. Please submit the technical and financial proposal with precise introduction on undertaking similar assignments. Kindly submit the technical and financial proposals on following postal address:

Mr. Muhammed Imran Qureshi

Plot No. 02, Street 11A, Idrees Market, Near Shalimar Police station,

F-10/2, Islamabad.

Pakistan

  1. Evaluation Criteria

Oxfam selection committee will evaluate all proposals on following criteria,

Evaluation Indicator

Weightage (Score)

Relevant Experience

30

Proposed Methodology

50

Proposed Budget

20

 

About Organization

Oxfam’s vision is a just world without poverty: a world in which people can influence decisions that affect their lives, enjoy their rights, and assume their responsibilities as full citizens of a world in which all human beings are valued and treated equally. Oxfam in Pakistan has been working in the country since 1973. In the Pakistan, our goal is to contribute to the eradication of poverty by supporting women and other vulnerable groups in saving lives and building livelihoods, enhancing their resilience to crises, shocks and stresses, and making their voices heard to hold duty-bearers accountable.