Country: Philippines
Closing date: 17 Aug 2017
Background
TTL Program Background
The Tindog Tabang Leyteno (TTL) program is a 3.5 year USD 20 million program collaboratively implemented by the American Red Cross (ARC) in partnership with the Philippine Red Cross (PRC) towards the promotion of community resilience in areas affected by Typhoon Haiyan. The goal of the TTL program is “to contribute to building safe and resilient communities by identifying and addressing various factors that will help people sustainably rebuild their lives, livelihoods and assets while ensuring that future climate, environmental and disaster related risks are addressed and/or minimized.” The project strives to reach this goal through three objectives: “to increase PRC capacity in community based recovery and preparedness to enhance community resilience”, “to increase communities’ capacity to adopt resilient practices”, and “to increase household and community access to safer and more sustainable infrastructure and resources”. Although the program is implemented in an integrated fashion, program activities generally fall into one of six sectors: Shelter, Infrastructure, Livelihoods, Water, Sanitation and Hygiene (WASH), Health, or Disaster Risk Reduction (DRR). To better understand community needs the program uses a community-driven approach in which decision-making is led by Barangay Recovery Committees (BRC). These BRCs serve as key points of contact between the program and community and are instrumental in the planning, implementation, and monitoring of program interventions. A detailed description of sectoral interventions implemented to-date follows below:
Shelter sector interventions include the Core, Shelter Retrofitting Assistance (SRA), and IDEALS programs. The Core program is intended for households with severely damaged homes and provides households with one of two PRC approved core shelter designs in addition to a latrine and provision of training on Safe Shelter Construction Techniques (SST). The SRA program provides households with moderately damaged homes with a cash grant, in-kind construction materials, technical oversight, and training on SST. The IDEALS program provides legal support for households with tenuous land rights towards improved land tenure.
Infrastructure sector interventions include the construction of Community Solar Lights, Multi-Purpose Halls, Community Drainage Systems, and a Stepped Pathway. All infrastructure projects were identified through the Participatory Rural Appraisal (PRA) process and are included in the communities’ Community Action Plans (CAP). Infrastructure selected for support were chosen based on a mix of community needs, interests, vulnerability, and capacity.
Livelihoods sector interventions include the CCG Program, Agri-Extension Program, Skills Training and Enterprise Development (STED) Program, and the Community Managed Livelihood Program (CMLP). Through the CCG Program, households who lost productive assets during Typhoon Haiyan were provided conditional cash grants for the recovery of their livelihoods. These households were required to provide a proposal outlining their plan for replacement of assets and expenditure of granted funds were closely monitored against the initial proposal. The Agri-Extension Program provides households with agricultural production and marketing trainings for swine, poultry, fisheries, and vegetable producers. Following the trainings, households are then eligible to receive farm inputs or a cash grant to support the utilization of the production techniques learned during the training. The Skills Training and Enterprise Development (STED) program provides out-of-school youth with formalized skills training courses through local accredited technical institutions. Courses identified include welding, cooking, automotive, carpentry, and plumbing courses. Following the completion of the training courses, individuals are provided toolkits or cash grants towards the achievement of employment. The Community Managed Livelihoods Program (CMLP) provides established community groups and associations with cash grants towards the purchase of income-generating productive assets and with trainings towards the improvement of the group’s functioning.
WASH sector interventions include the Participatory Hygiene and Sanitation Transformation (PHAST) Program, Child Hygiene and Sanitation Transformation (CHAST) Program, and the construction of water systems and latrines at the community and household levels. The PHAST program is a participatory process that seeks to address the major hygiene and sanitation issues faced by the community. The program provides trainings to community members on good hygiene and sanitation practices and supports the identification of hardware interventions required within the community. The CHAST program is similar to the PHAST program but focuses on schools and seeks to address the major hygiene and sanitation issues faced by schools. The program provides trainings to students on good hygiene and sanitation practices and supports the identification of hardware interventions required within the schools. Based on the hardware needs identified by the PHAST and CHAST programs, the WASH sector provides Level-1, Level-2, and Level-3 water systems within the community as well as providing latrines at the household level.
The Health sector interventions includes the Community Based Health and First Aid (CBHFA) Program is a participatory process that seeks to address the major health issues faced by the community. The program provides trainings to community members on good health practices and supports the identification of interventions required within the community to promote good health.
The DRR sector interventions includes the Community Based Disaster Risk Reduction (CBDRR) Program, Contingency Planning Program, Household Preparedness Planning Program, and DRR in Schools Program. The CBDRR Program is a participatory process that seeks to raise awareness of key DRR concepts within the community. The program provides trainings to community members on good DRR practices and supports the development of a community disaster risk reduction plan. The Contingency Planning Program works with communities to develop the Contingency Plans for the major hazards faced by the community. The Household Preparedness Planning Program works with households to develop household preparedness plans. The DRR in Schools Program works with schools to help train students and teachers on key DRR concepts
TTL Program Scope and Reach
The TTL program is currently operating in 4 municipalities and 23 barangays across Leyte Province in the Philippines. The targeted barangays are mostly non-contiguous and include densely populated urban barangays as well as remote rural barangays. Currently there are around 28,000 direct beneficiaries and an estimated 30,000 indirect beneficiaries.
TTL Program Stakeholders
In addition to donors and community members and government officials in the 23 targeted barangays, program stakeholders include ARC National Head Quarters staff, PRC National Head Quarters staff, PRC Haiyan Task Force Leyte Chapter staff, and PRC Leyte Chapter staff. The program also works in close coordination with the International Federation of Red Cross and Red Crescent (IFRC) and 14 other partnering national societies operating under the movement.
TTL Program Surveys To-Date
To date there have been three major data collection efforts conducted by the TTL program including an initial household profiling of all households within the TTL target areas, a baseline survey, and an evaluation of the program’s cash-based Shelter Retrofitting Assistance (SRA) program. A detailed description of each of these data collection efforts follows below:
TTL Program Household Profiling
The TTL program has previously conducted a census-based household survey of 5,706 households within the 23 barangays. Data collected included basic socio-economic data. This census-level data has been essential in providing data for beneficiary selection for program interventions and was used for the creation of beneficiary identification cards that are the backbone of the TTL program monitoring systems. These beneficiary identification cards have allowed for complete and efficient reporting and have allowed program managers to better understand the integration of program activities.
TTL Program Baseline Survey
The TTL program has previously conducted a baseline survey in August 2015 with data collected through a household-level survey administered to 563 households selected through simple random sampling with one-stage stratification by municipality. The baseline survey sought to enable the eventual assessment of the program’s effectiveness and impact against the outcome and goal level indicators included in the program logical framework.
Shelter Retrofitting Assistance Evaluation
The TTL program has previously conducted an evaluation of its Shelter Retrofitting Assistance (SRA) program which to-date has provided 3,459 households with cash grants averaging 426.30 USD per household and corrugated galvanized iron sheets averaging 12.82 per household. The SRA program has additionally trained 3,321 individuals on safe shelter techniques (SST). As the SRA program approached its end in May 2016, the need for an evaluation was established with a goal of better understanding the Relevance and Appropriateness; Efficiency; Effectiveness; Impact; and Sustainability of the program as well the program’s alignment with the RCRC Movement Fundamental Principles and Code of Conduct. The evaluation additionally sought to inform ongoing and future operations of the RCRC Typhoon Haiyan Operation as well as provide necessary information to ensure the TTL Program upholds it obligation to ensure accountability to beneficiary communities. The evaluation was undertaken across June, July, and August 2016.
Scope of Work
The TTL program is currently finishing its final year of implementation and is seeking to conduct a mixed methods evaluation using a sequential explanatory approach. The evaluation seeks to first understand “what happened” through the analysis of quantitative data collected through an endline survey designed to understand progress against outcome and goal level indicators outlined in the program Logical Framework. The evaluation then seeks to understand “why it happened” through the analysis of qualitative data drawn from existing secondary data and through the collection of primary data. In support of this evaluation, the TTL program is seeking a consultant to provide technical support related to endline survey tool development, enumerator training, data collection supervision, data analysis, and presentation of findings as well final evaluation question of interest formulation, tool development, enumerator training, data collection supervision, data analysis, and presentation of findings and recommendations. The expected duration of the consultancy is from October 2nd, 2017 to December 12th, 2017. A detailed description of the roles and responsibilities follows below.
Consultant Responsibilities
The consultant will be responsible for the following aspects of the survey:
Endline Survey Tool Development
Review of questionnaire
The consultant will review the data collection tool (questionnaire) supplied by the TTL M&E staff. The consultant should ensure that the question wording does not lead to bias in response and that question wording reflects the intent of data collection. The consultant will review definitions for outcome-level indicators and will ensure that all indicators can be reported per the definition and to the desired level of precision. Additionally, the consultant will ensure that a relevant composite measure of community resilience can be compiled to allow the TTL project to report against its goal as defined within the Logical Framework.
Pre-testing and finalization of questionnaire
The consultant will coordinate and supervise the pre-testing of the data collection tool (questionnaire). The pre-testing should involve a debriefing period and should ensure that all issues are addressed. The consultant will work closely with the TTL staff to incorporate these changes into the data collection tool, a task likely requiring short turnaround times. It is expected that the consultant have flexibility in working hours during this stage.
Endline Survey Enumerator Training
Training of enumerators
The consultant will coordinate and lead a formal training of enumerators of no less than 4 days. This training should include portions on replacement procedures, ethics, and safety. The training should also include roleplaying activities and pre-testing involving field activities and debrief. The consultant will be required to provide all training materials for enumerator reference.
Training of supervisors
The consultant will coordinate and lead a formal training of survey supervisors. The training should cover general management, communication, and quality assurance procedures. For both enumerator and supervisor trainings, adult learning methodologies should be incorporated.
Endline Survey Data Collection Supervision
Oversight of data collection
The consultant will be responsible for coordinating and supervising all data collection activities. The consultant should work closely with supervisors to ensure that enumerators are managed properly. All logistics will be organized by the consultant in coordination with the TTL operations staff.
Development of quality control measures
The consultant will be responsible for proposing and incorporating quality control measures to ensure that data quality is maintained throughout the data collection activity. This could include random spot checks, enumerator log sheets, etc. The consultant should also ensure that data is cleanly uploaded and synchronized to the server throughout the data collection process.
Endline Survey Data Analysis
Data cleaning
The consultant will be responsible for supervising the cleaning of data. Enumerators will be provided for this task.
Data analysis
The consultant will be responsible for analysis of the primarily quantitative endline data. The analysis will include descriptive statistics as well as basic hypothesis testing with the unit of analysis of the household.
Endline Survey Presentation of Findings
Presentation of findings
The consultant will be responsible for presenting and validating the findings of the endline data analysis
Final Evaluation Question of Interest Formulation
Development of evaluation questions of interest
The consultant will draw from the analysis of the endline survey to develop evaluation questions of interest under the International Federation of the Red Cross and Red Crescent Societies (IFRC) evaluation criteria.
Final Evaluation Tool Development
Development of qualitative data collection tools
The consultant will develop qualitative data collection tools to support the collection of primary qualitative data. Primary qualitative data sources will likely include key informant interviews and focus group discussions.
Pre-testing and finalization of qualitative data collection tools
The consultant will coordinate and supervise the pre-testing of the data collection tools. The consultant will work closely with TTL staff to incorporate these changes into the data collection tool, a tasks likely requiring short turnaround times. It is expected that the consultant have flexibility in working hours during this stage.
Final Evaluation Enumerator Training
Training of enumerators
The consultant will coordinate and lead a formal training of enumerators on the qualitative data collection tools. This training should include portions on facilitation skills, ethics, and safety. The consultant will be required to provide all training materials for enumerator reference.
Final Evaluation Data Collection Supervision
Oversight of data collection
The consultant will be responsible for coordinating and supervising all data collection activities. All logistics will be organized by the consultant in coordination with the TTL operations staff. The consultant should work closely with enumerator supervisors to ensure that enumerators are managed properly.
Final Evaluation Data Analysis
Data cleaning and data entry
The consultant will be responsible for coordinating the cleaning and entry of primary data. Enumerators will be provided for this task.
Data analysis
The consultant will be responsible for analyzing primary and secondary qualitative data to support the validated findings of the endline survey. Qualitative data sources will likely include key informant interviews, focus group discussions, most significant change videos, success stories, and monitoring reports.
Final Evaluation Presentation of Findings and Recommendations
Presentation of findings and recommendations
The consultant will be responsible for presenting and validating the findings and recommendations of the final evaluation analysis.
TTL Program Responsibilities
The TTL Program will be responsible for the following aspects of the survey:
Endline Survey Tool Development
Drafting of questionnaire
TTL staff will be responsible for the original development of the data collection tool (questionnaire)
Translation of questionnaire
TTL staff will be responsible for translation of the data collection tool (questionnaire) into the local dialect, Waray-Waray. The TTL staff will also provide forward and backward translation for this study until assurance can be made of translation quality.
Endline Survey Enumerator Training
Logistical support for pre-testing and data collection.
TTL staff will be responsible for providing transportation for up to 10 enumerators, 4 supervisors, and 1 consultant during the pre-testing and data collection.
Endline Survey Data Collection Supervision
Recruitment of enumerators and supervisors
TTL staff will be responsible for recruiting up to 10 enumerators and 4 data collection supervisors
Procurement of equipment for data collection
TTL staff will be responsible for providing up to 10 phones for data collection activities.
Endline Survey Data Analysis
Procurement of equipment for data cleaning
TTL staff will be responsible for providing up to 3 computers for data cleaning activities.
Recruitment of data entry staff
TTL staff will be responsible for recruiting up to 3 data entry staff.
Review of analysis
TTL staff will be responsible for reviewing the analysis and providing timely feedback.
Endline Survey Presentation of Findings
Logistical support for presentation
TTL staff will be responsible for providing the venue and local transportation for the presentation
Administrative support for presentation
TTL staff will be responsible for ensure attendance by relevant stakeholders
Final Evaluation Question of Interest Formulation
Review of evaluation questions of interest
TTL staff will be responsible for the review and approval of the evaluation questions of interest.
Final Evaluation Tool Development
Review of data collection tools
TTL staff will be responsible for the review and approval of the qualitative data collection tools.
Translation of data collection tools
TTL staff will be responsible for translation of the qualitative data collection tools into the local dialect, Waray-Waray. The TTL staff will also provide forward and backward translation for this study until assurance can be made of translation quality.
Final Evaluation Enumerator Training
Logistical support for pre-testing and data collection.
TTL staff will be responsible for providing transportation for up to 10 enumerators, 4 supervisors, and 1 consultant during the pre-testing and data collection.
Final Evaluation Data Collection Supervision
Recruitment of enumerators and supervisors
TTL staff will be responsible for recruiting up to 10 enumerators and 4 data collection supervisors
Final Evaluation Data Analysis
Procurement of equipment for data entry and data cleaning
TTL staff will be responsible for providing up to 3 computers for data cleaning activities.
Recruitment of data entry staff
TTL staff will be responsible for recruiting up to 3 data entry staff
Review of analysis
TTL staff will be responsible for reviewing the findings and providing timely feedback.
Final Evaluation Presentation of Findings
Logistical support for presentation
TTL staff will be responsible for providing the venue and local transportation for the presentation of findings and recommendations
Administrative support for presentation
TTL staff will be responsible for ensure attendance by relevant stakeholders
Endline Survey Detailed Overview
Endline Survey Objectives
The main objective of the survey is to collect quantitative data necessary for calculation of endline figures for goal and outcome level indicators within the Logical Framework.
Endline Survey Geographic Scope
The survey will cover the 23 target barangays of the TTL Program from the municipalities of Alang-Alang, MacArthur, Mayorga, and Tacloban City.
Endline Survey Target Population
The target population includes all 5,706 households with the 23 target barangays. The population includes 1,194 households in Alangalang, 1,112 households in MacArthur, 1,626 households in Mayorga, and 1,774 households in Tacloban. The average households size is 5.1 individuals with the eldest male in the household generally considered the head of household.
Endline Sampling Frame
The sample frame for the endline survey will be the household profiling list which includes all households within the targeted barangays. The household profiling list is considered to cover the entire population of interest. The sampling unit will be the household.
Endline Survey Mode of Data Collection
The mode of data collection will be personal interviews with data collected using Samsung Duos cellular phones running the ODK Collect survey application.
Endline Survey Main Audience
The main audience for the data collected from the survey will be the TTL program staff. All TTL staff efforts will be measured against the outcome-level indicators measured through the study. Additionally, ARC program delegates, ARC field management, ARC NHQ senior management, and PRC NHQ senior management will have special interest in the findings from this study. The survey will largely be used to better understand impact through comparison of baseline and endline data and will be used as an input for a final program evaluation, special information bulletins, case studies, and technical briefs.
Endline Survey Sample Methodology
The sample methodology will be a single stage stratified random sample.
Endline Survey Sample Precision
Survey estimates should have a level of precision less than or equal to 0.05.
Endline Survey Sample Size
The sample size for the study has been calculated as 600 households by the TTL staff however the consultant will be responsible for reviewing the calculations upon arrival. The finite population correction factor has been applied for each strata and a nonresponse rate of 15% is estimated at the strata and project level.
Endline Survey Sample Stratification
The sample design will be a single stage stratified random sample. The strata for this sample will be the municipality. The sampling unit will be the household and the selection methodology will be systematic random sampling within the strata. Clustering is not required because of the close proximity of households within the barangay.
Work Plan and Deliverables
Work Plan
The consultancy is expected to last 52 working days from October 2nd, 2017 to December 12th, 2017. The expected workflow for the consultancy is as outline in below.
- Desk review of secondary data (baseline report, evaluation report, etc.) and discussions with TTL program staff - 2 days
- Develop inception report - 1 day
- Review questionnaire for endline survey - 1 day
- Develop enumerator training guide for endline survey - 1 day
- Conduct enumerator training for endline survey - 5 days
- Supervise data collection for endline survey - 10 days
- Analyze data for endline survey - 5 days
- Presentation of findings for endline survey - 1 day
- Formulation of questions of interest for final evaluation - 2 days
- Desk review of secondary qualitative data (MSC videos, success stories, monitoring reports) for final evaluation - 2 days
- Develop qualitative data collection tool for final evaluation - 1 day
- Develop enumerator training guide for final evaluation - 1 day
- Conduct enumerator training for final evaluation - 2 days
- Supervise qualitative data collection for final evaluation - 4 days
- Analyze qualitative and quantitative data for final evaluation - 6 days
- Presentation of findings and recommendations for final evaluation - 1 day
- Develop final evaluation report - 7 days
Deliverables
- Inception report - 10/04
- Endline Survey Findings Presentation - 11/06
- Final Evaluation Findings and Recommendations Presentation - 12/03
- Final Evaluation Report - 12/12
Qualifications of Consultant/Firm
- Post graduate degree from a recognized institution relating to social research, survey methodologies or monitoring & evaluation required
- Minimum 10 years relevant experience in mixed-methods research, preferably in the development/NGO sector in developing countries required
- Demonstrated experience in management of household level surveys required
- Demonstrated experience in quantitative data analysis for stratified multistage surveys required
- Demonstrated experience in qualitative data analysis for key informant interviews, focus group discussions, and audio/visual content required
- Demonstrated experience in quantitative and qualitative data collection tool development required
- Demonstrated experience in training enumerators required
- Professional work experience with the Red Cross Red Crescent Movement preferred
- Professional work experience with the Red Cross Typhoon Haiyan Recovery Operation preferred
- Professional work experience in country or region preferred
- Fluency in English required, knowledge of Tagalog preferred
How to apply:
Application Submission Details
Applications should include a proposal brief, curriculum vitae, cover letter, reference sheet, and rate sheet. Proposals should be submitted by email to jobs.prc.ttl@gmail.com. All proposals should be submitted by 5 pm (UTC +8) on August 16th, 2017. Any bids received after the deadline will not be considered.
Application Submission Procedures
Interested candidates should submit the following application materials:
- Proposal Brief (max 2 pages)
- Curriculum Vitae
- Cover Letter
- Reference Sheet
- Rate Sheet
The proposal brief should include a short explanation of high-level activities proposed by the candidate and should be limited to a maximum of 2 pages in length. The proposal brief should specify a preferred methodology and provide cost estimates for meeting the deliverables listed in the TOR. The cover letter and curriculum vitae should concisely summarize prior experiences of key personnel relevant to the aforementioned TOR. The reference sheet should include at least three professional references. The rate sheet should include daily rates for the previous 12 months of work. We thank you in advance for understanding that only short-listed candidates will be contacted for the next step in the application process.