5.
How to conduct qualitative and quantitative operational research?

Evaluation Planning Tool - BetterEvaluation

Organization:

BetterEvaluation is an international collaboration with the following founding partners: RMIT, Pact, ILAC, ODI. The core BetterEvaluation team, site users, and evaluation experts develop content and its quality is monitored through peer and public review processes.

 

image012.gif

Purpose:

  • To improve evaluation practice and theory by sharing information about options (methods or tools) and approaches
  • To support evaluators, practitioners and managers of evaluation to choose options that are appropriate for their situation and to use these well. 
  • To support individuals and organizations to share their learning about evaluation across disciplinary and organisational boundaries, sectors, languages and countries, including examples of their practice and advice on choosing and using different options and approaches.

Content:

  • BetterEvaluation Planning Tool: helps to plan an evaluation by prompting to think about a series of key questions about each task, and select a package of methods that cover all the task
  • Information on different approaches (e.g. RCT, case study, outcome mapping, social return on investment) 

Guide to Operational Research - GFTAM/WHO

Organization: The Global Fund / WHO

Year: 2008

Purpose:

Short introduction and overview on operational research

Content:

  • General introduction to operational research: definition, rationale, process of conducting operational research and persons involved.
  • Practical examples of operational research. 
image013.gif

Framework for Operations and Implementation Research in Health and Disease Control Programs - GFTAM /TDR

Organization:

A collaborative effort between the GFTAM, TDR and an inter-agency technical working group.

Year: 2008

Purpose:

  • To standardize the practice of OR across the international health community
  • To stimulate the integration of OR into health programs.

 

image014.gif

Content:

  • Contains an overview of OR definitions, scope and uses.
  • OR process flowchart and a step-by-step 16-item checklist of major activities required in the planning, implementation and follow-through (dissemination and use) of OR at the country level (p. 18, see table) 
image015.gif

Qualitative Research Guide - MSF

Organization: MSF

Year: 2007

Purpose:

Guide to Using Qualitative Research Methodology

Content:

  • What is qualitative research: aims, uses and ethical issues?
  • How to develop qualitative research designs?
  • How to generate date: individual interviews, group interviews, contextual data
  • Data management and analysis 

Demographic & Health Survey Toolkit

Includes a set of comprehensive materials assisting the NGO worker in all phases of a survey from design to dissemination of results: survey design and sampling, data collection, data processing, data dissemination.

Guide to Participatory Action Research in health systems - EQUINET

Organisations: 

  • Regional Network on Equity in Health in East and Southern Africa (EQUINET) 
  • Training and Research Support Centre (TARSC)
  • Alliance for Health Policy and Systems Research 
  • International Development Research Centre (IDRC)
  • WHO

Year: 2014

Purpose:

  • To explain key features of participatory action research 
  • To explain processes and methods used in participatory action research 
  • To explain communication, reporting, institutionalisation and use of participatory action research in heatlh systems

Content: 

  • Concepts
  • Methods 
  • Issues and Challenges 
  • Evidence and Action
  • Empiriical Papers 

Conducting Mini-Surveys - USAID

Includes description of mini surveys, planning and preparing a mini-survey, designing the questionnaire, selecting the respondents, advice for interviewers, analyzing and presenting the survey data. 

RCT - short guide - MSF

Short guide by MSF: 

Includes planning, conducting the trial, analysis and writing up as well as a glossary of terms. 

RCT - Guide - BetterEvaluation

Includes an introduction, simple examples, steps of an RCT, examples, mapping the approach in terms of tasks and options, advice on choosing this approach, advice when using this approach, FAQ.

Collecting Data - KoBo Toolbox

 

Organisation: developed by Harvard Humanitarian Initiative 

Year: first pilot in 2007

Purpose: open source suite of tools for data collection and analysis

Content:

  • KoBoForm: Desigining the Questionnaire
  • KoBoCollect: Mobile data collection
  • KoBoSync: Data Aggregation
  • KoBoMap: Geospatial data display 
image017.jpg

Learning resources for population survey analysis

Organisation: 

  • developed by Dana Thomson with support from the University of Rwanda – College of Medicine and Health Sciences – School of Public Health, Harvard Medical School Global Health Research Core, and the Human Resources for Health Project.

Year: 2014

Purpose: 

  • Hands-on, visual learning material to enable analysis of existing population survey data

Content: 

  • e.g What is the DHS?; Introduction to Stata; Simple Random Sampling; Complex Sampling; Survey Analysis in Small Populations; Survey Analysis in Stata
  • Download YouTube videos and/or PDFs for offline viewing; also designed for use in low-bandwidth settings
  • Exercises focus on application, and provide learners with example code, output, text, and interpretations.

Implementation Research Toolkit - TDR / WHO

Organisation: 

  • TDR - special program for Research and Training in Tropical Diseases 
  • WHO

Year: 2014 

Purpose: 

  • To learn ho to conduct implementation research to address implementation barriers and improve delivery of heath services

Content: 

  • Introduction 
  • Contextualisation 
  • Developing an implementation research proposal 
  • Planning to conduct implementation research 
  • Data analysis and presentation 
  • Communicating research findings and feeding them back into the health system 
  • Monitoring and evaluation the project 

includes: Participant Manual; Workshop Session Slides; Links to relevant further reading and references

Impact Evaluation Toolkit - Worldbank

Toolkit Provides Hands-On Guidance

The  Impact Evaluation Toolkit helps practitioners design and implement impact evaluations, with a focus on Results-Based Financing in maternal and child health programs. The Toolkit consists of 1) guidelines for best practices and 2) tools to implement guideline recommendations such as:

  • terms of reference for team members/survey firms
  • maternal and child health indicators of interest
  • research protocols
  • questionnaires
  • training manuals and curricula
  • fieldwork supervision materials