Email updates

Keep up to date with the latest news and content from BMC Medical Informatics and Decision Making and BioMed Central.

Open Access Research article

Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation

Sunisha Neupane1*, Willem Odendaal2, Irwin Friedman3, Waasila Jassat4, Helen Schneider1 and Tanya Doherty12

Author Affiliations

1 School of Public Health, University of the Western Cape, Cape Town, South Africa

2 Health Systems Research Unit, Medical Research Council of South Africa, Cape Town, South Africa

3 Seed Trust, Durban, South Africa

4 Health Systems Trust, Durban, South Africa

For all author emails, please log on.

BMC Medical Informatics and Decision Making 2014, 14:69  doi:10.1186/1472-6947-14-69

Published: 9 August 2014

Abstract

Background

In an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs.

Methods

One sub-district in the North West province was identified for the evaluation. One outreach team comprising ten CHWs maintained both the paper forms and mHealth system to record household data on community-based services. A comparative analysis was done to calculate the correspondence between the paper and phone records. A focus group discussion was conducted with the CHWs. Clinical referrals, data accuracy and supervised visits were compared and analysed for the paper and phone systems.

Results

Compared to the mHealth system where data accuracy was assured, 40% of the CHWs showed a consistently high level (>90% correspondence) of data transfer accuracy on paper. Overall, there was an improvement over time, and by the fifth month, all CHWs achieved a correspondence of 90% or above between phone and paper data. The most common error that occurred was summing the total number of visits and/or activities across the five household activity indicators. Few supervised home visits were recorded in either system and there was no evidence of the team leader following up on the automatic notifications received on their cell phones.

Conclusions

The evaluation emphasizes the need for regular supervision for both systems and rigorous and ongoing assessments of data quality for the paper system. Formalization of a mHealth M&E system for PHC outreach teams delivering community based services could offer greater accuracy of M&E and enhance supervision systems for CHWs.

Keywords:
Community health workers; Monitoring and evaluation; mHealth; Community based services