Three reasons to keep pursuing data-driven approaches in public health
Monitoring, Evaluation and Learning—abbreviated as M&E, MEL, MLE or MEaL—is the key tool of a movement to bring transparency and accountability into projects in the development sector. In this era of evidence-based-everything, the usefulness of data to inform, justify and audit programmes is indisputable. Every organization does it. But working with data, projects and people involves endless complexities.
A group of MEL practitioners from USAID-India’s partner organizations came together to discuss just this at the #Numbers2Narratives workshop in Delhi on the 21st of June, 2018. Though they work across a range of public health issues, approaches and organizational structures, they still had a lot of the same issues to share: Trying to work with ‘program people’ with very different priorities and approaches to data, who may see data as a distraction, inaccurate, and even a threat. Trying to meet multiple and extensive reporting requirements with limited resources. Trying to capture the project’s dynamism while consistently tracking results over time. Struggling to collect data, analyse it, turn it into usable evidence, and ensure the uptake of that evidence. By any account, all of this together is a mammoth task, and often a struggle—and it can be hard to keep track of what the benefits are.
So why do we keep ‘reporting’?
The most obvious reason, of course, is because it’s a funding requirement. But more importantly, organizations now believe that putting in place a good monitoring system brings accountability, which in turn sets off a chain of learning, more effective programming, and greater impact. What’s assumed here, though, is that these organisational motivations for MEL will be evident and inspiring to everyone involved in the project, and so take effect the moment the systems are put in place. Instead, according to the practitioners: program people may be indifferent or defensive to efforts to collect data around what they do, many of those involved in data collection fail to see the point of it, and MEL teams themselves get lost in tables, charts and quarterly reports. While everyone senses—or has been told—that ‘proving and improving’ is at the heart of MEL, the bigger picture gets lost among the everyday details of project implementation.
So for the sake of returning to the idealistic origins of the MEL project, here are three great reasons why the public health sector needs to keep on striving to monitor, evaluate and learn from its projects:
Reason 1: Knowledge Management
MEL teams spend most of their time on data collection: capacity-building of those collecting the data, cleaning and analysing it, compiling it into reports every month, quarter or year. Yet there’s a sense that all this work is disappearing down a black hole, not contributing the the project objectives. This is where a shift in perspective of what they do might be required: rather than accountability-enforcers, MEL people need to be seen (and see themselves!) as knowledge managers. Their role in the project is not just to meet reporting requirements, but to collect, consolidate, distil and share knowledge that’s relevant to the project, helping it increase its effectiveness, scale and impact. This automatically means a more collaborative interaction with ‘program people’, with a two-way flow of information and an appreciation of the different priorities each group brings to the table. Win-win.
Reason 2: Documenting and [Building on] Success
Program teams justifiably feel that time spent documenting or reporting activities takes away from time spent actually doing them. Moreover, it can seem that the MEL team’s accountability mandate—measuring achievement against targets—puts them on the spot. And when the task of communicating successes is left to a separate Communications team, the MEL division appear to be the vultures looking for bad news.
In this context, the motivator for program teams to collaborate might be to see proof of what they have managed to achieve over the course of a reporting period. Once the MEL team starts supplementing data for reports with qualitative methods and success stories that document and appreciate the program team’s efforts, challenges and strategies, and create a pool of insights for the project to reflect on, the magic of learning can start to happen.
‘Numbers2Narratives’ emphasises the need to understand ‘how results were achieved’ and ‘why desired results could not be achieved’, beyond numbers. This contributes to the larger picture, for sustaining and scaling efforts. —Neeta Rao, USAID
evant to the project, helping it increase its effectiveness, scale and impact. This automatically means a more collaborative interaction with ‘program people’, with a two-way flow of information and an appreciation of the different priorities each group brings to the table. Win-win.
Reason 3: Strengthening the investment case for public health