Going Beyond "What Works" in Implementation Research: Understanding the "How" & "Why
In implementation research (IR), identifying how to best implement “what works” is often the focal point—those evidence-based solutions that improve outcomes in teaching and learning. But simply identifying a successful tweak isn’t enough. What’s often missing is the documentation of how the team arrived at the solution and why it worked in their specific context. Without this, we risk replicating solutions that may not be applicable in different settings.
The real breakthrough in IR happens when we replicate the approach—the decisions, adjustments, and learning process behind a successful solution. Sharing how teams adapted evidence-based ideas to their unique context not only makes the research more adaptable but also empowers others to use that approach in their own work.
The Importance of Documenting the Process
To move beyond “what works,” we must focus on the process.
Documenting the steps that led to a solution helps others understand how evidence-based practices were adapted, tested, and refined in response to real-world challenges. This ensures that the insights we gain are transferable across different contexts, districts, and countries.
In implementation research, we need to know more than just the outcomes. We need to understand how the team arrived at their conclusions, what barriers they encountered, and how they overcame them to achieve a feasible solution. This knowledge enables others to learn from the process and apply it in their own settings.
Dig into Existing Data
A fresh look at your data can reveal hidden patterns or gaps that highlight implementation challenges. By reviewing key metrics, comparing groups, and testing assumptions, you can gain important insights. Pairing quantitative data, like student assessment scores, with qualitative inputs, like teacher interviews, provides a fuller picture. Don’t overlook missing data—it can often be just as revealing. For example, Building Tomorrow analysed historic student attainment data by district and grade to understand the performance and distribution of P4/P5 students. They did see variance between districts and noticed that the jump towards proficiency is larger as students get older. This data informed the reconfiguration of teacher materials as well as training for a refreshed implementation focused on these learners, hypothesising that this could reinforce progress towards proficiency. The data also informed the sample of schools for testing. The team chose to test in historically low performing districts.
Increase Your Learning Velocity
In adaptive implementation, rapid learning via IR and real-time adjustments using the IR evidence are key. Instead of focusing solely on traditional milestones, embrace experimentation, feedback, and iteration—treating failures as valuable data. Asking questions like “What happened? Why? So what?” helps teams adapt quickly to evolving challenges. Meerkat Learning exemplified this by running an A/B test to compare in-person visits with a visit-and-call approach for remote coaching. The results showed similar learning outcomes with a 20% cost reduction, prompting them to run a second test to validate the findings.
Write Down (Codify) Business as Usual
Knowledge about how things are actually happening often lives in people’s heads. Documenting key processes helps align teams, clarify deviations from the plan, and identify areas for improvement. Comparing what’s happening to the original plan can uncover discrepancies and their causes. For instance, Impact Network (PEAS) began by aligning on their Theory of Change, focusing on actual implementation rather than intended outcomes. They then codified their professional development delivery, making this information accessible to both new and remote team members, which provided valuable insights that informed their intervention tweak.
To truly advance implementation research, we must go beyond asking “what works” to understanding how and why an evidence-based solution works. By sharing the process behind successful tweaks, we can help others adapt and replicate these solutions in their own contexts. By blending qualitative and quantitative methods and strategically investing in tweaks, we ensure that our work is both effective and scalable.
We’re excited to continue exploring these techniques and sharing insights that will help shape the future of implementation research.
