How to Refine and Prioritize Key Performance Indicators for Digital Health Interventions
What’s the current context? Why the need for this article?
The methodology used is unusual in a non-research exercise, as the authors said, but it provided a clear consultative framework and structure that facilitated the achievement of consensus within the large Gravitate Health consortium of 250 members on a substantial list of KPIs for the project. Consortium members ranked the relevance and importance of each KPI.
The final list of KPIs provides substantial indicators sensitive to the needs of a broad group of stakeholders that are being used to capture real-world data in developing and evaluating digital health interventions (DHIs). These have the potential to prove useful to other international networks or initiatives, investors, public authorities or policymakers, technology & service providers, and of course researchers and academics.
What to expect in the article?
- The first stage of this was the consultative process for the development of KPIs involving stakeholder (Gravitate Health project leads) consultations at the planning stages of the project. This resulted in the formation of an extensive list of KPIs organized into 7 categories.
- The second stage was conducting a scoping review, which confirmed the need for extensive stakeholder consultation in all stages of the KPI development, refinement, and prioritization process.
- The third stage was a period of further consultation with all consortium members, which resulted in the elimination of 1 category of KPIs.
- The fourth stage involved using the Delphi technique for refining and prioritizing the remaining 6 categories of KPIs.
Though the specific KPIs identified by this project may not be generalizable to all digital health intervention evaluations, this paper offers a useful first step toward a common methodology for the development of KPIs for DHIs.
Excerpt from the paper’s Discussion published in the J Med Internet Res 2025;27:e68757 .
Where to read the article?
If you’re interested in discovering more on the Tutorial on refining and prioritizing KPIs for digital health interventions using consensus methodology, then click here to view the full article.
Contact Information:
Catherine McCabe – School of Nursing and Midwifery Trinity College Dublin, Dublin, Ireland camccabe@tcd.ie
