1887
  1. Home
  2. Eurosurveillance
  3. Volume 30, Issue 19, 15/May/2025
  4. Article
Review Open Access
Like 0
Download

Abstract

Background

Evidence-informed decision-making in public health (PH) is a complex process requiring the consideration of multiple perspectives and contextual factors. Evidence-to-decision (EtD) frameworks are structured approaches aiming to improve decision-making by considering critical criteria, but users’ experience has not been systematically synthesised.

Aim

We aim to summarise users’ experiences of EtD frameworks used for PH.

Methods

As part of a broader scoping review, we identified 15 EtD frameworks for PH decision-making. We searched MEDLINE and Health Systems Evidence, conducted a hand search and citation search strategy for documents reporting users’ experience of EtD frameworks and surveyed key stakeholders. We conducted a descriptive thematic synthesis, identifying main barriers and facilitators, complementing with surveys to relevant stakeholders.

Results

We identified 12 studies reporting users’ experience of two EtD frameworks: Grading of Recommendations Assessment, Development and Evaluation (n = 9) and World Health Organization INTEGRATe Evidence (n = 3). Both were perceived as structured approaches that enhanced the use of evidence while including contextual factors and facilitating consensus-building processes. Main barriers were lack of high-quality evidence for the effectiveness of PH interventions, limitations of the terminology or unclear boundaries between specific criteria, perceptions of missing criteria and the need for more guidance. Survey responses (n = 13) were consistent with these findings.

Conclusion

Users of the two frameworks had an overall positive perception of the approaches, but several barriers remain. These experiences may change over time as the frameworks evolve. There is an evidence gap regarding users’ experience for other EtD frameworks.

© Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Loading

Article metrics loading...

/content/10.2807/1560-7917.ES.2025.30.19.2400184
2025-05-15
2025-05-17
/content/10.2807/1560-7917.ES.2025.30.19.2400184
Loading
Loading full text...

Full text loading...

/deliver/fulltext/eurosurveillance/30/19/eurosurv-30-19-4.html?itemId=/content/10.2807/1560-7917.ES.2025.30.19.2400184&mimeType=html&fmt=ahah

References

  1. Moberg J, Oxman AD, Rosenbaum S, Schünemann HJ, Guyatt G, Flottorp S, et al. The GRADE Evidence to Decision (EtD) framework for health system and public health decisions. Health Res Policy Syst. 2018;16(1):45.  https://doi.org/10.1186/s12961-018-0320-2  PMID: 29843743 
  2. Pohl HR, Jones DE, Holler JS, Murray HE. Public health decisions: actions and consequences. Regul Toxicol Pharmacol. 2014;70(1):363-9.  https://doi.org/10.1016/j.yrtph.2014.07.023  PMID: 25092130 
  3. Wabnitz K, Rueb M, Pfadenhauer LM, Strahwald B, Rehfuess EA. Rapid development of an evidence- and consensus-based guideline for controlling transmission of SARS-CoV-2 in schools during a public health emergency - A process evaluation. Front Public Health. 2023;11:1075210.  https://doi.org/10.3389/fpubh.2023.1075210  PMID: 37064706 
  4. World Health Organization (WHO). Evidence, policy, impact. WHO guide for evidence-informed decision-making. Geneva: WHO; 2021. Available from: https://www.who.int/publications/i/item/9789240039872
  5. Ciliska D, Thomas H, Buffett C. An Introduction to Evidence-Informed Public Health and a Compendium of Critical Appraisal Tools for Public Health Practice. Hamilton: National Collaborating Centre for Methods and Tools, McMaster University; 2010. Available from: https://www.nccmt.ca/uploads/media/media/0001/01/b331668f85bc6357f262944f0aca38c14c89c5a4.pdf
  6. Williams JH, Hooker C, Gilbert GL, Hor S, Degeling C. Disagreement among experts about public health decision making: is it polarisation and does it matter? BMJ Glob Health. 2023;8(3):e011182.  https://doi.org/10.1136/bmjgh-2022-011182  PMID: 36948532 
  7. Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30(1):175-201.  https://doi.org/10.1146/annurev.publhealth.031308.100134  PMID: 19296775 
  8. Alonso-Coello P, Schünemann HJ, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, et al. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ. 2016;353:i2016.  https://doi.org/10.1136/bmj.i2016  PMID: 27353417 
  9. Meneses-Echavez JF, Bidonde J, Yepes-Nuñez JJ, Poklepović Peričić T, Puljak L, Bala MM, et al. Evidence to decision frameworks enabled structured and explicit development of healthcare recommendations. J Clin Epidemiol. 2022;150:51-62.  https://doi.org/10.1016/j.jclinepi.2022.06.004  PMID: 35710054 
  10. Morgan RL, Kelley L, Guyatt GH, Johnson A, Lavis JN. Decision-making frameworks and considerations for informing coverage decisions for healthcare interventions: a critical interpretive synthesis. J Clin Epidemiol. 2018;94:143-50.  https://doi.org/10.1016/j.jclinepi.2017.09.023  PMID: 28988959 
  11. Norris SL, Aung MT, Chartres N, Woodruff TJ. Evidence-to-decision frameworks: a review and analysis to inform decision-making for environmental health interventions. Environ Health. 2021;20(1):124.  https://doi.org/10.1186/s12940-021-00794-z  PMID: 34876125 
  12. Song Y, Bracchiglione J, Meneses-Echávez JF, de Carvalho Gomes H, Albiger B, Solà I, et al. Frameworks to support evidence-informed decision-making in public health and infectious disease prevention and control: a scoping review. Euro Surveill. 2025;30(19):2400185.  https://doi.org/10.2807/1560-7917.ES.2025.30.19.2400185 
  13. European Centre for Disease Prevention and Control (ECDC). A scoping review and survey on Evidence-to-Decision Frameworks in public health. Stockholm: ECDC; 4 Apr 2025. Available from: https://www.ecdc.europa.eu/en/publications-data/scoping-review-and-survey-evidence-decision-frameworks-public-health
  14. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467-73.  https://doi.org/10.7326/M18-0850  PMID: 30178033 
  15. Bracchiglione J, Song Y, Comas DR, Alonso-Coello P. Frameworks to support evidence-informed decision-making from a public health perspective. OSF Preprints; 2023.  https://doi.org/10.31219/osf.io/9drm6 
  16. Schünemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186(3):E123-42.  https://doi.org/10.1503/cmaj.131237  PMID: 24344144 
  17. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8(1):45.  https://doi.org/10.1186/1471-2288-8-45  PMID: 18616818 
  18. Rosenbaum SE, Moberg J, Glenton C, Schünemann HJ, Lewin S, Akl E, et al. Developing Evidence to Decision Frameworks and an Interactive Evidence to Decision Tool for Making and Using Decisions and Recommendations in Health Care. Glob Chall. 2018;2(9):1700081.  https://doi.org/10.1002/gch2.201700081  PMID: 31565348 
  19. Li SA, Alexander PE, Reljic T, Cuker A, Nieuwlaat R, Wiercioch W, et al. Evidence to Decision framework provides a structured "roadmap" for making GRADE guidelines recommendations. J Clin Epidemiol. 2018;104:103-12.  https://doi.org/10.1016/j.jclinepi.2018.09.007  PMID: 30253221 
  20. Guldbrandsson K, Stenström N, Winzer R. The DECIDE evidence to recommendation framework adapted to the public health field in Sweden. Health Promot Int. 2016;31(4):749-54.  https://doi.org/10.1093/heapro/dav060  PMID: 26082448 
  21. Neumann I, Brignardello-Petersen R, Wiercioch W, Carrasco-Labra A, Cuello C, Akl E, et al. The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels. Implement Sci. 2016;11(1):93.  https://doi.org/10.1186/s13012-016-0462-y  PMID: 27417219 
  22. Meneses-Echavez JF, Rosenbaum S, Rada G, Flottorp S, Moberg J, Alonso-Coello P. Users’ experiences with an interactive Evidence to Decision (iEtD) framework: a qualitative analysis. BMC Med Inform Decis Mak. 2021;21(1):169.  https://doi.org/10.1186/s12911-021-01532-8  PMID: 34034723 
  23. Friesen VM, Mbuya MNN, Wieringa FT, Nelson CN, Ojo M, Neufeld LM. Decisions to Start, Strengthen, and Sustain Food Fortification Programs: An Application of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Evidence to Decision (EtD) Framework in Nigeria. Curr Dev Nutr. 2022;6(3):nzac010.  https://doi.org/10.1093/cdn/nzac010  PMID: 35261958 
  24. Stadelmaier J, Rehfuess EA, Forberger S, Eisele-Metzger A, Nagavci B, Schünemann HJ, et al. Using GRADE Evidence to Decision frameworks to support the process of health policy-making: an example application regarding taxation of sugar-sweetened beverages. Eur J Public Health. 2022;32(Suppl 4):iv92-100.  https://doi.org/10.1093/eurpub/ckac077  PMID: 36444109 
  25. Stratil JM, Paudel D, Setty KE, Menezes de Rezende CE, Monroe AA, Osuret J, et al. Advancing the WHO-INTEGRATE Framework as a Tool for Evidence-Informed, Deliberative Decision-Making Processes: Exploring the Views of Developers and Users of WHO Guidelines. Int J Health Policy Manag. 2022;11(5):629-41.  PMID: 33131223 
  26. Murano M, Chou D, Costa ML, Turner T. Using the WHO-INTEGRATE evidence-to-decision framework to develop recommendations for induction of labour. Health Res Policy Syst. 2022;20(1):125.  https://doi.org/10.1186/s12961-022-00901-7  PMID: 36344986 
  27. Moleman M, Jerak-Zuiderent S, van de Bovenkamp H, Bal R, Zuiderent-Jerak T. Evidence-basing for quality improvement; bringing clinical practice guidelines closer to their promise of improving care practices. J Eval Clin Pract. 2022;28(6):1003-26.  https://doi.org/10.1111/jep.13659  PMID: 35089625 
  28. Stalteri Mastrangelo R, Santesso N, Bognanni A, Darzi A, Karam S, Piggott T, et al. Consideration of antimicrobial resistance and contextual factors in infectious disease guidelines: a systematic survey. BMJ Open. 2021;11(7):e046097.  https://doi.org/10.1136/bmjopen-2020-046097  PMID: 34330853 
  29. de With K, Allerberger F, Amann S, Apfalter P, Brodt HR, Eckmanns T, et al. Strategies to enhance rational use of antibiotics in hospital: a guideline by the German Society for Infectious Diseases. Infection. 2016;44(3):395-439.  https://doi.org/10.1007/s15010-016-0885-z  PMID: 27066980 
  30. Rehfuess EA, Akl EA. Current experience with applying the GRADE approach to public health interventions: an empirical study. BMC Public Health. 2013;13(1):9.  https://doi.org/10.1186/1471-2458-13-9  PMID: 23294803 
  31. Zähringer J, Schwingshackl L, Movsisyan A, Stratil JM, Capacci S, Steinacker JM, et al. Use of the GRADE approach in health policymaking and evaluation: a scoping review of nutrition and physical activity policies. Implement Sci. 2020;15(1):37.  https://doi.org/10.1186/s13012-020-00984-2  PMID: 32448231 
  32. Rosenbaum SE, Glenton C, Oxman AD. Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010;63(6):620-6.  https://doi.org/10.1016/j.jclinepi.2009.12.014  PMID: 20434024 
  33. Vickery J, Atkinson P, Lin L, Rubin O, Upshur R, Yeoh EK, et al. Challenges to evidence-informed decision-making in the context of pandemics: qualitative study of COVID-19 policy advisor perspectives. BMJ Glob Health. 2022;7(4):e008268.  https://doi.org/10.1136/bmjgh-2021-008268  PMID: 35450862 
  34. Brubacher LJ, Lovato CY, Sri V, Cheng M, Berman P. The use of evidence to guide decision-making during the COVID-19 pandemic: Divergent perspectives from a qualitative case study in British Columbia, Canada. Research Square. 2023. Available from: https://www.researchsquare.com/article/rs-2564918/v1 https://doi.org/10.21203/rs.3.rs-2564918/v1 
  35. Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth. 2020;18(10):2119-26.  https://doi.org/10.11124/JBIES-20-00167  PMID: 33038124 
  36. Rehfuess EA, Stratil JM, Scheel IB, Portela A, Norris SL, Baltussen R. The WHO-INTEGRATE evidence to decision framework version 1.0: integrating WHO norms and values and a complexity perspective. BMJ Glob Health. 2019;4(Suppl 1):e000844.  https://doi.org/10.1136/bmjgh-2018-000844  PMID: 30775012 
  37. McGowan J, Akl EA, Coello PA, Brennan S, Dahm P, Davoli M, et al. Update on the JCE GRADE series and other GRADE article types. J Clin Epidemiol. 2021;140:163-4.  https://doi.org/10.1016/j.jclinepi.2021.05.023  PMID: 34089781 
  38. Jamieson MK, Govaart GH, Pownall M. Reflexivity in quantitative research: A rationale and beginner’s guide. Soc Personal Psychol Compass. 2023;17(4):e12735.  https://doi.org/10.1111/spc3.12735 
  39. Bero LA, Grundy Q. Why Having a (Nonfinancial) Interest Is Not a Conflict of Interest. PLoS Biol. 2016;14(12):e2001221.  https://doi.org/10.1371/journal.pbio.2001221  PMID: 28002462 
  40. Rosenbaum SE. Improving the user experience of evidence. A design approach to evidence-informed health care [dissertation]. Oslo: Oslo College of Architecture and Design; 2010. Available from: https://aho.brage.unit.no/aho-xmlui/bitstream/handle/11250/93062/Rosenbaum_thesis.pdf
  41. Kuckartz U. Die inhaltlich strukturierende qualitative Inhaltsanalyse. [The content-structuring qualitative content analysis]. In: Kuckartz U (editor). Qualitative Inhaltsanalyse: Methoden, Praxis, Computerunterstützung. 4th ed. Weinheim: Beltz Juventa; 2018. p. 97–122. German.
Users’ experience of frameworks to support evidence-informed decision-making in public health: a scoping review
<p class="citation"> <span>Citation style for this article:</span> <span class="meta-value authors"> <a href="/search?value1=Javier+Bracchiglione&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Bracchiglione Javier</a>, <a href="/search?value1=Yang+Song&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Song Yang</a>, <a href="/search?value1=Jose+F+Meneses-Ech%C3%A1vez&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Meneses-Echávez Jose F</a>, <a href="/search?value1=Helena+de+Carvalho+Gomes&option1=author&noRedirect=true" class="nonDisambigAuthorLink">de Carvalho Gomes Helena</a>, <a href="/search?value1=Barbara+Albiger&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Albiger Barbara</a>, <a href="/search?value1=Ivan+Sol%C3%A0&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Solà Ivan</a>, <a href="/search?value1=David+Rigau&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Rigau David</a>, <a href="/search?value1=Pablo+Alonso-Coello&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Alonso-Coello Pablo</a></span>. Users’ experience of frameworks to support evidence-informed decision-making in public health: a scoping review. <a href="/content/ecdc">Euro Surveill.</a> 2025;30(19):pii=2400184. <a href="https://doi.org/10.2807/1560-7917.ES.2025.30.19.2400184" title="doi link" target="_blank">https://doi.org/10.2807/1560-7917.ES.2025.30.19.2400184</a> <span class="ES_Article_citation"> <span class="generated">Received</span>: 26 Mar 2024;&nbsp;&nbsp; <span class="generated">Accepted</span>: 22 Feb 2025 </span> </p>
/content/10.2807/1560-7917.ES.2025.30.19.2400184
/content/10.2807/1560-7917.ES.2025.30.19.2400184
Loading

Data & Media loading...

Supplementary data

Submit comment
Close
Comment moderation successfully completed
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error