Editorial

International Journal of Health Governance

ISSN: 2059-4631

Article publication date: 12 October 2021

Issue publication date: 12 October 2021

266

Citation

Ibragimova, I. and Phagava, H. (2021), "Editorial", International Journal of Health Governance, Vol. 26 No. 3, pp. 221-224. https://doi.org/10.1108/IJHG-09-2021-138

Publisher

:

Emerald Publishing Limited

Copyright © 2021, Emerald Publishing Limited


Reporting guidelines and research frameworks

To make international scientific communication more efficient, research articles and other scientific publications should be complete, concise and clear (EASE, 2018). Established tools to achieve these are reporting guidelines for different types of research as well as research design. Over the last 20 years, more than 400 reporting guidelines have been developed, with some of them being regularly updated (Caulley et al., 2020). They help authors, peer reviewers and journal editors to improve transparency and accessibility of research, as well as to reduce research waste by making it more reproducible (Logullo et al., 2020), but also making it obvious as to what research has taken place to avoid duplication. More importantly, it helps reporting of research in such a manner that it protects both the authors and publishers of such research in avoiding potential unethical practices within both study design and the reporting of results. Such guidelines also aid literature reviewing, where comparing research methods, strengths and weaknesses of research etc. is vital. Completeness of reporting is also potentially associated with higher citation counts (Vilaró et al., 2019).

Many initiators of guidelines exist, and it shows that we are heading in the right direction by making research more transparent. A leading international initiative supporting the development and application of reporting guidelines is the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network – an “umbrella” organization that brings together researchers, medical journal editors, peer reviewers, developers of reporting guidelines, research funding bodies and other collaborators with mutual interest in improving the quality of research publications and of research itself. They define a research reporting guideline as a checklist, flow diagram or structured text to guide authors in reporting a specific type of research, developed using an explicit methodology, which presents a clear list of reporting items that should appear in a paper and explains how the list was developed. The EQUATOR Library contains a comprehensive database of reporting guidelines that can be searched by study design, by specialty and by section of report (EQUATOR. Search for reporting guidelines).

This editorial reports the findings of an analysis of published articles from the last seven issues of the International Journal of Health Governance (IJHG) (Vol. 25, issues 1–4, and Vol. 26, issues 1–3). From 47 papers included in our analysis, only four (8.5%) stated using and actually followed specific reporting guidelines (PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and PRISMA extention for scoping reviews). Among 157 highly cited guidelines for health research, PRISMA is in fact the most cited (Caulley et al., 2020). Amongst many other consensus-based guidelines for reporting research that could guide authors submitting to IJHG are STROBE (The Strengthening the Reporting of Observational Studies in Epidemiology) for observational studies, CARE (CAse REports) for case reports, COREQ (Consolidated criteria for reporting qualitative research) for qualitative research, SQUIRE for quality improvement studies, SQUIRE-EDU (Standards for QUality Improvement Reporting Excellence -Health Professions Education) for educational improvement studies, CHEERS (Consolidated Health Economic Evaluation Reporting Standards) for health economic evaluations, STARE-HI (Statement on reporting of evaluation studies in Health Informatics) for evaluation studies in health informatics and RAMESES (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) for realist evaluation in the assessment of complex interventions.

In their requirements for the article's methods section, many reporting guidelines recommend to elaborate on which descriptive or theoretical frameworks and models the research was based. This could add to the quality of publications in many ways: “using adequate research frameworks and models helps research studies to frame study questions and hypotheses, link to important background literature, clarify constructs to be measured, depict relationships to be tested and contextualize results, they provide a common language and thus allow to advance and develop cumulative evidence” (Birken et al., 2017). A recent systematic review has proved the utility of applying comprehensive implementation frameworks in implementation research (Louie et al., 2021).

The widely used frameworks for public health and health systems research are CFIR (Consolidated Framework for Implementation Research), RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance), EPIS (Exploration, Preparation, Implementation, Sustainment) and the Medical Research Council framework for evaluating the processes of complex public health interventions (Ridde et al., 2020; Glasgow et al., 2019; Shahsavari et al., 2020). While some established frameworks are adapted to specific contexts (Means et al., 2020), new frameworks to answer evolving research questions are also constantly developed, for example, eHealth Trust Model, a conceptual framework to guide patient privacy research (Shen et al., 2019), and embedded implementation research framework (Varallyay et al., 2020).

Despite the value in using research frameworks, recent reviews of implementation frameworks highlighted their limited use in research and practice (Moullin et al., 2020). One of the problems is the challenge for researchers to choose from a growing number of frameworks: recent reviews identified over 100 frameworks used in implementation research (Birken et al., 2017) and 16 frameworks for assessment of health systems governance (Pyone et al., 2017). The tools that could help researchers are Theory, Model, and Framework Comparison and Selection Tool (T-CaST), which defines specific implementation framework selection criteria, and Dissemination & Implementation Models Webtool, an interactive resource designed to help researchers and practitioners navigate models (frameworks) in health research and practice through planning, selecting, combining, adapting, using and linking to measures (Birken et al., 2018).

There are also concerns that research frameworks are not used optimally, for example “where it is applied conceptually, but not operationalized or incorporated throughout the phases of an implementation effort, such as limited use to guide research methods” (Moullin et al., 2020). While there is published guidance on the use of several widely used frameworks (including CFIR, RE-AIM, EPIS), recent analysis concluded that there is a need “of explicit guidance on the use of frameworks generally” and provided ten recommendations for using conceptual and theoretical frameworks in implementation research and practice (Moullin et al., 2020).

From 47 papers included in our IJHG (International Journal of Health Governance) analysis, 30 (63.8%) provided information about research frameworks, models or theories on which the authors based their research.

What could be done to improve completeness of reporting and thus add to the quality of papers published in general and in this journal specifically? There is a variety of strategies that journals can apply to enhance adherence to reporting guidelines in health research (Blanco et al., 2019). IJHG has already implemented some of them by establishing in summer 2020 a group of methodology peer reviewers for knowledge synthesis publications – 12 information professionals/librarians with experience in systematic reviews (Ibragimova and Phagava, 2020). Among other suggested strategies is regular auditing of the quality of published papers and sharing this information with journal's readers, members of Editorial Advisory Board and peer reviewers – we agree that “making such information available to the public would send a strong positive signal about openness, sharing data and the journal's commitment to continuous quality improvement” (Moher, 2018).

We therefore turn to our future authors and encourage them to use appropriate reporting guidelines while preparing their submissions to the scientific journal and to be more explicit and precise when describing theoretical terminologies and constructs, which will help the peer reviewers in comprehensive appraisal of submitted manuscripts and thus contribute to the quality of publications.

References

Birken, S.A., Powell, B.J., Presseau, J., Kirk, M., Lorencatto, F., Gould, N.J., Shea, C.M., Weiner, B.J., Francis, J.J., Yu, Y., Haines, E. and Damschroder, L.J. (2017), “Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): a systematic review”, Implementation Science, Vol. 12, Article No. 2, doi: 10.1186/s13012-016-0534-z.

Birken, S.A., Rohweder, C.L., Powell, B.J., Shea, C.M., Scott, J., Leeman, J., Grewe, M.E., Kirk, M.A., Damschroder, L., Aldridge II, W.A., Haines, E.R., Straus, S. and Presseau, J. (2018), “T-CaST: an implementation theory comparison and selection tool”, Implementation Science, Vol. 13, Article No. 143, doi: 10.1186/s13012-018-0836-4.

Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J.J. and Cobo, E. (2019), “Scoping review on interventions to improve adherence to reporting guidelines in health research”, BMJ Open, Vol. 9 No. 5, e026589, doi: 10.1136/bmjopen-2018-026589.

Caulley, L., Cheng, W., Catalá-López, F., Whelan, J., Khoury, M., Ferraro, J., Husereau, D., Altman, D.G. and Moher, D. (2020), “Citation impact was highly variable for reporting guidelines of health research: a citation analysis”, Journal of Clinical Epidemiology, Vol. 127, pp. 96-104, doi: 10.1016/j.jclinepi.2020.07.013.

Consolidated Framework for Implementation Research (CFIR), Available at: https://cfirguide.org/.

Glasgow, R.E., Harden, S.M., Gaglio, B., Rabin, B., Smith, M.L., Porter, G.C., Ory, M.G. and Estabrooks, P.A. (2019), “RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review”, Frontiers in Public Health, Vol. 7, Article No. 64, doi: 10.3389/fpubh.2019.00064.

Ibragimova, I. and Phagava, H. (2020), “Editorial”, International Journal of Health Governance, Vol. 25 No. 4, pp. 281-285, doi: 10.1108/IJHG-12-2020-120.

Logullo, P., de Beyer, J.A., Kirtley, S., Struthers, C. and Collins, G.S. (2020), “Reporting guidelines should be free to publish, read, and use”, Journal of Global Health, Vol. 10 No. 2, 0203107, doi: 10.7189/jogh.10.0203107.

Louie, E., Barrett, E.L., Baillie, A., Haber, P. and Morley, K.C. (2021), “A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework”, Implementation Science, Vol. 16, Article No. 22, doi: 10.1186/s13012-021-01090-7.

Means, A.R., Kemp, C.G., Gwayi-Chore, M.C., Gimbel, S., Soi, C., Sherr, K., Wagenaar, B.H., Wasserheit, J.N. and Weiner, B.J. (2020), “Evaluating and optimizing the consolidated framework for implementation research (CFIR) for use in low- and middle-income countries: a systematic review”, Implementation Science, Vol. 15, Article No. 17, doi: 10.1186/s13012-020-0977-0.

Moher, D. (2018), “Reporting guidelines: doing better for readers”, BMC Medicine, Vol. 16, Article No. 233, doi: 10.1186/s12916-018-1226-0.

Moullin, J.C., Dickson, K.S., Stadnick, N.A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B. and Aarons, G.A. (2020), “Ten recommendations for using implementation frameworks in research and practice”, Implementation Science Commununications, Vol. 1, Article No. 42, doi: 10.1186/s43058-020-00023-7.

Pyone, T., Smith, H. and van den Broek, N. (2017), “Frameworks to assess health systems governance: a systematic review”, Health Policy Plan, Vol. 32 No. 5, pp. 710-722, doi: 10.1093/heapol/czx007.

RE-AIM, Available at: http://www.re-aim.org.

Ridde, V., Pérez, D. and Robert, E. (2020), “Using implementation science theories and frameworks in global health”, BMJ Global Health, Vol. 5 No. 4, e002269.

Shahsavari, H., Matourypour, P., Ghiyasvandian, S. and Nejad, M. (2020), “Medical Research Council framework for development and evaluation of complex interventions: a comprehensive guidance”, Journal of Education and Health Promotion, Vol. 9 No. 88, doi: 10.4103/jehp.jehp_649_19.

Shen, N., Strauss, J., Silver, M., Carter-Langford, A. and Wiljer, D. (2019), “The eHealth Trust model: a patient privacy research framework”, Studies in Health Technology and Informatics, Vol. 257, pp. 382-387.

Varallyay, N.I., Langlois, E.V., Tran, N., Elias, V. and Reveiz, L. (2020), “Health system decision-makers at the helm of implementation research: development of a framework to evaluate the processes and effectiveness of embedded approaches”, Health Research Policy and Systems, Vol. 18, Article No. 64, doi: 10.1186/s12961-020-00579-9.

Vilaró, M., Cortés, J., Selva-O’Callaghan, A., Urrutia, A., Ribera, J.-M., Cardellach, F., Basagaña, X., Elmore, M., Vilardell, M., Altman, D., González, J.-A. and Cobo, E. (2019), “Adherence to reporting guidelines increases the number of citations: the argument for including a methodologist in the editorial process and peer-review”, BMC Medical Research Methodology, Vol. 19, Article No. 112, doi: 10.1186/s12874-019-0746-4.

Further reading

Dissemination and Implementation Models in Health Research and Practice, Available at: https://dissemination-implementation.org/index.aspx.

EQUATOR (2017), “Search for reporting guidelines. Enhancing the QUAlity and transparency of health research”, available at: http://www.equatornetwork.org/reporting-guidelines/ (accessed 28 April 2021).

National Academies of Sciences, Engineering, and Medicine (2019), Reproducibility and Replicability in Science, The National Academies Press, Washington, DC, p. 256, doi: 10.17226/25303.

Nilsen, P., Ingvarsson, S., Hasson, H., von Thiele Schwarz, U. and Augustsson, H. (2020), “Theories, models, and frameworks for de-implementation of low-value care: a scoping review of the literature”, Implementation Research and Practice. doi: 10.1177/2633489520953762.

Research Reporting Guidelines and Initiatives: By Organization, Available at: https://www.nlm.nih.gov/services/research_report_guide.html.

Related articles