Skip to main content
BMJ Open logoLink to BMJ Open
. 2024 Mar 8;14(3):e078414. doi: 10.1136/bmjopen-2023-078414

Effects of task shifting from primary care physicians to nurses: a protocol for an overview of systematic reviews

Muna Paier-Abuzahra 1, Nicole Posch 1,, Ulrike Spary-Kainz 1, Christina Radl-Karimi 1, Thomas Semlitsch 1, Klaus Jeitler 1,2, Andrea Siebenhofer 1,3
PMCID: PMC10928766  PMID: 38458792

Abstract

Introduction

Task-shifting from primary care physicians (PCPs) to nurses is one option to better and more efficiently meet the needs of the population in primary care and to overcome PCP shortages. This protocol outlines an overview of systematic reviews to assess the effects of delegation or substitution by nurses of PCPs’ activities regarding clinical, patient-relevant, professional and health services-related outcomes.

Methods and analysis

We will conduct a systematic literature search for secondary literature in PubMed/MEDLINE, EMBASE, CINAHL and Cochrane databases. Systematic reviews, meta-analyses and Health Technology Assessments in German and English comprising randomised controlled trials and prospective controlled trials will be considered for inclusion. Search terms will include Medical Subject Headings combined with free text words. At least one-third of abstracts and full-text articles are reviewed by two independent reviewers. Methodological quality will be assessed using the Overview Quality Assessment Questionnaire. We will only consider reviews if they include controlled trials, if the profession that substituted or delegated tasks was a nurse, if the profession of the control was a PCP, if the assessed intervention was the same in the intervention and control group and if the Overview Quality Assessment Questionnaire score is ≥5. The corrected covered area will be calculated to describe the degree of overlap of studies in the reviews included in the study. We will report the overview according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.

Ethics and dissemination

The overview of secondary literature does not require the approval of an Ethics Committee and will be published in a peer-reviewed journal.

PROSPERO registration number

CRD42020183327.

Keywords: Primary Health Care, Nursing Care, GENERAL MEDICINE (see Internal Medicine), Quality in health care


Strengths and limitations of this study.

  • This overview will include systematic reviews identified by a systematic literature search conducted in five databases.

  • We will include only high-quality reviews with controlled trials using the Overview Quality Assessment Questionnaire for quality assessment and exclude reviews with a score <5.

  • We will use a citation matrix to show the overlap in the included reviews and calculate the corrected covered area as a measure of the degree of overlap.

Background

Primary care, as the foundation of every healthcare system, is of great importance.1 Primary care physicians (PCPs) serve as the first point of medical contact, act as a guide and coordinator in the health system, empower patients and provide long-term care for the chronically ill.2 Furthermore, strong primary care is associated with better health outcomes.3 17 out of 24 European countries, including Norway, report a shortage of medical doctors.4 In many OECD (Organisation for Economic Co-operation and Development) countries, there are concerns about a shortage of medical doctors, particularly general practitioners and doctors in rural areas. This is because there is often a high concentration of doctors in national capital regions (eg, Austria, the Czech Republic, Denmark, Greece, Hungary, Portugal, the Slovak Republic and the USA).5 Possible shortages of PCP may make it challenging for some countries to maintain high-quality primary care and provide sufficient coverage in all regions. This could be a challenge especially in regions where vacancies are particularly difficult to fill, such as rural areas.6 7 A simulation by WHO in 20178 showed different scenarios for countries regarding the health workforce based on this simulation, certain countries may experience a surplus in nurses but a shortfall in physicians, such as Austria, Hungary, Japan, Republic of Korea, Slovakia and Slovenia. In contrast to this, other countries may experience a shortage of both professions (eg, USA). Projections for PCPs predict a shortage of between 17 800 and 48 000 physicians in the USA by 2034.9 However, we do not know how numbers in professions will develop actually, as the simulations underly several assumptions and are sensitive to differences in these assumptions.8 Moreover, many countries try to counteract these challenges with a number of measures. There is already some work available that proposes measures.6 10

However, nurses are the largest workforce in most healthcare systems.11–13 Their roles in the healthcare system include health promotion, disease prevention, care of physically ill, mentally ill and disabled people in both inpatient and outpatient settings.14

Although physicians and nurses are two distinct professions with different roots and philosophical backgrounds,15 task-shifting from PCPs to nurses is one option to better and more efficiently meet the needs of the populations in the primary care setting and to overcome PCP shortages. Nursing promotes self-care16 and the independent performance of activities that contribute to health or recovery,14 which aligns with some aspects of the WONCA (World Organization of Family Doctors) definition of general practice.2 There are certain aspects of primary care nursing and general practice that are common to both professions, although they should be regarded as distinct.

The role of nurses in primary care varies across countries. A WHO report analysed 40 European countries in terms of their primary care and professional groups. In 17 out of 40 European countries, nurses work in primary care settings. However, the report does not specify whether nurses work directly in general practices or as community nurses or home care nurses.17 In Great Britain, there are general practice nurses (GPN) who work on different levels, including practitioner, senior level, advanced nurse practitioner and consultant practitioner. Typically, they hold a bachelor’s degree with a special education for general practice. Depending on the level, nurses make a significant contribution to primary care, with a wide range of competencies including the promotion of healthy lifestyles, vaccination programmes, performance of diagnostic procedures such as ECG and spirometries and therapeutic procedures such as wound care, cannulation of venous lines, prescription of medication, follow-up of patients with chronic pathologies, including health education.18–21

In the primary care setting, there are two main professional nursing groups: practice nurses (or primary (health) care nurses) who primarily support general practitioners, and advanced nurse practitioners, who have an extended area of expertise based on in-depth education, usually at the master’s level. They sometimes also work in a general practice-substituting position.22

Previous systematic reviews have demonstrated that substituting PCP tasks with nurses could improve outcomes.23 24 The assessed interventions included preventative and curative measures, urgent consultations and treatment of patients with chronic conditions. The evidence was of low to moderate quality.23 Overviews of systematic reviews on similar topics have been published. They however focused on more occupational groups eligible for task-shifting and the methods used were more open to different study designs.25 In addition, the definition of the primary care setting was broader.25 26

There is a lack of a comprehensive review that evaluates preventive, curative, rehabilitative and palliative interventions in primary care, especially those provided by nurse substitutes for PCPs, using a rigorous methodology based on prospective controlled trials and reporting the results as comprehensively as possible, so that decision-makers in different healthcare systems can make decisions based on a high level of evidence. We also know little about the education that nurses receive before they start substituting. It is unclear whether the education of GPN is academic, leading to a bachelor’s, master’s or doctoral degree or whether it is specific, non-academic education and whether and to what extent the education includes practice.

Aim and review questions

The aim of the overview of systematic reviews is to assess the effects of delegation or substitution of PCPs’ activities by nurses on clinical, patient-relevant, professional and health services-related outcomes and to provide an overview of all primary care tasks that can be performed by nurses.

The review questions are:

  1. Which tasks and complex interventions usually carried out by PCPs are delegated to or substituted by nurses?

  2. What are the effects of delegation or substitution by nurses of PCPs’ tasks and interventions compared with routine care provided by PCPs regarding

  • clinical surrogate outcomes,

  • patient-relevant outcomes,

  • professional outcomes and

  • health services-related outcomes?

3. What is the education of nurses who carry out medical activities in the trials?

Methods and analysis

Protocol and registration

The study protocol has been registered on PROSPERO (https://www.crd.york.ac.uk/PROSPERO). The first registration date, and thus the start date, was 7 July 2020. Due to staffing constraints, we did not complete the review in 2020, but restarted the review in 2023. The expected completion date for this overview is 30 March 2024.

This protocol is reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-Protocol 2015 statement27 28 (see online supplemental 1).

Supplementary data

bmjopen-2023-078414supp001.pdf (88KB, pdf)

Patient and public involvement

No patients were involved.

Search strategy

The following databases are searched: PubMed/MEDLINE, EMBASE, Cochrane Library and Cumulative Index of Nursing and Allied Health Literature (CINAHL). Selected terms related to the topics ‘nursing’, ‘substitution’, ‘family physician’ and ‘primary care’ are applied using Medical Subject Headings and free text words. The date of the last search was 23 June 2023. Our search is limited to English and German. The full search strategy is available in the supplement (see online supplemental 2). The search is limited by date from 2020 to 2023 because we have already conducted a search in 2020 and were unable to complete the review due to staffing constraints. We are therefore carrying out an updated search. Our initial search in 2020 was limited to systematic reviews published since 2005. We chose this limitation because it seemed appropriate to us, as medicine, education and healthcare systems and their regulations are constantly evolving. This allows the authors of more recent reviews to better reflect today’s circumstances.

Supplementary data

bmjopen-2023-078414supp002.pdf (331.6KB, pdf)

Inclusion criteria

Inclusion criteria are listed in table 1.

Table 1.

Inclusion criteria

Study design Systematic reviews, meta-analyses or health technology assessments which included randomised controlled trials and prospective controlled trials
Language English, German.
Population Patients being treated in primary care (adults and children).
Intervention Medical task or intervention performed by nurses (delegation or substitution).
Control Medical task or intervention performed by primary care physicians.
Outcomes
  •  Clinical outcomes (eg, blood pressure levels, vaccination coverage, cholesterol levels).

  •  Patient-relevant outcomes (eg, satisfaction, hospitalisation, same-day consultation).

  •  Professional outcomes (eg, job satisfaction, reduced workload, education).

  •  Health services-related outcomes (eg, costs, efficiency, prescription expenditure).

Setting Primary care (results on primary care have to be presented).

We will only consider reviews:

  • If the reviews included studies with controls (randomised controlled trials or prospective controlled trials).

  • If the setting and the study results were clearly assignable to the primary care setting.

  • If the profession that substituted or to whom tasks were delegated tasks was a nurse or study results were reported separately and assignable to nurses.

  • If the control profession was a PCP.

  • If the intervention studied was the same in the intervention group (nurses) and the control group (doctors) (additional services performed by nurses compared with routine care by doctors providing not the same scope of service were not considered).

  • If the publication provided all relevant information (PRISMA criteria were fulfilled; conference abstracts were not considered).

Exclusion criteria:

  • Any task or intervention which is additionally performed to usual care and/or is carried out in an inpatient setting or outpatient secondary care setting.

Screening

A total of four researchers will be involved in the screening process (MP-A, NP, NPL and TS). Of these four people, three are experienced in systematic reviews. The abstracts and full-text articles will be screened independently by two randomly assigned reviewers (from the above-mentioned four researchers). In order to achieve a high level of agreement in the selection of the studies, we will hold a meeting after the first 50 screenings of each person. This will ensure a standardised approach and, if necessary, the inclusion and exclusion criteria will be specified. If we have an agreement rate >90% between the two reviewers after screening one-third of the abstracts, the remaining abstracts will be screened by one experienced scientist alone. Although double screening is recommended, single screening by an experienced researcher may also be considered appropriate.29 As there is no external funding for this project, this approach is planned.

In the event of disagreement between two reviewers, a consensus will be reached by discussion. In the case of uncertainty in a single review, another experienced reviewer will be consulted. Full-text articles will only be considered if they comply with the PRISMA checklist.30 Reasons for the exclusion of full-text articles will be reported. A PRISMA statement flowchart will be used to summarise the selection of studies. If an updated review has been published, we will include the most recent version. Conference abstracts will be excluded because full information according to the PRISMA statement is not available.

Quality assessment

Methodological quality will be assessed using the Overview Quality Assessment Questionnaire (OQAQ).31 32 We will choose the OQAQ because we started the first registration in 2020, but had to stop due to staffing constraints. At the time, we followed the IQWiG methods paper (V.5.0),33 which listed the OQAQ, AMSTAR (Assessing the Methodological Quality of Systematic Reviews) and ROBIS (Risk of Bias in Systematic Reviews) as possible instruments. The OQAQ is a 10-item questionnaire designed to measure the ‘scientific quality’ of review articles (eg, whether the search for evidence was reasonably comprehensive or whether the criteria used to assess the validity of the included studies were reported). In total, a systematic review can receive up to seven points in this assessment tool. If it receives more than five points, it is categorised as having ‘minor or minimal flaws’.32 Therefore, only reviews scoring 5 or more points will be included in the data synthesis and the score of the included reviews will be reported. A methodological analysis of meta-analyses of analgesic interventions showed that about half of the included meta-analyses would meet this criterion (≥5 points), and the median overall score was 4.34 In contrast, a paper evaluating systematic reviews in regular journals had a median score of 1, indicating extensive flaws and Cochrane systematic reviews had a median overall score of 6.35

In order to achieve a more consistent rating, the OQAQ will be supplemented by a list of examples of explanations for the rating, compiled by some of the authors on the basis of their many years of experience. To determine whether there is reporting bias, we will check whether the protocol of the review has been published. We will review the PROSPERO registry.

Data extraction

Data will be extracted according to a structured extraction table. The extraction table will be piloted on two relevant studies to ensure applicability and will be updated as necessary. One reviewer will extract the data and a second reviewer will check or correct the extracted data. Disagreements will be resolved by discussing the conflict or by involving a third reviewer.

The extraction table will include the following characteristics of all included reviews: title, first author, year of publication, date of search, databases, inclusion criteria, number of included studies, OQAQ score, description of the intervention, intervention period, nurse education and outcome measures. We will pay particular attention to information on nurse education. If reviews with a broader research question are included, only the results relevant to our research questions will be extracted. If the systematic reviews do not adequately report on the interventions, the description of the intervention will be extracted from the included primary studies. These results will be published in the results section or the appendices of the final manuscript.

Management of overlapping systematic reviews

We will include all relevant reliable Cochrane and non-Cochrane systematic reviews in the overview regardless of the degree of overlap using the full inclusion technique.36 As an overview of systematic reviews may include reviews that include the same primary studies, it is very important to report overlap. Failure to consider overlap may lead to bias in the results. We will use a citation matrix to show the overlap in the included reviews and will calculate the corrected covered area (CCA) as a measure of the degree of overlap according to Pieper’s suggestion: CCA 0–5 (low), 6–10 (moderate), 11–15 (high), >15 (very high).37 38 In addition, there are several ways of presenting overlap using tables and graphs39; we will try to find an appropriate and easily understandable way of presenting overlap in our review of systematic reviews. We will not carry out a quantitative synthesis and will draw conclusions carefully, taking into account the overlap.

Data synthesis and analysis

The data synthesis will be based on a narrative synthesis. We will report the characteristics of the included reviews in a table and provide all relevant basic information about systematic reviews. We will outline the countries where the original studies were conducted and the nurses’ education. We will provide a list of specific tasks or interventions that nurses have substituted with equal or better outcomes compared with PCPs. We will also provide a list of specific tasks or interventions that nurses have substituted with worse outcomes.

The primary outcomes of our overview are patient-relevant outcomes, including symptoms, complications/adverse events, survival/mortality, pain, quality of life and patient satisfaction. As a guide to what will be defined as a patient-relevant outcome, we will use the results of the scoping review with reported and justified patient-relevant outcomes.40

We will report all prespecified outcomes, regardless of the statistical significance of the results. We will not reanalyse outcomes data for any review or subpopulation. We will stratify the reporting of outcomes by subgroup when deemed appropriate. We will report the overview according to the guidelines in the PRISMA statement41 and a checklist developed by Li et al.42

Meta-analyses will not be carried out because of the likely high heterogeneity and wide variability of the interventions studied.

Discussion

We will perform an overview of systematic reviews to assess the effects of delegation or substitution of PCPs’ activities by nurses on clinical, patient-relevant, professional and health services-related outcomes.

The strength of this overview will be that we will only include high-quality reviews with controlled trials using the OQAQ rating for quality assessment. We will focus only on nurses in the intervention group and accept only PCPs as the control group because we want to compare only these two professions. Results will be reported comprehensively, taking into account relevant influencing factors, including education.

A potential limitation of this overview will be its complexity. The topic analysed is a complex issue in several respects:43

  • Intervention complexity: There may be medical tasks that could be described as a single intervention, such as performing an ECG (echocardiogram), but there are also complex interventions such as disease management programmes or therapies over a longer period of time. These would have more than one or two components, and therefore a comparison between the two professions might be more complicated than for a single intervention.

  • Implementation complexity: There may be different levels of education for the nurses participating in the studies. In addition, the role of nurses in the healthcare system, and thus the basic scope of practice, may vary depending on the country in which each study was conducted. This complicates the interpretation of the results. However, we will try to interpret the results of the studies by level of education. Evidence-based findings on education are important for the future planning of nursing educational programmes, which is why we are also interested in details on the education of the study nurses. We want to find out which medical activities can be carried out by nurses and to what effect, and what education is required for this (eg, academic education or clinical training, how many hours, full-time or part-time).

  • Context complexity: We may detect nurses who are that are specialist nurses, for example, for dermatology, as well as GPN who could completely take over the tasks of the physicians. There will be a difference in interpretation if the nurse is responsible for only one or more indications.

  • Complexity of participant responses: The acceptance of the nurses by the patients in the study may also have an impact on the results.

All these factors may make it difficult to synthesise the results. The results must therefore be presented in detail and the conclusions drawn with caution. Because of the wide range of services substituted by nurses, we expect to get heterogeneous results in terms of interventions and reported outcomes.

Implications for practice

This systematic review should be used by decision-makers (eg, in healthcare systems or primary care centres) to show what evidence is available. The translation of the results into practice in each individual country depends on several influencing factors: the number of doctors and nurses, the education and legal competencies of nurses, the willingness of physicians to give up and of nurses to take on new tasks and acceptance of the patients.

By taking on medical tasks, we expect nurses to do more than just medical work. As nurses have a different philosophical background15 and their key roles include advocacy, promotion of a safe environment, participation in patient management,13 they will have a fundamentally different approach to the work, for example, health promotion, attention to fragility, fall prevention and dependence prevention.

It will be necessary for the decision-makers in each healthcare system to make an individual decision on task-shifting based on their regional and country-specific healthcare situation.

Ethics and dissemination

This review does not require ethics committee approval because it uses only published studies. To the best of our knowledge, this is the first systematic review that directly compares nurses and PCPs and includes only high-quality reviews. This work will provide a list of tasks that can be substituted by nurses for decision-makers and stakeholders in decision-making, recognising their education. We will publish our findings in a peer-reviewed journal.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Contributors: MP-A, TS and KJ designed the study. MP-A developed and refined the study protocol with contributions from all coauthors (NP, US-K, CR-K, TS, KJ and AS). TS developed the search strategy. MP-A, NP, TS, US-K and CR-K will screen titles and abstracts and full-text articles and perform data extraction. MP-A, TS, KJ and NP will perform the analysis, interpretation and writing of the report. All authors have read and approved this manuscript. AS is the guarantor of the review.

Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not applicable.

References

  • 1. European Commission . A new drive for primary care in Europe: Rethinking the assessment tools and Methodologies. In: Report of the Expert Group on Health Systems Performance Assessment. Luxembourg: Publications Office of the European Union, 2018. [Google Scholar]
  • 2. Evans PWE, ed. The European Definition of General Practice/ Family Medicine. Barcelona: WONCA Europe / WHO Europe, 2023. [Google Scholar]
  • 3. Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q 2005;83:457–502. 10.1111/j.1468-0009.2005.00409.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. ICON Institut public sector Gmbh . In: Bottleneck Vacancies 2015. Luxembourg: European Union, 2016. [Google Scholar]
  • 5. OECD . Health At A Glance 2023: OECD Indicators. Paris: OECD Publishing, 2023. [Google Scholar]
  • 6. Strasser R, Neusy AJ. Context counts: training health workers in and for rural and remote areas. Bull World Health Organ 2010;88:777–82. 10.2471/BLT.09.072462 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Verma P, Ford JA, Stuart A, et al. A systematic review of strategies to recruit and retain primary care doctors. BMC Health Serv Res 2016;16. 10.1186/s12913-016-1370-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. World Health Organization . Health workforce and labor market dynamics in OECD high-income countries: a synthesis of recent analyses and simulations of future supply and requirements. Geneva: World Health Organization, 2017. [Google Scholar]
  • 9. IHS Markit Ltd . The Complexities of Physician Supply and Demand: Projections From 2019 to 2034. Washington, DC: Association of American Medical Colleges, 2021. [Google Scholar]
  • 10. Stigler FL, Zipp CR, Jeitler K, et al. Comprehensive catalogue of international measures aimed at preventing general practitioner shortages. Fam Pract 2021;38:793–801. 10.1093/fampra/cmab045 [DOI] [PubMed] [Google Scholar]
  • 11. Michas F. Nurses in the U.S. - Statistics & facts. 2021. Available: https://www.statista.com/topics/8337/nurses-in-the-us/#topicOverview
  • 12. Michas F. Number of nurses in the UK. 2010. Available: https://www.statista.com/statistics/318922/number-of-nurses-in-the-uk/#statisticContainer [Accessed 7 Jul 2023].
  • 13. World Health Organization . State of the world’s nursing 2020: investing in education, jobs and leadership. Geneva: World Health Organization, 2020. [Google Scholar]
  • 1. Nursing definitions Genéve . International Council of nurses. 2023. Available: https://www.icn.ch/resources/nursing-definitions [Accessed 11 Feb 2023].
  • 15. Carter MA, Haji Assa AS. The problem of comparing nurse practitioner practice with medical practice. Nurs Inq 2023;30:e12551. 10.1111/nin.12551 [DOI] [PubMed] [Google Scholar]
  • 16. Thrasher C. The primary care nurse practitioner: advocate for self care. J Am Acad Nurse Pract 2002;14:113–7. 10.1111/j.1745-7599.2002.tb00101.x [DOI] [PubMed] [Google Scholar]
  • 17. Kringos D, Wienke B, Allen H, et al. Building primary care in a changing Europe: case studies; 2015. World health organization [PubMed]
  • 18. National Health Service . Career & Development Framework for General Practice Nurse. NHS Education for Scotland, 2009. [Google Scholar]
  • 19. Nursing & Midwifery Council . Standards of proficiency for nurse and midwife prescribers. 2006. [Google Scholar]
  • 20. Royal college of nursing publishing. In: Nurse Prescribing - Update 2013. RCN Publishing, 2013. [Google Scholar]
  • 21. Ruscoe D, Cook F, Phare J, et al. General practice nurse Competencies 2012. 2012. [Google Scholar]
  • 22. Schuettengruber G, Abuzahra M, Siebenhofer A. Internationale Tätigkeitsprofile von Pflegefachkräften in der Primärversorgung Frankfurt am main. In: Kongress für Allgemeinmedizin und Familienmedizin 29.9.-1.10.2016. 2016: 50. [Google Scholar]
  • 23. Laurant M, van der Biezen M, Wijers N, et al. Nurses as substitutes for doctors in primary care. Cochrane Database Syst Rev 2018;7. 10.1002/14651858.CD001271.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Martínez-González NA, Rosemann T, Tandjung R, et al. The effect of physician-nurse substitution in primary care in chronic diseases: a systematic review. Swiss Med Wkly 2015;145. 10.4414/smw.2015.14031 [DOI] [PubMed] [Google Scholar]
  • 25. Leong SL, Teoh SL, Fun WH, et al. Task shifting in primary care to tackle Healthcare worker shortages: an umbrella review. Eur J Gen Pract 2021;27:198–210. 10.1080/13814788.2021.1954616 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Abuzahra M, Horvath K, Jeitler K, et al. Tätigkeiten von Pflegefachkräften in der Hausarztpraxis: Internationale Tätigkeitsprofile und Evidenzlage. Graz: Hauptverband der österreichischen Sozialversicherungsträger, 2016. [Google Scholar]
  • 27. Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;350. 10.1136/bmj.g7647 [DOI] [PubMed] [Google Scholar]
  • 29. Waffenschmidt S, Knelangen M, Sieben W, et al. Single screening versus conventional double screening for study selection in systematic reviews: a methodological systematic review. BMC Med Res Methodol 2019;19. 10.1186/s12874-019-0782-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009;339. 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol 1991;44:1271–8. 10.1016/0895-4356(91)90160-b [DOI] [PubMed] [Google Scholar]
  • 32. Oxman AD, Guyatt GH, Singer J, et al. Agreement among reviewers of review articles. J Clin Epidemiol 1991;44:91–8. 10.1016/0895-4356(91)90205-n [DOI] [PubMed] [Google Scholar]
  • 33. IQWIG (Institute for quality and efficiency in health care). Allgemeine Methoden. version 5.0 Vom 10.07.2017. In: Köln: Institute for Quality and Efficiency in Health Care. 2017. [Google Scholar]
  • 34. Jadad AR, McQuay HJ. Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. J Clin Epidemiol 1996;49:235–43. 10.1016/0895-4356(95)00062-3 [DOI] [PubMed] [Google Scholar]
  • 35. Lundh A, Knijnenburg SL, Jørgensen AW, et al. Quality of systematic reviews in pediatric oncology--a systematic review. Cancer Treat Rev 2009;35:645–52. 10.1016/j.ctrv.2009.08.010 [DOI] [PubMed] [Google Scholar]
  • 36. Pollock M, Fernandes RM, Newton AS, et al. A decision tool to help researchers make decisions about including systematic reviews in Overviews of reviews of Healthcare interventions. Syst Rev 2019;8. 10.1186/s13643-018-0768-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Hennessy EA, Johnson BT. Examining overlap of included studies in meta-reviews: guidance for using the corrected covered area index. Res Synth Methods 2020;11:134–45. 10.1002/jrsm.1390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Pieper D, Antoine S-L, Mathes T, et al. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol 2014;67:368–75. 10.1016/j.jclinepi.2013.11.007 [DOI] [PubMed] [Google Scholar]
  • 39. Bougioukas KI, Vounzoulaki E, Mantsiou CD, et al. Methods for depicting overlap in Overviews of systematic reviews: an introduction to static Tabular and graphical displays. J Clin Epidemiol 2021;132:34–45. 10.1016/j.jclinepi.2020.12.004 [DOI] [PubMed] [Google Scholar]
  • 40. Kersting C, Kneer M, Barzel A. Patient-relevant outcomes: what are we talking about? A Scoping review to improve conceptual clarity. BMC Health Serv Res 2020;20. 10.1186/s12913-020-05442-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Page MJ, Moher D, Bossuyt PM, et al. PRISMA 2020 explanation and elaboration: updated guidance and Exemplars for reporting systematic reviews. BMJ 2021;372. 10.1136/bmj.n160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Li L, Tian J, Tian H, et al. Quality and transparency of Overviews of systematic reviews. J Evid Based Med 2012;5:166–73. 10.1111/j.1756-5391.2012.01185.x [DOI] [PubMed] [Google Scholar]
  • 43. Anderson LM, Petticrew M, Chandler J, et al. Introducing a series of methodological articles on considering complexity in systematic reviews of interventions. J Clin Epidemiol 2013;66:1205–8. 10.1016/j.jclinepi.2013.07.005 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2023-078414supp001.pdf (88KB, pdf)

Supplementary data

bmjopen-2023-078414supp002.pdf (331.6KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES