Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2021 Dec 23;6:363. [Version 1] doi: 10.12688/wellcomeopenres.17430.1

Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries

Abdulazeez Imam 1,a, Sopuruchukwu Obiesie 2, Jalemba Aluvaala 3,4, Michuki Maina 3, David Gathara 5, Mike English 1,3
PMCID: PMC8943346  PMID: 35368905

Abstract

Background: Adequate staffing is key to the delivery of nursing care and thus to improved inpatient and health service outcomes. Several systematic reviews have addressed the relationship between nurse staffing and these outcomes. Most primary studies within each systematic review are likely to be from high-income countries which have different practice contexts to low and middle-income countries (LMICs), although this has not been formally examined. We propose conducting an umbrella review to characterise the existing evidence linking nurse staffing to key outcomes and explicitly aim to identify evidence gaps in nurse staffing research in LMICs.

Methods and analysis: This protocol was developed using the Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols (PRISMA-P). Literature searching will be conducted across Ovid Medline, Embase and EBSCO Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases. Two independent reviewers will conduct searching and data abstraction and discordance will be handled by discussion between both parties. The risk of bias of the individual studies will be performed using the AMSTAR-2 .

Ethics and dissemination: Ethical permission is not required for this review as we will make use of already published data. We aim to publish the findings of our review in peer-reviewed journals.

PROSPERO registration number: CRD42021286908

Keywords: Developing countries, Nurses, quality of care, patient care, ward staffing

Background

Globally, nurses represent almost three-fifths of all health professionals and are key to the attainment of universal health coverage 1 . They are integral to ensuring the quality of patient care and are crucial in all health systems, playing significant roles at all levels of healthcare, including primary care where they promote mental health and well-being and anchor maternal health, growth monitoring and immunization services. They also have important roles within secondary and tertiary inpatient care settings where they plan, deliver and coordinate care and represent a critical part of the hospitals' surveillance system in detecting adverse patient events 2 . As a result, having the right number of nurses with the right skills is paramount to sustaining any health system.

In recent times, the World Health Organization has estimated that there is a need for an extra six million nurses to actualise the global health agenda 1 . It is estimated that around 90% of nursing shortages occur in low and middle-income countries (LMICs); particularly in Africa, South-East Asia and the eastern Mediterranean region 1 . Only 3% of the global nurses reside in Africa, which houses 17.2% of the world’s population; this is in contrast to Europe and the Americas where 26% and 30% of global nurses reside and which have 9.6% and 17.2% share of the global population respectively 1, 3 . The nursing crisis in LMICs represents a mismatch between increasing health service demand and the supply or employment of the nursing workforce supply 4 . The demand is fuelled by rapid population expansion and health policies promoting universal free medical care without commensurate expansion in health services to cater for these demands 1 . It is also driven by a rapid expansion in the scope of healthcare, changing population expectations and the increasing use of medical technologies that require more intensive nursing, for example, the use of mechanical ventilators or continuous positive airway pressure machines. The supply of nurses, on the other hand, is limited by inadequate workforce planning, financing, and investments in healthcare. The migration of highly skilled nurses from LMICs to developed countries, in search of better remuneration and improved career prospects, plays part of the role in reducing nursing levels in LMICs 5 . It has also been suggested that LMIC source countries play a role due to limited strategies for attracting and retaining such staff 5, 6 . Nursing shortages, while prevalent in LMICs, also occur in high-income countries (HICs) 7 . A changing population structure resulting in an ageing population with greater healthcare needs and a steadily ageing nurse workforce, has resulting in an imbalance between nursing service demand and supply 8 .

This imbalance in supply and demand of nurses has stimulated research on how nurse staffing might affect quality of patient care outcomes. There have been multiple studies from Europe, the U.S. and HICs, which suggest that reduced nurse staffing is associated with poorer patient outcomes 911 . Over the last two decades, several published reviews have also examined the relationship between nurse to patient ratios and the quality of hospital inpatient care 12 . Relatively little attention has however been paid to the origins of this research, although it is likely that most studies are from HICs. As a result, the global evidence on the consequences of poor nurse staffing may mostly arise from areas with better staffing ratios. This umbrella review will examine this hypotheses.

There is a need for context specific LMIC studies or research that appraises existing evidence based on nurse staffing and quality of patient care, based on practical realities these settings. This is because staffing ratios vary across LMICs and HICs. For example, data from Kenya and Ethiopia, both LMICs report ratios can be as low as one nurse caring for 25 patients on a shift 13, 14 , while UK Paediatric general wards report ratios of one nurse to four patients, which might approach one to one nursing in intensive care settings 15 .

We propose an umbrella review of existing systematic reviews on nurse staffing and inpatient care. Umbrella reviews provide broader and more complete evidence on specific topics 16 . They have also been previously shown to be an efficient way of summarising the evidence base for extensively researched topics, such as nurse staffing 17 . Our review will pay special attention to identifying and highlighting possible evidence gaps for nurse staffing research in LMICs. It will also be important to guide the conduct of future nurse staffing research in LMICs and provide important information for policymakers.

This umbrella review aims to characterise the literature examining the consequences of nurse staffing on inpatient care and identify evidence gaps for LMICs. Our review will address the following questions:

  • 1.

    What proportion of studies in published systematic reviews were conducted in LMICs?

  • 2.

    What patient care outcomes do these studies report?

  • 3.

    How do these outcomes differ across HICs and LMIC settings?

  • 4.

    What is the range of nurse staffing levels that have been researched across acute care settings?

  • 5.

    How do the nurse staffing levels described differ between LMICs and HICs?

Methods

The protocol for this review was developed using the Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols (PRISMA-P) 18 , and the Joanna Briggs Institute (JBI) guidelines for preparing and conducting umbrella reviews 19 . Our review was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 27 th October 2021 (Registration number - CRD42021286908).

Ethics

Our review is secondary research and so will not require any ethical approval. We hope to publish our findings in a peer-reviewed journal.

Study Design

An umbrella review pulls together evidence from various systematic reviews and authors can also extract data from primary studies included in the reviews 20 . Our umbrella review will focus on systematic reviews that investigate how nurse staffing levels affect the quality of care outcomes in hospitals. It will specifically identify what evidence has been put forward for LMICs within these reviews and abstract data on the range of nurse staffing level contexts described within the primary studies of each of our included systematic reviews. We will only consider quantitative systematic reviews; qualitative, mixed-method, narrative and other umbrella reviews will be excluded from our review, as well as commentaries, editorials, and review protocols. LMIC in this paper will be defined using the World Bank’s country and lending groups classification system, which classifies 135 countries into low-income, low-middle-income and upper-middle-income economies, based on gross national income per capita.

Population

We will include systematic reviews where the focus was on patients admitted to hospital ward settings which might either include newborn, paediatric or adult wards. We will however exclude systematic reviews of intensive care units, as the staffing of these units varies significantly from regular ward care settings, which is the focus of our umbrella review. We will also exclude systematic reviews of non-hospital settings, such as community clinics and nursing homes or settings where care is not carried out continuously, such as outpatient clinics. For those systematic reviews that combine both studies conducted in intensive care units and hospital ward settings, we will include them but only report on the primary studies that were conducted in ward care settings.

Exposure

Our exposure of interest is nurse staffing and its effect on patient care outcomes. Our review will consider a wide variety of staffing metrics reported by authors. This includes but is not limited to, nurse-to-patient ratios, nurse-to-bed ratios, or nursing hour per patient days. Our focus will be to identify systematic reviews that investigate the impact of any of these staffing metrics on patient outcomes. We will exclude systematic reviews which investigated the impact of other staffing metrics, for example, nursing skill mix and nursing work schedules on patient care outcomes.

Outcome

Our primary outcome of interest will be the quality of patient care. This includes patient care outcomes described in systematic reviews, for example length of hospital stays and the incidences of hospital-acquired infection and mortality. We will also consider nursing process outcomes such as missed nursing care or errors in administering medications. For reviews that report mixed outcomes, for example reviews on nurse and patient outcomes, we will include them but only report on their patient care outcomes.

Setting

We aim to identify the broad range of quality-of-care outcomes studied across systematic reviews and identify how these reported outcomes differ between HICs and LMICs. We will also identify the range of staffing levels, where individual studies reported in the reviews have been conducted and we will compare these across LMIC and HICs.

Search strategy

We will conduct our search in databases for systematic reviews, these include the Cochrane Register of Systematic Reviews, the JBI Database of Systematic Reviews and Implementation Reports and other databases such as Medline, Embase and Cumulative Index to Nursing and Allied Health Literature (CINAHL). The databases will be filtered by, to only show reviews published in English, due to limitations in translation. There will be no date restrictions applied to our search and we will identify reviews published from inception of the databases till when we conduct our searches. We will also perform hand searches in some select journals and search the reference list of articles we identify for additional papers. We contacted a health information librarian to develop our search strategy, and this was piloted in Ovid Medline (see Extended data 21 ). We also conducted initial searches in Prospero to identify ongoing or planned reviews that might relate to our proposed research before undertaking the review.

Data management

Following our search, we will upload all retrieved abstracts of the identified systematic reviews to Zotero, a reference management software, where we will perform deduplication 22 . Following this, titles and abstracts of the retrieved papers will be screened for relevance by two independent reviewers using the Rayyan – Intelligent Systematic Review, a web-based application for screening 23 . Full text of potentially relevant articles will then be scrutinised by both reviewers independently using the pre-defined inclusion criteria. In the event of any discordance, this will be resolved through discussion and if unsuccessful, arbitration by a third reviewer.

Data items

Pre-review, we will develop a standardised Microsoft Excel form to extract data on each of the identified systematic reviews for our umbrella review. This will include publication year, first author’s name, outcome type/types measured, the number of studies included in each identified review that reported on specific patient outcomes in regular ward settings, and countries where these studies were conducted. This will be used to determine the proportion of studies conducted in LMIC settings and if a difference exists in outcomes studied in both LMICs and HICs. We will also extract the type of staffing metrics reported by the individual studies within each review, and a summary statistic describing this, from the study summary table, provided in each of our eligible reviews. If this data is unavailable or incomplete, we will abstract this from the primary articles of the selected systematic reviews. The range of staffing will be our preferred metric. In the event there is no range specified, the mean or median staffing metric will be preferred. For a staffing metric to be reported, the parent study should report one of our previously identified nurse staffing metrics and determine its association with any patient care outcomes in a regular ward setting.

Quality assessment

We will use the AMSTAR-2 criteria to assess the methodological quality of each systematic review 24 . This is a widely used tool for appraising systematic reviews and is recommended by the JBI guidelines for preparing and conducting umbrella reviews 19 . Assessments will be carried out independently by two reviewers, AI and SO. Any disagreements will be managed through discussions and in event of a lack of consensus, a third reviewer will be invited as a tiebreaker. As we aim for our umbrella review to provide broad information on patient care outcomes in LMICs, we will include all eligible systematic reviews in our synthesis irrespective of their risk of bias scores, but we will discuss any potential impact of these scores in our evidence synthesis.

Data synthesis

The findings of our umbrella review will be reported using a narrative synthesis as we do not include any effect estimates. We will summarise each review, providing details on the research context, period of review, objectives and primary studies included in the review.

We intend to group studies conducted within each systematic review into those conducted in LMIC settings and those in non-LMIC settings using the World Bank’s country and lending group classification system. Our data synthesis will describe the proportion of LMIC studies within each systematic review. We will also compare the broad range of patient care outcomes described across both LMIC and HIC settings and the range of staffing levels in both care settings. Our data will be presented using a combination of tables, figures, and clustered bar charts.

Study status

We confirm that at the time of submission of this protocol, we have completed full-text screening of identified articles.

Discussion

Nurse staffing has long been recognised as one of the key factors that affect the quality of patient care. While staffing requirements might vary across different health care settings, HICs have traditionally had better staffing-to-patient ratios compared to many LMICs. Additionally, more research into staffing and patient care outcomes is conducted in HICs and these studies might form the bulk of evidence for systematic reviews in this area. Our Umbrella review determines the extent of this and proposes to identify the evidence gaps for LMICs in terms of contributions to the overall literature on nurse staffing and quality of patient care.

Data availability

No underlying data are associated with this article.

Extended data

Open Science Framework: Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries https://doi.org/10.17605/OSF.IO/7YTKX 21

This project contains the following extended data:

  • Search strategy for Ovid Medline.docx

Reporting guidelines

Open Science Framework: PRISMA-P checklist for ‘Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries’. https://doi.org/10.17605/OSF.IO/7YTKX 21

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Funding Statement

This work was supported by Wellcome [207522; awarded to ME]; Wellcome [203077; to the Kenya Major Overseas Programme]; National Institute for Health Research [NIHR130812].

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 2 approved, 1 approved with reservations]

References

  • 1. Organization WH: State of the world’s nursing 2020: investing in education, jobs and leadership.2020. Reference Source [Google Scholar]
  • 2. Clarke SP, Aiken LH: Failure to Rescue: Needless deaths are prime examples of the need for more nurses at the bedside. AJN Am J Nurs. 2003;103(1):42–7. 10.1097/00000446-200301000-00020 [DOI] [PubMed] [Google Scholar]
  • 3. 7 Continents of the World.Worldometer. [cited 2021 Jun 22]. Reference Source [Google Scholar]
  • 4. Buchan J, Sochalski J: The migration of nurses: trends and policies. Bull World Health Organ. 2004;82(8):587–94. [PMC free article] [PubMed] [Google Scholar]
  • 5. Martineau T, Decker K, Bundred P: Briefing note on international migration of health professionals: levelling the playing field for developing country health systems. Liverp Liverp Sch Trop Med. 2002. Reference Source [Google Scholar]
  • 6. Kingma M: Nurses on the move: Historical perspective and current issues. J Issues Nurs. 2008;13(2). Reference Source [Google Scholar]
  • 7. The NHS workforce in numbers. The Nuffield Trust,2017; [cited 2021 Jun 9]. Reference Source [Google Scholar]
  • 8. Haddad LM, Annamaraju P, Toney-Butler TJ: Nursing shortage. StatPearls,2020. Reference Source [PubMed] [Google Scholar]
  • 9. Aiken LH, Sloane D, Griffiths P, et al. : Nursing skill mix in European hospitals: cross-sectional study of the association with mortality, patient ratings, and quality of care. BMJ Qual Saf. 2017;26(7):559–68. 10.1136/bmjqs-2016-005567 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Aiken LH, Clarke SP, Sloane DM, et al. : Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288(16):1987–93. 10.1001/jama.288.16.1987 [DOI] [PubMed] [Google Scholar]
  • 11. Aiken LH, Cimiotti JP, Sloane DM, et al. : Effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments. J Nurs Adm. 2012;42(10 Suppl):S10–6. 10.1097/01.NNA.0000420390.87789.67 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Griffiths P, Recio-Saucedo A, Dall’Ora C, et al. : The association between nurse staffing and omissions in nursing care: a systematic review. J Adv Nurs. 2018;74(7):1474–87. 10.1111/jan.13564 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Gathara D, Serem G, Murphy GAV, et al. : Missed nursing care in newborn units: a cross-sectional direct observational study. BMJ Qual Saf. 2020;29(1):19–30. 10.1136/bmjqs-2019-009363 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Assaye AM, Wiechula R, Schultz TJ, et al. : Nurse staffing models in medical-surgical units of acute care settings: A cross-sectional study. Int J Nurs Pract. 2020;26(1):e12812. 10.1111/ijn.12812 [DOI] [PubMed] [Google Scholar]
  • 15. NHS England:  Safe, sustainable and productive staffing for neonatal care and children and young people’s services. [cited 2021 Jun 1]. Reference Source [Google Scholar]
  • 16. Lugo A, Bosetti C, Peveri G, et al. : Dose-response relationship between cigarette smoking and site-specific cancer risk: protocol for a systematic review with an original design combining umbrella and traditional reviews. BMJ Open. 2017;7(10):e018930. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Thompson W, Tonkin-Crine S, Pavitt SH, et al. : Factors associated with antibiotic prescribing for adults with acute conditions: an umbrella review across primary care and a systematic review focusing on primary dental care. J Antimicrob Chemother. 2019;74(8):2139–52. 10.1093/jac/dkz152 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Moher D, Shamseer L, Clarke M, et al. : Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Aromataris E, Fernandez R, Godfrey CM, et al. : Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc. 2015;13(3):132–40. 10.1097/XEB.0000000000000055 [DOI] [PubMed] [Google Scholar]
  • 20. Biondi-Zoccai G: Umbrella reviews: evidence synthesis with overviews of reviews and meta-epidemiologic studies. Cham (CH): Springer International Publishing; This Book Provid Compr Guid Clin Res Interest In.2016; [cited 2018 Feb 26]. 10.1007/978-3-319-25655-9 [DOI] [Google Scholar]
  • 21. Imam A: Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries.2021. 10.17605/OSF.IO/7YTKX [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Zotero: Your personal research assistant. [cited 2021 Oct 22]. Reference Source [Google Scholar]
  • 23. Ouzzani M, Hammady H, Fedorowicz Z, et al. : Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Shea BJ, Reeves BC, Wells G, et al. : AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. 10.1136/bmj.j4008 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2022 Mar 23. doi: 10.21956/wellcomeopenres.19273.r49080

Reviewer response for version 1

Uzochukwu Egere 1

General comments:

Thanks for asking me to review this protocol which details an umbrella review to characterize the existing evidence linking nurse staffing to key outcomes, and also identifies and highlights possible evidence gaps for nurse staffing research in low- and middle-income countries (LMICs). The authors make a strong case for conducting this review and draw on several important publications to bring more clarity into the subject.

At this time of renewed determination to ensure universal health coverage especially in the vulnerable LMIC settings, this umbrella review has a huge potential to impact policy and inform strategies for health systems strengthening. 

I would like to see data from LMICs disaggregated by countries and health system levels. Though there are huge nursing staff shortages in these settings, the shortages are likely to vary widely across health systems levels. I suggest that the authors consider these data items during data extraction.

Specific comments:

Background: The data on percentage of global nurses resident in each region versus the population they serve, is helpful. However, I wonder if this ratio would change for Latin America, for instance, if the USA is taken out of the 'Americas' region. Secondly, the discussion on the demand and supply crisis could also highlight intra-country dynamics such as movements from rural to urban areas as contributory to the crisis within LMICs.

Study design: It is in order to focus on quantitative variables as the authors have done here, given the review questions. It may therefore be necessary to consider abstracting quantitative data from the mixed methods studies instead of completely excluding all mixed methods studies. 

Population: The authors mention in the review questions that they will find out the "range of nurse staffing levels that have been researched across acute care settings" but then in this (Population) section, it mentioned that systematic reviews of intensive care units will be excluded. It might be in order to clarify what is meant by "acute care settings" in this review.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Clinical medicine (Paediatrics), Public health, Implementation research, Health systems analysis, Health services research.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2022 Mar 15. doi: 10.21956/wellcomeopenres.19273.r49078

Reviewer response for version 1

Aduragbemi Banke-Thomas 1

Thank you for inviting me to review this protocol. I read it with a lot of interest.

I have suggested a number of points that I believe will help to really strengthen the protocol. The two big comments point to the need to provide a stronger rationale underpinning the need for this umbrella review. This needs to come out very clearly. Second is there is a need to clarify if the focus of this review is purely LMIC or if it is global. I think it is global, that wants to show there is an evidence gap for LMICs. I would argue that the protocol needs to reflect this.

Specific points are presented below:

  • The title as written, "Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries" might not be appropriate as you still collect data from HICs to identify gaps. This is more of a global review. Your review questions certainly do not suggest that this is a purely LMIC focused review. Please tweak the title to reflect the focus.

  • Please specify the period when you write "In recent times, the World Health Organization...".

  • For this statement, "Only 3% of the global nurses reside in Africa, which houses 17.2% of the world’s population..". Rather than relating this to the population, please relate to the burden of disease, especially NCDs that need long term care for which nurses are particularly critical.

  • Kindly motivate the introduction better to improve flow. This statement, "Nursing shortages, while prevalent in LMICs, also occur in high-income countries (HICs)..." shows the global reach of this planned review. Please structure the section in a way that shows the LMIC and HIC foci.

  • A stronger case for this review of reviews is needed. You write that "Umbrella reviews provide broader and more complete evidence on specific topics 16 . They have also been previously shown to be an efficient way of summarising the evidence base for extensively researched topics, such as nurse staffing 1". Can you evidence that nurse staffing is an example of an "extensively researched topic"? Yet you make a point already that this topic is minimally researched in LMICs. If it is not well sufficiently studied in LMICs, then a review of LMIC original papers will do. Summary: The rationale for an umbrella review does not come out clearly. Please review and rephrase.

  • Ref 16 will be better as a methodology paper that describes the process of an umbrella review not an example of another one. Maybe consider using Ref 19 and deleting 16.

  • You have cited JBI guidelines for umbrella reviews, registered with PROSPERO, and leveraged PRISMA-P. Good!

  • This statement "We hope to publish our findings in a peer-reviewed journal." has nothing to do with ethics. It is more about dissemination. Please remove or move elsewhere.

  • Please align your methods to your research question and frankly the entire protocol (title, background and methods). Under study design, you only talk about LMIC. Elsewhere, you talk about LMIC and HIC. This is difficult to follow. Please be more consistent in this protocol.

  • The World Bank classification is fluid. Be specific with cut off date of definition where you write "LMIC in this paper will be defined using the  World Bank’s country and lending groups classification system, which classifies 135 countries into low-income, low-middle-income and upper-middle-income economies, based on gross national income per capita".

  • Please use evidence to justify your exclusion criteria. For example, you write, "We will however exclude systematic reviews of intensive care units, as the staffing of these units varies significantly from regular ward care settings...".

  • These sort of protocols typically include their detailed search strategy across multiple databases, so this will not be needed with the same level of detail in the actual review. Please include the detailed search strategy across the different databases to be searched.

  • It might also be helpful to show how you have actually reached the search terms used. So, in essence, detail the piloting of the search strategy.

  • Not sure if this will be possible in all cases "For those systematic reviews that combine both studies conducted in intensive care units and hospital ward settings". Please rethink.

  • You write, "We will exclude systematic reviews which investigated the impact of other staffing metrics, for example, nursing skill mix and nursing work schedules on patient care outcomes". Please explain why.

  • This is not clear, "...due to limitations in translation". Do you mean no services available? Or no one on the team can translate? Please think about this a bit more. Are there actually papers that you will really be missing?

  • This sentence is consuming "We also conducted initial searches in  Prospero to identify ongoing or planned reviews that might relate to our proposed research before undertaking the review.". Was this done to find out if another team is doing an umbrella review? Or if there are ongoing reviews of primary studies? If former, then this should be moved upwards. Either way, this needs to be rephrased for clarity.

  • You write, "Pre-review, we will develop a standardised Microsoft Excel form to extract data on each of the identified systematic reviews for our umbrella review". Should this not be available already?

  • Should quality assessment come before data extraction?

  • Please review the content being extracted from the reviews. You write "first author’s name". Is it the name or surname or full name? It is not clear why the metrics such as nurse-to-patient ratios, nurse-to-bed ratios, or nursing hour per patient days need to be extracted from the primary studies. Do you want to maybe review this and fix it from the point of inclusion? 

  • Please cite the approach being used for synthesis - narrative synthesis.

  • Clustered bar charts are also Figures. Is there a reason why this is being specified?

  • Please rewrite the discussion to reflect the global nature of this review of reviews. In addition, make a case for why it is important to conduct this review of reviews. What will it show differently compared to what the actual reviews will not show? You can also bring in your dissemination plan (which I suggested should be deleted from ethics above) here.

I hope you find these comments useful and look forward to the revised version. Very best wishes.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

No

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Maternal Health; Health Policy

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2022 Jan 10. doi: 10.21956/wellcomeopenres.19273.r47865

Reviewer response for version 1

Denny John 1

The authors have used standard guidelines for umbrella reviews, registered with PROSPERO, and also mentioned use of the AMSTAR-2 checklist for assessing quality of systematic reviews. However, for patient reported outcomes some reviews might come from cost-effectiveness studies where the CiCERO might be useful (Mandrik et al., 2021 1 ).

The authors are also suggested to use the PRISMA-S checklist during the final review process to report search strategy details.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Yes

Reviewer Expertise:

Evidence synthesis, health technology assessment, public health in developing countries.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

References

  • 1. : Critical Appraisal of Systematic Reviews With Costs and Cost-Effectiveness Outcomes: An ISPOR Good Practices Task Force Report. Value Health .24(4) : 10.1016/j.jval.2021.01.002 463-472 10.1016/j.jval.2021.01.002 [DOI] [PubMed] [Google Scholar]

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No underlying data are associated with this article.


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES