Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2024 Jul 2;19(7):e0305008. doi: 10.1371/journal.pone.0305008

A global perspective of advanced practice nursing research: A review of systematic reviews

Kelley Kilpatrick 1,2,*, Isabelle Savard 3,#, Li-Anne Audet 3,#, Gina Costanzo 3, Mariam Khan 3, Renée Atallah 3, Mira Jabbour 2, Wentao Zhou 4,5, Kathy Wheeler 6, Elissa Ladd 7, Deborah C Gray 8, Colette Henderson 9, Lori A Spies 10, Heather McGrath 11, Melanie Rogers 12
Editor: Federica Canzan13
PMCID: PMC11218965  PMID: 38954675

Abstract

Introduction

The World Health Organization (WHO) called for the expansion of all nursing roles, including advanced practice nurses (APNs), nurse practitioners (NPs) and clinical nurse specialists (CNSs). A clearer understanding of the impact of these roles will inform global priorities for advanced practice nursing education, research, and policy.

Objective

To identify gaps in advanced practice nursing research globally.

Materials and methods

A review of systematic reviews was conducted. We searched CINAHL, Embase, Global Health, Healthstar, PubMed, Medline, Cochrane Library, DARE, Joanna Briggs Institute EBP, and Web of Science from January 2011 onwards, with no restrictions on jurisdiction or language. Grey literature and hand searches of reference lists were undertaken. Review quality was assessed using the Critical Appraisal Skills Program (CASP). Study selection, data extraction and CASP assessments were done independently by two reviewers. We extracted study characteristics, country and outcome data. Data were summarized using narrative synthesis.

Results

We screened 5840 articles and retained 117 systematic reviews, representing 38 countries. Most CASP criteria were met. However, study selection by two reviewers was done inconsistently and language and geographical restrictions were applied. We found highly consistent evidence that APN, NP and CNS care was equal or superior to the comparator (e.g., physicians) for 29 indicator categories across a wide range of clinical settings, patient populations and acuity levels. Mixed findings were noted for quality of life, consultations, costs, emergency room visits, and health care service delivery where some studies favoured the control groups. No indicator consistently favoured the control group. There is emerging research related to Artificial Intelligence (AI).

Conclusion

There is a large body of advanced practice nursing research globally, but several WHO regions are underrepresented. Identified research gaps include AI, interprofessional team functioning, workload, and patients and families as partners in healthcare.

PROSPERO registration number

CRD42021278532.

Introduction

Globally, nurses make up approximately half of the healthcare workforce [1]. The World Health Organization (WHO) has called for the broadening of nurses’ scope of practice to promote equitable care delivery and respond to the growing demands for healthcare services [1, 2]. According to the International Council of Nurses (ICN), nurses in advanced practice roles have a minimum of Master’s-level preparation in addition to in-depth clinical expertise and complex decision-making skills [3]. Globally, diverse titles and varying nomenclature are used for these roles, with the most widely used being the titles advanced practice nurses (APNs), nurse practitioners (NPs) and clinical nurse specialists (CNSs) [3]. Advanced practice nurses ensure direct care to patients and families with acute, chronic or complex conditions [3, 4]. In addition to providing direct care, APNs, NPs and CNSs support healthcare teams to deliver patient care and improve access to services [57]. Advanced practice nursing roles are growing exponentially worldwide [8]. However, an understanding of the impact of these roles has been uneven across the globe because of inconsistent definitions of roles and titles, and a lack of role clarity. A recent umbrella review of primary healthcare NPs [9] documented that an average of three countries per review were found across the 44 systematic reviews. Although there are systematic reviews of APNs and CNSs in other clinical settings (e.g., Allsop et al., 2021; Audet et al., 2021; Kerr et al. 2021) [6, 7, 10], no synthesis of this body of evidence is available using recognized advanced practice role definitions, making it difficult to compare advanced practice nursing roles internationally.

It is challenging to distinguish between the roles of nurses and advanced practice nurses [11]. For example, some jurisdictions (e.g., Belgium) employ the term nurse-led for all nursing roles [1, 8, 12, 13]. A clearer understanding of the roles that are in place, titles used across the globe and relevant outcomes will support optimal use of advanced practice nursing roles, and inform global priorities for advanced practice nursing education, research, and policy reform.

To identify current gaps in advanced practice nursing research globally, we conducted a review of systematic reviews of studies examining APNs, NPs or CNSs using recognized advanced practice nursing role definitions [3, 4]. The overview sought to answer the following question: Do current systematic reviews that include APNs, NPs or CNSs represent countries where these roles are found globally? The three following objectives were pursued:

  1. Identify the countries included in systematic reviews of APNs, NPs or CNSs;

  2. Describe the types of included studies, study population, role definitions, and settings identified in the systematic reviews; and

  3. Examine the types of outcomes of APN, NP or CNS roles included in systematic reviews globally.

Materials and methods

The protocol for this overview was developed a priori and published (PROSPERO International Prospective Register of Systematic Reviews CRD42021278532) [1416]. In essence, the review of systematic reviews describes the literature related to advanced practice nursing globally to identify key research gaps. The methods used in an umbrella review of indicators sensitive to primary healthcare NP practice formed the basis for the current review [9, 17]. The descriptive table, critical appraisal and outcomes table are presented in the appendices given the large size of these tables.

Inclusion criteria

Types of studies

Published and unpublished systematic reviews identified between January 1st 2011 and April 3rd 2023 were examined. No restrictions on jurisdiction or language were applied. The review had to 1) provide elements of a research question (i.e., PICOS) related to advanced practice nursing; and 2) detail inclusion and exclusion criteria to be considered [18]. Systematic reviews were included if the advanced practice nursing role was clearly defined and the APN, NP or CNS had decision-making autonomy [3, 4].

Types of participants

Participants included individual, groups or communities. Patients were from all age groups or health conditions receiving APN, NP or CNS care regardless of the type (e.g., long-term care), size, and location (e.g., urban/rural) of the facility. All members of the healthcare team across all types, sizes, and locations of facilities were included (e.g., physicians, nurses).

Types of interventions

Studies of APNs, NPs or CNSs in any sector were considered to capture representative country-level data where the roles are implemented. We identified studies in acute care and primary care settings. Acute care was defined as in-hospital or specialized ambulatory care to address specific health conditions [19]. Primary care referred to the entry point of the healthcare system where patients receive comprehensive healthcare services for common health concerns [20].

Advanced practice nursing role dimensions include clinical and non-clinical activities related to education, research, and administration/leadership [21, 22]. APNs are nurses who have acquired in-depth expertise, complex decision-making skills and advanced clinical competencies [3, 4]. Consistent with ICN definitions, master’s or doctoral educational preparation is recommended and in many countries is required with national board certification for licensure and entry-level practice [3, 4]. Given the diversity of terms used globally to identify APNs, NPs, and CNSs, research team members were actively involved in determining if role titles specific to their region represented an advanced practice nursing role (e.g., nurse-led).

NPs are autonomous clinicians who practice in acute and primary care (including long-term care (LTC), home care). NPs assess, diagnose, treat, and manage acute episodic and chronic illnesses. They order and interpret diagnostic and laboratory tests, prescribe medication and non-pharmacologic therapies. NPs are health promotion and illness prevention experts and as such teach and counsel individuals and communities. In addition to clinical practice, they are clinical and health care system leaders, interdisciplinary consultants, and patient advocates [3, 5].

CNS roles include practice, consultation, education, research and leadership [3, 4]. CNSs have in-depth expertise in a nursing specialty and help solve complex healthcare issues. They are leaders in the development of clinical practice guidelines, promoting evidence-informed practice, and facilitating system change [3, 4]. CNS specialty-areas of practice may be with specific patient populations (frail elderly), settings (ICU), disease (cancer care), or type of care (post-operative care).

Types of comparators

We extracted data related to the comparator (i.e., control). Comparator groups included usual care, care provided by other healthcare professionals (e.g., physicians), and adherence to best practice guidelines.

Types of outcomes

Outcomes were categorized as patient (e.g., quality of life), provider (e.g., education), and health system (e.g., costs, scope of practice) levels.

Exclusion criteria

We excluded reviews addressing broad research questions (e.g., scoping reviews) and reviews related to physician assistants, certified registered nurse anesthetists, and nurse midwives. We also excluded reviews where the impact of the APNs, NPs or CNSs could not be teased out or was not reported separately from other provider roles. A list of excluded reviews are provided in S1 Appendix.

Database search

We searched the following electronic databases from January 1st 2011 to April 3rd 2023: Cumulative Index to Nursing and Allied Health Literature (CINAHL), Embase, Global Health, Healthstar, PubMed, Medline, Cochrane Library Database of Systematic Reviews and Controlled Trials Register, Database of Abstracts of Reviews of Effects (DARE), Joanna Briggs Institute (JBI) EBP, and Web of Science [16]. This time period was selected to capture the most recent trends in advanced practice nursing research and because evidence in approximately half of reviews is outdated five years after publication [16]. The keywords and search strategies are available in S2 Appendix. Search filters based on the CADTH systematic reviews and meta-analyses search and one developed by Lunny et al. for reviews of systematic reviews were used [23, 24]. The full preliminary search strategy developed for the PubMed database was subsequently adapted to each electronic database (See S2 Appendix). We adapted strategies reviewed by an academic librarian that have been used successfully in previous reviews [9, 25]. In addition, hand searches of reference lists of all relevant reviews were conducted to identify additional studies.

The grey literature was searched for the same period using the following websites and tools: World Health Organization, Organization for Economic Co-operation and Development (OECD), CADTH Information Services, CADTH Grey Matters Tool, International Council of Nurses (ICN), and ProQuest Dissertation and Theses. We searched the PROSPERO International Prospective Register of Systematic Reviews to identify registered review protocols. For each website, the content was searched using the same search terms as those used for the published literature. If there was not an inherent search function on the website, a search was completed of all webpages and weblinks. The search strategy for the grey literature can be found in S3 Appendix.

Study selection

All reviewers were trained to use the screening instrument and inclusion/exclusion criteria to enhance inter-rater agreement [16]. Three training sessions were conducted. The retained studies were uploaded into the EndNote and RAYYAN software, and duplicates were removed [26]. Two reviewers independently screened titles and abstracts using the predefined inclusion/exclusion criteria, and recommended exclusion or further full-text review. Inter-rater agreement was estimated using Cohen’s kappa (κ). Moderate agreement was found (κ = 0.456) with a percentage of agreement equal to 81.2 [27].

To be retained, papers had to be identified as a systematic review, and focus on an advanced practice nursing role or intervention. Full text reviews were conducted if no abstract was available or if it contained insufficient information. Any discrepancies were discussed among the reviewers until consensus was reached. A third reviewer to function as a tie-breaker was available but consensus was reached on all reviews and the additional review was not required.

Data extraction

Six training sessions were conducted with reviewers over a 6-month period to review data extractions tools and answer questions. Individualized feedback was provided by the primary author for two practice articles per reviewer. Data were extracted by one reviewer and checked independently by a second reviewer. A third reviewer revised all the papers for consistency. Discrepancies were resolved by consensus. A structured tool developed for a previous overview was adapted and pilot-tested by the research team [17, 25]. Descriptive characteristics included: first author and publication year; review aims; number of electronic databases searched; countries where studies were conducted; number and types of studies included in the review; APN role and population; intervention and comparator; synthesis methods, funding source, APN, NP or CNS involvement in the conduct of the review. Outcomes related to patient, provider, health system, education, policy, and scope of practice were extracted for each paper [28]. Results were categorized as equal to statistically significant in favour of the intervention or control group.

Design of included studies

The addition or expanded use of APNs, NPs and CNSs represents a complex healthcare system intervention [29]. Our overview considered studies that employed diverse research methods including randomized and non-randomized studies and qualitative methodologies.

Assessment of review quality

To enhance inter-rater agreement, two training sessions with three practice articles (poor to high quality) were conducted with reviewers to examine the Critical Appraisal Skills Program (CASP) tool. Two reviewers independently assessed each review’s methodologic quality using CASP [30] systematic review checklist. The instrument includes 10 items. To help standardize our assessments, we considered if the review addressed a clear question, if the protocol had been developed a priori, if elements of a PICO question could be found, or if the review aims were clearly stated. For syntheses of qualitative studies, we determined if the qualitative approach was identified and the methods appropriate. Inter-rater agreement was assessed using Cohen’s kappa. We considered that the ‘can’t tell’ response was equivalent to the item not being met. No study was excluded based on methodologic quality because our overview aimed to capture the countries where advanced practice nursing research had been undertaken. Disagreements were reviewed and discussed until the reviewers reached a consensus. A summary of the CASP ratings can be found in S1 Table.

Data synthesis

A narrative synthesis was developed using an iterative process [31]. Summary tables outlined key review characteristics (e.g., countries where studies were conducted), type of advanced practice nursing role, outcomes, and quality assessment. We kept a record of all review-related decisions. Additional quantitative analysis was not conducted on combined reviews to avoid the potential risk of including studies that appear in more than one review [32].

Results

We screened 5840 articles after removing duplicates (Fig 1). Of these, full text review was completed on 961 studies. We retained 117 systematic reviews in our overview representing 1653 primary studies. The reviews were published in 121 papers between 2011 and 2023 with six reviews published as constellation papers. Each review included an average of 14.1 papers (Standard deviation (SD): 13.2, range: 1 to 79). Articles were cited once (n = 1193, 86%), twice (n = 137, 10%), three times or more (n = 51, 4%). Reviews were published in English, Farsi, German, Mandarin, and Spanish languages. APNs, NPs or CNSs were included as a co-author in 37% of reviews. The funding source was indicated in 36%.

Fig 1. PRISMA 2020 flow diagram.

Fig 1

* * From: Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: 10.1136/bmj.n71. For more information, visit: http://www.prisma-statement.org/.

Positive assessments of the CASP items ranged from 27% to 99%. Inter-rater agreement was almost perfect with Cohen’s kappa ranging from 91% to total agreement for items in section C related to local application of results (S1 Table). Reviews were downgraded for the criterion related to study identification primarily because review authors did not clearly state that: 1) two reviewers independently screened titles and abstracts; 2) two reviewers checked the extractions; and 3) language or country restrictions were applied.

To address Aims 1 and 2, study characteristics are presented in S2 Table. Overall, 38 countries were identified with an average of 3.4 countries (SD: 2.5, range: 1 to 13) per review. Twelve reviews did not report on the included countries. The number of systematic reviews per country is reported in Fig 2 with the United States and United Kingdom reporting the largest number of reviews. Fig 3 represents the advanced practice nursing roles and countries where the roles are represented.

Fig 2. Number of systematic reviews per country.

Fig 2

We would like to acknowledge the use of MapChart (https://www.mapchart.net) for creating Figs 2 and 3 in this article.

Fig 3. Advanced practice nursing roles and countries where these roles are represented.

Fig 3

We would like to acknowledge the use of MapChart (https://www.mapchart.net) for creating Figs 2 and 3 in this article.

To address Aim 3, review outcomes were categorized into broader categories at the patient (S3 Table), provider (S4 Table) and health system levels (S5 Table). The emergence of Artificial Intelligence (AI) and advanced practice nursing roles was documented separately given the transversal role that AI can play across levels (S6 Table). Patient indicators include activities of daily living (ADLs), adaptation to health conditions, clinical outcomes, diagnosis, education-patient, mortality, morbidity, patient adherence, quality of life, satisfaction, and signs and symptoms. Provider indicator categories include adherence to best practice guidelines-provider, education-provider, illness prevention, interprofessional team functioning, prescribing, and satisfaction-provider. Health system indicator categories include access to care, consultations, costs, emergency room visits, health care service delivery, hospitalization, length of stay, patient safety, quality of care, scope of practice, and wait times. Artificial intelligence (AI)-Health technology was added as a cross cutting indicator category given its broad application. Each category is summarized below.

Patient indicators

Activities of Daily Living (ADLs) were examined in nine reviews [7, 10, 3340]. Reviews included APNs in acute and primary care and NPs primary care. Patients with hip fractures, following cardiac surgery, in transition between care settings, long-term care, with multi-morbidities, primary care, acute care, home care, and children with special needs were followed. Equal to statistically significant improvements noted in all reviews. No outcomes favoured the control group.

Adaptation to Health Conditions was examined in nine reviews [35, 36, 4147]. Reviews of APNs in acute and primary care and NPs in primary care examined self-management of health conditions (e.g., osteoporosis, rheumatoid arthritis), lifestyle, self-efficacy, life goal attainment and advance directive for older adults, reductions in disempowerment in homebound elderly, reductions in uncertainty in women with cancer and depression, reductions in mental distress for adolescents and caregivers. All studies showed equal to statistically significant improvements in the intervention group with no indicators favouring the control group.

Clinical Outcomes were divided into health, cardiovascular, cancer care, diabetes, mental health, musculoskeletal, renal and respiratory. Each is presented below.

Clinical/Health was assessed in 12 reviews [3840, 42, 4856]. Studies included APNs, NPs and CNSs in acute care, and APNs and NPs in primary care. The reviews examined self-reported perceptions of health, physical and mental health, health risk reduction, complex Type 1 and Type 2 diabetes, men with prostate or bladder cancer receiving radiotherapy, and the influence on nurse-led models of care on health condition-specific clinical indicators related to lung function, blood pressure control, lipid profiles, chronic inflammatory arthritis, cancer-related colorectal surgery, human immunodeficiency virus (HIV) and mental illness, chronic depression, women with gestational diabetes, people with chronic kidney disease, nursing observations of sitter days, neonatal complications, mortality or long term delays. All 12 reviews found equal to statistically significant improvements or reduction of harm in favour of the intervention group. No outcomes favoured the control group.

Clinical/Cardiovascular outcomes were examined in 18 reviews [7, 34, 39, 40, 47, 50, 5769] of APNs and NPs in acute and primary care. Care was provided to adults, residents in LTC, and patients 12 weeks post cardiac surgery. Outcomes included assessment and monitoring of patients with heart failure, blood pressure and symptom management, screening for undetected hypertension in the Emergency Room, vascular risk reduction, direct current cardioversion, and metabolic outcomes. Results include statistically significant reductions in systolic and diastolic blood pressure using meta-analyses [50, 60, 64, 65, 67]. Equal to statistically significant reductions noted in outcomes. No outcome favouring the control group was identified.

Clinical/Cancer Care was identified in four reviews [7073]. Studies encompassed APNs and CNSs in acute care and NPs in primary care. Bryant-Lukosius, Cosby, et al. [70] reported that 150 outcomes were measured across 29 studies. Among these, 88 outcomes were equal and 53 were superior in the APN group. Nine outcomes favoured the control group including health perceptions, symptom distress, depression and physical functioning in 1/9 studies [70]. In breast cancer care, statistically significant reductions were noted in levels of uncertainty at one, three and six months but not at 12 months. Statistically significant reductions in uncertainty and symptom distress (p<0.0001), and better health related quality of life (HRQoL) SF‐12 related to mental (p = 0.0001) and physical(p<0.001) well‐being were noted in the intervention group. Cancer screening was examined in six studies with statistically significant increases noted in the APN group. Similar technical competencies were noted between the intervention and control groups in these studies. NPs had significantly fewer discrepancies between the PAP smears and the biopsies, unsatisfactory colposcopies or missed invasive cancers. CNSs contributed to understanding and meeting the individual needs of women with gynecological cancer in 1/1 study [71]. NPs increased the number of clinical skin examinations by 14% over a 4-year period, and the number of referrals to a dermatologist, biopsies and surgery also decreased during the same period in 1/1 study [72]. CNS-led cancer survivorship and post-treatment follow-up interventions in acute care significantly improved patients’ information needs, self-care, coping and well-being [70]. However, there was a lack of studies examining post treatment survivorship care in primary care [73].

Clinical/Diabetes was identified in 11 reviews [34, 3840, 47, 58, 61, 62, 6466, 74]. Studies were conducted with APNs in acute and primary care and NPs in primary care. All studies showed equal to statistically significant reductions in HbA1C and blood glucose levels. Significantly more eye and foot exams in the intervention group noted in one review [62]. No differences in annual eye exams noted in another review [66]. No measures favoured the control group.

Clinical/Mental Health was examined in 18 reviews [7, 33, 35, 36, 45, 47, 50, 51, 60, 67, 70, 7581]. Studies included APNs, NPs and CNSs in acute care, and APNs and NPs in primary care. Scheydt [79] mapped 46 tasks and activities of mental health APNs to six practice domains that include 1) clinical nursing, 2) care coordination and case management, 3) psychosocial health promotion and prevention; 4) consulting, education and coaching, 5) leadership and public relations, and 6) research and practice development. Patient health conditions included depression and/or anxiety, anxiety rehabilitation, symptom burden, depression following cardiac surgery, emotional well being, social functioning, psychological morbidity, distress, empowerment, self-management, confidence, subjective health status, and cognitive impairment over 12 months. Equal to statistically significant improvements noted in all the studies. One review identified decreased odds of depression at the 4-year mark for clinic patients in the control group (p = 0.001) [67]. However, the authors cautioned of a suspected cross-over effect.

Clinical/Musculoskeletal indicators were identified in six reviews [10, 43, 46, 61, 82, 83]. Reviews included APNs and CNSs in acute care and CNSs and NPs in primary care. Unchanged rates of hip re-fractures in the frail elderly, and disease activity and progression in rheumatoid arthritis were noted. Statistically significant reductions in surgical infections and caregiver distress at 2 weeks post discharge of frail elderly identified in one review of CNSs in transition roles [83]. No outcomes favoured the control group.

Clinical/Renal indicators were examined in three reviews [58, 62, 65]. Studies were conducted with NPs in primary care. No significant differences noted in parameters of kidney functioning at six months, phosphate levels, levels of urinary albumin excretion, and urinalysis in the intervention group. No outcomes favoured the control groups.

Clinical/Respiratory outcomes were identified in eight reviews [33, 3841, 62, 65, 84, 85]. Studies were conducted with APNs and NPs in primary care. Equal to statistically significant results favouring the intervention group for the frequency of asthma exacerbation and asthma control in adults and children, airway hyper-reactivity, antibiotic treatments, peak flow measures, and lung function at 12 and 24 months. No outcome favouring the control group was identified.

Diagnosis was identified in three reviews [61, 86, 87]. Studies were conducted with NPs in primary care and examined diagnostic accuracy, most common diagnoses, and nurse-initiated X-Rays and treatments. The most common diagnoses in the Emergency room included soft tissue injuries and fractures. Improvements were noted in adenoma detection (p < 0.001), and diagnosis and treatment (p < 0.001) in the intervention group. No outcomes favoured the control groups.

Education-Patient was examined in 10 reviews [36, 48, 52, 61, 62, 64, 66, 69, 87, 88]. Studies were conducted with APNs and NPs in acute care and NPs in primary care. Activities included providing information about independent and supplemental nurse prescribing, knowledge of positive contributions of prescribing, health education, medication, symptom relief, discharge information, face-to-face visits and telephone calls at 12 months or longer, providing written documentation, information on who to contact if needed, healthy lifestyle recommendations for sodium intake, alcohol consumption, and weight management. Equal to statistically significant results favouring the NP group noted for all the reviews. No outcomes in favour of the control group were identified.

Mortality identified in 21 reviews [7, 10, 3336, 39, 40, 46, 61, 64, 67, 80, 84, 8996] and included APNs and NPs in acute and primary care. Studies examined mortality, mortality at 30-days, 90 days, 12 months and 24 months, mortality related to coronary events, total mortality, all-cause mortality, survival time, and mortality in critical care. Equal to statistically significant reductions in mortality or improved survival noted in all studies. A cross‐over effect noted in one study because all patients had the chance to attend the nurse‐led clinics within 10 years and detecting differences between the groups was unlikely [67]. One review [10] reported increased mortality at 30 days (p = 0.04) in 1/12 study. No other studies favoured the control group.

Morbidity was reported in one review [10]. A trend towards a reduction in the complication rate identified in 6/6 studies, with rates remaining low. One study reported a significant decrease and one study reporting a non-significant increase noted between the intervention and control groups.

Patient Adherence was identified in seven reviews [7, 10, 33, 48, 51, 85, 97] and included APNs and NPs in acute and primary care. Indicators included bone mineral density testing, condition-specific medications, adherence to cardiac rehabilitation, dietary management, lipid profiles at 12 months, smoking cessation, patient enablement, follow-up adherence for return appointments. One meta-analysis (n = 676 patients) of medication adherence identified that short-term adherence (pooled odds ratio 1.55 (1.04–2.29) improved over time with long-term adherence (pooled odds ratio: 1.87 (1.35–2.61)) [97]. Equal to statistically significant improvements were noted in the intervention group with no results favouring the control group.

Quality of Life (QoL) was examined in 28 reviews [7, 10, 33, 34, 36, 37, 41, 42, 45, 50, 52, 55, 56, 6062, 66, 67, 7578, 80, 84, 85, 95, 98, 99]. Studies were conducted with APNs, NPs and CNSs in acute care and APNs and NPs in primary care. Indicators included physical, social and role functioning, health-related QoL, cancer survivorship QoL in acute care, condition-specific QoL for asthma, cancer, diabetes, coronary artery disease, QoL in heart failure at 12 weeks and 12 months, chronic obstructive pulmonary disease (COPD), quality-adjusted life years, apnea and feeding tolerance in neonates, daily functioning and perceived health problems in elderly patients at 6 weeks post hospital discharge. Equal to statistically significant improvements were noted in all reviews. Chan [42] highlighted that 1/17 studies reporting on health related QoL in their review found a small but statistically significant reduction in overall physical component scores on the SF36 for patients with Type 2 diabetes.

Satisfaction-Patient and Family was identified in 40 reviews [7, 33, 35, 36, 3844, 48, 51, 52, 55, 56, 6163, 69, 71, 76, 78, 80, 87, 88, 92, 94, 96, 100111]. Studies included APNs, NPs and CNSs in acute care and APNs and NPs in primary care. Almost all reviews found equal to statistically significant improvements in patient and family satisfaction. Two meta-analyses [33, 69] were conducted with significant improvements noted for NP care of patients post hysterectomy and for patient and parent satisfaction in primary care. Mixed findings noted in two reviews. The first review [55] found that men with prostate cancer had statistically lower scores for satisfaction at the end of treatment in ½ studies. The second review [108] highlighted that patient satisfaction with the usual source of care and wait times was worse in states with the least restrictive NP scope of practice policies.

Signs and Symptoms were examined in 18 reviews [33, 36, 42, 46, 56, 60, 61, 66, 67, 75, 77, 78, 85, 92, 99, 110, 112, 113]. Studies included APNs in acute and primary care and NPs in primary care. Outcomes included symptom burden, symptom management for angina, appetite loss, constipation, diarrhea, dyspnea, insomnia, nausea and vomiting, cognitive and behavioural changes and dementia at 12 months and 18 months, fatigue at 12 months and 24 months, urinary tract infections, symptom improvement, pain, jaundice in neonates. Equal to statistically significant improvements in signs and symptom management noted in the reviews. In a meta-analysis of appetite loss conducted by Monterosso (2019) [60], no significant differences were noted in appetite loss at the end of the intervention (up to 24 months) but appetite loss at 4–6 months was significantly lower in the control group (MD = 4.43, 95%CI [0.08, 8.78], 354 participants, p = 0.05; I2 = 0%).

Provider indicators

Adherence to Best Practice-Provider was identified in 10 reviews [33, 34, 48, 51, 66, 67, 81, 92, 114, 115]. Studies included APNs in acute and primary care and NPs in primary care. Reviews examined medication adherence, renin-angiotensin converting enzyme inhibitors, beta blockers, aspirin intake, clopidogrel, annual physical assessment, condition-specific care, meeting clinical targets, motivational interviewing, dementia care, counselling, cognitive behavioural and problem-solving therapy in older adults. Equal to statistically significant improvements noted in all reviews. No negative outcomes noted.

Education-Provider was examined in 17 reviews [34, 44, 59, 72, 87, 92, 107, 114123]. Studies were conducted with APNs and NPs in education and acute and primary care. Provider education topics included pharmacology, clinical decision-making, task knowledge and capabilities, self-knowledge and interpersonal skills, transition as new faculty, advanced diagnostic procedures and skills, educational preparedness in the Emergency Room, mentor competency, informal training to assess skin lesions, clinical skin assessments, early detection of skin cancer, application of evidence-based protocols and staff consultation. Training modalities used were didactic, e-learning, workshops, education logs, simulation, face-to-face and observations by experts, orientation in LTC and in academia, continuing education and on-the-job training. Equal to statistically significant improvements and no negative outcomes noted across the reviews.

Illness Prevention was reported in nine reviews [33, 45, 46, 48, 61, 62, 67, 70, 73]. Care involved APNs in acute and primary care and NPs in primary care. Follow-up consultations, metabolic outcomes, feasibility of screening for depression, patient health assessment at 12 and 24 months, clinical examinations, smoking status, smoking cessation, diet at one-year, cervical cancer screening, breast cancer screening, colorectal cancer screening, follow-up consultations and return visits were examined. No cancer screening activities for patients were identified for APNs in acute care in one review [70]. Equal to statistically significant improvements noted.

Interprofessional Team Functioning was examined in five reviews [34, 35, 81, 88, 117]. Studies include APN in acute care and APNs and NPs in primary care. Reviews reported on communication, building trusting relationships, reducing hierarchies, interdisciplinary approaches, team functioning, and collaborative care. Equal to improved team functioning noted across reviews. No provider outcomes reported in LTC [34].

Prescribing identified in 24 reviews [34, 36, 42, 46, 48, 51, 61, 62, 69, 81, 85, 8890, 92, 112115, 117, 124127]. APNs, NPs and CNSs in acute care and APNs and NPs in primary care were studied. A wide range of prescribing activities were described including medications, systemic anti-cancer therapy, blood tests, laboratory tests, weight loss pharmaceuticals, rescue medication, opioid prescribing. Equal to statistically significant results favouring the intervention group noted in 23/24 reviews. One review [112] found that NPs appeared to be less likely to prescribe an opioid for acute users at baseline but they were more likely to prescribe higher doses of morphine milligram equivalents in 2/2 studies. Single studies in reviews by Salamanca-Balen [126] in acute care and Swan [51] in primary care found that CNSs and APNs, respectively, requested significantly more tests.

Satisfaction-Provider was examined in nine reviews [42, 92, 105, 114, 115, 118, 128130] and included APNs and NPs in acute and primary care. Positive views were noted with improved communication, good interpersonal relationships, increased role confidence, improved dementia care, care coordination and timely access to care. Some mental health nurse prescribers expressed anxiety over role conflict related to prescribing in one review [114]. Dissatisfaction was associated with higher overtime hours in one review [128].

Health system indicators

Access to Care was identified in eight reviews [49, 54, 61, 71, 100, 115, 121, 126]. Studies included CNSs in acute and primary care and APNs and NPs in primary care. Studies examined access for women with gynecological cancers, treatment for precancerous lesions, patients with COPD, primary care, and pediatric visits. Equal to statistically significant improvements noted in access to care. No negative outcomes noted.

Consultations were reported in 20 reviews [7, 33, 34, 42, 46, 48, 51, 5355, 61, 62, 69, 72, 85, 92, 105, 109, 122, 126]. Studies included all roles but did not report on CNSs in primary care separately. Mixed findings noted with equal to statistically significant reductions in consultations, treatment initiation in lung cancer, and improved attendance to provider appointments in acute and primary care noted in 10 reviews [7, 33, 42, 51, 72, 85, 92, 105, 122, 126]. However, one study in the Salamanca-Balen [126] review reported that the number of referrals to primary care and cardiology clinics increased significantly. Increased consultations favouring the control group noted in nine reviews [34, 46, 48, 5355, 62, 69, 109]. One review did not report on the length of consultations times [61].

Costs were reported in 40 reviews [7, 10, 3336, 3840, 42, 44, 46, 47, 49, 51, 52, 54, 55, 57, 60, 61, 63, 69, 8385, 9196, 98, 103, 106, 109, 111, 115, 126, 131, 132]. Studies included all roles. Costs were estimated for diverse goods and services including laboratory tests, diagnostic procedures, direct and indirect costs, medications, healthcare personnel, patient care visits, types of services, salary, fee for service, hospital costs, home care, program costs, quality adjusted life years, cost effectiveness, incremental cost effectiveness ratio, cost utility, and total costs. Equal to reduced costs noted in 32 reviews. Mixed results noted in seven reviews [42, 52, 55, 84, 109, 126, 131] at the level of individual studies included in the reviews. One review [63] did not report costs in retained studies of APNs.

Emergency Room Visits were identified in 18 reviews [34, 3740, 45, 47, 53, 62, 69, 84, 86, 90, 93, 102104, 126, 133]. Except for one review conducted with CNSs in acute care [126], reviews were conducted with APNs and NPs in primary care. Equal to statistically significant reductions were noted in 15 studies. Mixed results noted in two reviews [34, 45] with equal to statistically significant increases noted at the study level. Lawton [84] did not specifically report on ER attendance. Van Vliet [53] did not report on non conveyance rates for NPs as data were not available for ambulance transport.

Health Care Service Delivery was reported in 25 reviews [33, 34, 36, 37, 41, 45, 46, 5156, 61, 62, 69, 78, 83, 92, 93, 99, 100, 103, 122, 127]. Studies conducted with APNs and NPs in acute and primary care and CNSs in acute care examined adherence to appointments, hospitalizations, office-based visits to oncologists, no-show rates, continuity of care of providers, transitional care for patients with schizophrenia, home-based interventions for individuals with severe mental illness and HIV, primary care interventions for women with ovarian cancers, healthcare utilization, follow-up contact, barriers to pre-exposure prophylaxis implementation in HIV, acceptability of nurse-led care, specialist and primary care visits, collaborative care models, end of life care for patients with severe dementia, palliative care, number of outpatient contacts and primary care contacts, service use at 30-, 120- and 180-days, transition care, case management consultation length, NP growth over time, post-discharge care, and return visits. Lovink [34] reported that no study measured implementation as a process outcome. Equal to significant reductions in healthcare service delivery or resource utilization noted in 19 reviews. Yang [54] noted that full practice authority for NPs led to increases in service utilization. Mixed findings noted in four reviews [51, 55, 56, 69]. These reviews respectively reported an increased number of visits at 12 months but fewer APN visits at 24 months in primary care, more referrals to mental health specialists and prenatal visits, more home care services for elderly patients post discharge, and additional return visits within 2 weeks. Zhang [127] identified key barriers to implement pre-exposure prophylaxis in HIV. Trend to decreased Emergency medical service use for patients with high 911-call use and no significant differences in NP follow up contact after the completion of pre-hospital care [53].

Hospitalization was examined in 29 reviews [7, 10, 33, 34, 3640, 47, 49, 50, 55, 57, 61, 62, 67, 69, 8385, 8991, 93, 95, 98, 115, 126, 133]. Reviews included APNs in acute and primary care, NPs in primary care and CNSs in acute care. Reviews examined a range of provider interventions, hospital admissions, heart failure readmissions, re-hospitalizations at 3-, 6- and 12 months, unplanned hospital transfers, ICU readmissions, return visits for any reason, post-discharge care following surgery and for women with high-risk pregnancies and in the post-partum period, nursing home admissions, and home visits. Equal to statistically significant reductions noted in 26 reviews. Mixed results noted in one review where ¼ studies reported an increase in admissions at 2 weeks post-discharge [10]. A higher proportion of hospital admissions [84] and increased admission rates for patients with lung disease reported in 1/1 study [61].

Length of Stay was reported in 22 reviews [7, 10, 36, 39, 40, 42, 50, 55, 56, 62, 63, 83, 86, 87, 91, 93, 94, 96, 104, 109, 115, 126, 134]. Studies with APNs, NPs and CNSs in acute care and APNs and NPs in primary care examined length of stay in the intensive care unit, in the Emergency room, in radiology, length of visits, in hospital, psychiatric inpatient unit, post-partum and postoperative cardiac surgery. Equal to statistically significant reductions noted 19 reviews. Mixed results noted in three reviews [62, 115, 126].

Patient Safety was examined in 19 reviews [7, 33, 35, 36, 39, 40, 46, 5456, 6163, 72, 87, 90, 91, 103, 109, 135]. Studies included APNs, NPs and CNSs in acute care and NPs in primary care. Safety issues included postoperative complications, urinary tract infections, time to occlusion of arteriovenous fistula access, adverse events, treatment complications, medication interactions, malpractice, restraint use, sitter walk-aways, falls, mandatory monitoring of blood tests, out of range blood tests, risk factor management, missed injuries, deep vein thrombosis identification, inappropriate management of health conditions, unnecessary biopsies, condition-specific complications related to strokes, pregnancy, and the intensive care unit. Equal to statistically significant reductions noted for all adverse events. No studies favoured the control groups.

Quality of Care reported in 11 reviews [34, 42, 49, 52, 54, 85, 92, 103, 106, 135, 136]. Studies included APNs and CNSs in acute care and APNs and NPs in primary care. Indicators included quality of outreach services for dementia care, complications related to endoscopies, improved recording of medical information, incident rates of arteriovenous fistula use, incidence of central venous catheter placement at the start of dialysis, prevalence of late referrals of arteriovenous fistulas, emergency care, and asthma care. Equal to statistically significant improvements noted across the reviews. No outcomes favouring the control groups were noted.

Scope of Practice was assessed in 22 reviews [49, 54, 86, 87, 92, 101, 107, 108, 117, 122, 130, 136146]. Several reviews used meta-synthesis and thematic analysis to summarize key findings for this indicator. Scope of practice includes clinical and non-clinical role dimensions [145, 146]. Legislation shapes practice [139]. Leadership, consultancy, networking and the ability to develop relationships influence scope of practice [145, 146]. Central themes to changes in scope of practice included professional boundaries, autonomy, interprofessional collaboration and the advanced practice role as a resource for the team [137]. APN governance and regulations are often country-specific [136]. Several reviews indicated that autonomous or full scope of practice enhanced patient, provider and health system level outcomes (e.g., Dawson, 2015; Hutchison, 2014) [101, 141].

Wait Times were examined in 12 reviews [10, 53, 61, 63, 72, 86, 96, 100, 103, 104, 111, 122]. Studies included APNs and NPs in acute care and primary care. Wait times for treatment, for appointments, in the Emergency Room, did-not-wait rates, time to surgery, to provider’s initial assessment, patients seen in a timely manner, and on scene treatment times were measured. Equal to statistically significant reductions noted in all reviews. No data for APN wait times for direct current cardioversion [63] or pre-hospital conveyance [53].

Artificial Intelligence-Health Technology was examined in two reviews [147, 148]. One review identified 13 barriers to hospital-based NPs using clinical decision support [147]. A second review examined NP involvement and experience with AI-based health technologies in primary care (e.g., family, geriatric and pediatric care), hospital (e.g., acute, post-acute and post-operative), and in the Emergency Room in which Machine Learning-based clinical decision support systems were developed. Decision outputs (diagnostic and referral decisions) were compared with the clinical decisions of NPs who assumed the role of diagnostic and/or therapeutic expert. NP clinical activities that are enabled by AI-based health technologies (AIHT) systems and addressed AIHT in support of the referral or triage decisions made by NPs were examined. Studies examined AI-based technologies were meant to improve the follow-up and surveillance of patients by NPs, and a single study in the review examined illness prevention.

Discussion

We sought to determine if current systematic reviews represent countries where APNs, NPs or CNSs are found, and describe the studies, study population, roles, and outcomes identified in the reviews. The overview identified 117 systematic reviews published in 121 papers incorporating 1653 primary studies. Less than 4% of papers were cited more than twice, thus there was minimal overlap in our findings. An average of 3.4 countries per review were identified. Countries (e.g., United States) with longer histories of advanced practice nursing roles represented the largest contributors to the overview. Countries where APN, NP and CNS roles are emerging were also identified (e.g., France) [149151]. Geographical gaps in advanced practice nursing research were identified in countries in almost all WHO regions including Africa, Europe, Southeast Asia, Eastern Mediterranean, Western Pacific and Latin America.

The evaluation of the risk of bias was conducted using CASP and several criteria were met. However, the assessments related to the identification of all important studies was low. Although several databases were searched, review authors did not clearly state that two reviewers had independently screened titles and abstracts and extracted the relevant studies. If was often not clear if a second reviewer had verified the extractions. This underscores the importance of adhering to reporting guidelines (e.g., PRISMA 2020 [18]) when reporting on this important step of the review. In addition, reviews were also downgraded if they included geographical and language restrictions.

We found highly consistent evidence about the care provided by APNs, NPs and CNSs across 29 indicator categories at the patient, provider and health system levels. Care was assessed as equal or superior to the comparator (usual care, physicians) across a wide range of clinical settings, patient populations and acuity levels in almost all the reviews. Mixed findings were noted for quality of life, consultations, costs, emergency room visits, and health care service delivery where some studies favoured the control groups. However, no review or indicator category clearly favoured the control group.

Some areas have been examined extensively as evidenced by the number of reviews included in the indicator category. Indicators related to clinical categories (health, cardiovascular, diabetes, mental health), education-patient, mortality, quality of life, satisfaction-patient and family, signs and symptoms, adherence to best practice-provider, education-provider, prescribing, consultations, costs, emergency room visits, health care service delivery, hospitalization, length of stay, patient safety, quality of care, scope of practice and wait times were examined in 10 to 40 systematic reviews.

The current overview built on the categorization scheme used in a recent overview of indicators to measure the quality of primary healthcare NP practice where outcomes were classified in 26 indicator categories [9]. Three new indicator categories were created for the current overview that incorporated a broader range of advanced practice nursing roles across acute and primary care settings. At the patient level, an indicator related to morbidity was created. At the provider level, satisfaction was added. Artificial intelligence-Health technology was added as a cross-cutting indicator category because of the broad scope and reach of AI. Finally, the indicator category related to rheumatoid arthritis was broadened to include musculoskeletal outcomes. This categorization scheme can be used in subsequent studies to classify and measure relevant APN, NP and CNS outcomes across sectors and with a wide range of patient populations.

There is emerging research in AI that cuts across care sectors by engaging remote monitoring, improving diagnosis accuracy, assisting clinical decision and facilitating predictive analysis. The COVID-19 pandemic increased the use of technology exponentially. Healthcare providers need to have the most up-to-date knowledge to adapt to a quickly changing healthcare landscape. In addition, patients in vulnerable situations (e.g., homelessness) or those with cognitive or sensory deficits (e.g., patients with impaired hearing, patients with dementia) have specific needs regarding technology. Subsequent research needs to close the knowledge gap related to the use of technology and how they influence patient, provider, and health system outcomes. In addition, the use of big data to capture advanced practice nursing contributions is needed. Many health systems worldwide do not track advanced practice nursing care providers adequately. Thus, it is difficult to identify their activities and associated outcomes.

There is a lack of reviews related to APNs, NPs or CNSs and global health research, such as disaster, communicable diseases, and care equity. Other gaps in research in clinical settings include pre-hospital and ambulance care, cancer survivorship in primary care, care of patients in vulnerable situations, interprofessional team functioning, workload and working conditions, acute care nephrology and hemodialysis. In relation to advanced practice roles, there is a lack of research describing CNS roles in primary care and with specific patient populations (e.g., CNSs in adolescent care).

Nurses in advanced practice roles play an important role in engaging patients and families as partners in care. Patient and family engagement in care needs to be better understood to support their experience of care and engagement (e.g., patient reported experience measures (PREMs) and patient reported outcome measures (PROMs). Other important knowledge gaps include an examination of spirituality, cultural safety and cultural sensitivity and advanced practice nursing [9, 152]. Turkelson et al. [153] highlighted that simulation with NP students increased cultural sensitivity with patients of Hispanic origins. The umbrella review to measure the quality of primary healthcare NP practice [9] found no indicator to measure cultural safety, particularly with Indigenous Peoples. Filling these gaps in knowledge is critical to give patients and families a voice in their healthcare [154].

Current knowledge about the influence of high and low fidelity simulation on provider behaviours and patient, provider and system outcomes remains mostly anecdotal [155]. We identified two reviews examining simulation with NPs in acute and primary care that focussed on increasing knowledge and learner satisfaction [118, 123]. A systematic review of short team interventions [25] identified helpful modalities for high and low fidelity simulations and debriefing for providers. However, new knowledge is needed to outline content areas for specific patient (e.g., complex care, home care), and provider (e.g., complex technical skills) groups including other advanced practice nursing roles.

Strengths and limitations

Several challenges were identified during title and abstract screening, extraction and analysis for studies that used the title of nurse-led. Internationally, some countries do not have recognized APN, NP or CNS titles which may have limited our ability to identify this body of research. To counteract this, we included several strategies to optimize study identification including a wide database search, review of the grey literature, hand searches and consultations across our global research collaborators to identify published and unpublished reviews that met our criteria. In addition, we went beyond accepted role titles to review role descriptions in all the reviews that included the term nurse-led. Several reviews were excluded late in the review process, after full text review and extraction, to ensure that we captured roles that met the level of decision-making autonomy consistent with advanced practice nursing roles.

Conclusion

Our overview identified 117 systematic reviews examining advanced practice nursing across the globe with 38 countries represented across the reviews. Review quality was downgraded because study selection and extraction were not conducted by two reviewers and language or geographic restrictions were applied. However, given the large number of primary studies that were captured, we do not anticipate that this influences our findings. Consistent evidence of equal to statistically significant improvements noted for APNs, NPs and CNSs across 29 indicator categories at the patient, provider and health system levels. Care was assessed across a range of clinical settings, patient populations and acuity levels. Mixed results noted for the length of consultations and costs primarily. No indicator clearly favoured the control group. There is emerging research in AI that cuts across care sectors. Specific research gaps were identified to guide subsequent needs for advanced practice research. They include research related to AI, technology, global health research, interprofessional team functioning, workload and working conditions, how to engage patients and families as partners in healthcare, and care of patients in vulnerable situations.

Supporting information

S1 Checklist. PRISMA 2020 checklist.

(PDF)

pone.0305008.s001.pdf (135KB, pdf)
S1 Appendix. Record of review-related decisions.

(PDF)

pone.0305008.s002.pdf (200.2KB, pdf)
S2 Appendix. Search strategies for the published literature.

(PDF)

pone.0305008.s003.pdf (283.5KB, pdf)
S3 Appendix. Search strategies for the grey literature.

(PDF)

pone.0305008.s004.pdf (92.1KB, pdf)
S1 Table. Risk of bias assessment for the included systematic reviews (n = 117).

(PDF)

pone.0305008.s005.pdf (175.1KB, pdf)
S2 Table. Description of included systematic reviews (n = 117).

(PDF)

pone.0305008.s006.pdf (563.4KB, pdf)
S3 Table. Extractions of review results by indicator category at the Patient level.

(PDF)

pone.0305008.s007.pdf (411.7KB, pdf)
S4 Table. Extraction of review results by indicator category at the Provider level.

(PDF)

pone.0305008.s008.pdf (261.8KB, pdf)
S5 Table. Extraction of review results by indicator category at the Health System level.

(PDF)

pone.0305008.s009.pdf (577.8KB, pdf)
S6 Table. Extraction of review results by indicator category related to Artificial Intelligence.

(PDF)

pone.0305008.s010.pdf (142KB, pdf)

Acknowledgments

The collaborative effort of the International Council of Nurses Nurse Practitioner Advanced Practice Nurse Network (ICN NP/APNN) is exemplified in this work, with significant contributions made by several ICN NP/APNN members.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This work is supported by the McGill University Faculty of Medicine and Health Sciences and the Newton Foundation via the Susan E. French Chair in Nursing Research and Innovative Practice held by KK. KK is also supported by a Fonds de recherche du Québec-Santé (https://frq.gouv.qc.ca/en/health/) Research Scholar Senior (Award Number 298573) salary award. There was no additional external funding received for this study, and the authors received no specific funding for this work. All the funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.World Health Organization. State of the World’s Nursing Report 2020- Investing in education, jobs and leadership. Health Workforce. 6 April 2020. Available from: https://www.who.int/publications/i/item/9789240003279. [Google Scholar]
  • 2.National Academies of Sciences and Medicine. The future of nursing 2020–2030: Charting a path to achieve health equity. Washington, DC: The National Academies Press; 2021. Available from: https://www.ncbi.nlm.nih.gov/books/NBK573914/pdf/Bookshelf_NBK573914.pdf. [PubMed] [Google Scholar]
  • 3.International Council of Nurses, Schober M, Lehwaldt D, Rogers M, Steinke M, Turale S, et al. Guidelines on advanced practice nursing. 2020. Available from: https://www.icn.ch/system/files/documents/2020-04/ICN_APN%20Report_EN_WEB.pdf. [Google Scholar]
  • 4.Canadian Nurses Association, Almost J. Regulated nursing in Canada: The Landscape in 2021. February 2021. Available from: https://www.cna-aiic.ca/en/nursing-practice/the-practice-of-nursing/regulated-nursing-in-canada. [Google Scholar]
  • 5.American Association of Nurse Practitioners (AANP). Discussion Paper: Quality of nurse practitioner practice. 2020. Available from: https://storage.aanp.org/www/documents/advocacy/position-papers/Quality-of-NP-Practice-Bib_11.2020.pdf. [Google Scholar]
  • 6.Kerr H, Donovan M, McSorley O. Evaluation of the role of the clinical nurse specialist in cancer care: An integrative literature review. Eur J Cancer Care. 2021;30(3):e13415. doi: 10.1111/ecc.13415 [DOI] [PubMed] [Google Scholar]
  • 7.Audet LA, Paquette L, Bordeleau S, Lavoie-Tremblay M, Kilpatrick K. The association between advanced practice nursing roles and outcomes in adults following cardiac surgery: A systematic review of randomized controlled trials. Int J Nurs Stud. 2021;122:104028. doi: 10.1016/j.ijnurstu.2021.104028 [DOI] [PubMed] [Google Scholar]
  • 8.Ladd E, Miller M, Wheeler M, Wainaima S, Aguirre F, McGrath H, et al. A global SWOT analysis of advanced practice nursing: Policy, regulation, and practice. ResearchSquare [Preprint]. 2020. [Posted 2020 Nov 25; cited 2022 Dec 7]: [21 p.]. Available from: https://www.researchsquare.com/article/rs-113320/v1 doi: 10.21203/rs.3.rs-113320/v1 [DOI] [Google Scholar]
  • 9.Kilpatrick K, Tchouaket E, Savard I, Chouinard MC, Bouabdillah N, Provost-Bazinet B, et al. Identifying indicators sensitive to primary healthcare nurse practitioner practice: A review of systematic reviews. PLoS One. 2023;18(9):e0290977. doi: 10.1371/journal.pone.0290977 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Allsop S, Morphet J, Lee S, Cook O. Exploring the roles of advanced practice nurses in the care of patients following fragility hip fracture: A systematic review. J Adv Nurs. 2021;77(5):2166–84. doi: 10.1111/jan.14692 [DOI] [PubMed] [Google Scholar]
  • 11.Jokiniemi K, Bryant-Lukosius D, Roussel J, Kilpatrick K, Martin-Misener R, Tranmer J, et al. Differentiating specialized and advanced nursing roles: The pathway to role optimization. Nurs Leadersh. 2023;36(1):57–74. doi: 10.12927/cjnl.2023.27123 [DOI] [PubMed] [Google Scholar]
  • 12.Sastre-Fullana P, Gray DC, Cashin A, Bryant-Lukosius D, Schumann L, Geese F, et al. Visual analysis of global comparative mapping of the practice domains of the nurse practitioner/advanced practice nursing role in respondent countries. J Am Assoc Nurse Pract. 2020;33(7):496–505. doi: 10.1097/JXX.0000000000000458 [DOI] [PubMed] [Google Scholar]
  • 13.Schumann L, Bird B, Pilane C, Duff E, Geese F, Jelic M, et al. Mapping of advanced nursing competencies from nineteen respondent countries against the Strong Model of advanced practice nursing (2000) and the International Council of Nurses (2008) Advanced Practice Nursing Competencies (2013–2017). International Council of Nurses NP/APN Network Research Subgroup Publication. March 2019. doi: 10.13140/RG.2.2.30271.94884 [DOI] [Google Scholar]
  • 14.Henderson C, Kra-Friedman A, Audet L-A, Savard I, Spies LA, McGrath H, et al. A global perspective of advanced practice nursing research: A review of systematic reviews. PROSPERO, CRD42021278532. 2021. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021278532. [Google Scholar]
  • 15.Kilpatrick K, Savard I, Audet L-A, Kra Friedman A, Atallah R, Jabbour M, et al. A global perspective of advanced practice nursing research: A review of systematic reviews protocol. PloS One. 2023;18(1):e0280726. doi: 10.1371/journal.pone.0280726 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: A systematic review. J Clin Epidemiol. 2012;65:e1267–e73. doi: 10.1016/j.jclinepi.2012.06.015 [DOI] [PubMed] [Google Scholar]
  • 17.Kilpatrick K, Tchouaket E, Chouinard M, Savard I, Bouabdillah N, Houle J, et al. Identifying indicators sensitive to primary healthcare nurse practitioner practice: A review of systematic reviews protocol. BMJ Open. 2021;11(1):e043213. doi: 10.1136/bmjopen-2020-043213 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: 10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kilpatrick K, Harbman P, Carter N, Martin-Misener R, Bryant-Lukosius D, Donald F, et al. The acute care nurse practitioner role in Canada. Nurs Leadersh. 2010;23 Spec No 2010:114–39. doi: 10.12927/cjnl.2010.22272 [DOI] [PubMed] [Google Scholar]
  • 20.Valaitis R, Martin-Misener R, Wong ST, MacDonald M, Meagher-Stewart D, Austin P, et al. Methods, strategies and technologies used to conduct a scoping literature review of collaboration between primary care and public health. Prim Health Care Res Dev. 2012;13(3):219–36. doi: 10.1017/S1463423611000594 [DOI] [PubMed] [Google Scholar]
  • 21.Kilpatrick K, Tchouaket E, Carter N, Bryant-Lukosius D, DiCenso A. Structural and process factors that influence clinical nurse specialist role implementation. Clin Nurse Spec. 2016;30(2):89–100. doi: 10.1097/NUR.0000000000000182 [DOI] [PubMed] [Google Scholar]
  • 22.Landry V, Kilpatrick K, Paquette L, Jabbour M, Beaulieu MD, Dubois CA, et al. The scope of nurse practitioner roles in primary health care in different practice setting in Quebec: A time and motion study. Science of Nursing and Health Practices. 2020;3(6). Available from: https://id.erudit.org/iderudit/1076475ar. [Google Scholar]
  • 23.Lunny C, McKenzie JE, McDonald S. Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy. J Clin Epidemiol. 2016;74:107–18. doi: 10.1016/j.jclinepi.2015.12.002 [DOI] [PubMed] [Google Scholar]
  • 24.Canadian Agency for Drugs and Technologies in Health. CADTH Search Filters Database. Ottawa. 2022. Available from: https://searchfilters.cadth.ca/list?q=&p=1&ps=20&topic_facet=systematic%20reviews%20000000%7CSystematic%20reviews.
  • 25.Kilpatrick K, Paquette L, Jabbour M, Tchouaket E, Fernandez N, Al Hakim G, et al. Systematic review of the characteristics of brief team interventions to clarify roles and improve functioning in healthcare teams. PloS One. 2020;15(6):e0234416. doi: 10.1371/journal.pone.0234416 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. doi: 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257–68. [PubMed] [Google Scholar]
  • 28.Hart LC, Patel-Nguyen SV, Merkley MG, Jonas DE. An evidence map for interventions addressing transition from pediatric to adult care: A systematic review of systematic reviews. J Pediatr Nurs. 2019;48:18–34. doi: 10.1016/j.pedn.2019.05.015 [DOI] [PubMed] [Google Scholar]
  • 29.Jackson N, Waters E. Criteria for the guidelines for systematic reviews in health promotion and public health taskforce. Health Promot Int. 2005;20(4):367–74. doi: 10.1093/heapro/dai022 [DOI] [PubMed] [Google Scholar]
  • 30.Critical Appraisal Skills Programme (CASP). CASP Checklist: 10 questions to help you make sense of a systematic review. 2018. Available from: https://casp-uk.net/casp-tools-checklists/. [Google Scholar]
  • 31.Whitemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52(5):546–53. doi: 10.1111/j.1365-2648.2005.03621.x [DOI] [PubMed] [Google Scholar]
  • 32.Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol. 2011;11(1):15. doi: 10.1186/1471-2288-11-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Donald F, Kilpatrick K, Reid K, Carter N, Bryant-Lukosius D, Martin-Misener R, et al. Hospital to community transitional care by nurse practitioners: a systematic review of cost-effectiveness. Int J Nurs Stud. 2015;52(1):436–51. doi: 10.1016/j.ijnurstu.2014.07.011 [DOI] [PubMed] [Google Scholar]
  • 34.Lovink MH, Persoon A, Koopmans R, Van Vught A, Schoonhoven L, Laurant MGH. Effects of substituting nurse practitioners, physician assistants or nurses for physicians concerning healthcare for the ageing population: A systematic literature review. J Adv Nurs. 2017;73(9):2084–102. doi: 10.1111/jan.13299 [DOI] [PubMed] [Google Scholar]
  • 35.McParland C, Johnston B, Cooper M. A mixed-methods systematic review of nurse-led interventions for people with multimorbidity. J Adv Nurs. 2022;78(12):3930–51. doi: 10.1111/jan.15427 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Morilla-Herrera JC, Garcia-Mayor S, Martin-Santos FJ, Kaknani Uttumchandani S, Leon Campos A, Caro Bautista J, et al. A systematic review of the effectiveness and roles of advanced practice nursing in older people. Int J Nurs Stud. 2016;53:290–307. doi: 10.1016/j.ijnurstu.2015.10.010 [DOI] [PubMed] [Google Scholar]
  • 37.Osakwe ZT, Aliyu S, Sosina OA, Poghosyan L. The outcomes of nurse practitioner (NP)-Provided home visits: A systematic review. Geriatr Nurs. 2020;41(6):962–9. doi: 10.1016/j.gerinurse.2020.07.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Sun CA, Parslow C, Gray J, Koyfman I, Hladek MD, Han HR. Home-based primary care visits by nurse practitioners. J Am Assoc Nurse Pract. 2022;34(6):802–12. doi: 10.1097/JXX.0000000000000706 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Newhouse RP, Stanik-Hutt J, White KM, Johantgen M, Bass EB, Zangaro G, et al. Advanced practice nurse outcomes 1990–2008: A systematic review. Nurs Econ. 2011;29(5):230–51. [PubMed] [Google Scholar]
  • 40.Stanik-Hutt J, Newhouse R, White K, Johantgen M, Bass E, Zangaro G, et al. The quality and effectiveness of care provided by nurse practitioners. J Nurse Pract. 2013;9(8):492–500.e13. doi: 10.1016/j.nurpra.2013.07.004 [DOI] [Google Scholar]
  • 41.Baker E, Fatoye F. Clinical and cost effectiveness of nurse-led self-management interventions for patients with copd in primary care: A systematic review. Int J Nurs Stud. 2017;71:125–38. doi: 10.1016/j.ijnurstu.2017.03.010 [DOI] [PubMed] [Google Scholar]
  • 42.Chan RJ, Marx W, Bradford N, Gordon L, Bonner A, Douglas C, et al. Clinical and economic outcomes of nurse-led services in the ambulatory care setting: A systematic review. Int J Nurs Stud. 2018;81:61–80. doi: 10.1016/j.ijnurstu.2018.02.002 [DOI] [PubMed] [Google Scholar]
  • 43.de Thurah A, Esbensen BA, Roelsgaard IK, Frandsen TF, Primdahl J. Efficacy of embedded nurse-led versus conventional physician-led follow-up in rheumatoid arthritis: a systematic review and meta-analysis. RMD Open. 2017;3(2):e000481. doi: 10.1136/rmdopen-2017-000481 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Donald F, Martin-Misener R, Carter N, Donald EE, Kaasalainen S, Wickson-Griffiths A, et al. A systematic review of the effectiveness of advanced practice nurses in long-term care. J Adv Nurs. 2013;69(10):2148–61. doi: 10.1111/jan.12140 [DOI] [PubMed] [Google Scholar]
  • 45.Fung YL, Chan Z, Chien WT. Role performance of psychiatric nurses in advanced practice: a systematic review of the literature. J Psychiatr Ment Health Nurs. 2014;21(8):698–714. doi: 10.1111/jpm.12128 [DOI] [PubMed] [Google Scholar]
  • 46.Garner S, Lopatina E, Rankin JA, Marshall DA. Nurse-led care for patients with rheumatoid arthritis: A systematic review of the effect on quality of care. J Rheumatol. 2017;44(6):757–65. doi: 10.3899/jrheum.160535 [DOI] [PubMed] [Google Scholar]
  • 47.McMenamin A, Turi E, Schlak A, Poghosyan L. A systematic review of outcomes related to nurse practitioner-delivered primary care for multiple chronic conditions. Med Care Res Rev. 2023;80(6):563–81. doi: 10.1177/10775587231186720 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Gielen SC, Dekker J, Francke AL, Mistiaen P, Kroezen M. The effects of nurse prescribing: a systematic review. Int J Nurs Stud. 2014;51(7):1048–61. doi: 10.1016/j.ijnurstu.2013.12.003 [DOI] [PubMed] [Google Scholar]
  • 49.Mileski M, Pannu U, Payne B, Sterling E, McClay R. The impact of nurse practitioners on hospitalizations and discharges from long-term nursing facilities: A systematic review. Healthcare. 2020;8(2). doi: 10.3390/healthcare8020114 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Smigorowsky MJ, Sebastianski M, Sean McMurtry M, Tsuyuki RT, Norris CM. Outcomes of nurse practitioner-led care in patients with cardiovascular disease: A systematic review and meta-analysis. J Adv Nurs. 2020;76(1):81–95. doi: 10.1111/jan.14229 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Swan M, Ferguson S, Chang A, Larson E, Smaldone A. Quality of primary care by advanced practice nurses: A systematic review. Int J Qual Health Care. 2015;27(5):396–404. doi: 10.1093/intqhc/mzv054 [DOI] [PubMed] [Google Scholar]
  • 52.Tsiachristas A, Wallenburg I, Bond CM, Elliot RF, Busse R, van Exel J, et al. Costs and effects of new professional roles: Evidence from a literature review. Health Policy. 2015;119(9):1176–87. doi: 10.1016/j.healthpol.2015.04.001 [DOI] [PubMed] [Google Scholar]
  • 53.van Vliet R, Ebben R, Diets N, Pelgrim T, Loef J, Vloet L. Nurse practitioners and physician assistants working in ambulance care: A systematic review. F1000Res. 2020;9:1182. doi: 10.12688/f1000research.25891.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Yang BK, Johantgen ME, Trinkoff AM, Idzik SR, Wince J, Tomlinson C. State nurse practitioner practice regulations and U.S. health care delivery outcomes: A systematic review. Med Care Res Rev. 2021;78(3):183–96. doi: 10.1177/1077558719901216 [DOI] [PubMed] [Google Scholar]
  • 55.Kilpatrick K, Kaasalainen S, Donald F, Reid K, Carter N, Bryant-Lukosius D, et al. The effectiveness and cost effectiveness of clinical nurse specialists in outpatient roles: A systematic review. J Eval Clin Pract. 2014;20(6):1106–23. doi: 10.1111/jep.12219 [DOI] [PubMed] [Google Scholar]
  • 56.Kilpatrick K, Reid K, Carter N, Donald F, Bryant Lukosius D, Martin-Misener R, et al. A systematic review of the cost-effectiveness of clinical nurse specialists and nurse practitioners in inpatient roles. Nurs Leadersh. 2015;28(3):56–76. [PubMed] [Google Scholar]
  • 57.Fichadiya P, Karen L, Rankin J. The impact of nurse practitioners on health outcomes in outpatient heart failure management: A systematic review. Can J Cardiovasc Nurs. 2021;31(3):13–7. [Google Scholar]
  • 58.McCrory G, Patton D, Moore Z, O’Connor T, Nugent L. The impact of advanced nurse practitioners on patient outcomes in chronic kidney disease: A systematic review. J Ren Care. 2018;44(4):197–209. doi: 10.1111/jorc.12245 [DOI] [PubMed] [Google Scholar]
  • 59.McQuilkin MA, Gatewood E, Gramkowski B, Hunter JM, Kuster A, Melino K, et al. Transitioning from clinician to nurse practitioner clinical faculty: A systematic review. J Am Assoc Nurse Pract. 2020;32(10):652–9. doi: 10.1097/JXX.0000000000000295 [DOI] [PubMed] [Google Scholar]
  • 60.Monterosso L, Platt V, Bulsara M, Berg M. Systematic review and meta-analysis of patient reported outcomes for nurse-led models of survivorship care for adult cancer patients. Cancer Treat Rev. 2019;73:62–72. doi: 10.1016/j.ctrv.2018.12.007 [DOI] [PubMed] [Google Scholar]
  • 61.Carranza AN, Munoz PJ, Nash AJ. Comparing quality of care in medical specialties between nurse practitioners and physicians. J Am Assoc Nurse Pract. 2021;33(3):184–93. doi: 10.1097/JXX.0000000000000394 [DOI] [PubMed] [Google Scholar]
  • 62.Health Quality Ontario. Specialized nursing practice for chronic disease management in the primary care setting: An evidence-based analysis. Ont Health Technol Assess Ser. 2013;13(10):1–66. Available from: https://www.hqontario.ca/Portals/0/Documents/evidence/reports/full-report-specialized-nursing-practice-cdm-130906-en.pdf. [PMC free article] [PubMed] [Google Scholar]
  • 63.Manoj S, Moore Z, Patton D, O’Connor T, Nugent LE. The impact of a nurse-led elective direct current cardioversion in atrial fibrillation on patient outcomes: A systematic review J Clin Nurs. 2019;28(19–20):3374–85. doi: 10.1111/jocn.14852 [DOI] [PubMed] [Google Scholar]
  • 64.Massimi A, De Vito C, Brufola I, Corsaro A, Marzuillo C, Migliara G, et al. Are community-based nurse-led self-management support interventions effective in chronic patients? Results of a systematic review and meta-analysis. PloS One. 2017;12(3):e0173617. doi: 10.1371/journal.pone.0173617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Martinez-Gonzalez NA, Tandjung R, Djalali S, Huber-Geismann F, Markun S, Rosemann T. Effects of physician-nurse substitution on clinical parameters: A systematic review and meta-analysis. PloS One. 2014;9(2):e89181. doi: 10.1371/journal.pone.0089181 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Norful AA, Swords K, Marichal M, Cho H, Poghosyan L. Nurse practitioner-physician comanagement of primary care patients: The promise of a new delivery care model to improve quality of care. Health Care Manage Rev. 2019;44(3):235–45. doi: 10.1097/HMR.0000000000000161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Schadewaldt V, Schultz T. Nurse-led clinics as an effective service for cardiac patients: Results from a systematic review. Int J Evid Based Healthc. 2011;9(3):199–214. doi: 10.1111/j.1744-1609.2011.00217.x [DOI] [PubMed] [Google Scholar]
  • 68.Scott RL, Cummings GE, Newburn-Cook C. The feasibility and effectiveness of emergency department based hypertension screening: A systematic review. J Am Acad Nurse Pract. 2011;23(9):493–500. doi: 10.1111/j.1745-7599.2011.00636.x [DOI] [PubMed] [Google Scholar]
  • 69.Martin-Misener R, Harbman P, Donald F, Reid K, Kilpatrick K, Carter N, et al. Cost-effectiveness of nurse practitioners in primary and specialised ambulatory care: Systematic review. BMJ Open. 2015;5(6):e007167. doi: 10.1136/bmjopen-2014-007167 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Bryant-Lukosius D, Cosby R, Earle C, Bakker D, Fitzgerald B, Burkoski V, et al. Effective use of advanced practice nurses in the delivery of adult cancer services in Ontario. 2015. Available from: https://www.cancercareontario.ca/en/guidelines-advice/types-of-cancer/2166. [Google Scholar]
  • 71.Cook O, McIntyre M, Recoche K, Lee S. Experiences of gynecological cancer patients receiving care from specialist nurses: a qualitative systematic review. JBI Database Syst Rev Implement Rep. 2017;15(8):2087–112. doi: 10.11124/JBISRIR-2016-003126 [DOI] [PubMed] [Google Scholar]
  • 72.Loescher LJ, Stratton D, Slebodnik M, Goodman H. Systematic review of advanced practice nurses’ skin cancer detection knowledge and attitudes, clinical skin examination, lesion detection, and training. J Am Assoc Nurse Pract. 2018;30(1):43–58. doi: 10.1097/JXX.0000000000000004 [DOI] [PubMed] [Google Scholar]
  • 73.Smith AA, Kepka D, Yabroff KR. Advanced practice registered nurses, physician assistants and cancer prevention and screening: A systematic review. BMC Health Serv Res. 2014;14:68. doi: 10.1186/1472-6963-14-68 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Wang Q, Shen Y, Chen Y, Li X. Impacts of nurse-led clinic and nurse-led prescription on hemoglobin A1c control in type 2 diabetes: A meta-analysis. Medicine. 2019;98(23):e15971. doi: 10.1097/MD.0000000000015971 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Alotaibi T, Al Anizi CA. The impact of advanced nurse practitioner (ANP) role on adult patients with cancer: A quantitative systematic review. Appl Nurs Res. 2020;56:151370. doi: 10.1016/j.apnr.2020.151370 [DOI] [PubMed] [Google Scholar]
  • 76.Belun-Vieira I, McInness D, Khalid Sheriff M. In the case of prostate cancer patients, are there advantages in cancer nurse-led follow-up? Int J of Urol Nurs. 2016;10(3):154–66. doi: 10.1111/ijun.12112 [DOI] [Google Scholar]
  • 77.Cheng X, Wei S, Zhang H, Xue S, Wang W, Zhang K. Nurse-led interventions on quality of life for patients with cancer: A meta-analysis. Medicine 2018;97(34):e12037. doi: 10.1097/MD.0000000000012037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Kobleder A, Mayer H, Gehrig L, Ott S, Senn B. Wirksamkeit von APN-Interventionen in der gynäkologischen Onkologie. Eine systematische Literaturübersicht. Klinische Pflegeforschung. 2017;3:85–101. doi: 10.6094/KlinPfleg.3.85 [DOI] [Google Scholar]
  • 79.Scheydt S, Hegedus A. Tasks and activities of Advanced Practice Nurses in the psychiatric and mental health care context: A systematic review and thematic analysis. Int J Nurs Stud. 2021;118:103759. doi: 10.1016/j.ijnurstu.2020.103759 [DOI] [PubMed] [Google Scholar]
  • 80.Schneider F, Kempfer SS, Backes VMS. Training of advanced practice nurses in oncology for the best care: A systematic review. Rev Esc Enferm USP. 2021;55:e03700. doi: 10.1590/S1980-220X2019043403700 [DOI] [PubMed] [Google Scholar]
  • 81.Turi E, McMenamin A, Kueakomoldej S, Kurtzman E, Poghosyan L. The effectiveness of nurse practitioner care for patients with mental health conditions in primary care settings: A systematic review. Nurs Outlook. 2023;71(4):101995. doi: 10.1016/j.outlook.2023.101995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Lempp H, Baggott R, Scott DL, Parker L, Bosworth A, Georgopoulou S, et al. The value, impact and role of nurses in rheumatology outpatient care: Critical review of the literature. Musculoskeletal Care. 2020;18(3):245–55. doi: 10.1002/msc.1467 [DOI] [PubMed] [Google Scholar]
  • 83.Bryant-Lukosius D, Carter N, Reid K, Donald F, Martin-Misener R, Kilpatrick K, et al. The clinical effectiveness and cost-effectiveness of clinical nurse specialist-led hospital to home transitional care: A systematic review. J Eval Clin Pract. 2015;21(5):763–81. doi: 10.1111/jep.12401 [DOI] [PubMed] [Google Scholar]
  • 84.Lawton K, Royals K, Carson-Chahhoud KV, Campbell F, Smith BJ. Nurse-led versus doctor-led care for bronchiectasis. Cochrane Database Syst Rev. 2018;6:CD004359. doi: 10.1002/14651858.CD004359.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Kuethe MC, Vaessen-Verberne AA, Elbers RG, Van Aalderen WM. Nurse versus physician-led care for the management of asthma. Cochrane Database Syst Rev. 2013(2):CD009296. doi: 10.1002/14651858.CD009296.pub2 [DOI] [PubMed] [Google Scholar]
  • 86.Elder E, Johnston AN, Crilly J. Review article: Systematic review of three key strategies designed to improve patient flow through the emergency department. Emerg Med Australas. 2015;27(5):394–404. doi: 10.1111/1742-6723.12446 [DOI] [PubMed] [Google Scholar]
  • 87.Galiana-Camacho T, Gómez-Salgado J, García-Iglesias JJ, Fernández-García D. Enfermería de práctica avanzada en la atención urgente, una propuesta de cambio: Revisión sistemática [Advanced Practice Nursing in emergency care, a proposal for the change: Systematic review]. Rev Esp Salud Publica. 2018;92:e201809065. [PMC free article] [PubMed] [Google Scholar]
  • 88.Arian M, Nobahar M, Raiesdana N, Bagher Oghazian M. Identifying the field of activity, challenges and positive consequences of nurses’ prescriptions: A systematic review. J Fac Nurs Midwifery. 2017;24(3):279–95. [Google Scholar]
  • 89.Barker RO, Craig D, Spiers G, Kunonga P, Hanratty B. Who should deliver primary care in long-term care facilities to optimize resident outcomes? A systematic review. J Am Med Dir Assoc. 2018;19(12):1069–79. doi: 10.1016/j.jamda.2018.07.006 [DOI] [PubMed] [Google Scholar]
  • 90.Driscoll A, Currey J, Tonkin A, Krum H. Nurse-led titration of angiotensin converting enzyme inhibitors, beta-adrenergic blocking agents, and angiotensin receptor blockers for people with heart failure with reduced ejection fraction. Cochrane Database Syst Rev. 2015;2015(12):CD009889. doi: 10.1002/14651858.CD009889.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Edkins RE, Cairns BA, Hultman CS. A systematic review of advance practice providers in acute care: options for a new model in a burn intensive care unit. Ann Plast Surg. 2014;72(3):285–8. doi: 10.1097/SAP.0000000000000106 [DOI] [PubMed] [Google Scholar]
  • 92.Kennedy F, McDonnell A, Gerrish K, Howarth A, Pollard C, Redman J. Evaluation of the impact of nurse consultant roles in the United Kingdom: a mixed method systematic literature review. J Adv Nurs. 2012;68(4):721–42. doi: 10.1111/j.1365-2648.2011.05811.x [DOI] [PubMed] [Google Scholar]
  • 93.Leduc S, Cantor Z, Kelly P, Thiruganasambandamoorthy V, Wells G, Vaillancourt C. The safety and effectiveness of on-site paramedic and allied health treatment interventions targeting the reduction of emergency department visits by long-term care patients: Systematic review. Prehosp Emerg Care. 2021;25(4):556–65. doi: 10.1080/10903127.2020.1794084 [DOI] [PubMed] [Google Scholar]
  • 94.Medeiros R, NeSmith E, Heath J, Hawkins M, Hawkins D, Bias R. Midlevel health providers impact on ICU length of stay, patient satisfaction, mortality, and resource utilization. J Trauma Nurs. 2011;18(3):150–2. doi: 10.1097/JTN.0b013e31822b7faf [DOI] [Google Scholar]
  • 95.Ordonez-Piedra J, Ponce-Blandon JA, Robles-Romero JM, Gomez-Salgado J, Jimenez-Picon N, Romero-Martin M. Effectiveness of the advanced practice nursing interventions in the patient with heart failure: A systematic review. Nurs Open. 2021;8(4):1879–91. doi: 10.1002/nop2.847 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Woo BFY, Lee JXY, Tam WWS. The impact of the advanced practice nursing role on quality of care, clinical outcomes, patient satisfaction, and cost in the emergency and critical care settings: A systematic review. Hum Resour Health. 2017;15(1):63. doi: 10.1186/s12960-017-0237-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Van Camp YP, Van Rompaey B, Elseviers MM. Nurse-led interventions to enhance adherence to chronic medication: systematic review and meta-analysis of randomised controlled trials. Eur J Clin Pharmacol. 2013;69(4):761–70. doi: 10.1007/s00228-012-1419-y [DOI] [PubMed] [Google Scholar]
  • 98.Bohner K, Zeller H, Saxer S. Effectiveness and efficiency of advanced practice nurses in patients with chronic heart failure. Pflegewissenschaft. 2012;14(6):342–8. [Google Scholar]
  • 99.Kwok C, Degen C, Moradi N, Stacey D. Nurse-led telehealth interventions for symptom management in patients with cancer receiving systemic or radiation therapy: A systematic review and meta-analysis. Support Care Cancer. 2022;30(9):7119–32. doi: 10.1007/s00520-022-07052-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100.Ansell D, Crispo JAG, Simard B, Bjerre LM. Interventions to reduce wait times for primary care appointments: a systematic review. BMC Health Serv Res. 2017;17(1):295. doi: 10.1186/s12913-017-2219-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Dawson AJ, Nkowane AM, Whelan A. Approaches to improving the contribution of the nursing and midwifery workforce to increasing universal access to primary health care for vulnerable populations: a systematic review. Hum Resour Health. 2015;13:97. doi: 10.1186/s12960-015-0096-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.Ismail SA, Gibbons DC, Gnani S. Reducing inappropriate accident and emergency department attendances: a systematic review of primary care service interventions. Br J Gen Pract. 2013;63(617):e813–20. doi: 10.3399/bjgp13X675395 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Jennings N, Clifford S, Fox A, O’Connell J, Gardner G. The impact of nurse practitioner services on cost, quality of care, satisfaction and waiting times in the emergency department: A systematic review. Int J Nurs Stud. 2015;52(1):421–35. doi: 10.1016/j.ijnurstu.2014.07.006 [DOI] [PubMed] [Google Scholar]
  • 104.Jeyaraman MM, Alder RN, Copstein L, Al-Yousif N, Suss R, Zarychanski R, et al. Impact of employing primary healthcare professionals in emergency department triage on patient flow outcomes: A systematic review and meta-analysis. BMJ Open. 2022;12(4):e052850. doi: 10.1136/bmjopen-2021-052850 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Johnson F. Systematic review of oncology nurse practitioner navigation metrics. Clin J Oncol Nurs. 2015;19(3):308–13. doi: 10.1188/15.CJON.308-313 [DOI] [PubMed] [Google Scholar]
  • 106.Joseph J, Vaughan R, Haakan S. Effectiveness of nurse-performed endoscopy in colorectal cancer screening: A systematic review. Gastrointest Nurs. 2015;13(14):26–33. doi: 10.12968/gasn.2015.13.4.26 [DOI] [Google Scholar]
  • 107.Niezen MG, Mathijssen JJ. Reframing professional boundaries in healthcare: a systematic review of facilitators and barriers to task reallocation from the domain of medicine to the nursing domain. Health Policy. 2014;117(2):151–69. doi: 10.1016/j.healthpol.2014.04.016 [DOI] [PubMed] [Google Scholar]
  • 108.Patel EY, Petermann V, Mark BA. Does state-level nurse practitioner scope-of-practice policy affect access to care? West J Nurs Res. 2019;41(4):488–518. doi: 10.1177/0193945918795168 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Thamm C, Teleni L, Chan R, Stone L, Mccarthy A. Nurse-led interventions for cancer patients in emergency departments: Systematic review. Collegian. 2019;26(2019):311–19. doi: 10.1016/j.colegn.2018.08.005 [DOI] [Google Scholar]
  • 110.Thomas LH, Coupe J, Cross LD, Tan AL, Watkins CL. Interventions for treating urinary incontinence after stroke in adults. Cochrane Database Syst Rev. 2019;2(2):CD004462. doi: 10.1002/14651858.CD004462.pub4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Whiteford C, White S, Stephenson M. Effectiveness of nurse-led clinics on service delivery and clinical outcomes in adults with chronic ear, nose and throat complaints: A systematic review. JBI Database Syst Rev Implement Rep. 2016;14(4):229–56. doi: 10.11124/JBISRIR-2016-2237 [DOI] [PubMed] [Google Scholar]
  • 112.Nikpour J, Franklin M, Calhoun N, Broome M. Influence of provider type on chronic pain prescribing patterns: A systematic review. J Am Assoc Nurse Pract. 2022;34(3):474–88. doi: 10.1097/JXX.0000000000000673 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Wu MW, Pu L, Grealish L, Jones C, Moyle W. The effectiveness of nurse-led interventions for preventing urinary tract infections in older adults in residential aged care facilities: A systematic review. J Clin Nurs. 2020;29(9–10):1432–44. doi: 10.1111/jocn.15198 [DOI] [PubMed] [Google Scholar]
  • 114.Emrich-Mills L, Collier P, West J. The role of nurse prescribers in memory services and their continuing professional development: A review of the literature. J Clin Nurs. 2019;28(9–10):1422–32. doi: 10.1111/jocn.14796 [DOI] [PubMed] [Google Scholar]
  • 115.Hyde R, MacVicar S, Humphrey T. Advanced practice for children and young people: A systematic review with narrative summary. J Adv Nurs. 2020;76(1):135–46. doi: 10.1111/jan.14243 [DOI] [PubMed] [Google Scholar]
  • 116.Chua CMS, Nantsupawat A, Wichaikhum OA, Shorey S. Content and characteristics of evidence in the use of standardized patients for advanced practice nurses: A mixed-studies systematic review. Nurse Educ Today. 2023;120:105621. doi: 10.1016/j.nedt.2022.105621 [DOI] [PubMed] [Google Scholar]
  • 117.Hyer S. Practice patterns of nurse practitioners related to weight management in primary care. J Am Assoc Nurse Pract. 2019;31(4):236–44. doi: 10.1097/JXX.0000000000000122 [DOI] [PubMed] [Google Scholar]
  • 118.Rutherford-Hemming T, Nye C, Coram C. Using simulation for clinical practice hours in nurse practitioner education in the United States: A systematic review. Nurse Educ Today. 2016;37:128–35. doi: 10.1016/j.nedt.2015.11.006 [DOI] [PubMed] [Google Scholar]
  • 119.Schallmo MK, Godfrey TM, Dunbar D, Brown KM, Coyle A, D’Aoust RF. Is it time for the 4th P in nurse practitioner education? Physical assessment, pharmacology, pathophysiology, and procedures: A systematic review. J Am Assoc Nurse Pract. 2019;31(12):705–11. doi: 10.1097/JXX.0000000000000206 [DOI] [PubMed] [Google Scholar]
  • 120.Speight C, Firnhaber G, Scott ES, Wei H. Strategies to promote the professional transition of new graduate nurse practitioners: A systematic review. Nursing Forum. 2019;54(4):557–64. doi: 10.1111/nuf.12370 [DOI] [PubMed] [Google Scholar]
  • 121.Stratton DB, Loescher LJ. Educational interventions for primary care providers to improve clinical skin examination for skin cancer. J Am Assoc Nurse Pract. 2020;32(5):369–79. doi: 10.1097/JXX.0000000000000235 [DOI] [PubMed] [Google Scholar]
  • 122.Veenema TG, Lavin RP, Thornton CP, Schneider-Firestone S, Seal S. Alignment of nurse practitioner educational preparation and scope of practice in United States emergency departments: a systematic review of the literature. J Emerg Nurs. 2021;47(4):563–81. doi: 10.1016/j.jen.2021.04.005 [DOI] [PubMed] [Google Scholar]
  • 123.Warren JN, Luctkar-Flude M, Godfrey C, Lukewich J. A systematic review of the effectiveness of simulation-based education on satisfaction and learning outcomes in nurse practitioner programs. Nurse Educ Today. 2016;46:99–108. doi: 10.1016/j.nedt.2016.08.023 [DOI] [PubMed] [Google Scholar]
  • 124.Barrott L, Wiseman T, Tsianakas V, Czuber-Dochan W. Nurse and pharmacist systemic anti-cancer therapy review clinics and their impact on patient experience and care: A systematic review. J Adv Nurs. 2023;79(2):442–53. doi: 10.1111/jan.15512 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 125.Ness V, Price L, Currie K, Reilly J. Influences on independent nurse prescribers’ antimicrobial prescribing behaviour: A systematic review. J Clin Nurs. 2016;25(9–10):1206–17. doi: 10.1111/jocn.13249 [DOI] [PubMed] [Google Scholar]
  • 126.Salamanca-Balen N, Seymour J, Caswell G, Whynes D, Tod A. The costs, resource use and cost-effectiveness of Clinical Nurse Specialist–led interventions for patients with palliative care needs: A systematic review of international evidence. Palliat Med. 2018;32(2):447–65. doi: 10.1177/0269216317711570 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Zhang C, Mitchell W, Xue Y, LeBlanc N, Liu Y. Understanding the role of nurse practitioners, physician assistants and other nursing staff in HIV pre-exposure prophylaxis care in the United States: A systematic review and meta-analysis. BMC Nurs. 2020;19(1):117. doi: 10.1186/s12912-020-00503-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 128.Geese F, Zwakhalen S, Lucien B, Hahn S. Job satisfaction of advanced practice nurses in cancer care: A systematic review. Eur J Oncol Nurs. 2022;56:102089. doi: 10.1016/j.ejon.2021.102089 [DOI] [PubMed] [Google Scholar]
  • 129.Han RM, Carter P, Champion JD. Relationships among factors affecting advanced practice registered nurses’ job satisfaction and intent to leave: A systematic review. J Am Assoc Nurse Pract. 2018;30(2):101–13. doi: 10.1097/JXX.0000000000000006 [DOI] [PubMed] [Google Scholar]
  • 130.Lyness E, Parker J, Willcox ML, Dambha-Miller H. Experiences of out-of-hours task-shifting from GPs: A systematic review of qualitative studies. BJGP Open. 2021;5(4). doi: 10.3399/BJGPO.2021.0043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 131.Abraham CM, Norful AA, Stone PW, Poghosyan L. Cost-effectiveness of advanced practice nurses compared to physician-led care for chronic diseases: A systematic review. Nurs Econ. 2019;37(6):293–305. doi: 10.1002/nau.21204 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 132.Fraser M, Melilo C. Expanding the scope of practice of APRNs: A systematic review of the cost analyses used. Nurs Econ. 2018;36(1):23–8. [Google Scholar]
  • 133.Searle B, Barker RO, Stow D, Spiers GF, Pearson F, Hanratty B. Which interventions are effective at decreasing or increasing emergency department attendances or hospital admissions from long-term care facilities? A systematic review. BMJ Open. 2023;13(2):e064914. doi: 10.1136/bmjopen-2022-064914 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Curr S, Xyrichis A. Does nurse-led initiation of Ottawa ankle rules reduce ED length of stay? Int Emerg Nurs. 2015;23:317–22. doi: 10.1016/j.ienj.2015.01.006 [DOI] [PubMed] [Google Scholar]
  • 135.Schoch M, Bennett P, Fiolet R, Kent B, Au C. Renal access coordinators’ impact on hemodialysis patient outcomes and associated service delivery: a systematic review. JBI Database Syst Rev Implement Rep. 2014;12(4):319–53. doi: 10.11124/jbisrir-2014-1359 [DOI] [PubMed] [Google Scholar]
  • 136.Cooper M, McDowell J, Raeside L. The similarities and differences between advanced nurse practitioners and clinical nurse specialists. Br J Nurs. 2019;28(20):1308–14. doi: 10.12968/bjon.2019.28.20.1308 [DOI] [PubMed] [Google Scholar]
  • 137.Andregard AC, Jangland E. The tortuous journey of introducing the nurse practitioner as a new member of the healthcare team: a meta-synthesis. Scand J Caring Sci. 2015;29(1):3–14. doi: 10.1111/scs.12120 [DOI] [PubMed] [Google Scholar]
  • 138.Clavo-Hall JA, Bender M, Harvath TA. Roles enacted by Clinical Nurse Leaders across the healthcare spectrum: A systematic literature review. J Prof Nurs. 2018;34(4):259–68. doi: 10.1016/j.profnurs.2017.11.007 [DOI] [PubMed] [Google Scholar]
  • 139.Harkless G, Vece L. Systematic review addressing nurse practitioner reimbursement policy: Part one of a four-part series on critical topics identified by the 2015 nurse practitioner research agenda. J Am Assoc Nurse Pract. 2018;30(12):673–82. doi: 10.1097/JXX.0000000000000121 [DOI] [PubMed] [Google Scholar]
  • 140.Hourahane G, West N, Barnes R, Rees S, Bowyer A, Dundon J, et al. Supporting trail-blazing: A systematic review of the factors that facilitate or inhibit the implementation of new nursing roles: the experiences of UK consultant nurses. JBI Libr Syst Rev. 2012;10(50):3146–294. doi: 10.11124/jbisrir-2012-21 [DOI] [PubMed] [Google Scholar]
  • 141.Hutchison M, East L, Stasa H, Jackson D. Deriving consensus on the characteristics of advanced practice nursing: meta-summary of more than 2 decades of research. Nurs Res. 2014;62(3):116–128. doi: 10.1097/NNR.0000000000000021 [DOI] [PubMed] [Google Scholar]
  • 142.Wang-Romjue P. Meta-synthesis on nurse practitioner autonomy and roles in ambulatory care. Nurs Forum. 2018;53(2):148–55. doi: 10.1111/nuf.12236 [DOI] [PubMed] [Google Scholar]
  • 143.Xue Y, Ye Z, Brewer C, Spetz J. Impact of state nurse practitioner scope-of-practice regulation on health care delivery: Systematic review. Nurs Outlook. 2016;64(1):71–85. doi: 10.1016/j.outlook.2015.08.005 [DOI] [PubMed] [Google Scholar]
  • 144.Hako L, Turunen H, Jokiniemi K. Advanced practice nurse capabilities: A mixed methods systematic review. Scand J Caring Sci. 2023;37(1):3–19. doi: 10.1111/scs.13134 [DOI] [PubMed] [Google Scholar]
  • 145.Ramis M-A, Wu C-J, Pearson A. Experience of being an advanced practice nurse within Australian acute care settings: a systematic review of qualitative evidence. Int J Evid Based Healthc. 2013;11:161–180. doi: 10.1111/1744-1609.12029 [DOI] [Google Scholar]
  • 146.Jokiniemi K, Pietilä A-M, Kylma J, Haatainen K. Advanced nursing roles: A systematic review. Nurs Health Sci. 2012;14:421–431. doi: 10.1111/j.1442-2018.2012.00704.x [DOI] [PubMed] [Google Scholar]
  • 147.Borum C. Barriers for hospital-based nurse practitioners utilizing clinical decision support systems: A systematic review. Inform. 2018;36(4):177–82. doi: 10.1097/CIN.0000000000000413 [DOI] [PubMed] [Google Scholar]
  • 148.Raymond L, Castonguay A, Doyon O, Pare G. Nurse practitioners’ involvement and experience with AI-based health technologies: A systematic review. Appl Nurs Res. 2022;66:151604. doi: 10.1016/j.apnr.2022.151604 [DOI] [PubMed] [Google Scholar]
  • 149.Devictor J, Burnet E, Henriot T, Leclercq A, Ganne-Carrie N, Kilpatrick K, et al. Implementing advanced practice nursing in France: A country-wide survey 2 years after its introduction. Nurs Open. 2023;10(3):1437–48. doi: 10.1002/nop2.1394 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 150.Quiroz P, Toso B. Advanced practice nursing in Latin America and the Caribbean: seeking its implementation. Rev Bras Enferm. 2021;74(Suppl 6):e74suppl601. doi: 10.1590/0034-7167.202174suppl601 [DOI] [PubMed] [Google Scholar]
  • 151.Gray DC, Rogers M, Miller MK. Advanced practice nursing initiatives in Africa, moving towards the nurse practitioner role: Experiences from the field. Int Nursing Rev. 2023. doi: 10.1111/inr.12835 [DOI] [PubMed] [Google Scholar]
  • 152.Kilpatrick K, Geeze F, Zhou W, Bryant-Lukosius D. Advanced practice nurses and engagement in research, quality improvement, and evidence-informed decision-making. In: Rogers M, Lehwaldt D, Roussel J, Acorn M, editors. Advanced practice nurse networking to enhance global health. Cham: Springer; 2024. pp. 143–161. [Google Scholar]
  • 153.Turkelson C, Cooper D, Creech C, Schellenberg K, Behnke L. Using simulation to enhance nurse practitioner students cultural sensitivity, communication, and empathy with vulnerable populations. Clin Simul Nurs. 2021;56:108–16. doi: 10.1016/j.ecns.2021.04.011 [DOI] [Google Scholar]
  • 154.Kilpatrick K, Tchouaket E, Fernandez N, Jabbour M, Dubois CA, Paquette L, et al. Patient and family views of team functioning in primary healthcare teams with nurse practitioners: A survey of patient-reported experience and outcomes. BMC Fam Pract. 2021;22(1):76. doi: 10.1186/s12875-021-01406-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 155.Nye C. State of simulation research in advanced practice nursing education. Annu Rev Nurs Res. 2021;39(1):33–51. doi: 10.1891/0739-6686.39.33 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Federica Canzan

20 Mar 2024

PONE-D-23-42783A global perspective of advanced practice nursing research: A review of systematic reviewsPLOS ONE

Dear Dr. Kilpatrick,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the minor points raised during the review process.

Please submit your revised manuscript by May 04 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Federica Canzan

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that Figures 1 and 2 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figures 1 and 2 to publish the content specifically under the CC BY 4.0 license. 

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Congratulations to the team of the International Council of Nurses Nurse Practitioner Advanced Practice Nurse Network that performed this huge umbrella review. Despite the amount of studies included, it is clearly presented, both the methodological aspects of the revision and the results. Methods are presented in detail as expected in a systematic review, and results are synthetized in broader categories, previously developed, allowing the reader to have a grasp of the types of outcomes of APN, NP and CNS roles.

I would suggest minor improvements, namely:

i) Abstract

I suggest that under results the sentence written in lines 652-657 expresses more clearly the results of the study "We found highly consistent evidence about the care provided by APNs, NPs and CNSs across 29 indicator categories at the patient, provider and health system levels. Care was assessed as equal or superior to the comparator (usual care, physicians) across a wide range of clinical settings, patient populations and acuity levels in almost all the reviews. Mixed findings were noted for quality of life, consultations, costs, emergency room visits and health care service delivery where some studies favoured the control groups."

ii) Matherials and Methods:

In Database search (line 186) it is not clear why you decide to include reviews published after 2011.

In the assessment of review quality it is not clear if the authors decided to include the reviews even the ones with low CASP scores.

iii) Results

In line 291 authors refer to Patient outcomes and in line 301 Patient Indicators. Are they synonyms?

Reviewer #2: I thank the authors for giving me the opportunity to read their manuscript which deals with an important topic in nursing. In the PRISMA statement, enter how many articles were found for each database queried.

I would also insert a table with search strings for each database queried.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Jul 2;19(7):e0305008. doi: 10.1371/journal.pone.0305008.r002

Author response to Decision Letter 0


28 Mar 2024

Please see enclosed Response to Reviewers for our response to their comments.

Attachment

Submitted filename: Response to Reviewers.docx

pone.0305008.s011.docx (33.1KB, docx)

Decision Letter 1

Federica Canzan

22 May 2024

A global perspective of advanced practice nursing research: A review of systematic reviews

PONE-D-23-42783R1

Dear Dr. Kilpatrick,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Federica Canzan

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript required minor revisions and the authors accepted and changed all the suggestions. Congratulations to the team for this detailed and rigorous systematic review.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

Acceptance letter

Federica Canzan

27 May 2024

PONE-D-23-42783R1

PLOS ONE

Dear Dr. Kilpatrick,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Federica Canzan

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist. PRISMA 2020 checklist.

    (PDF)

    pone.0305008.s001.pdf (135KB, pdf)
    S1 Appendix. Record of review-related decisions.

    (PDF)

    pone.0305008.s002.pdf (200.2KB, pdf)
    S2 Appendix. Search strategies for the published literature.

    (PDF)

    pone.0305008.s003.pdf (283.5KB, pdf)
    S3 Appendix. Search strategies for the grey literature.

    (PDF)

    pone.0305008.s004.pdf (92.1KB, pdf)
    S1 Table. Risk of bias assessment for the included systematic reviews (n = 117).

    (PDF)

    pone.0305008.s005.pdf (175.1KB, pdf)
    S2 Table. Description of included systematic reviews (n = 117).

    (PDF)

    pone.0305008.s006.pdf (563.4KB, pdf)
    S3 Table. Extractions of review results by indicator category at the Patient level.

    (PDF)

    pone.0305008.s007.pdf (411.7KB, pdf)
    S4 Table. Extraction of review results by indicator category at the Provider level.

    (PDF)

    pone.0305008.s008.pdf (261.8KB, pdf)
    S5 Table. Extraction of review results by indicator category at the Health System level.

    (PDF)

    pone.0305008.s009.pdf (577.8KB, pdf)
    S6 Table. Extraction of review results by indicator category related to Artificial Intelligence.

    (PDF)

    pone.0305008.s010.pdf (142KB, pdf)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0305008.s011.docx (33.1KB, docx)

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES