Abstract
Background
Nurses make up the largest constituent of the health workforce. The success of health care interventions depends on nurses’ ability and willingness to provide quality health care services. A well-implemented performance management (PM) system can be a valuable asset in ensuring that nurses are motivated, promoted, trained and rewarded appropriately. Despite the significant benefits of effective PM such as improved motivation, job satisfaction and morale, PM systems are highly contested. Therefore, it is important to examine evidence on PM methods and practices in order to understand its consequences among nursing professionals in primary health care (PHC) settings.
Methods
The search strategy of this systematic scoping review will involve various electronic databases which include Academic Search Complete, PsycARTICLES. PsycINFO, Cumulative Index to Nursing and Applied Health Literature, Medline and Cochrane Library from the EbsocHost Database Platform. Electronic databases such as PubMed and Google Scholar, Union catalogue of theses and dissertations via SABINET online and WorldCat dissertations will be incorporated. A grey literature search will be conducted on websites such as the World Health Organization and government websites to find relevant policies and guidelines. The period for the search is from 1978 to 2018. This time period was chosen to coincide with the Declaration of Alma-Ata on PHC adopted in 1978. All references will be exported to Endnote library. Two independent reviewers will begin screening for eligible titles, abstracts and full articles. During title and abstract screening, duplicates will be removed. The Mixed Method Appraisal Tool will determine the quality of included studies. Thematic analysis will be used to analyse the included articles.
Discussion
Evidence of preferences on PM methods and practices will generate insight on the use of PM systems in PHC and how this can be used for the purpose of improving nurses’ performance and in turn, the provision of quality health care. We hope to expose knowledge gaps and inform future research.
Keywords: Performance management, Performance appraisals, Performance review, Nurses, Quality of care, Human resources management, Systematic scoping review, Primary health care
Background
Growing health challenges have placed pressure on health management to monitor and evaluate human resource for health (HRH) in an effort to strengthen health systems response to evolving health challenges [1]. One such challenge is chronic conditions. Chronic conditions present the largest public health challenge of the twenty-first century [2]. It is projected that by 2020, heart disease, stroke, depression and cancer will be the greatest contributors of non-communicable diseases (NCDs), with mental disorders accounting for 60% of total mortality in the world. The number of people that require daily health care is rapidly growing, and it is projected that NCDs will continue to increase at a higher rate in lower-socio economic groups [2]. This has created a need for NCDs surveillance, prevention and control [3]. If not managed appropriately, chronic multiple NCDs will become the most expensive problem faced by health care systems globally [3]. This has resulted in the need for the re-organisation of health care systems to cater for chronic conditions, with people-centred care identified as the optimal approach to cater for multimorbid chronic conditions [4]. Noticeably, the ability of a country to strengthen its health system in order to meet its health goals depends largely on its human capital [5]. The six core components or ‘building blocks’ of the World Health Organization (WHO)’s analytical framework of health systems includes the health workforce as the people responsible for organising and delivering quality health services [6, 7]. Quality health care refers to services that consistently deliver care that improves or maintains health, is valued and trusted by recipients and is responsive to changing population needs [5, 6], with people-centred services identified as central to this endeavour globally given the changing disease profile towards chronic multimorbidity (see Table 1 for definition of quality care). In order to achieve the above, the health workforce must possess the knowledge, skills, motivation and preparedness to engage in actions with the primary intent to improve the provision of quality health services for people-centred services. Therefore, it is of vital importance that health workers are motivated and supported with the relevant capacities, thereby ensuring that they significantly contribute to attaining health objectives set nationally and globally [6, 7]. One of the key human resource (HR) processes used to facilitate training and motivation of any workforce is a performance management (PM) system.
Table 1.
Concept | Definition | Example (s) |
---|---|---|
PM methods | PM methods refer to the particular procedures, processes or tools used to consolidate data on the performance of staff, in the case of this study, registered nurses. | - Conducting annual performance appraisals through 360 ° feedback, peer reviews, behaviourally anchored rating scales (BARS) and critical incidents. |
PM practices | PM practices refer to actual application and use of a PM method, as opposed to theories relating to it. | - The above- mentioned methods are known to be effective in providing performance data; however, in practice, factors such as the users’ attitude towards PM methods, training of rater and ratees as well as the provision of constructive performance feedback may impact on the overall success of a PM system. |
Quality health care/quality of care | The WHO definition of quality of care is the extent to which health care services provided to individuals and communities improve desired health outcomes. Therefore, in order to achieve ‘quality of care’, health care must be safe, effectively, timely, efficient, equitable and people-centred. |
- ‘Safe: Delivering health care that minimizes risks and harm to service users, including avoiding preventable injuries and reducing medical errors. - Effective: Providing services based on scientific knowledge and evidence-based guidelines. - Timely: Reducing delays in providing and receiving health care. - Efficient: Delivering health care in a manner that maximizes resource use and avoids waste. - Equitable: Delivering health care that does not differ in quality according to personal characteristics such as gender, race, ethnicity, geographical location or socioeconomic status. - People-centred: Providing care that takes into account the preferences and aspirations of individual service users and the culture of their community.’ [8] |
According to the PCC framework: The targeted population for this review is nurses/nurse practitioners/registered nurses. | Nurses for the purpose of this review refer to nurse practitioners/advanced practice nurses (also referred to as registered nurses). The characteristics of this kind of nurse are shaped by the context and/or country that s/he is credentialed to practice. | For instance, a registered nurse must have acquired the necessary expert knowledge base to work in an environment that requires complex decision-making and clinical competencies for expanded practice. Such nurses can generally work independently in clinics and private practices as primary health care providers. |
Concept (s): Performance management/performance appraisal/performance review | The concept of performance management (for this review) refers to a process of monitoring, reviewing and appraising registered nurses’ work performance over a certain period of time. | - The purpose of this process is to ensure accountability; thus, it would assist nurse managers in administering incentives towards good performance (eg. a performance bonus) and identify gap in one’s performance so to develop/improve one’s ability (training and development needs). The terms performance management, appraisal or review are used to describe this process—the preferred term to use is based on the context/country in which it is used. |
Context: Primary health care | Primary health care refers to health care provided in the community for people initialling a visit to a medical practitioner or clinic for advice/treatment. | - The review is concerned with nurses that work in the primary health care setting. These nurses work at clinics, community-based health care centres, general practices and home-based health services. |
PM is described as a continuous process to identify, measure and improve the performance of individuals, teams and organisation, which involves aligning performance activities with the strategic goals of the organisation [7]. An important component of a PM system is performance appraisal (PA). PA refers to the formal process of assessing performance at work. PA is also sometimes referred to as performance review [9].
Accordingly, PA is a necessary component of PM systems. Some researchers argue that due to previous research not distinguishing between these two concepts, these terms are generally used interchangeably [9, 10]. This study will do the same.
Accordingly, PM systems primarily serve three broad functions:
-
i.
Strategically, PM systems aim to achieve the strategic objectives of the organisation, which is achieved by linking the organisation’s goals with individual performance goals [11].
-
ii.
Administratively, PM provides essential information to help managers take important decisions regarding salary increments, promotions and rewards [12].
-
iii.
The developmental function is facilitated through the provision of feedback on evaluated performance. Through the feedback mechanism, remedial action and steps to improve performance should be discussed. This presents an opportunity for managers to coach employees and aid improvement in performance on an ongoing basis [13].
In order to re-configure health care systems to support people-centred care for chronic multimorbid conditions, there is a need to initially identify methods and practices that promote effective PM that can be harnessed to this end [14]. Methods refer to standard processes and procedures used by a PM system (this is usually prescribed by policy). Practices refer to the formal and informal application or execution of ideas, beliefs and methods. Such re-configured systems require a focus on training, motivation and readiness of health professionals who are at the forefront of facilitating changes in health care best practices, such as nursing staff who constitute the largest sector of health workers across the globe [15] (see Table 1 for definitions of PM methods and practices). As an important managerial tool, PM systems are a critical tool for facilitating health system reforms as they determine if health workers are working diligently, trained appropriately and adequately rewarded for providing quality health care interventions in line with the health systems reforms [16].
Contribution to the field
PM methods and practices
PM systems are generally housed as part of role of human resource management (HRM), within the health care sector. The benefits of HRM practices to employee well-being and improved health outcomes have become a topical discussion among human resource practitioners and health care systems researchers around the world [17]. However, the impact of PM systems in health care settings has not received as much attention. While the nature of each health system and the use of HRM differ depending on national context, regardless of the context, it has become evident across national settings that HR is crucial in terms of its impact on patient outcomes and health care expenditures [18]. In order to determine how current health care delivery and reforms in health care systems may fully utilise HRM processes and systems such as a PM system to improve quality health care for people-centred care and promote better health outcomes [19], there is a need to initially examine evidence on PM methods and practices, as well as its consequences on the delivery of quality care among nurses in PHC settings.
PM opportunities and challenges
Some identified challenges include a world-wide shortage of nurses, health worker’s commitment and job satisfaction [8, 13–19]. These factors have an impact on patient care and the provision of quality service delivery. Generally, there is a limited understanding of how a PM system impacts on managing health workers, more specifically nurses and how it may be used to improve care delivery and ultimately patient outcomes. Researchers opine that the purpose of PM systems is to monitor employees’ performance, motivate staff through providing opportunities for skills development and improving morale through rewarding and incentivising good performance. Their argument is that a PM system is one of the most important components of HRM. It provides justifications for decisions regarding recruitment and selection, training and development needs of existing employees and how to optimise the quality of work and efficiency within individual health care centres as well as the health system in general [18]. Accordingly, a poorly implemented PM system can be detrimental to staff morale, overall job satisfaction and result in high staff turnover rates [20, 21]. The extent to which this has been investigated in health care settings is not clear. Some experts have varying opinions and approaches to PM systems that may add to HRM outcomes and quality of care [22]. Consequently, there is a need to review what is available on this topic for the purpose of creating a greater understanding of PM systems, as well as to identify knowledge gaps and providing recommendations on how future research may fill these gaps.
The aim of this scoping review was to systematically map the available evidence on the PM of nurses in PHC settings in order to enhance our understanding of the role of PM systems in improving ‘quality of care’, so as to understand how PM systems need to be strengthened for managing performance in PHC settings that encourages improving quality people-centred care and improve patients’ outcomes. This review offers a broad overview of managing the performance of nurses working at various PHC settings. In addition, it provides an analysis of international methods and practices used to manage nurses. From these methods, it is possible to identify best practices for suitable PM approaches.
The review of primary research has gained popularity, as evidence-based practices gain recognition as a benchmark for care and primary research sources continue to grow [23]. A scoping review is considered as a relatively new method for reviewing literature, with the first such framework published in 2005. This method of literature review is an advantage for synthesising research evidence and mapping existing literature in a given field in terms of its prevalence and key features. Hence, it is also referred to as a ‘mapping’ review [23, 24].
Methodology
Systematic scoping review
We will conduct a systematic scoping review of grey and peer-reviewed literature on PM and its influence on quality of care among nurses in PHC settings. The review will be guided by the Arksey and O’Malley’s scoping review framework [25], which outlines the following steps:
Stage 1. Identifying the research question
Stage 2. Identifying relevant studies
Stage 3. Study selection
Stage 4. Charting the data
Stage 5. Collating, summarising and reporting the results
The recommendations of Levac et al. (2010) will be used to improve the transparency of each step pertaining to the conduct of the systematic scoping review [26].
Stage 1: Identifying the research question
The central research question of the study is as follows:
What is the existing evidence on the influence of PM methods and practices on quality of care among nurses in PHC?
The sub-research questions are as follows:
-
i.
What are the common challenges and opportunities reported on various PM methods and practices?
-
ii.
What are the key gaps in literature on the contribution of effective PM on quality of care among nurses in PHC settings?
The study will use the broad population, concept and context (PCC) framework recommended by the Joanna Briggs Institute for Scoping Reviews [27, 28]. The design of the search strategy will be underpinned by a key inclusion criteria (see Table 2).
Table 2.
Date of search | Keyword search | No. of publications retrieved | Search engine utilised |
---|---|---|---|
30 April 2019 | (nurses OR nurse practitioners OR registered nurses) AND (performance management OR performance appraisal OR performance reviews OR performance management and appraisal systems) AND (primary health care OR clinics) | 696 | PubMed |
The PCC framework to determine the research questions is illustrated in Fig. 1.
Stage 2: Identifying relevant studies
We will identify relevant studies by conducting a comprehensive search on the following electronic databases: Academic Search Complete, PsycARTICLES. PsycINFO, Cumulative Index to Nursing and Applied Health Literature (CINAHL), Medline, Cochrane Library and PubMed. Literature will include published peer-reviewed journal articles with primary studies which have a transparent empirical base utilising qualitative, quantitative and mixed method research design and grey literature addressing the research questions.
To achieve a comprehensive search, websites such as the WHO and governmental websites will be used to gather policies and guidelines on PM for the respective health care sectors. Databases such as Google Scholar, Union Catalogue of Theses and Dissertations (UCTD) via SABINET Online and WorldCat Dissertations and Theses via OCLO will also be used to find relevant literature.
A hand search through the main published texts used in PM systems and its outcomes will also be conducted. In addition, articles will be searched through the ‘cited by’ search as well as citations included in the reference lists of included articles. The search terms will include Nurse OR Nurse Practitioners OR Registered Nurse AND, Performance Management OR Performance Appraisal OR Performance Review OR Performance Management and Appraisal Systems AND Primary Health Care or Clinics. This search strategy was piloted to check the suitability of selected electronic databases and key words (see Table 2).
Stage 3: Study selection
Following the keyword search, relevant citations must be selected through title, abstract and full-text screening. The study selection process involves the elimination of studies that do not address the main research question. Developing an inclusion and exclusion criteria at the outset of the study ensures there are clear guidelines enforced, so each researcher is consistent in decision-making on the relevance for each citation [25]. An inclusion and exclusion criteria reduce the risk of bias in the review, thereby minimising the risk of error and promoting credibility of the findings.
In Table 3, information is provided about the inclusion and exclusion criteria that will be adhered to.
Table 3.
Inclusion criteria | Exclusion criteria |
---|---|
• Be available in full text • Be in all languages • Studies that show evidence on performance management • Studies based on nurses or nurse practitioner or registered nurses • Must have been published between 1978 to date • Must be within the primary health care sector • All study design |
• Studies with no evidence on performance management, appraisal or review • Studies published before 1978 • Studies not within the primary health care health sector • Studies not based on nurses or nurse practitioner or registered nurses |
An Endnote™ library will be created for the aforementioned review. The primary investigator (CZM) will conduct a comprehensive database search and screen titles from the previously mentioned databases with the assistance from a senior librarian at the University of KwaZulu-Natal (UKZN) library services to assist with the search. All references screened will be exported to the Endnote library; title and abstract screening will be conducted. Once the initial screening is completed, eligible references are kept, and duplicates will be removed. The full text of eligible abstracts will be retrieved. To optimise the full article search procedure, the reviewers will further consult with the librarian to assist with locating and retrieving articles that will be included in the full article screening. In cases where the reviewers are unable to retrieve the articles from the databases, a request will be lodged with the relevant authors. Two reviewers (CZM and TS) will discuss eligible and ineligible studies to identify if there are any discrepancies [27]. Should the reviewers be unable to resolve disagreements through discussion, a third reviewer will be consulted (TPM-T). The screening results will be reported accordingly using the PRISMA chart as depicted in Fig. 2 [30, 31].
Stage 4: Charting the data
The process of extracting data aims to generate a descriptive summary of the results that corresponds to the aim and research question of the scoping review at hand. A draft data charting table (see Table 4) has been developed to facilitate the collection and sorting of key pieces of information from articles that have made the selection [32]. A data charting form, highlighting the important aspects for the study will be developed and piloted. The variables and themes included will answer each of the research questions. One reviewer will be involved in data extraction (CZM). Once completed, this process will be verified by the two other reviewers (TS and TPM-T). The data charting form will be updated as and when required.
Table 4.
Author and publication year | |
Type of publication | |
Aims or research questions | |
Study design | |
Country | |
Health care setting | |
Study population | |
Category of nurse | |
Intervention | |
Key findings | |
Most significant findings | |
Conclusions | |
Additional comments |
Stage 5: Collating, summarising and reporting the results
To provide a narrative account of the data extracted from the included studies, data will be analysed using content and thematic analysis. Content and thematic analysis is useful as it provides a descriptive presentation of data. Through the identification of common themes in the text, the researcher is able to analyse the data. The data will be extracted around the following themes: PM initiatives, managing performance of nurses in PHC settings and the use of PM to influence the improvement of the quality of health care.
Quality appraisal
The Mixed Method Appraisal Tool (MMAT) will be used to assess the quality of the studies [32, 33]. Each section is divided by research design type. During the appraisal process, the following will be used:
Section 1 of the MMAT will be used to review the quality of a qualitative study;
Section 2 is for quantitative randomised controlled studies;
Section 3 will be used for non-randomised studies;
Section 4 is for descriptive studies;
Section 5 is for mixed-method research methodology studies.
[Note: for a mixed methods study, we will use section 1 for appraising the qualitative component, the appropriate section for the quantitative component (2 or 3 or 4) and section 5 for the mixed methods component]. This tool is valuable in examining the suitability of an objective of a study, its methodology, the appropriateness of the study design, the data collection, the study selection, the data analysis, the findings presentation as well as the discussion and conclusion. The results from the scrutiny of the above-mentioned aspects will determine the quality of the articles and if the studies will be included after the extraction of the data [33]. The quality of the articles will be graded per domain on a percentage basis. For qualitative (QUAL) and quantitative (QUAN) studies, the grading of each study will be based on the number of criteria met divided by 4, the score ranging from 25 (*only one criterion was met) to 100% (****all criteria were met). For mixed methods (MM) studies, the quality of the combination cannot exceed the quality of the weakest component. Therefore, the overall quality score is the lowest score of the study components. Thus, the score of 25% (*) is gained when QUAL = 1 or QUAN = 1 or MM = 0, 50% (**) when QUAL = 2 or QUAN = 2 or MM = 1, it is 75% when QUAL = 3 or QUAN = 3 or MM = 2 and it is 100% when QUAL = 4 or QUAN = 4 and MM = 3. For the purpose of this study, 25% is considered low quality, and above 80% is considered high [31, 34]. Grey literature will be assessed using the Joanna Briggs Institution (JBI) Narrative, Opinion, Text Assessment and Review Instrument (NOTARI) systematic reviews. Using the JBI Reviewer’s Manual 2014, any issues relating to the including suitability of topic selection, critical appraisal, data extraction and synthesis will be addressed. Textual evidence requires three levels of credibility. Therefore, the reviewers are required to determine if, when comparing the conclusion with the argument, the conclusion represents evidence that is Unequivocal (U) (relates to evidence beyond reasonable doubt), Credible (C) and Unsupported (findings that are not supported by the data) [35].
Discussion
PM systems are a significant element of HRM. The growing need for improved clinical outcomes and quality of care has highlighted the importance of standards of care and managing the performance of health workers. However, poor practices in the implementation of PM systems within the health sector have been shown to have a negative impact on employees’ perceptions of fairness and accountability, which in turn leads to high staff turnover and poor clinical outcomes. Literature on the PM of nurses in health care is abundant. With the shift towards PHC and its well-documented benefits, the reviewers will aim to map literature around the evidence, preferences and practices of the PM of nurses, in light of the need to ensure health workers are adequately trained and rewarded for meeting the needs of existing health care systems. Enhancing methods and practices of PM will help inform decisions on how the practice of people-centred care may be improved, by ensuring good performance is rewarded and health workers are equipped with tools that assist and facilitate effective chronic care practices in PHC settings.
The reviewers anticipate this scoping review finding will assist in mapping evidence of best practices and preferences on PM methods and practices. Likewise, the reviewers hope to expose knowledge gaps and limitations, as well as inform future research. Findings will be disseminated electronically, in print, through peer presentations and conferences on strengthening health systems, HRH or conference proceedings, symposia and other research contributions that examine investing in health care human capital.
Acknowledgements
The authors would like to thank the College of Health Sciences, Systematic Review Services and University of KwaZulu-Natal for financially supporting the development of this research study.
Abbreviations
- HCW
Health care workers
- HR
Human resource
- HRH
Human resources for health
- HRM
Human resource management
- HRP
Human resource practitioner
- MMAT
Mixed Method Appraisal Tool
- NCD
Non-communicable disease
- PA
Performance appraisals
- PCC
Population concept context
- PHC
Primary health care
- PM
Performance management
- PRISMA-ScR
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews
- QI
Quality improvement
- QOC
Quality of car
- TA
Thematic analysis
- UKZN
University of Kwa-Zulu Natal
- WHO
World Health Organization
Authors’ contributions
CZM contributed by conceptualising the study and prepared the draft proposal under the guidance and supervision of IP and TPM-T. All three authors contributed to the development of the background and planned output of the research as well as the design of the study. TPM-T contributed to the development process. CZM prepared the manuscript, and IP and TPM-T reviewed it. All three authors contributed to the reviewed draft version of the manuscript and approved the final version.
Funding
The College of Health Sciences, Systematic Review Services and University of KwaZulu-Natal funded this research study. They also provided the resources used in the development of this protocol.
Availability of data and materials
All data generated or analysed during this study will be included in the published systematic scoping review article and will also be made available upon request.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.World Health Organisation. Global strategy on human resources for health: workforce 2030. Geneva: World Health Organisation; 2016. https://www.who.int/hrh/resources/pub_globstrathrh-2030/en/. Accessed 25 Jan 2019.
- 2.Epping-Jordan JE, Bengoa R, Yach D. Chronic conditions-the new health challenge. SAMJ. 2008;93(8):585. [PubMed] [Google Scholar]
- 3.Tinetti ME, Naik AD, Dodson JA. Moving from disease-centred to patient goals–directed care for patients with multiple chronic conditions: patient value-based care. JAMA Cardiology. 2016;1(1):9–10. doi: 10.1001/jamacardio.2015.0248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kuluski K, Peckham A, Williams AP, Upshur RE. What gets in the way of person-centred care for people with multimorbidity? Lessons from Ontario. Canada. Healthc Q. 2016;19(2):17–23. doi: 10.12927/hcq.2016.24694. [DOI] [PubMed] [Google Scholar]
- 5.Nxumalo N, Goudge J, Gilson L, Eyles J. Performance management in times of change: experiences of implementing a performance assessment system in a district in South Africa. Int J Equity Health. 2018;17(1):141. doi: 10.1186/s12939-018-0857-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kruk ME, Pate M, Mullan Z. Introducing the Lancet Global Health Commission on high-quality health systems in the SDG era. The Lancet Global health. 2017;5(5):e480–e481. doi: 10.1016/S2214-109X(17)30101-8. [DOI] [PubMed] [Google Scholar]
- 7.World Health Organisation . Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva: World Health Organisation; 2010. [Google Scholar]
- 8.World Health Organisation . Quality of care in the context of universal health coverage (UHC). Lilongwe. Malawi: World Health Organisation; 2017. [Google Scholar]
- 9.DeNisi AS, Murphy KR. Performance appraisal and performance management: 100 years of progress? J Appl Psychol. 2017;102(3):421. doi: 10.1037/apl0000085. [DOI] [PubMed] [Google Scholar]
- 10.Aguinis H. Performance management. Boston, MA: Pearson; 2013. [Google Scholar]
- 11.Lutwama GW, Roos JH, Dolamo BL. Assessing the implementation of performance management of health care workers in Uganda. BMC Health Serv Res. 2013;13(1):355. doi: 10.1186/1472-6963-13-355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Lee TW, Steers RM. Facilitating effective performance appraisals: the role of employee commitment and organisational climate. In: Landy EJ, Zedeck S, Cleveland J, editors. Performance measurement and theory. New York, NY: Routledge; 2017. pp. 75–93. [Google Scholar]
- 13.DeNisi AS. Managing performance to change behaviour. J Organ Behav Man. 2011;31(4):262–276. doi: 10.1080/01608061.2011.619414. [DOI] [Google Scholar]
- 14.Bartram T, Dowling PJ. An international perspective on human resource management and performance in the health care sector: toward a research agenda. Int J Hum Resour Man. 2013;24(16):3031–3037. doi: 10.1080/09585192.2013.775024. [DOI] [Google Scholar]
- 15.Ball J, Day T, Murrells T, Dall’Ora C, Rafferty AM, Griffiths P, Maben J. Cross-sectional examination of the association between shift length and hospital nurses job satisfaction and nurse reported quality measures. BMC Nursing. 2017;16(1):26. doi: 10.1186/s12912-017-0221-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Platis C, Reklitis P, Zimeras S. Relation between job satisfaction and job performance in health care services. Procedia Soc Behav Sci. 2015;175:480–487. doi: 10.1016/j.sbspro.2015.01.1226. [DOI] [Google Scholar]
- 17.Bitton A, Ratcliffe HL, Veillard JH, Kress DH, Barkley S, Kimball M, Secci F, Wong E, Basu L, Taylor C, Bayona J. Primary health care as a foundation for strengthening health systems in low-and middle-income countries. J Gen Intern Med. 2017;32(5):566–571. doi: 10.1007/s11606-016-3898-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Choudhary G, Puranik S. Study on employee performance appraisal in health care. Asian J Manag Sci. 2014;2(03 Special Issue):59-64.
- 19.O’Malley AS, Rich EC. Measuring comprehensiveness of primary care: challenges and opportunities. J Gen Intern Med. 2015;30(3):568–575. doi: 10.1007/s11606-015-3300-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gedif G, Sisay Y, Alebel A, Belay YA. Level of job satisfaction and associated factors among health care professionals working at University of Gondar Referral Hospital, Northwest Ethiopia: a cross-sectional study. BMC Research Notes. 2018;11(1):824. doi: 10.1186/s13104-018-3918-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Skinner N, Van Dijk P, Stothard C, Fein EC. “It breaks your soul”: an in-depth exploration of workplace injustice in nursing. J Nurs Manag. 2018;26(2):200–208. doi: 10.1111/jonm.12535. [DOI] [PubMed] [Google Scholar]
- 22.Scheffelaar A, Bos N, Hendriks M, van Dulmen S, Luijkx K. Determinants of the quality of care relationships in long-term care-a systematic review. BMC Health Serv Res. 2018;18(1):903. doi: 10.1186/s12913-018-3704-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–146. doi: 10.1097/XEB.0000000000000050. [DOI] [PubMed] [Google Scholar]
- 24.Khalil H, Peters M, Godfrey CM, McInerney P, Soares CB, Parker D. An evidence-based approach to scoping reviews. Worldviews Evid Based Nurs. 2016;13(2):118–123. doi: 10.1111/wvn.12144. [DOI] [PubMed] [Google Scholar]
- 25.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
- 26.Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69. doi: 10.1186/1748-5908-5-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Hannes K, Macaitis K. A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers. Qual Res. 2012;12(4):402–442. doi: 10.1177/1468794111432992. [DOI] [Google Scholar]
- 28.Ng L, Pitt V, Huckvale K, Clavisi O, Turner T, Gruen R, Elliott JH. Title and abstract screening and evaluation in systematic reviews (TASER): a pilot randomised controlled trial of title and abstract screening by medical students. Syst Rev. 2014;3(1):121. doi: 10.1186/2046-4053-3-121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, Gagnon MP, Griffiths F, Nicolau B, O’Cathain A, Rousseau MC, Vedel I. The Mixed Methods Appraisal Tool (MMAT) version 2018. User guide. Montreal: McGill University, Department of Family Medicine; 2018. [Google Scholar]
- 30.Moher D, Liberati A, Tetzlaff J, Altman DG, Group P Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLOS Medicine. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L, Hempel S. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–473. doi: 10.7326/M18-0850. [DOI] [PubMed] [Google Scholar]
- 32.Armstrong R, Hall BJ, Doyle J, Waters E. Cochrane Update. ‘Scoping the scope’ of a cochrane review. J Public Health. 2011;33(1):147–150. doi: 10.1093/pubmed/fdr015. [DOI] [PubMed] [Google Scholar]
- 33.Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, Seller R. Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int J Nurs Stud. 2012;49(1):47–53. doi: 10.1016/j.ijnurstu.2011.07.002. [DOI] [PubMed] [Google Scholar]
- 34.Tricco AC, Lillie E, Zarin W, O’Brien K, Colquhoun H, Kastner M, Levac D, Ng C, Sharpe JP, Wilson K. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16(1):15. doi: 10.1186/s12874-016-0116-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.The Joanna Briggs Institute . Joanna Briggs Institute Reviewers’ Manual: 2014 edition. The University of Adelaide. South Australia: The Joanna Briggs Institute; 2014. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data generated or analysed during this study will be included in the published systematic scoping review article and will also be made available upon request.