Abstract
Introduction: Patient-reported Experience Measures (PREMs) are validated questionnaires, that gather patients' and families' views of their experience receiving care and are commonly used to measure the quality of care, with the goal to make care more patient and family-centered. PREMs are increasingly being adopted in pediatric population, however knowledge gaps exist around understanding the use of PREMs in pediatrics.
Objective: To identify and synthesize evidence on the use of PREMs in pediatric healthcare settings and their characteristics.
Evidence Review: Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines governed the conduct and reporting of this review. An exhaustive search strategy was applied to MEDLINE, EMBASE, PsycINFO, Cochrane Library, and CINAHL databases to identify relevant peer-reviewed articles from high-income countries. Additionally, gray literature was searched to capture real-world implementation of PREMs. All the articles were screened independently by two reviewers in two steps. Data was extracted independently, synthesized, and tabulated. Findings from gray literature was synthesized and reported separately. Risk of bias for the studies identified through scientific databases was assessed independently by two reviewers using the National Institutes of Health Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies.
Results: The initial search identified 15,457 articles. After removing duplicates, the title and abstracts of 11,543 articles were screened. Seven hundred ten articles were eligible for full-text review. Finally, 83 articles met the criteria and were included in the analyses.
Of the 83 includes studies conducted in 14 countries, 48 were conducted in USA, 25 in European countries and 10 in other countries. These 83 studies reported on the use of 39 different PREMs in pediatric healthcare settings. The gray literature retrieved 10 additional PREMs. The number of items in these PREMs ranged from 7 to 89. Twenty-three PREMs were designed to be completed by proxy, 10 by either pediatric patients or family caregivers, and 6 by pediatric patients themselves.
Conclusion and Relevance: This comprehensive review is the first to systematically search evidence around the use of PREMs in pediatrics. The findings of this review can guide health administrators and researchers to use appropriate PREMs to implement patient and family-centered care in pediatrics.
Keywords: patient-centered care, pediatrics, systematic review, routine clinical care, patient-reported experience measures (PREMs)
Introduction
Pediatric healthcare systems around the world continue to evolve and are increasingly acknowledging the importance of delivering patient and family-centered care (PFCC) to improve all dimensions of quality, including patients' and families' experience with care received (1). Encouraged by the American Academy of Pediatrics, PFCC is key in the planning, delivery, and evaluation of healthcare that is grounded in mutually beneficial partnerships among healthcare providers, patients, and families. To improve and sustain the practice of PFCC, measuring patient and families' experience with the care received is necessary (2).
Patient-reported Experience Measures (PREMs) are validated questionnaires, that gather patients' and families' views of their experience receiving care. PREMs assess the impact of the process of care including communication between patient, their families and healthcare providers, information sharing, involvement of patients and their families in decision-making and are commonly used as indicators to evaluate the quality of care (2, 3). In the context of the Institute for Healthcare Improvement (IHI) Triple Aim Framework, the implementation of PREMs in healthcare leads to improved outcomes while lowering healthcare costs (4). In addition, it allows the voice of patients and their family to inform care improvement, an important concept included in the learning health system paradigm (5).
The growing adoption of PREMs in pediatric care requires the identification of appropriate PREMs and their subsequent use in healthcare settings. PREMs are centered around the experience while receiving care (e.g., hospital environment, ease of parking, call buttons near bed etc.) rather than clinical outcomes. Moreover, most of the validated PREMs are developed in high income countries which have comparable healthcare systems and services. Thus, the objective of this systematic review is to identify and synthesize evidence on the types of PREMs used in pediatric care, and their subsequent use in healthcare systems in high income countries to inform care improvement and support pediatric learning health systems paradigm.
Methods
Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines governed the conduct and reporting of this review (6). The protocol has been registered with OSF (DOI 10.17605/OSF.IO/3RMNC).
MeSH (Medical Subject Headings) terms, keywords and their variations were used to develop a search strategy, which was initially applied to MEDLINE database to randomly screen 100 abstracts to refine this strategy. The final search strategy was applied to MEDLINE, EMBASE, PsycINFO, Cochrane Library, and CINAHL databases. Gray literature was searched through the websites of health institutes, pediatric hospitals, conferences, professional agencies, and search engines manually, which provided an overview of real-world implementation of PREMs.
Covidence was used for article screening and selection against pre-defined inclusion and exclusion criteria (Box 1) (8). In the first step, two independent reviewers screened titles and abstracts. Then, two reviewers independently screened selected articles by going through their full text. In both the steps, conflicts were resolved by discussion and consensus or by involving a third reviewer.
Box 1. Inclusion and exclusion criteria.
Inclusion Criteria
1. Population: Studies that focused only on pediatric populations (≤ 18 years).
2. Measure: Studies that implemented previously validated pediatric PREMs with explicit information regarding how the PREM was validated by mentioning either the validation process or referencing a previous article that described the validation and development process.
3. Geography: Included studies also needed to have been conducted in high-income countries, loosely defined by World Bank (7 ).
4. Articles published from January 2000 to April 2021.
Exclusion Criteria:
1. Population: Studies that focused on adult or general populations alongside pediatric populations.
2. Measure: Studies that utilized a non-validated PREM or a satisfaction survey. Editing a validated PREM threatens its validity, therefore we excluded studies where PREMs were either edited or researcher created their own questionnaires without conducting any validity testing.
3. PREM validation studies.
4. Study design: opinion pieces and reviews.
5. Language: Studies in languages other than English, French, Spanish, or Dutch.
Following screening, two reviewers independently extracted the data. Due to heterogeneity among the studies in both statistical and methodological domains, conducting a meta-analysis was neither warranted nor plausible. We instead synthesized the results inductively by tabulating identified PREMs in various geographic locations, their type, use and characteristics. Similarly, findings from gray literature are synthesized and reported separately.
Risk of bias for all the studies identified through scientific databases was assessed independently by two reviewers using the National Institutes of Health Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies (9).
Results
Search Results
The PRISMA flow diagram (Figure 1) summarizes the study selection process. The initial search identified 15,457 articles. After removing duplicates, the title and abstracts of 11,543 articles were screened. Of these, 710 were eligible for full-text review. In total, 83 articles met the inclusion criteria and were included in the analyses. These studies reported on the use of 39 different PREMs in pediatric healthcare settings (Table 1). The gray literature retrieved 10 additional PREMs that are used in clinical practice. Since many PREMs are usually copy-righted by the developers, so we did not contact authors or developer of the surveys for more information.
Figure 1.
Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) flow diagram of identification and selection process of studies.
Table 1.
Summary of the pediatric patient-reported experience measures.
No. | PREM name | Year and country of origin |
Type (generic/ disease specific) |
Patient or proxy completion | Number of items | Number of domains | Domain descriptors |
---|---|---|---|---|---|---|---|
1 | Child HCAHPS | 2015, United States (10) | Generic | Proxy | 62 | 5 | Communication with parent, Communication with child, Attention to safety and comfort, Hospital environment, Global ratings. |
2 | Children and Young People's Inpatient and Day Case Survey 2014 | 2014, United Kingdom (11) | Generic | Both | 74 | 10 | Presence of pain, Pain relief, Overall experience, Involvement in decisions, Communication on arrival, Communication about care and treatment, Communication before operation/procedure, Communication after operation/procedure, Discharge communication, Advice on post-discharge care. |
3 | Children's Revised Humane Care Scale (CRHCS) | 2019, Finland (12) | Generic | Both | 41 | 6 | Professional practice, Information and participation in own care, Cognition of physical needs, Human resources, Pain and apprehension management, Interdisciplinary collaboration. |
4 | Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) | 2007, United States (13) | Generic | Proxy | 33 | N/A | N/A |
5 | Consultation and Relational Empathy measure (CARE) | 2004, United Kingdom (Scotland) (14) | Generic | Both | 10 | 4 | Not specified. |
6 | Consumer Assessment of Health Plan Study (CAHPS) 2.0 Child Core Questionnaire | 2014, United States (15) | Generic | Proxy | 7 | 5 | Courtesy and respect of office staff, Helpfulness of office staff, Providers' communication skills with parents, Respect shown to parents by providers, Providers' communication skills with children. |
7 | Consumer Assessment of Health Plans Survey (CAHPS) | 2002, United States (16) | Generic | Proxy | 18 | 9 | Getting care quickly, Doctor's communication; Health plan customer service, Getting prescription medicines, Getting specialized services, Family centred care-shared decision making, Family centred care-getting needed information, Family centred care-personal doctor. |
8 | Consumer Assessment of the Healthcare Providers and Systems (CAHPS) | 2012, United States (17) | Generic | Proxy | 29 | 9 | Care from nurses, Care from doctors, The hospital environment, Experiences in this hospital, Post-discharge overall rating, Understanding care post-discharge, About patient. |
9 | Disease-specific patient satisfaction questionnaire | 2014, Germany (18) | Disease specific (IBS) | Patient | 32 | N/A | N/A |
10 | Epilepsy 12 | 2002, United Kingdom (19) | Disease specific (epilepsy) | Both | 18 | N/A | N/A |
11 | EMPATHIC-30 | 2011, Netherlands (20) | Generic (ICU) | Proxy | 30 | 5 | Information, Care and treatment, Organization and coordination of care, Parents and family engagement, Team care (pediatrician and other clinicians involved in the care of the children), Overall score. |
12 | Evaluation of the Quality of Diabetes Care' (PEQ-D) | 2002, Netherlands (21) | Disease specific (diabetes) | Patient | 14 | N/A | N/A |
13 | Experience of Service Questionnaire (ESQ) | 2002, United Kingdom (22) | Disease specific (mental health) | Both | 12 | N/A | N/A |
14 | Family-Provider Relationships Instrument-NICU (FAMPRO-NICU) | 2001, United States (23) | Generic (NICU) | Proxy | 65 | 3 | Belief-desire, Feelings, Intentions. |
15 | FCCS (Family Centered Care Survey) | 2006, Canada (24) | Generic | Proxy? | 20 | N/A | N/A |
16 | GYV (Give Youth a Voice) | 2008, Canada (25) | Generic | Patient | 56 | 4 | Supportive and respectful relationships, Information sharing and communication, Support of independence, Teen centered services. Note: adapted from MPOC. |
17 | Inpatient Survey (IS) | 2013, United Kingdom (26) | Generic | Patient | 86 | N/A | N/A |
18 | McLean Hospital's Perception of Care survey | 2002, United States (27) | Generic (inpatient psychiatric care) | Both | 20 | 4 | Interpersonal aspects of care, Continuity/coordination of care, Communication/information received from treatment providers, Global evaluation of care. |
19 | MPOC-20, MPOC-32, MPOC-56 | 1996, Canada (28) | Generic | Proxy | 20, 32, 56 | 5 | Enabling and partnership, providing general information, Providing specific information about the child, Coordinated and comprehensive care, Respectful and supportive care. |
20 | Mind the Gap | 2007, United Kingdom (29) | Generic | Both | 22 | 3 | The environment, Care processes, Healthcare provider characteristics. |
21 | Neonatal Instrument of Parent Satisfaction (NIPS) | 1996, Canada (30) | Generic (NICU) | Proxy | 27 | N/A | N/A |
22 | NRC Health Patient Survey | 2020, United States (31) | Generic | Proxy | 20 | N/A | N/A |
23 | P-MISS (Medical Interview Satisfaction Scale) | 1986, United States (32) | Generic | Proxy | 23 | 3 | Parent communication and child communication, Parent communication and adherence intent, Distress relief and adherence |
24 | Parent's Perceptions of Primary Care (P3C) | 2001, United States (33) | Generic | Proxy | 23 | 6 | Continuity of care, Accessibility of care, Contextual knowledge of physicians, Communication skills of physicians, Comprehensiveness of care, Coordination of care. |
25 | Pediatric Family Satisfaction Questionnaire (PFSQ) | 2002, United States (34) | Generic | Proxy | 35 | 3 | Hospital services and accommodation, Nursing care, Medical care |
26 | Pediatric Family Satisfaction-ICU (pFS-ICU) | 2001, United States (35) | Generic (ICU) | Proxy | 24 | 5 | How did we treat your family member (the patient), Symptom management: how well the ICU staff assessed and treated your child's symptoms, How did we treat you? Information needs, Process of making decisions. |
27 | PedsQL - Healthcare Satisfaction Generic Module | 2005, United States (36) | Generic | Both | 26 | 6 | Information, Family inclusion, Communication, Technical skills, Emotional needs, Overall satisfaction. |
28 | Picker Inpatient Survey | 1990's, United States (37) | Generic | Proxy | 35 | 7 | Partnership, Overall care, Physical comfort, Information to parents, Confidence and trust, Continuity and transition, Coordination of care. |
29 | Press Ganey Inpatient Pediatric Survey | 1998, United States (38) | Generic | Proxy | 38 | 8 | Admission, Nursing care, Tests and treatments; Family and visitors, Child's physician, Discharge, Personal issues, Overall assessment. |
30 | Press Ganey Medical Practice Survey | United States (39) | Generic | Proxy | 29 | 6 | Access to care, Visit processes, Nursing, Care provider, Personal issues, Overall assessment. |
31 | Press Ganey Patient Satisfaction Survey | United States (40) | Generic | Patient | Not provided | 4 | Inpatient overall, ED overall, Inpatient speed of admission, ED wait times to treatment |
32 | Press Ganey Physician Specialties Survey | United States (41) | Generic | Proxy | 39 | N/A | N/A |
33 | Press Ganey Satisfaction Survey (unique to each study) | United States (42) | Generic | Proxy | Varies | Varies | Varies |
34 | Swedish Pyramid Questionnaire (Quality of Patient Care Questionnaire - Parents Version)/ Swedish parent satisfaction questionnaire | 2001, Sweden (43) | Generic | Proxy | 63 | 8 | Information on illness, Information on routines, Accessibility, Medical treatment, Care processes, Staff attitudes, Parent participation, Staff work environment. |
35 | The Picker Institute's Neonatal Intensive Care Unit Family Satisfaction survey | 2014, United States (44) | Generic (NICU) | Proxy | 80 | 8 | Information and education to parents, Environment and visitation policies, Family and infant support by the NICU, Confidence and trust in the NICU, Continuity and transition, Family participation in care, Overall impressions, Coordination of care. |
36 | The Children's Hospital Boston Inpatient Experience Survey | 2013, United States (45) | Generic | Proxy | 62 | 8 | Care from nurses, Care from doctors, Doctors/nurses/parents working together, Hospital experiences (procedures, pain management, comfort), Hospital environment, Child's medication, Arrival at and discharge from the hospital, Overall ratings. |
37 | The national cancer patient experience survey | 2010–2014, United Kingdom (46) | Disease Specific (cancer) | Patient | 79 (varied each year) | N/A | N/A |
38 | The patient-reported experience measure (PREM) for children in urgent and emergency care. | 2012, United Kingdom (47) | Generic (emergency care) | Both | 29 | N/A | N/A |
39 | Young Patient Survey | 2004, United Kingdom (48) | Generic | Both | 89 | 9 | Respect for patient preferences, Coordination of care, Information and education, Physical comfort, Emotional support, Involvement of family and friends, Continuity and transition, Overall quality of care, Confidentiality and privacy. |
Characteristics of Included Studies
The included studies were conducted in 14 countries, including 48 studies in the United States of America, 25 studies in European countries (Austria, Finland, Germany, Greece, Iceland, the Netherlands, Norway, Slovenia, Spain, and the United Kingdom), 8 studies in Canada, and 1 study each in Australia and Singapore. Figure 2 provides an overview of the number of different PREMs that are used per country. Regarding study design, 41 of the included studies used a cross-sectional study design. The remaining study designs include 13 cohort studies, 6 mixed-methods, 6 observational, 3 quasi-experimental, 2 randomized-control trials, 2 quality improvement studies, 2 secondary data analyses, 2 retrospective data studies, and 1 of each of the following study designs: program evaluation, descriptive, longitudinal, case study, and pilot/feasibility studies.
Figure 2.
Geographic locations of pediatric PREMs identified through systematic review and gray literature.
The duration of studies ranged from 2 weeks to 5 years and study populations ranged from 0 to 25 years. Disease of interest varied across studies, although most studies addressed a general disease group. Disease-specific populations included epilepsy, diabetes, asthma, neurological conditions, and juvenile arthritis, among others. The identified studies also presented a diverse range of health care settings, including emergency rooms, NICU and PICUs, inpatient wards, and outpatient ambulatory clinic, among others Overall, paper-pencil was the most common mode of administering PREMs (60.2%), followed by electronic (26.5%), telephone (12.0%), and/or via interview (1.2%) modes. The PREMs were completed by proxy only in 60 studies (71.4%), by patient and/or the proxy in 14 studies (16.7%), by only the patient in 7 studies (8.3%), while 3 studies did not specify (3.6%) (one study used two different PREMs that had different methods of completion) (49).
Among the studies, the most commonly used PREMs were the various Press Ganey surveys (50) (n = 18), the Measure of Processes of Care (MPOC) (28) (n = 15), Child HCAHPS (10) (n = 10) and HCAHPS surveys (51) (n = 5). Among all the included studies, there was a high amount of variation in the purpose of using PREMs. PREMs were most commonly used to evaluate factors that affected overall patient experience and to assess the experiences after an intervention, most often an improvement in quality of care. A complete overview of the characteristics of the included studies can be found in the Supplement 1.
PREMs
This extensive review identified 39 previously validated pediatric PREMs (Table 1). These PREMs were developed in 7 countries. The greatest number of PREMs were developed in the United States of America (N = 21), followed by the United Kingdom (N = 9), Canada (N = 4), the Netherlands (N = 2), Finland (N = 1), Germany (N = 1), and Sweden (N = 1). Most of the included PREMs were generic (N = 34), aiming to measure general experiences of healthcare regardless of the disease or care sector. The included disease specific PREMs (N = 5) have been developed to capture the experience of healthcare from patients with inflammatory bowel disease, epilepsy, diabetes, cancer, and mental health conditions.
Of the identified PREMs, 23 were designed to be completed by proxy (59.0%), 10 PREMs (25.6%) could be completed by either or both of the pediatric patient and their caregiver(s), and 6 PREMs (13.4%) had been explicitly developed for completion by the pediatric patients themselves. The PREMs designed for completion by the pediatric patients were Disease-Specific Patient Satisfaction Questionnaire (18), Evaluation of the Quality of Diabetes Care (21), the Give Youth a Voice (25), the Inpatient Survey (26), the Press Ganey Patient Satisfaction Survey (40), and the National Cancer Patient Experience Survey (46).
Among the studies reporting questionnaire characteristics, the number of items ranged from 7 to 89, and the number of domains ranged from 3 to 10. The number of items was not provided for 5 PREMs, and the number of domains was not provided for 12 PREMs. Domains related to communication were most common, such as “communication with parent,” “communication with child,” “communication about care and treatment,” and “provider's communication skills.” Other examples of reported domains include “information,” “respect,” “coordination of care,” “patient and family engagement,” “respectful and supportive care,” and “overall experiences.”
Quality Assessment
The quality assessment of the included studies is presented in the Supplement 1. The quality of all studies was rated as either fair (40%) or good (60%). Overall, the risk of bias of the included studies was moderate.
Gray Literature
Ten additional PREMs were identified through the gray literature search (Supplement 2). These PREMs were used to evaluate the experiences of pediatric patients and/or caregivers with daily clinical healthcare in the United States of America, the United Kingdom, the Netherlands, Canada, and Australia. The majority of hospitals in these countries asked patients to share their experiences with the use of PREMs. The gray literature search showed that a variation of PREMs, often self-developed, were used in the hospitals. Some hospitals administered PREMs to all their patients/caregivers, though most hospitals randomly invited recently discharged patients/caregivers to complete PREMs. The modes of administering PREMs identified through gray literature were similar to the ones identified through scientific databases, as listed previously.
Discussion
In this review, we document the geographic distribution of pediatric PREMs used and quantify the different PREMs administered in clinical care. PREMs are often falsely synonymized with patient reported outcome measures (PROMs) and satisfaction questionnaires, but these three types of questionnaires have distinct purposes and target different elements of patient care. In contrast to PROMs, which assess the patient's health status and measures quality of life, PREMs focus on care processes and their perceived impact on overall patient experience (52). While dissimilar in outlook, PREMs and PROMs are often used in tandem to gather information related to the patient's care experience and outcome contentment. The terms patient satisfaction and patient experience despite being often used interchangeably, are different. Patient experience assesses whether something that should happen in a healthcare setting (such as clear communication with a provider) actually happened or how often it happened. On the other hand, Satisfaction is about whether a patient's expectations about a health encounter were met (52–54). PREMs also differ from patient satisfaction surveys, which relate to patient expectations and often involve a degree of subjectivity that is not seen in PREMs (52, 55–57).
The results of our review demonstrate an international uptake of pediatric PREMs in clinical care, totaling 49 different PREMs, 39 from peer-reviewed articles and 10 from gray literature that were used in 14 developed countries spanning four continents. While administered in 14 different countries, the development of these PREMs only occurred in seven, with the greatest heterogeneity in both pediatric PREM development and implementation occurring in the United States (21), followed by the United Kingdom (9). While primarily utilized for quality improvement purposes, various research groups implemented pediatric PREMs to gauge how the responses varied between patient populations or between the patients and their family caregivers.
Measuring patient and family experience has a critical role in informing PFCC. Previous studies have explored the development and psychometric evaluation of PREMs, assessed their validity and reliability, and compared different PREM instruments for their respective utilization (58–60). Studies have also noted differences between proxy ratings, usually coming from a family caregiver, and the ratings of a patient themselves, where the patient tends to provide lower rating regarding their own experiences of care (49, 61). Additionally, there exists a paucity of information regarding the use of pediatric PREMs, and their type (i.e., generic, disease-specific, health-setting-specific), as well as their purpose and impact on quality of care in clinical practice. These findings can be used to inform PFCC initiatives at a system-level, helping to achieve the Triple Aim and supporting the learning health system paradigm (62, 63).
Additionally, research has acknowledged the correlation between PREM-implementation, the establishment of the PFCC, and the promotion of quality improvement initiatives (64). While this information is accepted in the context of adult PREMs, much less research exists regarding the implementation and assessment of pediatric PREMs (65). This study will inform future work in the area of PREM implementation in pediatric care.
The identified PREMs feature important domains addressing PFCC concepts such as shared-decision making and respecting patient values. A main gap identified in our review suggests that the use of disease-specific PREMs warrants more attention, with only five of the validated PREMs being disease-specific. Even among studies conducted in disease-specific settings, generic PREMs were more often chosen over an appropriate disease-specific tool. This may be related to the versatility and applicability of generic PREMs in more healthcare settings compared to disease-specific PREMs. However, disease-specific PREMs issues more specific to the corresponding disease. For example, MPOC (28) is a validated PREM commonly used for children with variety of neurodevelopmental disabilities or maxillofacial disorders. MPOC assesses family caregiver's perception of the care that their children receive at rehabilitation treatment centers, and thus can provide a better contextual understanding of patient experience specifically related to those clinical conditions. Therefore, future research examining why disease-specific PREM use and development is lacking should be explored. Additionally, while all included studies discussed the utility of using these pediatric PREMs, few examined the practicality of implementing them (66–68). Future research examining the capacity of hospitals and physicians to incorporate these measures into clinical care is needed to pragmatically assess the likelihood of pediatric PREM administration.
A significant strength of this systematic review is the inclusion of gray literature. As this review aimed to explore the range of pediatric PREMs currently in use, gray literature sources provided an exploration of real-world PREM implementation in pediatric healthcare settings around the world. We also incorporated the perspectives of international researchers with expertise in the topics of PREMs and PROMs. This bolstered the knowledge and experience of the research team and allowed for the inclusion of different perspectives on PREM implementation from different countries.
Despite being successful in identifying the number of pediatric PREMs currently in use, this review was not without limitations. Regarding gray literature, the information about the PREMs and their implementation were often not explicitly described on hospital websites, meaning we could only provide a global description of these PREMs. PREMs created in or translated to different languages or cultural contexts may have not been available in a language that the reviewers could understand, and therefore those studies were excluded. Furthermore, the inclusion criteria of “high-income countries” potentially limited the scope of this study by geographically restricting the results. Lastly, because of the interchangeable use of the terms “experience” and “satisfaction,” it is possible that due to the phrasing of study surveys, some PREMs were inadvertently excluded. However, the likelihood of this occurring was minimized due to the continual implementation of dual reviewers and the inclusion of the terms “satisfaction” and “satisfaction survey” in our initial search strategy.
The objective of this systematic review was to identify pediatric PREMs and their use in care settings. Although there are tools like the COSMIN Checklist to critically appraise the validity and reliability of PROs (PROMs and PREMs), there are no such standard tools to evaluate the strengths and weaknesses of PREMs. Moreover, evaluating these measures for their strengths and weaknesses would be subjective and context specific. Therefore, this systematic review did not evaluate the strengths and weaknesses of the PREMs, but further studies focused on assessing the strengths and weaknesses of individual PREMs may be warranted in the future.
Conclusion
This systematic review details the international use of pediatric PREMs in different pediatric clinical settings and provides an overview of the current validated pediatric PREMs available for use. The findings of this review can guide health administrators and researchers to use appropriate PREMs to implement PFCC in pediatric settings. In most of the studies included in this review, the usefulness of pediatric PREMs was highlighted. However, future additional research into the views of implementing PREMs held by clinical practitioners and patients and their families is warranted to best gauge the practicality of widespread pediatric PREM implementation.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
MS, LH, SB, SA, EG, LT, and HO contributed to the overall rationale and design of the review. ND provided expert input on developing search strategy. SB, MZ, SR, SA, and LT assessed studies for eligibility against inclusion and exclusion criteria including gray literature and assessed risk of bias and also extracted the data and synthesized results. SB, MZ, SR, and SA led the drafting of the manuscript. MS, LH, SB, SA, EG, LT, HO, MZ, and SR contributed to the subsequent drafts of the manuscript. All authors contributed to the article and approved the submitted version.
Funding
SB received financial support in the form of graduate studentship from Alberta Children's Hospital Research Institute. MZ received financial support in the form of summer research studentship from Alberta Innovates.
Conflict of Interest
EG was employed by Evidera. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank these funding agencies for their financial support.
Glossary
Abbreviations
- Child HCAHPS
The Child Hospital Consumer Assessment of Healthcare Providers and Systems
- IHI
Institute for Healthcare Improvement
- MeSH
Medical Subject Headings
- MPOC
Measure of Process of Care
- PFCC
Patient and Family-Centered Care
- PREM
Patient-Reported Experience Measure
- PRISMA
Preferred Reporting Items for Systematic Review and Meta-Analysis
- PROM
Patient-Reported Outcome Measure.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2021.753536/full#supplementary-material
References
- 1.Patient-and Family-Centered Care. Institute for Patient-and Family-Centered Care. (2021) Available online at: https://www.ipfcc.org/about/pfcc.html (accessed November 1, 2021).
- 2.Kingsley C, Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. (2017) 17:137–44. 10.1093/bjaed/mkw060 [DOI] [Google Scholar]
- 3.Beattie M, Murphy DJ, Atherton I, Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: A systematic review. Syst Rev. (2015) 4:1–21. 10.1186/s13643-015-0089-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff. (2008) 27:759–69. 10.1377/hlthaff.27.3.759 [DOI] [PubMed] [Google Scholar]
- 5.Nwaru BI, Friedman C, Halamka J, Sheikh A. Can learning health systems help organisations deliver personalised care? BMC Med. (2017) 15:1–8. 10.1186/s12916-017-0935-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. (2021) 372:n71. 10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.High income | Data . Available online at: https://data.worldbank.org/country/XD (accessed June 18, 2021).
- 8.Covidence. Better Systematic Review Management. (2021). Available online at: https://www.covidence.org/ (accessed June 17, 2021).
- 9.Study, Quality Assessment Tools,. NHLBI, NIH. Available online at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (accessed June 18, 2021).
- 10.Toomey SL, Zaslavsky AM, Elliott MN, Gallagher PM, Fowler FJ, Klein DJ, et al. The development of a pediatric inpatient experience of care measure: child HCAHPS ® HHS public access. Pediatrics. (2015) 136:360–9. 10.1542/peds.2015-0966 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Care Quality Commission,. Children young peoples inpatient day case survey 2014: National results. (2015). (Newcastle Upon Tyne), 1–78. Available online at: https://www.cqc.org.uk/sites/default/files/20150626_cypsurvey_results_tables.pdf
- 12.Janhunen K, Kankkunen P, Kvist T. Quality of pediatric emergency care as assessed by children and their parents. J Nurs Care Qual. (2019) 34:180–4. 10.1097/NCQ.0000000000000346 [DOI] [PubMed] [Google Scholar]
- 13.Development of the CAHPS Clinician & Group Survey | Agency for Healthcare Research Quality . Available online at: https://www.ahrq.gov/cahps/surveys-guidance/cg/about/Develop-CG-Surveys.html (accessed June 30, 2021).
- 14.Mercer SW, Maxwell M, Heaney D, Watt GCM. The consultation and relational empathy (CARE) measure: Development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract. (2004) 21:699–705. 10.1093/fampra/cmh621 [DOI] [PubMed] [Google Scholar]
- 15.Kleinsorge CA, Roberts MC, Roy KM, Rapoff MA. The program evaluation of services in a primary care clinic: Attaining a medical home. Clin Pediatr (Phila). (2010) 49:548–59. 10.1177/0009922809358615 [DOI] [PubMed] [Google Scholar]
- 16.Knapp C, Madden V, Sloyer P, Shenkman E. Effects of an integrated care system on quality of care and satisfaction for children with special health care needs. Matern Child Health J. (2012) 16:579–86. 10.1007/s10995-011-0778-9 [DOI] [PubMed] [Google Scholar]
- 17.Family Experiences and Pediatric Health Services Use Associated With Family-Centered Rounds (2012) . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Sadlo A, Altevers J, Peplies J, Ayis S, Direkze N, Lomer MC, et al. Measuring satisfaction with health care in young persons with inflammatory bowel disease -an instrument development and validation study. BMC Health Serv Res. (2014) 14:1–10. 10.1186/1472-6963-14-97 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Down C, Waldron B, Maini R, Colaco F, Bowyer K, Gilmore E, et al. Epilepsy12 - United Kingdom collaborative clinical audit of health care for children and young people with suspected epileptic seizures. Arch Dis Child. (2015) 100(Suppl. 3):A118.2–9. 10.1136/archdischild-2015-308599.26028850992 [DOI] [Google Scholar]
- 20.Latour JM, Van Goudoever JB, Duivenvoorden HJ, Albers MJ, van Dam NA, Dullaart E, et al. Construction and psychometric testing of the EMPATHIC questionnaire measuring parent satisfaction in the pediatric intensive care unit. Intensive Care Med. (2011) 37:310–8. 10.1007/s00134-010-2042-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Pouwer F, Snoek FJ. Patients' evaluation of the quality of diabetes care (PEQD): Development and validation of a new instrument. Qual Saf Heal Care. (2002) 11:131–6. 10.1136/qhc.11.2.131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Barber AJ, Tischler VA, Healy E. Consumer satisfaction and child behaviour problems in child and adolescent mental health services. J Child Heal Care. (2006) 10:9–21. 10.1177/1367493506060200 [DOI] [PubMed] [Google Scholar]
- 23.Van Riper M. Family-provider relationships and well-being in families with preterm infants in the NICU. Hear Lung J Acute Crit Care. (2001) 30:74–84. 10.1067/mhl.2001.110625 [DOI] [PubMed] [Google Scholar]
- 24.Mah JK, Tough S, Fung T, Douglas-England K, Verhoef M. Parents' global rating of mental health correlates with SF-36 scores and health services satisfaction. Qual Life Res. (2006) 15:1395–401. 10.1007/s11136-006-0014-z [DOI] [PubMed] [Google Scholar]
- 25.Gan C, Campbell KA, Snider A, Cohen S, Hubbard J. Giving Youth a Voice (GYV): A measure of youths' perceptions of the client-centredness of rehabilitation services. Can J Occup Ther. (2008) 75:96–104. 10.1177/000841740807500205 [DOI] [PubMed] [Google Scholar]
- 26.Hargreaves DS, McDonagh JE, Viner RM. Validation of you're welcome quality criteria for adolescent health services using data from national inpatient surveys in England. J Adolesc Heal. (2013) 52:50–57.e1. 10.1016/j.jadohealth.2012.04.005 [DOI] [PubMed] [Google Scholar]
- 27.Eisen S V., Wilcox M, Idiculla T, Speredelozzi A, Dickey B. Assessing consumer perceptions of inpatient psychiatric treatment: the perceptions of care survey. Jt Comm J Qual Improv. (2002) 28:510–26. 10.1016/S1070-3241(02)28056-6 [DOI] [PubMed] [Google Scholar]
- 28.King SM, Rosenbaum PL, King GA. Parents' perceptions of caregiving: Development and validation of a measure of processes. Dev Med Child Neurol. (1996) 38:757–72. 10.1111/j.1469-8749.1996.tb15110.x [DOI] [PubMed] [Google Scholar]
- 29.Shaw KL, Southwood TR, McDonagh JE. Development and preliminary validation of the “Mind the Gap” scale to assess satisfaction with transitional health care among adolescents with juvenile idiopathic arthritis. Child Care Health Dev. (2007) 33:380–8. 10.1111/j.1365-2214.2006.00699.x [DOI] [PubMed] [Google Scholar]
- 30.Mitchell-DiCenso A, Guyatt G, Paes B, Blatz S, Kirpalani H, Fryers M, et al. A new measure of parent satisfaction with medical care provided in the neonatal intensive care unit. J Clin Epidemiol. (1996) 49:313–8. 10.1016/0895-4356(95)00531-5 [DOI] [PubMed] [Google Scholar]
- 31.Davis-Dao CA, Ehwerhemuepha L, Chamberlin JD, Feaster W, Khoury AE, Fortier MA, et al. Keys to improving patient satisfaction in the pediatric urology clinic: A starting point. J Pediatr Urol. (2020) 16:377–83. 10.1016/j.jpurol.2020.03.013 [DOI] [PubMed] [Google Scholar]
- 32.Lewis CC, Scott DE, Pantell RH, Wolf MH. Parent satisfaction with children's medical care: Development, field test, and validation of a questionnaire. Med Care. (1986) 24:209–15. 10.1097/00005650-198603000-00003 [DOI] [PubMed] [Google Scholar]
- 33.Seid M, Varni JW, Bermudez LO, Zivkovic M, Far MD, Nelson M, et al. Parents' perceptions of primary care: Measuring parents' experiences of pediatric primary care quality. Pediatrics. (2001) 108:264–70. 10.1542/peds.108.2.264 [DOI] [PubMed] [Google Scholar]
- 34.Bragadóttir H, Reed D. Psychometric instrument evaluation: the pediatric family satisfaction questionnaire. Pediatr Nurs. (2002) 28:475–82. Available online at: https://pubmed.ncbi.nlm.nih.gov/12424983/ [PubMed] [Google Scholar]
- 35.Hummel K, Presson AP, Millar MM, Larsen G, Kadish H, Olson LM. An assessment of clinical and system drivers of family satisfaction in the PICU*. Pediatr Crit Care Med. (2020) 21:E888–97. 10.1097/PCC.0000000000002394 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Sigurdardottir AO, Garwick AW, Svavarsdottir EK. The importance of family support in pediatrics and its impact on healthcare satisfaction. Scand J Caring Sci. (2017) 31:241–52. 10.1111/scs.12336 [DOI] [PubMed] [Google Scholar]
- 37.Brousseau DC, Mukonje T, Brandow AM, Nimmer M, Panepinto JA. Dissatisfaction with hospital care for children with sickle cell disease not due only to race and chronic disease. Pediatr Blood Cancer. (2009) 53:174–8. 10.1002/pbc.22039 [DOI] [PubMed] [Google Scholar]
- 38.Nagarajan N, Rahman S, Boss EF. Are there racial disparities in family-reported experiences of care in inpatient pediatrics? Clin Pediatr (Phila). (2017) 56:619–26. 10.1177/0009922816668497 [DOI] [PubMed] [Google Scholar]
- 39.Boss EF, Thompson RE. Patient experience in outpatient pediatric otolaryngology. Laryngoscope. (2012) 122:2304–10. 10.1002/lary.23364 [DOI] [PubMed] [Google Scholar]
- 40.Krugman SD, Suggs A, Photowala HY, Beck A. Redefining the community pediatric hospitalist: The combined pediatric ED/inpatient unit. Pediatr Emerg Care. (2007) 23:33–7. 10.1097/01.pec.0000248685.94647.01 [DOI] [PubMed] [Google Scholar]
- 41.Allam SD, Mehta M, Ben Khallouq B, Burrows JF, Rosen P. Key drivers of patient experience in ambulatory paediatric cardiology. Cardiol Young. (2017) 27:1585–90. 10.1017/S1047951117000841 [DOI] [PubMed] [Google Scholar]
- 42.Singh SC, Sheth RD, Burrows JF, Rosen P. Factors influencing patient experience in pediatric neurology. Pediatr Neurol. (2016) 60:37–41. 10.1016/j.pediatrneurol.2016.04.002 [DOI] [PubMed] [Google Scholar]
- 43.Ygge BM, Arnetz JE. Quality of paediatric care: Application and validation of an instrument for measuring parent satisfaction with hospital care. Int J Qual Heal Care. (2001) 13:33–43. 10.1093/intqhc/13.1.33 [DOI] [PubMed] [Google Scholar]
- 44.Conner JM, Nelson, EC,. Neonatal Intensive Care: Satisfaction Measured From a Parent's Perspective. (1999) Available online at: http://www.aappublications.org/news (accessed June 30, 2021). [PubMed]
- 45.Uhl T, Fisher K, Docherty SL, Brandon DH. Insights into patient and family-centered care through the hospital experiences of parents. JOGNN - J Obstet Gynecol Neonatal Nurs. (2013) 42:121–31. 10.1111/1552-6909.12001 [DOI] [PubMed] [Google Scholar]
- 46.Furness CL, Smith L, Morris E, Brocklehurst C, Daly S, Hough RE. Cancer patient experience in the teenage young adult population- key issues and trends over time: an analysis of the united kingdom national cancer patient experience surveys 2010-2014. J Adolesc Young Adult Oncol. (2017) 6:450–8. 10.1089/jayao.2016.0058 [DOI] [PubMed] [Google Scholar]
- 47.Patient Reported Experience Measure (PREM) for urgent emergency care | RCPCH . Available online at: https://www.rcpch.ac.uk/resources/patient-reported-experience-measure-prem-urgent-emergency-care (accessed July 1, 2021).
- 48.Viner RM. Do adolescent inpatient wards make a difference? Findings from a national young patient survey. Pediatrics. (2007) 120:749–55. 10.1542/peds.2006-3293 [DOI] [PubMed] [Google Scholar]
- 49.Mah JK, Tough S, Fung T, Douglas-England K, Verhoef M. Adolescent quality of life and satisfaction with care. J Adolesc Heal. (2006) 38:607.e1-607.e7. 10.1016/j.jadohealth.2005.08.004 [DOI] [PubMed] [Google Scholar]
- 50.Patient Experience | Press Ganey . Available online at: https://www.pressganey.com/solutions/patient-experience (accessed June 30, 2021).
- 51.Goldstein E, Farquhar M, Crofton C, Darby C, Garfinkel S. Measuring hospital care from the patients' perspective: An overview of the CAHPS® Hospital Survey development process. Health Serv Res. (2005) 40:1977–95. 10.1111/j.1475-6773.2005.00477.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Berkowitz B. The patient experience and patient satisfaction: Measurement of a complex dynamic. Online J Issues Nurs. (2016) 21:1. 10.3912/OJIN.Vol21No01Man01 [DOI] [PubMed] [Google Scholar]
- 53.Patient experience or patient satisfaction: what should you measure? Available online at: https://www.essenburgh.com/en/blog/patient-experience-or-patient-satisfaction-what-should-you-measure-and-how-will-it-benefit-your-organization (accessed June 18, 2021).
- 54.What Is Patient Experience? | Agency for Healthcare Research and Quality . Available online at: https://www.ahrq.gov/cahps/about-cahps/patient-experience/index.html (accessed november 6, 2021).
- 55.Larson E, Sharma J, Bohren MA, Tunçalp Ö. When the patient is the expert: measuring patient experience and satisfaction with care. Bull World Health Organ. (2019) 97:563–9. 10.2471/BLT.18.225201 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Patient Satisfaction Surveys . Available online at: https://catalyst.nejm.org/doi/full/10.1056/CAT.18.0288 (accessed November 6, 2021).
- 57.11 03 12 02 Patient experience is not patient satisfaction understanding the fundamental differ - YouTube . Available online at: https://www.youtube.com/watch?v=79iZv0GygPs (accessed June 18, 2021).
- 58.Bull C, Byrnes J, Hettiarachchi R, Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. (2019) 54:1023–35. 10.1111/1475-6773.13187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Sizmur S, Graham C, Bos N. Psychometric evaluation of patient-reported experience measures: Is it valid? Int J Qual Heal Care. (2020) 32:219–20. 10.1093/intqhc/mzaa006 [DOI] [PubMed] [Google Scholar]
- 60.Male L, Noble A, Atkinson J, Marson T. Measuring patient experience: A systematic review to evaluate psychometric properties of patient reported experience measures (PREMs) for emergency care service provision. Int J Qual Heal Care. (2017) 29:314–26. 10.1093/intqhc/mzx027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Sonneveld HM, Strating MMH, van Staa AL, Nieboer AP. Gaps in transitional care: What are the perceptions of adolescents, parents and providers? Child Care Health Dev. (2013) 39:69–80. 10.1111/j.1365-2214.2011.01354.x [DOI] [PubMed] [Google Scholar]
- 62.Stiefel M, Nolan K. Measuring the triple aim: A call for action. Popul Health Manag. (2013) 16:219–20. 10.1089/pop.2013.0025 [DOI] [PubMed] [Google Scholar]
- 63.Farmanova E, Kirvan C, Verma J. Triple aim in Canada: Developing capacity to lead to better health, care and cost. Int J Qual Heal Care. (2016) 28:830–7. 10.1093/intqhc/mzw118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Price RA, Elliott MN, Zaslavsky AM, Hays RD, Lehrman WG, Rybowski L, et al. Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev. (2014) 71:522–54. 10.1177/1077558714541480 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Kemp KA, Ahmed S, Quan H, Johnson D, Santana MJ. Family Experiences of pediatric inpatient care in Alberta, Canada: results from the child HCAHPS Survey. Hosp Pediatr. (2018) 8:338–44. 10.1542/hpeds.2017-0191 [DOI] [PubMed] [Google Scholar]
- 66.Hargreaves DS, Sizmur S, Pitchforth J. Children and young people's versus parents' responses in an English national inpatient survey. Arch Dis Child. (2018) 103:486–91. 10.1136/archdischild-2017-313801 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Tilly-Gratton A, Nadon MA, Houle A, Pelaez S, Ducharme FM. What convinces parents of children with asthma to adhere to maintenance inhaled corticosteroids? Can J Respir Crit Care, Sleep Med. (2018) 2:147–54. 10.1080/24745332.2018.1450101 [DOI] [Google Scholar]
- 68.Toomey SL, Elliott MN, Zaslavsky AM, Quinn J, Klein DJ, Wagner S, et al. Improving response rates and representation of hard-to-reach groups in family experience surveys. Acad Pediatr. (2019) 19:446–53. 10.1016/j.acap.2018.07.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.