Skip to main content
PMC home page
BMC Health Services Research logoLink to BMC Health Services Research
. 2013 Jan 27;13:31. doi: 10.1186/1472-6963-13-31

Developing a patient and family-centred approach for measuring the quality of injury care: a study protocol

Henry T Stelfox 1,2,3,4,7,✉, Jamie M Boyd 3, Sharon E Straus 5, Anna R Gagliardi 6
PMCID: PMC3570378  PMID: 23351430

Abstract

Background

Quality indicators (QI) are used in health care to measure quality of service and performance improvement. Health care professionals and organizations caring for patients with injuries need information regarding the quality of care provided and the outcomes experienced in order to target improvement efforts. However, very little is known about the quality of injury care provided to individual patients and populations and even less about patients’ perspectives on quality of care. The absence of QIs that incorporate patient or family preferences, needs or values has been identified as an important gap in the science and practice of injury quality improvement. The primary objective of this research protocol is to develop and evaluate the first set of patient and family-centred QIs of injury care for critically injured patients

Methods/design

This mixed methods study is comprised of three Sub-Studies. Sub-Study A will utilize focus group methodology to describe the preferences, needs and values of critically injured patients and their family members regarding the quality of health care delivered. Qualitative content analysis of the transcripts will begin after the first completed focus group and will draw on grounded theory using a process of open, axial and selective coding. A panel of stakeholders will be assembled during Sub-Study B to review the themes identified from the focus groups and develop a catalogue of potential patient and family-centred QIs of injury care using the RAND/UCLA Appropriateness Method (RAM). The QIs developed by the stakeholder panel will be pilot tested in Sub-Study C using surveys of patients and their family members to determine construct validity, intra-rater reliability and clinical sensibility.

Discussion

Measuring the quality of injury care is but a first step towards improving patient outcomes. This research will develop the first set of patient and family-centred QIs of injury care. To improve patient care, we need accessible, reliable indicators of quality that are important to patients, and that can then be used to establish quality of care benchmarks, to flag potential problems or successes, follow trends over time and identify disparities across organizations, communities, populations and regions.

Keywords: Injury, Patient-centred care, Quality improvement, Quality indicators, Trauma, Focus group, Consensus panel, Survey

Background

Each year, injuries affect 700 million people worldwide [1,2] with more than five million people dying from injuries annually [3]. The human and societal burden of injuries is even greater with many survivors being permanently impaired and never returning to school, work or their “regular” lives [4,5]. Evaluations of the quality of care in medicine have revealed that medical care often falls short of established standards, and this is also true of injury management. Half of all critically injured patients do not receive recommended care [6-10], medical errors are common in this population [11,12] and preventable injury deaths in hospital are widely reported [13-17].

These studies were based on evaluation of guideline recommendations, but injury management is complex. Performance measures reflecting a range of decisions, processes and outcomes are needed to truly measure care delivery and its impact, and identify whether and how improvements are needed. To address the challenge of providing valid and reliable measurement of injury care quality, we implemented a research program to develop population-based and evidence-based quality indicators (QI) of injury care. A Research Synthesis of existing QIs of injury care in published and unpublished literature [18,19] identified a large heterogeneous group of indicators (n = 1,572 QIs from 192 articles in three languages) supported by a limited evidence base [18-20]. Based on the results of the Synthesis, an International Audit of QI Practices was performed by conducting surveys and interviews of the leaders of 251 accredited North American and Australasian trauma centres. Ninety seven percent of participating centres employ QIs to measure the quality of injury care they deliver. However, this work identified an important gap in the science and practice of injury quality improvement, the absence of QIs that incorporate patient or family preferences, needs or values (n = 0/1,572 QIs identified in Research Synthesis and n = 19/11,460 QIs identified in International Audit of QI Practices).

The Institute of Medicine (IOM) defines quality as “the degree to which health care services for individuals and populations increase the likelihood of desired outcomes and are consistent with current professional knowledge.”[21] Central to this definition is that desired outcomes be consistent with both clinical goals and the patients’ goals. In Crossing the Quality Chasm, the IOM emphasized the importance that care be patient-centred, “respectful of and responsive to individual patient preferences, needs, and values.”[22] At present, patient preferences are best understood for primary care and chronic diseases [23]. Conversely, relatively little is known about the priorities of critically injured patients who epitomize the challenges of providing patient-centred acute care. Surveys of traumatic brain injured patients and their family members have demonstrated that many perceive a significant information deficit from health professionals [24,25]. Janssen et al. [26] demonstrated satisfaction with hospital care of patients with injuries is associated with perceptions of being involved in treatment decisions, being attended to by physicians and trusting physicians. While these are important initial learnings more information is needed.

As healthcare systems seek to provide patient-centred care, questions about how to measure this aspect of quality have become more important since previously developed QIs rarely incorporated patient perspectives [19,27]. A qualitative study done in preparation for this research demonstrated patients of differing age, sex and health status have consistently indicated that patient participation is important so that quality improvement efforts can reflect patient preferences, something that cannot be determined by health providers [28,29]. Patient-centred measures have been successfully developed in select domains of health care. For example, the Consumer Assessment of Health Providers and Systems Survey (CAHPS) has been used to evaluate patient experiences with primary care, and has identified shortfalls in care delivery and support quality improvement [30-32]. A hospital version of CAHPS (HCAHPS) has been developed to measure medical, surgical and obstetrical inpatient experiences with care, is publicly reported in the United States [33] and the results appear to correlate with processes of care for acute myocardial infarction, congestive heart failure, pneumonia and prevention of complications from surgery [34]. No such patient-centred QIs currently exist to evaluate the quality of injury care.

Aim

The primary aim of this study is to develop and evaluate the first set of patient and family-centred quality indicators of injury care for critically injured patients. These indicators will be designed to reflect the emerging health needs of critically injured patients and to support health policy decision making to improve the quality of injury care [35]. We define QIs as performance measures that compare actual care against ideal criteria [22,36]. The QIs will be patient and family-centred, reflecting the preferences, needs and values of patients and their family members [22]. We define critically injured patients as those with injuries from “the physical damage that results when a human body is suddenly subjected to energy in amounts that exceed the threshold of physiological tolerance” [37] resulting in admission to an intensive care unit, a step-down unit or a monitored, high acuity unit. The specific objectives of the proposed study are:

• To determine the preferences, needs and values of recovering critically injured patients and family members from four trauma centres in Canada regarding quality injury care (Sub-Study A) including: the most important dimensions of quality of injury care; how quality of injury care should be measured; how quality should be reported; and how quality should be improved.

• To develop patient and family-centred QIs in injury care using a multi-step development process (Sub-Study B).

• To pilot test the patient and family-centred QIs for construct validity, intra-rater reliability, and clinical sensibility (Sub-Study C).

Methods/design

Approach

This mixed methods study is comprised of three Sub-Studies: A) Patient & Family Focus Groups, B) Multi-Step Quality Indicator Development Process and C) Pilot Test of Quality Indicators. The qualitative components of this research adhere to the RATS guidelines for qualitative research. The full study protocol has been approved by the Conjoint Health Research Ethics Board at the University of Calgary and Sub-Study A of the protocol has also been approved by Research Ethics Boards at the University of British Columbia; Vancouver Coastal Health Authority Research Institute; Interior Health Authority, British Columbia; and St. Michael’s Hospital.

Theoretical framework

This research will examine the quality of care provided to critically injured patients using a theoretical framework of patient and family-centred care (Figure 1) and a conceptual model of QIs of injury care (Table 1). We developed a theoretical framework of patient and family-centred care that is informed by patient, family, provider and contextual factors and derived from the work of Gillespie et al. [38], Mead et al. [39] and Stewart [40]. Based on our previous work [18], we developed a conceptual model of QIs in injury care that merges the Donabedian framework of health care quality (structure, process, outcome) [41-43] with components of a trauma system (prehospital care, hospital care, posthospital care, secondary injury prevention) [44].

Figure 1.

Figure 1

Open in a new tab

Theoretical framework of patient and family-centred care.

Table 1.

Conceptual model of quality indicators of trauma care*†

Phase of care Structure Process Outcome
Prehospital
 protocol for field triage
 time to first medical contact
 death
Hospital
 massive transfusion protocol
 massive transfusion protocol activation
 adverse event
Posthospital
 rehabilitation referral protocol
 evaluation of functional status
 multiple hospital visits
2° Prevention chemical dependence screening protocol chemical dependence screening recurrent injury
Open in a new tab

*Table populated with sample clinical QIs [18,45,46].

†Current proposal focuses on acute care including posthospital transition and initiation of 2° prevention.

Structure is the environment in which health care is provided and includes material and health resources, operational factors, and organizational characteristics of the healthcare facility.

Process is the method by which healthcare is provided and includes the giving and receiving of care by the providers and healthcare system.

Outcome is the consequence of healthcare and includes the health status of patients and communities.

Sub-study A: patient & family focus groups

Design

With little prior research to guide the content and format of patient and family-centred QIs of injury care, qualitative research is needed to develop a comprehensive appreciation of patient and family perspectives. Focus group methodology is an effective technique for exploring attitudes and needs, and the contextual factors that influence those perspectives [47]. The aim of these focus groups is to describe the preferences, needs and values of critically injured patients and their families regarding the quality of health care delivered.

A grounded approach will be used to elicit and understand participant views about the most important dimensions of quality of injury care; how quality of injury care should be measured; how quality should be reported; and how quality should be improved [48]. Rigour will be optimized by sampling from a range of trauma centres featuring varying institutional and patient characteristics that could influence patient experiences, exploring responses inductively for emerging ideas based on a conceptual framework, extending the conceptual framework by thoroughly examining emerging themes including deviant cases, demonstrating responses from an array of respondents by including an anonymous identification code with exemplary quotes, and comparison of independent thematic coding across two individuals [49].

Sampling and recruitment

A convenience sample of consecutive consenting patients and family members will be recruited. The research coordinators (RC) will identify critically injured adult (≥18 yrs) patients admitted to each trauma centre over a 12 month period (n ≈ 125-175 patients/centre). Patients will be eligible if they are admitted to hospital for penetrating or blunt polytrauma injury (i.e. no isolated burns or drownings); during admission were admitted to an intensive care unit, a step-down unit or a monitored, high acuity unit; and have an anticipated length of stay of at least seven days. These criteria are designed to identify patients with major injuries who are likely to experience sufficient exposure to health care to be able to provide commentary on quality of injury care. Family members will be eligible to participate if their family member (patient) meets the aforementioned criteria and the family member visited the hospitalized patient, at least one time during their hospitalization. Patients and family members will be eligible if they speak English. Recovering patients and their family members will be approached by the site RC prior to hospital discharge and asked whether they would be willing to be contacted in the future for potential participation in a forthcoming focus group. Contact information will be collected for potential participants. For patients who die during their hospital stay, families will be mailed a bereavement package four weeks after death that includes an invitation to share their experiences and participate in our study. Each site will conduct a focus group of patients and families of survivors and a second group for families of non-survivors. Focus groups will be conducted until thematic saturation is achieved.

Data collection

Patients and family members that express interest in participating will be contacted by telephone or email and asked whether they would like to participate in a focus group discussion. Patients/family members that consent to participation will be scheduled for a focus group. Verbal consent will be obtained at the time of telephone screening and written informed consent will be obtained prior to the focus groups. It is expected that the RCs will encounter patients recovering from a severe traumatic brain injury who are incapable of understanding our study procedures. Accordingly, a modified version of the consent-capacity assessment tool will be used to evaluate whether patients are able to understand and consent to study procedures [50]. Once five to eight participants agree to attend a focus group, recruitment for that group will end.

The focus groups will be moderated by a trained facilitator (AG). A clinical co-facilitator with extensive experience in the delivery of injury care (HTS) will be present at each group to address any clinical questions or concerns raised during the group. The moderator will follow a semi-structured focus group guide designed to elicit participants’ experiences with care and their perceptions of what constitutes good quality care (see Additional file 1). Each focus group will include an overview to introduce the purpose and agenda, an icebreaker exercise to familiarize the participants with each other, a series of questions which proceed from general to specific, and a summary to highlight and verify key points [47], including patients’/family members’ knowledge, attitudes and values surrounding patient-centred care and outcomes of care. Participants will be asked to complete a brief written questionnaire prior to the start of the focus group that will collect demographic data including age, sex, marital status, mother tongue, ethnicity, religion, postal code (residential location), education, patient injuries and patient functional status (pre-injury, present).

Data analysis

All focus groups interviews will be audio taped, transcribed verbatim, assigned a unique identifier and imported into MAXQDA2 (Verbi Software, Marburg, Germany) a computer program for qualitative data management. Qualitative content analysis of the transcripts will begin after the first completed focus group and will draw on grounded theory using a process of open, axial and selective coding [51,52]. Two investigators (JB, AG) will independently read each transcript and code the raw data, line by line. Axial coding will be done to examine the context, intervening conditions and consequences of core variables. For example, the investigators will identify what contextual factors influence the identification of exemplary cases of high quality injury care [53]. Selective coding is the final stage of analysis in which a ‘story’ of patient and family perceptions of what constitutes quality injury care is built. Written memos will provide a record of the analytic process [51,52].

Sub-study B: multi-step quality indicator development process

Design

We will develop patient and family-centred QIs of injury care using a rigorous deliberative process, involving a panel of national injury stakeholders. The panel will be presented with a list of themes identified in the Patient and Family Focus Groups (Sub-Study A) and a summary of the findings. The themes will be presented in the form of QIs (e.g. provider team should offer to meet with patient and/or family within 24 hours of admission to hospital) [27]. A modified version of the RAND/UCLA Appropriateness Method (RAM), a reproducible and valid nominal group technique used in health services research to gather feedback and information from relevant experts [54-57], will be utilized. The methodology will allow the combination of a highly structured process for rating QIs and an interactive meeting to explore areas of disagreement and review of QI definitions, data elements and codes.

Sampling and recruitment

A national panel of stakeholders involved in the multi-disciplinary care (emergency medical systems, subspecialty hospital care, rehabilitation, secondary injury prevention), organization (organizational leadership & healthcare quality) and advocacy (patient/family advocates) of critically injured patients will be assembled by seeking nominations through the Trauma Association of Canada (http://www.traumacanada.org), Ontario Neurotrauma Foundation (http://www.onf.org), Brain Injury Association of Canada (http://www.biac-aclc.ca) and the Canadian Institute for Health Information (http://www.cihi.ca). Nominated members will be selected to obtain broad expert and geographic representation. This group of stakeholders will also be asked to nominate other stakeholders in related disciplines. After establishing a list of potential candidate members for our panel we will approach them with details of the time requirements and program details. Interested nominees will be invited to participate in panel. A target sample size of 9 panel members is based on the RAM and should allow obtaining broad expertise and geographic representation [57].

Data collection

A survey consisting of a list of all of the potential QIs proposed or identified from themes in the Patient and Family Focus Groups (Sub-Study A) will be developed. Panel members will be mailed a one-page monograph for each QI describing the indicator (definition, specifications for numerator, denominator, etc.), and summarizing the evidence from the Patient and Family Focus Groups (Sub-Study A) in the form of direct quotes from focus group participants with descriptions of discussion in the focus groups. Panellists will be asked to independently rate each QI according to four dimensions derived from the Strategic Framework Board in the United States: [58] 1) targets important improvements in the care of critically injured patients, 2) feasible to implement, 3) easy to use, 4) strength of scientific evidence (using the GRADE criteria) [59]. These dimensions will be ranked on the validated nine -point RAM scale with one representing strong disagreement and nine representing strong agreement [57]. Overall assessment of the QI will be scored on a nine-point scale as unnecessary (1–3), supplementary (4–6) and necessary (7–9) [57]. The median rating will be used to classify each item. Disagreement on the ratings for a QI will be defined as an overall assessment by at least three panellists (one third) in the unnecessary range and at least three ratings in the necessary range [57]. Panellists will be asked to provide written comments, and to suggest additional QIs.

Potential QIs with a median overall assessment score of one to three (unnecessary) will be removed. All other QIs including newly suggested indicators will be retained for the second round questionnaire. A second round questionnaire will be prepared and mailed to all the panellists with a frequency distribution breakdown of scoring for all potential QIs from round one. Panellists will be asked to score the QIs including the newly suggested indicators using the same scales as in round one and comments will be solicited. Once all of the second round questionnaires have been received and scored, they will be collated using the same methods described for round one.

A two-day workshop will be held with the stakeholder panel to review the retained QIs. Each QI will be discussed and independently re-scored using the same scale as in round one. Indicators with a median overall assessment score of seven or greater (necessary) will be retained. All QIs with panel disagreement (previously defined) will be rejected. For each retained QI, based on available evidence (Patient and Family Focus Groups (Sub-Study A)) and their expertise, panellists will be asked to determine content validity, establish clear definitions of all terms and specify modifications [60]. Deliberations will be performed as a group and final agreement on QI specifications will be established using the RAM scales.

Data analysis

Standard definitions and a data dictionary for the QIs retained from round two will be developed before the panel members meet face-to-face [61]. In addition, QIs dependent on trauma registries or administrative data will have coding algorithms developed [62]. Two expert coders experienced in International Statistical Classification of Diseases and Related Health Problems, 10th Revision (ICD-10), coding will independently code the QIs using the ICD-10 computerized ‘code finder’. The two lists of codes for each QI will then be combined. After excluding duplicate codes, a comprehensive list of codes will be developed for each QI. The codes will be described using clinical terms in the ICD-10 manuals. Following the workshop, the coding algorithms for the retained QIs will be jointly revised by the two expert coders to both accommodate the panel’s recommended modifications and ensure consistency with the clinical definitions established.

Sub-study C: pilot test of quality indicators

Design

The findings from the Patient and Family Focus Groups (Sub-Study A) and the Multi-Step Quality Indicator Development Process (Sub-Study B) will inform the specific analyses performed in the Pilot Test of Quality Indicators (Sub-Study C). First, the QIs will be implemented in the form of a telephone survey of patients and family members following hospital discharge at the four trauma centres that participated in the Patient and Family Focus Groups (Sub-Study A). Second, the measurement properties for each QI will be evaluated, including construct validity and reliability. Third, a clinical sensibility assessment of the QIs will be performed [63].

Sampling and recruitment

The same method for identifying and approaching potential participants used in the Patient and Family Focus Groups (Sub-Study A) will be followed to recruit patients and family members for Pilot Test of Quality Indicators (Sub-Study C).

Data collection

The same sequential approach for data collection used in the Patient and Family Focus Groups (Sub-Study A) will be followed. Patients and family members will be contacted by the site RC following hospital discharge (4 weeks for patients discharged home, 12 weeks for patients discharged to rehabilitation or deceased) and offered an opportunity to participate in a four part telephone survey evaluating their recent injury care experience: 1) patient and family-centred QI survey, 2) patient and family satisfaction survey, 3) clinical sensibility survey and 4) demographic and clinical data survey. The RC will contact a randomly selected 25% of participants who completed the survey instruments a second time, one week following initial survey administration and re-administer the patient and family-centred QI survey to evaluate intra-rater reliability.

1) Patient and family-centred quality indicator survey: a survey instrument will be developed to administer the QIs developed in The Multi-Step Quality Indicator Development Process (Sub-Study B). Two versions of the instrument will be developed; one for surviving patients and their family members and a second for family members of non-surviving patients. Except for pronouns (e.g. “his or her injuries” instead of “your injury”), the family member survey (survivors) will be identical to the patient survey. The indicators will be designed to report patient and family observations and will be structured as binary responses. Family members will be instructed to report their own views and not to offer proxy responses on behalf of the patient.

2) Patient and family satisfaction survey: The Patient Satisfaction with Injury Care Survey [64] (43 acute care items and 27 post-acute care items) will be administered to measure patient and family satisfaction with injury care.

3) Clinical sensibility survey: A clinical sensibility assessment will be performed of the QIs based on Feinstein’s criteria by asking patients and family members to rate each QI for clarity, utility, face validity, content validity, redundancy, discriminability (distinguish between patients and family members receiving good care and poor care) and overall level of importance (see Additional file 2) [63]. Patients and families will be invited to provide suggestions on how to make the QIs better and improve the quality of injury care.

4) Demographic and clinical data: The RC will collect basic demographic and clinical data from patients and family members including age, sex, marital status, ethnicity, religion, education, patient injuries and patient functional status (pre-injury, present). The RC will request permission from patients to obtain injury data from the trauma registries.

Data analysis

The goals of the Pilot Test of Quality Indicators (Sub-Study C) is to evaluate the feasibility of implementation, construct validity, reliability and clinical sensibility of the patient and family-centred QIs developed in the Multi-Step Quality Indicator Development Process (Sub-Study B). Global data will be presented on the proportion of patients and families who report receiving care that satisfied each QI along with binomial 95% confidence intervals. Detailed tabulations will be presented by respondent characteristics (e.g. type of injury, whether a patient or family member etc.).

Construct validity will be defined as the extent to which the QIs relate to other measures in a manner consistent with a theoretically-derived hypothesis concerning the domains measured [65]. Validity will be determined using two approaches. First, the agreement between the individual QIs (binary measures) and overall quality of care scores (sum of the QIs) will be examined at the patient level. Second, the agreement between QIs (both individual QIs and overall quality of care scores) and patient and family satisfaction survey ratings (ordinal scale) will be examined. Spearman rank-correlation coefficients and Wilcoxon Rank sum tests will be calculated for agreement between QIs and overall patient and family satisfaction and individual domains of the satisfaction survey. Reporting of health care quality and evaluations of satisfaction with care are not the same, but do measure similar domains of care and provide a means for evaluating construct validity [23,66]. Kappa values will be calculated to evaluate intra-rater reliability for individual QIs while intraclass correlation coefficients will be calculated to evaluate overall quality of care scores. Clinical sensibility measures (six measures) and overall level of importance will be summarized for each QI as medians with interquartile ranges.

A sample size of 72 participants for intra-rater reliability is sufficient to detect a true kappa of 0.85 in a one-sided test for a kappa less than or equal to 0.65 under the null hypothesis with 80% power and a significance level of 0.05 [67]. Therefore, for a re-sampling rate of 25% to assess intra-rater reliability, a total sample size of 360 telephone survey participants is needed (accounting for 20% loss to follow up). A sample of this size will also provide adequate power to detect a true intraclass correlation of 0.85 for a one-sided test for an intraclass correlation less than or equal to 0.65 under the null hypothesis using an F-test with a significance level of 0.05 [68]. Statistical analyses will be performed using SAS version 9.2 (SAS Institute Inc., Cary, NC).

Discussion

Measuring the quality of injury care is but a first step towards improving patient outcomes. The above-described approach to gathering data from patients/families is feasible and likely to succeed. Members of our research team have previously conducted focus groups of decision support tools [69,70] and development of QIs [71,72].

This research is essential because it will develop the first set of patient and family-centred QIs of injury care. Around the world, countries are faced with a quietly growing injury epidemic [2]. Yet remarkably, little is known about the quality of injury care and the impact on outcomes that patients value. To improve patient care, we need accessible, reliable indicators of quality that are important to patients, and that can then be used to establish quality of care benchmarks, to flag potential problems or successes, follow trends over time and identify disparities across organizations, communities, populations and regions. The proposed work builds directly on our existing research program of employing clinical research evidence to measure the quality of injury care by incorporating patient and family preferences, needs and values into the development of an applied health tool that will allow health care providers to develop local quality improvement initiatives, systems managers to identify and correct system wide problems, policy makers to plan for future trauma systems and funding agencies to establish priorities for future injury research.

Abbreviations

CAHPS: Consumer assessment of health providers and systems survey; HCAHPS: Hospital version of consumer assessment of health providers and systems survey; ICD-10: International statistical classification of diseases and related health problems, 10th revision; IOM: Institute of medicine; QI: Quality indicator; RAM: RAND/UCLA appropriateness Method; RC: Research coordinator.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

HTS was involved in the conception of the study and participated in obtaining funding, designing the study and the drafting and editing of the manuscript. JB participated in the design of the study, its coordination and the editing of the manuscript. SS was involved in the conception of the study and participated in obtaining funding, designing the study and editing the manuscript. AG was involved in the conception of the study and participated in obtaining funding, designing the study and editing the manuscript. All authors have read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/13/31/prepub

Supplementary Material

Additional file 1

Draft Focus Group Guide. Description of data: draft of the semi-structure guide for the patient and family focus groups in Sub-Study A.

Click here for file (192.1KB, pdf)
Additional file 2

Draft Clinical Sensibility Instrument. Description of data: draft of survey instrument to measure clinical sensibility in Sub-Study C.

Click here for file (13.1KB, pdf)

Contributor Information

Henry T Stelfox, Email: tstelfox@ucalgary.ca.

Jamie M Boyd, Email: jamboyd@ucalgary.ca.

Sharon E Straus, Email: sharon.straus@utoronto.ca.

Anna R Gagliardi, Email: anna.gagliardi@uhnresearch.ca.

Acknowledgements

The project is supported by a Partnerships for Health System Improvement Grant (PHE#11411) from the Canadian Institutes of Health Research. Dr. Stelfox is supported by a New Investigator Award from the Canadian Institutes of Health Research and a Population Health Investigator Award from Alberta Innovates Health Solutions. Dr. Straus is funded by a Tier 1 Canada Research Chair. Dr. Gagliardi is supported by a New Investigator Award from the Canadian Institutes of Health Research. Funding sources had no role in the design of the protocol and we are unaware of any conflicts of interest. We thank the Site Investigators: Dr. Avery Nathens, Dr. David Evans and Dr. Lynn Gerein. We also thank the research coordinators at the study sub-sites: Jennifer Bridge, Ellen Randall and Rita Clarke.

References

  1. Facts on Injury. http://www.phac-aspc.gc.ca/injury-bles/facts-eng.php.
  2. Murray CJ, Lopez AD. Global health statistics: a compendium of incidence, prevalence and mortality estimates for over 200 conditions. Cambridge: Harvard University Press; 1996. [Google Scholar]
  3. Murray CJ, Lopez AD. Mortality by cause for eight regions of the world: global burden of disease study. Lancet. 1997;349(9061):1269–1276. doi: 10.1016/S0140-6736(96)07493-4. [DOI] [PubMed] [Google Scholar]
  4. Miller TR, Pindus NM, Douglass JB, Rossman SB. Databook on nonfatal injury: incidence, costs and consequences. Washington, DC: Urban Institute Press; 1995. [Google Scholar]
  5. Rice DP, MackKenzie EJ. The cost of injury in the United States. San Francisco: Johns Hopkins University; 1989. (Institute for health and aging, university of california and the injury prevention center). [Google Scholar]
  6. Rhodes M, Sacco W, Smith S, Boorse D. Cost effectiveness of trauma quality assurance audit filters. J trauma. 1990;30(6):724–727. doi: 10.1097/00005373-199006000-00012. [DOI] [PubMed] [Google Scholar]
  7. Nayduch D, Moylan J, Snyder BL, Andrews L, Rutledge R, Cunningham P. American college of surgeons trauma quality indicators: an analysis of outcome in a statewide trauma registry. J trauma. 1994;37(4):565–573. doi: 10.1097/00005373-199410000-00008. discussion 573–565. [DOI] [PubMed] [Google Scholar]
  8. Copes WS, Staz CF, Konvolinka CW, Sacco WJ. American college of surgeons audit filters: associations with patient outcome and resource utilization. J trauma. 1995;38(3):432–438. doi: 10.1097/00005373-199503000-00027. [DOI] [PubMed] [Google Scholar]
  9. Cryer HG, Hiatt JR, Fleming AW, Gruen JP, Sterling J. Continuous use of standard process audit filters has limited value in an established trauma system. J trauma. 1996;41(3):389–394. doi: 10.1097/00005373-199609000-00003. discussion 394–385. [DOI] [PubMed] [Google Scholar]
  10. O’Keefe GE, Jurkovich GJ, Maier RV. Defining excess resource utilization and identifying associated factors for trauma victims. J trauma. 1999;46(3):473–478. doi: 10.1097/00005373-199903000-00023. [DOI] [PubMed] [Google Scholar]
  11. Hoyt DB, Hollingsworth-Fridlund P, Fortlage D, Davis JW, Mackersie RC. An evaluation of provider-related and disease-related morbidity in a level I university trauma service: directions for quality improvement. J trauma. 1992;33(4):586–601. doi: 10.1097/00005373-199210000-00016. [DOI] [PubMed] [Google Scholar]
  12. Davis JW, Hoyt DB, McArdle MS, Mackersie RC, Shackford SR, Eastman AB. The significance of critical care errors in causing preventable death in trauma patients in a trauma system. J trauma. 1991;31(6):813–818. doi: 10.1097/00005373-199106000-00012. discussion 818–819. [DOI] [PubMed] [Google Scholar]
  13. Trunkey DD, Lewis FR. In: Current therapy of trauma. 3. Trunkey DD, Lewis FR, editor. Philadelphia: BC Decker; 1991. Preventable Mortality; pp. 3–4. [Google Scholar]
  14. Mendeloff JM, Cayten CG. Trauma systems and public policy. Annual rev publ health. 1991;12:401–424. doi: 10.1146/annurev.pu.12.050191.002153. [DOI] [PubMed] [Google Scholar]
  15. West JG, Trunkey DD, Lim RC. Systems of trauma care. A study of two counties. Arch Surg. 1979;114(4):455–460. doi: 10.1001/archsurg.1979.01370280109016. [DOI] [PubMed] [Google Scholar]
  16. MacKenzie EJ, Steinwachs DM, Bone LR, Floccare DJ, Ramzy AI. Inter-rater reliability of preventable death judgments. The preventable death study group. J trauma. 1992;33(2):292–302. doi: 10.1097/00005373-199208000-00021. discussion 302–293. [DOI] [PubMed] [Google Scholar]
  17. Shackford SR, Hollingsworth-Fridlund P, McArdle M, Eastman AB. Assuring quality in a trauma system–the medical audit committee: composition, cost, and results. J trauma. 1987;27(8):866–875. doi: 10.1097/00005373-198708000-00004. [DOI] [PubMed] [Google Scholar]
  18. Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE. Quality indicators for evaluating trauma care: a scoping review. Arch Surg. 2010;145(3):286–295. doi: 10.1001/archsurg.2009.289. [DOI] [PubMed] [Google Scholar]
  19. Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE. A systematic review of quality indicators for evaluating pediatric trauma care. Crit Care Med. 2010;38(4):1187–1196. doi: 10.1097/CCM.0b013e3181d455fe. [DOI] [PubMed] [Google Scholar]
  20. Stelfox HT, Straus SE, Nathens A, Bobranska-Artiuch B. Evidence for quality indicators to evaluate adult trauma care: a systematic review. Crit Care Med. 2011;39(4):846–859. doi: 10.1097/CCM.0b013e31820a859a. [DOI] [PubMed] [Google Scholar]
  21. Institute of Medicine Committee on the Quality of Health Care in America. Medicare: A strategy for quality assurance. Washington, DC: National Academy Press; 1990. [Google Scholar]
  22. Institute of Medicine Committee on the Quality of Health Care in America. Crossing the quality chasm: a New health system for the 21st century. Washington DC: National Academy Press; 2001. [Google Scholar]
  23. Elwyn G, Buetow S, Hibbard J, Wensing M. Measuring quality through performance. Respecting the subjective: quality measurement from the patient’s perspective. BMJ. 2007;335(7628):1021–1022. doi: 10.1136/bmj.39339.490301.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. McMordie WR, Rogers KF, Barker SL. Consumer satisfaction with services provided to head-injured patients and their families. Brain Inj. 1991;5(1):43–51. doi: 10.3109/02699059108998510. [DOI] [PubMed] [Google Scholar]
  25. Thomsen IV. The patient with severe head injury and his family. A follow-up study of 50 patients. Scand J Rehabil Med. 1974;6(4):180–183. [PubMed] [Google Scholar]
  26. Janssen C, Ommen O, Neugebauer E, Lefering R, Pfaff H. How to improve satisfaction with hospital stay of severely injured patients. Langenbecks Arch Surg. 2007;392(6):747–760. doi: 10.1007/s00423-007-0186-1. [DOI] [PubMed] [Google Scholar]
  27. Bokhour BG, Pugh MJ, Rao JK, Avetisyan R, Berlowitz DR, Kazis LE. Improving methods for measuring quality of care: a patient-centered approach in chronic disease. Med Care Res Rev. 2009;66(2):147–166. doi: 10.1177/1077558708327174. [DOI] [PubMed] [Google Scholar]
  28. Gagliardi AR, Lemieux-Charles L, Brown AD, Sullivan T, Goel V. Barriers to patient involvement in health service planning and evaluation: an exploratory study. Patient Educ Couns. 2008;70(2):234–241. doi: 10.1016/j.pec.2007.09.009. [DOI] [PubMed] [Google Scholar]
  29. Gagliardi A, Lemieux-Charles L, Brown A, Sullivan T, Goel V. Stakeholder preferences for cancer care performance indicators. Int J Health Care Qual Assur. 2008;21(2):175–189. doi: 10.1108/09526860810859030. [DOI] [PubMed] [Google Scholar]
  30. Davies E, Shaller D, Edgman-Levitan S, Safran DG, Oftedahl G, Sakowski J, Cleary PD. Evaluating the use of a modified CAHPS survey to support improvements in patient-centred care: lessons from a quality improvement collaborative. Health Expect. 2008;11(2):160–176. doi: 10.1111/j.1369-7625.2007.00483.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Cleary PD, Edgman-Levitan S. Health care quality. Incorporating consumer perspectives. JAMA. 1997;278(19):1608–1612. doi: 10.1001/jama.1997.03550190072047. [DOI] [PubMed] [Google Scholar]
  32. Crofton C, Lubalin JS, Darby C. Consumer assessment of health plans study (CAHPS). foreword. Medical care. 1999;37(3 Suppl):MS1–MS9. doi: 10.1097/00005650-199903001-00001. [DOI] [PubMed] [Google Scholar]
  33. Giordano LA, Elliott MN, Goldstein E, Lehrman WG, Spencer PA. Development, implementation, and public reporting of the HCAHPS survey. Med Care Res Rev. pp. 27–37. [DOI] [PubMed]
  34. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients’ perception of hospital care in the United States. N Engl J Med. 2008;359(18):1921–1931. doi: 10.1056/NEJMsa0804116. [DOI] [PubMed] [Google Scholar]
  35. Canadian Institutes of Health Research Act. S.C. 2000, c.6 (April 13, 2000)
  36. Berg K, Fries B, Jones R, Mattke S, Moore T, Mor V, Morris J, Murphy K, Nonemaker S. Identification and evaluation of existing quality indicators that are appropriate for use in long-term care settings. Baltimore, MD: Centers for medicare and medicaid services; 2001. [Google Scholar]
  37. International statistical classification of diseases and related health problems, tenth revision (ICD-10) Geneva; 1992. [PubMed] [Google Scholar]
  38. Gillespie R, Florin D, Gillam S. How is patient-centred care understood by the clinical, managerial and lay stakeholders responsible for promoting this agenda? Health Expect. 2004;7(2):142–148. doi: 10.1111/j.1369-7625.2004.00264.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Mead N, Bower P. Patient-centredness: a conceptual framework and review of the empirical literature. Soc Sci Med. 2000;51(7):1087–1110. doi: 10.1016/S0277-9536(00)00098-8. [DOI] [PubMed] [Google Scholar]
  40. Stewart M. Towards a global definition of patient centred care. BMJ. 2001;322(7284):444–445. doi: 10.1136/bmj.322.7284.444. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor, Michigan: Health Administration Press; 1980. [Google Scholar]
  42. Donabedian A. The quality of care. How can it be assessed? Jama. 1988;260(12):1743–1748. doi: 10.1001/jama.1988.03410120089033. [DOI] [PubMed] [Google Scholar]
  43. Donabedian A. Evaluating the quality of medical care. Milbank Q. 2005;83(4):691–729. doi: 10.1111/j.1468-0009.2005.00397.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Hoyt DB, Coimbra R. Trauma systems. Surg Clin North Am. 2007;87(1):21–35. doi: 10.1016/j.suc.2006.09.012. v-vi. [DOI] [PubMed] [Google Scholar]
  45. Santana MJ, Stelfox HT. Quality indicators used by trauma centers for performance measurement. J Trauma Acute Care Surg. 2012;72(5):1298–1302. doi: 10.1097/TA.0b013e318246584c. [DOI] [PubMed] [Google Scholar]
  46. Santana MJ, Stelfox HT. Development and evaluation of evidence-informed quality indicators for adult injury care. Ann Surg. in press. [DOI] [PubMed]
  47. Kitzinger J. Qualitative research. Introducing focus groups. BMJ. 1995;311(7000):299–302. doi: 10.1136/bmj.311.7000.299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Strauss A, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. Newbury Park, CA: Sage; 1990. [Google Scholar]
  49. Barbour RS. Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? BMJ. 2011;322:1115–1117. doi: 10.1136/bmj.322.7294.1115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Etchells E, Darzins P, Silberfeld M, Singer PA, McKenny J, Naglie G, Katz M, Guyatt GH, Molloy DW, Strang D. Assessment of patient capacity to consent to treatment. J Gen Intern Med. 1999;14(1):27–34. doi: 10.1046/j.1525-1497.1999.00277.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Qualitative research in health care. 2. London: BMJ Books; 1999. [Google Scholar]
  52. Strauss AL. Qualitative analysis for social scientists. Cambridge: Cambridge University Press; 2003. [Google Scholar]
  53. Strauss A, Corbin J. Basics of qualitative research: techniques and procedures for developing grounded theory. 2. CA: USA: Sage Publication; 1998. (Thousand oaks). [Google Scholar]
  54. McGory ML, Shekelle PG, Ko CY. Development of quality indicators for patients undergoing colorectal cancer surgery. J Nat Cancer Institute. 2006;98(22):1623–1633. doi: 10.1093/jnci/djj438. [DOI] [PubMed] [Google Scholar]
  55. Kennedy J, Quan H, Ghali WA, Feasby TE. Variations in rates of appropriate and inappropriate carotid endarterectomy for stroke prevention in 4 Canadian provinces. Cmaj. 2004;171(5):455–459. doi: 10.1503/cmaj.1040170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Shekelle PG, Kahan JP, Bernstein SJ, Leape LL, Kamberg CJ, Park RE. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med. 1998;338(26):1888–1895. doi: 10.1056/NEJM199806253382607. [DOI] [PubMed] [Google Scholar]
  57. Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, van het Loo M, McDonnell J, Vader JP, Kahan JP. The RAND/UCLA appropriateness method user’s manual. Santa Monica: RAND; 2001. [Google Scholar]
  58. McGlynn EA. Selecting common measures of quality and system performance. Med care. 2003;41(1 Suppl):I39–I47. doi: 10.1097/00005650-200301001-00005. [DOI] [PubMed] [Google Scholar]
  59. Fan E, Laupacis A, Pronovost PJ, Guyatt GH, Needham DM. How to use an article about quality improvement. JAMA. 2010;304(20):2279–2287. doi: 10.1001/jama.2010.1692. [DOI] [PubMed] [Google Scholar]
  60. McDowell I. Measuring health: a guide to rating scales and questionnaires. third. Oxford: Oxford University Press; 2006. [Google Scholar]
  61. Guidelines for developing a data dictionary. J AHIMA. 2006;77(2):64A–64D. [PubMed] [Google Scholar]
  62. Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43(11):1130–1139. doi: 10.1097/01.mlr.0000182534.19832.83. [DOI] [PubMed] [Google Scholar]
  63. Feinstein AR. The theory and evaluation of sensibility. New Haven: Yale University Press; 1987. pp. 141–166. (Clinimetrics). [Google Scholar]
  64. Bobrovitz N, Santana MJ, Ball CG, Kortbeek J, Stelfox HT. The development and testing of a survey to measure patient and family experiences with injury care. j trauma acute care surg. 2012;73(5):1332–1339. doi: 10.1097/TA.0b013e31825c4d57. [DOI] [PubMed] [Google Scholar]
  65. Feinstein AR. The evaluation of validity. New Haven: Yale University Press; 1987. pp. 190–211. (Clinimetrics). [Google Scholar]
  66. Wensing M, Elwyn G. Methods for incorporating patients’ views in health care. BMJ. 2003;326(7394):877–879. doi: 10.1136/bmj.326.7394.877. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Cantor AB. Sample-size calculations for cohen’s kappa. Psycho Methods. 1996;1(2):150–153. [Google Scholar]
  68. Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101–110. doi: 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E. [DOI] [PubMed] [Google Scholar]
  69. Kastner M, Li J, Lottridge D, Marquez C, Newton D, Straus SE. Development of a prototype clinical decision support tool for osteoporosis disease management: a qualitative study of focus groups. BMC Med Inform Decis Mak. 2010;10:40. doi: 10.1186/1472-6947-10-40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Shah BR, Bhattacharyya O, Yu C, Mamdani M, Parsons JA, Straus SE, Zwarenstein M. Evaluation of a toolkit to improve cardiovascular disease screening and treatment for people with type 2 diabetes: protocol for a cluster-randomized pragmatic trial. Trials. 2010;11:44. doi: 10.1186/1745-6215-11-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Gagliardi AR, Fleshner N, Langer B, Stern H, Brown AD. Development of prostate cancer quality indicators: a modified Delphi approach. Can J Urol. 2005;12(5):2808–2815. [PubMed] [Google Scholar]
  72. Gagliardi AR, Fung MF, Langer B, Stern H, Brown AD. Development of ovarian cancer surgery quality indicators using a modified Delphi approach. Gynecol Oncol. 2005;97(2):446–456. doi: 10.1016/j.ygyno.2004.12.059. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1

Draft Focus Group Guide. Description of data: draft of the semi-structure guide for the patient and family focus groups in Sub-Study A.

Click here for file (192.1KB, pdf)
Additional file 2

Draft Clinical Sensibility Instrument. Description of data: draft of survey instrument to measure clinical sensibility in Sub-Study C.

Click here for file (13.1KB, pdf)

Articles from BMC Health Services Research are provided here courtesy of BMC

RESOURCES