An official website of the United States government
Here's how you know
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with,
the contents by NLM or the National Institutes of Health.
Learn more:
PMC Disclaimer
|
PMC Copyright Notice
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA
✉
Corresponding author: Allison Lipitz-Snyderman, PhD, Center for Health Policy and Outcomes, Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 485 Lexington Ave, 2nd Floor, New York, NY 10017; email: snyderma@mskcc.org.
Although medical record–based measurement of adverse events (AEs) associated with cancer care is desirable, condition-specific triggers in oncology care are needed. We sought to develop a screening tool to facilitate efficient detection of AEs across settings of cancer care via medical record review. We hope to use this tool to understand the frequency, spectrum, and preventability of AEs with the goal of helping improve the quality and safety of cancer care.
SUMMARY ANSWER:
We developed a cancer-specific screening tool to help identify candidate preventable AEs that occur during cancer care from patients’ medical records. Our oncology screening tool consists of 76 triggers—readily identifiable findings to screen for possible AEs that occur during cancer care (Table 1).
METHODS:
We sought to develop a screening tool to facilitate the detection of AEs across settings of cancer care via medical record review. We obtained structured and unstructured input from clinical experts to develop our tool, using a modified Delphi process.
BIAS, CONFOUNDING FACTOR(S), DRAWBACKS:
Our oncology tool requires further evaluation in order to understand its usefulness for population-based assessments of AEs in oncology and quality improvement.
REAL-LIFE IMPLICATIONS:
Information obtained from structured record reviews using an oncology trigger tool could help to prioritize quality improvement activities, identify high-risk groups, and generate cancer-focused quality measures. Ultimately, the goals of this work are to prevent AEs and allow timely, automated identification of these events so that clinicians can intervene promptly to improve patient outcomes.
Table 1.
Memorial Sloan Kettering Cancer Center Oncology Trigger Tool
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
1Memorial Sloan Kettering Cancer Center; Columbia University Medical Center; AIG, New York, NY; Tufts Medical Center, Boston, MA; Pascal Metrics, Washington, DC; University of Utah School of Medicine, Salt Lake City, UT; and Genentech, San Francisco, CA.
✉
Corresponding author: Allison Lipitz-Snyderman, PhD, Center for Health Policy and Outcomes, Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 485 Lexington Ave, 2nd Floor, New York, NY 10017; email: snyderma@mskcc.org.
Widespread consensus exists about the importance of addressing patient safety issues in oncology, yet our understanding of the frequency, spectrum, and preventability of adverse events (AEs) across cancer care is limited.
Methods:
We developed a screening tool to detect AEs across cancer care settings through medical record review. Members of the study team reviewed the scientific literature and obtained structured input from an external multidisciplinary panel of clinicians by using a modified Delphi process.
Results:
The screening tool comprises 76 triggers—readily identifiable findings to screen for possible AEs that occur during cancer care. Categories of triggers are general care, vital signs, medication related, laboratory tests, other orders, and consultations.
Conclusion:
Although additional testing is required to assess its performance characteristics, this tool may offer an efficient mechanism for identifying possibly preventable AEs in oncology and serve as an instrument for quality improvement.
INTRODUCTION
Widespread consensus exists about the importance of improving patient safety in oncology,1-3 yet our current understanding of the frequency, spectrum, and preventability of adverse events (AEs) across cancer care is limited. This information is essential for improvement. AEs, which refer to unwanted outcomes associated with medical care rather than to the underlying disease or condition of a patient, can be harmful and costly for patients with cancer.4,5 Examples of AEs are hospital-acquired infections, delirium, procedural complications, surgical infections, and falls. In this context, AEs are not limited to serious AEs, which generally refer to adverse drug reactions that occur during clinical trials.
Medical record review has been the primary approach to conducting population-level assessments of AEs in health care.6-9 Given the quantity and complexity of information in patient records, screening tools are used to guide targeted reviews for AEs based on key triggers or easily identifiable flags.10,11 The Institute for Healthcare Improvement developed the Global Trigger Tool (GTT) to measure AEs in the general inpatient setting.10,12 Triggered cases are followed up with focused reviews to assess whether an AE occurred. Reviewers typically assess the likelihood that the AE could have been prevented or whether the harm associated with the AE could have been mitigated. Trigger tools have been developed successfully for population-level assessments in patient safety and quality improvement in several settings.13-16
Much of the work in measuring AEs has focused on general medical, surgical, and pediatric inpatient settings.6-8,17 Because cancer care often is outpatient, these efforts may not capture important AEs. Conversely, the measurement of outpatient AEs alone can miss important AEs associated with surgery and inpatient care.18-22 AEs may have various causes and expected frequencies by group that warrant cohort-specific benchmarking. Many existing quality measures exclude patients with cancer for these reasons.19 Indeed, studies of traditional trigger tools have shown poor performance in oncology populations.23,24 For example, an oncology module of the GTT detects oncology-specific inpatient AEs.25 Two analyses raised concerns about its inability to capture several important AEs in cancer care, particularly those after surgery (complications of anesthesia or abscess), measurement error, and disagreement between reviewers in AE identification.23,26
Although medical record–based measurement of AEs associated with cancer care is desirable, condition-specific triggers in oncology care are needed. We developed a screening tool to facilitate efficient detection of AEs across settings of cancer care through medical record review. Ultimately, we hope to use it to generate population-level estimates of AEs, identify high-risk patients, and improve quality of cancer care.
METHODS
We developed an oncology trigger tool through a multistep process (Figure 1). First, members of the study team compiled an organ system–based list of common AEs or severe AEs relevant to the treatment of patients with breast, colorectal, and lung cancers. The goal was to identify AEs that occur in any inpatient or outpatient setting during the course of cancer care. We initiated this process by identifying a wide range of clinically significant AEs within each organ system on the basis of our clinical knowledge and experience. We then added to and refined the initial list by reviewing AEs reported in clinical trials in patients with breast, colorectal, and lung cancers.27-34 Finally, we consulted outside specialists, including anesthesiologists and hematologists, to capture additional specialty-specific AEs.
From the list of AEs, we generated a set of candidate triggers that might signal the occurrence of the corresponding AE. We included triggers that would be easily identifiable from medical record review and would be generalizable across institutions with different electronic medical records. We used our own clinical experience and reviewed existing triggers from previous tools to generate our list of triggers.
To narrow the list of triggers, we sought input from clinicians on the study team with expertise in medical oncology, surgery, patient safety, quality measurement, and research methods (C.A., A.S.E., S.N.W., A.K., D.C., D.P.). Study team members assigned each trigger a summary score from 1 to 3 based on ease of trigger detection in the medical record, likely frequency of trigger, severity of the associated AEs, and expected specificity of the trigger. As a group, the team members reviewed and discussed the scores that they individually assigned to each trigger. For redundant triggers, they determined the likely best options. From the discussion, they reached consensus on the triggers to be rated and assessed by an external multidisciplinary panel of clinicians. This panel included nine representatives from medical oncology, radiation oncology, surgery, inpatient and outpatient nursing, anesthesiology, general medicine, and emergency medicine. The clinicians had expertise in treating patients with breast, colorectal, and lung cancers.
To obtain input from the external panel in a structured way, we used a modified Delphi process.13,35 For this process, panel members individually rated on a 5-point scale each trigger based on expected frequency, ease of trigger detection, and seriousness of the related AE. The panel also provided open-ended feedback about specific triggers and recommendations for additional triggers. The individual scores for each criterion were averaged and a summary score calculated for each trigger by multiplying the three averaged scores. The study team ranked the triggers by these scores and comments provided by the panel, and proposed whether to include the trigger in the list. The study team returned the proposed list to the panel for additional feedback. The study team reviewed the final comments and determined the triggers that would comprise the oncology trigger tool. The study was considered exempt research by the institutional review board of Memorial Sloan Kettering Cancer Center.
RESULTS
The oncology trigger tool comprises 76 triggers (Table 1). For ease, we categorized triggers as general care (eg, death in hospital), vital signs (eg, blood pressure > 200/100 mmHg), medication related (eg, epinephrine), laboratory tests (eg, Clostridium difficile toxin positivity), other orders (eg, reintubation), and consultations (eg, nephrology).
Table 1.
Memorial Sloan Kettering Cancer Center Oncology Trigger Tool
Abbreviations: BNP, brain natriuretic peptide; CT, computed tomography; ICU, intensive care unit; INR, international normalized ratio; IR, interventional radiology; PACU, postanesthesia care unit; Sao2, arterial oxygen saturation; TSH, thyroid-stimulating hormone.
*
Triggers have been automated in the pilot study at Memorial Sloan Kettering Cancer Center.
We encountered several challenges while developing and refining the set of relevant triggers. The first was to exclude AEs and triggers that result primarily from the disease process rather than from the care delivered. We also eliminated redundant triggers that are likely difficult to identify through record abstraction or that have low sensitivity or specificity for the associated AE. For example, we initially considered the use of patient restraints as a trigger for the AE inpatient delirium but ultimately selected the presence of an order for a sitter and inpatient psychiatric consult because this may be easier to identify. Similarly, we excluded ECG as a trigger for a variety of severe cardiac AEs, including myocardial infarction because it was nonspecific. Instead, we used the presence of elevated troponin levels. We explicitly included triggers for some expected treatment-related toxicities, such as neutropenia and uncontrolled pain because further study may characterize risk factors for these potentially preventable AEs. Finally, we eliminated a small number of AEs because we suspected that they would be rare (eg, air embolism, suicide), could not identify a trigger with sufficient sensitivity and specificity to flag its presence (eg, peripheral neuropathy), or would likely be captured through other methods (eg, retained foreign body during surgery).
DISCUSSION
We created an oncology-specific AE trigger tool based on cancer-specific harm vulnerabilities by using a modified Delphi approach. The tool, which requires further evaluation, includes 76 triggers. In the process of creating the tool, we focused on cancer-specific harms, such as toxicities related to treatment, adverse drug events, diagnostic delays, and miscommunication with patients and among caregivers. This tool may offer a mechanism for identifying candidate preventable AEs in oncology. Some of the GTT triggers are not sufficiently specific for cancer care because laboratory abnormalities and expected toxicities are common. The current tool differs from the GTT in that it incorporates events that occur in ambulatory and inpatient settings, identifies cancer care–specific complications, and includes triggers that do not need a detailed review of the clinical notes. This contribution addresses the paucity of tools available to detect the range of cancer care–related AEs through medical record abstraction and may advance the study of patient safety events in the oncology community.
Our objective was to generate and ultimately validate a comprehensive set of triggers that are objective, reproducible, and identifiable through automated chart abstraction techniques. By following the GTT methodology, we developed an oncology trigger tool to support this goal of improving our understanding of AEs in patients with cancer across the spectrum of care. Information obtained from structured record reviews can help to prioritize quality improvement activities and identify high-risk groups. Information obtained could also lead to cancer-focused quality measures.19 Further evaluation of the performance of the tool will help us to understand its usefulness for population-based assessments of AEs in oncology and quality improvement. Ultimately, the goals of this work are to prevent AEs or allow timely identification of these events so that clinicians can intervene promptly to improve patient outcomes.
Acknowledgment
Supported by the United Hospital Fund and in part by a Cancer Center Support Grant to Memorial Sloan Kettering Cancer Center (P30 CA 008748). Previously presented at the ASCO Quality Care Symposium, Boston, MA, October 14–17, 2014. Pascal Metrics is a federally certified patient safety organization. We thank the expert panel from Memorial Sloan Kettering Cancer Center for providing clinical input.
AUTHOR CONTRIBUTIONS
Conception and design: Allison Lipitz-Snyderman, Saul N. Weingart, Christopher Anderson, Andrew S. Epstein, Aileen Killen, David Classen, Camelia S. Sima, David Pfister
Collection and assembly of data: Allison Lipitz-Snyderman, Saul N. Weingart, Christopher Anderson, Andrew S. Epstein, Aileen Killen, David Classen, Elizabeth Fortier, Coral L. Atoria, David Pfister
Data analysis and interpretation: Allison Lipitz-Snyderman, Saul N. Weingart, Christopher Anderson, Andrew S. Epstein, Aileen Killen, David Classen, Coral L. Atoria, David Pfister
Manuscript writing: All authors
Final approval of manuscript: All authors
AUTHORS' DISCLOSURES OF POTENTIAL CONFLICTS OF INTEREST
Detection of Potentially Avoidable Harm in Oncology From Patient Medical Records
The following represents disclosure information provided by authors of this manuscript. All relationships are considered compensated. Relationships are self-held unless noted. I = Immediate Family Member, Inst = My Institution. Relationships may not relate to the subject matter of this manuscript. For more information about ASCO's conflict of interest policy, please refer to www.asco.org/rwc or jop.ascopubs.org/site/misc/ifc.xhtml.
1.Norton PG, Baker GR. Patient safety in cancer care: A time for action. J Natl Cancer Inst. 2007;99:579–580. doi: 10.1093/jnci/djk161. [DOI] [PubMed] [Google Scholar]
2.Hinkel JM. Report on the NCCN Third Annual Patient Safety Summit. J Natl Compr Canc Netw. 2008;6:528–535, quiz 534-535. doi: 10.6004/jnccn.2008.0041. [DOI] [PubMed] [Google Scholar]
4.Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991;324:370–376. doi: 10.1056/NEJM199102073240604. [DOI] [PubMed] [Google Scholar]
5.Runciman W, Hibbert P, Thomson R, et al. Towards an international classification for patient safety: Key concepts and terms. Int J Qual Health Care. 2009;21:18–26. doi: 10.1093/intqhc/mzn057. [DOI] [PMC free article] [PubMed] [Google Scholar]
6.Landrigan CP, Parry GJ, Bones CB, et al. Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. 2010;363:2124–2134. doi: 10.1056/NEJMsa1004404. [DOI] [PubMed] [Google Scholar]
7.Leape LL, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med. 1991;324:377–384. doi: 10.1056/NEJM199102073240605. [DOI] [PubMed] [Google Scholar]
8.Thomas EJ, Studdert DM, Burstin HR, et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38:261–271. doi: 10.1097/00005650-200003000-00003. [DOI] [PubMed] [Google Scholar]
9.Wang Y, Eldridge N, Metersky ML, et al. National trends in patient safety for four common conditions, 2005-2011. N Engl J Med. 2014;370:341–351. doi: 10.1056/NEJMsa1300991. [DOI] [PMC free article] [PubMed] [Google Scholar]
10.Classen DC, Lloyd RC, Provost L, et al. Development and evaluation of the Institute for Healthcare Improvement Global Trigger Tool. J Patient Saf. 2008;4:169–177. [Google Scholar]
11.Griffin F, Resar R. IHI Global Trigger Tool for Measuring Adverse Events. 2009. (ed 2). IHI Innovation Series White Paper. Cambridge, MA, Institute for Healthcare Improvement.
12.Classen DC, Resar R, Griffin F, et al. “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood) 2011;30:581–589. doi: 10.1377/hlthaff.2011.0190. [DOI] [PubMed] [Google Scholar]
13.Sharek PJ, Horbar JD, Mason W, et al. Adverse events in the neonatal intensive care unit: Development, testing, and findings of an NICU-focused trigger tool to identify harm in North American NICUs. Pediatrics. 2006;118:1332–1340. doi: 10.1542/peds.2006-0565. [DOI] [PubMed] [Google Scholar]
14.de Wet C, Bowie P. The preliminary development and testing of a global trigger tool to detect error and patient harm in primary-care records. Postgrad Med J. 2009;85:176–180. doi: 10.1136/pgmj.2008.075788. [DOI] [PubMed] [Google Scholar]
15.Resar RK, Rozich JD, Simmonds T, et al. A trigger tool to identify adverse events in the intensive care unit. Jt Comm J Qual Patient Saf. 2006;32:585–590. doi: 10.1016/s1553-7250(06)32076-4. [DOI] [PubMed] [Google Scholar]
16.Unbeck M, Lindemalm S, Nydert P, et al. Validation of triggers and development of a pediatric trigger tool to identify adverse events. BMC Health Serv Res. 2014;14:655. doi: 10.1186/s12913-014-0655-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
17.Kaushal R, Bates DW, Landrigan C, et al. Medication errors and adverse drug events in pediatric inpatients. JAMA. 2001;285:2114–2120. doi: 10.1001/jama.285.16.2114. [DOI] [PubMed] [Google Scholar]
18.Gandhi TK, Weingart SN, Borus J, et al. Adverse drug events in ambulatory care. N Engl J Med. 2003;348:1556–1564. doi: 10.1056/NEJMsa020703. [DOI] [PubMed] [Google Scholar]
19.Spinks TE, Walters R, Feeley TW, et al. Improving cancer care through public reporting of meaningful quality measures. Health Aff (Millwood) 2011;30:664–672. doi: 10.1377/hlthaff.2011.0089. [DOI] [PubMed] [Google Scholar]
20.Sukumar S, Roghmann F, Trinh VQ, et al. National trends in hospital-acquired preventable adverse events after major cancer surgery in the USA. BMJ Open. 2013;3:e002843. doi: 10.1136/bmjopen-2013-002843. [DOI] [PMC free article] [PubMed] [Google Scholar]
21.Walsh KE, Dodd KS, Seetharaman K, et al. Medication errors among adults and children with cancer in the outpatient setting. J Clin Oncol. 2009;27:891–896. doi: 10.1200/JCO.2008.18.6072. [DOI] [PubMed] [Google Scholar]
22.Rinke ML, Shore AD, Morlock L, et al. Characteristics of pediatric chemotherapy medication errors in a national error reporting database. Cancer. 2007;110:186–195. doi: 10.1002/cncr.22742. [DOI] [PubMed] [Google Scholar]
23.Mattsson TO, Knudsen JL, Lauritsen J, et al. Assessment of the Global Trigger Tool to measure, monitor and evaluate patient safety in cancer patients: Reliability concerns are raised. BMJ Qual Saf. 2013;22:571–579. doi: 10.1136/bmjqs-2012-001219. [DOI] [PubMed] [Google Scholar]
24.Lipczak H, Knudsen JL, Nissen A. Safety hazards in cancer care: Findings using three different methods. BMJ Qual Saf. 2011;20:1052–1056. doi: 10.1136/bmjqs.2010.050856. [DOI] [PubMed] [Google Scholar]
26.Mattsson TO, Knudsen JL, Brixen K, et al. Does adding an appended oncology module to the Global Trigger Tool increase its value? Int J Qual Health Care. 2014;26:553–560. doi: 10.1093/intqhc/mzu072. [DOI] [PubMed] [Google Scholar]
27.Schmoll HJ, Cunningham D, Sobrero A, et al. Cediranib with mFOLFOX6 versus bevacizumab with mFOLFOX6 as first-line treatment for patients with advanced colorectal cancer: A double-blind, randomized phase III study (HORIZON III) J Clin Oncol. 2012;30:3588–3595. doi: 10.1200/JCO.2012.42.5355. [DOI] [PubMed] [Google Scholar]
28.Allegra CJ, Yothers G, O’Connell MJ, et al. Initial safety report of NSABP C-08: A randomized phase III study of modified FOLFOX6 with or without bevacizumab for the adjuvant treatment of patients with stage II or III colon cancer. J Clin Oncol. 2009;27:3385–3390. doi: 10.1200/JCO.2009.21.9220. [DOI] [PMC free article] [PubMed] [Google Scholar]
29.Hurvitz SA, Dirix L, Kocsis J, et al. Phase II randomized study of trastuzumab emtansine versus trastuzumab plus docetaxel in patients with human epidermal growth factor receptor 2-positive metastatic breast cancer. J Clin Oncol. 2013;31:1157–1163. doi: 10.1200/JCO.2012.44.9694. [DOI] [PubMed] [Google Scholar]
30.Pless M, Stupp R, Ris HB, et al. SAKK Lung Cancer Project Group Induction chemoradiation in stage IIIA/N2 non-small-cell lung cancer: A phase 3 randomised trial. Lancet. 2015;386:1049–1056. doi: 10.1016/S0140-6736(15)60294-X. [DOI] [PubMed] [Google Scholar]
31.Schuchert MJ, Pettiford BL, Pennathur A, et al. Anatomic segmentectomy for stage I non-small-cell lung cancer: Comparison of video-assisted thoracic surgery versus open approach. J Thorac Cardiovasc Surg. 2009;138:1318–1325. e1,. doi: 10.1016/j.jtcvs.2009.08.028. [DOI] [PubMed] [Google Scholar]
32.Vlug MS, Wind J, Hollmann MW, et al. LAFA Study Group Laparoscopy in combination with fast track multimodal management is the best perioperative strategy in patients undergoing colonic surgery: A randomized clinical trial (LAFA-study) Ann Surg. 2011;254:868–875. doi: 10.1097/SLA.0b013e31821fd1ce. [DOI] [PubMed] [Google Scholar]
33.Barton MB, West CN, Liu IL, et al. Complications following bilateral prophylactic mastectomy. J Natl Cancer Inst Monogr. 2005;2005:61–66. doi: 10.1093/jncimonographs/lgi039. [DOI] [PubMed] [Google Scholar]
34.Hoang T, Dahlberg SE, Schiller JH, et al. Randomized phase III study of thoracic radiation in combination with paclitaxel and carboplatin with or without thalidomide in patients with stage III non-small-cell lung cancer: The ECOG 3598 study. J Clin Oncol. 2012;30:616–622. doi: 10.1200/JCO.2011.36.9116. [DOI] [PMC free article] [PubMed] [Google Scholar]
35.Powell C. The Delphi technique: Myths and realities. J Adv Nurs. 2003;41:376–382. doi: 10.1046/j.1365-2648.2003.02537.x. [DOI] [PubMed] [Google Scholar]