Abstract
Objective To develop standardized definitions for a list of indicators that represent significant events during pediatric transport, which were previously identified by a national Delphi study.
Methods We designed a three-phase consensus process that applied Delphi methodology to a combination of electronic questionnaires and a live consensus meeting.
Results Thirty-one pediatric transport experts evaluated a total of 59 indicators. Twenty-four indicators represented events or interventions that did not require definition. One indicator was removed from the list. Definitions for the remaining 34 indicators were developed.
Conclusion This standardized indicator list is intended for application to quality improvement and clinical research initiatives.
Keywords: transportation of patients, outcome assessment (health care), intensive care units, pediatrics
Introduction
The transport of critically ill children from initial stabilizing hospitals to specialized pediatric facilities for ongoing medical and surgical management is a high-risk procedure. Transport distances can be extensive and may require transition between various modes of transportation. With exposure to environmental hazards, in combination with the potential for worsening of the underlying disease state, these children are at risk of experiencing adverse events (AE). 1 2 In addition, this risk of AE increases due to the unique challenges of providing patient care during transport, including awkward physical access to the patient, difficulties with physiologic monitoring, and limited resources.
AE rates in the literature vary widely, from 1.5 to 91% of pediatric transports. 1 2 3 4 5 6 7 While some of the disparity in AE rates is due to differences in the structure and degree of pediatric specialization of transport teams, it is likely that the variation in the choice and definition of AE between studies also contributes. Discrepant definitions of AE create challenges for the design of quality improvement and research initiatives in pediatric transport medicine, and indeed make it difficult for individual teams to benchmark and assess their own performance. Adoption of a well-defined, standardized list of indicators will enhance the consistency of event reporting and enable comparisons between different transport services. To facilitate this, we previously used Delphi methodology to identify an inclusive list of indicators relevant to pediatric transport medicine and represent significant events if they occur while the transport team is in direct contact with a patient during patient retrieval. 8 This paper reports on the second stage of the consensus process whereby we used a systematic, consensus-based methodology to establish definitions for each of these indicators.
Materials and Methods
Study Design
We conducted a Delphi-questionnaire process and consensus meeting to review and establish definitions for the indicators identified by the initial study. 8 In the absence of a standardized methodology, our protocol was developed after a literature review of consensus meetings that applied a Delphi methodology 9 10 11 12 13 14 15 16 17 18 19 and consultation with local researchers who had experience with the design and coordination of consensus meetings. 20 21 Approval for this consensus process was obtained from the Institutional Review Board at the Children's Hospital of Eastern Ontario.
Participant Selection
We sought a panel of physician and nonphysician health care providers with expertise in neonatal and pediatric transport medicine and with representation from different regions and transport services from across the country. Panelists were obtained from two sources: (1) participants from the initial Delphi study, 8 and (2) other health care providers and stakeholders who became aware of the program of research after the completion of the initial study. The process by which the initial Delphi panel was selected has been previously described. 8 Briefly, panelists were identified through contact with the medical directors of the 16 pediatric intensive care units in Canada, as well as senior members of two independent transport organizations. The latter two organizations are respectively responsible for (1) patient transport in the most populated Canadian province, Ontario, and include service to 4 pediatric intensive care units, and (2) transport of children from a large region of one of Canada's arctic territories, Nunavut. All participation was voluntary.
The panel included experts from transport teams that provide care for patients aged from birth to 18 years across a broad range of transport environments. A variety of patient volumes and acuity, geographies (including mountainous, costal, forested, and arctic desert), distances (up to thousands of miles), population densities, modes of transport (including land, helicopter, plane, and boat), and team structures (provider type, level of pediatric specialization, and physician presence on transport) were represented.
Consensus Process
Preliminary definitions for indicators were developed from two sources: (1) suggestions from participants in the initial study, 8 and (2) from recognized sources that were modified when necessary to suit the transport population/environments. 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 The consensus process had three phases: a premeeting electronic questionnaire, a consensus meeting, and a postmeeting electronic-based Delphi process. In the premeeting questionnaire, participants first indicated whether an indicator required a definition. Where a definition was required, they indicated which definition they preferred, any they would consider acceptable, and had the opportunity to propose an alternate definition. Responses were collated and anonymized and presented at a consensus meeting hosted in Toronto, Ontario, Canada, May 2, 2013. The definition with the highest rate of preference was reviewed for modification through a two-iteration process of discussion and voting. Definitions without 100% consensus were moved to the phase 3 postmeeting process, wherein a refined literature search and expert deliberation generated a modified definition that was then evaluated by the full expert panel using Delphi methodology, as previously described. 8 Data for the post meeting Delphi were collected and managed using REDCap electronic data capture tools hosted at the CHEO Research Institute. 42 The minimum level of agreement was set at 80% for the postmeeting process. Given the multiple consensus-building techniques that we applied to this study, including a face-to-face meeting, and that this definition-building process was separate from initial indicator selection, we refer to this study as a consensus process rather than a Delphi study. Principles of Delphi methodology were applied where possible, including using multiple iterations to establish consensus, a priori defined consensus, and preserving anonymity in the pre- and postmeeting phases.
Statistical Analysis
Microsoft Office Excel 2007 software (Microsoft Canada Inc., Mississauga, Ontario, Canada) was used to tabulate survey responses in the pre- and postmeeting processes and perform descriptive statistical analyses.
Results
A total of 29 experts from 10 institutions participated in one or more stages of the definition consensus process, 18 of whom (from 8 institutions) joined the consensus meeting. Table 1 displays the demographic characteristics of the expert panel. Of note, the panel included physicians (pediatric intensivists, pediatric emergency physicians, and neonatologists) as well as nonphysician health care providers (including, nurses, nurse practitioners, paramedics, and respiratory therapists). Our panel included some participants with < 5 years of experience but who had relevant methodologic expertise, experience working specifically with transport metrics, and/or ensured regional representation.
Table 1. Consensus study expert panel profession and experience.
Characteristics | No. (%) |
---|---|
Health care profession | 29 |
Physician | 18 |
Neonatologist | 4 (22) |
Pediatric emergency physician | 3 (17) |
Pediatric intensivist a | 11 (61) |
Nonphysician health care provider | 13 |
Registered nurse b | 6 (46) |
Nurse practitioner | 2 (11) |
Registered respiratory therapist | 2 (11) |
Critical care paramedic | 3 (23) |
Experience (y) | |
< 5 | 5 (17) |
5–10 | 5 (17) |
10–15 | 7 (24) |
> 15 | 12 (41) |
Patient population of transport c | |
Neonatal | 21 (72) |
Pediatric | 26 (90) |
Adult | 2 (7) |
Role in pediatric transport medicine c | |
Administrative/supervisor | 6 (21) |
Telephone advice/consultation | 20 (69) |
Bedside patient care d | 22 (76) |
One pediatric intensivist is also an emergency physician.
One nurse practitioner and one registered nurse are certified paramedics.
Percentages may add up to > 100% as survey participants could indicate more than one category.
Bedside patient care includes care at the peripheral hospital and/or during transport between facilities.
Of the 52 indicators that were identified during our original Delphi process, 8 the panel subdivided 2 indicators for clarity and identified the need for separate neonatal and pediatric definitions for 5 indicators, resulting in the discussion of 59 definitions ( Table 2 ). Overall, 24 indicators did not require further definition as they represented clear clinical events (e.g., seizure, death) or interventions (vagal stimulation, endotracheal intubation). One indicator (cyanosis) was removed as it was felt to be redundant when the indicators apnea, respiratory arrest, and respiratory deterioration were all included.
Table 2. Final agreed indicator definitions.
Indicator | Definition | Stage at which agreement reached |
---|---|---|
Physiologic deterioration | ||
Respiratory failure, as indicated by | ||
Apnea | Cessation of respiratory airflow for ≥ 20 s; or shorter if associated with cyanosis, marked pallor, hypotonia or bradycardia | Consensus meeting (unmodified from premeeting questionnaire) |
Disordered breathing | Pattern of breathing, including periods of apnea and hypopnea, which does not allow for adequate oxygenation or ventilation | Consensus meeting (unmodified from premeeting questionnaire) |
Hypercapnia | CO 2 > 55 mm Hg (end tidal, arterial, venous, transcutaneous, capillary) 27 | Consensus meeting |
Provided Asherman chest seal or chest tube placement | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided bag-mask ventilation | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided endotracheal intubation | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided laryngeal mask insertion | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided needle or surgical cricothyroidotomy | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided needle thoracostomy | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided noninvasive ventilatory support | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Pulmonary aspiration | Observed event of aspiration of foreign substance (e.g., vomitus) with associated change in oxygenation needs or respiratory status | Consensus meeting (unmodified from premeeting questionnaire) |
Respiratory arrest | No definition required | Premeeting questionnaire |
Respiratory deterioration | Defined by at least one of the following: • Increased work of breathing • Increased oxygen requirements • Increased carbon dioxide retention • Increased ventilator parameters from baseline |
Neonatal definition
: Consensus meeting (modified from premeeting questionnaire despite 100% acceptance in this stage)
Pediatric definition : Consensus meeting |
Cardiac instability, as indicated by | ||
Cardiac arrest | No definition required | Consensus meeting |
Cardiac bradycardia |
Mean heart rate < 10th percentile.
11
By age:
• 0 d to 2 y: < 100 beats/min • > 2 y old: < 60 beats/min |
Consensus meeting |
Cardiac tachycardia |
A mean heart rate that is > 2 SD (standard deviation) above age-defined norms.
11
By age:
• 0 d to 1 y: > 180 beats/min • 2–5 y: > 140 beats/min • 6–12 y: > 130 beats/min • 13–18 y: > 110 beats/min |
Consensus meeting |
Death during transport | No definition required | Premeeting questionnaire |
Hypothermia |
Neonates
: Core body temperature
12
:
• Mild: 36–36.4°C • Moderate: 32–35.9°C • Severe: < 32°C Pediatric : Body temperature < 36°C, excluding therapeutic hypothermia 11 |
Neonatal definition
:
Consensus meeting (unmodified from premeeting questionnaire) Pediatric definition : Consensus meeting |
Initiation or escalation of vasoactive/inotropic medication | Increased requirement for vasoactive/inotropic support, indicated by introduction of new inotropic/vasoactive medication or increase in dose administered | Consensus meeting (unmodified from premeeting questionnaire) |
Provided cardiopulmonary resuscitation or chest compressions | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided cardioversion or defibrillation | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided transcutaneous pacing | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Provided vagal stimulation | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Systemic hypotension |
Neonates
a
:
Mean arterial pressure (MAP) less than gestational age Pediatric a : Systolic blood pressure < 5th percentile for age-defined norms. 13 By age 11 : • 1 mo to 1 y: < 70 mm Hg • 1–10 y: < 70 mm Hg + 2 × age • > 10 y: < 90 mm Hg or Mean blood pressure < 5th percentile for males at the 95th percentile for height, by age (selecting the highest MAP available) 14 : • 1 mo to 1 y: < 40 mm Hg • 1–5 y: < 50 mm Hg • 5–10 y: < 60 mm Hg • > 10 y: < 65 mm Hg |
Pediatric definition of hypotension by systolic blood pressure and neonatal definitions were accepted at the consensus meeting. Pediatric definition of hypotension by mean blood pressure was accepted during postmeeting Delphi after one iteration (92% agreement) |
Neurologic deterioration, as indicated by | ||
Acute loss of spinal cord function | Flaccidity, areflexia, and loss of sensation of extremities below level of presumed injury | Consensus meeting (unmodified from premeeting questionnaire) |
Change in mental status | An acute change in mental status with a decrease in the Glasgow coma score (GCS) of ≥ 3 points from abnormal baseline, with neurologic dysfunction defined as GCS ≤ 11 11 | Consensus meeting |
Change in pupillary response | A deviation from patient's baseline pupillary response, including • Pupils become slow to respond • Pupils are no longer equal in size or response to light • Pupils are fixed and dilated |
Consensus meeting (unmodified from premeeting questionnaire) |
Clinical seizure | No definition required | Premeeting questionnaire |
Loss of brainstem reflexes | No definition required | Consensus meeting |
Significant increase in urine output | Urine output ≥4 mL/kg/h not related to medications | Consensus meeting |
Signs of increased intracranial pressure | Decrease from baseline in level of consciousness, and two of the following: • Hypertension • Bradycardia • Pupillary changes (As defined above) • Respiratory pattern changes on a nonventilated patient |
Consensus meeting |
Renal and electrolyte abnormalities, as indicated by | ||
Absolute or relative hyponatremia | Serum sodium < 135 mmol/L or a decrease of > 5 mmol/L 15 16 17 | Consensus meeting |
Provided administration of dextrose or glucagon | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Hyperkalemia |
Neonates: Serum potassium > 6.0 mmol/L
20
Pediatric: Serum potassium > 5.5 mmol/L 15 18 19 20 |
Consensus meeting |
Hypoglycemia | Serum glucose < 3 mmol/L 21 22 23 24 25 26 |
Neonatal definition
: Consensus meeting (modified from premeeting questionnaire despite 100% acceptance in this stage)
Pediatric definition : Consensus meeting |
Equipment failure and other urgent interventions | ||
Accidental extubation | No definition required | Premeeting questionnaire |
Equipment or vehicle failure | No definition required | Consensus meeting: Description modified from “equipment failure (e.g., IV pump failure, ventilator failure)” |
Failure to provide oxygenation from exhaustion of supply or unintentional disconnection | No definition required | Premeeting questionnaire |
Intravenous (IV) extravasation of caustic medication | No definition required | Premeeting questionnaire |
Loss of peripheral IV access | No definition required | Premeeting questionnaire |
Need for intraosseous needle insertion | No definition required | Premeeting questionnaire |
Obstructed endotracheal tube | Inability to provide airflow through the endotracheal tube due to intra- or extraluminal obstruction | Consensus meeting |
Provided removal of foreign object from airway | No definition required | Premeeting questionnaire: The prefix “Received” was changed to “Provided” during meeting discussion |
Specific medication/intervention triggers for acute patient deterioration | Administration of medications for resuscitation (epinephrine, atropine, sodium bicarbonate, amiodarone, adenosine, lidocaine), any fluid bolus administration > 60 mL/kg, hypertonic saline or mannitol bolus, inhaled nitric oxide, prostaglandins, flumazenil, naloxone, or blood products | Consensus meeting (modified from premeeting questionnaire despite 100% acceptance in this stage) |
Process errors and transport team safety issue | ||
Communication error | Error that occurs due to failure to accurately receive or transmit information between two parties 28 | Consensus meeting (unmodified from premeeting questionnaire) |
Inability to properly and safely access and secure patient during transport | Inadequate infrastructure in transport vehicle to secure patient according to governmental safety standards, and inability for transport crew to adequately access the patient for an emergent reason without compromising the safety of themselves or the patient | Consensus meeting (unmodified from premeeting questionnaire) |
Lack of appropriate equipment or supplies in patient transport environment | Inability to provide appropriate level of care to patient due to transport environment | Consensus meeting (modified from premeeting questionnaire despite 100% acceptance in this stage) |
Lack of neck immobilization in a patient for whom a neck injury cannot be excluded | Cervical spine precautions for the following patients: high-speed motor vehicle collision (> 100 km/h), rollover, ejection; axial load to head; fall from > 3 ft/5 stairs; bicycle crash; paresthesias in extremities or focal neurologic deficits; cervical spine tenderness; distracting injury or decreased loss of consciousness where suspicious mechanism of injury cannot be excluded | Consensus meeting (unmodified from premeeting questionnaire) |
Medication error |
a) A deviation from the weight-appropriate dose (ordered or given) by > 20%, or drug-related serious adverse event (SAE, defined by Health Canada
a
)
or
b) May include any of the following: incorrect drug; documented allergy to medication; incorrect IV rate; incorrect time for medication; incorrect patient; incorrect method of administration; medication omission a Health Canada definition of SAE: A serious adverse event (experience) or reaction is any untoward medical occurrence that at any dose: results in death; is life-threatening b ; requires inpatient hospitalization or prolongation of existing hospitalization; results in significant disability/incapacity; or is a congenital anomaly/birth defect b Note: The term “life-threatening” in the definition of “serious” refers to an event in which the patient was at risk of death at the time of the event; it does not refer to an event that hypothetically might have caused death if it were more severe 29 |
Consensus meeting |
Delays in transport (e.g., weather-related, access to flight/land crews) |
Delay in the urgent transport of a pediatric patient from a sending to receiving facility at any point during transport, including a delay in 1 or more of the of the following
30
:
A) Dispatch time : time from receipt of transport call to transport team dispatch in excess of 15 min B) Mobilization time : time from transport team dispatch to departure from home hospital/base in excess of: For land transport: i) > 15 min for transport teams with dedicated staffing (24 h/d, 7 d/wk) ii) > 30 min for transport teams with nondedicated staffing For air transport (Note: this only includes time from team dispatch to departure from home base/hospital and does not include transport time to airport) : i) > 30 min for transport teams with dedicated staffing 24 h/d, 7 d/wk ii) > 60 min for transport teams with nondedicated staffing C) For air transport : Delay for any reason that occurs between the departure from home base/hospital to aircraft engines on considering what is reasonable for the distance covered/type of aircraft used. D) Time en route : Delay that occurs for any reason between transport team departure to arrival at receiving facility, considering what is reasonable given the geographic distance covered and mode(s) of transportation used. E) Stabilization and preparation time : The time taken by the transport team to stabilize patient and prepare them for transport. All transports should be reviewed if this time is in excess of: i) 60 min for pediatric transports ii) 120 min for neonatal transports F) Out-of-hospital time : The total amount of time spent by the patient between facilities in the transport environment, considering what is reasonable given the geographic distance covered and mode(s) of transportation used. |
Postmeeting Delphi after two iterations (88% agreement) |
Unsafe environment for transport crew due to personal crew factors | Includes, but is not limited to, safety policies pertaining to impairment from exhaustion, drugs, alcohol, illness, or injury; appropriate clothing for environmental conditions (both expected and potential); crew members fit the personal physical requirements specified by the transport team; additional crew stressors (e.g., challenges to adequate nutrition and hydration); adequate transport crew education/training given patient demands and transport environment; appropriate orientation of team members to transport vehicles. | Postmeeting Delphi after one iteration, although wording slightly modified in second iteration after consistent written feedback (85% agreement) |
Unsatisfactory safety environmental for transport crew | Includes, but is not limited to, access to government-mandated safety items (e.g., seatbelts); exposure to external environmental conditions (strict adherence to vehicle-specific minimal weather requirements); appropriate medical configuration of vehicle (e.g., adequate lighting, reduced vibration and noise, adequate supplies); adequate and functioning communication equipment for crew members, including when appropriate, hands-free technology for driver/pilot; adequate environment/vehicle configuration to facilitate adherence to team-specific safety policies (e.g., guidelines regarding when to provide unrestrained care to the patient, standard precautions, transport of family members); adequate pressurization capabilities of transport vehicle; access to appropriate personal protective equipment. | Postmeeting Delphi after one iteration, although wording slightly modified in second iteration after consistent written feedback (85% agreement) |
Note: Definitions with citations were adopted or modified from specified references.
These values may not correlate with a clinical diagnosis of hypotension if other signs of end organ perfusion are adequate, but provide a diagnostic cutoff for further evaluation.
Of the 34 remaining indicators, there was 100% acceptance without modification of 12 definitions that were initially proposed in the premeeting questionnaire. Of the other 22 definitions discussed at the consensus meeting, 18 were modified and accepted at the consensus meeting and 4 were moved to the postmeeting process, which included a full Delphi process. After further definition development, three of these indicators were accepted by the panel after one Delphi iteration, and the remaining indicator was accepted after two Delphi iterations. The phase at which consensus was reached for each indicator is listed with their respective definitions in Table 2 .
Discussion
Considerable variability has been noted in the AE rates reported in the pediatric transport literature. 1 2 3 4 5 6 7 This variability is in part likely due to inconsistency in the indicators selected as outcome measures, as well as differences in how these indicators are defined. This consensus process is the first to provide a comprehensive list of significant and relevant event indicators and accompanying definitions for use within pediatric transport medicine.
Standardized definitions to enhance the comparability of different event rates for the purpose of benchmarking and research is explicitly stated as a best practice for surveillance of health care–associated infection (HAI). 43 This prompted the standardization of definitions for many conditions, including pediatric acute respiratory distress syndrome, 44 nosocomial infection, 45 and pediatric sepsis. 22 Adoption of this indicator list and definitions by pediatric transport services may enhance the consistency of event reporting and, in so doing, enable comparisons between different transport services and environments. In addition, the list and definitions may be used to provide cutoff values for concern and allow individual agencies to benchmark team performance against a standard.
Bigham and colleagues introduced a consensus-based list of pediatric transport quality metrics 18 19 with the aim to provide a truncated list of metrics to measure and track quality of care. While there is some overlap with our event indicators, our goals differed. While the goal of the aforementioned list was to develop a truncated list of metrics to measure and track quality of care, our aim was to develop an inclusive list of significant event indicators to identify all AE on transport. Given that our consensus process identified 21 novel indicators not previously measured in the literature, we are concerned that adverse event rates are still underreported. To effectively benchmark transport team performance and launch effective quality assurance strategies, we must first ensure we accurately understand the risks of transport. While the long indicator list may appear burdensome, when applied to a transport database, multiple indicators should signal different aspects of the same event, thus hopefully improving the sensitivity of event detection. Transport teams should then review each identified event to note whether it represented an adverse event and for any modifiable contributing factors. For example, if a patient developed hypotension en route, this may be signaled in the database by low blood pressure, administration of fluids, or initiation/escalation of inotropes. When this event is reviewed, it should be determined whether this was caused by the transport process (e.g., medication administration), inadequate pretransport resuscitation, or whether this was inevitable given their severity of illness. Quality assurance initiatives should target any concerns.
Within the adult literature, Papson et al 46 developed a checklist of unexpected events for intrahospital transport of adult patients. This checklist focused largely on indicators that represent equipment-related issues and physiologic deterioration. By incorporating trigger tools (e.g., procedural interventions) and team process issues (e.g., communication and medication error), our pediatric list is more extensive and inclusive, which may improve event detection during transport for the purpose of quality assurance initiatives and the improvement of patient safety.
Given that defining entities within health care is not an objective straightforward science this consensus process had several strengths. The initial definitions for discussion were grounded in the literature and the integrated, multilevel Delphi process was rigorous with high levels of consensus (> 85%) at each stage. The pre- and post-meeting processes provided the necessary time and means for input of all participants (esp. for any controversial definitions at the meeting) and prevented forced consensus at the meeting due to time constraints. Of particular note is the diverse panelist representation of experience, profession, geographic scope, transport mode, and team composition.
There are limitations of this consensus process and the definitions generated. First and foremost, although the definitions were grounded in the literature where possible, they are based on expert consensus interpretation and judgment. While the indicators have good face validity, the content validity and reliability of the indicators to identify all AE and adverse outcomes are unknown and require examination. Although the panelist representation was diverse, the generalizability of these findings to jurisdictions outside Canada is unknown. Transport teams will differ in their ability to measure some indicators (particularly laboratory values) based on differences in resources and access to technology, which may limit applicability of the indicators and definitions. However, the importance of providing definitions for the indicators relevant to each team (as a minimum set) will still improve standardization between studies.
Application and Future Directions
This inclusive list of indicators and their definitions is intended for application to neonatal and pediatric transport services and associated databases for prospective data capture. Efforts to create a national pediatric transport database in Canada that incorporates these indicators are currently underway, and will be used to assess the validity of indicators with the definitions provided, including their relation to patient outcome. Broad application of this list may facilitate benchmarking of different transport teams, quality assurance programs, and clinical research initiatives.
Conclusion
We completed an interdisciplinary, national consensus process using Delphi methodology to verify the importance of, and establish definitions for, indicators that represent significant events during pediatric transport. We believe application of these indicators to the pediatric transport environment could improve the sensitivity of event detection that we hope will facilitate enhanced patient safety and quality improvement initiatives.
Acknowledgments
The authors wish to thank the following individuals for their participation in the Delphi process (alphabetical order):
PN Cox, MBChB, DCH, FFARCS (U.K.), FRCPC, Associate Chief, Department of Critical Care Medicine, Clinical Director, Pediatric Intensive Care Unit & Fellowship Program Director, Hospital for Sick Children/University of Toronto, Toronto, Canada; Allan DeCaen, MD, FRCP, Clinical Professor, Medical Director, Pediatric Intensive Care Unit, Medical Director, PICU Transport Team, Stollery Children's Hospital, University of Alberta, Edmonton, Alberta, Canada; Craig Eling, RN BSc, BScN, CNCCP(C), PICU Transport, Royal University Hospital, Saskatoon, Saskatchewan, Ontario, Canada; Colleen Fitzgibbons, RN BScN, CNCCP(C), AEMCA, Nurse Educator, Pediatric Intensive Care Unit and Critical Care Response Team, Children's Hospital of Eastern Ontario, Ottawa, Canada; Eli Gilad, MD, Pediatric Intensive Care Co-Director Critical Care Transport, Alberta Children's Hospital, Calgary, Alberta, Canada; Gonzalo Garcia Guerra, MD, MSc, Clinical Assistant Professor, Associate Medical Director Pediatric Transport Team, Pediatric Critical Care, Stollery Children's Hospital, University of Alberta, Edmonton, Alberta, Canada; JoAnn Harrold, MD, FRCPC, Neonatologist, Site Chief, Division of Neonatology, Medical Director of Neonatal Transport Team, Department of Pediatrics, University of Ottawa, Children's Hospital of Eastern Ontario, Ottawa, Canada; N. Jackson, RN BScN, Neonatal Transport Team, Children's Hospital of Eastern Ontario, Ottawa, Canada; Trevor Lang, Critical Care Flight Paramedic, Ornge; Angelo Mikrogianakis, Chief, Section of Pediatric Emergency Medicine, Co-Director of Critical Care Transport Program, Associate Professor of Pediatrics, University of Calgary, Alberta Children's Hospital, Calgary, Alberta, Canada; Hadi Mohseni-Bod, MD, MRCPCH (U.K.), Pediatric Intensivist, Hospital for Sick Children, Toronto, Canada; Lisa Ramnarine, BSc, RRT, Neonatal Transport Team, Pediatric CCRT, Children's Hospital of Eastern Ontario, Ottawa, Canada; Stephanie Redpath, MBChB, FRCPCH (U.K.), Medical Director CHEO Transport Team, Neonatologist, Division of Neonatology, Department of Pediatrics, University of Ottawa, Children's Hospital of Eastern Ontario, Ottawa, Canada; Janlyn Rozdisky, RN(NP), MN CNCCP(C), Clinical Nurse Educator, Pediatric Intensive Care Unit, Royal University Hospital, Saskatoon, Saskatchewan, Canada; Gabriela Speck, RRT, Neonatal Transport Team, Children's Hospital of Eastern Ontario, Ottawa, Canada; Tanya Spence, RN MN, Clinical Nurse Specialist ECLS Program, Pediatric Critical Care Transport Program, Pediatric Intensive Care Unit, Alberta Children's Hospital, Alberta, Canada; Jeremiah Soucie, BHSc, MBA CCP(f) Critical Care Flight Paramedic, Ornge; Ronald K. Tam, MD, FRCPC, Assistant Professor of Departments of Pediatrics and Emergency Medicine, University of Ottawa, Staff Pediatric Emergency Medicine Physician, Children's Hospital of Eastern Ontario, Ottawa, Canada; Janice A. Tijssen, MD, FRCPC, FAAP, Pediatric Intensivist, Department of Pediatrics, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada; Penny Triggs, VP Air Medical Operations, Keewatin Air; Mary Wagner, AEMCA, Pediatric Critical Care Paramedic, Ornge; David Wensley, MD FRCPC, Division Head, Critical Care, Department of Pediatrics, University of British Columbia, Vancouver, Canada; Hilary Writer, MD, FRCPC, Assistant Professor, Division of Critical Care, Department of Pediatrics, University of Ottawa, Children's Hospital of Eastern Ontario, Ottawa, Canada.
Melissa Parker is supported by a Canadian Blood Services (CBS)/Canadian Institutes of Health Research (CIHR) New Investigator Award funded by Health Canada and Canadian Blood Services (CIHRPA201309-MP-322414), and a Career Enhancement Program Award from the Canadian Child Health Clinician Scientist Program. The views expressed herein do not necessarily represent the view of the federal government.
References
- 1.Britto J, Nadel S, Maconochie I, Levin M, Habibi P.Morbidity and severity of illness during interhospital transfer: impact of a specialised paediatric retrieval team BMJ 1995311(7009):836–839. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Edge W E, Kanter R K, Weigle C G, Walsh R F. Reduction of morbidity in interhospital transport by specialized pediatric staff. Crit Care Med. 1994;22(07):1186–1191. doi: 10.1097/00003246-199407000-00023. [DOI] [PubMed] [Google Scholar]
- 3.Macnab A J. Optimal escort for interhospital transport of pediatric emergencies. J Trauma. 1991;31(02):205–209. [PubMed] [Google Scholar]
- 4.Orr R A, Felmet K A, Han Y et al. Pediatric specialized transport teams are associated with improved outcomes. Pediatrics. 2009;124(01):40–48. doi: 10.1542/peds.2008-0515. [DOI] [PubMed] [Google Scholar]
- 5.Beyer A J, III, Land G, Zaritsky A. Nonphysician transport of intubated pediatric patients: a system evaluation. Crit Care Med. 1992;20(07):961–966. doi: 10.1097/00003246-199207000-00011. [DOI] [PubMed] [Google Scholar]
- 6.Kanter R K, Tompkins J M. Adverse events during interhospital transport: physiologic deterioration associated with pretransport severity of illness. Pediatrics. 1989;84(01):43–48. [PubMed] [Google Scholar]
- 7.Barry P W, Ralston C. Adverse events occurring during interhospital transfer of the critically ill. Arch Dis Child. 1994;71(01):8–11. doi: 10.1136/adc.71.1.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Gunz A C, Dhanani S, Whyte H et al. Identifying significant and relevant events during pediatric transport: a modified Delphi study. Pediatr Crit Care Med. 2014;15(07):653–659. doi: 10.1097/PCC.0000000000000171. [DOI] [PubMed] [Google Scholar]
- 9.Bellander B-M, Cantais E, Enblad P et al. Consensus meeting on microdialysis in neurointensive care. Intensive Care Med. 2004;30(12):2166–2169. doi: 10.1007/s00134-004-2461-8. [DOI] [PubMed] [Google Scholar]
- 10.Blay J-Y, Bonvalot S, Casali P et al. Consensus meeting for the management of gastrointestinal stromal tumors. Report of the GIST Consensus Conference of 20–21 March 2004, under the auspices of ESMO. Ann Oncol. 2005;16(04):566–578. doi: 10.1093/annonc/mdi127. [DOI] [PubMed] [Google Scholar]
- 11.Braylan R C, Orfao A, Borowitz M J, Davis B H. Optimal number of reagents required to evaluate hematolymphoid neoplasias: results of an international consensus meeting. Cytometry. 2001;46(01):23–27. doi: 10.1002/1097-0320(20010215)46:1<23::aid-cyto1033>3.0.co;2-z. [DOI] [PubMed] [Google Scholar]
- 12.Fine J-D, Eady R A, Bauer E A et al. The classification of inherited epidermolysis bullosa (EB): Report of the Third International Consensus Meeting on Diagnosis and Classification of EB. J Am Acad Dermatol. 2008;58(06):931–950. doi: 10.1016/j.jaad.2008.02.004. [DOI] [PubMed] [Google Scholar]
- 13.Fink A, Kosecoff J, Chassin M, Brook R H. Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984;74(09):979–983. doi: 10.2105/ajph.74.9.979. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Land J A, Evers J L. Risks and complications in assisted reproduction techniques: Report of an ESHRE consensus meeting. Hum Reprod. 2003;18(02):455–457. doi: 10.1093/humrep/deg081. [DOI] [PubMed] [Google Scholar]
- 15.Nair R, Aggarwal R, Khanna D. Methods of formal consensus in classification/diagnostic criteria and guideline development. Semin Arthritis Rheum. 2011;41(02):95–105. doi: 10.1016/j.semarthrit.2010.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tytgat G N, Heading R C, Müller-Lissner S et al. Contemporary understanding and management of reflux and constipation in the general population and pregnancy: a consensus meeting. Aliment Pharmacol Ther. 2003;18(03):291–301. doi: 10.1046/j.1365-2036.2003.01679.x. [DOI] [PubMed] [Google Scholar]
- 17.Wargocki P, Sundell J, Bischof W et al. Ventilation and health in non-industrial indoor environments: report from a European multidisciplinary scientific consensus meeting (EUROVEN) Indoor Air. 2002;12(02):113–128. doi: 10.1034/j.1600-0668.2002.01145.x. [DOI] [PubMed] [Google Scholar]
- 18.Bigham M T, Schwartz H P; Ohio Neonatal/Pediatric Transport Quality Collaborative.Quality metrics in neonatal and pediatric critical care transport: a consensus statement Pediatr Crit Care Med 20131405518–524. [DOI] [PubMed] [Google Scholar]
- 19.Schwartz H P, Bigham M T, Schoettker P J, Meyer K, Trautman M S, Insoft R M; American Academy of Pediatrics Section on Transport Medicine.Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project Pediatr Crit Care Med 20151608711–717. [DOI] [PubMed] [Google Scholar]
- 20.Plint A, Stang A S, Calder L A; Priorities in Patient Safety Research in Emergency Medicine Consensus Panel.Establishing priorities for patient safety research in the emergency department: a multidisciplinary consensus panel Int J Emerg Med 201581. Doi: 10.1186/s12245-014-0049-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Dhanani S. Planning Meeting to Develop an International Interdisciplinary Research Network.Meetings, Planning and Dissemination Grant Final Report Ottawa, Canada; 2012
- 22.Goldstein B, Giroir B, Randolph A; International Consensus Conference on Pediatric Sepsis.International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics Pediatr Crit Care Med 20056012–8. [DOI] [PubMed] [Google Scholar]
- 23.Maternal and Newborn Health/Safe Motherhood Unit WHO (institution)Thermal protection of the newborn: a practical guide.1997http://apps.who.int/iris/bitstream/10665/63986/1/WHO_RHT_MSM_97.2.pdf. Accessed February 10, 2016
- 24.Coates B M, Vavilala M S, Mack C D et al. Influence of definition and location of hypotension on outcome following severe pediatric traumatic brain injury. Crit Care Med. 2005;33(11):2645–2650. doi: 10.1097/01.ccm.0000186417.19199.9b. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Haque I U, Zaritsky A L. Analysis of the evidence for the lower limit of systolic and mean arterial pressure in children. Pediatr Crit Care Med. 2007;8(02):138–144. doi: 10.1097/01.PCC.0000257039.32593.DC. [DOI] [PubMed] [Google Scholar]
- 26.Lander A. Paediatric fluid and electrolyte therapy guidelines. Surgery. 2008;26(07):283–287. [Google Scholar]
- 27.Moritz M L, Ayus J C. Disorders of water metabolism in children: hyponatremia and hypernatremia. Pediatr Rev. 2002;23(11):371–380. [PubMed] [Google Scholar]
- 28.Bockenkamp B, Vyas H. Understanding and managing acute fluid and electrolyte disturbances. Curr Paediatr. 2003;13(07):520–528. [Google Scholar]
- 29.Rodríguez-Soriano J. Potassium homeostasis and its disturbances in children. Pediatr Nephrol. 1995;9(03):364–374. doi: 10.1007/BF02254217. [DOI] [PubMed] [Google Scholar]
- 30.Lehnhardt A, Kemper M J. Pathogenesis, diagnosis and management of hyperkalemia. Pediatr Nephrol. 2011;26(03):377–384. doi: 10.1007/s00467-010-1699-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Masilamani K, van der Voort J. The management of acute hyperkalaemia in neonates and children. Arch Dis Child. 2012;97(04):376–380. doi: 10.1136/archdischild-2011-300623. [DOI] [PubMed] [Google Scholar]
- 32.Lemon V, Stockwell D C. Automated detection of adverse events in children. Pediatr Clin North Am. 2012;59(06):1269–1278. doi: 10.1016/j.pcl.2012.08.007. [DOI] [PubMed] [Google Scholar]
- 33.Dickerman M J, Jacobs B R, Vinodrao H, Stockwell D C. Recognizing hypoglycemia in children through automated adverse-event detection. Pediatrics. 2011;127(04):e1035–e1041. doi: 10.1542/peds.2009-3432. [DOI] [PubMed] [Google Scholar]
- 34.Kyle U G, Coss Bu J A, Kennedy C E, Jefferson L S. Organ dysfunction is associated with hyperglycemia in critically ill children. Intensive Care Med. 2010;36(02):312–320. doi: 10.1007/s00134-009-1703-1. [DOI] [PubMed] [Google Scholar]
- 35.Faustino E VS, Bogue C W. Relationship between hypoglycemia and mortality in critically ill children. Pediatr Crit Care Med. 2010;11(06):690–698. doi: 10.1097/PCC.0b013e3181e8f502. [DOI] [PubMed] [Google Scholar]
- 36.Cornblath M, Hawdon J M, Williams A F et al. Controversies regarding definition of neonatal hypoglycemia: suggested operational thresholds. Pediatrics. 2000;105(05):1141–1145. doi: 10.1542/peds.105.5.1141. [DOI] [PubMed] [Google Scholar]
- 37.Kalhan S, Peter-Wohl S. Hypoglycemia: what is it for the neonate? Am J Perinatol. 2000;17(01):11–18. doi: 10.1055/s-2000-7296. [DOI] [PubMed] [Google Scholar]
- 38.Del Castillo J, López-Herce J, Matamoros M et al. Hyperoxia, hypocapnia and hypercapnia as outcome factors after cardiac arrest in children. Resuscitation. 2012;83(12):1456–1461. doi: 10.1016/j.resuscitation.2012.07.019. [DOI] [PubMed] [Google Scholar]
- 39.Flin R, Winter J, Cakil Sarac M R.Human factors in patient safety: review of topics and tools. World Health Organization (WHO) 2009http://www.who.int/patientsafety/research/methods_measures/human_factors/human_factors_review.pdf. Accessed February 10, 2016
- 40.Health Canada.Clinical Safety Data Management Definitions and Standards for Expedited Reporting 1995http://www.hc-sc.gc.ca/dhp-mps/alt_formats/hpfb-dgpsa/pdf/prodpharma/e2a-eng.pdf. Accessed February 10, 2016
- 41.Woodward R M, Insoft R M, Kleinman M E, eds.Guidelines for Air and Ground Transport. 3rd ed Elk Grove Village, IL: American Academy of Pediatrics; 20061–529.. Available athttp://ebooks.aappublications.org/content/9781581105124/9781581105124. [Google Scholar]
- 42.Harris P A, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J G. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(02):377–381. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Ontario Agency for Health Protection and Promotion (Public Health Ontario) PIDAC.Best Practices for Surveillance of Health Care-Associated Infections: In Patient and Resident Populations3rd ed.Toronto, ON, Canada: Queen's Printer for Ontario; 2014 [Google Scholar]
- 44.Khemani R G, Smith L S, Zimmerman J J, Erickson S; Pediatric Acute Lung Injury Consensus Conference Group.Pediatric acute respiratory distress syndrome: definition, incidence, and epidemiology: proceedings from the Pediatric Acute Lung Injury Consensus Conference Pediatr Crit Care Med 2015160501S23–S40. [DOI] [PubMed] [Google Scholar]
- 45.Garner J S, Jarvis W R, Emori T G, Horan T C, Hughes J M. CDC definitions for nosocomial infections, 1988. Am J Infect Control. 1988;16(03):128–140. doi: 10.1016/0196-6553(88)90053-3. [DOI] [PubMed] [Google Scholar]
- 46.Papson J PN, Russell K L, Taylor D M. Unexpected events during the intrahospital transport of critically ill patients. Acad Emerg Med. 2007;14(06):574–577. doi: 10.1197/j.aem.2007.02.034. [DOI] [PubMed] [Google Scholar]