Skip to main content
Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease logoLink to Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease
. 2018 Jun 30;7(13):e008571. doi: 10.1161/JAHA.118.008571

Delphi Analysis of Science Gaps in the 2015 American Heart Association Cardiac Arrest Guidelines

Ashish R Panchal 1,2,, Rebecca E Cash 2, Remle P Crowe 2, Ryan Coute 3, David Way 1, Tom Aufderheide 4, Raina M Merchant 5
PMCID: PMC6064902  PMID: 29960986

Abstract

Background

Current cardiac arrest guidelines have limited high‐quality scientific evidence to support recommendations for care. The quality of scientific evidence on which guidelines are based may correlate with improved patient outcomes and meaningful survival. We sought to develop a prioritized list of knowledge gaps in resuscitation to assist researchers, policy makers, and funding agencies in their decision‐making process.

Methods and Results

A 4‐stage modified Delphi method was used with a panel of cardiac arrest experts. Experts addressed the prompt: “What are the top 3 gaps in knowledge involving cardiac arrest care that should be research priorities for National Institutes of Health/American Heart Association funding to have the greatest impact on public health?” Knowledge gaps were identified in the initial round, rated in a second round, and rank ordered in the third round, and they underwent final review and consensus (final round). The outcome was 10 knowledge gaps, with prioritization of the top 3 gaps. A total of 61 gaps, with 19 distinct themes, were identified by participants. The 10 knowledge gaps most likely to affect public health identified by the expert panel included, in order, the following: telecommunicator cardiopulmonary resuscitation, hemodynamic monitoring for goal‐directed resuscitation, reasons why bystanders fail to respond, optimization of postarrest care, out‐of‐hospital cardiac arrest identification and response, individualizing resuscitation strategies, predicting patients at risk, tools for neuroprognostication, optimal airway management, and optimizing educational strategies.

Conclusions

Ten priorities for cardiac arrest research were identified, but consensus was not reached on the prioritized top 3. Future research should address these gaps to potentially improve resuscitation guideline evidence quality.

Keywords: cardiac arrest, consensus, Delphi, knowledge gap, resuscitation, science gap

Subject Categories: Cardiopulmonary Arrest, Cardiopulmonary Resuscitation and Emergency Cardiac Care


Clinical Perspective

What Is New?

  • Using a 4‐stage modified Delphi method with a panel of cardiac arrest experts, a list of 10 prioritized knowledge gaps in resuscitation science were identified addressing the question, “What are the top gaps in knowledge involving cardiac arrest care that should be research priorities for National Institutes of Health/American Heart Association funding to have the greatest impact on public health?”

What Are the Clinical Implications?

  • These resuscitation science knowledge gaps, if addressed, could improve the level of evidence on which resuscitation guidelines are based as well as define focus areas for researchers, stakeholders, and funding organizations to improve the public health impact of cardiac arrest.

In the United States, ≈500 000 people each year are victims of cardiac arrest, with only ≈12% to 24% surviving to hospital discharge.1 The low survival rate continues even with a national initiative for cardiopulmonary resuscitation (CPR) training and the development of systems to improve resuscitation care both in and out of hospital.2 Furthermore, there are concerted efforts to improve resuscitation practices with the development of evidence‐based guidelines.3, 4 Despite this, the overall survival rates remain low, with only modest increases over the past decade.2, 5, 6, 7

One of the challenges of improving resuscitation outcomes is a lack of high‐quality evidence from which to develop treatment recommendations. Of the 685 recommendations in the 2010 Emergency Cardiovascular Care (ECC)/American Heart Association (AHA) Guidelines, 54% were based on low‐quality evidence defined as level of evidence (LOE) C (correlating to low grade).8 More recently, of the 315 updated recommendations in the 2015 ECC/AHA Guidelines, nearly three quarters were based on LOE C‐Expert Opinion or LOE C‐Limited Data (grade low or nonrecommendation), and only 1% were based on the highest LOE, LOE A (high grade).8 Because the science of resuscitation drives both the development of education and implementation of resuscitation practices, the quality of evidence on which guidelines are based may correlate with improved patient outcomes and meaningful survival.

The International Liaison Consensus on Research Scientific Evidence Evaluation and AHA Guideline development processes identify many knowledge gaps,8, 9 yet neither of these prioritizes the importance of these knowledge gaps to public health. A prioritized set of gaps may assist researchers, stakeholders, and funding organizations to better understand the relationship of specific knowledge gaps and potential public health impact. The goal of this project was to develop a prioritized list of science knowledge gaps to assist researchers, policy makers, and funding agencies in their decision‐making process.

Methods

The data that support the findings of this study are available from the corresponding author on reasonable request.

Objectives and Participants

The goal of this evaluation was to gain consensus on the knowledge and science gaps in resuscitation after publication of the 2015 AHA Guidelines for CPR and ECC. Specifically, the objectives of the study were to develop the following: (1) a top 10 list of knowledge gaps and (2) a prioritized top 3 list of knowledge gaps. A modified Delphi method was used to develop consensus among an expert panel of leaders in the field.10, 11, 12, 13, 14 The Delphi method is a well‐described structured process for building consensus from a group of informed experts.10 It includes multiple rounds of data collection combined with feedback to the panel originally meant to occur as a face‐to‐face process. The modified Delphi method uses asynchronous electronic communication to gather information, provide feedback, and report results to a panel of experts.11 In this evaluation, the modified Delphi method was selected because of the need for a diverse panel of experts from a national organization who could be more readily engaged through electronic communication.

In October 2016, an invitation to participate in the Delphi process was sent by E‐mail to 100 cardiac arrest experts identified from the author list of the 2015 AHA Guidelines for CPR and ECC published in November 2015.2, 15 These individuals have previously been established as subject matter experts in cardiac arrest by the AHA ECC Committee. Ideal panel sizes for the Delphi method have been cited at ≈10 to 18 participants to allow for group dynamics to be established.16, 17, 18

Participation and completion of the project was voluntary, and no personal information was collected until after the final round. Participant responses were maintained in a separate database from contact information to ensure anonymity of the process. This project was approved by the institutional review board and granted an exemption.

Data Collection Process

To obtain group consensus, 4 rounds of surveys, with specific tasks, were administered electronically following the modified Delphi method between October 2016 and December 2016.10, 14, 19 Reminders to participate were sent out ≈1 and 2 weeks after each round's survey invitation, in accordance with Dillman's tailored design method to improve survey response and participation through multiple survey invitations.20 The main outcome of interest was development of consensus on a prioritized list of knowledge gaps in cardiac arrest research that, if addressed, have the greatest impact to public health.

Round 1

The initial round of data collection focused on having the experts identify specific knowledge gaps in cardiac arrest research through an electronic questionnaire. Participants were presented with a simple prompt:

“What are the top 3 gaps in knowledge involving cardiac arrest care that should be research priorities for National Institutes of Health/AHA funding to have the greatest impact on public health?”

In answering this query, participants were asked to consider the priorities of the Institute of Medicine report titled, “Strategies to Improve Cardiac Arrest Survival: A Time to Act” and guidelines directed at cardiac arrest care (2010 and 2015 AHA/ECC Guidelines). Participants were directed to individually enter 3 specific gaps in the electronic questionnaire with a short rationale. Responses were collected, and qualitative analysis was used to develop themes identified by the participants to continue in the next rounds.

Round 2

Participants were asked to rate the importance of each knowledge gap in relation to its impact on public health. Each participant was provided identified themes from round 1 in alphabetical order. Participants were then asked to consider the importance of each gap theme (and rationale) and its impact on public health and rate the importance of these gaps. Participants individually rated the themes using a 5‐point Likert‐type scale, from 1 (“not at all important”) to 5 (“very important/critical”), in an electronic questionnaire. The mean importance rating was calculated for each theme, and the top 10 themes by mean importance were advanced to round 3 on the basis of an a priori decision.21

Round 3

In round 3, participants were asked to revise their judgments on the basis of feedback from the prior round and to individually rank order the top 10 themes identified in round 2 in an electronic questionnaire. To allow expression of dissenting opinions, rationales for ranking items outside of the group consensus were requested.

Round 4

At the beginning of the final round, participants have identified the themes, scored each theme for importance to public health, and rank ordered the themes into a top 10 list.

To assess for agreement within the group about the top 3 prioritized knowledge gaps identified in round 3, participants were provided the top 3 gaps and asked whether the prioritized list answers the following prompt:

“What are the top 3 gaps in knowledge involving cardiac arrest care that should be research priorities for National Institutes of Health/AHA funding to have the greatest impact on public health?”

Participants could agree or disagree in the electronic questionnaire and then were allowed free text space to provide a rationale for disagreement. Group consensus was defined using a published benchmark of a 75% majority of the experts agreeing to the top 3 list of prioritized knowledge gaps.22

Statistical Analysis

Descriptive statistics were calculated using STATA IC 12.1 (StataCorp LP, College Station, TX). Qualitative analysis was performed by 3 independent reviewers (A.P., R.C., D.W.) to find the main themes of gaps identified in round 1, as previously noted. Rationales for the distinct themes were summarized by the 3 reviewers using as much of the submitted language from participants as possible. Mean importance scores were calculated in round 2 for each theme. On the basis of the method described in detail previously, the rank ordering of the prioritized list was determined by assigning points to each rank option, with a rank of 1 (most important) equal to 10 points and a rank of 10 (least important) equal to 1 point.21 Total points were calculated and themes were ranked by the subsequent total point value obtained. In addition, the percentage of respondents who selected each gap in their top 5 rankings was calculated. This was used as an objective metric of the consensus process. As the group reaches consensus, the percentage of experts ranking the themes in the top 5 would have less variability (ie, higher percentages for fewer themes). Majority consensus was defined as at least 75% of participants agreeing with the prioritized list of top 3 gaps.22

Results

Participant Characteristics

At the beginning of the study, 22 experts assented to being part of the Delphi process. A total of 13 participants completed all 4 rounds of the modified Delphi process. Seven participants (54%) were women, 12 (92%) were physicians, 6 (46%) had primary appointments in pediatrics, and an additional 6 (46%) had primary appointments in emergency medicine. No significant conflicts of interest were reported (Data S1). All participants were confirmed to have been selected by the AHA as content experts in cardiac arrest and, thus, directly involved in the 2015 AHA/ECC Guidelines development process and publication. Four participants (31%) were authors of the Institute of Medicine report on cardiac arrest,2 and 3 (23%) were involved in development of the International Consensus on CPR and ECC Science With Treatment Recommendations for the International Liaison Consensus on Research.8

Delphi Results

A total of 61 knowledge gaps with rationales were submitted by 22 participants in round 1. From these identified gaps, 19 distinct themes were derived by 3 reviewers during qualitative analysis. A set of top 10 themes by mean score advanced to round 3 (Table 1). For round 2, there was a 73% retention rate (16/22 participants). Mean importance scores of the top 10 themes were high for all 10 themes consistently, with the participants placing significant importance on each of these themes. In round 3, 14 participants rank ordered the top 10 themes, developing a final list of prioritized knowledge gaps, which is presented in Table 2. The round 3 and 4 retention rates were 64% (14/22 participants) and 59% (13/22 participants), respectively.

Table 1.

Top 10 Themes and Associated Rationale, as Decided by the Expert Panel

Rank Mean Importance Score Gap Theme Rationale
1 4.56 Hemodynamic monitoring for goal‐directed resuscitation during cardiac arrest For both IHCA and OHCA, we must monitor the effectiveness of care during resuscitation and develop optimal targets for goal‐directed resuscitation using available hemodynamic/physiologic measures (blood pressure and end tidal carbon dioxide) that will result in improved outcomes.
2 4.47 Dispatch‐directed CPR (T‐ CPR) Dispatcher‐directed CPR (T‐CPR), especially for children and those with primary asphyxial cardiac arrest, needs to be evaluated. Validated instructions should be developed for specific age groups (infants and neonates) and situations (asphyxial). Outcomes, such as ROSC, hospital admission, hospital discharge, survival, and improved neurological outcome, should be assessed.
3 4.44 Optimization of postarrest care After ROSC, the optimal prehospital and in‐hospital care for cardiac arrest patients is poorly defined. More studies are needed to examine factors, such as hypothermia/targeted temperature management, titration of medications and oxygen, and appropriate hemodynamic monitoring/targets for optimal neurological outcomes and quality of life.
4 4.25 Individualizing resuscitation strategies for victims of cardiac arrest We need to better understand the individual patient characteristics that drive choices in care during arrest. Better understanding of the physiological features of various cardiac arrest causes will help develop recommendations for when ventilations are required or use of compression‐only CPR would provide better outcomes.
5 4.19 Developing tools for early neuroprognostication Lack of robust, reliable, evidence‐based strategy results in both premature prognostication of futility and overuse of resources when care is futile. Optimizing tools for neuroprognostication will help contextualize outcomes
6 4.13 Understanding the reasons why bystanders fail to respond Bystander CPR and use of an automated external defibrillator are associated with marked increased survival for OHCA. We do not have a strong understanding of why some bystanders choose not to respond nor how best to educate, train, and motivate laypeople (particularly youths) to recognize cardiac or neurological emergencies and take appropriate actions.
7 4.13 Optimizing educational strategies for healthcare providers How do we best train providers for improved recognition and initial treatment of at‐risk patients to prevent cardiac arrest? How do we best train providers to improve outcomes of cardiac arrest? Does frequent rolling refresher training combined with debriefing improve team performance and the process of care?
8 4.00 Using novel technology for OHCA identification and response Many cardiac arrests in the community are unwitnessed. New technologies may offer strategies to recognize unwitnessed cardiac arrest in the community, increase the use of bystander CPR, and decrease emergency medical services response time.
9 3.94 Determining the optimal airway management strategy for cardiac arrest patients Significant risk/harm is possible from overoxygenation or underoxygenation. Definitive studies are needed to examine issues, such as initial airway control strategies (endotracheal tube vs supraglottic airway) and optimal use of oxygen during CPR for neonates.
10 3.80 Predicting patients at risk for cardiac arrest Many victims of OHCA experience cardiac arrest with no history of symptoms. Predicting which patients may experience cardiac arrest could result in better outcomes by activating a response or getting the patient to the “right” environment before arrest. Providers do not have adequate sensitivity and specificity to identify those patients needing emergency interventions. What vital sign changes and changes in rhythms best predict a higher risk of cardiac arrest?

Mean importance score is scaled from 1 to 5, from 1 (“not at all important”) to 5 (“very important/critical”). CPR indicates cardiopulmonary resuscitation; IHCA, in‐hospital cardiac arrest; OHCA, out‐of‐hospital cardiac arrest; ROSC, return of spontaneous circulation; T‐CPR, telecommunicator CPR.

Table 2.

Final Ranking of the Top 10 Knowledge and Science Gaps in the 2015 AHA Guidelines, as Determined by the Expert Panel

Gap Theme Frequency of Occurrence Ranks: 1 2 3 4 5 6 7 8 9 10 Points: 10 9 8 7 6 5 4 3 2 1a Total Points Rank Order of Total Points % of Experts Ranking in Top 5
Dispatch‐directed CPR (telecommunicator CPR) 4 2 2 1 1 2 0 1 0 0 100 1 77
Hemodynamic monitoring for goal‐directed resuscitation during cardiac arrest 3 2 1 0 1 3 0 2 0 1 84 2 54
Understanding the reasons why bystanders fail to respond 3 1 2 2 0 0 0 2 2 1 80 3 62
Optimization of postarrest care 0 2 2 1 4 0 0 3 1 0 76 4.5 69
Using novel technology for OHCA identification and response 0 1 3 2 2 2 1 0 1 1 76 4.5 62
Individualizing resuscitation strategies for victims of cardiac arrest 2 0 1 1 2 2 3 0 1 1 72 6 46
Predicting patients at risk for cardiac arrest 0 3 2 0 1 2 1 1 1 2 70 7 38
Developing tools for early neuroprognostication 0 1 0 2 1 1 3 1 3 1 56 8.5 31
Determining the optimal airway management strategy for cardiac arrest patients 1 1 0 3 0 0 1 2 1 4 56 8.5 38
Optimizing educational strategies for healthcare providers 0 0 0 1 1 1 4 1 3 2 45 10 15

Points were assigned on the basis of individual expert panel ranking and summated for final ranking by total points. The percentage of experts who ranked a theme in the top 5 was also calculated, demonstrating the range of expert rankings of each theme. AHA indicates American Heart Association; CPR, cardiopulmonary resuscitation; OHCA, out‐of‐hospital cardiac arrest.

a

Each number in the display represents the number of respondents selecting a particular ranking for an item.

The top 10 prioritized gaps were achieved using the experts’ ratings (round 2) and rankings (round 3). Table 2 describes the overall ranking of the 10 themes by the total points awarded by the experts’ evaluation. The themes achieving the highest scores were dispatch‐directed CPR, hemodynamic monitoring for goal‐directed resuscitation during cardiac arrest, and understanding the reasons why bystanders fail to respond.

The final prioritized list of gaps included themes that may improve outcomes throughout the continuum of patient care (Table 2). All the gaps addressed both adult and pediatric patients. Out‐of‐hospital care was the exclusive focus of 30%, with the remaining 70% addressing both in‐hospital and out‐of‐hospital care. One gap focused on prevention, with the goal of predicting patients at risk of cardiac arrest. Identification and directed response were important for another gap using novel technology in the out‐of‐hospital setting. The need to optimize resuscitation practices was noted in 60% of gaps, including hemodynamic monitoring for goal‐directed resuscitation, understanding why bystanders fail to act, leveraging technology to enhance response, individualizing resuscitation strategies, and optimizing airway management strategies and education for healthcare providers. Post–cardiac arrest management was a focus of 2 gaps, including one on the optimization of postarrest care and another identifying the need to develop validated tools for early neuroprognostication.

The final prioritized list of the top 3 knowledge gaps included the following: (1) development of validated dispatcher‐directed (telephone) CPR instructions and assessment of outcomes after deployment; (2) development of optimal targets in hemodynamic monitoring for goal‐directed resuscitation during cardiac arrest; and (3) understanding the reasons why bystanders fail to respond and ways to educate, train, and motivate laypeople to respond to cardiac and neurological emergencies. A simple majority consensus was reached, with a total of 7 of 13 (62%), although this did not meet our goal of a 75% majority consensus.22 One additional respondent agreed with the list but presented a different prioritized order than the group consensus.

Discussion

To address the public health impact of cardiac arrest, focused efforts need to be made on addressing the knowledge gaps in research that will drive innovation and implementation in resuscitation science. As part of this goal, we leveraged the knowledge of resuscitation experts to identify 10 high‐yield science gaps where researchers, stakeholders, and funding agencies may direct resources to improve survival from cardiac arrest. This approach has been used in other areas to improve outcomes by effecting research decisions to direct attention and funding at significant public health problems.23, 24 In this study, the expert panel generated a list of 10 prioritized knowledge gaps but was unable to reach consensus on the top 3 at our predetermined 75% level.

Using a modified Delphi technique, the top 10 list of knowledge gaps included themes related to out‐of‐hospital and in‐hospital cardiac arrest management.25 At the onset of a cardiac arrest event, the expert panel noted the importance of leveraging technology to improve rapid identification and response along with enhancing CPR provision by improving bystander and dispatcher response (telecommunicator CPR). As the victim's care is transferred from initial rescuers, optimizing care through improved airway management strategies, hemodynamic monitoring, and individualized goal‐directed management becomes an important consideration. As the patient attains return of spontaneous circulation, experts noted that improved postarrest care and developing tools to assist in neuroprognostication become critical. Finally, in the in‐hospital setting, improved educational strategies would assist healthcare provider provision of care and early identification of patients “at risk” of cardiac arrest, improving patient management to prevent cardiac arrest.

The prioritized list of knowledge gaps identified by the expert panel aligns closely with the recommendations outlined in the Institutes of Medicine report, “Strategies to Improve Cardiac Arrest Survival: A Time to Act.”2 Specifically, the Institute of Medicine report recommends the following: enhancing emergency medical service systems, with an emphasis on dispatcher and high‐performance CPR (eg, gaps 1 and 2, Table 1); improving strategies for in‐hospital arrest (eg, gaps 3 and 5) and special resuscitation circumstances (eg, gap 4); promoting the use of innovative technologies (eg, gap 8) and treatments (eg, gaps 1 and 4); and improving bystander response and CPR provision (eg, gap 6). The concurrence with the Institute of Medicine recommendations lends further credence to the possible impact of addressing these gaps.

The top 10 identified knowledge gaps, when placed in the context of the magnitude of public health impact (lives saved), further demonstrate the importance of identifying knowledge gaps for funding choices. Using the method described by Elmer et al,26 we estimated the potential impact of addressing 3 of the identified themes that have been studied previously in out‐of‐hospital cardiac arrest (OHCA): telecommunicator CPR, improved neuroprognostication, and optimizing postarrest care (Table 3). Nationally, there are ≈167 000 emergency medical service–treated OHCAs in the United States, with a survival rate of ≈12%.1, 27 In systems in which telecommunicator CPR is optimized, all rhythm survival from OHCA is ≈37%.28 If telecommunicator CPR were implemented nationally, as recommended by the AHA,29 the expected impact on OHCA survival would be 41 810 lives saved annually, doubling overall survival. Following this same logic, as outlined by Elmer et al, implementation of a national neuroprognostication standard (eg, no withdrawal of life support for <72 hours after return of spontaneous circulation) would save 2300 lives per year, amounting to a 26% increase in OHCA survival.26

Table 3.

Extrapolated Potential Impact of Addressing Key Knowledge Gaps on Survival for OHCA Using National Epidemiological Data

Theme Addressed US Population Incidence of EMS‐Treated OHCAs Total EMS Cardiac Arrests27 Intervention Survival Rate (All Rhythm), % Survival to Hospital (All Rhythm) All Rhythm Survival % Increase in Survival
T‐CPR 321 000 000 52/100 000 167 241 Current bystander CPR provision only 121 20 068 208
321 000 000 52/100 000 167 241 Optimized T‐CPR and bystander CPR 3728 61 879
Neuroprognostication26 321 000 000 52/100 000 167 241 WLS <72 41 810 9198 26
321 000 000 52/100 000 167 241 WLS >72 41 810 11 589
Optimizing postarrest care30 321 000 000 52/100 000 167 241 No CRC 8.9 14 884 57
321 000 000 52/100 000 167 241 CRC 14 23 414

Extrapolation conducted similar to that outlined in Elmer et al.26 CPR indicates cardiopulmonary resuscitation; CRC, cardiac receiving center; EMS, emergency medical service; OHCA, out‐of‐hospital cardiac arrest; T‐CPR, telecommunicator CPR; WLS, withdrawal of life support.

Implementation of standards of postarrest care would also have a significant impact. For example, the use of cardiac arrest centers in the Save Hearts in Arizona Registry & Education data set demonstrated a 14% survival rate compared with 8.9% survival of cardiac arrest patients managed at non–cardiac arrest centers.30 Again, assuming 167 000 emergency medical service–treated OHCAs, national implementation of optimized resuscitation care (eg, cardiac arrest receiving centers) would lead to 8500 additional lives saved annually, accounting for a 57% increase in OHCA survival. As a conservative estimate examining only OHCA, focused funding directed at merely 3 of the defined knowledge gaps may lead to a substantial increase in survival of victims of cardiac arrest. Application of the identified themes to in‐hospital cardiac arrest victims would likely lead to even greater increases in survival overall.

We were unable to reach majority consensus for the top 3 themes after 4 rounds, and opinions were unlikely to converge with additional work because of a wide range of opinions. The inability to reach stronger consensus may be related to the cognitive burden of ranking prioritized gaps because there were numerous highly important competing themes. Each theme was clearly selected by the panel because of the high impact of the knowledge gap in improving outcomes for patients and public health. The overall rankings did not concur with experts’ individual rankings of the top 5 themes (Table 2), and no theme achieved strong individual top 5 ranking by >80% of the panel. For example, although many participants highly ranked the gap on optimization of postarrest care, no participant ranked it as the most important theme, decreasing the points to which it was assigned. On the contrary, there was a wide range of rankings for the gap on hemodynamic monitoring for goal‐directed resuscitation during cardiac arrest, but many participants ranked this highly, increasing the overall points assigned. On tasking experts to deterministically rank order this list, it is possible many began to think in a less scientific manner and instead make value decisions on where funding should be spent.

Limitations

A major limitation of the Delphi method is the relatively demanding iterative process. Especially in the modified Internet‐based setting, survey response rates may suffer when surveying over a period of several months. In this evaluation, the initial participation rate from the group of experts was lower than expected, likely because of the cognitive burden of developing a response to an open‐ended question as well as the total time and multiweek participation required for the study (overall participation rate, 22%). Once the panel was developed in round 2, retention remained high (retention rate to round 4, 59%). A more condensed in‐person meeting may have facilitated the consensus‐building process. In addition, the use of recognized experts by recruiting known AHA Guideline writers was a strength of this study; however, purposeful selection of experts for the panel may have allowed for representation and balancing of the wide range of experts in the field. This study was also limited by the inability to reach consensus on the top 3 prioritized list of gaps. The context of the question posed to the expert panel, in terms of impact of these gaps to public health, likely required a value decision leading to differing opinions in the panel and the inability to reach consensus because of the numerous highly important competing themes. Convening an in‐person expert panel could help improve the identification and prioritization of gaps, but may not prevent the value decision inherent in the task.

Conclusion

This evaluation used a modified Delphi technique, leveraging cardiac arrest experts to identify 10 critical knowledge gaps that have the potential to affect public health by improving outcomes from cardiac arrest. Although the expert panel was unable to reach consensus on the prioritization of the top 3 knowledge gaps, this list still provides a valuable resource that may assist researchers, policy makers, and funding agencies in their decision‐making process. Future research should be directed at addressing these gaps to improve the quality of evidence on which we develop resuscitation guidelines.

Disclosures

None.

Supporting information

Data S1. Expert panel participants with declared conflicts of interest.

(J Am Heart Assoc. 2018;7:e008571 DOI: 10.1161/JAHA.118.008571.)

An abstract of this work was presented at the American Heart Association Scientific Sessions, November 11 to 15, 2017, in Anaheim, CA.

References

  • 1. Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, de Ferranti SD, Floyd J, Fornage M, Gillespie C, Isasi CR, Jiménez MC, Jordan LC, Judd SE, Lackland D, Lichtman JH, Lisabeth L, Liu S, Longenecker CT, Mackey RH, Matsushita K, Mozaffarian D, Mussolino ME, Nasir K, Neumar RW, Palaniappan L, Pandey DK, Thiagarajan RR, Reeves MJ, Ritchey M, Rodriguez CJ, Roth GA, Rosamond WD, Sasson C, Towfighi A, Tsao CW, Turner MB, Virani SS, Voeks JH, Willey JZ, Wilkins JT, Wu JH, Alger HM, Wong SS, Muntner P. Heart disease and stroke statistics—2017 update: a report from the American Heart Association. Circulation. 2017;135:e146–e603. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Committee on the Treatment of Cardiac Arrest: Current Status and Future Directions, Board on Health Sciences Policy, Institute of Medicine . Recommendations and Key Opportunities In: Graham R, McCoy MA, Schultz AM, eds. Strategies to Improve Cardiac Arrest Survival: A Time to Act. Washington, DC: National Academies Press (US); 2015:363–394. [PubMed] [Google Scholar]
  • 3. Neumar RW, Shuster M, Callaway CW, Gent LM, Atkins DL, Bhanji F, Brooks SC, de Caen AR, Donnino MW, Ferrer JM, Kleinman ME, Kronick SL, Lavonas EJ, Link MS, Mancini ME, Morrison LJ, O'Connor RE, Samson RA, Schexnayder SM, Singletary EM, Sinz EH, Travers AH, Wyckoff MH, Hazinski MF. Part 1: executive summary: 2015 American Heart Association guidelines update for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2015;132:S315–S367. [DOI] [PubMed] [Google Scholar]
  • 4. Monsieurs KG, Nolan JP, Bossaert LL, Greif R, Maconochie IK, Nikolaou NI, Perkins GD, Soar J, Truhlar A, Wyllie J, Zideman DA. European resuscitation council guidelines for resuscitation 2015: section 1: executive summary. Resuscitation. 2015;95:1–80. [DOI] [PubMed] [Google Scholar]
  • 5. Sasson C, Rogers MA, Dahl J, Kellermann AL. Predictors of survival from out‐of‐hospital cardiac arrest: a systematic review and meta‐analysis. Circ Cardiovasc Qual Outcomes. 2010;3:63–81. [DOI] [PubMed] [Google Scholar]
  • 6. Chan PS, McNally B, Tang F, Kellermann A. Recent trends in survival from out‐of‐hospital cardiac arrest in the United States. Circulation. 2014;130:1876–1882. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Girotra S, Nallamothu BK, Spertus JA, Li Y, Krumholz HM, Chan PS. Trends in survival after in‐hospital cardiac arrest. N Engl J Med. 2012;367:1912–1920. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Morrison LJ, Gent LM, Lang E, Nunnally ME, Parker MJ, Callaway CW, Nadkarni VM, Fernandez AR, Billi JE, Egan JR, Griffin RE, Shuster M, Hazinski MF. Part 2: evidence evaluation and management of conflicts of interest: 2015 American Heart Association guidelines update for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2015;132:S368–S382. [DOI] [PubMed] [Google Scholar]
  • 9. Hazinski MF, Nolan JP, Aickin R, Bhanji F, Billi JE, Callaway CW, Castren M, de Caen AR, Ferrer JM, Finn JC, Gent LM, Griffin RE, Iverson S, Lang E, Lim SH, Maconochie IK, Montgomery WH, Morley PT, Nadkarni VM, Neumar RW, Nikolaou NI, Perkins GD, Perlman JM, Singletary EM, Soar J, Travers AH, Welsford M, Wyllie J, Zideman DA. Part 1: executive summary: 2015 international consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Circulation. 2015;132:S2–S39. [DOI] [PubMed] [Google Scholar]
  • 10. Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manage Sci. 1963;9:458–467. [Google Scholar]
  • 11. McKenna HP. The Delphi technique: a worthwhile research approach for nursing? J Adv Nurs. 1994;19:1221–1225. [DOI] [PubMed] [Google Scholar]
  • 12. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32:1008–1015. [PubMed] [Google Scholar]
  • 13. Linstone HA, Turoff M, eds. The Delphi Method: Techniques and Applications. Reading, MA: Addison‐Wesley Publishing Co; 1975. [Google Scholar]
  • 14. Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311:376–380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. American Heart Association Guideline Committee . 2015 American Heart Association guidelines update for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2015;132:S313–S589. [DOI] [PubMed] [Google Scholar]
  • 16. Paliwoda SJ. Predicting the future using Delphi. Manag Decis. 1983;21:31–38. [Google Scholar]
  • 17. Ludwig B. Predicting the future: have you considered the Delphi methodology? J Ext. 1997;35:1–4. [Google Scholar]
  • 18. Dalkey N. The Delphi method: an experimental study of group opinion In: Dalkey NC, Rourke DL, Lewis R, Snyder D, eds. Studies in the Quality of Life: Delphi and Decision‐Making. Lexington, MA: Lexington Books; 1972:13–54. [Google Scholar]
  • 19. Schmidt RC. Managing Delphi surveys using nonparametric statistical techniques. Decis Sci. 1997;28:763–774. [Google Scholar]
  • 20. Dillman DA, Smyth JD, Christian LM. Internet, Mail, and Mixed‐Mode Surveys: The Tailored Design Method. Hoboken, NJ: Wiley & Sons; 2009. [Google Scholar]
  • 21. Witkin BR, Altschuld JW. Planning and Conducting Needs Assessments: A Practical Guide. Thousand Oaks, CA: SAGE Publications; 1995. [Google Scholar]
  • 22. Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, Wales PW. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67:401–409. [DOI] [PubMed] [Google Scholar]
  • 23. Sathiyakumar V, Blumenthal RS, Nasir K, Martin SS. Addressing knowledge gaps in the 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a review of recent coronary artery calcium literature. Curr Atheroscler Rep. 2017;19:7. [DOI] [PubMed] [Google Scholar]
  • 24. Rich MW, Chyun DA, Skolnick AH, Alexander KP, Forman DE, Kitzman DW, Maurer MS, McClurken JB, Resnick BM, Shen WK, Tirschwell DL; American Heart Association Older Populations Committee of the Council on Clinical Cardiology, Council on Cardiovascular and Stroke Nursing, Council on Cardiovascular Surgery and Anesthesia, and Stroke Council; American College of Cardiology; and American Geriatrics Society . Knowledge gaps in cardiovascular care of the older adult population: a scientific statement from the American Heart Association, American College of Cardiology, and American Geriatrics Society. Circulation. 2016;133:2103–2122. [DOI] [PubMed] [Google Scholar]
  • 25. Kronick SL, Kurz MC, Lin S, Edelson DP, Berg RA, Billi JE, Cabanas JG, Cone DC, Diercks DB, Foster JJ, Meeks RA, Travers AH, Welsford M. Part 4: systems of care and continuous quality improvement: 2015 American Heart Association guidelines update for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2015;132:S397–S413. [DOI] [PubMed] [Google Scholar]
  • 26. Elmer J, Torres C, Aufderheide TP, Austin MA, Callaway CW, Golan E, Herren H, Jasti J, Kudenchuk PJ, Scales DC, Stub D, Richardson DK, Zive DM. Association of early withdrawal of life‐sustaining therapy for perceived neurological prognosis with mortality after cardiac arrest. Resuscitation. 2016;102:127–135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Nichol G, Thomas E, Callaway CW, Hedges J, Powell JL, Aufderheide TP, Rea T, Lowe R, Brown T, Dreyer J, Davis D, Idris A, Stiell I; Resuscitation Outcomes Consortium Investigators . Regional variation in out‐of‐hospital cardiac arrest incidence and outcome. JAMA. 2008;300:1423–1431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Kim F, Nichol G, Maynard C, Hallstrom A, Kudenchuk PJ, Rea T, Copass MK, Carlbom D, Deem S, Longstreth WT Jr, Olsufka M, Cobb LA. Effect of prehospital induction of mild hypothermia on survival and neurological status among adults with cardiac arrest: a randomized clinical trial. JAMA. 2014;311:45–52. [DOI] [PubMed] [Google Scholar]
  • 29. American Heart Association . Telephone CPR (T‐CPR) program recommendations and performance measures. Available at: https://cpr.heart.org/AHAECC/CPRAndECC/ResuscitationScience/TelephoneCPR/RecommendationsPerformanceMeasures/UCM_477526_Telephone-CPR-T-CPR-Program-Recommendations-and-Performance-Measures.jsp. Accessed June 11, 2018.
  • 30. Spaite DW, Bobrow BJ, Stolz U, Berg RA, Sanders AB, Kern KB, Chikani V, Humble W, Mullins T, Stapczynski JS, Ewy GA. Statewide regionalization of postarrest care for out‐of‐hospital cardiac arrest: association with survival and neurologic outcome. Ann Emerg Med. 2014;64:496–506.e491. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data S1. Expert panel participants with declared conflicts of interest.


Articles from Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease are provided here courtesy of Wiley

RESOURCES