Background
Unintentional injury is the leading cause of death for most age groups in the United States and is the 4th leading cause of death for all age groups combined.1 The availability and quality of prehospital trauma care can have a great impact on survival. Hemorrhage, for example, is a leading cause of trauma death prior to arrival at a hospital. It is estimated that 30–40% of trauma mortality is due to hemorrhagic shock, and hemorrhage plays a role in 33–56% of trauma fatalities that occur in the prehospital setting.2,3 Recognition of this fact has led to initiatives such as the Department of Homeland Security’s “Stop the Bleed” campaign that encourages bystander action prior to the arrival of medical personnel.4 Equipping prehospital healthcare providers (PHPs) to succeed is essential to ensuring optimal patient outcomes.
The military has a wealth of experience with prehospital trauma care. Many United States military units have implemented training called “Tactical Combat Casualty Care” which aims to decrease mortality from potentially survivable combat injuries.5 One illustrative example of the efficacy of this training comes from data from the Army Rangers. Since 1998, all members of the 75th Ranger Regiment have undergone prehospital trauma care training. There is a particular emphasis on extremity hemorrhage, tension pneumothorax, and airway obstruction – medical emergencies that can often be rapidly stabilized with proper care. A retrospective review of almost ten years of combat casualties conducted by Kotwal et al.5 in 2011 revealed that this regiment has a decreased rate of soldiers who are killed in action and die of wounds compared to the rest of the Department of Defense. Notably, none of the regiment’s deaths were from the three potentially survivable causes of death emphasized by the training program. This study gives credence to training all service members with a special emphasis on care of life-threatening injuries that can be managed with relatively simple maneuvers.
Our institutions have recently been involved in the development of simulation models to train military personnel. Historically, a large portion of military trauma care training utilized animal models, such as anesthetized goats. Animal models face inherent challenges such as animal safety and care. A polytrauma simulation model, dubbed “Frank-N-Stein”, was therefore developed. Sweet et al. compared the use of an animal model to use of this simulation model in the training of 590 combat medics, and they found no difference in the assessment performance based on the type of model used in the training.6
The purpose of our study was to evaluate the applicability of critical skills training focused on the treatment of potentially survivable injuries and assessment using a simulation model in the civilian population. The initial step in this investigation was to assess the baseline proficiency of PHPs utilizing a simulation model.
Methods
This prospective cohort study was conducted with PHPs (both nurses and paramedics) employed by North Memorial Health (Robbinsdale, MN) undergoing their annual skills training in January and February of 2016. The study size was therefore determined by convenience sampling. Study approval was granted by the Institutional Review Board of North Memorial Health. Providers from ground and flight crews were represented. Each participant was asked to provide care to a patient suffering from injuries after a grain bin explosion. The PHPs were provided a stocked equipment bag and were asked to provide interventions as they would in the field. An assistant to the PHP was present but could only assist as directed by the PHP. The providers had previously received all institutionally-required skills training, including education in Massive Hemorrhage, Airway, Respiration, Circulation, Head, and Hypothermia (MARCH) principles.
The first module assessed performance on hemorrhage control measures in the setting of a groin wound and lower limb amputation. It involved a live actor wearing the Frank-N-Stein model. The model consists of multiple elements. The upper portion is a cut suit that a live actor can wear (Strategic Operations, San Diego, CA). The lower portion of the model simulated groin hemorrhage and a traumatic amputation (Trauma F/X® HEMO, Kforce Government Solutions, Inc., Fairfax, VA). Hemorrhage occurred through both the groin wound and the stump of the amputated limb via a mechanical pump with bleeding rates set using the manikin’s software, as established by the manufacturer in collaboration with the U.S. Army Institute of Surgical Research. This composite simulation model can be utilized to demonstrate other injuries such as bowel evisceration and airway obstruction. For the purpose of the first module, we analyzed only the six measures related to hemorrhage control (Table 1). These measures were developed based on standards of care from military training experience as well as standard guidelines established by North Memorial Health for their PHPs.
TABLE 1.
Successful performance of hemorrhage control measures.
| Measure | n (total*) | % of total |
|---|---|---|
| Hemorrhage control initiation within one minute | 37 (95) | 38.9 |
| Application of a tourniquet within two minutes | 84 (95) | 88.4 |
| Placement of wound packing | 74 (92) | 80.4 |
| Hemorrhage control within ten minutes | 48 (92) | 52.2 |
| Consideration/administration of packed red blood cells | 55 (94) | 58.5 |
| Consideration/administration of tranexamic acid | 58 (93) | 62.4 |
This number represents the number of participants with complete data for given measure.
The second module involved airway management. The participating PHP was brought from the setting of the hemorrhage control module to the transport vehicle (either a helicopter or ambulance dependent on the participant’s usual mode of transport). A simulation mannequin (SimMan® 3G, Laerdal Medical, Wappingers Falls, NY) was present, and the PHP was informed that the patient had stopped communicating. A direct laryngoscope (DL) was present, but the batteries had been installed incorrectly and thus the light did not function. The alternative advanced airways available for use were a video laryngoscope (VL) and supraglottic airways (SGA) (King, Ambu, Ballerup, Denmark; i-gel®, Intersurgical Ltd, Berkshire, UK).
The evaluation tool was adapted from an instrument (the Medical Simulation Combat Casualty Training Consortium Assessment Instrument) previously developed and validated at the University of Minnesota to assess performance in polytrauma scenarios.7 The tool included eight items with global rating scales used to generate the participant’s global rater score (Table 2). The total point scale ranged from 5 to 40. In addition to awarding an overall score of performance, task completion was also noted for participant education and feedback as well as to inform the scoring on the evaluation tool. Multiple tasks were tracked including the hemorrhage control measures detailed in Table 1 as well as tasks related to airway management (i.e. successful airway placement, achievement of bilateral chest rise after airway placement). The total blood volume loss was measured by the quantity of simulated blood lost from the model reservoir. The model contains sensors that stop blood flow when the appropriate pressure is applied (i.e. by direct pressure, wound packing, tourniquet application). There was one tourniquet available to the participants. Of note, if the hemorrhage was not controlled within ten minutes, the hemorrhage was stopped by remote means, and the PHP was directed to move on to the next module. The participants were evaluated by two trained judges. The judges were paramedics who had underwent training for rating the performance of military medics in hemorrhage control, and each had four years of experience in evaluating military prehospital providers. The evaluation tool utilized had previously been rigorously tested to determine its inter-rater reliability.7
TABLE 2.
Evaluation tool used to generate the global rater score.
| 1. Handling Equipment and Supplies | ||||
| (1) Clumsy, chose wrong tools, struggled with bags | (2) | (3) Hesitant, usually chose correct tools, basically had the correct bags | (4) | (5) Confident, chose correct tools, efficient with bags |
| 2. Smoothness, Economy of Motion | ||||
| (1) Many unnecessary moves, frequent start and stop, restless hands | (2) | (3) Some unnecessary moves, reasonably efficient, somewhat calm hands | (4) | (5) Few or no unnecessary moves, efficient, calm and confident hands |
| 3. Controlled Pace | ||||
| (1) All rushed or slow, pace unrelated to task | (2) | (3) Mixture of paces, pace somewhat related to task | (4) | (5) Quick when required, slow when needed, pace related to task |
| 4. Controlled Force | ||||
| (1) Too aggressive/tentative, force unrelated to task | (2) | (3) Mixture of force, force somewhat related to task | (4) | (5) Forceful when needed, gentle when needed, force related to task |
| 5. Thinking Like a Medic | ||||
| (1) Poor sequence of tasks, rarely verified results, no reassessment | (2) | (3) Ok sequence of tasks, some verification of results, some reassessment | (4) | (5) Optimum sequence, always verified results, constant reassessment |
| 6. Working Under Stress | ||||
| (1) Poor error recovery, couldn't improvise, many breaks in focus | (2) | (3) Some error recovery, some ability to improvise, few breaks in focus | (4) | (5) Excellent error recovery, high ability to improvise, rare breaks in focus |
| 7. Leadership | ||||
| (1) Poor communicator, awareness, and use of assets; indecisive | (2) | (3) Adequate communicator, awareness, and use of assets; adequate leader | (4) | (5) Excellent communicator, awareness, and use of assets; decisive |
| 8. Communication with Patient | ||||
| (1) No reassurance, instructions, or chatter | (2) | (3) Moderate reassurance, instructions, and chatter | (4) | (5) Continuous reassurance, instructions, and chatter |
In addition, the participants completed surveys before and after training reporting their comfort level with the key skills tested (namely, tourniquet use, wound packing, endotracheal intubation, and SGA placement). The PHPs ranked their comfort level on a scale from 1 to 5 (1 = “weak” and 5 = “confident”).
Data analysis was conducted using SPSS Statistics 23 (IBM, Inc., Somers, NY) and the R statistical software package (R Foundation for Statistical Computing, Vienna, Austria). Binomial logistic regression was implemented to assess the relationship between the PHP’s background (profession, years of prehospital experience, and past military experience) and the successful performance of the six hemorrhage control measures. Total blood volume loss and global rater score were compared using Pearson correlation testing. Chi-square testing was used to assess changes in comfort level between pre- and post-training. Participants with missing, duplicate, or otherwise inadequate data for a particular measure were excluded from analysis for that measure.
Results
Demographics
There were 95 participants, including both nurses (n = 45) and paramedics (n = 50) (Table 3). The range of prehospital experience was 1 to 39 years; the mean was 15.9 ± 8.3 years. The majority of participants (93%) did not have previous military training. A pre-assessment survey revealed that 17% (n=16) of the participants had placed a tourniquet while on-duty in the prior six months. Furthermore, 64% of the PHPs had placed an endotracheal tube in the prior six months however only 29% of the PHPs had placed a SGA.
TABLE 3.
Background of study participants (n=95).
| n (%) or mean ± SD | |
|---|---|
| Profession | |
| Nurse | 45 (47.4) |
| Air | 36 (37.9) |
| Ground | 9 (9.5) |
| Paramedic | 50 (52.6) |
| Air | 28 (29.5) |
| Ground | 22 (23.2) |
| Prehospital experience (years) | 15.9 ± 8.3 |
| Previous military tourniquet training | |
| Yes | 7 (7.4) |
| No | 88 (92.6) |
Hemorrhage Control Performance
Successful performance of the outlined measures ranged from 38.9% to 88.4% of participants (Table 1). The participants performed the best on prompt tourniquet application (successful performance by 88.4%) and placement of wound packing (80.4%). The poorest performance was seen in initiation of hemorrhage control within one minute (38.9%) and control of hemorrhage within ten minutes (52.2%).
Using binomial logistic regression, we assessed the performance of the hemorrhage control measures in relation to the participants’ background, including profession (nurse versus paramedic), years of prehospital experience, and past military experience (Table 4). The analysis revealed that profession was a significant predictor of consideration of a blood transfusion before a fluid bolus (p=0.011) and consideration of tranexamic acid (p=0.016). In addition, previous military training impacted the performance of the same two measures with p values of 0.033 and 0.028, respectively. Paramedics were less likely to consider a blood transfusion before a fluid bolus (odds ratio [confidence interval], 0.305 [0.123–0.760]) as well as being less likely to consider tranexamic acid (0.315 [0.123–0.804]). Participants with previous military training were less likely to perform the same two measures (0.083 [0.008–0.813] and 0.073 [0.007–0.075], respectively).
TABLE 4.
Results of logistic regression analyzing association of participant background to performance.
| Participant background | Hemorrhage control measure | p value | ORa (95% CI) |
|---|---|---|---|
| Profession (paramedicb vs nurse) | Hemorrhage control attempt within 1 minute | 0.395 | |
| Tourniquet application within 2 minutes | 0.599 | ||
| Placement of wound packing | 0.827 | ||
| Hemorrhage control within 10 minutes | 0.576 | ||
| Blood transfusion considered before fluid bolus | 0.011 | 0.305 (0.123–0.760) | |
| Tranexamic acid considered | 0.016 | 0.315 (0.123–0.804) | |
| Years of prehospital experience | Hemorrhage control attempt within 1 minute | 0.948 | |
| Tourniquet application within 2 minutes | 0.984 | ||
| Placement of wound packing | 0.694 | ||
| Hemorrhage control within 10 minutes | 0.549 | ||
| Blood transfusion considered before fluid bolus | 0.703 | ||
| Tranexamic acid considered | 0.520 | ||
| Previous military tourniquet training (yesb vs no) | Hemorrhage control attempt within 1 minute | 0.991 | |
| Tourniquet application within 2 minutes | 0.992 | ||
| Placement of wound packing | 0.668 | ||
| Hemorrhage control within 10 minutes | 0.182 | ||
| Blood transfusion considered before fluid bolus | 0.033 | 0.083 (0.008–0.813) | |
| Tranexamic acid considered | 0.028 | 0.073 (0.007–0.075) |
Reported for significant findings in logistic regression.
Reference group.
OR, odds ratio. CI, confidence interval.
The median total blood volume loss in the scenario was 1700 milliliters (IQR, 1043–2000). The mean global rater score was 25.0 ± 7.4. The global rater score did negatively correlate with the total blood volume loss when evaluated with Pearson correlation testing (r = −0.59, n = 88, p = 1.93 × 10−9), providing additional support to the validity of the evaluation tool utilized in this study (Figure 1).
FIGURE 1.
Correlation of global rater score and total blood volume loss (r = −0.59, n = 88, p = 1.93 × 10−9).
Airway Management Performance
Seven participants were excluded from analysis for this module due to incomplete data. After forced failure of DL, 58% of the PHPs elected to use VL for endotracheal intubation while the remaining 42% chose to utilize a SGA. Regardless of alternate advanced airway selected, 86% of the participants obtained bilateral chest rise in the simulation mannequin after airway placement. Sixty-four percent of PHPs secured the airway on the first VL or SGA attempt (Table 5). The selection of VL versus SGA and number of attempts to successful airway placement were similar between nurses and paramedics.
TABLE 5.
Number of attempts until airway secured (n=88).
| Attempts | n (%) |
|---|---|
| 1 | 56 (63.6) |
| 2 | 18 (20.5) |
| 3 | 12 (13.6) |
| 4 | 2 (2.3) |
Participant Confidence
Comfort levels reported by the PHPs improved after training for each of the skills of inquiry (Figure 2). The participants’ confidence rating for wound packing after training was significantly different from baseline (p=0.0292).
FIGURE 2.
Participant reported comfort level with skills rated on a scale of 1 (“weak”) to 5 (“confident”), before and after modules. *p<0.05. SGA, supraglottic airway.
Discussion
Simulation model training is an important component in the education of healthcare professionals. Many studies have reported on the efficacy of simulation models.8–10 The military has also had growing interest in the utilization of simulation models.6,8 To optimize efficacy and enhance feasibility, prehospital trauma training should also focus on improved simulation models. Given the key role that trauma care plays for medics in the armed forces as well as civilian prehospital healthcare providers (i.e. paramedics, emergency medical technicians), it was a natural progression to move from the military population to test the relevance of the polytrauma simulation model in the training of civilian PHPs.
A key finding in our study was the deficiencies in the readiness of PHPs in hemorrhage control measures with less than two-thirds of participants successfully performing four of the six measures. This finding suggests need for improvement in the initial training of PHPs in addition to the potential initiation of remediation training when insufficient skills are identified. In 2014, the American College of Surgeons Committee on Trauma published guidelines for the prehospital care of external hemorrhage.11 In their review, the recommendation best supported by the literature was the use of tourniquets for the control of significant extremity hemorrhage. There is growing adoption of tourniquet use in civilian practice, and evidence exists of the safe and appropriate use of tourniquets in the prehospital civilian setting.12,13 Notable gaps in the literature were appreciated in regards to topical hemostatic agents although such measures are regularly employed in military operations.14 Many of the recent studies related to prehospital care of traumatic hemorrhage focus on the resuscitation product.15–18 In addition to these efforts, given our experience in the assessment of PHPs, it is necessary to continue to develop and to validate improved training methods and simulation models.
We found that paramedics were less likely than nurses to consider the use of a blood transfusion before a fluid bolus in the setting of life-threatening hemorrhage (OR 0.305 [0.123–0.760]). Paramedics were also less likely to consider tranexamic acid (OR 0.315 [0.123–0.804]). The reason for this is unclear. A potential explanation could be a difference in training methods at some point in their careers. Also, 80% of the nurses were flight nurses. There could be a distinction in training based on flight versus ground crews. Our other significant finding was that participants who reported previous training in the military (namely tourniquet training) were less likely to consider a blood transfusion before a fluid bolus (OR 0.083 [0.008–0.0813]) as well as tranexamic acid (OR 0.073 [0.007–0.075]). We do not have additional data on the extent of military experience for the 7 participants who reported previous military tourniquet training therefore it is difficult to ascertain what may have contributed to this difference.
The difficulty of the airway management module was intentionally augmented to assess the participants’ decision-making and fluidity with various airway adjuncts. Ultimately, 86% of the PHPs were able to secure an airway successfully as evidenced by bilateral chest rise in the mannequin. We did not assess the PHPs ability to place an endotracheal tube utilizing DL. Ideally, successful airway placement using DL or other airway adjuncts should approach 100%.
There are limitations to the current study. We did not have a control group to compare hemorrhage control performance on the model to the traditional PHP training and assessment. Furthermore, although skills in hemorrhage control are crucial for any PHP to develop and to maintain, extremity hemorrhage accounts for fewer prehospital deaths in the civilian population than is appreciated in the military.19 An emphasis on extremity hemorrhage, therefore, perhaps has a different training priority in civilian versus military populations. The coverage area for the PHPs participating in this study however does include a significant portion of agricultural land, and agricultural work carries the risk of limb injury and traumatic amputation.20–22 In addition, although the scenario was created as realistically as possible, we cannot determine with certainty that participant performance in our simulation scenario is comparable to how the participant would perform in the field. The Hawthorne effect concerns research participation, the consequent awareness of being studied, and possible impact on behavior.23 Although this effect cannot be completely eliminated in simulation scenarios, attempts to mitigate observation bias included the creation of a realistic prehospital environment and deliberate instruction of PHPs to provide interventions as they would in the field.
Conclusion
PHPs are on the frontline of trauma care, and we must equip them to succeed. Given the military’s recent successes in training to prevent death from potentially survivable combat injuries, there is a great opportunity to translate these efforts to the civilian population through improved training for our PHPs.
Acknowledgments
The authors express their gratitude to the prehospital healthcare providers from North Memorial Health who participated in this study.
Footnotes
Author Contribution: MS analyzed the data and wrote the manuscript. SW, KM, and GB were involved in study design and participant evaluation. BB partook in simulation model development and participant evaluation. EL provided assistance with data analysis. All authors participated in manuscript review and revision.
References
- 1.National Center for Injury Prevention and Control (NCIPC) Web-based Injury Statistics Query and Reporting System. Centers for Disease Control and Prevention; Atlanta, GA: [Accessed October 10, 2017]. Available at: https://webappa.cdc.gov/cgi-bin/broker.exe. [Google Scholar]
- 2.El Sayad M, Noureddine H. Recent advances of hemorrhage management in severe trauma. Emerg Med Intl. 2014;2014:638956. doi: 10.1155/2014/638956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kauvar DS, Lefereing R, Wade CE. Impact of hemorrhage on trauma outcomes: an overview of epidemiology, clinical presentations, and therapeutic considerations. J Trauma. 2006;60:S3–11. doi: 10.1097/01.ta.0000199961.02677.19. [DOI] [PubMed] [Google Scholar]
- 4.Goolsby C, Branting A, Chen E, Mack E, Olsen C. Just-in-time to save lives: a pilot study of layperson tourniquet application. Acad Emerg Med. 2015;9:1113–1117. doi: 10.1111/acem.12742. [DOI] [PubMed] [Google Scholar]
- 5.Kotwal RS, Montgomery HR, Kotwal BM, Champion HR, Butler FK, Mabry RL, Cain JS, Blackbourne LH, Mechler KK, Holcomb JB. Eliminating preventable death on the battlefield. Arch Surg. 2011;146(12):1350–1358. doi: 10.1001/archsurg.2011.213. [DOI] [PubMed] [Google Scholar]
- 6.Sweet RM, Rule GT, Chipman JG, Hart D, Rush R, Beilman G, Clinton J, Anders S, Brown R, Reihsen T, et al. Teaching and evaluating traumatic hemorrhage: comparison of a synthetic versus live tissue model; Talk presented at: Military Health System Research Symposium; August 2016; Orlando, FL. [Google Scholar]
- 7.Schmitz CC, Chipman JG, Yoshida K, Isaksson Vogel R, Sainfort F, Beilman G, Clinton J, Cooper J, Reihsen T, Sweet RM. Reliability and validity of a test designed to assess combat medics' readiness to perform life-saving procedures. Mil Med. 2014;179(1):42–48. doi: 10.7205/MILMED-D-13-00247. [DOI] [PubMed] [Google Scholar]
- 8.Mabry RL. Use of hemorrhage simulator to train military medics. Mil Med. 2005;170(11):921–925. doi: 10.7205/milmed.170.11.921. [DOI] [PubMed] [Google Scholar]
- 9.Maricic MA, Bailez MM, Rodriguez SP. Validation of an inanimate low cost model for training minimal invasive surgery (MIS) of esophageal atresia with tracheoesophageal fistula (AE/TEF) repair. J Pediatr Surg. 2016;51:1429–1435. doi: 10.1016/j.jpedsurg.2016.04.018. [DOI] [PubMed] [Google Scholar]
- 10.Izawa Y, Hishikawa S, Muronoi T, Yamashita K, Maruyama H, Suzukawa M, Lefor AK. Ex-vivo and live animal models are equally effective training for the management of a penetrating cardiac injury. World J of Emerg Surg. 2016;11:45. doi: 10.1186/s13017-016-0104-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Bulger EM, Snyder D, Schoelles K, Gotschall C, Dawson D, Lang E, Sanddal ND, Butler FK, Fallat M, Taillac P, et al. An evidence-based prehospital guideline for external hemorrhage control: American College of Surgeons Committee on Trauma. Prehosp Emerg Care. 2014;18(2):163–173. doi: 10.3109/10903127.2014.896962. [DOI] [PubMed] [Google Scholar]
- 12.El Sayed MJ, Tamim H, Mailhac A, Mann NC. Trends and predictors of limb tourniquet use by civilian emergency medical services in the United States. Prehosp Emerg Care. 2017;21:54–62. doi: 10.1080/10903127.2016.1227002. [DOI] [PubMed] [Google Scholar]
- 13.Scerbo MH, Mumm JP, Gates K, Love JD, Wade CE, Holcomb JB, Cotton BA. Safety and appropriateness of tourniquets in 105 civilians. Prehosp Emerg Care. 2016;20:712–722. doi: 10.1080/10903127.2016.1182606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Littlejohn L, Bennett B, Drew B. Application of current hemorrhage control techniques for backcountry care: part two, hemostatic dressings and other adjuncts. Wilderness Environ Med. 2015;26(2):246–254. doi: 10.1016/j.wem.2014.08.018. [DOI] [PubMed] [Google Scholar]
- 15.Mulier KE, Lexcen DR, Luzcek E, Greenberg JJ, Beilman GJ. Treatment with beta-hydroxybutyrate and melatonin is associated with improved survival in a porcine model of hemorrhagic shock. Resuscitation. 2012;83(2):253–258. doi: 10.1016/j.resuscitation.2011.08.003. [DOI] [PubMed] [Google Scholar]
- 16.Wolf A, Mulier KE, Iyegha UP, Asghar AI, Beilman GJ. Safety of D-β-hydroxybutyrate and melatonin for the treatment of hemorrhagic shock with polytrauma. Shock. 2015;44:79–89. doi: 10.1097/SHK.0000000000000315. [DOI] [PubMed] [Google Scholar]
- 17.Brown JB, Guyette FX, Neal MD, Claridge JA, Daley BJ, Harbrecht BG, Miller RS, Phelan HA, Adams PW, Early BJ, et al. Taking the blood bank to the field: the design and rationale of the prehospital air medical plasma (PAMPer) trial. Prehosp Emerg Care. 2015;19(3):343–350. doi: 10.3109/10903127.2014.995851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Fischer PE, Bulger EM, Perina DG, Delbridge TR, Gestring ML, Fallat ME, Shatz DV, Doucet J, Levy M, Stuke L, et al. Guidance document for the prehospital use of tranexamic acid in injured patients. Prehosp Emerg Care. 2016;20:557–559. doi: 10.3109/10903127.2016.1142628. [DOI] [PubMed] [Google Scholar]
- 19.Dorlac WC, DeBakey ME, Holcomb JB, Fagan SP, Kwong KL, Dorlac GR, Schreiber MA, Persse DE, Moore FA, Mattow KL. Mortality from isolated civilian penetrating extremity injury. J Trauma. 2005;59(1):217–222. doi: 10.1097/01.ta.0000173699.71652.ba. [DOI] [PubMed] [Google Scholar]
- 20.Boyle D, Parker D, Larson C, Pessoa-Brandao L. Nature, incidence, and cause of work-related amputations in Minnesota. Am J Ind Med. 2000;37:542–550. doi: 10.1002/(sici)1097-0274(200005)37:5<542::aid-ajim10>3.0.co;2-w. [DOI] [PubMed] [Google Scholar]
- 21.Gross N, Young T, Ramirez M, Leinenkugel K, Peek-Asa C. Characteristics of work- and non-work-related farm injuries. J Rural Health. 2015;31:401–409. doi: 10.1111/jrh.12121. [DOI] [PubMed] [Google Scholar]
- 22.Yaffe MA, Kaplan FT. Agricultural injuries to the hand and upper extremity. J Am Acad Orthop Surg. 2014;22:605–613. doi: 10.5435/JAAOS-22-10-605. [DOI] [PubMed] [Google Scholar]
- 23.McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67:267–277. doi: 10.1016/j.jclinepi.2013.08.015. [DOI] [PMC free article] [PubMed] [Google Scholar]


