Abstract
An outbreak of community-associated methicillin-resistant Staphylococcus aureus (CA-MRSA) skin infections was observed in a population of U.S. military trainees in the summer of 2002. A questionnaire was developed and administered to 206 trainees, 22 of whom had MRSA infections. Factors associated with infection were described by multivariable logistic regression modeling and included having a roommate in training with a prior skin infection (odds ratio [OR] = 3.44) or having a family member or friend who worked in a health care setting (OR = 2.79). Previous antibiotic use, hospitalization, or health problems were not associated with MRSA infection. This outbreak of MRSA skin infections in an otherwise-healthy, well-defined, military population provided an opportunity to describe risk factors for CA-MRSA which may help focus prevention efforts in this and other communities.
Mounting evidence has confirmed that methicillin-resistant Staphylococcus aureus (MRSA), once based almost exclusively in health care facilities, is emerging as a community-based pathogen. Recent reports indicate that the prevalence of community-associated MRSA (CA-MRSA) infections is increasing (1, 4, 14, 17, 18, 22, 26), but even more concerning are the recent, numerous CA-MRSA outbreaks in groups of young, healthy individuals with no direct ties to health care facilities and none of the typical risk factors for infection (6-10, 15, 16, 20, 24).
Among the risk factors for CA-MRSA infection identified in previous investigations are prior antibiotic use, prior hospitalization, close contact with an MRSA-infected or -colonized individual, injection drug use, and underlying illnesses (3, 5, 11, 27-29, 31). As CA-MRSA infections continue to become more widespread, additional investigation into the risk factors for infection will be vital to the development and implementation of effective prevention and control measures. In this investigation, we examined potential risk factors for CA-MRSA infection in a population of military trainees.
MATERIALS AND METHODS
Population.
Young, healthy males who were enrolled in a 26-week, physically demanding military training program comprised the population for this investigation. During the course of the program, trainees lived and worked closely together and rarely left the training facility. As a result of this closed environment, trainees experienced relatively uniform exposures. Due to their frequent contact with sand, boats, equipment, and seawater during their training regimen, trainees historically experienced a high occurrence of skin abrasions (L. Garsha [U.S. Navy, San Diego, Calif.], personal communication, Sept. 2002).
Outbreak identification.
The first MRSA case was identified by the presence of cellulitis and a positive wound culture on 2 August 2002. Between 2 August and 28 October 2002 (12 weeks), a total of 34 MRSA skin infections were confirmed (Fig. 1). Four of those infections occurred in trainees that had experienced a previous MRSA infection during this same 12-week period, and these were identified as repeat infections. The incidence of MRSA skin infection during this period was calculated as 9.5 cases per 1,000 person-weeks. This was considered markedly higher than the baseline rate of cellulitis in this population, estimated at 3 cases per 1,000 person-weeks (L. Garsha, personal communication).
Laboratory methods.
Staphylococcal isolates from binasal swab specimens and wound cultures were sent to the Department of Defense Center for Deployment Health Research, San Diego, Calif., for additional molecular epidemiology analysis.
Clinical isolates were confirmed to be S. aureus by colony morphology, Gram stain, positive MRSA latex agglutination (Oxoid), and positive tube coagulase tests. In addition, a multiplex PCR was used to detect the mecA and nucA genes to confirm identification of MRSA isolates (21).
The susceptibilities of these MRSA isolates to different antibiotics were determined by the broth microdilution method following the recommendations of the National Committee for Clinical Laboratory Standards guidelines (23). Penicillin, trimethoprim-sulfamethoxazole, levofloxacin, clindamycin, erythromycin, ceftriaxone, rifampin, tetracycline, and vancomycin were tested. Additional resistance determinations for mupirocin and oxacillin were performed with the E-test (AB Biodisk, Solna, Sweden) method. Resistance to oxacillin was defined as an MIC of ≥4 μg/ml. S. aureus ATCC 25912 and S. aureus ATCC 43300 were used as control strains susceptible and resistant to methicillin, respectively.
Clinical isolates were further evaluated by molecular methods for the presence of the Panton-Valentine leukocidin (PVL) gene, and sequence type (ST) was determined using the multilocus sequence typing method (12, 13, 19, 21).
Outbreak intervention.
During the course of the outbreak, trainees and staff had their nares cultured several times to identify potential sources of MRSA carriage in this population. In addition, several measures were implemented in the trainee population to reduce the spread of infection. All trainees were required to apply mupirocin to their nares and to bathe with an antimicrobial skin cleanser on three separate occasions. In addition, the barracks were routinely disinfected with a 5% bleach solution.
Postoutbreak survey.
As part of the outbreak investigation, a postoutbreak survey was developed to describe potential risk factors for CA-MRSA infection in this population. An optically scannable questionnaire was administered to 206 military trainees, representing approximately 70% of the available military trainee population, in October 2002.
Data captured by the survey included demographic characteristics and medical characteristics, including prior antibiotic use, prior hospitalizations, medications, allergies, and past medical history. Past medical history included questions about prior skin conditions. Trainees were also asked to provide information about dietary supplement use, tobacco and alcohol use, travel history, whether their roommate had been treated for a skin infection, whether any members of their crew had been treated for a skin infection, whether they had a family member or friend who worked in a health care setting, and whether they had a family member who had recently been hospitalized or had an outpatient procedure.
Self-reported data on prior hospitalizations, prior antibiotic use, and medication allergies were verified by medical records.
Statistical analyses.
After descriptive investigation of population characteristics, analyses were performed to assess the significance of associations between the outcome (MRSA infection) and demographic and exposure variables. Using regression diagnostics, colinearity among variables was assessed. A manual backward stepwise logistic regression was conducted, with variables considered for inclusion in the model if initial significance was characterized by P values of <0.15 from the univariate analysis. All covariates were investigated as possible confounders prior to removing them from further modeling. Multivariable logistic regression modeling was performed; the reduced model included only those variables with significance characterized by a P value of <0.05 or otherwise identified as possible confounders. Results were reported as odds ratios (ORs) and 95% confidence intervals (CIs) calculated for variables associated with MRSA infection. SAS software (version 8.0; SAS Institute, Cary, N.C.) was used for analyses.
This research was conducted in compliance with all applicable federal regulations governing the protection of human subjects in research.
RESULTS
Based on testing of nasal swab specimens and wound cultures, military trainees were classified as MRSA infected, MRSA colonized, or MRSA negative. Trainees who had a skin infection and tested positive for MRSA by wound culture of the infected area were classified as MRSA infected. Trainees who did not have a skin infection but whose nasal swab specimen tested positive for MRSA were classified as MRSA colonized. Trainees who did not have a skin infection and whose nasal swab specimen did not test positive for MRSA were classified as MRSA negative. Of the 206 military trainees surveyed, 10.7% (n = 22) were MRSA infected, 1.9% (n = 4) were MRSA colonized, and 87.4% (n = 180) were MRSA negative. Due to the small number, data from the four MRSA-colonized individuals were not included in further statistical analyses, although the complete laboratory testing battery was performed on the isolates.
Questionnaire data for the remaining 202 trainees indicated that 77.2% were Caucasian, 67.4% were younger than 25 years old, 32.2% reported antibiotic use within the past 12 months, 16.8% reported a hospitalization within the past 24 months, 6.5% reported current dietary supplement use, 43.1% reported any tobacco use, and 46.5% reported current alcohol use (Table 1).
TABLE 1.
Variable | Total no. (%) | No. (%) among MRSA infected | OR (CI)a |
---|---|---|---|
Race or ethnicity | NSS | ||
Caucasian | 156 (77.2) | 17 (77.3) | |
Other | 46 (22.8) | 5 (22.7) | |
Age (yrs) | NSS | ||
<21 | 50 (24.8) | 8 (36.4) | |
21-25 | 86 (42.6) | 7 (31.8) | |
>25 | 66 (32.7) | 7 (31.8) | |
Antibiotic use within past 12 mos | 65 (32.2) | 5 (22.7) | NSS |
Hospitalization within past 24 mos | 34 (16.8) | 3 (13.6) | NSS |
Currently taking a dietary supplement | 13 (6.5) | 1 (4.6) | NSS |
Any past or current tobacco use | 87 (43.1) | 11 (50) | NSS |
Current alcohol use | 94 (46.5) | 10 (45.5) | NSS |
Having roommate during training with prior skin infection | 49 (24.3) | 11 (50) | 3.44 (1.34, 8.85) |
Having family member or friend who worked in healthcare setting | 56 (27.7) | 11 (50) | 2.79 (1.09, 7.15) |
Having parent or member of household who smoked during respondent's childhood | 77 (38.1) | 3 (13.6) | 0.26 (0.07, 0.94) |
Adjusted OR and 95% CI based on multivariable logistic regression modeling. NSS, not statistically significant.
The variables identified through univariate analyses as being significantly associated with MRSA infection included antibiotic use within the 12 months prior to training (P = 0.123), dietary supplement use prior to training (P = 0.110), having a roommate in training with a prior skin infection (P = 0.003), having a family member or friend who worked in a health care setting (P = 0.013), and having a parent or member of the household who smoked during the trainee's childhood (P = 0.007). Two variables were identified in the reduced logistic regression model as having a significant positive association with MRSA infection. Military trainees who reported having a roommate in training with a prior skin infection had 3.4 times higher odds of becoming infected with MRSA than trainees who did not report having a roommate with a skin infection (OR = 3.44; 95% CI, 1.34 to 8.85). Trainees who reported having a family member or friend who worked in a health care setting had 2.8 times higher odds of becoming infected with MRSA than trainees who did not report such ties to the health care field (OR = 2.79; 95% CI, 1.09 to 7.15) (Table 1). Conversely, having a parent or other household member who smoked during the trainee's childhood was negatively associated with MRSA infection; trainees who reported this appeared less likely to develop an MRSA infection than those who did not report such environmental tobacco exposure (OR = 0.26; 95% CI, 0.07 to 0.94).
Laboratory results.
Staphylococcal isolates from all 22 MRSA-infected individuals tested positive for the mecA and PVL genes. In addition, all 22 isolates were identified as ST8 by multilocus sequence typing. Three of the four isolates from MRSA-colonized individuals were also identified as ST8, while the remaining isolate was identified as ST30. Antibiotic susceptibility testing showed resistance of all isolates to oxacillin, penicillin, erythromycin, and ceftriaxone. The isolates were susceptible to all other antibiotics tested.
DISCUSSION
The steady increase in reports of CA-MRSA outbreaks in young, healthy populations with no apparent risk factors for infection is concerning. With each outbreak, it is important to determine the possible risk factors for infection in order to focus prevention and control efforts.
This outbreak of CA-MRSA occurred in a young, healthy, and well-defined population of military trainees. During the course of their 26-week intense training regimen, these trainees lived and worked closely together. In this environment, a small number of initial MRSA cases quickly became noticed as an outbreak.
The control measures implemented within this military trainee population during the summer and fall of 2002 were apparently effective in stopping the MRSA outbreak. During its 12-week course, however, the affected population incurred a high cost from infections. At least six trainees were hospitalized due to their MRSA infection, and eight trainees were unable to complete their original training program and therefore had to restart. Although these hospitalization and lost-time rates were higher than would be expected for a healthy trainee population, the “voluntary drop” rate for this trainee population was actually much lower than expected. Only one trainee reported dropping the training program after his MRSA infection.
In this outbreak investigation, the major risk factor associated with MRSA infection was having a roommate during training who had a prior skin infection. This finding is consistent with data from previous studies that identified close contact with an MRSA-infected or -colonized individual as a risk factor for infection (11, 29). Another risk factor associated with MRSA infection in this outbreak was having a family member or friend who worked in a health care setting. This finding suggests that this CA-MRSA outbreak may have had indirect ties to health care facilities from trainees' past contact with family and friends, a factor that has also been suggested in previous studies of MRSA infection (27). Finally, the statistical analyses identified having a parent or other household member who smoked during the trainee's childhood as protective against MRSA infection. Although difficult to explain, one might speculate that childhood environmental tobacco smoke exposure is a surrogate for another factor(s), perhaps immunologic, that is protective against infection. Note than none of these trainees had asthma or reactive airway disease; therefore, those exposed to environmental smoke as children may represent a subgroup with especially strong immune profiles (2).
From previous studies, it is important to note that other factors found associated with CA-MRSA infection, including past antibiotic use and prior hospitalization, were not found to be associated with MRSA infection in this present investigation. This implies that this population of otherwise healthy, strong, young adults may be different from other populations affected by MRSA.
The results of the laboratory testing of staphylococcal isolates conducted in this outbreak investigation were consistent with those of other CA-MRSA outbreaks. The isolates in this outbreak were primarily susceptible to the antibiotics tested, except for beta-lactams and erythromycin. This finding is consistent with antibiotic susceptibility patterns reported in previous CA-MRSA outbreaks. In addition, this finding contrasts sharply with the multidrug resistance patterns often observed with nosocomial MRSA infections (4, 6, 11, 16, 25, 29). The presence of the mecA gene in the 22 isolates is consistent with the finding of methicillin resistance among these pathogens (21). In addition, the PVL gene is a potential virulence factor that has been linked to other CA-MRSA infections (19, 30). Finally, the identification of all 22 MRSA skin isolates as ST8 by multilocus sequence typing indicates that a single MRSA clone was transmitted in this outbreak. Community- and hospital-acquired MRSA outbreaks with ST8 have been identified previously within the United States (30).
The limitations of this study include the small sample size and the unique population. As a result, the findings of this investigation may not be generalizable. There are inherent limitations to the use of survey data, including recall and response biases. It may be notable that the 70% response rate was strong, and some survey data were confirmed via medical record review.
Despite limitations, this outbreak investigation included strengths that may contribute to our expanding understanding of CA-MRSA infections. Most notably, the outbreak occurred in a well-defined population of young, healthy, military trainees who experienced relatively uniform exposures in their environment. In this controlled setting, one may have more confidence that factors found to be associated with infection are true risk factors.
The control measures implemented during this outbreak may have helped reduce the transmission of MRSA between trainees who had close contact but were not roommates, such as trainees who were members of the same crew. However, the data suggest that control measures did not eliminate the risk of MRSA transmission between roommates. Targeting education, hygiene, and personal behaviors may be key to reducing the spread of MRSA among those with close physical contact in future outbreaks. Future studies may also explore the immunologic mechanisms that appear to make some otherwise healthy adults at higher risk for MRSA infections.
Acknowledgments
The views expressed in this article are those of the authors and do not reflect the official policy or position of the Department of the Navy, Department of Defense, or the U.S. Government. This information has been approved for public release; its distribution is unlimited.
We appreciate the contributions and support of Brad Hale from the Naval Medical Center, San Diego, Calif.; Larry Garsha, Paul Ware, and Jennifer Segarra from the Naval Special Warfare Center, San Diego, Calif.; Scott Sherman and Dennis Faix from the Navy Environmental and Preventive Medicine Unit 5, San Diego, Calif.; Dana Bradshaw and Gary Gackstetter from the Uniformed Services University of Health Sciences, Bethesda, Md.; and Lesley Henry and Rosha Aran from the Naval Health Research Center, San Diego, Calif.
Footnotes
Report 04-05, supported by the Department of Defense under work unit no. 6609.
REFERENCES
- 1.Abi-Hanna, P., A. L. Frank, J. P. Quinn, S. Kelkar, P. C. Schreckenberger, M. K. Hayden, and J. F. Marcinak. 2000. Clonal features of community-acquired methicillin-resistant Staphylococcus aureus in children. Clin. Infect. Dis. 30:630-631. [DOI] [PubMed] [Google Scholar]
- 2.Babu, K. S., and S. H. Arshad. 2003. The role of allergy in the development of airway inflammation in children. Paediatr. Respir. Rev. 4:40-46. [DOI] [PubMed] [Google Scholar]
- 3.Borer, A., J. Gilad, P. Yagupsky, N. Peled, N. Porat, R. Trefler, H. Shprecher-Levy, K. Riesenberg, M. Shipman, and F. Schlaeffer. 2002. Community-acquired methicillin-resistant Staphylococcus aureus in institutionalized adults with developmental disabilities. Emerg. Infect. Dis. 8:966-970. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Bukharie, H. A., M. S. Abdelhadi, I. A. Saeed, A. M. Rubaish, and E. B. Larbi. 2001. Emergence of methicillin-resistant Staphylococcus aureus as a community pathogen. Diagn. Microbiol. Infect. Dis. 40:1-4. [DOI] [PubMed] [Google Scholar]
- 5.Centers for Disease Control and Prevention. 1981. Community-acquired methicillin-resistant Staphylococcus aureus infections—Michigan. Morb. Mortal. Wkly. Rep. 30:185-187. [PubMed] [Google Scholar]
- 6.Centers for Disease Control and Prevention. 1999. Four pediatric deaths from community-acquired methicillin-resistant Staphylococcus aureus—Minnesota and North Dakota, 1997-1999. JAMA 282:1123-1125. [PubMed] [Google Scholar]
- 7.Centers for Disease Control and Prevention. 2003. Methicillin-resistant Staphylococcus aureus infections among competitive sports participants—Colorado, Indiana, Pennsylvania, and Los Angeles County, 2000-2003. Morb. Mortal. Wkly. Rep. 52:793-795. [PubMed] [Google Scholar]
- 8.Centers for Disease Control and Prevention. 2003. Methicillin-resistant Staphylococcus aureus infections in correctional facilities—Georgia, California, and Texas, 2001-2003. Morb. Mortal. Wkly. Rep. 52:992-996. [PubMed] [Google Scholar]
- 9.Centers for Disease Control and Prevention. 2001. Methicillin-resistant Staphylococcus aureus skin or soft tissue infections in a state prison—Mississippi, 2000. Morb. Mortal. Wkly. Rep. 50:919-922. [PubMed] [Google Scholar]
- 10.Centers for Disease Control and Prevention. 2003. Outbreaks of community-associated methicillin-resistant Staphylococcus aureus skin infections—Los Angeles County, California, 2002-2003. Morb. Mortal. Wkly. Rep. 52:88. [PubMed] [Google Scholar]
- 11.Chambers, H. F. 2001. The changing epidemiology of Staphylococcus aureus? Emerg. Infect. Dis. 7:178-182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Dufour, P., Y. Gillet, M. Bes, G. Lina, F. Vandenesch, D. Floret, J. Etienne, and H. Richet. 2002. Community-acquired methicillin-resistant Staphylococcus aureus infections in France: emergence of a single clone that produces Panton-Valentine leukocidin. Clin. Infect. Dis. 35:819-824. [DOI] [PubMed] [Google Scholar]
- 13.Enright, M. C., N. P. Day, C. E. Davies, S. J. Peacock, and B. G. Spratt. 2000. Multilocus sequence typing for characterization of methicillin-resistant and methicillin-susceptible clones of Staphylococcus aureus. J. Clin. Microbiol. 38:1008-1015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Frank, A. L., J. F. Marcinak, P. D. Mangat, and P. C. Schreckenberger. 1999. Increase in community-acquired methicillin-resistant Staphylococcus aureus in children. Clin. Infect. Dis. 29:935-936. [DOI] [PubMed] [Google Scholar]
- 15.Gorak, E. J., S. M. Yamada, and J. D. Brown. 1999. Community-acquired methicillin-resistant Staphylococcus aureus in hospitalized adults and children without known risk factors. Clin. Infect. Dis. 29:797-800. [DOI] [PubMed] [Google Scholar]
- 16.Herold, B. C., L. C. Immergluck, M. C. Maranan, D. S. Lauderdale, R. E. Gaskin, S. Boyle-Vavra, C. D. Leitch, and R. S. Daum. 1998. Community-acquired methicillin-resistant Staphylococcus aureus in children with no identified predisposing risk. JAMA 279:593-598. [DOI] [PubMed] [Google Scholar]
- 17.Kallen, A. J., T. J. Driscoll, S. Thornton, P. E. Olson, and M. R. Wallace. 2000. Increase in community-acquired methicillin-resistant Staphylococcus aureus at a Naval Medical Center. Infect. Control Hosp. Epidemiol. 21:223-226. [DOI] [PubMed] [Google Scholar]
- 18.Layton, M. C., W. J. Hierholzer, Jr., and J. E. Patterson. 1995. The evolving epidemiology of methicillin-resistant Staphylococcus aureus at a university hospital. Infect. Control Hosp. Epidemiol. 16:12-17. [DOI] [PubMed] [Google Scholar]
- 19.Lina, G., Y. Piémont, F. Godail-Gamot, M. Bes, M. O. Peter, V. Gauduchon, F. Vandenesch, and J. Etienne. 1999. Involvement of Panton-Valentine leukocidin-producing Staphylococcus aureus in primary skin infections and pneumonia. Clin. Infect. Dis. 29:1128-1132. [DOI] [PubMed] [Google Scholar]
- 20.Lindenmayer, J. M., S. Schoenfeld, R. O'Grady, and J. K. Carney. 1998. Methicillin-resistant Staphylococcus aureus in a high school wrestling team and the surrounding community. Arch. Intern. Med. 158:895-899. [DOI] [PubMed] [Google Scholar]
- 21.Louie, L., S. O. Matsumura, E. Choi, M. Louie, and A. E. Simor. 2000. Evaluation of three rapid methods for detection of methicillin resistance in Staphylococcus aureus. J. Clin. Microbiol. 38:2170-2173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Moreno, F., C. Crisp, J. H. Jorgensen, and J. E. Patterson. 1995. Methicillin-resistant Staphylococcus aureus as a community organism. Clin. Infect. Dis. 21:1308-1312. [DOI] [PubMed] [Google Scholar]
- 23.National Committee for Clinical Laboratory Standards. 2002. Methods for dilution antimicrobial susceptibility tests for bacteria that grow aerobically, 5th ed. Approved standard M7-A5. National Committee for Clinical Laboratory Standards, Wayne, Pa.
- 24.Pan, E. S., B. A. Diep, H. A. Carleton, E. D. Charlebois, G. F. Sensabaugh, B. L. Haller, and F. Perdreau-Remington. 2003. Increasing prevalence of methicillin-resistant Staphylococcus aureus infection in California jails. Clin. Infect. Dis. 37:1384-1388. [DOI] [PubMed] [Google Scholar]
- 25.Saïd-Salim, B., B. Mathema, and B. N. Kreiswirth. 2003. Community-acquired methicillin-resistant Staphylococcus aureus: an emerging pathogen. Infect. Control Hosp. Epidemiol. 24:451-455. [DOI] [PubMed] [Google Scholar]
- 26.Saiman, L., M. O'Keefe, P. L. Graham III, F. Wu, B. Saïd-Salim, B. Kreiswirth, A. LaSala, P. M. Schlievert, and P. Della-Latta. 2003. Hospital transmission of community-acquired methicillin-resistant Staphylococcus aureus among postpartum women. Clin. Infect. Dis. 37:1313-1319. [DOI] [PubMed] [Google Scholar]
- 27.Salgado, C. D., B. M. Farr, and D. P. Calfee. 2003. Community-acquired methicillin-resistant Staphylococcus aureus: a meta-analysis of prevalence and risk factors. Clin. Infect. Dis. 36:131-139. [DOI] [PubMed] [Google Scholar]
- 28.Saravolatz, L. D., N. Markowitz, L. Arking, D. Pohlod, and E. Fisher. 1982. Methicillin-resistant Staphylococcus aureus. Epidemiologic observations during a community-acquired outbreak. Ann. Intern. Med. 96:11-16. [DOI] [PubMed] [Google Scholar]
- 29.Saravolatz, L. D., D. J. Pohlod, and L. M. Arking. 1982. Community-acquired methicillin-resistant Staphylococcus aureus infections: a new source for nosocomial outbreaks. Ann. Intern. Med. 97:325-329. [DOI] [PubMed] [Google Scholar]
- 30.Vandenesch, F., T. Naimi, M. C. Enright, G. Lina, G. R. Nimmo, H. Heffernan, N. Liassine, M. Bes, T. Greenland, M. E. Reverdy, and J. Etienne. 2003. Community-acquired methicillin-resistant Staphylococcus aureus carrying Panton-Valentine leukocidin genes: worldwide emergence. Emerg. Infect. Dis. 9:978-984. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Warshawsky, B., Z. Hussain, D. B. Gregson, R. Alder, M. Austin, D. Bruckschwaiger, A. H. Chagla, J. Daley, C. Duhaime, K. McGhie, G. Pollett, H. Potters, and L. Schiedel. 2000. Hospital- and community-based surveillance of methicillin-resistant Staphylococcus aureus: previous hospitalization is the major risk factor. Infect. Control Hosp. Epidemiol. 21:724-727. [DOI] [PubMed] [Google Scholar]