Skip to main content
PLOS Medicine logoLink to PLOS Medicine
. 2021 Sep 17;18(9):e1003795. doi: 10.1371/journal.pmed.1003795

Differences in outcomes of mandatory motorcycle helmet legislation by country income level: A systematic review and meta-analysis

Jacob R Lepard 1,2,*, Riccardo Spagiari 3, Jacquelyn Corley 2,4, Ernest J Barthélemy 2,5, Eliana Kim 2,6, Rolvix Patterson 2,7, Sara Venturini 8, Megan E H Still 9, Yu Tung Lo 10,11, Gail Rosseau 12, Rania A Mekary 11,13,, Kee B Park 2,
Editor: Donald A Redelmeier14
PMCID: PMC8486090  PMID: 34534215

Abstract

Background

The recent Lancet Commission on Legal Determinants of Global Health argues that governance can provide the framework for achieving sustainable development goals. Even though over 90% of fatal road traffic injuries occur in low- and middle-income countries (LMICs) primarily affecting motorcyclists, the utility of helmet laws outside of high-income settings has not been well characterized. We sought to evaluate the differences in outcomes of mandatory motorcycle helmet legislation and determine whether these varied across country income levels.

Methods and findings

A systematic review and meta-analysis were completed using the PRISMA checklist. A search for relevant articles was conducted using the PubMed, Embase, and Web of Science databases from January 1, 1990 to August 8, 2021. Studies were included if they evaluated helmet usage, mortality from motorcycle crash, or traumatic brain injury (TBI) incidence, with and without enactment of a mandatory helmet law as the intervention. The Newcastle–Ottawa Scale (NOS) was used to rate study quality and funnel plots, and Begg’s and Egger’s tests were used to assess for small study bias. Pooled odds ratios (ORs) and their 95% confidence intervals (CIs) were stratified by high-income countries (HICs) versus LMICs using the random-effects model. Twenty-five articles were included in the final analysis encompassing a total study population of 31,949,418 people. There were 17 retrospective cohort studies, 2 prospective cohort studies, 1 case–control study, and 5 pre–post design studies. There were 16 studies from HICs and 9 from LMICs. The median NOS score was 6 with a range of 4 to 9. All studies demonstrated higher odds of helmet usage after implementation of helmet law; however, the results were statistically significantly greater in HICs (OR: 53.5; 95% CI: 28.4; 100.7) than in LMICs (OR: 4.82; 95% CI: 3.58; 6.49), p-value comparing both strata < 0.0001. There were significantly lower odds of motorcycle fatalities after enactment of helmet legislation (OR: 0.71; 95% CI: 0.61; 0.83) with no significant difference by income classification, p-value: 0.27. Odds of TBI were statistically significantly lower in HICs (OR: 0.61, 95% CI 0.54 to 0.69) than in LMICs (0.79, 95% CI 0.72 to 0.86) after enactment of law (p-value: 0.0001). Limitations of this study include variability in the methodologies and data sources in the studies included in the meta-analysis as well as the lack of available literature from the lowest income countries or from the African WHO region, in which helmet laws are least commonly present.

Conclusions

In this study, we observed that mandatory helmet laws had substantial public health benefits in all income contexts, but some outcomes were diminished in LMIC settings where additional measures such as public education and law enforcement might play critical roles.


In a systematic review and meta-analysis, Jacob Lepard and colleagues evaluate the differences in outcomes of mandatory motorcycle helmet legislation by country-income level.

Author summary

Why was this study done?

  • The utility of mandatory motorcycle helmet legislation has been studied at length in high-income country (HIC) settings, with extensive evidence demonstrating improvement in mortality and morbidity from road traffic accidents.

  • Prior to this study, there was very limited discussion regarding the utility of helmet laws specifically in low-resource settings, despite the fact that over 90% of fatal road traffic injuries occurred in low- and middle-income countries (LMICs) each year.

  • Based upon this, we sought to evaluate all available literature using a systematic review and meta-analysis to determine the benefit of helmet legislation in LMICs in comparison to HICs.

What did the researchers do and find?

  • A systematic review and meta-analysis were conducted, which demonstrated that road users in countries with mandatory motorcycle helmet legislation were significantly more likely to wear a helmet and significantly less likely to experience motorcycle fatality or traumatic brain injury (TBI).

  • We identified a disparity in legislative benefit, showing lower usage of motorcycle helmets and less reduction in brain injuries, including severe TBI in LMICs compared with HICs.

  • Notably though, the reduction in motorcycle fatalities was similar between income contexts and overall greater in LMICs when controlling for study quality and years since law enactment, indicating that the overall goal of the law is achieved regardless of income context.

What do these findings mean?

  • Our research addresses a significant gap in the literature regarding the utility of helmet laws in low- and middle-income settings, where they are unequivocally needed the most.

  • These findings indicate that helmet laws reduce mortality and have significant benefit in all income contexts.

  • The presence of some disparities in legislative outcomes in LMICs highlights that additional measures beyond legislation may be needed in low-resource settings to ensure the greatest protection to the most vulnerable populations of road users worldwide.

  • Our study is limited in that no studies from the lowest income countries met criteria for inclusion. This is likely a result of minimal research output or resources from these regions. Additionally, few low-income countries (13.9%) have helmet laws to be studied. We thus had to infer our findings from middle-income countries onto the lowest income countries.

Introduction

Road traffic injuries represent a leading cause of death worldwide, taking the lives of more than 1.2 million people each year. In addition to mortality, over 50 million people on the world’s roads acquire nonfatal injuries each year and are left with permanent disabilities [1]. Riders of 2-wheeled vehicles such as motorcycles are considered the most vulnerable road users along with pedestrians, as they account for more than half of all road fatalities [2]. In recent decades, the number of motorcycle users in low- and middle-income countries (LMICs) has increased dramatically, with as many as 83% to 87% of households using a motorbike as primary transportation in parts of Southeast Asia [3]. According to the World Health Organization (WHO), the majority of countries worldwide (94%) have a law in place that mandates helmet usage among motorcyclists; however, only 49 countries have comprehensive helmet laws that meet the WHO standards, which require that both drivers and passengers wear them, fastened, for all motorized 2-wheelers. The majority of these laws are present in high-income countries (HICs), with 38.4% (15/39) of HICs and only 13.9% (6/43) of low-income countries (LICs) having a comprehensive helmet law [2].

The implications of helmet legislation and their potential to reduce death and injuries related to motorcycle accidents are immense for LMICs. Over 90% of fatal road traffic injuries occur in LMICs, primarily affecting people in the working age and resulting in major economic costs to society. Mortality among motorcycle users in LMICs is more than twice than in HICs [4]. Consequently, the widespread adoption of mandatory helmet laws has been advocated by many international organizations [5,6]. While previous systematic reviews have proven the ability of helmets to prevent death and injury [7,8], little emphasis has been given to their utility in LMICs. The purpose of this study was to conduct a systematic review and meta-analysis of the literature to assess the potential utility of mandatory motorcycle helmet legislation on helmet usage, motorcyclist mortality, and incidence of traumatic brain injury (TBI) and determine if these outcomes differed across country income levels.

Methods

Search strategy

The study was designed and reported as per the Preferred Reporting Items for Systematic-reviews and Meta-Analysis (PRISMA) checklist (S1 Checklist) [9]. Articles were eligible for inclusion if they compared populations with and without implementation of a mandatory motorcycle helmet legislation and evaluated the association with 1 of 3 outcomes—helmet usage, motorcycle fatality, or TBI. Studies were excluded if they focused on a different vehicle type than motorcycle. A search for relevant articles was conducted on August 8, 2021 using the PubMed, Embase, and Web of Science databases. A search term was designed using appropriate key words and Medical Subject Heading (MeSH) terms to select for studies dealing with helmet legislation (S1 Table). In order to be reflective of only the most recent data, risk factors for road traffic injury, and road safety efforts, all studies published prior to 1990 were excluded. No restrictions were made regarding language of publication. Non-English articles were digitally translated into English using Google Translate (Google, Menlo Park, California, United States of America) [10].

Study selection

After removal of duplicates, the titles and abstracts of all resultant articles were reviewed independently by 2 authors (JL and RS) for inclusion and exclusion criteria. The papers that passed this screening step were then carried forward for full-text review, which was initially divided among 5 of the authors (RS, SV, EK, MS, and RP) and then independently performed in duplicate by the primary investigator (JL). Discrepancies were addressed by discussion among reviewers to reach consensus. In the event that consensus could not be reached, all remaining discrepancies were to be resolved by the senior author (KP). There were 15 discrepancies that required additional discussion among the reviewers out of 187 articles reviewed in full text (8%, 15/187). Appropriate consensus was achieved for all 15 discrepancies without requiring further arbitration by the senior author, and 2 of these papers were ultimately included in the analysis. References for all full-text articles were reviewed to find additional relevant studies for inclusion.

Data extraction

All articles that met criteria for inclusion underwent data extraction, which was similarly performed in duplicate, with discrepancies, if any, resolved through discussion. Information was collected from the manuscript including study characteristics including year of publication, study design, study period, country in which study and data collection occurred, income level, when the law was enacted, enactment gap (defined as number of follow-up years post the law implementation), and specific outcomes (e.g., odds of helmet usage, odds of moderate to severe TBI, and odds of mortality related to motorcycle traffic injury). Studies were classified as including national-level data if they utilized a national database or collected data representative of the entire country, regional if they used a regional-level database or including data from multiple hospitals responsible for the care of an entire region, and single center if their data only included the clinical experience of a single hospital or institution. The World Bank Income classifications were used to assign income levels to each country studied [11]. The extracted data are available in S1 Data.

Data analysis

The random-effects model using the DerSimonian and Laird approach [12] was used to obtain the pooled odds ratio (OR) estimates and their 95% confidence intervals (CIs) to assess the odds of helmet usage, motorcycle fatality, and TBI after helmet legislation as compared to before its implementation. Heterogeneity was statistically tested through the Cochrane Q test (p < 0.10) and the I2 value [13,14], which estimates the percentage of variation between studies. To address potential heterogeneity sources, subgroup analysis was conducted by income level, and pooled ORs were presented for each category, along with a p-value that compared the pooled effect estimates across the different groups [15]. If the p-value was significant, the overall pooled value of all the studies was not shown; instead, only the pooled effect estimate of each group was shown. Univariate and multivariate meta-regression were used to assess whether study quality (continuous), enactment gap (continuous), and income level (binary with ref: HIC) were a significant source of heterogeneity. The “meta” and “metafor” packages in R (version 3.3.0; R Foundation for Statistical Computing, Vienna, Austria) were used to perform all analyses [16,17]. Unless otherwise specified, a p-value < 0.05 was considered statistically significant.

Risk of bias assessment

Study quality was assessed using the Newcastle–Ottawa Scale (NOS) for observational studies assessing cohort selection, comparability, and outcome assessment [18] with a possible score range of 0 to 9. For outcomes that had at least 9 to 10 studies, the potential for small study bias was assessed through funnel plots and through Begg’s and Egger’s tests [19,20]. When a subgroup analysis was significant as indicated by the p-value, the publication bias was performed for each subgroup separately, only if the number of studies was appropriate for each subgroup.

Results

Search results

The initial literature search yielded a total of 3,751 documents—1,274 from PubMed, 996 from Embase, and 1,481 from Web of Science. After removing duplicates, there were 2,316 documents available to be screened by the title and abstract for inclusion. During this process, 2,127 articles were excluded due to lack of relevance to the study question, leaving 189 studies for full-text review. There were 166 articles excluded after full-text review due to the wrong intervention (n = 69), typically meaning that the law did not meet criteria or the intervention was not a law at all; lack of outcomes of interest being reported (n = 49); and noncomparative study design (n = 48). After searching bibliographies and references, 17 additional studies were reviewed; however, only 2 studies met criteria for inclusion in the analysis.

Twenty-five [2145] articles encompassing a total study population of 31,949,418 people qualified for the systematic review and meta-analysis and underwent complete data extraction (Fig 1). All studies utilized a comparative design either with data before and after the implementation of a helmet law in the same region (pre–post or retrospective cohort design) or simultaneous comparison between different regions with and without helmet laws (case–control or prospective cohort design). The median time interval from passage of the relevant helmet legislation to study completion (i.e., enactment gap) was 3 years with an interquartile range (IQR) of 1 to 4 years, and an overall range of 0 to 41 years. The median gap for studies based in HICs was 3 years (IQR 0.75 to 10.25), while the median gap for studies based in LMICs was 2 years (IQR 1 to 3).

Fig 1. Study selection process of the identified articles.

Fig 1

There were 17 retrospective cohort studies, 2 prospective cohort studies, 1 case–control study, and 5 pre–post design studies. One retrospective cohort study was translated from Spanish to English for data extraction [26]. All studies assessed legislation related specifically to motorcycle helmet use. Eight studies [21,2325,28,41,42,45] utilized national-level data, another 13 studies [22,26,27,29,30,3337,39,40,46] utilized regional-level data, and the last 4 studies [31,38,41,43] were limited to single center experience. There were 9 studies based from AMR-US/CAN, 4 studies from EUR, 1 from AMR-L, 4 from SEAR, 6 from WPR, and 1 from EMR. There were no studies evaluating laws in Africa. Sixteen of the studies evaluated helmet laws in HICs, while 4 evaluated upper-middle income, 5 evaluated lower-middle income, and none evaluated LICs. Using the NOS, the median score was 6 with a range of 4 to 9. The median quality score for studies based in HICs was 7 (IQR 5–8), while the median score for studies based in LMICs was 6 (IQR 5–6) (Table 1). AMR-L, Latin America; AMR-US/CAN, United States or Canada; EMR, Eastern Mediterranean region; EUR, Europe; HIC, high-income country; LIC, low-income country; LMIC, low- and middle-income country; NOS, Newcastle–Ottawa Scale; SEAR, Southeast Asia region; WPR, Western Pacific region.

Odds of helmet usage

Ten studies with a total study population of 862,522 people evaluated the difference in motorcyclist helmet usage before and after the implementation of a mandatory helmet law. Six of these studies were based in HICs, and another 4 were based in LMICs. Four studies calculated helmet usage based upon standardized roadway observation [21,29,37,46], and another 6 recorded helmet usage per patients hospitalized following motorcycle crash [24,25,31,34,40,43]. Although all studies demonstrated a higher odds of helmet usage after the enactment of the law, there was a stronger association upon comparing the benefit of law implementation in HICs (OR: 53.5; 95% CI: 28.4; 100.7; I2: 98.0%; p-heterogeneity < 0.01; 6 studies) than in LMICs (OR 4.82; 95% CI: 3.58; 6.49; I2: 97.0%; p-heterogeneity < 0.01; 4 studies), with a significant difference between the groups (p < 0.0001) (Fig 2). Although the I2 was high in both categories, this could be a reflection of the change in the magnitude of the association that could differ among studies and not of the direction of the association per se. A sensitivity analysis where we removed a potential outlier (Kraus J, 1995) from the HIC subgroup did not materially alter the original results (HIC: OR: 42.5; 95% CI: 26.3, 68.5 versus LMIC: OR: 4.82, 95% CI: 3.58; 6.49).

Fig 2. Forest plots demonstrating the OR for increased helmet usage following implementation of helmet legislation (95% CI) in HICs from 6 studies and in LMICs from 4 studies.

Fig 2

Solid squares represent the point estimate of each study, and the centers of the clear diamonds represent the estimate of the intervention effect for HIC vs. LMIC. Horizontal lines represent 95% CIs, and the width of the diamonds represents the 95% CI of the pooled ORs. Prediction interval for the OR of helmet usage comparing post- to pre-law enactment in HIC: (5.29; 540.4). In 95% of all meta-analyses, the range of the prediction interval will capture the true effect size of 95% of all new studies in HIC. Prediction interval for the OR of helmet usage comparing post- to pre-law enactment in LMIC: (1.24; 18.7). In 95% of all meta-analyses, the range of the prediction interval will capture the true effect size of 95% of all new studies in LMIC. CI, confidence interval; HIC, high-income country; LMIC, low- and middle-income country; OR, odds ratio.

Odds of motorcycle fatality

Thirteen studies with a total study population of 12,830,513 reported motorcycle fatality rate as an outcome, 4 of which were based from LMIC settings. Four studies calculated fatality rate relative to the number of registered motorcycles nationally [22,23,27,28], 3 quantified based upon regional population [30,42,47], and 6 determined fatality rates per patients hospitalized following motorcycle crash [25,35,36,38,40,45]. Across all studies, there was a significantly lower odds of motorcycle fatality after enactment of the law (pooled OR 0.71, 95% CI: 0.61, 0.83; I2: 68.6%; p-heterogeneity: 0.0001). When stratifying by income level, there was no apparent statistically significant difference comparing HICs (0.78; 95% CI: 0.66; 0.91; I2: 42.0%; p-heterogeneity: 0.09; 9 studies) to LMICs (0.62; 95% CI: 0.44; 0.89; I2: 86.2%; p-heterogeneity < 0.0001; 4 studies); p-value comparing both groups: 0.27 (Fig 3).

Fig 3. Forest plots demonstrating the OR of motorcycle fatality following implementation of helmet legislation (95% CI) in HICs from 8 studies and in LMICs from 4 studies.

Fig 3

Solid squares represent the point estimate of each study, and the centers of the clear diamonds represent the estimate of the intervention effect for HIC vs. LMIC, while the center for the black diamond represents the overall OR for all studies. Horizontal lines represent 95% CIs for the original studies, and the width of the diamonds represents the 95% CI of the pooled ORs. Prediction interval for the OR of helmet usage comparing post- to pre-law enactment in HIC: (0.53; 1.14). In 95% of all meta-analyses, the range of the prediction interval will capture the true effect size of 95% of all new studies in HIC. Prediction interval for the OR of helmet usage comparing post- to pre-law enactment in LMIC: (0.13; 2.90). In 95% of all meta-analyses, the range of the prediction interval will capture the true effect size of 95% of all new studies in LMIC. CI, confidence interval; HIC, high-income country; LMIC, low- and middle-income country; OR, odds ratio.

Odds of traumatic brain injury

Twelve studies with a total study population of 30,567,064 reported the incidence of TBI. When stratifying by income level, the odds of TBI after the enactment of the law was significantly more pronounced in HICs (OR: 0.61; 95% CI: 0.54; 0.69; I2: 90.2%; p-heterogeneity < 0.0001; 10 studies) in comparison to LMICs (OR: 0.79; 95% CI: 0.72; 0.86; I2: 50.8%; p-heterogeneity 0.15; 2 studies); p-value comparing both income groups was 0.0007 (Fig 4). Four studies [35,40,44,45] reported incidence rates specific to clinical diagnosis of severe TBI, while the other eight [24,25,32,33,36,39,41,42,48] included incidence rates broadly based on ICD-9 codes for “head injury” or “traumatic brain injury.” There was no significant difference in the benefit demonstrated in those studies evaluating the odds specifically of severe TBI versus studies including all types of TBI (p-value: 0.32).

Fig 4. Forest plots demonstrating the OR for TBI following implementation of helmet legislation (95% CI) in HICs from 9 studies and in LMICs from 2 studies.

Fig 4

Solid squares represent the point estimate of each study, and the centers of the clear diamonds represent the estimate of the intervention effect for HIC vs. LMIC, while the center for the black diamond represents the overall OR for all studies. Horizontal lines represent 95% CIs for the original studies, and the width of the diamonds represents the 95% CI of the pooled ORs. Prediction interval for the OR of TBI comparing post- to pre-law enactment for HIC: (0.42; 0.88). In 95% of all meta-analyses in HIC, the range of the prediction interval will capture the true effect size of 95% of all new studies in HIC. Prediction interval for the OR of TBI comparing post- to pre-law enactment for LMIC: NA due to paucity of studies. CI, confidence interval; HIC, high-income country; LMIC, low- and middle-income country; OR, odds ratio; TBI, traumatic brain injury.

Sensitivity analyses

Univariate meta-regression revealed that study quality and enactment gap were not found to have a significant effect on any of the 3 primary outcomes. Only the income level of a country was found to have a significant association with the odds of helmet usage (p < 0.01) and TBI due to motorcycle accident (p = 0.049), but not with the odds of motorcycle fatality (p = 0.32). Notably, further adjusting for enactment gap or for study quality in the multivariate meta-regression models did not impact the statistically significant univariate results observed for income level. This adjustment did, however, impact the results observed for motorcycle fatality where the relationship with income level was found to be statistically significant (p = 0.02). (Table 2).

Table 2. Meta-regression analyses of each of the 3 outcomes on each of the following trial-level covariates: enactment gap (continuous); study quality (continuous); and income level (binary with ref = HIC).

Outcome Meta-regression Slope (95% CI) p-Value New I2 Number of studies
Helmet usage Enactment gap 0.02 (−0.07, 0.11) 0.71 99.7% 10
Study quality 0.04 (−0.66, 0.75) 0.90 99.7%
Income level
 Ref (HIC)
 LMIC

________________
−2.39 (−3.01, −1.77)

<0.01

97.8%

Income level + enactment gap −2.41 (−3.08, −1.73)
−0.01 (−0.06, 0.03)
<0.01
0.61
98.0%
Income level + study quality −2.49 (−3.11, −1.88)
−0.23 (−0.52, 0.06)
<0.01
0.12
97.7%
Motorcycle fatality Enactment gap 0.0001 (−0.01, 0.01) 0.99 70.4% 13
Study quality −0.05 (−0.18, 0.09) 0.50 66.8%
Income level
 Ref (HIC)
 LMIC

________________
−0.18 (−0.53, 0.17)

0.32

69.0%

Income level + enactment gap −0.21 (−0.61, 0.20)
−0.002 (−0.02, 0.01)
0.32
0.72
68.5%
Income level + study quality −0.33 (−0.60, −0.06)
−0.13 (−0.24, −0.02)
0.02
0.02
37.8%
TBI Enactment gap 0.002 (−0.01, 0.01) 0.59 91.1% 12
Study quality 0.02 (−0.06, 0.10) 0.65 91.2%
Income level
 Ref (HIC)
 LMIC

________________
0.23 (0.00, 0.47)

0.049
89.4%
Income level + enactment gap 0.28 0.01, 0.55)
0.004 (−0.00, 0.01)
0.045
0.33
90.4%
Income level + study quality 0.35 0.08, 0.62)
0.07 (−0.01, 0.16)
0.01
0.09
85.6%

p-Value is obtained from the Z-test, which corresponds to the statistical significance of the slope generated by the meta-regression.

Multivariate meta-regression adjusting simultaneously for income level (ref: HIC) and enactment gap (continuous). All the rest of the models are univariate meta-regression where only one trial-level covariate was entered in the model.

CI, confidence interval; HIC, high-income country; LMIC, low- to middle-income country; TBI, traumatic brain injury.

Evaluation of bias

The funnel plot was not feasible for a helmet law as each subgroup had fewer than 9 to 10 studies. For motorcycle fatality, there was no possible absence of negative studies comprising small sample sizes, as evident by the funnel plot that showed no asymmetry (S1 Fig) and the p-values of Begg (0.22) and Egger (0.29). As for the odds of TBI among studies in HICs, a slight asymmetry in the funnel plot was shown to the right side of the pooled point estimate, despite the nonstatistically significant p-value of Begg (0.93); however, Egger’s p-value was significant (0.045). Notably, the source of asymmetry in a funnel plot could be due to other reasons than small study bias (e.g., true heterogeneity, data irregularities, artifactual, selection bias) [20] (S2 Fig).

Discussion

In the present analysis, we found that the odds of helmet usage increased in all income contexts following passage of a helmet law, with a significantly greater benefit in HICs compared with LMICs. Studies also showed that the odds of TBI decreased by 41% in HICs, which was significantly greater than the 21% reduction in LMICs. Lastly, the odds of motorcycle fatality decreased by 29% overall with no difference among income contexts, although when controlling for study quality and enactment gap, the reduction was significantly greater in LMICs. To our knowledge, this is the first meta-analysis conducted regarding the utility of helmet legislation with specific evaluation of the benefits in LMICs compared with HICs.

In the recent Lancet Commission regarding the Legal Determinants of Health, Gostin and colleagues remark that “Law can be a powerful tool for advancing global health, yet it remains underutilized and poorly understood” [49]. According to the WHO 2018 Global Status Report on Road Safety, there are an estimated 1.35 million deaths annually from road traffic accidents (RTAs), with a disproportionate number of these occurring in LICs. Indeed, the annual incidence of death from RTAs is 27.5 per 100,000 population in LICs compared to 8.3 per 100,000 in HICs. Since 2013, WHO has tracked metrics regarding road-related injury in an effort to meet Sustainable Development Goal (SDG) 3.6, which targets a 50% reduction in road traffic deaths by 2020 [50]. In the interval time period, 5 countries have enacted helmet legislations complying with what WHO considers to be “best practices,” bringing the global total to 49 countries including 38.4% of HICs, 21.6% of MICs, and 13.9% of LICs. Despite such measures, no LICs, including those having adopted helmet legislations, have recorded a reduction in death from RTAs in contrast to 23.4% of MICs and 51% of HICs that have noted at least 2% decrease in RTA deaths since 2014 [1].

Several systematic reviews and meta-analyses have demonstrated the utility of helmets in decreasing motorcycle related deaths. A Cochrane review completed by Liu and colleagues demonstrated that helmet usage decreased the risk of death from 69% to 42% [7]. Other studies looked specifically at the potential benefits of helmet legislations as an intervention [51,52]. Du and colleagues included studies of helmet laws in multiple countries, emphasizing the global need for comprehensive laws; however, no analysis of benefit by country or income level was conducted [8]. While such analyses are important to ensure the utility of policy initiatives, the majority of studies to date have focused only on HIC contexts and thus entirely miss the global scope of the problem. The disparities of TBI prevention are clear; however, these findings beg the important question as to whether a mandatory helmet law passed in sub-Saharan Africa or Southeast Asia is an equivalent measure to a law passed in North America or Western Europe.

Our data suggest that universal passage of motorcycle helmet legislation could increase the use of helmets, reduce the incidence of TBI, and decrease motorcyclist mortality. These practical results could provide substantial progress toward achieving SDG 3.6 in a timely fashion. However, our findings of varied benefit of legislation based on the income setting suggest that there still remain context-specific barriers that prevent implementation in limited-resource settings. In particular, lack of education regarding public health interventions likely lead to poor compliance rates. In addition, the challenge of implementing such legislations with often limited law enforcement resources creates a scenario in which lawmakers may be forced to decide which policies will be given priority. This effect could explain the findings of Nazif-Muñoz and colleagues in which the benefit of road safety legislations diminished over time as law enforcement assets were reallocated to other areas [53,54]. Our data would suggest that policy makers should give the highest priority to enforcing helmet legislations, given the very high potential for preventing mortality and morbidity in young road users.

At the local level, we must first consider what impediments to compliance exist in order to provide appropriately focused incentive and education. For example, there are many cultural complexities such as religious beliefs preventing head covering [55] and misperceptions such as concern for higher risk of cervical spine injury to helmeted child passengers [56], which reduce helmet usage. Cultural norms and perceptions such as these must be addressed through culturally specific public education campaigns, which encourage individuals to be participants in their own healthcare and prevention. Such nonlegislative interventions are undeniably an important component of public health measures in all settings, but perhaps particularly in LMICs. The value of these efforts are typified by international organizations such as ThinkFirst [57] (www.ThinkFirst.org) and the Asia Injury Prevention Foundation (www.aip-foundation.org) [58], both of which have played major roles in the promotion of helmet usage and the prevention of head injury in Southeast Asia and worldwide. As helmet laws are increasingly passed in LMICs, it will be important that they are accompanied by efforts such as these.

Limited finances also represent an important practical barrier to helmet usage [59]. In general, with greater helmet quality comes higher cost and thus lower usage. While minimum standards for helmet quality and government subsidies remain useful, public education programs to teach the importance of high-quality helmet usage are an effective adjunctive strategy. In addition, motorcycle taxis have long been a fixture of roadways throughout the world and are known for unsafe driving practices that contribute to road traffic injuries [60]. Notably, as this industry is increasingly formalized via the use of app-based ride-hailing motorcycle services throughout Africa and Southeast Asia, there is a significant impetus to increase the standards of driver safety, vehicle maintenance, and helmet usage among motorcycle taxi drivers. Such trends show a significant promise in utilizing free market mechanisms to increase the usage of helmets and overall safety of commercial motorcycle drivers and passengers [61].

As are all meta-analyses, this study is limited in its reliance upon previously published literature. In order to account for any publication bias, funnel plots and trim-and-fill method were completed, when statistically feasible, for all studied outcomes and without evidence of significant bias. Additionally, among the studies included in our analyses, there were multiple study designs and data sources employed, which ranged from national-level trauma databases to individual hospital-level experiences. In an effort to provide the greatest level of transparency in the interpretation of our data, we have included in Table 1 the population scale of each study’s data (single center, regional, or national) along with ratings of overall study quality using the NOS. Another limitation of the study is that all extracted data used in our analysis were summary-level data rather than individual-level data from each included study. While this has strong validity as a methodology for meta-analysis, it is possible that this could introduce bias into the data extraction process.

Table 1. Summary of all included studies with study characteristics and reported outcomes with mandatory helmet legislation in effect.

First Author and Publication Year Country WHO Region Income Level Law Enacted Study Period Enactment Gap (Years) Scale Design NOS
Venturini S., 2019 Cambodia WPR Lower Middle 2016 2014–2017 1 Single Center Retro Cohort 4
Akl Z., 2018 Lebanon EMR Upper Middle 2015 1997–2017 2 National Pre–Post 6
Ha N., 2018 Vietnam WPR Lower Middle 2007 2005–2010 3 Regional Retro Cohort 7
Marya J., 2017 India SEAR Lower Middle 2014 2014–2015 1 Regional Retro Cohort 6
Nguyen H., 2013 Vietnam WPR Lower Middle 2007 2007–2011 4 Regional Pre–Post 6
French M., 2012 USA AMR-US/CAN High 1967 1988–2008 41 National Case–Control 8
Passmore J., 2010 Vietnam WPR Lower Middle 2007 2007–2008 1 Regional Pre–Post 4
Espitia-Hardeman V., 2008 Colombia AMR-L Upper Middle 1996, 1997 1993–2001 4 Regional Retro Cohort 8
Mayrose J., 2008 USA AMR-US/CAN High 1997 1995–2000 3 Regional Retro Cohort 7
Chiu W., 2007 Taiwan WPR High 1997 1991–2001 4 National Cohort 8
Coben J., 2007 USA AMR-US/CAN High 1967 2001 34 National Retro Cohort* 7
La Torre G., 2007 Italy EUR High 2000 1999–2000 0 Single Center Retro Cohort 7
Ichikawa M., 2003 Thailand SEAR Upper Middle 1994 1994–1997 3 Single Center Retro Cohort 6
Servadei F., 2003 Italy EUR High 2000 1999–2001 1 National Retro Cohort 5
Auman K., 2002 USA AMR-US/CAN High 1992 1990–1995 3 Regional Retro Cohort 8
Proscia N., 2002 USA AMR-US/CAN High 1967 1996–1998 31 Regional Retro Cohort* 5
Branas C., 2001 USA AMR-US/CAN High 1967 1994–1996 29 National Retro Cohort 9
Ferrando J., 2000 Spain EUR High 1992 1990–1995 1 Regional Retro Cohort 7
Chiu W., 2000 Taiwan WPR High 1997 1996–1998 3 National Cohort 6
Tsai M., 1999 Taiwan WPR High 1997 1996–1997 0 National Retro Cohort 6
Peek-Asa C., 1997 USA AMR-US/CAN High 1992 1991–1993 1 Regional Retro Cohort 8
Panichaphongse V., 1995 Thailand SEAR Upper Middle 1994 1991–1994 0 Single Center Retro Cohort 5
Mock C., 1995 USA AMR-US/CAN High 1990 1986–1993 0 Regional Retro Cohort* 5
Grima F., 1995 Spain EUR High 1992 1992 3 Regional Pre–Post 5
Kraus J., 1995 USA AMR-US/CAN High 1992 1991–1992 0 Regional Pre–Post* 5

Cambodian helmet law passed in 2016 expanded the required population for helmet usage and increased the fines for violators in comparison to the 2009 law.

The Highway Safety Act of 1966 mandated that all states in the US pass motorcycle helmet legislation. Many states have since repealed or overturned these laws allowing for comparison between these states now with no helmet law and others having had one in place for several decades.

*Included only severe TBI in the study.

AMR-L, Latin America; AMR-US/Can, North America–US/Canada; EMR, Eastern Mediterranean Region; EUR, Europe; NOS, Newcastle–Ottawa Scale for study quality; SEAR, Southeast Asia Region; TBI, traumatic brain injury; USA, United States of America; WPR, Western Pacific Region.

Enactment Gap = time interval from passage of the helmet legislation to study completion.

Notably, there was no available literature regarding helmet laws from the lowest income countries or from the African WHO region. This is likely due in part to relatively fewer LICs with helmet laws, 13.9%, but also likely represents an important regional research disparity. Given this disparity, it is possible that lower study quality and years since enactment of legislation were potential confounding variables in the results of our studies coming from LMICs. We addressed this by performing specific meta-regression analyses that demonstrated no significant effect of these variables on the 3 outcomes of interest and persistent effect of country income even when adjusting for study quality and years since law enactment. These findings suggested that study quality and years since enactment were not a significant effect modifier or source of heterogeneity in the results of our study. Moving forward, research efforts focused on the lowest-income strata should be a priority of the international community.

Our findings suggest that there are significant potential benefits to the widespread enactment of mandatory motorcycle helmet legislations in all global settings. We identified a disparity in legislative impact, showing lower usage of motorcycle helmets and less reduction in brain injuries, including severe TBI in LMICs compared with HICs. Notably though, the reduction in motorcycle fatalities was similar between income contexts and overall greater in LMICs when controlling for study quality and years since law enactment. This indicates that while some outcomes of the law are diminished in lower income settings, the overall goal of reducing mortality is achieved. The passing and enforcement of such laws provides protection to the most economically indispensable demographics through prevention of traumatic injuries. Given that LICs are, by definition, economically disadvantaged, any policy that could provide benefit to those individuals who are most capable of working a job and improving the quality and stability of a society should be given high priority. We therefore propose that not only should mandatory helmet legislation be encouraged at the international policy level but also by local champions who act as evidence-based advocates for injury prevention.

While helmet laws alone have strong potential to reduce death and disability related to RTAs, there are additional legislative reforms that could provide additional important benefit such as the creation and enforcement of speed limits, seat belt usage, and stricter policies regarding alcohol intoxication [62]. In particular, alcohol usage has been found to be a significant contributor to road-related morbidity and mortality worldwide with greater prevalence in LMIC settings [63]. Lastly, poorer road and transportation infrastructure give way to disproportionately higher rates of RTAs in LMICs [64]. Improving the ease and safety of transportation has important implications both for economics and public health and is a growing priority of the international development community. The recent Lancet Commission on Legal Determinants of Global Health makes the case that governance can provide the framework for achieving sustainable development goals and be used to implement fair and evidence-based health interventions [49]. We propose the potential public health impact that could occur with passage, and implementation of international mandatory helmet laws typifies this sentiment.

We concluded that mandatory motorcycle helmet legislation was associated with a reduction in motorcycle fatalities in all income contexts. There was improved helmet usage and reduced TBI due to motorcycle crash worldwide, but with greater benefit seen in higher-income settings where the legal framework may be more solidified. WHO and UN have taken strong stands in better understanding the issues at hand; however, still needed are local partners that understand the data and are willing to implement policies that facilitate adequate and equitable preventive health measures to the world population.

Supporting information

S1 Checklist. Preferred Reporting Items for Systematic-reviews and Meta-Analysis (PRISMA) checklist.

(DOC)

S1 Fig. Funnel plot of standard error for log ORs of motorcycle fatality in all studies.

The vertical solid line is drawn at the pooled log OR, and the other 2 lines represent the expected 95% CI for a given standard error. The plot shows no significant publication bias. Begg’s (p-value: 0.22) and Egger’s (p-value: 0.29) tests showed no evidence of a statistically significant publication bias. CI, confidence interval; OR, odds ratio.

(PDF)

S2 Fig. Funnel plot of standard error for log ORs of TBI in HICs.

The vertical solid line is drawn at the pooled log OR, and the other 2 lines represent the expected 95% CI for a given standard error. The plot shows slight asymmetry to the right of the pooled effect estimate, despite the nonstatistically significant p-values of Begg (0.93) and Egger (0.045). CI, confidence interval; HIC, high-income country; OR, odds ratio; TBI, traumatic brain injury.

(PDF)

S1 Table. Search terms used for each database.

(DOCX)

S1 Data. Extracted data used in meta-analysis separated by study and outcome of interest.

(XLSX)

S1 Code. R code used for data analysis and visualization.

(R)

Abbreviations

CI

confidence interval

HIC

high-income country

IQR

interquartile range

LIC

low-income country

LMIC

low- and middle-income country

NOS

Newcastle–Ottawa Scale

OR

odds ratio

RTA

road traffic accident

SDG

Sustainable Development Goal

TBI

traumatic brain injury

WHO

World Health Organization

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This manuscript was prepared while Jacob R. Lepard, MD was a Wilson Family Clinical Scholar supported by the University of Alabama at Birmingham Women’s Leadership Council. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.WHO. Global status report on road safety 2018. WHO [Internet]. [cited 2019 Oct 2]. Available from: http://www.who.int/violence_injury_prevention/road_safety_status/2018/en/
  • 2.WHO. Interventions to reduce road traffic injuries: increasing motorcycle helmet use. WHO [Internet]. [cited 2019 Oct 2]. Available from: http://www.who.int/gho/road_safety/legislation/motorcycle_helmet_text/en/
  • 3.Countries With the Highest Motorbike Usage. WorldAtlas [Internet]. [cited 2020 Mar 16]. Available from: https://www.worldatlas.com/articles/countries-that-ride-motorbikes.html
  • 4.Banstola A, Mytton J. Cost-effectiveness of interventions to prevent road traffic injuries in low- and middle-income countries: A literature review. Traffic Inj Prev. 2017;18:357–62. doi: 10.1080/15389588.2016.1212165 [DOI] [PubMed] [Google Scholar]
  • 5.Commission for Global Road Safety. World Health Organization (WHO) Global Plan for the Decade of Action in Road Safety. 2018. Available from: https://www.who.int/roadsafety/decade_of_action/plan/en/
  • 6.Corley J, Barthèlemy EJ, Lepard J, Alves JL, Ashby J, Khan T, et al. Comprehensive Policy Recommendations for Head and Spine Injury Care in Low- and Middle-Income Countries. World Neurosurg. 2019;132:434–6. doi: 10.1016/j.wneu.2019.08.240 [DOI] [PubMed] [Google Scholar]
  • 7.Liu BC, Ivers R, Norton R, Boufous S, Blows S, Lo SK. Helmets for preventing injury in motorcycle riders. Cochrane Database Syst Rev. 2008:CD004333. doi: 10.1002/14651858.CD004333.pub3 [DOI] [PubMed] [Google Scholar]
  • 8.Du RY, LoPresti MA, García RM, Lam S. Primary prevention of road traffic accident-related traumatic brain injuries in younger populations: a systematic review of helmet legislation. J Neurosurg Pediatr. 2020:1–14. doi: 10.3171/2019.10.PEDS19377 [DOI] [PubMed] [Google Scholar]
  • 9.Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535. doi: 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Balk EM, Chung M, Chen ML, Chang LKW, Trikalinos TA. Data extraction from machine-translated versus original language randomized trial reports: a comparative study. Syst Rev. 2013;2:97. doi: 10.1186/2046-4053-2-97 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.New country classifications by income level: 2018–2019. [cited 2020 Mar 23]. Available from: https://blogs.worldbank.org/opendata/new-country-classifications-income-level-2018-2019
  • 12.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–88. doi: 10.1016/0197-2456(86)90046-2 [DOI] [PubMed] [Google Scholar]
  • 13.Higgins BT, Barlow DR, Heagerty NE, Lin TJ. Anterior vs. Posterior Approach for Total Hip Arthroplasty, a Systematic Review and Meta-analysis. J Arthroplast. 2014. doi: 10.1016/j.arth.2014.10.020 [DOI] [PubMed] [Google Scholar]
  • 14.Huedo-Medina TB, Sánchez-Meca J, Marín-Martínez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol Methods. 2006;11:193–206. doi: 10.1037/1082-989X.11.2.193 [DOI] [PubMed] [Google Scholar]
  • 15.Borenstein M, Higgins JPT. Meta-analysis and subgroups. Prev Sci. 2013;14:134–43. doi: 10.1007/s11121-013-0377-7 [DOI] [PubMed] [Google Scholar]
  • 16.Balduzzi S, Rücker G, Schwarzer G. How to perform a meta-analysis with R: a practical tutorial. Evid Based Ment Health. 2019;22:153–60. doi: 10.1136/ebmental-2019-300117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Lortie CJ, Filazzola A. A contrast of meta and metafor packages for meta-analyses in R. Ecol Evol. 2020;10:10916–21. doi: 10.1002/ece3.6747 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ottawa Hospital Research Institute. [cited 2019 Oct 19]. Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp
  • 19.Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–101. [PubMed] [Google Scholar]
  • 20.Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629–34. doi: 10.1136/bmj.315.7109.629 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Akl Z, Akl M, Eriksson C, Gifford M, Koustuv D. Evaluating Helmet Use Among Motorcycle Drivers in Lebanon. Open Public Health J. 2018;11. doi: 10.2174/1874944501811010393 [DOI] [Google Scholar]
  • 22.Auman KM, Kufera JA, Ballesteros MF, Smialek JE, Dischinger PC. Autopsy study of motorcyclist fatalities: the effect of the 1992 Maryland motorcycle helmet use law. Am J Public Health. 2002;92:1352–5. doi: 10.2105/ajph.92.8.1352 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Branas CC, Knudson MM. Helmet laws and motorcycle rider death rates. Accid Anal Prev. 2001;33:641–8. doi: 10.1016/s0001-4575(00)00078-6 [DOI] [PubMed] [Google Scholar]
  • 24.Chiu W-T, Huang S-J, Tsai S-H, Lin J-W, Tsai M-D, Lin T-J, et al. The impact of time, legislation, and geography on the epidemiology of traumatic brain injury. J Clin Neurosci. 2007;14:930–5. doi: 10.1016/j.jocn.2006.08.004 [DOI] [PubMed] [Google Scholar]
  • 25.Chiu WT, Kuo CY, Hung CC, Chen M. The effect of the Taiwan motorcycle helmet use law on head injuries. Am J Public Health. 2000;90:793–6. doi: 10.2105/ajph.90.5.793 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Espitia-Hardeman V, Vélez L, Muñoz E, Gutiérrez-Martínez MI, Espinosa-Vallín R, Concha-Eastman A. [Impact of interventions directed toward motorcyclist death prevention in Cali, Colombia: 1993–2001]. Salud Publica Mex. 2008;50(Suppl 1):S69–77. doi: 10.1590/s0036-36342008000700011 [DOI] [PubMed] [Google Scholar]
  • 27.Ferrando J, Plasència A, Orós M, Borrell C, Kraus JF. Impact of a helmet law on two wheel motor vehicle crash mortality in a southern European urban area. Inj Prev. 2000;6:184–8. doi: 10.1136/ip.6.3.184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.French MT, Gumus G, Homer JF. Motorcycle fatalities among out-of-state riders and the role of universal helmet laws. Soc Sci Med. 2012;75:1855–63. doi: 10.1016/j.socscimed.2012.06.022 [DOI] [PubMed] [Google Scholar]
  • 29.Grima FG, Ontoso IA, Ontoso EA. Helmet use by drivers and passengers of motorcycles in Pamplona (Spain), 1992. Eur J Epidemiol. 1995;11:87–9. doi: 10.1007/BF01719951 [DOI] [PubMed] [Google Scholar]
  • 30.Ha NT, Ederer D, Vo VAH, Pham AV, Mounts A, Nolen LD, et al. Changes in motorcycle-related injuries and deaths after mandatory motorcycle helmet law in a district of Vietnam. Traffic Inj Prev. 2018;19:75–80. doi: 10.1080/15389588.2017.1322203 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Ichikawa M, Chadbunchachai W, Marui E. Effect of the helmet act for motorcyclists in Thailand. Accid Anal Prev. 2003;35:183–9. doi: 10.1016/s0001-4575(01)00102-6 [DOI] [PubMed] [Google Scholar]
  • 32.La Torre G, Van Beeck E, Bertazzoni G, Ricciardi W. Head injury resulting from scooter accidents in Rome: differences before and after implementing a universal helmet law. Eur J Pub Health. 2007;17:607–11. doi: 10.1093/eurpub/ckm028 [DOI] [PubMed] [Google Scholar]
  • 33.Marya J, Dhirawani RB, Dube G, Pathak S, Dausage P, Sethi JK. Impact of compulsory helmet legislation on mortality rate and types of head and facial injuries in Jabalpur. J Oral Maxillofac Surg Med Pathol. 2017;29:24–8. doi: 10.1016/j.ajoms.2016.08.008 [DOI] [Google Scholar]
  • 34.Mayrose J. The effects of a mandatory motorcycle helmet law on helmet use and injury patterns among motorcyclist fatalities. J Saf Res. 2008;39:429–32. doi: 10.1016/j.jsr.2008.07.001 [DOI] [PubMed] [Google Scholar]
  • 35.Mock CN, Maier RV, Boyle E, Pilcher S, Rivara FP. Injury prevention strategies to promote helmet use decrease severe head injuries at a level I trauma center. J Trauma. 1995;39:29–33; discussion 34–35. doi: 10.1097/00005373-199507000-00004 [DOI] [PubMed] [Google Scholar]
  • 36.Passmore J, Tu NTH, Luong MA, Chinh ND, Nam NP. Impact of mandatory motorcycle helmet wearing legislation on head injuries in Viet Nam: results of a preliminary analysis. Traffic Inj Prev. 2010;11:202–6. doi: 10.1080/15389580903497121 [DOI] [PubMed] [Google Scholar]
  • 37.Nguyen HT, Passmore J, Cuong PV, Nguyen NP. Measuring compliance with Viet Nam’s mandatory motorcycle helmet legislation. Int J Inj Control Saf Promot. 2013;20:192–6. doi: 10.1080/17457300.2012.706617 [DOI] [PubMed] [Google Scholar]
  • 38.Panichaphongse V, Watanakajorn T, Kasantikul V. Effects of law promulgation for compulsory use of protective helmets on death following motorcycle accidents. J Med Assoc Thail. 1995;78:521–5. [PubMed] [Google Scholar]
  • 39.Peek-Asa C, Kraus JF. Estimates of injury impairment after acute traumatic injury in motorcycle crashes before and after passage of a mandatory helmet use law. Ann Emerg Med. 1997;29:630–6. doi: 10.1016/s0196-0644(97)70252-x [DOI] [PubMed] [Google Scholar]
  • 40.Proscia N, Sullivan T, Cuff S, Nealon P, Atweh N, DiRusso SM, et al. The effects of motorcycle helmet use between hospitals in states with and without a mandatory helmet law. Conn Med. 2002;66:195–8. [PubMed] [Google Scholar]
  • 41.Servadei F, Begliomini C, Gardini E, Giustini M, Taggi F, Kraus J. Effect of Italy’s motorcycle helmet law on traumatic brain injuries. Inj Prev. 2003;9:257–60. doi: 10.1136/ip.9.3.257 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Tsai MC, Hemenway D. Effect of the mandatory helmet law in Taiwan. Inj Prev. 1999;5:290–1. doi: 10.1136/ip.5.4.290 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Venturini S, Still MEH, Vycheth I, Nang S, Vuthy D, Park KB. The National Motorcycle Helmet Law at 2 Years: Review of Its Impact on the Epidemiology of Traumatic Brain Injury in a Major Government Hospital in Cambodia. World Neurosurg. 2019;125:320–6. doi: 10.1016/j.wneu.2019.01.255 [DOI] [PubMed] [Google Scholar]
  • 44.Kraus JF, Peek C. The impact of two related prevention strategies on head injury reduction among nonfatally injured motorcycle riders, California, 1991–1993. J Neurotrauma. 1995;12:873–81. doi: 10.1089/neu.1995.12.873 [DOI] [PubMed] [Google Scholar]
  • 45.Coben JH, Steiner CA, Miller TR. Characteristics of motorcycle-related hospitalizations: comparing states with different helmet laws. Accid Anal Prev. 2007;39:190–6. doi: 10.1016/j.aap.2006.06.018 [DOI] [PubMed] [Google Scholar]
  • 46.Kraus JF, Peek C, Williams A. Compliance with the 1992 California motorcycle helmet use law. Am J Public Health. 1995;85:96–9. doi: 10.2105/ajph.85.1.96 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Espitia-Hardeman V, Vélez L, Muñoz E, Gutiérrez-Martínez MI, Espinosa-Vallín R, Concha-Eastman A. [Impact of interventions directed toward motorcyclist death prevention in Cali, Colombia: 1993–2001]. Salud Publica Mex. 2008;50(Suppl 1):S69–77. doi: 10.1590/s0036-36342008000700011 [DOI] [PubMed] [Google Scholar]
  • 48.Kraus JF, Peek C, McArthur DL, Williams A. The effect of the 1992 California motorcycle helmet use law on motorcycle crash fatalities and injuries. JAMA. 1994;272:1506–11. [PubMed] [Google Scholar]
  • 49.Gostin LO, Monahan JT, Kaldor J, DeBartolo M, Friedman EA, Gottschalk K, et al. The legal determinants of health: harnessing the power of law for global health and sustainable development. Lancet. 2019;393:1857–910. doi: 10.1016/S0140-6736(19)30233-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Hyder AA. Road safety is no accident: a call for global action. Bull World Health Organ. 2004;82:240. [PMC free article] [PubMed] [Google Scholar]
  • 51.Byrnes M, Gerberich S. Motorcycle helmet use and legislation: a systematic review of the literature. Minn Med. 2012;95:60–5. [PubMed] [Google Scholar]
  • 52.Sosin DM, Sacks JJ. Motorcycle helmet-use laws and head injury prevention. JAMA. 1992;267:1649–51. doi: 10.1001/jama.267.12.1649 [DOI] [PubMed] [Google Scholar]
  • 53.Ignacio Nazif-Muñoz J, Nandi A, Ruiz-Casares M. Impact of child restraint policies on child occupant fatalities and injuries in Chile and its regions: An interrupted time-series study. Accid Anal Prev. 2018;120:38–45. doi: 10.1016/j.aap.2018.07.028 [DOI] [PubMed] [Google Scholar]
  • 54.Nazif-Muñoz JI, Batomen B, Oulhote Y, Spengler J, Nandi A. State or market? How to effectively decrease alcohol-related crash fatalities and injuries. J Epidemiol Community Health. 2020;74:502–9. doi: 10.1136/jech-2019-213191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Gupta A, Jaipuria J, Bagdia A, Kumar S, Sagar S, Misra MC. Motorised two-wheeler crash and helmets: injury patterns, severity, mortality and the consequence of gender bias. World J Surg. 2014;38:215–21. doi: 10.1007/s00268-013-2230-3 [DOI] [PubMed] [Google Scholar]
  • 56.Pervin A, Passmore J, Sidik M, McKinley T, Nguyen THT, Nguyen PN. Viet Nam’s mandatory motorcycle helmet law and its impact on children. Bull World Health Organ. 2009;87:369–73. doi: 10.2471/blt.08.057109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Youngers EH, Zundel K, Gerhardstein D, Martínez M, Bertrán C, Proctor MR, et al. Comprehensive Review of the ThinkFirst Injury Prevention Programs: A 30-Year Success Story for Organized Neurosurgery. Neurosurgery. 2017;81:416–21. doi: 10.1093/neuros/nyx053 [DOI] [PubMed] [Google Scholar]
  • 58.AIP Foundation. AIP Foundation [Internet]. [cited 2019 Oct 4]. Available from: https://www.aip-foundation.org/
  • 59.Hung DV, Stevenson MR, Ivers RQ. Barriers to, and factors associated, with observed motorcycle helmet use in Vietnam. Accid Anal Prev. 2008;40:1627–33. doi: 10.1016/j.aap.2008.05.002 [DOI] [PubMed] [Google Scholar]
  • 60.Nguyen T, Vissoci JRN, Joelson T, Pesambili M, Haglund M, Gerardo CJ, et al. Injury prevalence and safety habits of boda boda drivers in Moshi, Tanzania: A mixed methods study. PLoS ONE. 2018;13:e0207570. doi: 10.1371/journal.pone.0207570 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Muni K, Kobusingye O, Mock C, Hughes JP, Hurvitz PM, Guthrie B. Motorcycle taxi programme increases safe riding behaviours among its drivers in Kampala, Uganda. Inj Prev. 2018. doi: 10.1136/injuryprev-2018-043008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.O’Connor LR, Ruiz RAL. Alcohol and hospitalized road traffic injuries in the Philippines. Yale J Biol Med. 2014;87:307–19. [PMC free article] [PubMed] [Google Scholar]
  • 63.Gjerde H, Sousa TR, De Boni R, Christophersen AS, Limberger RP, Zancanaro I, et al. A comparison of alcohol and drug use by random motor vehicle drivers in Brazil and Norway. Int J Drug Policy. 2014;25:393–400. doi: 10.1016/j.drugpo.2014.01.019 [DOI] [PubMed] [Google Scholar]
  • 64.Papadimitriou E, Filtness A, Theofilatos A, Ziakopoulos A, Quigley C, Yannis G. Review and ranking of crash risk factors related to the road infrastructure. Accid Anal Prev. 2019;125:85–97. doi: 10.1016/j.aap.2019.01.002 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Artur Arikainen

11 May 2020

Dear Dr Lepard,

Thank you for submitting your manuscript entitled "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" for consideration by PLOS Medicine.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by .

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Artur Arikainen,

Associate Editor

PLOS Medicine

Decision Letter 1

Emma Veitch

4 Aug 2020

Dear Dr. Lepard,

Thank you very much for submitting your manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R1) for consideration at PLOS Medicine.

Your paper was evaluated by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to three independent reviewers, including a statistical reviewer (reviewer #2). The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by Aug 25 2020 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Emma Veitch, PhD

PLOS Medicine

On behalf of Clare Stone, PhD, Acting Chief Editor,

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

*The academic editor advising us noted the difference of opinion between reviewers and commented "Reviewer #2 and #3 are scholarly, constructive, yet harsh.. my judgments align more closely to Reviewer #1 and I believe the article might be salvaged after major revisions based on Reviewer #2 and #3 recommendations".

*Please structure the abstract using the PLOS Medicine headings (Background, Methods and Findings, Conclusions) - "Methods and Findings" is a single subsection.

*In the last sentence of the Abstract Methods and Findings section, please include a brief note about any key limitation(s) of the study's methodology.

*As noted by reviewers, PRISMA is a reporting tool rather than a guideline for *conduct* of systematic reviews. In the abstract and Methods section, it's implied that PRISMA was used to design the study rather than to guide reporting - this could be rephrased.

-----------------------------------------------------------

Comments from the reviewers:

Reviewer #1: Please see attached my comments for authors

-----------------------------------------------------------

Reviewer #2: See attachment

Michael Dewey

-----------------------------------------------------------

Reviewer #3: There is a concern that road safety legislation could have differential impact for high vs low/middle income countries. So, the topic of this systematic review and meta-analysis is a good one. However, I have tried to make sense of the data extracted and the analysis performed, but I have not had much luck.

There are at least two ways this data could be analysed: (1) assume the log OR is normally distributed which would also require extracting its variance or both can be computed if the data are available, or (2) random effects logistic regression which are possible if the study-level counts are available (they appear to be). I am assuming the authors did approach (1) since there is mention of the DerSimonian and Laird estimator for the random effect tau^2. But, in doing so, there is no natural interaction term to be analysed if the authors wanted to, say, compare high vs low/middle income countries. In a logistic regression model, it would be possible to have main effects for helmet law (y/n) and HIC (y/n) and their interaction term. It is possible to add HIC (y/n) as a moderator to approach (1) but this is not explicitly an interaction term. So, I am left with not fully understanding what the authors did for the analysis. My preference would be approach (2) as this would likely be the analysis for each study given a binary outcome and the desire to adjust for other factors.

In the supplementary data file, counts are given for helmet use and other variables before and after motorcycle helmet legislation with, I assume, N representing the population or total sampled and n representing "cases". This notation becomes confusing when representing rates. For example, the Tsai (1999) fatality rate is 307/11000000 (per population? or per motorcyclist?) from the data, I think. This is problematic if using approach (1) from above. The variance for the log OR (or even the log odds for each group) requires the actual count and not the rate to compute the variance. It could be argued that 1/(11000000-307) (the contribution to the log OR variance) is a very small number and would be similar if the full count were known, but this should be detailed/argued somewhere in the submission.

The categorisation of countries is unclear. For example, India does not belong in Southeast Asia (SEAR) or Western Pacific Region (WPR), although listed as SEAR in the data. Vietnam is listed separately as being in SEAR and WPR, depending on the study. The US is listed as "United States" and "USA". These inaccuracies could influence the analysis if not corrected (modelling software would treat them as different countries). Why not just list out the 10 countries?

In my opinion, the conclusions of this review are unsupported until the data are corrected and the analysis performed is made clear. I would also urge the authors to provide code used to perform the analyses. The authors mention using CMA to perform analyses, and I would recommend using freely available software like R and the meta-analysis package metafor. This would make it easier to check if the analyses were performed correctly.

Other issues:

Abstract, Background: Why and how have helmet laws been undermined in LMIC's? That is a bold statement that should be supported by evidence.

Abstract, Methods: Please use "crash" instead of "accident". It is unlikely known whether a crash was intentional or not.

It is not clear what "p-interaction" or "p-heterogeneity" mean? I can certainly guess at it, but these are not standard terms for p-values associated with tests of interaction or heterogeneity, and I strongly urge they are not adopted. It only creates confusion.

Also, see my point above, there is no clear interaction term in a meta-analysis model for the log OR with HIC (y/n) as a moderator. Assuming there is an interaction term being tested, there are better ways of assessing whether it should be included in a model or not (e.g., likelihood ratio test, Akaike or Bayesian information criterion).

Abstract, Conclusion: The first sentence is background info and should be given above it.

Assuming the data and the analyses are correct, then the smaller impact of motorcycle TBI and fatalities in LMIC's are expected due to less uptake of helmets. This should be part of the conclusions.

Introduction. No citation(s) given for the first two sentences. Where do these statistics come from? It is not common knowledge that 1.2M people die on roads each year. There is a ref #1 that does not appear to have been used.

No quotes are needed for vulnerable road users.

What percentage of HIC's have comprehensive helmet laws?

This study is an assessment of the effectiveness of motorcycle helmet laws. Efficacy, in this context, would be whether a helmet was effective in biomechanical studies (e.g., dummy drop test).

PRISMA is a checklist not a guideline, although it is sometimes used that way (note: PRISMA checklist not provided in supplementary material).

How did the authors decide the start date for the search? Why not 1980? Or 2000? There do not appear to be many studies on this topic, so it is not clear why a start date was used at all.

It should made clear in the methods what the plan is for non-English studies. It shows up in the results, but presumably there was a plan before studies were identified (who translated the Spanish article?).

Data extraction: What is "country of focus" mean? Presumably the authors mean country of data collection?

Data analysis:

The trim-and-fill method should never be used to "correct" for publication bias.

https://pubmed.ncbi.nlm.nih.gov/26186117/

https://pubmed.ncbi.nlm.nih.gov/12820277/

http://www.metafor-project.org/doku.php/plots:funnel_plot_with_trim_and_fill

Be careful with terminology. The search would yield abstracts and other documents that are not "articles" and documents are "screened" by the title and abstract for inclusion.

Results, 2nd paragraph. Presumably 24 articles qualified for inclusion and then data were extracted? What is a "single centre experience"?

Authors state in results: "All studies assessed legislation related specifically to motorcycle helmet use." Shouldn't this have been an inclusion criterion? It would be odd if this were not the case.

I urge the authors be cautious in over-interpreting "tests for funnel plot asymmetry" as "tests for publication bias". There is a desire to assume these are the same, but they are not. A funnel plot can be asymmetric for reasons other than publication bias, e.g., unaccounted for heterogeneity.

-----------------------------------------------------------

Any attachments provided with reviews can be seen via the following link:

[LINK]

Attachment

Submitted filename: Review meta analysis motorcycles.pdf

Attachment

Submitted filename: lepard.pdf

Decision Letter 2

Artur Arikainen

16 Oct 2020

Dear Dr. Lepard,

Thank you very much for submitting your manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R2) for consideration at PLOS Medicine.

Your paper was evaluated once more by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to the three independent reviewers who reviewed previously, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by Nov 06 2020 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Artur Arikainen

Associate Editor

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

1. Please respond to reviewer #3’s comments below. Specifically, we would ask that you provide the underlying data, calculations, and code in a format amenable to review. Further consideration of your manuscript will likely depend on satisfactory resolution of these concerns.

2. Abstract:

a. Please report your abstract according to PRISMA for abstracts, following the PLOS Medicine abstract structure (Background, Methods and Findings, Conclusions) http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1001419 .

b. Please report the databases searched, the search date ranges, inclusion criteria, scales used for quality/bias assessment.

c. Please report the overall quality of included studies, and a break-down by region and study design.

d. In the last sentence of the Abstract Methods and Findings section, please describe the main limitation(s) of the study's methodology.

3. At this stage, we ask that you include a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript – you may repurpose your “Research in Context” section for this, but please follow our format. This text will be subject to editorial change and should be distinct from the scientific abstract. Please see our author guidelines for more information: https://journals.plos.org/plosmedicine/s/revising-your-manuscript#loc-author-summary

4. Line 230: PLOS does not permit data "not shown”; please remove this claim, or do one of the following:

a) If you are the owner of the data relevant to this claim, please provide the data in accordance with the PLOS data policy, and update your Data Availability Statement as needed.

b) If the data not shown refer to a study from another group that has not been published, please cite personal communication in your manuscript text (it should not be included in the reference section). Please provide the name of the individual, the affiliation, and date of communication. The individual must provide PLOS Medicine written permission to be named for this purpose.

c) For any other circumstance, please contact the journal office ASAP.

5. Thank you for providing your PRISMA checklist. Please replace the page numbers with paragraph numbers per section (e.g. "Methods, paragraph 1"), since the page numbers of the final published paper may be different from the page numbers in the current manuscript. Please rename the file ‘S1 Checklist’ and cite it in the Methods, eg.: "This study is reported as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline (S1 Checklist)."

----

Comments from the reviewers:

Reviewer #1: Dear authors,

I am extremely pleased by your professionalism when answering all my requests. I look forward to read this very important manuscript.

Reviewer #2: The authors have addressed my points

Michael Dewey

Reviewer #3: I do not believe the authors have properly addressed my initial concerns. So, I would like to first restate my main concern:

* In my opinion, the conclusions of this review are unsupported until the data are corrected and the analysis performed is made clear.

My suggestion was to reproduce the analysis using open source software such as R. Having done so, with results at least similar to those using CMA, I would have been satisfied and that would be the end of it for me. I cannot check the authors' CMA code (assuming there is any and not just point-and-click software). That is, this is an issue of reproducibility and not about software choices.

Instead of addressing this issue, the authors have decided to make false claims about who develops statistical software. With all due respect to Larry Hedges and Julian Higgins, the primary developers of R are truly world-renowned statisticians, from initial developers Ross Ihaka and Robert Gentleman (Department of Statistics, University of Auckland) to current developers like Hadley Wickham (last year's COPSS Presidents' Award winner; sometimes called the "Nobel Prize of Statistics"). Also note that I am the head of the statistics department at my university, and our statistics courses are primarily taught using R.

But "whose statisticians are the best" was not my criticism of the submission. I found discrepancies in the data and the authors' response has done little to alleviate those concerns. I do appreciate the column "Methodology Comments (Denominator)" that has been added to the data, but it also raises concerns the effect sizes are heterogeneous because of the denominators used. From what I can gather, there are at least five versions of this total -- population, motorcycle registrations, fatal crashes, reported injuries, and admitted patients. The odds (and therefore odds ratio) are not equivalent when comparing the numbers of cases to each of these. This would be further problematic if the choice of N were confounded with LMIC (yes vs no). The authors should try accounting for these differences, if possible, and include this as a limitation at a minimum.

Re term "p-interaction": It is somewhat clear that comparisons are between helmet law and HIC, but this is not a formal test for interaction. The use of the term "p-interaction" is not justified and very confusing, especially when no model interaction term is being assessed. At a minimum, this non-standard terminology needs to be defined including in the abstract since it appears there. Also note that the Borenstein & Higgins paper cited by the authors makes no mention of "p-interaction" or even "interaction" at all in their paper. I think the terms "effect modifier" and "source of heterogeneity", as used by the authors in their response, is much easier to understand and would be considered standard terminology.

I do think it is acceptable to perform a meta-analysis using summary data, especially when the counts are unavailable as is the case here. However, the authors need to make this clear in the text and it should be listed as a limitation.

I believe the authors should have considered a multivariate meta-regression model as there are likely effect sizes that are not independent. I do not use CMA, but I could not find where this is a feature on their website or their manual.

https://www.meta-analysis.com/pages/features.php?cart=BGM44889920

https://www.meta-analysis.com/downloads/MRManual.pdf

Response to Other Issues #4: A meta-regression can be fit by maximum likelihood, so likelihood methods (e.g., likelihood ratio test, AIC) are possible. It is not true that the width of the confidence interval is a valid measure to assess the model goodness of fit. The summary log OR (not untransformed OR as in response) is computed as a weighted average for both fixed effects and random effects meta-analysis. The "optimal" weights among unbiased estimators (that is, smallest variance) can be shown to be those using the inverse variance (with/without tau^2, depending on approach). This was proven many years ago by Larry Hedges. So, the resulting summary estimator will have the smallest variance and therefore narrowest confidence interval. That is, the CI width is the smallest by construction and not because of how well a model fits the data.

---

Any attachments provided with reviews can be seen via the following link:

[LINK]

Decision Letter 3

Artur Arikainen

7 Jan 2021

Dear Dr. Lepard,

Thank you very much for submitting your revised manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R3) for consideration at PLOS Medicine.

Your paper was evaluated by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to independent reviewers, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, we would like to once more consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by Jan 28 2021 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Artur Arikainen,

Associate Editor

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

1. We note that one reviewer still has some concerns regarding your results. Please therefore provide the latest version of the underlying data, to allow for verification. Please name the file(s) S1 Data etc, and provide a legend at the end of the manuscript.

2. Abstract:

a. Please combine the Methods and Findings sections into one section, “Methods and findings”.

b. Here and throughout, please give exact p values above 0.001, and P<0.001 otherwise.

c. Please include another limitation at line 31.

d. Please delete the Key Words section at lines 36-37.

3. Please provide supplementary tables without tracked changes, and ensure all have a unique number starting from 1, along with a legend at the end of the manuscript.

Comments from the reviewers:

Reviewer #3: Thanks for the detailed response and I appreciate the inclusion of a statistical author. However, the results from CMA and R differ which should not be the case. The DerSimonian-Laird estimator is being used to estimate the random effect (as indicated in R code). This estimator has a closed form solution, so there should be no discrepancies between R and CMA (i.e., no differences in rounding or optimisation procedure). This could be due to using DL when using R and perhaps using ML or ReML when using CMA, but this is not clear.

I attempted to investigate, but the data used has not been provided. I downloaded the data in an earlier submission which I understand has been corrected. The latest version of the data, as far as I can tell, is not part of the submission. So, I cannot perform my review until this is addressed. By the way, uploading the data and the R code file would be helpful and expedite the process.

I am not purposely trying to be obstinate, but I have had serious concerns about how the meta-analysis was conducted from the beginning and those concerns have not been allayed through any of the revisions.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Decision Letter 4

Raffaella Bosurgi

18 Mar 2021

Dear Dr. Lepard,

Thank you very much for re-submitting your manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R4) for review by PLOS Medicine.

I have discussed the paper with my colleagues and the academic editor and it was also seen again by the 3rd reviewer. We can't proceed unless the points below are dealt

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We expect to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

Please note, when your manuscript is accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you've already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosmedicine@plos.org.

If you have any questions in the meantime, please contact me or the journal staff on plosmedicine@plos.org.  

We look forward to receiving the revised manuscript by Mar 25 2021 11:59PM.   

Sincerely,

Dr Raffaella Bosurgi

Executive Editor

PLOS Medicine

plosmedicine.org

------------------------------------------------------------

Requests from Editors:

Comments from Reviewers:

Reviewer #3: Thanks for going through this process again and putting a lot effort into my queries.

I have played around with the data the authors provided and the meta-analysis functions in R meta and metafor.

First, I think it is overly simplistic to claim results differ across software packages for, presumably, computational differences. Generalized linear models do not have closed form solutions, but running some sample code for logistic regression across R and SAS give the exact same results to 4 decimal places. A few notes about this. I set the seed in R to randomly generate data which I then imported into SAS (i.e., data files are the same). The differences are not in the estimates but in the number of significant digits each program prints by default.

My code:

R:

set.seed(12345)

y = round(runif(100),digits=0)

x = rnorm(100)

dta <- data.frame(y=y,x=x)

write.csv(dta,'test_data.csv',row.names=F)

reg <- glm(y~x,family='binomial',data=dta)

summary(reg)

SAS:

proc import file='test_data.csv'

out=test

dbms=csv

replace;

run;

proc logistic data=test;

class y;

model y = x;

run;

This is also true for meta and metafor for a simple case. Using the authors' data with no moderator for country's income, the DL approach provides the exact same results (estimates for tau^2 and its se below).

> c(res.meta$tau2,res.meta$se.tau2)

[1] 1.423870 1.238741

> c(res.metafor$tau2,res.metafor$se.tau2)

[1] 1.423870 1.238741

This is not the case when moderators or subgroups are included. The overall estimates are similar, but this is not a computational issue. I could find much about how each package estimates tau^2 with subgroups, but the metagen() function in meta gives this message:

Details on meta-analytical method:

- Inverse variance method

- Maximum-likelihood estimator for tau^2

- Q-profile method for confidence interval of tau^2 and tau

The methods used in metafor are less clear but they are different from the meta package. Since CMA is propriety, it is less clear what methods they use.

Note that I also tried using maximum likelihood for the two packages and got similar but not exactly the same results.

In sum, I believe the available software -- CMA, R meta, R metafor -- are fitting different models to a DL-type meta-analysis model with a single moderator. It is not clear to me which is the best or better of them, but in some sense they could all be reasonably argued to be acceptable. But this does mean the available software is making different modelling assumptions which may or may not be acceptable for this data.

It is important that scientific studies be transparent and the results be reproducible. Therefore, my recommendation to the authors is to reproduce all their analyses using their data using either R meta or R metafor, and not use CMA. They should also make their data set and R code for ALL analyses publicly available. This will make the analytic approach as transparent as possible while confirming the results can be reasonably reproduced from the data on hand.

In making this recommendation, I would to make it clear that I find it a bit disturbing software packages, especially proprietary ones, do no make it clear what models are being fit and how things are computed. Also, this issue is of no fault to the authors of the submission, so I urge them to be as transparent as possible to avoid any later confusion.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Decision Letter 5

Louise Gaynor-Brook

6 Aug 2021

Dear Dr. Lepard,

Thank you very much for re-submitting your manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R5) for review by PLOS Medicine.

I have discussed the paper with my colleagues and the academic editor and it was also seen again by two reviewers. I am very pleased to say that provided the remaining editorial and production issues are dealt with we are planning to accept the paper for publication in the journal.

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We expect to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

Please note, when your manuscript is accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you've already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosmedicine@plos.org.

If you have any questions in the meantime, please contact me or the journal staff on plosmedicine@plos.org.  

We look forward to receiving the revised manuscript by Aug 13 2021 11:59PM.   

Sincerely,

Louise Gaynor-Brook, MBBS PhD

Associate Editor 

PLOS Medicine

plosmedicine.org

------------------------------------------------------------

Requests from Editors:

General comments:

Please avoid using ‘effect’ and ‘effectiveness’ throughout your manuscript, as these should be used only when causality can be inferred, i.e. from an RCT.

Abstract:

Please report your abstract according to PRISMA for abstracts, following the PLOS Medicine abstract structure (Background, Methods and Findings, Conclusions) http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1001419

Abstract Background:

Line 8 - please replace ‘effects of’ with ‘differences in outcomes of’.

Line 9 - please replace ‘ the effectiveness’ with ‘these’ to avoid using effect/effectiveness

Abstract Methods and Findings:

Please include details on the participant numbers of the studies included if possible; preferably also for the main results presented.

We require that SRs are updated to within roughly 6 months of the expected publication date. Please update your search to the present time.

Line 22 - For the OR of helmet usage, please specify the comparison group. Please revise ‘ effect’

Abstract Conclusions:

Please begin your Abstract Conclusions with "In this study, we observed ..." or similar, to summarize the main findings from your study.

Line 33 - please clarify what is meant by ‘ typified this sentiment’

Author Summary:

Line 54 - please revise ‘effectiveness’

In the final bullet point of ‘What Do These Findings Mean?’, please describe the main limitations of the study in non-technical language.

Introduction:

Line 91 - please expand upon ‘its effectiveness for... '

Line 93 - please consider another term for ‘inflicting’

If there has been a systematic review of the evidence related to your study, please refer to and reference that review and indicate whether it supports the need for your study

Methods:

We require that SRs are updated to within roughly 6 months of the expected publication date. Please update your search to the present time.

For those less familiar with the Newcastle-Ottawa Scale, please provide the maximum score possible

When completing the PRISMA checklist, please use section and paragraph numbers, rather than page numbers which may not correspond to the appropriate sections after copy-editing.

Results

Please include details on the participant numbers of the studies included if possible; preferably also for the main results presented.

Discussion:

Please re-organize the Discussion so that implications and next steps for research, clinical practice, and/or public policy follow the strengths and limitations of the study; followed finally by a one-paragraph conclusion.

Please remove all subheadings within your Discussion

Lines 257, 294-6 - please consider another term for ‘dramatically’

Line 334 - please temper the assertion that your findings were ‘unequivocal’

Figures:

Figure 2 - as pointed out by the reviewer, please do check the labels on the x axis. Please also check that the prediction interval for OR in HIC has been quoted correctly: 5.29 - 540.4

Tables:

Table 1 - please clarify which study only included TBI (should be marked with * )

Table 2 - When a p value is given, please specify the statistical test used to determine it.

Comments from Reviewers:

Reviewer #2: I have reviewed this before but I think I skipped a round of commenting so I am just evaluating the current submission. I have no problems with the current version and I think the degree of detail provided should enable anyone who disagrees with the analysis to replicate it or carry out something different.

I am not so concerned with the problems of differences between software of the estimation of τ² even when using the same method as I believe any differences would be less than using a completely different estimation method. These can give surprisingly different results. However it may be interesting to visit a thread on the R-sig-meta-analysis mailing list which discusses what may be a relevant difference between meta and metafor. However it does date from 2017 and both packages are in constant development.

Michael Dewey

Reviewer #3: I am confused by parts of the authors' response. The authors state:

"we have provided our original data and R-code for all analyses performed"

However, the file "Helmet-R-Script_V4.docx" contains one analysis/forest plot/check for publication bias. I believe there should be three sets of analyses in this file. Additionally, it is unclear why R code has been saved as a WORD file. Why not save it in its native format?

Figure 2: The text states: "all studies demonstrated a higher odds of helmet usage after the enactment of the law"; however, Figure 2 indicates, effectively, a decrease in helmet usage post-law (all OR's are within the "Favors pre-law" region). Is something wrong with your code or the labelling of the figure?

Given the current forest plots in the submission, this statement in the author summary does not really appear true: "Interestingly, the data demonstrated significantly lower effectiveness in LMIC settings". The submission does support a smaller increase in helmet wearing (if Fig 2 was mislabeled, OR=4.82 vs OR=53.49) and less benefit from TBI but STILL a benefit (Fig 4, OR=0.79 vs 0.59), but LMIC's have larger reduction in fatalities than HIC's (OR=0.62 vs 0.79). That is, the results are a mixed bag with regards to LMIC's vs HIC's. I am sure many would argue larger reductions in fatalities is the primary goal of many road safety interventions like helmet laws.

Please make sure all errors have been corrected in this paper, so that we can all move on from this.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Decision Letter 6

Louise Gaynor-Brook

3 Sep 2021

Dear Dr Lepard, 

On behalf of my colleagues and the Academic Editor, Prof. Donald Redelmeier, I am very pleased to inform you that we have agreed to publish your manuscript "Differences in Outcomes of Mandatory Motorcycle Helmet Legislation by Country-Income Level: A Systematic Review and Meta-analysis" (PMEDICINE-D-20-01817R6) in PLOS Medicine.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Once you have received these formatting requests, please note that your manuscript will not be scheduled for publication until you have made the required changes.

In the meantime, please log into Editorial Manager at http://www.editorialmanager.com/pmedicine/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production process. 

PRESS

We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with medicinepress@plos.org. If you have not yet opted out of the early version process, we ask that you notify us immediately of any press plans so that we may do so on your behalf.

We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Thank you again for submitting to PLOS Medicine. We look forward to publishing your paper. 

Sincerely, 

Louise Gaynor-Brook, MBBS PhD 

Associate Editor 

PLOS Medicine

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist. Preferred Reporting Items for Systematic-reviews and Meta-Analysis (PRISMA) checklist.

    (DOC)

    S1 Fig. Funnel plot of standard error for log ORs of motorcycle fatality in all studies.

    The vertical solid line is drawn at the pooled log OR, and the other 2 lines represent the expected 95% CI for a given standard error. The plot shows no significant publication bias. Begg’s (p-value: 0.22) and Egger’s (p-value: 0.29) tests showed no evidence of a statistically significant publication bias. CI, confidence interval; OR, odds ratio.

    (PDF)

    S2 Fig. Funnel plot of standard error for log ORs of TBI in HICs.

    The vertical solid line is drawn at the pooled log OR, and the other 2 lines represent the expected 95% CI for a given standard error. The plot shows slight asymmetry to the right of the pooled effect estimate, despite the nonstatistically significant p-values of Begg (0.93) and Egger (0.045). CI, confidence interval; HIC, high-income country; OR, odds ratio; TBI, traumatic brain injury.

    (PDF)

    S1 Table. Search terms used for each database.

    (DOCX)

    S1 Data. Extracted data used in meta-analysis separated by study and outcome of interest.

    (XLSX)

    S1 Code. R code used for data analysis and visualization.

    (R)

    Attachment

    Submitted filename: Review meta analysis motorcycles.pdf

    Attachment

    Submitted filename: lepard.pdf

    Attachment

    Submitted filename: Helmet Meta - PLOS Reviewer Response Final.docx

    Attachment

    Submitted filename: @Helmet Law Meta - Reviewer Response2 Final.docx

    Attachment

    Submitted filename: PLOS Revision3 Reviewer Comments - V3 RM.docx

    Attachment

    Submitted filename: Helmet - Reviewer Comments_V4.docx

    Attachment

    Submitted filename: Helmet - Editors Comments_V5_ Final.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS Medicine are provided here courtesy of PLOS

    RESOURCES