Abstract
Background
Pandemic mortality rates in 1918 and in 2009 were highest among those with the lowest socioeconomic status (SES). Despite this, low SES groups are not included in the list of groups prioritized for pandemic vaccination, and the ambition to reduce social inequality in health does not feature in international and national pandemic preparedness plans. We describe plans for a systematic review and meta-analysis of the association between SES and pandemic outcomes during the last five pandemics.
Method
The planned review will cover studies of pandemic influenza that report associations between morbidity, hospitalization, or mortality with socioeconomic factors such as education and income. The review will include published studies in the English, Danish, Norwegian, and Swedish languages, regardless of geographical location. Relevant records were identified through systematic literature searches in MEDLINE, Embase, Cinahl, SocIndex, Scopus, and Web of Science. Reference lists of relevant known studies will be screened and experts in the field consulted in order to identify other additional sources. Two investigators will independently screen and select studies, and discrepancies will be resolved through discussion until consensus is reached. Covidence will be used. Results will be summarized narratively and using three meta-analytic strategies: coefficients expressing the difference between the highest and lowest socioeconomic groups reported will be pooled using (a) fixed and random effects meta-analysis where studies involve similar outcome and exposure measures and (b) meta-regression where studies involve similar outcome measures. In addition, we will attempt to use all reported estimates for SES differences in (c) a Bayesian meta-analysis to estimate the underlying SES gradient and how it differs by outcome and exposure measure.
Discussion
This study will provide the first systematic review of research on the relation between SES and pandemic outcomes. The findings will be relevant for health policy in helping to assess whether people of low socioeconomic status should be prioritized for vaccines in preparedness plans for pandemic influenza. The review will also contribute to the research literature by providing pooled estimates of effect sizes as inputs into power calculations of future studies.
Systematic review registration
Keywords: Pandemic influenza, Morbidity, Hospitalization, Mortality, Socioeconomic status, Education, Income, Poverty, Occupational social class, Housing conditions
Introduction
Reducing social inequality in health is a core aim of international policies and health work, but a recent review of international and national pandemic preparedness plans finds this perspective lacking in this policy area [1]. No country currently includes low socioeconomic status (SES) groups on their list of groups prioritized for pandemic vaccination. This is surprising given that pandemic mortality rates both in 1918 and in 2009 are highest among those with the lowest SES.
To our knowledge, our study will be the first systematic review and meta-analysis on the associations between SES and pandemic outcomes. A systematic review has been carried out on the associations between disadvantaged ethnic populations and pandemic outcomes in 2009 [2], and a few countries have put ethnic minorities on their list of risk groups for vaccination (e.g., the USA, Canada, and Australia). Our research will provide a strong foundation for assessing whether low SES groups should be placed on the recommended lists of pandemic vaccination along with high-risk age groups, the pregnant, ethnic minorities, health care workers, and the previously ill.
Our research question is whether—and to what extent—socioeconomic status measured by covariates such as education or income is associated with pandemic morbidity, hospitalization, or death. In terms of PICO criteria, the Population (P) consists of groups defined by socioeconomic status, the intervention (I) or exposure or risk factor is pandemic influenza, the comparison (C) or alternative interventions is not relevant, while the outcomes (O) are morbidity, hospitalization, or death associated with influenza pandemics.
A number of studies suggest that pandemic outcomes vary with income and socioeconomic status. During the 1918 pandemic, mortality rates were reduced in high-income countries relative to low-income countries and for rich individuals relative to poor in towns with a large degree of social inequality at baseline. For instance, India had a mortality rate 40 times higher than Denmark [3], while research on Norway found raised mortality rates for members of the working class and those living in small flats and on the east side of the capital city Oslo [4]. Recent studies have also demonstrated that the illiterate, the unemployed, and those renting their homes suffered higher mortality than their counterparts in the city of Chicago, [5] and in Sweden, there was a clear occupational class gradient in mortality [6]. By contrast, countries with small social inequalities at baseline, such as New Zealand, had no mortality differences by socioeconomic status [7–9]. During the 2009 pandemic, some South American countries had a mortality rate 20 times that of Europe [10], while poorer parts of England had mortality rates three times those of more affluent parts [11].
Similar results have been reported for other severe outcomes from pandemics, such as hospitalizations [12, 13], although studies of less severe outcomes such as lab-confirmed H1N1 infection rates during the 2009 pandemic did not appear to differ with socioeconomic indexes across areas in Brisbane, Australia, or by neighborhood socioeconomic status in French administrative regions [14, 15].
Although the studies referred to above report social inequalities in severe outcomes in 1918 and in 2009, more studies are needed to uncover and separate the distal (social and policy) and proximal (behavioral and biological) risk factors for unequal exposure, susceptibility, and access to health care leading to unequal pandemic outcomes [16]. These may relate to cramped living conditions, occupational exposure, ability to stay away from work in order to care for family members, poor nutritional status, concurrent illnesses, and a lack of understanding of or access to health advice (e.g., hand hygiene) and vaccination recommendations due to poor reading and writing skills [1, 4].
Based on the above studies and theoretical arguments for why SES might be dependent on the severity of the pandemic outcome [4], we hypothesize that the association between SES and pandemic outcomes increases with outcome severity, for instance, because higher income and SES are associated with access to resources and protective factors that reduce the risk of progression to more severe outcomes. To test this hypothesis, we will carry out a systematic review and meta-analysis of the literature on the associations between socioeconomic status and pandemic outcomes in the last five pandemics. These are the Russian influenza in 1889–90: Spanish Influenza in 1918–1920, Asian influenza of 1957–1958, the Hong Kong flu of 1968–1970, and the swine flu of 2009–2010.
Although influenza pandemics have occurred three to four times each century since the first generally recognized pandemic occurred in 1580 [17], our analysis concentrate on pandemics that occurred in the period 1889–2009, for three reasons. First, because the detailed sociodemographic data needed to analyze the topic of interest do not exist or are scant for most countries prior to the 1889–1890 pandemic, few, if any, have studied the role of SES for pandemics prior to 1889. Second, the farther we go back in history, the less likely is it that experiences during historical pandemics are relevant and can be translated into current and future influenza pandemic preparedness. This may be an issue even within our covered period of some 120 years, a possibility that will be examined through subsample analyses (see below). Even within our covered period, the results from recent pandemics may differ from those occurring 100–120 years ago. Third, by studying the five last pandemics, our systematic review will cover the breadth of the topic by geographic and pathogen variety over time that cannot be captured by studying, for example, only the 2009 pandemic. We expect to find most studies focused on the 2009 pandemic, followed by the 1918 pandemic, and with very few studies on the pandemics of 1957–1958 and 1968–1970.
Methods/design
Bibliographic database search
A comprehensive and exhaustive search of MEDLINE, Embase, Cinahl, SocIndex, Scopus, and Web of Science was performed to identify all relevant articles published on socioeconomic factors and pandemic influenza. The strategy for the literature search was developed by two information specialists in cooperation with the research group. Several pilot searches were conducted in MEDLINE and Web of Science to ensure a sensitive search. The search strategy combines relevant terms, both controlled vocabulary terms (i.e., MeSH) and text words. The main search strategy used in MEDLINE is available in PROSPERO 87922. The strategy was translated and modified to fit the other databases listed above. To generate manageable results, restrictions on language (English, Danish, Norwegian, and Swedish) and publication type (article/research article) were added to the searches in the other databases. The searches in MEDLINE and Embase were performed without publication type restrictions. The search strategy was peer-reviewed by a third information specialist using a structured tool based on the PRESS framework [18]. In order to identify further relevant books not covered by the databases used in this review, we will ask experts in the field for additional research titles and to search the reference lists of the most relevant articles for additional sources.
Inclusion criteria for title and abstract screening
We identified 8411 records through database searching. After a preliminary elimination of duplicates (n = 4202), the results from the Endnote library were imported to the program Covidence (n = 4203). Here, additional duplicates were discovered and removed (n = 78), leaving 4128 hits. Each article’s title and abstract will be screened by the two authors (SEM and CSE), according to the selection criteria. After the screening of titles and abstracts, full-text versions will be added in Covidence. Divergences in the inclusion of studies will be re-assessed by the same researchers until consensus is reached in terms of inclusion or exclusion. The criteria for inclusion are as follows:
The study period 1889–2009 including the five pandemics in 1889, 1918, 1957, 1968, and 2009
Studies looking at the quantitative associations between SES on the one hand, and morbidity, severe disease, and mortality from pandemic influenza, on the other. SES is captured by keywords such as education, income, and occupational social class (see search history for more examples). Morbidity is captured by keywords such as infection rates, transmission rates, lab-confirmed influenza, flu-like illness, and influenza-like illness (ILI). Severe disease is captured by keywords such as disease severity, critical illness, critical disease, severe illness, severe disease, hospitalization, patient admission, hospital admission, intensive care unit (ICU) admission, and ICU treatment. Mortality is captured by keywords such as fatal outcome, fatal illness, fatal disease, fatality, lethal outcome, lethal illness, lethal disease, terminal outcome, terminal illness, terminal disease, lethality, death, death rate, and mortality rate. All of these keywords were used in both pilots and the final search as described above. The search strategy also covered studies of ethnic and disadvantaged populations, as we expect some of these to include covariates for socioeconomic confounders that would fall within our inclusion criteria
Studies covering both seasonal and pandemic influenza separating between non-pandemic and pandemic years
Studies covering all regions/countries, type of studies (interventional, observational, etc.), and populations (age, gender, pregnant women, soldiers, etc.)
Exclusion criteria for title and abstract screening
The following criteria will exclude studies from the systematic literature review:
Studies on other pandemic diseases than influenza
Studies on seasonal influenza only
Studies on both seasonal and pandemic influenza that do not separate between non-pandemic and pandemic years
Studies on influenza vaccine uptake, attitudes towards influenza vaccination, and compliance with (non)pharmaceutical interventions during influenza pandemics
Case studies or qualitative studies on the associations between socioeconomic factors and pandemic outcomes
Studies on social justice and pandemic influenza
Studies of pandemic influenza preparedness plans
Studies on ethnic and disadvantaged minorities that do not report controls for socioeconomic confounders
Data selection and extraction
We will draft a data abstraction form, pilot test it and modify it, if necessary. Two reviewers (SEM and CSE) will independently extract data from all included studies. Any disagreements will be resolved via discussion or by involving a third reviewer for arbitration; 1–5 and 6 below will be entered into separate spreadsheets for each article. The following information will be extracted:
- Article info
- First author
- Year published
- Journal
- Data sample
- Country or region of analysis
- Pandemic years (1889, 1918, 1957, 1968, 2009)
- Sample inclusion criteria—i.e., characteristics of sample/population (civilian, military, gender, pregnant, age-group/median/average age, patient group, etc.)
- Sample size
- Unit of analysis (individuals, households, regions, hospitals, etc.)
- Data aggregation level (observations of individual units, aggregated units, etc.), e.g., if hospitals are the unit of analysis, does the data used occur at the hospital level or is it pooled across hospitals?
- Source of outcome data, e.g., census, routine notification data (e.g., influenza cases reported to a doctor), survey data, register data
-
i.If survey or incomplete coverage of population data
- Response rate/coverage
- Is the sample shown to be representative for the population? That is, has a non-response analysis been carried out?
-
i.
- Outcome variable—pandemic outcome ((a) morbidity, (b) hospitalization, (c) mortality)
- Give the definition of morbidity: ILI, lab-confirmed infection rates (PCR), transmission rates (reproduction number, R0), immunity/antibodies towards influenza (HI titer above a certain threshold) etc.
- Give the definition of hospitalization: hospitalized inpatients with (PCR) or without confirmed influenza, patients admitted to intensive care unit (ICU) or not, mechanically ventilated patients (“lung machines”) or not, inpatients vs outpatients) etc.
- Give the definition of cause of mortality: influenza and pneumonia (PI), excess mortality (PI, all causes of death, etc.), respiratory diseases, pneumonia, etc.
- Independent variables of interest—relating to SES
- Type of SES indices (education, income, crowding, density, deprivation index, unemployment, occupational social class, poverty status, % below poverty level)
- Give definition or brief descriptive text on SES indices (e.g., if based on a specific type of poverty index, etc.)
- Statistical methodology
- Design of study (cross-sectional, longitudinal, case-control, cohort studies)
- Estimation technique (cross tables, correlation analysis, OLS, Poisson regression, logistic regression, Cox regressions, GEE regressions, GLMM models, etc.)
- Report all control variables (e.g., age, gender, marital status, pre-existing disease, health behavior, etc.) in light of sample restrictions (e.g., for pregnant women, sex is not among the controls)
- Report on the reference categories with which all point estimates are compared
Results reported (separate spreadsheet)
Quality assessment
We will use the Newcastle Ottawa Scale (NOS) to evaluate the quality of the included studies. NOS can be used to evaluate the risk of bias in nonrandomized studies such as case-control and cohort studies and consist of three domains: selection, comparability, and exposure [19].
We will score studies on the representativeness of each sample/data source, whether studies control for important confounders (e.g., age, gender, baseline health etc.) or not, or whether studies are using aggregate- or individual-level data. For instance, a representative sample using individual data and a broad set of relevant controls will receive higher quality ratings than studies using aggregate data, narrow samples, or lacking important confounding variables.
Data synthesis
We will synthesize our results both narratively and quantitatively. The narrative (descriptive) review will include a table of the study characteristics of the included studies, such as author, year, pandemic years, region/country/hospital, sample size and type of data, population by type of socioeconomic status indices (N and %), and pandemic outcome (1–5 in data extraction protocol above). Missing data will be requested from authors, e.g., number of events and population at risk, and quality will be assessed using the NOS. The presence of publication bias will be assessed using funnel plots and the Egger test, as well as through the p value of the standard-error covariate in the PET-PEESE meta-regression (see below).
The quantitative part of the study will pool results across studies. Such pooling can be done using various methods that impose different constraints on the type of studies that can be pooled. We will pursue three strategies. The first two are within the frequentist statistical tradition. We will here note whether coefficients are statistically significant at the 1%, 5%, or 10% level, i.e., whether the evidence base indicates pooled effects that would be unlikely if the true effect was zero. We will also discuss the strength of this test by assessing the magnitude of the pooled coefficient and its standard error (precision) in relation to plausible effect sizes. In the third, Bayesian methods will be used and we will assess how the evidence updates weakly informative priors for the coefficients.
Pooled effect meta-analysis
Where several studies are available with similar outcome and exposure measures, we will show forest plots and estimate pooled effects using fixed and random effects analyses with the metafor meta-analytic package in R [20], transforming the outcome variable when this is required to make the sampling distribution approximate the normal distribution, e.g., taking the log of odds ratios or using the Freeman-Tukey double arcsine transformation for proportions. In these analyses, the pooled estimates will reflect comparisons of the highest to the lowest reported socioeconomic group. We expect random effects to be more appropriate, since the socioeconomic gradient in outcomes may differ across time and region (e.g., we would expect a lower gradient in countries and periods with lower inequality). Cochran’s Q test will be used to assess whether data indicate statistically significant heterogeneity in effects at the 5% level. Effect estimates are also expected to differ systematically across studies according to the socioeconomic “distance” between compared groups. For instance, we would expect a larger outcome difference between the top and bottom 10% of a distribution than we would between those above and below the mean. Depending on the total number of studies that can be pooled in a given analysis, it may also be appropriate to conduct subsample analyses that assess whether pooled effects differ within subgroups of studies characterized by region, pandemic, age-group, gender, and estimation technique or quality assessment score.
Meta-regression
A recent innovation in meta-analyses is a meta-regression technique with precision effect test and precision effect estimate with standard error (“PET-PEESE”) [21, 22]. This technique will be used to pool estimates with similar outcome measures and will allow us to include study-level information as covariates and explore how these correlate with the coefficient estimates. This allows us to assess whether coefficients from comparisons of educational groups tend to differ from those comparing income groups, whether coefficients vary systematically by study-level variables such as pandemic, country-level inequality measures, statistical methodology used, or quality assessment score. The method additionally allows for the examination of how estimates differ systematically with e.g., age-groups. Finally, the technique tests whether coefficients vary systematically with reported standard errors, which may indicate the presence of small sample or publication bias.
Bayesian meta-analysis
The above strategies require a similar outcome measure and will pool coefficients for the highest relative to the lowest socioeconomic group from each study. This ignores the “dose-response” information available from studies that report coefficients comparing multiple socioeconomic levels to a reference level (e.g., coefficients for different income quantiles). Under the assumption that an underlying socioeconomic gradient will be linear on the logit scale, all such reported estimates can contribute to estimating the underlying gradient [23, 24]. The resulting statistical model will be coded and estimated using the Stan language for probabilistic modeling [25] with a multilevel/hierarchical specification to account for heterogeneity across exposure measures (e.g, income, education), pandemic, and study-level covariates. We will also explore whether such an approach makes it feasible to pool studies across outcome measures to assess the hypothesis that gradients vary systematically by the severity of outcome.
Discussion
To the best of our knowledge, our review will be the first to review systematically the evidence for a link between socioeconomic status and pandemic outcomes. The review will generate insights for health policy. If socioeconomic risk factors are shown to be important in explaining the variation in pandemic outcomes above and beyond biomedical risk factors, influenza pandemic preparedness plans should include discussion regarding how to reduce social inequalities in pandemic outcomes, e.g., by recommending vaccination to certain households with below poverty income or people living in a designated poverty area. If socioeconomic risk factors cannot explain the association between the traditional biomedical risk factors and pandemic outcomes, pandemic preparedness plans do not need to be changed. However, we still need to address the underlying reasons for inequalities in health and fight poverty as part of UN Sustainable Development Goals.
Acknowledgements
We are indebted to our librarians Bettina Grødem Knutsen, Ingjerd Legreid Ødemark and Elisabeth Karlsen at the Learning Center and Library, Oslo Metropolitan University. Without their expertise this research would never have been accomplished.
Funding
This research did not receive any funding.
Availability of data and materials
Not applicable.
Abbreviations
- CSE
Clare Shelley-Egan
- OR
Ole Rogeberg
- SEM
Svenn-Erik Mamelund
- SES
Socioeconomic status
Authors’ contributions
SEM and CSE have contributed to the design and writing of the protocol, including collaboration with the librarians. OR has designed the plan for data synthesis and meta-analysis. All authors have read and approved the final manuscript.
Authors’ information
SEM is a historical demographer, PhD, and a research professor. For 23 years, SEM has studied the demography of epidemic diseases with a focus on the 1918 influenza pandemic. The topic is timely with the centenary falling in 2018. CSE is a senior researcher with a PhD in Science and Technology Studies, and a research focus on the ethics and governance of new and emerging technologies. More recently, she has collaborated in research on public health and research policy responses to the Zika virus outbreak. OR has a PhD in Economics, and has published extensively in the field of Experimental Economics including a meta-analysis in a review of the epidemiological literature on the increased crash risks associated with cannabis.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Svenn-Erik Mamelund, Email: Svenn-Erik.Mamelund@oslomet.no.
Clare Shelley-Egan, Email: Clare.Shelley-Egan@oslomet.no.
Ole Rogeberg, Email: ole.rogeberg@frisch.uio.no.
References
- 1.Mamelund SE. Social inequality – a forgotten factor in pandemic influenza preparedness. J Nor Med Assoc. 2017;137(12-13):911–913. doi: 10.4045/tidsskr.17.0273. [DOI] [PubMed] [Google Scholar]
- 2.Tricco AC, Lillie E, Soobiah C, Perrier L, Straus SE. Impact of H1N1 on socially disadvantaged populations: systematic review. PLoS One. 2012;7:1–17. doi: 10.1371/journal.pone.0039437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Murray CJL, Lopez AD, Chin B, Feehan D, Hill KH. Estimation of potential global pandemic influenza mortality on the basis of vital registry data from the 1918-20 pandemic: a quantitative analysis. Lancet. 2006;368:2211–2218. doi: 10.1016/S0140-6736(06)69895-4. [DOI] [PubMed] [Google Scholar]
- 4.Mamelund S-E. A socially neutral disease? Individual social class, household wealth and mortality from Spanish influenza in two socially contrasting parishes in Kristiania 1918–19. Soc Sci Med. 2006;62:923–940. doi: 10.1016/j.socscimed.2005.06.051. [DOI] [PubMed] [Google Scholar]
- 5.Grantz KH, Cummings DAT, Glass GE, Rane MS, Salje H, Schachterle SE. Disparities in influenza mortality and transmission related to sociodemographic factors within Chicago in the pandemic of 1918. Proc Natl Acad Sci U S A. 2016;113:13839–13844. doi: 10.1073/pnas.1612838113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bengtsson T, Dribe M, Eriksson B. Social class and excess mortality in Sweden during the 1918 influenza pandemic. Am J Epidemiol. 2018. 10.1093/aje/kwy151. [DOI] [PMC free article] [PubMed]
- 7.Rice G, Bryder L. Black November: the 1918 influenza pandemic in New Zealand. Christchurch: Canterbury University Press; 2005. [Google Scholar]
- 8.Summers JA, Stanley J, Baker MG, Wilson N. Risk factors for death from pandemic influenza in 1918–1919: a case–control study. Influenza Other Respir Viruses. 2014;8:329–338. doi: 10.1111/irv.12228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Summers JA, Wilson N, Baker MG, Shanks GD. Mortality risk factors for pandemic influenza on New Zealand troop ship, 1918. Emerg Infect Dis. 2010;16:1931–1937. doi: 10.3201/eid1612.100429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Simonsen L, Spreeuwenberg P, Lustig R, Taylor RJ, Fleming DM, Kroneman M, Van Kerkhove MD, Mounts AW, Paget WJ. Global mortality estimates for the 2009 Influenza Pandemic from the GLaMOR project: a modeling study. PLoS Med. 2013;10:e1001558. doi: 10.1371/journal.pmed.1001558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Rutter PD, Mytton OT, Mak M, Donaldson LJ. Socio-economic disparities in mortality due to pandemic influenza in England. Int J Public Health. 2012;57:745–750. doi: 10.1007/s00038-012-0337-1. [DOI] [PubMed] [Google Scholar]
- 12.Chandrasekhar R, Sloan C, Mitchel E, Ndi D, Alden N, Thomas A, Bennett NM, Kirley PD, Hill M, Anderson EJ, et al. Social determinants of influenza hospitalization in the United States. Influenza Other Respi Viruses. n/a-n/a. 2017;11:479–88. [DOI] [PMC free article] [PubMed]
- 13.Tam K, Yousey-Hindes K, Hadler JL. Influenza-related hospitalization of adults associated with low census tract socioeconomic status and female sex in New Haven County, Connecticut, 2007-2011. Influenza Other Respir Viruses. 2014;8:274–281. doi: 10.1111/irv.12231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Mansiaux Y, Salez N, Lapidus N, Setbon M, Andreoletti L, Leruez-Ville M, Cauchemez S, Gougeon M-L, Vély F, Schwarzinger M, et al. Causal analysis of H1N1pdm09 influenza infection risk in a household cohort. J Epidemiol Community Health. 2015;69:272–277. doi: 10.1136/jech-2014-204678. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hu W, Williams G, Phung H, Birrell F, Tong S, Mengersen K, Huang X, Clements A. Did socio-ecological factors drive the spatiotemporal patterns of pandemic influenza a (H1N1)? Environ Int. 2012;45:39–43. doi: 10.1016/j.envint.2012.03.010. [DOI] [PubMed] [Google Scholar]
- 16.Quinn SC, Kumar S. Health inequalities and infectious disease epidemics: a challenge for global health security. Biosecur Bioterror. 2014;12:263–273. doi: 10.1089/bsp.2014.0032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mamelund S-E. International encyclopedia of public health. San Diego: Academic Press; 2008. Influenza, historical; pp. 597–609. [Google Scholar]
- 18.McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–46. doi: 10.1016/j.jclinepi.2016.01.021. [DOI] [PubMed] [Google Scholar]
- 19.Wells GA , Shea B, Peterson J, Welch V, Losos M, P Tugwell. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp.
- 20.Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. 2010;36:1–48. doi: 10.18637/jss.v036.i03. [DOI] [Google Scholar]
- 21.Stanley TD. Meta-regression methods for detecting and estimating empirical effects in the presence of publication selection*. Oxf Bull Econ Stat. 2008;70:103–127. [Google Scholar]
- 22.Stanley TD, Doucouliagos H. Meta-regression approximations to reduce publication selection bias. Res Synth Methods. 2014;5:60–78. doi: 10.1002/jrsm.1095. [DOI] [PubMed] [Google Scholar]
- 23.Marconi A, Di Forti M, Lewis CM, Murray RM, Vassos E. Meta-analysis of the association between the level of cannabis use and risk of psychosis. Schizophr Bull. 2016;42:1262–1269. doi: 10.1093/schbul/sbw003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Vassos E, Pedersen CB, Murray RM, Collier DA, Lewis CM. Meta-analysis of the association of urbanicity with schizophrenia. Schizophr Bull. 2012;38:1118–1123. doi: 10.1093/schbul/sbs096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Carpenter B, Gelman A, Hoffman M, Lee D, Goodrich B, Betancourt M, Brubaker MA, Guo J, Li P, Riddel A. Stan: a probabilistic programming language. J Stat Softw. 2017;76(1):32. 10.18637/jss.v076.i01, https://www.osti.gov/servlets/purl/1430202. [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.