Abstract
Background
Novel psychoactive substances (NPS) are new narcotic or psychotropic drugs that are not controlled by the United Nations drug convention that may pose a serious public health threat due to their wide availability for purchase on the internet and in so called “head shops.” Yet, the extent of their global use remains largely unknown. The aim of this study is to conduct a systematic review of the prevalence of NPS use in non-clinical populations.
Methods
This is a systematic review of observational studies. Embase, MEDLINE, PubMed, Cumulative Index to Nursing and Allied Health (CINAHL), Cochrane Library, Lilacs, Scopus, Global Health, PsychINFO, Web of Science, and the World Health Organization (WHO) regional databases will be searched for eligible prevalence studies published between 2010 and 2016. Data from cross-sectional studies that report the prevalence of NPS use (one or more types) in participants (of any age) from censuses or probabilistic or convenience samples will be included. Data will be extracted from eligible publications, using a data extraction tool developed for this study. Visual and statistical approaches will be adopted instead of traditional meta-analytic approaches.
Discussion
This review will describe the distributions of various types of prevalence estimates of NPS use and explore the impact of different population groups and study-related and tempo-geographical variables on characteristics of these distributions over the period of 2010 to 2016.
Systematic review registration
PROSPERO CRD42016037020
Keywords: Novel psychoactive substances, New psychoactive substances, Legal highs, Research chemicals, Designer drugs, Internet drugs, Club drugs, Epidemiology, Prevalence, Psychiatric morbidity
Background
Definitions, types, and effects
The authors of the United Nations Office on Drugs and Crime report define novel psychoactive substances (NPS) as “substances of abuse, either in a pure form or a preparation, that are not controlled by the 1961 Single Convention on Narcotic Drugs or the 1971 Convention on Psychotropic Substances, but which may pose a public health threat” [1]. “Spice,” “bath salts,” “Special K,” and “herbal incense” are a few street names for a whole new milieu of “designer” drugs that have seen a dramatic increase in use across the globe. Part of the problem in controlling the proliferation of these substances lies in their variety, their ease of synthesis, low cost, being undetectable by standard toxicology screens, and resourceful marketing. In addition to being available from drug traffickers, they are often sold on the internet as well as in neighborhood head shops [2].
Although the NPS terminology seems to imply the creation of novel drugs, many are not new. In fact, most psychoactive drugs (that later became abused) have been in use for at least a century. Many NPS were discovered at the same time as other drugs, and it was simply, for whatever reasons, these other drugs became popular. The majority of these substances are chemicals produced by tweaking or altering the molecular structure of previous well-known psychoactive agents such as cannabis, cocaine, methylenedioxymethamphetamine (or MDMA, commonly known as ecstasy), and lysergic acid diethylamide (or LSD), which are being sold as “legal highs,” “research chemicals,” “herbal highs,” “party pills,” or “plant food” in an attempt to stay ahead of the law prohibiting the sale and use of psychoactive drugs.
NPS are formulated in a variety of forms, and when sold in the market, many contain mixtures of different substances some including controlled drugs. Smoked, ingested, snorted, or injected NPS can produce a variety of psychotropic effects, which can be similar to those related to the controlled substances they contain or to the chemical entities that they are derived from. Based on their clinical effects, NPS can be classified as stimulants, empathogens-entactogens, sedative-hypnotic-anxiolytics, dissociatives, and hallucinogens. Alternatively, they can be classified according to their chemical class as phenethylamines, piperazines, tryptamines, synthetic cathinones, alkylindoles (synthetic cannabinoids), and arylcyclohexylamines [3].
Pharmacologically, these substances affect dopamine, noradrenaline, and serotonin producing a broad spectrum of effects [1, 4]. Additionally, their potential for addiction and toxic effects is diverse and varies depending on the type of NPS. Research on the health implications of most NPS is limited, but what evidence there is suggests that the adverse effects can be just as serious as for controlled drugs. In fact, a broad range of negative health outcomes have been associated with their use [1, 3, 5]. These can be physical or psychological, including cardiovascular problems, seizures, renal failure, myocardial infarction, anxiety, agitation, memory loss, depression, and psychosis [6–11]. Health impacts also depend upon whether other drugs and/or alcohol are used at the same time as NPS and the method of use (if they are swallowed, snorted, or injected). Deaths have been associated with drugs in each of the main NPS groups [12].
Emergence of NPS
Since 2010, there has been a marked increase in the new types of NPS that have been detected for the first time with over 70% of these substances detected in the last 5 years alone [13]. From 166 new substances reported in 2009 to 348 in 2012 [14] and 450 in 2014 [15], in 2015, the European Monitoring Centre for Drugs and Drug Addiction detected over 100 new psychoactive substances bringing the total number of monitored NPS to more than 560 [16]. In fact, their widespread availability through the internet made the issue of NPS a global phenomenon with evidence that the majority of countries that reported the emergence of NPS were from Europe, followed by Asia, Africa, the Americas, and Oceania [12].
Estimating prevalence of self-reported use through surveys
Despite great concern about the increasing availability worldwide and their potential adverse effects, there has been little consideration of the public health burden associated with NPS use. Prevalence is an epidemiological parameter critical for generation of burden metrics, such as the disability-adjusted life year (DALY), now largely used by governments for prioritization of health care and service planning [17].
To collect information about the prevalence of NPS use in the general population, several countries have recently opted for the inclusion of NPS in routine national drug surveys. Based on data from limited number of countries (Canada, USA, Australia, New Zealand, and Ireland), the estimated 12 months prevalence of NPS use for 2011–2012 period ranged from 0.4 to 5.9% [18–23]. In the US, more recent national use estimates are available from two main sources: Monitoring the Future (MTF) study and the National Survey on Drug Use and Health (NSDUH). MTF reported 12 months prevalence of synthetic cannabinoids and bath salts of 10 and 1%, respectively [24]. Meanwhile, data from five cohorts in the NSDUH sampled from households between 2009 and 2013 reported a lifetime prevalence of 1.2% of any NPS use. Psychedelic tryptamines (86.1%), psychedelic phenethylamines (3.9%), and synthetic cannabinoids (3.6%) were the top three most widely used NPS types over this time frame [25].
Although most of the epidemiological data on NPS use come from general population surveys, it is known that some groups of users, particularly some marginalized groups, may be underrepresented in these surveys. This constitutes a major limitation of these surveys given that NPS use is concentrated in certain subgroups such as the young [26], the mentally ill [27], and other special groups (clubbers, psychonauts (people who use substances for exploratory purposes), and people who are lesbian, gay, bisexual, and transgender (LGBT)).
Alternative approaches to NPS prevalence estimation in non-clinical samples (country-specific and international) utilize “flash surveys” often online-, but also phone-based surveys, which obtain results relatively quickly through purposive sampling with focus on specific target groups. Although largely limited by self-selection, surveys like the Flash Eurobarometers and Global Drugs Survey (GDS) have sample sizes of users that are considerably bigger than most national household surveys. Therefore, provided estimates from subgroups of users that may be largely underrepresented in more “traditional surveys”—those based on census or probability samples. For example, the GDS captures NPS use among thousands of clubbers, psychonauts, and students, thus providing valuable information related to use in at-high risk subpopulation groups. According to the most recent GDS, an 11.6% rise in last year purchase occurred in the USA, the highest rate of any country assessed. The next highest estimates were found in the US, Canada, and the Netherlands with the lowest estimate in Switzerland. Globally, the mean percentage of NPS use was 4.8% [28].
Beyond sample designs and characteristics of participants, there are many challenges related to the evolving nature of NPS including the lack of universal definition of what constitutes an NPS, the large and increasing number of substances regarded as NPS, and the differences in legislation between countries. These issues are too complex to be adequately controlled by any one survey or a handful of large-sized surveys, if at all.
Review aims
The aim of this review is to identify and collate studies describing the prevalence of NPS use over the period of 2010 to 2016. To achieve this aim, we will undertake a systematic review of studies reporting point, period, and lifetime prevalence estimates of NPS use in non-clinical populations. We will evaluate the quality of studies and the reported data, which will be extracted and filtered sequentially using multiple criteria and decision rules defined a priori. Data will be synthesized and described using cumulative prevalence distribution plots and related summary measures. The role of temporal, geographical, and other study level variables as potential sources of heterogeneity will also be explored graphically and through planned statistical comparisons.
Search strategy
There is currently no universal definition for novel psychoactive substances (NPS). Furthermore, the extent of variability in reported prevalence estimates of use is largely attributed to lack of such consensus. To balance this need for inclusiveness with practical constraints related to resources, we will use the definition proposed by the United Nations Office on Drugs and Crime [1] to define novel psychoactive substances (NPS). As our interest lies mostly in self-identified NPS use, prevalence as an epidemiological parameter, and population-based surveys as methodological framework for capturing this outcome of interest, we will use layman search terms suggested in a recent review [3].
Search terms will include the following:
(“new psychoactive substances” OR “novel psychoactive substances” OR “legal highs” OR “designer drugs” OR “research chemicals” OR “smart drugs” OR “emerging drugs of abuse” OR “club drugs” OR “herbal highs” OR “bath salts” OR “internet drugs” OR “spice” OR “synthetic drugs”) AND (“prevalence” OR “epidemiology “OR “rate”)
The search string was developed using the Embase (Ovid) database and lists a number of relevant medical subject headings (MESH) and free text words for each construct. The search terms within each concept will be combined using the Boolean operator “or” and the terms across the two key concepts will be combined with “and.” We will then adapt the search strings for other electronic databases as necessary.
In order to identify the relevant papers, we will search the following databases:
EMBASE/OVID (2010–2016)
MEDLINE/OVID (2010–2016)
Cumulative Index to Nursing and Allied Health (CINAHL with Full Text) (2010–2016)
The Cochrane Library (2010–2016)
LILACS
Scopus
PubMed
Global Health
PsychINFO
Web of Science
World Health Organization (WHO) regional databases including Index Medicus for the Eastern Mediterranean Region (IMEMR), African Index Medicus (AIM), Index Medicus for South-East Asia Region (IMSEAR), and Western Pacific Region Index Medicus (WPRIM)
We will search all relevant journals and manually review the reference lists of included articles to identify additional studies. Proceedings from scientific meetings and conference abstracts will also be included. A “Google” search will be performed to identify relevant reports published by international non-government organizations (e.g., WHO, United Nations) and drug monitoring agencies as well as local government reports. In addition, we will initiate contact via email with scientific authorities in the field of substance abuse from North America, South America, Europe, Africa, Asia, Oceania, and the Middle East to ascertain their awareness of relevant unpublished reports or studies in progress. Only articles or scholarly works or reports available in English, German, French, Spanish, Arabic, and Portuguese will be included.
Inclusion and exclusion criteria
We will include cross-sectional probability or census-based surveys that report on prevalence of any type of NPS use in community dwelling individuals. We will exclude studies based on inpatient clinical populations. Studies that do not report prevalence of NPS use or information that would allow estimation of any type of prevalence parameters will be excluded. If relevant data necessary for calculating the precision of the prevalence estimates are missing from the original publications, we will request this data directly from authors. Data from international drug monitoring agencies or online surveys will be included if available.
Condition or domain being studied
Any type of NPS use will be considered with or without other substance use disorders. Self-identification will be the primary method of case ascertainment in the population of interest. Studies using recognized diagnostic criteria, standardized instruments, or biological tests for ascertainment of NPS use will also be included.
Participants/population
The review is concerned with respondents of any age from non-referred samples: the general population or community or educational institutions (schools, colleges, and universities) with a self-reported history of recent NPS use including initiation and recurrent use.
Intervention(s), exposure(s)
None.
Comparator(s)/control
None.
Context
Prevalence estimates will be computed based on a review of studies from North America, South America, Europe, Africa, Asia, Oceania, and the Middle East conducted from 2010 to 2016. Countries will be categorized as low, middle, and high income based on the World Atlas Method [29].
Outcome(s)
The prevalence of NPS use is defined as the proportion of users of any type of NPS at a given point in time (point prevalence) or over a specified period of time (period prevalence) or the proportion of ever users (lifetime prevalence). Synthesis of data related to the prevalence of any type of NPS is the primary outcome for this review. Synthesis of data related to prevalence of commonly (across maximum number of studies) defined classes of NPS would be carried out on ad hoc basis. Synthesis of data related to the prevalence of specific NPS is out of the scope of the current review.
Data extraction, sorting, and selection
Abstracts identified in the searches will be exported to reference management software. Duplicate records will be excluded (using endnote and manually). Titles and abstracts of all identified articles will be screened for eligibility based on the following criteria: (1) significant reviews of the literature reporting NPS use prevalence; (2) major reports on NPS; and (3) original investigations on prevalence of substance use in non-clinical samples of participants of any age. Two members of the research team will conduct the screening process independently. Disagreements will be resolved by discussion with the remaining members of the research team and/or an independent researcher as necessary. An eligibility form will be developed based on the inclusion/exclusion criteria for this review, and reasons and information about included/excluded studies will be recorded. A similar process will be followed for the full-text screening stage of the review.
We will develop a data extraction tool, which will be piloted on a random sample of papers to check for accuracy and consistency. The following information about each study will be extracted:
Study or report characteristics: author (s), study year, country, publication type, language(s)
Study design/methodology: study design, sample size, sampling strategy, recruitment methods, sample coverage (community, country, region), survey administration modality
Parameter of interest: prevalence type including point-, period-, lifetime-prevalence, and non-specified. Type of parameter information available (numerator and denominator or prevalence and denominator or prevalence and standard error, or prevalence and 95% confidence intervals)
NPS-related information: definition(s), wording of use questions, level of information discrete drugs, drug classes, or no information, sources of reported NPS use (proxy or non-proxy), point of purchase
Special groups: information on type of population groups (students, psychiatric morbidity clubbers/ravers, psychonaut, and LGBT
Country-level variables: country’s economic status/measure of wealth, geographical region
Person-level variables: age and gender
Included studies will be categorized and sequentially filtered by a series of criteria including population group (households, schools, and other special groups), survey mode (face-to-face, phone, internet), sample type (probability, census, convenience), prevalence type (point, period, lifetime, and non-specified), and NPS type (any NPS versus specific NPS types—chemical drug name, chemical class name, “street” name). Rules will be developed, pretested, and systematically applied to allow careful selection of prevalence data without counting the same individuals more than once within the same study or in different studies. Specifically, selection rules that prioritize the inclusion of the single most informative and/or representative prevalence estimate will be developed and applied to situations where overall (combined) and class-specific prevalence estimates of NPS are reported by the same study. These rules will be developed ad hoc (if we find that most studies were reporting the prevalence of specific classes—e.g., synthetic cannabinoids, synthetic cathinones—as opposed to any NPS use then when we come across a study that reports both, we will choose the former type of estimates).
Prevalence estimates will be extracted separately for those with and without psychiatric morbidity. To avoid duplication, where person- and psychiatric-specific estimates are reported by the same study, only the latter will be included in the analyses.
Age-specific or overall age prevalence estimates (range) will be extracted separately. To ensure independence of observations, where both are reported, only the latter will be included. Where only age-specific estimates are reported, these will be combined to calculate the overall age prevalence by summing the number of cases across each age group and dividing by the summed denominator across each age group.
Risk of bias (quality) assessment
A tool specifically designed for the assessment of the risk of bias and methodological quality of population-based prevalence studies will be used for the purpose of this review [30]. Studies will be graded using this tool, which will be adapted to incorporate established criteria for high-quality surveys as per evaluation framework put forth by the American Association of Public Opinion Research [31]. Studies will also be graded for the quality of reporting including information about how NPS was defined and operationalized.
Strategy for data synthesis
Setting aside variability due to methodological issues related to quality of studies, reporting, and measurement, we anticipate that the underlying frequency distributions of NPS used to be largely heterogeneous. Prevalence estimates of NPS use are expected to vary widely between countries/regions and time periods due to differences in population characteristics and socio-economic and exposure levels. Therefore, traditional meta-analytic approaches of pooling data to produce a single estimate of prevalence may be conceptually problematic, potentially contributing to loss of informative variation about the prevalence of NPS use. For this reason, we will use descriptive approaches to reporting variations in the distributions of different types of prevalence data across studies. Cumulative prevalence distributions will be plotted for each prevalence type (point, period, and lifetime) and summary statistics for each plot will be provided in accompanying tables with quantiles (including median, mean, interquartile range, and standard deviations). Potential sources of heterogeneity can be investigated through sorting the data according to various rules and comparing the resulting distributions i.e., assessment of significant distributional changes in the cumulative prevalence plots resulting from the inclusion/exclusion of different subsets of studies [32].
In this respect, we plan to conduct a series of sensitivity analyses related to understanding variation in NPS use prevalence by country-level variables (economic status, region), population groups (students, people with psychiatric comorbidity, ravers/clubbers, and people who are gay or lesbian), and study-level variables (survey mode, sample type). Additionally, we aim to understand the role of changing definitions of NPS by detecting significant differences in the distribution of prevalence estimates when data are sorted by studies applying different definitions of NPS. Comparisons between the distributions of proportion estimates for different groups (e.g., males versus females) or for different levels of other variables of interest will be described using the ratio of the measures of central tendency for each variable level (e.g., male to female prevalence estimate ratio). Necessary multiple-comparison adjustments to the tests of significance will be carried out for any post hoc analyses.
Temporal trends will also be investigated by visually inspecting and testing for significant distributional changes in the cumulative prevalence plots and corresponding changes in the effect size of the prevalence estimates in response to the stepwise addition of studies after sorting data in chronological order [33]. This allows estimation of the contribution of studies over time.
Discussion
This systematic review will produce and describe prevalence distributions of NPS use based on data collected by studies conducted between 2010 to 2016 in North America, South America, Europe, Africa, Asia, Oceania, and the Middle East. This review will also explore study-, person-, group-, and NPS-related variables contributing to the heterogeneity of these distribtutions providing a much-needed picture of the extent of variation in prevalence of NPS use across different populations and regions of the world since 2010. Researchers, policy makers, and public health stakeholders will use evidence resulting from the study to set research, policy, and program priorities for surveillance purposes, prevention, and provision of adequate clinical services. This information will also provide necessary insight into the effects of international efforts at policy and control of NPS by identifying “hot spots” and potential “at risk populations,” detailing the relative role of environmental factors in the formation of problematic NPS use.
Acknowledgements
The Social and Economic Survey Research Institute at Qatar University made this study possible. The statements made herein are solely the responsibility of the authors.
Funding
None.
Availability of data and materials
Not applicable.
Authors’ contributions
SK drafted the protocol with support from EH, DB, MZ, AR, AB, and RG. All authors were involved in the design of the review questions, the development of the exclusion/inclusion criteria, and the search strategy for the review. All authors have read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethical approval and consent to participate
Not applicable.
Abbreviations
- AIM
African Index Medicus
- CI
Confidence intervals
- IMEMR
Index Medicus for the Eastern Mediterranean Region
- IMSEAR
Index Medicus for South-East Asia Region
- MESH
Medical subject headings
- NPS
Novel psychoactive substances
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- SE
Standard error
- WHO
World Health Organization
- WPRIM
Western Pacific Region Index Medicus
Contributor Information
Salma M. Khaled, Email: skhaled@qu.edu.qa
Elizabeth Hughes, Email: E.C.Hughes@hud.ac.uk.
Dan Bressington, Email: dan.bressington@polyu.edu.hk.
Monica Zolezzi, Email: mzolezzi@qu.edu.qa.
Ahmed Radwan, Email: ARadwan11@hamad.qa.
Ashish Badnapurkar, Email: abadanapurkar@hamad.qa.
Richard Gray, Email: Rgray@hamad.qa.
References
- 1.UNODC. United Nations Office on Drugs and Crime, 2013. [Internet]. Vienna: United Nations Office On Drugs And Crime; 2013 [cited 2016 May 5]. (World Drug Report). Available from: https://www.unodc.org/unodc/secured/wdr/wdr2013/World_Drug_Report_2013.pdf.
- 2.Corazza O, Demetrovics Z, van den Brink W, Schifano F. “Legal highs” an inappropriate term for “Novel Psychoactive Drugs” in drug prevention and scientific debate. Int J Drug Policy. 2013;24(1):82–83. doi: 10.1016/j.drugpo.2012.06.005. [DOI] [PubMed] [Google Scholar]
- 3.Schifano F, Orsolini L, Duccio Papanti G, Corkery JM. Novel psychoactive substances of interest for psychiatry. World Psychiatry. 2015;14(1):15–26. doi: 10.1002/wps.20174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Iversen L, Gibbons S, Treble R, Setola V, Huang X-P, Roth BL. Neurochemical profiles of some novel psychoactive substances. Eur J Pharmacol. 2013;700(1–3):147–151. doi: 10.1016/j.ejphar.2012.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hermanns-Clausen M, Kneisel S, Szabo B, Auwarter V. Acute toxicity due to the confirmed consumption of synthetic cannabinoids: clinical and laboratory findings. Addict Abingdon Engl. 2013;108(3):534–544. doi: 10.1111/j.1360-0443.2012.04078.x. [DOI] [PubMed] [Google Scholar]
- 6.Balmelli C, Kupferschmidt H, Rentsch K, Schneemann M. Fatal brain edema after ingestion of ecstasy and benzylpiperazine. Dtsch Med Wochenschr 1946. 2001;126(28–29):809–811. doi: 10.1055/s-2001-15702. [DOI] [PubMed] [Google Scholar]
- 7.Borek HA, Holstege CP. Hyperthermia and multiorgan failure after abuse of “bath salts” containing 3,4-methylenedioxypyrovalerone. Ann Emerg Med. 2012;60(1):103–105. doi: 10.1016/j.annemergmed.2012.01.005. [DOI] [PubMed] [Google Scholar]
- 8.Corkery JM, Elliott S, Schifano F, Corazza O, Ghodse AH. MDAI (5,6-methylenedioxy-2-aminoindane; 6,7-dihydro-5H-cyclopenta[f][1,3]benzodioxol-6-amine; “sparkle”; “mindy”) toxicity: a brief overview and update. Hum Psychopharmacol. 2013;28(4):345–355. doi: 10.1002/hup.2298. [DOI] [PubMed] [Google Scholar]
- 9.Spiller HA, Ryan ML, Weston RG, Jansen J. Clinical experience with and analytical confirmation of “bath salts” and “legal highs” (synthetic cathinones) in the United States. Clin Toxicol Phila Pa. 2011;49(6):499–505. doi: 10.3109/15563650.2011.590812. [DOI] [PubMed] [Google Scholar]
- 10.Warrick BJ, Hill M, Hekman K, Christensen R, Goetz R, Casavant MJ, et al. A 9-state analysis of designer stimulant, “bath salt”, hospital visits reported to poison control centers. Ann Emerg Med. 2013;62(3):244–251. doi: 10.1016/j.annemergmed.2012.12.017. [DOI] [PubMed] [Google Scholar]
- 11.Wood DM, Davies S, Greene SL, Button J, Holt DW, Ramsey J, et al. Case series of individuals with analytically confirmed acute mephedrone toxicity. Clin Toxicol Phila Pa. 2010;48(9):924–927. doi: 10.3109/15563650.2010.531021. [DOI] [PubMed] [Google Scholar]
- 12.UNODC. United Nations Office on Drugs and Crime, 2016. [Internet]. Vienna: United Nations Office On Drugs And Crime; 2016 [cited 2016 May 5]. (World Drug Report). Available from: http://www.unodc.org/doc/wdr2016/WORLD_DRUG_REPORT_2016_web.pdf.
- 13.European Monitoring Centre for Drugs and Drug Addiction. EU Drug Markets Report, In-depth Analysis, 2016 [Internet]. Lisbon: EMCDD; 2016 p. 141. Available from: https://dl.dropboxusercontent.com/u/566349360/library/EU-Drug-Markets-Report-In-depth-Analysis.PDF.
- 14.UNODC. United Nations Office on Drugs and Crime, 2014 [Internet]. Vienna: United Nations Office On Drugs And Crime; 2014 [cited 2016 May 5]. (World Drug Report). Available from: http://www.unodc.org/documents/wdr2014/World_Drug_Report_2014_web.pdf.
- 15.European Monitoring Center for Drugs and Drug Addiction . European Drug Report: Trends and Developments [Internet] Lisbon: EMCCDA; 2016. [Google Scholar]
- 16.European Monitoring Center for Drugs and Drug Addiction . European Drug Report: Trends and Developments [Internet] Lisbon: EMCCDA; 2015. [Google Scholar]
- 17.Murray CJ. Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ. 1994;72(3):429–445. [PMC free article] [PubMed] [Google Scholar]
- 18.Health Canada. “Summary of results of 2010–11 Youth Smoking Survey” [Internet]. Waterloo, Canada: Health Canada; 2012 May. (Controlled Substances and Tobacco Directorate). Available from: http://www.hc-sc.gc.ca/hc-ps/tobac-tabac/research-recherche/stat/_survey-sondage_2010-2011/result-eng.php.
- 19.Ministry of Health, New Zealand. “Regulatroy impact statement, new regulatory regime for psychoactive substances” [Internet]. Wellington, New Zealand: the Treasury; 2012 Jul. Available from: http://www.health.govt.nz/about-ministry/legislation-and-regulation/regulatory-impact-statements/new-regulatory-regime-psychoactive-substances.
- 20.National Advisory Commitee on Drugs and Public Health Information and Research Branch, Ireland and Northern Ireland (United Kingdom). Drug Use in Ireland and Northern Ireland 2010/2011: Drug Prevalence Survey: Regional Drug Task Force (Ireland) and Health and Social Care Trust (Northern Ireland) Results. Ireland and Northern Ireland (United Kingdom): National Advisory Commitee on Drugs and Public Health Information and Research Branch; 2012.
- 21.National Drug and Alcohol Research Center, Sydney, 2012. “Australian trends in ecstasy and related drug markets 2011”, findings from ecstasy and related drugs reporting system (EDRS) [Internet]. Sydney 2012: University of New South Wales; (Australian Drug Trends Series No.82). Available from: https://ndarc.med.unsw.edu.au/sites/default/files/ndarc/resources/EDRS%202012%20national%20report%20FINAL.pdf.
- 22.Smith K, Flatley J. Drug misuse declared: findings from the 2010/2011 British Crime Survey England and Wales. UK: Home Office; 2011. [Google Scholar]
- 23.The National Institute on Drug Abuse, USA. “Monitoring the Future, national results on adolescent drug use, overview of key findings, 2011” [Internet]. USA: The University of Michigan, sponsored by The National Institute on Drug Abuse, National Institute of Health; 2012 Feb. Available from: http://www.monitoringthefuture.org/pubs/monographs/mtf-overview2011.pdf.
- 24.Palamar JJ, Acosta P. Synthetic cannabinoid use in a nationally representative sample of US high school seniors. Drug Alcohol Depend. 2015;149:194–202. doi: 10.1016/j.drugalcdep.2015.01.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Palamar JJ, Martins SS, Su MK, Ompad DC. Self-reported use of novel psychoactive substances in a US nationally representative survey: Prevalence, correlates, and a call for new survey methods to prevent underreporting. Drug Alcohol Depend. 2015;156:112–119. doi: 10.1016/j.drugalcdep.2015.08.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.European Union. “Youth Attitudes on Drugs”, Flash Eurobarometer 330 [Internet]. 2011 p. 18. Available from: http://ec.europa.eu/public_opinion/flash/fl_330_en.pdf.
- 27.Martinotti G, Lupi M, Acciavatti T, Cinosi E, Santacroce R, Signorelli MS, et al. Novel psychoactive substances in young adults with and without psychiatric comorbidities. BioMed Res Int. 2014;2014:815424. doi: 10.1155/2014/815424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Global Drug Survey (GDS). The Global Drug Survey 2016 findings [Internet]. Available from: https://www.globaldrugsurvey.com/past-findings/the-global-drug-survey-2016-findings/.
- 29.World Bank Organization. World Atlas Method [Internet]. The World Bank. 2016. Available from: http://go.worldbank.org/IEH2RL06U0.
- 30.Hoy D, Brooks P, Woolf A, Blyth F, March L, Bain C, et al. Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement. J Clin Epidemiol. 2012;65(9):934–939. doi: 10.1016/j.jclinepi.2011.11.014. [DOI] [PubMed] [Google Scholar]
- 31.American Associaton For Public Opinion Research. Evaluating Survey Quality in Today’s Complex Environment [Internet]. AAPOR; 2016 Dec [cited 2016 Sep 15]. Available from: http://www.aapor.org/AAPOR_Main/media/MainSiteFiles/AAPOR_Reassessing_Survey_Methods_Report_Final.pdf.
- 32.McGrath J, Saha S, Welham J, El Saadi O, MacCauley C, Chant D. A systematic review of the incidence of schizophrenia: the distribution of rates and the influence of sex, urbanicity, migrant status and methodology. BMC Med. 2004;2:13. doi: 10.1186/1741-7015-2-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992;327(4):248–254. doi: 10.1056/NEJM199207233270406. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.