Skip to main content
BMJ Open logoLink to BMJ Open
. 2022 Nov 29;12(11):e065520. doi: 10.1136/bmjopen-2022-065520

Melatonin for sleep disorders in children with neurodevelopmental disorders: protocol for a systematic review with meta-analysis and Trial Sequential Analysis of randomised clinical trials

Caroline Kamp Jørgensen 1,2,, Rikke Hermann 1,3, Sophie Juul 1, Pascal Faltermeier 1,4, Mark Horowitz 5, Joanna Moncrieff 5,6, Christian Gluud 1,2, Janus Christian Jakobsen 1,2
PMCID: PMC9710329  PMID: 36446459

Abstract

Introduction

Neurodevelopmental disorders are a group of disorders thought to be associated with the functioning of the brain and the nervous system. Children with neurodevelopmental disorders often have sleep-related comorbidities that may negatively affect quality of life for both the children and their families. Melatonin is one of the most used interventions in children with neurodevelopmental disorders and sleep disorders. Previous reviews have investigated the effects of melatonin for sleep disorders in children with neurodevelopmental disorders, but these had important limitations, such as inadequate analysis of adverse effects, small sample sizes and short follow-up.

Methods and analysis

This is a protocol for a systematic review with meta-analysis and Trial Sequential Analysis of randomised clinical trials. The protocol is reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols. We will search for published and unpublished trials in the Cochrane Central Register of Controlled Trials, MEDLINE Ovid, Embase Ovid, LILACS, Science Citation Index Expanded, Conference Proceedings Citation Index-Science, PsycINFO, ClinicalTrials.gov and the International Clinical Trials Registry Platform. We will search the databases from their inception without language restrictions. We will also request clinical study reports from regulatory authorities and pharmaceutical companies. Review authors working in pairs will screen reports, extract data and conduct risk of bias assessments using the Cochrane Risk of Bias tool. We will include randomised clinical trials comparing melatonin versus placebo or no intervention for sleep disorders in children with neurodevelopmental disorders. Primary outcomes will be total sleep time and adverse effects. Secondary outcomes will be quality of life of the child and caregivers and sleep onset latency. Data will be analysed using random-effects and fixed-effect meta-analyses. Certainty of evidence will be assessed with Grading of Recommendations, Assessment, Development and Evaluation approach.

Ethics and dissemination

Ethical approval was not required for this protocol. The systematic review will be published in a peer-reviewed journal.

PROSPERO registration number

CRD42022337530.

Keywords: SLEEP MEDICINE, Paediatric neurology, Developmental neurology & neurodisability


Strengths and limitations of this study.

  • The methodology of our systematic review is predefined in detail to avoid data-driven biased results.

  • The protocol is based on the Cochrane Handbook, the eight-step procedure suggested by Jakobsen et al, Trial Sequential Analysis and the Grading of Recommendations, Assessment, Development and Evaluation approach.

  • This systematic review will consider the risks of random errors, systematic errors, publication bias, heterogeneity and external validity.

  • This systematic review will include both published and unpublished trials.

  • We assess multiple outcomes and subgroup analyses which increases the risks of type I errors.

Introduction

Description of the condition

Neurodevelopmental disorders are a group of disorders thought to be associated with the functioning of the brain and the nervous system.1 Neurodevelopmental disorders are usually diagnosed in childhood and include neurological disorders such as cerebral palsy, epilepsy, Angelman syndrome, Down’s syndrome, Fragile X syndrome, Prader-Willi syndrome, Rett syndrome, Smith-Magenis syndrome, Williams syndrome and non-specific intellectual disability, along with some psychiatric disorders including autism spectrum disorder, attention deficit hyperactivity disorder (ADHD) and attention deficit disorder (ADD).1 2 Children with neurodevelopmental disorders may experience difficulties with learning, attention, behaviour, speech, motor skills and other neurological functions.1

The impact of sleep disturbances was recently ranked as a top 10 research priority within the topics of children with neurodevelopmental disorders by a UK partnership of patients, carers and clinicians.3 Children with neurodevelopmental disorders often have sleep-related comorbidities, including sleep disorders such as insomnia disorder, hypersomnolence disorder, narcolepsy, breathing-related sleep disorders, circadian rhythm sleep disorders, rapid eye movement (REM) sleep arousal disorders, non-REM sleep arousal disorders and nightmare disorders.2 4 Studies have shown the prevalence of comorbid neurodevelopmental disorders and sleep disorders is between 25% and 86% compared with 1% and 6% in the general paediatric population.4–8 Sleep disorders may further enhance problems with learning and behaviour in children with neurodevelopmental disorders,4–8 and often have a negative effect on quality of life for both the children and their families.9 10

Description of the intervention

Melatonin is a naturally occurring hormone in both humans and animals.11 Previously, melatonin was derived from animal pineal tissue,11 but it is now developed synthetically and distributed in different forms, including capsules, tablets, gummies and liquids.12 Melatonin is available in many countries either sold as prescription-only medicine or as over-the-counter medicine to treat sleep disorders in both children and adults, as it is hypothesised to be associated with few adverse effects.11 13 Furthermore, melatonin is one of the most commonly used interventions in children with neurodevelopmental disorders and sleep disorders.14–18 The dosage recommendations vary according to country, but the UK National Health Service currently recommend treatment up to 13 weeks of 2 mg 1–2 hours before bedtime for adults with sleep problems.19 However, there are currently no clear guidelines for prescribing melatonin for children and adolescents with neurodevelopmental disorders.5 11

How the intervention might work

The understanding of melatonin’s underlying mechanisms has previously been extrapolated from animals to humans, but the exact physiological mechanisms of melatonin in humans remain unclear.20–22 Melatonin is a neurohormone primarily secreted by the pineal gland.13 Melatonin mediates dark signals, since the secretion of melatonin is related to darkness, and it is therefore associated with the circadian rhythm in humans.13 17 The secretion of melatonin is regulated by the suprachiasmatic nucleus in the hypothalamus, and the production of melatonin depends on darkness, as the exposure to light inhibits secretion.11 23 A decrease in the secretion of melatonin has been associated with ageing and different diseases, and synthetic melatonin may theoretically reduce sleep disturbance related to melatonin deficiency.13 24 Previous studies have shown that melatonin improves total sleep time, sleep onset latency and sleep quality for adults with sleep disorders, but the effects seem small.13 25 Furthermore, some studies suggest that children with autistic spectrum disorders have abnormal secretions of melatonin.6 26 27 For these theoretical reasons, children with neurodevelopmental disorders may benefit from melatonin.

Why it is important to do this review

A systematic review published in 2018 investigated the effects of melatonin for sleep problems in children with neurodevelopmental disorders.5 The review concluded that melatonin was safe and effective in improving sleep for children with neurodevelopmental disorders.5 Another systematic review published in 2019 investigated the effects of oral melatonin for non-respiratory sleep disturbances in children with neurodisabilities.28 The review concluded that there was some evidence of beneficial effects, but the extent of these effects was unclear due to the poor quality of the evidence.28 The review also concluded that melatonin was well-tolerated, as comparable adverse effects were found in the melatonin and placebo groups.28

These previous reviews had important limitations. The conclusions were affected by a high degree of heterogeneity, high and unclear risk of bias in the included trials and small sample sizes.5 28 Furthermore, the duration of treatment was limited to a maximum of 13 weeks, and adverse events were not adequately reported or analysed in either of the reviews.5 28

In recent studies, it has been questioned whether higher levels of melatonin are associated with delayed puberty, and other adverse effects of melatonin are also theoretically possible.29–31 In 2021, a 2-year follow-up of a trial investigating the treatment with melatonin in 119 children with autism spectrum disorder was published.32 This trial concluded that melatonin was safe and effective for long-term treatment in children.32 Other, new randomised clinical trials might have been published since the last published systematic reviews, and on-going trials have been identified on ClinicalTrials.gov.33 34 These trials may contribute important information about the use of melatonin in children with neurodevelopmental disorders, including adverse effects. Therefore, there is a need for a systematic review to shed light on this important topic and to assess whether the beneficial effects outweigh any harmful effects. Our systematic review will take risks of systematic errors (‘bias’), risks of random errors (‘play of chance’) and the certainty of the evidence into consideration when assessing the effects of melatonin for sleep disorders in children with neurodevelopmental disorders.

Methods and analysis

The present protocol has been registered in the PROSPERO database and is reported according to the guidance suggested in the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) statement (please find the checklist in online supplemental material 1).35 36

Supplementary data

bmjopen-2022-065520supp001.pdf (141.5KB, pdf)

Criteria for considering studies for this review

Types of studies

We will include randomised clinical trials irrespective of trial design (including crossover trials), setting, publication status, publication year and language. We will use online translation services to translate foreign abstracts and reach out to our international colleagues (who will be thanked in the acknowledgements) for help with data extraction of relevant trials. We will not include quasi-randomised trials, cluster-randomised trials or observational studies.

Types of participants

We will include trials randomising children and adolescents (below 18 years of age) with neurodevelopmental disorders, such as cerebral palsy, epilepsy, Angelman syndrome, Down’s syndrome, Fragile X syndrome, Prader-Willi syndrome, Rett syndrome, Smith-Magenis syndrome, Williams syndrome, non-specific intellectual disability, autism spectrum disorder, ADHD and ADD.1 2 Trials will be included if the disorders of the participants are diagnosed by standardised diagnostic criteria, such as the Diagnostic and Statistical Manual of Mental Disorders37 or International Classification of Diseases38 or where the diagnosis or designation of neurodevelopmental disorder is made by a clinician. The participants also need to have a diagnosis of any type of sleep disorder (as defined by trialists), such as insomnia disorder, hypersomnolence disorder, narcolepsy, breathing-related sleep disorder, circadian rhythm sleep disorders, REM sleep arousal disorder, non-REM sleep arousal disorder, and nightmare disorders.

We will include participants irrespective of sex, comorbidities, demographic factors, the stage of their condition and the care setting. If a trial reports data where only a subset of participants is eligible (eg, a combination of children and adults), we will only include data from those participants that fulfil the inclusion criteria, and we will therefore require subset data for the specific group to be available.

Types of interventions

We will include trials where participants in the experimental group are given melatonin at any dose, form (eg, tablet, capsules, gummies, liquids), duration of administration, type of administration (eg, oral), timing of administration and setting. We will include trials where participants receive a co-intervention (eg, pharmacological interventions, such as methylphenidate, or non-pharmacological interventions, such as exercise), providing it is delivered equally (in any aspect, eg, same dose, equal subset of population receiving co-intervention) in the experimental group and the control group.

Comparators

As control intervention we will accept placebo or ‘no intervention’.

Types of outcome measures

Primary outcomes

  1. Total sleep time (in minutes using any type of measurement, eg, polysomnography, actigraphy, self-report or parent-report).

  2. Adverse effects

    1. The proportion of participants with one or more serious adverse events. We will use the International Conference on Harmonisation of technical requirements for registration of pharmaceuticals for human use—Good Clinical Practice (ICH-GCP) definition of a serious adverse event, which is any untoward medical occurrence that resulted in death, was life-threatening, required hospitalisation or prolonging of existing hospitalisation, resulted in persistent or significant disability or jeopardised the participant.39 If the trialists do not use the ICH-GCP definition, we will include the data if the trialists use the term ‘serious adverse event’. If the trialists do not use the ICH-GCP definition nor use the term serious adverse event, then we will also include the data provided the event clearly fulfils the ICH-GCP definition for a serious adverse event. We will also analyse each type of serious adverse event separately.

    2. The proportion of participants with one or more non-serious adverse events (any adverse event not classified as serious). We will also analyse each type of adverse event separately.

Secondary outcomes

  1. Quality of life of the child (any valid continuous scale, eg, Child Quality of Life Questionnaire).40

  2. Quality of life of the parents/caregivers (any valid continuous scale, eg, 36-Item Short Form Survey (SF-36)).41

  3. Sleep onset latency (in minutes using any type of measurement, eg, polysomnography, actigraphy, self-report or parent-report).

Exploratory outcomes

  1. Quality of sleep (any valid continuous scale), such as the Pittsburgh Sleep Quality Index.42

  2. Delayed puberty or any reports of hormonal changes.

  3. Any continuous scale assessing adverse effects (eg, Paediatric Adverse Event Rating Scale).43

Timing of outcome assessment

We will include outcome data recorded at the end of the treatment period primarily and at maximum follow-up secondarily.

Search methods for identification of studies

Electronic searches

We will search the following:

  • Cochrane Central Register of Controlled Trials (CENTRAL; current issue) in The Cochrane Library.

  • MEDLINE Ovid (1946 onwards).

  • Embase Ovid (1974 onwards).

  • LILACS (Latin American and Caribbean Health Science Information database; 1982 onwards).

  • Science Citation Index Expanded (Web of Science; 1964 onwards).

  • Conference Proceedings Citation Index-Science (Web of Science; 1990 onwards).

  • PsycINFO (1967 onwards).

  • ClinicalTrials.gov.

  • International Clinical Trials Registry Platform (ICTRP).

Please see online supplemental material 2 for the search strategy.

Supplementary data

bmjopen-2022-065520supp002.pdf (90.8KB, pdf)

Searching other resources

We will check reference lists of all included trials and any relevant systematic reviews to identify additional trials. We will also search for errata and retraction statements for the included trials. We will search websites of pharmaceutical companies (eg, Natrol, Neurim Pharmaceuticals, Takeda Pharma), websites of US Food and Drug Administration (FDA) and European Medicines Agency (EMA) to identify relevant trials. We will request FDA, EMA and national medicines agencies to provide all publicly releasable information about relevant studies that were submitted for marketing approval, including clinical study reports. We will contact authors of eligible trials and other experts to identify any relevant trials (published or unpublished).

Data collection and analysis

We will perform and report the review based on the recommendations in the Cochrane Handbook for Systematic Reviews of Interventions.44 Analyses will be performed using Stata V.1745 and Trial Sequential Analysis.46 47

Selection of studies

Two review authors will independently screen titles and abstracts using Covidence.48 We will mark articles that clearly do not meet the eligibility criteria as excludes, while potentially eligible articles will go through to the next phase. We will retrieve all relevant full-text study reports/publications, and two review authors will independently screen the full text to identify and record reasons for exclusion of the ineligible trials. The two review authors will resolve any disagreement through discussion, or, if required, they will consult with a third author (JCJ). We will illustrate the selection process of the trials in a PRISMA flow diagram.49 If multiple reports are available for a single trial, all reports will be grouped under a single reference ID.

Data extraction and management

Review authors in pairs will independently extract data from the included trials using a pilot tested data extraction form. Disagreements will be resolved through internal discussion or, if required, by discussion with a third author (JCJ). The two review authors will assess all publications of a trial together to evaluate all available data simultaneously. We will contact trial authors by email to obtain any additional data, which may not have been reported sufficiently in the publication. We will extract the following data:

  • Methods: trial setting, trial location, trial design, trial duration, duration of follow-ups, date of the trial, estimation of sample size, inclusion criteria and exclusion criteria.

  • Participants: number randomised, number analysed for each outcome, number lost to follow-up, age (mean and SD), sex ratio and diagnostic criteria.

  • Interventions: type, dose, timing and duration of intervention.

  • Control: type, dose, timing and duration of comparison.

  • Co-intervention: type, dose, timing and duration of co-interventions.

  • Outcomes: primary, secondary and exploratory outcomes at the reported time points.

  • Notes: trial funding and conflicts of interest of the trial authors.

One review author will transfer the data to Stata. We will double-check the data by comparing the data presented in the review to the data extraction form.

Assessment of risk of bias in included studies

Our bias risk assessment will be based on the Cochrane Risk of Bias tool—version 2 (RoB 2) as recommended in the Cochrane Handbook of Systematic Reviews of Interventions.44 We will evaluate the methodology in respect of the following bias domains:

  • Bias arising from the randomisation process.

  • Bias due to deviations from the intended interventions (effect of assignment to intervention).

  • Bias due to missing outcome data.

  • Bias in measurement of the outcome.

  • Bias in selection of the reported result.

Review authors in pairs will independently assess the risk of bias using a template (available at https://www.riskofbias.info/). Disagreements will be resolved through internal discussion or, if required, by discussion with a third author (JCJ). We will use the signalling questions in the RoB 2 tool to rate each domain at either ‘low risk of bias’, ‘some concerns’ or ‘high risk of bias’. We will assess all domains of risk of bias for each outcome in each trial. The overall risk of bias of a result will be judged to be low if all domains are assessed at low risk of bias. If one or more domains are assessed at either some concerns or high risk of bias, the overall risk of bias will be assessed at high. We will assess the risk of bias for the outcomes of the included trials presented in the ‘Summary of findings’ table (primary and secondary outcomes at end of treatment). The risk of bias assessments will be illustrated in a table (using https://www.riskofbias.info/), and the assessments will be used to conduct subgroup analyses. The risk of bias assessment will also be used to inform the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) and the ‘Summary of findings’ table. For trials using crossover design, only data from the first period will be assessed.

Measures of treatment effect

Continuous outcomes

We will calculate mean differences (MDs) and consider calculating standardised mean differences (SMDs) with 95% CIs for continuous outcomes. We will enter data presented as a scale with a consistent direction of effect. We will primarily analyse scores assessed at single time points. If only changes from baseline scores are reported, we will analyse the results together with follow-up scores for MD (not for SMD).44 If SDs are not reported, we will calculate the SDs using trial data, if possible, or request such data from the authors.

Dichotomous outcomes

We will calculate risk ratios with 95% CIs for dichotomous outcomes.

Unit of analysis issues

We will only include randomised clinical trials. Trials using a crossover design will be treated as parallel trials, since only data from the first period will be included.44 Where multiple trial arms are reported in a single trial, we will include only the relevant arms. For trials with multiple relevant experimental or control groups, we will combine the groups as appropriate.44

Dealing with missing data

We will, as the first option, contact all trial authors to obtain information on missing data (ie, for data extraction and for assessment of risk of bias, as specified above). We will use intention-to-treat data if provided by the trialists.50

Dichotomous outcomes

We will not impute missing values for any outcomes in our primary analysis. In our sensitivity analyses (see below), we will impute data.

Continuous outcomes

We will not impute missing values for any outcomes in our primary analysis. In our sensitivity analysis (see below) for continuous outcomes, we will impute data.

Assessment of heterogeneity

We will investigate forest plots to visually assess for signs of heterogeneity. We will also estimate the presence of statistical heterogeneity by a χ2 test (threshold p<0.05) and measure the quantities of heterogeneity by the I² statistic.51 52 We will investigate possible heterogeneity through subgroup analyses. We may ultimately decide that a meta-analysis should be avoided.44 We will interpret I² heterogeneity as suggested by the Cochrane Handbook for Systematic Reviews of Interventions.44 If we identify substantial heterogeneity (I²>50%), we will report it, and explore the possible causes by prespecified subgroup analyses. We will carefully investigate trial characteristics and report if we find unexpected heterogeneity due to clinical or methodological factors. Ultimately it will be decided if meta-analysis should be avoided.

Assessment of reporting biases

We will use funnel plots to assess reporting bias if 10 or more trials are included in an outcome.44 We will visually inspect funnel plots to assess the risk of small trial effects that could potentially reflect publication bias. We are aware of the limitations of a funnel plot (ie, a funnel plot assesses bias due to small sample size). From this information, we will assess possible risk of publication bias. For dichotomous outcomes, we will test asymmetry with the Harbord test53 if τ2 is <0.1 and with the Rücker test if τ2 is >0.1. For continuous outcomes, we will use the regression asymmetry test54 and the adjusted rank correlation.55

Data synthesis

Meta-analysis

We will undertake this meta-analysis according to the recommendations stated in the Cochrane Handbook for Systematic Reviews of Interventions,44 Keus et al56 and our eight-step procedure suggested by Jakobsen et al.57 We will assess our intervention effects with both random-effects meta-analyses (Hartung-Knapp-Sidik-Jonkman)58 and fixed-effect meta-analyses (Mantel-Haenszel for dichotomous outcomes and inverse variance for continuous outcomes),44 59 and report both meta-analysis results.57 We will primarily report the most conservative result (widest CI and highest p value), and report the less conservative result as a sensitivity analysis.57 As two primary outcomes are specified, we will consider a p value of 0.025 or less as the threshold for statistical significance for all outcomes.57 Our primary analyses will include all trials. Where data are only available from one trial, we will use Fisher’s exact test for dichotomous data and Student’s t-test for continuous data.60 61

Trial Sequential Analysis

Traditional meta-analysis runs the risk of random errors due to sparse data and repetitive testing of accumulating data when updating reviews. We wish to control for the risks of type I and type II errors. We will therefore perform Trial Sequential Analysis on all outcomes, in order to calculate the required information size (ie, the number of participants needed in a meta-analysis to detect or reject a certain intervention effect) and the cumulative Z-curve’s breach of relevant trial sequential monitoring boundaries.47 62–67 A more detailed description of Trial Sequential Analysis can be found in the manual47 and at www.ctu.dk/tsa/. For dichotomous outcomes, we will estimate the required information size based on the observed proportion of patients with an outcome in the control group (the cumulative proportion of patients with an event in the control groups relative to all patients in the control groups), a relative risk reduction or a relative risk increase of 25%, an alpha of 2.5% for all our outcomes, a beta of 10% and the observed diversity as suggested by the trials in the meta-analysis. For continuous outcomes, we will use the observed SD in the control group, a mean difference of 30 min when assessing total sleep time; otherwise, a mean difference of the observed SD/2, an alpha of 2.5% for all outcomes, a beta of 10% and the observed diversity of the trials in the meta-analysis. We will only use the diversity-adjusted required information size (DARIS) for random-effects Trial Sequential Analyses.

Subgroup analysis and investigation of heterogeneity

We will perform the following subgroup analyses on the primary outcomes:

  1. Type of neurodevelopmental disorder: this subgroup analysis will assess whether the effects of melatonin are different depending on the neurodevelopmental disorder of the child.

  2. Age (below 12 years compared with above 12 years and preschool-age children compared with school-age children (as defined by trialists)): this will assess whether the effects of melatonin vary depending on the age of the participants.

  3. Type of comparator (placebo or no intervention): this subgroup analysis will assess whether the effects of melatonin vary depending on the comparator.

  4. Timing of the melatonin administration: if data are available, we will use the following comparisons: <2 hours before bedtime, 2–4 hours before bedtime or 4–8 hours before bedtime. If not, we will use definitions by trialists. This subgroup analysis is relevant, because the timing of administration may affect the outcomes.68–70

  5. Formulation of medication: this subgroup analysis will assess whether the effects of melatonin vary depending on the formulation of melatonin.

  6. Type of sleep disorder: this subgroup analysis will assess whether the effects of melatonin vary depending on the type of sleep disorder.

  7. Trials at high risk of bias compared with trials at low risk of bias: this subgroup analysis will assess whether the effects of melatonin vary depending on the risk of bias of the included trials.

  8. Duration of trials: this subgroup analysis will assess whether the effects of melatonin vary depending on the duration of the included trials.

Post-hoc subgroup analyses might be warranted if unexpected clinical or statistical heterogeneity is identified during the analysis of the review results.57 We will disclose any new subgroup analyses not reported in this protocol in the ‘Differences between protocol and review’ section of the systematic review.

Sensitivity analysis

To assess the potential impact of the missing data, we will perform the two following sensitivity analyses on the primary outcomes:

‘Best-worst-case’ scenario: we will assume that all participants lost to follow-up in the experimental group had beneficial outcomes (no serious adverse events/improved quality of sleep defined as the group mean plus two SDs).57 We will accordingly assume that all participants lost to follow-up in the control group had poor outcomes (serious adverse events/deteriorated quality of sleep defined as the group mean plus two SDs).57

‘Worst-best-case’ scenario: we will assume that all participants lost to follow-up in the experimental group had poor outcomes (serious adverse events/deteriorated quality of sleep defined as the group mean plus two SDs).57 We will accordingly assume that all participants lost to follow-up in the control group had beneficial outcomes (no serious adverse events/improved quality of sleep defined as the group mean plus two SDs).57

We will present the results of both scenarios in our review.

We will assess the potential impact of missing SDs for quality of sleep as follows: when SDs are missing, and it is not possible to calculate them, we will impute SDs from trials with similar populations and low risk of bias. If we find no such trials, we will impute SDs from trials with a similar population. As the final option, we will impute SDs from all trials. We will present results of this scenario in our review.

Summary of findings and assessment of the certainty of the evidence

Review authors in pairs will use GRADE to assess the certainty of the body of evidence associated with each of the primary and secondary outcomes at the end of treatment in our review. We will construct ‘Summary of findings’ tables using the GRADEpro GDT.71 The GRADE approach appraises the certainty of a body of evidence based on the extent to which one can be confident that an estimate of effect or association reflects the item being assessed. We will assess the GRADE levels of evidence as either high, moderate, low or very low certainty on the following quality measures: risk of bias (the overall risk of bias will be used for each outcome), directness of the evidence, heterogeneity of the data, precision of effect estimates (assessed by Trial Sequential Analysis) and risk of publication bias.71 We will downgrade the evidence by one or two levels due to serious or very serious issues. We will downgrade imprecision in GRADE by two levels if the accrued number of participants is below 50% of the DARIS, and one level if between 50% and 100% of DARIS. We will not downgrade if the cumulative Z-curve crosses the monitoring boundaries for benefit, harm or futility, or DARIS is reached. Two review authors will assess the certainty of evidence independently and decide on downgrading. If no agreement can be reached, a third review author (JCJ) will resolve the discussion. We will justify all decisions to downgrade the certainty of evidence using footnotes, and we will make comments to aid the reader’s understanding of the review where necessary. The ‘Summary of findings’ table will also report the anticipated absolute effects, relative effects, number of participants, type of participants and setting.

Differences between the protocol and the review

We will conduct the review according to this published protocol and report any deviations from it in the ‘differences between the protocol and the review’ section of the systematic review.

Patient and public involvement

None.

Ethics and dissemination

Ethical approval was not required for this protocol and systematic review. The results of the systematic review will be published in a peer-reviewed journal to help inform future research and clinical practice.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

We thank Sarah Louise Klingenberg (Information Specialist, The Cochrane Hepato-Biliary Group, Copenhagen Trial Unit, Centre for Clinical Intervention Research, Copenhagen University Hospital—Rigshospitalet, Denmark) for the help with developing the search strategy.

Footnotes

Twitter: @joannamoncrieff

Contributors: CKJ, RH, SJ, PF, MH, JM, CG and JCJ contributed to the conceptualisation and design of the study. CKJ and JCJ wrote the original draft. All authors commented and approved the final manuscript. JCJ is the guarantor of the review.

Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not applicable.

References

  • 1.United States Environmental Protection Agency . Neurodevelopmental disorders, 2015. Available: https://www.epa.gov/sites/default/files/2015-10/documents/ace3_neurodevelopmental.pdf [Accessed 16 Sep 2021].
  • 2.Morris-Rosendahl DJ, Crocq M-A. Neurodevelopmental disorders-the history and future of a diagnostic concept. Dialogues Clin Neurosci 2020;22:65–72. 10.31887/DCNS.2020.22.1/macrocq [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Morris C, Simkiss D, Busk M, et al. Setting research priorities to improve the health of children and young people with neurodisability: a British Academy of childhood disability-James Lind alliance research priority setting partnership. BMJ Open 2015;5:e006233. 10.1136/bmjopen-2014-006233 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Robinson-Shelton A, Malow BA. Sleep disturbances in neurodevelopmental disorders. Curr Psychiatry Rep 2016;18:6. 10.1007/s11920-015-0638-1 [DOI] [PubMed] [Google Scholar]
  • 5.Abdelgadir IS, Gordon MA, Akobeng AK. Melatonin for the management of sleep problems in children with neurodevelopmental disorders: a systematic review and meta-analysis. Arch Dis Child 2018;103:1155–62. 10.1136/archdischild-2017-314181 [DOI] [PubMed] [Google Scholar]
  • 6.Gringras P, Nir T, Breddy J, et al. Efficacy and safety of pediatric prolonged-release melatonin for insomnia in children with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry 2017;56:948–57. 10.1016/j.jaac.2017.09.414 [DOI] [PubMed] [Google Scholar]
  • 7.Hollway JA, Aman MG. Pharmacological treatment of sleep disturbance in developmental disabilities: a review of the literature. Res Dev Disabil 2011;32:939–62. 10.1016/j.ridd.2010.12.035 [DOI] [PubMed] [Google Scholar]
  • 8.Johnson CR. Sleep problems in children with mental retardation and autism. Child Adolesc Psychiatr Clin N Am 1996;5:673–84. 10.1016/S1056-4993(18)30355-9 [DOI] [Google Scholar]
  • 9.Gringras P, Gamble C, Jones AP, et al. Melatonin for sleep problems in children with neurodevelopmental disorders: randomised double masked placebo controlled trial. BMJ 2012;345:e6664. 10.1136/bmj.e6664 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Devnani PA, Hegde AU. Autism and sleep disorders. J Pediatr Neurosci 2015;10:304–7. 10.4103/1817-1745.174438 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Esposito S, Laino D, D'Alonzo R, et al. Pediatric sleep disturbances and treatment with melatonin. J Transl Med 2019;17:77. 10.1186/s12967-019-1835-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Wang S-Y, Shi X-C, Laborda P. Indole-based melatonin analogues: synthetic approaches and biological activity. Eur J Med Chem 2020;185:111847. 10.1016/j.ejmech.2019.111847 [DOI] [PubMed] [Google Scholar]
  • 13.Xie Z, Chen F, Li WA, et al. A review of sleep disorders and melatonin. Neurol Res 2017;39:559–65. 10.1080/01616412.2017.1315864 [DOI] [PubMed] [Google Scholar]
  • 14.Boafo A, Greenham S, Sullivan M, et al. Medications for sleep disturbance in children and adolescents with depression: a survey of Canadian child and adolescent psychiatrists. Child Adolesc Psychiatry Ment Health 2020;14:10. 10.1186/s13034-020-00316-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kimland EE, Bardage C, Collin J, et al. Pediatric use of prescribed melatonin in Sweden 2006-2017: a register based study. Eur Child Adolesc Psychiatry 2021;30:1339–50. 10.1007/s00787-020-01598-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Owens JA, Rosen CL, Mindell JA, et al. Use of pharmacotherapy for insomnia in child psychiatry practice: a national survey. Sleep Med 2010;11:692–700. 10.1016/j.sleep.2009.11.015 [DOI] [PubMed] [Google Scholar]
  • 17.Rzepka-Migut B, Paprocka J. Efficacy and safety of melatonin treatment in children with autism spectrum disorder and attention-deficit/hyperactivity Disorder-A review of the literature. Brain Sci 2020;10. doi: 10.3390/brainsci10040219. [Epub ahead of print: 07 04 2020]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Schwichtenberg AJ, Malow BA. Melatonin treatment in children with developmental disabilities. Sleep Med Clin 2015;10:181–7. 10.1016/j.jsmc.2015.02.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.National Health Service . Melatonin for sleep problems; 2019.
  • 20.Cipolla-Neto J, Amaral FGdo. Melatonin as a hormone: new physiological and clinical insights. Endocr Rev 2018;39:990–1028. 10.1210/er.2018-00084 [DOI] [PubMed] [Google Scholar]
  • 21.Pévet P. Melatonin in animal models. Dialogues Clin Neurosci 2003;5:343–52. 10.31887/DCNS.2003.5.4/ppevet [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Tosini G, Owino S, Guillaume J-L, et al. Understanding melatonin receptor pharmacology: latest insights from mouse models, and their relevance to human disease. Bioessays 2014;36:778–87. 10.1002/bies.201400017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Janjua I, Goldman RD. Sleep-related melatonin use in healthy children. Can Fam Physician 2016;62:315–6. [PMC free article] [PubMed] [Google Scholar]
  • 24.Karasek M. Melatonin, human aging, and age-related diseases. Exp Gerontol 2004;39:1723–9. 10.1016/j.exger.2004.04.012 [DOI] [PubMed] [Google Scholar]
  • 25.Ferracioli-Oda E, Qawasmi A, Bloch MH. Meta-analysis: melatonin for the treatment of primary sleep disorders. PLoS One 2013;8:e63773. 10.1371/journal.pone.0063773 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rossignol DA, Frye RE. Melatonin in autism spectrum disorders: a systematic review and meta-analysis. Dev Med Child Neurol 2011;53:783–92. 10.1111/j.1469-8749.2011.03980.x [DOI] [PubMed] [Google Scholar]
  • 27.Tordjman S, Anderson GM, Pichard N, et al. Nocturnal excretion of 6-sulphatoxymelatonin in children and adolescents with autistic disorder. Biol Psychiatry 2005;57:134–8. 10.1016/j.biopsych.2004.11.003 [DOI] [PubMed] [Google Scholar]
  • 28.Parker A, Beresford B, Dawson V, et al. Oral melatonin for non-respiratory sleep disturbance in children with neurodisabilities: systematic review and meta-analyses. Dev Med Child Neurol 2019;61:880–90. 10.1111/dmcn.14157 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Boafo A, Greenham S, Alenezi S, et al. Could long-term administration of melatonin to prepubertal children affect timing of puberty? A clinician's perspective. Nat Sci Sleep 2019;11:1–10. 10.2147/NSS.S181365 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kennaway DJ. Potential safety issues in the use of the hormone melatonin in paediatrics. J Paediatr Child Health 2015;51:584–9. 10.1111/jpc.12840 [DOI] [PubMed] [Google Scholar]
  • 31.Abdallah N, Attia A, Montaser B. Role of melatonin in constitutional delayed puberty in boys. Menoufia Med J 2020;33:283. 10.4103/mmj.mmj_300_18 [DOI] [Google Scholar]
  • 32.Malow BA, Findling RL, Schroder CM, et al. Sleep, growth, and puberty after 2 years of Prolonged-Release melatonin in children with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry 2021;60:252–61. 10.1016/j.jaac.2019.12.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.ClinicalTrials.gov . Does melatonin restore sleep architecture in autistic children (SOMELIA), 2019. Available: https://clinicaltrials.gov/ct2/show/study/NCT01993251 [Accessed 20 Sep 2021].
  • 34.ClinicalTrials.gov . Treatment of sleep disturbance in children with ASD, 2021. Available: https://clinicaltrials.gov/ct2/show/NCT04878198 [Accessed 20 Sep 2021].
  • 35.Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;349:7647. 10.1136/bmj.g7647 [DOI] [PubMed] [Google Scholar]
  • 37.American Psychiatric Association . Diagnostic and statistical manual of mental disorders (DSM-5®). Washington DC: American Psychiatric Publishing, 2013. [Google Scholar]
  • 38.World Health Organization . International statistical classification of diseases and related health problems (ICD), 2021. Available: https://www.who.int/standards/classifications/classification-of-diseases [Accessed 16 Sep 2021].
  • 39.International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use . ICH harmonised guideline: integrated addendum to ICH E6(R1): guideline for good clinical practice (ICH-GCP), 2015. Step 2 version. Available: https://ichgcp.net/da [Accessed 01 Sep 2021].
  • 40.Graham P, Stevenson J, Flynn D. A new measure of health-related quality of life for children: preliminary findings. Psychol Health 1997;12:655–65. 10.1080/08870449708407412 [DOI] [Google Scholar]
  • 41.Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992;30:473–83. [PubMed] [Google Scholar]
  • 42.Buysse DJ, Reynolds CF, Monk TH, et al. The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res 1989;28:193–213. 10.1016/0165-1781(89)90047-4 [DOI] [PubMed] [Google Scholar]
  • 43.Wehmeier PM, Schacht A, Lehmann M, et al. Emotional well-being in children and adolescents treated with atomoxetine for attention-deficit/hyperactivity disorder: findings from a patient, parent and physician perspective using items from the pediatric adverse event rating scale (PAERS). Child Adolesc Psychiatry Ment Health 2008;2:11. 10.1186/1753-2000-2-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Higgins J, Thomas J, Chandler J, et al. Cochrane Handbook for systematic reviews of interventions. Cochrane, 2022. [Google Scholar]
  • 45.StataCorp . Stata statistical software: release 17 College Station. TX: StataCorp LLC; 2020. [Accessed 01 May 2022]. [Google Scholar]
  • 46.Copenhagen Trial Unit . TSA - Trial Sequential Analysis [Web page]. Available: http://www.ctu.dk/tsa/ [Accessed 01 May 2022].
  • 47.Thorlund K, Engstrøm J, Wetterslev J, et al. User manual for trial sequential analysis (TSA). Copenhagen, Denmark: Copenhagen Trial Unit, Centre for Clinical Intervention Research, 2011: 1–115. [Google Scholar]
  • 48.Covidence . Covidence systematic review software VHI. Available: www.covidence.org
  • 49.Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71. 10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Jakobsen JC, Gluud C, Wetterslev J, et al. When and how should multiple imputation be used for handling missing data in randomised clinical trials - a practical guide with flowcharts. BMC Med Res Methodol 2017;17:162. 10.1186/s12874-017-0442-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539–58. 10.1002/sim.1186 [DOI] [PubMed] [Google Scholar]
  • 52.Higgins JPT, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ 2003;327:557–60. 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Harbord RM, Egger M, Sterne JAC. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med 2006;25:3443–57. 10.1002/sim.2380 [DOI] [PubMed] [Google Scholar]
  • 54.Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997;315:629–34. 10.1136/bmj.315.7109.629 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994;50:1088–101. 10.2307/2533446 [DOI] [PubMed] [Google Scholar]
  • 56.Keus F, Wetterslev J, Gluud C, et al. Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol 2010;10:90. 10.1186/1471-2288-10-90 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Jakobsen JC, Wetterslev J, Winkel P, et al. Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med Res Methodol 2014;14:120. 10.1186/1471-2288-14-120 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.IntHout J, Ioannidis JPA, Borm GF. The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med Res Methodol 2014;14:25. 10.1186/1471-2288-14-25 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Demets DL. Methods for combining randomized clinical trials: strengths and limitations. Stat Med 1987;6:341–8. 10.1002/sim.4780060325 [DOI] [PubMed] [Google Scholar]
  • 60.Fisher RA. On the interpretation of χ 2 from contingency tables, and the calculation of P. J R Stat Soc 1922;85:87. 10.2307/2340521 [DOI] [Google Scholar]
  • 61.Student . The probable error of a mean. Biometrika 1908;6. 10.2307/2331554 [DOI] [Google Scholar]
  • 62.Brok J, Thorlund K, Gluud C, et al. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol 2008;61:763–9. 10.1016/j.jclinepi.2007.10.007 [DOI] [PubMed] [Google Scholar]
  • 63.Brok J, Thorlund K, Wetterslev J, et al. Apparently conclusive meta-analyses may be inconclusive—trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol 2009;38:287–98. 10.1093/ije/dyn188 [DOI] [PubMed] [Google Scholar]
  • 64.Copenhagen Trial Unit . Trial sequential analysis, 2022. Available: https://ctu.dk/tsa/
  • 65.Imberger G, Thorlund K, Gluud C, et al. False-positive findings in Cochrane meta-analyses with and without application of trial sequential analysis: an empirical review. BMJ Open 2016;6:e011890. 10.1136/bmjopen-2016-011890 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Thorlund K, Devereaux PJ, Wetterslev J, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol 2009;38:276–86. 10.1093/ije/dyn179 [DOI] [PubMed] [Google Scholar]
  • 67.Wetterslev J, Thorlund K, Brok J, et al. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol 2008;61:64–75. 10.1016/j.jclinepi.2007.03.013 [DOI] [PubMed] [Google Scholar]
  • 68.Arendt J, Skene DJ. Melatonin as a chronobiotic. Sleep Med Rev 2005;9:25–39. 10.1016/j.smrv.2004.05.002 [DOI] [PubMed] [Google Scholar]
  • 69.Khullar A. The role of melatonin in the circadian rhythm sleep-wake cycle. Psychiatr Times 2012;29:26 https://www.psychiatrictimes.com/view/role-melatonin-circadian-rhythm-sleep-wake-cycle [Google Scholar]
  • 70.Mundey K, Benloucif S, Harsanyi K, et al. Phase-dependent treatment of delayed sleep phase syndrome with melatonin. Sleep 2005;28:1271–8. 10.1093/sleep/28.10.1271 [DOI] [PubMed] [Google Scholar]
  • 71.Guyatt GH, Oxman AD, Vist GE, et al. Grade: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2022-065520supp001.pdf (141.5KB, pdf)

Supplementary data

bmjopen-2022-065520supp002.pdf (90.8KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES