Abstract
Aim
To identify the highest‐priority clinical research areas related to children with neurological impairment and medical complexity among clinicians and caregivers.
Method
A modified, three‐stage Delphi study using online surveys and guided by a steering committee was completed. In round 1, clinicians and family caregivers suggested clinical topics and related questions that require research to support this subgroup of children. After refinement of the suggestions by the steering committee, participants contributed to 1 (family caregivers) or 2 (clinicians) subsequent rounds to develop a prioritized list.
Results
A diverse international expert panel consisting of 49 clinicians and 12 family caregivers provided 601 responses. Responses were distilled into 26 clinical topics comprising 126 related questions. The top clinical topics prioritized for research were irritability and pain, child mental health, disorders of tone, polypharmacy, sleep, aspiration, behavior, dysautonomia, and feeding intolerance. The clinician expert panel also prioritized 10 specific research questions.
Interpretation
Study findings support a research agenda for children with neurological impairment and medical complexity focused on addressing clinical questions, prioritized by an international group of clinicians and caregivers.
Short abstract
This original article is commented by Becker‐Barroso on page 145 of this issue.
This article's abstract has been translated into Spanish and Portuguese.
Follow the links from the abstract to view the translations.
Resumen
Objetivo
Identificar las áreas de investigación clínica prioritarias relacionadas con niños con enfermedades neurológicas. deterioro y complejidad médica entre médicos y cuidadores.
Método
Se completó un estudio Delphi modificado de tres etapas que utiliza encuestas en línea guiado por un comité directivo. En la ronda 1, los médicos y los cuidadores familiares sugirieron temas clínicos y preguntas relacionadas que requieren investigación para apoyar a este subgrupo de niños. Después del refinamiento de las sugerencias del comité directivo, los participantes contribuyeron a 1 (cuidadores familiares) o 2 (médicos) rondas posteriores para desarrollar una lista de prioridades
Resultados
Un panel de expertos internacionales diverso que consta de 49 médicos y 12 cuidadores familiares proporcionó 601 respuestas. Las respuestas se desglosaron en 26 temas clínicos que comprenden 126 pregunta relacionadas. Los principales temas clínicos priorizados para la investigación fueron irritabilidad y dolor, salud mental infantil, trastornos del tono, polifarmacia, sueño, aspiración, conducta, disautonomía e intolerancia alimentaria. El panel de expertos clínicos también dio prioridad a 10 preguntas de investigación específicas.
Interpretación
Los hallazgos del estudio apoyan una agenda de investigación para niños con enfermedades neurológicas, discapacidad y complejidad médica centrada en abordar cuestiones clínicas, priorizadas por un grupo internacional de médicos y cuidadores.
Abstract
OBJETIVO
Identificar as áreas de pesquisa clínica de maior prioridade relacionadas a crianças com comprometimento neurológico e complexidade médica entre clínicos e cuidadores.
MÉTODO
Um estudo Delphi modificado em três estágios usando pesquisas online e guiado por uma comissão foi concluída. Na rodada 1, clínicos e cuidadores familiares sugeriram tópicos clínicos e questões relacionadas que requerem pesquisa para apoiar este subgrupo de crianças. Após o refinamento das sugestões do comitê gestor, os participantes contribuíram com 1 (cuidadores familiares) ou 2 (clínicos) rodadas subsequentes para desenvolver uma lista de prioridades.
RESULTADOS
Um painel internacional diversificado de especialistas composto por 49 clínicos e 12 cuidadores familiares forneceu 601 respostas. As respostas foram distribuídas em 26 tópicos clínicos, incluindo 126 perguntas relacionadas. Os principais tópicos clínicos priorizados para pesquisa foram irritabilidade e dor, saúde mental infantil, distúrbios do tônus, polifarmácia, sono, aspiração, comportamento, disautonomia e intolerância alimentar. O painel de especialistas clínicos também priorizou 10 questões de pesquisa específicas.
INTERPRETATION
Os resultados do estudo apoiam uma agenda de pesquisa para crianças com deficiência neurológica e complexidade médica com foco no tratamento de questões clínicas, priorizadas por um grupo internacional de médicos e cuidadores.
Abbreviation
- CMC
Children with medical complexity
What this paper adds.
Prioritized research areas highlighted neuropsychiatric and feeding topics in children with neurological impairment and medical complexity.
The clinician expert panel prioritized 10 specific research questions.
Children with neurological impairment, defined by functional and/or intellectual impairment that results from neurological disease, 1 , 2 are an important subgroup of children with medical complexity (CMC). CMC have substantial family‐identified service needs, chronic conditions, functional limitations, and high healthcare use. 3 Children with neurological impairment account for about 28% of all CMC. 4 The clinical care required by children with neurological impairment and medical complexity is intensive, 5 requiring multiple providers in numerous locations over time and frequently relying on technological assistance for activities of daily living. 6 Multisystem involvement and multiple comorbidities from a characteristic pattern of co‐occurring conditions are common, requiring an increased complexity of care. 7 , 8 , 9 , 10 , 11
As high users of healthcare resources, CMC, including those with neurological impairments, have garnered growing interest from child health researchers, healthcare providers, and policymakers. 5 , 12 Although their absolute numbers are small (<1% of all children), the impact of CMC is substantial, accounting for a quarter of inpatient bed‐days 13 and a third of overall pediatric healthcare spending. 4 Much of the focus to date has been on care coordination and service delivery. 14 Some CMC have well‐defined evidence influencing care paths, including those with advanced cystic fibrosis lung disease 15 and congenital heart disease, for example, children with single‐ventricle physiology. 16
Unfortunately, less attention has been given to establishing the evidence base to guide clinical care practice for children with neurological impairment and medical complexity. 14 , 17 Evidence for diagnosing or treating common clinical scenarios for children with neurological impairment and medical complexity often relies on extrapolation from studies conducted on otherwise typically developing children. For example, while pneumonia is a frequent indication for hospitalization for children with neurological impairment and medical complexity, 17 clinical guidelines frequently exclude children with an underlying pathology 18 due to a lack of research in this area. Exclusion of children with neurological impairment and medical complexity from guidelines and clinical pathways creates knowledge gaps that limit evidence‐based clinical practice. Furthering clinical research focused on children with neurological impairment and medical complexity supports improvements in their care and outcomes.
The consensus of clinicians and patients/caregivers is an increasingly important element of the research agenda setting 19 and can produce more relevant agendas while simultaneously reducing research waste. 20 , 21 We aimed to develop a list of the top priorities for clinical research, clinical topics, and specific research questions in the care of children with neurological impairment and medical complexity, reflecting the prioritization of an international expert panel consisting of both clinicians and family caregivers.
METHOD
We conducted a modified prioritization study, which included three Internet‐based surveys, conducted between 18th November 2019 and 28th June 2020. Previous literature supports the notion that three survey rounds are sufficient to achieve consensus 22 and these have been used in previous research priority studies. 23 , 24 Institutional review board approval was obtained from the Hospital for Sick Children, Toronto, Canada (research ethics board no. 1000063902).
Establishment of the steering committee
A steering committee consisting of the study authors was created, reflecting clinician‐researchers actively providing care to children with neurological impairment and medical complexity; the steering committee included clinician‐researchers from Ireland (n=1), Canada (n=4), and the USA (n=4), with a median of 10 years in practice (range 5–19y). A parent of a child with neurological impairment and medical complexity who received dedicated training to support their participation was also a steering committee member. Training focused on the basics of the research process, the role of patient advisors, and the support available to facilitate meaningful engagement. Ongoing support to the family representative was provided through the Centre for Innovation & Excellence in Child and Family‐Centered Care. Further family caregiver input was obtained from the Research Family Advisory and Complex Care Family Advisory committees at the primary academic center (n=14 members). These advisors provided feedback relating to family caregiver involvement, which was incorporated into the study design.
Recruitment of the clinician expert panel
The steering committee nominated a range of international clinical experts who provide clinical care to children with neurological impairment and medical complexity. A broad range of specialists (country, setting of practice [e.g. community‐ and hospital‐based], and subspecialty) were nominated to ensure diversity and international representation and are described in the ‘Results’. Recruitment was limited to physicians and nurse practitioners since the study’s focus was to prioritize clinical research questions encountered in their clinical practice. To build on previous work, an invitation was extended to the principal investigator of a research prioritization study from the UK focused on the care of a broader group of children and young people with neurodisability. 25
The study team invited nominated experts to participate in the study via e‐mail, agreeing to a commitment including three rounds of surveys, each taking approximately 30 minutes to complete. Individuals consenting to participate were subsequently considered members of the clinician expert panel.
Recruitment of the family caregiver expert panel
Family caregivers of children with neurological impairment and medical complexity were recruited using social media feeds. The primary institution’s official Twitter account highlighted the study and the personal Twitter accounts of the study investigators (CD, JO, and EC). A Facebook page organized by family caregivers located in Ontario, Canada, also shared information about the study. Caregivers who contacted the study team by e‐mail received details about the study outlining a commitment to two rounds of surveys, each taking approximately 20 minutes to complete. After completion of written informed consent, their eligibility for participation as family caregivers of children with neurological impairment and medical complexity was confirmed with details about their child’s diagnosis and technology use. Eligible caregivers were subsequently considered members of the family caregiver expert panel.
Prioritization methodology
Figure 1 outlines the three‐stage prioritization methodology using online surveys. 26 , 27 Before round 1, the steering committee defined the scope of the study. We excluded topics relating to health service design or delivery, health policy, and those limited to a specific underlying disease that can cause neurological impairment (e.g. trisomy 21). Topics generated by free response in round 1 that could not be developed into specific research questions by the steering committee were excluded from further rounds. On each survey round before distribution, all surveys were piloted with family caregivers (n=2) and clinicians (n=2) and refined based on feedback. 28
Figure 1.
Study rounds and results of the data collection and surveys. The steps required for the modified, three‐stage Delphi methodology using online surveys are shown. These led to the prioritization of clinical topics and research questions.
The elicitation round (first survey) included open‐ended elicitation questions asking for suggested priority research areas, clinical topics, and specific questions relating to the clinical care of children with neurological impairment and medical complexity. A similar survey with modified language was distributed to family caregivers. Both surveys are included as Appendices S1 and S2 (online supporting information).
The steering committee reviewed all suggestions and refined the list of clinical topics and research questions. Research questions were reframed in survey rounds 2 and 3 in the population, intervention, control, and outcome format whenever possible to ensure clarity and consistency in prioritization rounds. We also reviewed the UK prioritization results to ensure our clinical topic and research questions were complete. 25
The second round included a two‐part survey. Both family caregivers and clinical experts participated in round 2a, the prioritization of clinical topic areas from the perspective of future research using a 7‐point Likert scale (1=not important to 7=very important). Specific research questions falling within each content area were listed to provide context and trigger additional suggestions from participants, who could provide feedback and identify missing clinical topics. The survey questions and instructions are summarized in Appendices S3 and S4 (online supporting information).
Round 2b asked clinical experts to select up to seven ‘most important’ clinical topics. Experts were then asked to rank all specific research questions falling within their top seven content areas using a 7‐point Likert scale (Appendix S5, online supporting information). The third survey round asked clinical experts to rate the importance of research questions relating to the top clinical topics identified in round 2. Rounds 2b and 3 asked respondents to rank research questions based on their importance to clinical care and the current state of available evidence. This step was considered outside the scope of family caregiver expertise, so rounds 2b and 3 included only the clinician expert panel.
All study data were collected and managed using Research Electronic Data Capture (REDCap). 29 , 30
Data analysis
In rounds 2 and 3, analysis of the responses involved (1) calculating a frequency score (frequency of inclusion in the top seven clinical topics) and (2) calculating the median and interquartile range (IQR) of the Likert scale for each clinical topic and research question to create a rank order. 28 For clinical topics, the steering committee reviewed the data from round 2 graphically to determine a natural cutoff of ranked clinical topics to develop a feasible list of questions for inclusion in round 3 prioritization. Any specific research question with a median of less than 3 was removed. Microsoft Excel (Microsoft Corporation, Redmond, WA, USA) was used throughout. In round 3, the total score was calculated based on the sum of Likert ratings provided by clinical experts for each clinical topic. Analysis also included calculation of the median and IQR for each clinical topic.
RESULTS
Participants
Clinicians
Of the 81 clinicians invited to participate in the study, 49 (60.5%) consented to participate. Figure S1 (online supporting information) shows a flow chart of the clinician expert panel participants. Clinicians were recruited from nine different countries: USA (n=28); Canada (n=9); Ireland (n=3); UK (n=3); Australia (n=2); Chile (n=1); the Netherlands (n=1); Hong Kong (n=1); and Spain (n=1). The most common clinical disciplinary background was medicine (86% of respondents), comprising 13 different specialties (adolescent medicine [n=1], developmental pediatrics [n=12], emergency medicine [n=2], gastroenterology [n=2], general pediatrics [n=16], neurology [n=1], neurodisability [n=8], neurosurgery [n=1], orthopedics [n=2], palliative care [n=7], primary care [n=1], rehabilitation [n=1], and respirology [n=1]). Thirty clinicians (61%) were female and the rest were male.
Thirty‐one clinicians worked in dedicated children’s hospitals, seven in community hospitals (not academic centers), three in non‐children’s hospitals (e.g. general academic centers), two in specialty hospitals (e.g. rehabilitation and long‐term acute care centers), one in a consultancy practice, and one in a respite facility. In these centers, clinicians provided a variety of services: a combination of inpatient (acute) and outpatient services (n=24); primary care outpatient (n=8); specialty outpatient (n=8); and inpatient (acute) only (n=3). One clinician worked in each of the following settings: inpatient (non‐acute); emergency department; consultancy practice; and home care. Most (76%) spent more than 25% of their working week caring for children with neurological impairments and medical complexity.
Family caregivers
Twelve interested family caregivers met the eligibility criteria and participated (all mothers), nine from Canada (seven from Ontario, two from Alberta) and three from Ireland. The children’s underlying diagnoses varied with six reporting primary neurological disorders (cerebral palsy [n=3], brain injury [n=1], brain tumor [n=1], Moebius syndrome [n=1]) and four reporting genetic disorders with neurological manifestations (trisomy 21 [n=2], Prader–Willi syndrome [n=1], non‐specified [n=1]). An additional respondent reported a primary mental health diagnosis (n=1). Technology requirements described included enteral feeding tubes (n=4) and respiratory technology (n=5).
Study rounds
Round 1
The flow chart in Figure 1 outlines the three study rounds and their output. In survey round 1, the elicitation survey led to 601 individual comments or questions. The raw suggestions spanned 73 clinical topic areas. The supplementary material contains the full list of clinical topics suggested by clinicians (Table S1, online supporting information) and caregivers (Table S2, online supporting information) and the frequency with which they were mentioned.
After round 1, the steering committee refined the research topics and questions and merged those that overlapped highly. For example, spasticity and dystonia were combined into one clinical topic (disorders of tone including contractures). The steering committee excluded 34 topics, including those related to a specific underlying disease, for example, hypoxic‐ischemic encephalopathy (n=12), health service delivery (n=6), no specific research question (n=6), and research design (n=1). Nine were acknowledged to be relevant to clinical practice but were excluded as being beyond the study scope (e.g. decision‐making capacity). A single clinical topic (behavior and emotional regulation) was recommended solely by the family caregiver expert panel. The steering committee added infection control as a topic. A review of the UK prioritization study identified one additional unique question related to the use of Lycra, Kinesio Taping, or plastic among children with neurological impairment at risk for deformity secondary to spasticity. 25 Round 1 ended with 26 clinical topic areas and 126 related questions (Appendix S7, online supporting information).
Round 2
Forty‐three clinicians (88% retention from round 1) and six family caregivers (50% retention from round 1) participated in round 2. To amplify caregiver input, separate rank lists were created because of the difference in panel size. We ranked topics by median Likert scores with IQRs used to differentiate between ties. Since family caregivers were separately asked to identify their ‘top seven’ topic areas, we created a third rank list based on the percentage of individuals choosing a given topic as in their top seven.
In the family caregiver expert panel, there were some differences when compared with the clinician expert panel. Six clinical topics were common to both panels (behavior, sleep, aspiration, irritability and pain, feeding tolerance, and child mental health); family caregivers also prioritized acute respiratory infections, enteral feeding tubes, infection control, and nutrition and growth. Clinicians’ prioritization included tone, polypharmacy, dysautonomia, and chronic lung disease in their top 10 clinical topics.
Given the steering committee’s concern for respondent burden in ranking the full 126 research questions proposed, the members of the steering committee considered the agreement across analyses (Table 1) and incorporated the sharp inflection point in priority scoring between the top nine clinical topics and the rest (Fig. 2) to arrive at a list for consideration for round 3. The clinician expert panel suggested an additional two questions (Appendix S8, online supporting information). A question exploring the role of turmeric in abdominal distension was excluded (median <3).
Table 1.
Round 2 prioritization of clinical topics (clinical experts [n=49] and family caregivers [n=12])
Clinician prioritization | Caregiver prioritization | ||||||
---|---|---|---|---|---|---|---|
Rank | Clinical topic | Frequencya | Median (IQR) | Rank | Clinical topic | Frequency score | Median (IQR) |
1 | Irritability and pain | 28 | 6 (6–6.5) | 1 | Behavior | 40 | 7 (7–7) |
2 | Child mental health | 20 | 6 (4–6) | 2 | Acute LRTI | 37 | 6.5 (6–7) |
2 | Disorders of tone | 20 | 6 (5–7) | 3 | Enteral feeding tubes | 36 | 6 (5.25–6.75) |
2 | Polypharmacy | 20 | 5 (5–6) | 4 | Sleep | 35 | 5.5 (5–6.75) |
2 | Sleep | 20 | 5 (5–6) | 5 | Aspiration | 34 | 6 (6–6) |
3 | Aspiration | 19 | 6 (5–6.5) | 5 | Infection control | 34 | 6.5 (5.25–7) |
4 | Behavior | 18 | 5 (4–6.5) | 5 | Irritability and pain | 34 | 6.5 (5.25–7) |
4 | Dysautonomia | 18 | 5 (4–6) | 6 | Nutrition and growth | 33 | 5 (5–6.5) |
4 | Feeding tolerance | 18 | 5 (4–6.5) | 6 | Feeding tolerance | 33 | 6 (5.35–6) |
5 | Chronic lung disease | 13 | 5 (4–6) | 6 | Child mental health | 33 | 5.5 (5–6.75) |
6 | Nutrition and growth | 12 | 5 (3–6) | 7 | Chronic lung disease | 32 | 5.5 (4.25–6.75) |
7 | Acute LRTI | 11 | 5 (3–6) | 8 | Dysautonomia | 31 | 5.5 (4.25–6.75) |
8 | Enteral feeding tubes | 10 | 4 (3–5) | 9 | Constipation | 29 | 4 (3.5–6) |
8 | Sialorrhea | 10 | 5 (3.5–6) | 9 | GERD | 29 | 5 (3.25–6.75) |
8 | Scoliosis | 10 | 4 (3–5.5) | 9 | Polypharmacy | 29 | 5 (3.25–6) |
9 | Osteoporosis and osteopenia | 9 | 4 (4–6) | 10 | Sialorrhea | 28 | 5.5 (5.25–6) |
10 | Constipation | 8 | 4 (3–5) | 10 | Venous access | 28 | 4.5 (4–5) |
10 | Neurogenic bladder | 8 | 4 (3–5) | 11 | Disorders of tone | 27 | 4.5 (2.5–6.5) |
11 | GERD | 7 | 4 (4–6) | 11 | Postoperative complications | 27 | 4 (3.25–6.25) |
12 | Postoperative complications | 5 | 4 (3–5) | 11 | Peripubertal issues | 27 | 4.5 (2.5–6.5) |
12 | Infection control | 5 | 4 (3–5) | 12 | Neurogenic bladder | 26 | 4.5 (3.25–5) |
13 | Venous access | 4 | 3 (2–4) | 12 | Scoliosis | 26 | 4.5 (2.5–5.75) |
13 | Hip displacement | 4 | 4 (3–5) | 13 | Dental caries | 25 | 5.5 (2.25–5.75) |
14 | Hydrocephalus | 3 | 4 (2–5) | 14 | Hip displacement | 24 | 3.5 (2.25–3.25) |
14 | Peripubertal issues | 3 | 4 (2.5–5) | 14 | Hydrocephalus | 24 | 3.5 (2–5.75) |
15 | Dental caries | 2 | 4 (2.5–4.5) | 15 | Osteoporosis and osteopenia | 23 | 3.5 (2.25–4.75) |
The top clinical topics are shaded. aThe frequency score reflects the number of clinical experts who provided the top ranking for each clinical topic. IQR, interquartile range; LRTI, lower respiratory tract infection; GERD, gastroesophageal reflux disease.
Figure 2.
Frequency score of clinical topics by clinical experts. The frequency score calculated by the frequency of inclusion among the top seven of 26 clinical topics developed after round 1 is shown. LRTI, lower respiratory tract infection; GERD, gastroesophageal reflux disease.
Round 3
Forty‐one clinicians responded to round 3 (84% retention from round 1) and prioritized the research questions related to the clinical topics in round 2. Table 2 contains the prioritized top 10 research questions. The top 10 research questions involved seven of the nine clinical topic areas, except for behavior and polypharmacy.
Table 2.
Top 10 ranked research questions with related clinical topics
Overall rank | Clinical topic | Research question | Total score | Median (IQR) |
---|---|---|---|---|
1 | Feeding tolerance | In children with neurological impairment and medical complexity with feeding intolerance, do blenderized formulas (e.g. home or commercially) versus other formula (polymeric or hydrolyzed) improve outcomes (e.g. nutritional health, feeding tolerance, quality of life)? | 229 | 6 (5–7) |
2 | Disorders of tone | In children with neurological impairment and medical complexity with dystonia, does baclofen versus baclofen plus gabapentin improve outcomes (e.g. pain, function)? | 228 | 6 (5–6) |
3 | Dysautonomia | In children with neurological impairment and medical complexity with autonomic dysfunction, does propranolol versus gabapentin versus clonidine decrease symptoms of autonomic dysfunction (e.g. sweating, temperature dysregulation, blood pressure lability)? | 228 | 5 (5–7) |
4 | Irritability and pain | In children with neurological impairment and medical complexity with irritability, does gabapentin versus clonidine improve outcomes (e.g. duration of crying, discomfort)? | 227 | 6 (5–7) |
5 | Irritability and pain | In children with neurological impairment and medical complexity with irritability, does cannabidiol and/or tetrahydrocannabinol versus standard therapy (e.g. gabapentin) improve outcomes, for example, duration of crying, discomfort? | 226 | 6 (5–7) |
6 | Sleep | In children with neurological impairment and medical complexity with disrupted sleep, does melatonin versus hydroxyzine versus trazodone versus clonidine improve outcomes (e.g. sleep quality, sleep duration, daytime function)? | 225 | 6 (5–6) |
7 | Aspiration | In children with neurological impairment and medical complexity, does exclusive enteral (tube) feeding (without oral intake) versus a feeding plan, which includes oral intake, reduce aspiration risk? | 218 | 6 (4–7) |
8 | Feeding tolerance | In children with neurological impairment and medical complexity with feeding intolerance, does polymeric formula versus hydrolyzed formula improve outcomes (e.g. nutritional health, feeding tolerance, quality of life)? | 218 | 5 (4–7) |
9 | Child mental health | In children with neurological impairment and medical complexity, does screening for mental health issues versus standard (no screening) improve outcomes (e.g. child mental health)? | 217 | 5 (4–6) |
10 | Disorders of tone | In children with neurological impairment and medical complexity with dystonia not responsive to medication, does deep brain stimulation versus intrathecal baclofen improve outcomes (e.g. function)? | 216 | 5 (4–6) |
Two prioritized clinical topics did not have a research question ranked in the top 10 (polypharmacy and behavior). The top ranked question for the clinical topic of polypharmacy was ‘In CMC and neurological impairment, what are the demographics and clinical predictors of a medication error?’ (total score=185; median [IQR]=4 [3–6]). The top ranked question in the clinical topic of behavior was ‘In CMC and neurological impairment, what are the demographic and clinical predictors of challenging behavior (e.g. aggression) and emotional dysregulation?’ (total score=174; median [IQR]=4 [3–5]). IQR, interquartile range; CMC, children with medical complexity.
DISCUSSION
This study encompassed clinicians’ and family caregivers’ priorities to develop a prioritization‐based research agenda focused on children with neurological impairment and medical complexity. Participants were engaged throughout the prioritization process, proposing 26 clinical topics and 126 research questions that were distilled down to a prioritized list where neuropsychiatric topics (e.g. irritability and pain, sleep, child mental health) dominated, comprising 6 of 10 clinical topics. The generation of clinical topics and research questions benefited from family caregiver input. While there was relatively good concordance in clinical topics between family caregivers and clinicians, only family caregivers suggested behavior in round 1, which was subsequently prioritized by both clinicians and family caregivers. Although the study’s main aim was to develop a prioritized list of topics and questions to create a research agenda, the long list of potential research questions suggests substantial equipoise in many aspects of care of children with neurological impairment and medical complexity.
Some prioritized areas overlapped due to definitional vagaries, such as irritability and pain and dysautonomia. Other overlapping areas reflect the challenge of differentiation in clinical practice, for example, aspiration and acute lower respiratory tract infections. Some topic areas were prioritized but were challenging to frame as research questions. For instance, while in round 1, 17 clinicians highlighted irritability and pain as a clinical topic, which they frequently encounter in their practice and cannot access adequate evidence to guide management, only three questions with vaguely specified interventions and outcome metrics were developed for ratings in subsequent rounds. This observation likely reflects that irritability and pain, although undefined, has high prevalence 31 and highlights the challenges and complexity in diagnosing and treating pain in this population. The lack of understanding of the pathophysiology, 32 , 33 including the contribution of multiple organ systems, for example, the gut, 34 and limited treatment options, 31 translated into a lack of specific population, intervention, control, and outcome research questions. The vagueness of suggested research questions suggests that an impactful research agenda for children with neurological impairment and medical complexity requires greater clarity and uniformity of definitions.
The development of meaningful research, including outcome measures, will involve understanding and including those relevant and meaningful to the child and family experience. Caregiver involvement in research, including in this study, supports a more inclusive, improved research agenda. 35 In this study, the inclusion of behavior and emotional regulation is a result of family caregiver inclusion. Similar studies, including those that adhere to the James Lind Alliance framework, 25 highlight a known phenomenon: families prioritize psychosocial needs more than medical clinicians. 36 Professionals often prioritize basic science while caregivers will emphasize aspects of psychosocial health. 21 , 37 Despite an increased prevalence of psychiatric diagnoses among children with intellectual disabilities, 38 the clinician expert panel infrequently proposed related clinical topics in the elicitation phase with few research questions suggested. However, both clinicians and family caregivers subsequently prioritized both topics as research areas. This observation suggests that clinicians and researchers initially overlooked these clinical topics and yet recognize their inherent importance, presumably because of the impact on the family and child.
Clinicians and caregivers were asked to focus on clinical questions and not the entire healthcare experience of children with neurological impairment and medical complexity and their families. Despite this instruction, both groups frequently enumerated such topics (e.g. transition to adult care), reflecting the substantial impact that caring for CMC can have on families and the healthcare system. 39 , 40
This international prioritization study incorporated the UK‐based James Lind Alliance study including (1) inviting a lead researcher to participate in the expert panel and (2) incorporating some of the suggested research topics identified in that study as research questions in this study. The scope of this study differs from previously conducted studies by focusing on a subgroup of children with neurological impairment, those with medical complexity. Previous studies included all children with neurodisability or neurodevelopmental disorders or individuals of all ages with cerebral palsy.
Refinement of the various clinical topics could be the next step for clinical research in this population of children. For example, irritability is an undefined neologism. A better understanding of this clinical phenotype, including its impact on children and their families would be a foundational step for future research. We are partnering with Family Voices, a family‐led organization focused on the experience of children and young people with special healthcare needs and the Lucile Packard Foundation for Children’s Health to deliver a seminar series focusing on the clinical topics prioritized in this study starting in September 2021. This seminar series will bring clinicians, researchers, and families together to facilitate partnerships to design research studies related to the clinical topics addressed in this prioritization study.
Limitations
This study has several limitations. First, family caregiver involvement was valuable but limited in the number of participants with a high dropout rate between the first and second round (50%), and their relative homogenous demographic characteristics (all were mothers from Canada or Ireland), reflecting the investigators’ social media following. Second, the depth of family caregiver involvement was limited. There was only one family caregiver on the steering committee, caregivers were excluded from rounds 2b and 3, incomplete caregiver responses were recorded in round 2, and there was no youth voice in the process. Recruitment of a more diverse and larger group of caregivers and young people with neurological impairment and medical complexity may have led to a more representative group of clinical topics for prioritization.
Third, some clinical topics may not be indistinguishable (e.g. lower respiratory tract infection and aspiration) and some clinical questions overlapped. There was agreement within the steering committee that distinct clinical topics and related questions may not be mutually exclusive. For example, in clinical practice, a child with neurological impairment and medical complexity can present with respiratory illness and clinically differentiating aspiration from infection can be difficult. Fourth, non‐medical health professionals who provide care for children with neurological impairment and medical complexity were excluded, for example, therapists, social workers, and nurses who are not nurse practitioners. The involvement of these professionals would likely have led to an even larger group of potential questions and may have made arriving at a prioritized list more difficult. Fifth, all family caregivers and all but one of the clinical experts were from high‐income countries; therefore, they may not reflect the experience of families and clinicians in low‐ and middle‐income countries. Sixth, the members of the steering committee were at different career stages and the decision‐making process may have introduced known and unknown power differentials and biases. Lastly, while a broad group of clinicians from diverse geography, practice settings, and specialties were recruited, a different sampling of clinicians may have arrived at a slightly different prioritized list.
CONCLUSION
This study represents a prioritization process to develop a research agenda about children with neurological impairment and medical complexity focused on addressing everyday clinical questions, reflecting clinicians’ and caregivers’ international prioritization. This research agenda may be informative for funders, clinicians, and others to develop and conduct research projects to improve outcomes in children with neurological impairment and medical complexity.
CONFLICTS OF INTERESTS
The authors have no conflicts of interests to declare.
Supporting information
Figure S1: Flow chart of the study participants (clinician expert panel).
Table S1: Clinical topics as suggested by the clinician expert panel
Table S2: Clinical topics as suggested by the family caregiver expert panel
Appendix S1: Round 1 survey (clinician expert panel).
Appendix S2: Round 1 survey (family caregiver panel).
Appendix S3: Round 2a survey (clinician expert panel).
Appendix S4: Round 2a survey (family caregiver panel).
Appendix S5: Round 2b survey (clinician expert panel).
Appendix S6: Round 3 survey (clinician expert panel).
Appendix S7: Clinical topics and related research questions included in round 2.
Appendix S8: Additional questions included in round 3.
ACKNOWLEDGEMENTS
The study team acknowledges the time and contribution of the expert clinicians and family caregivers who participated in the study. Ms Francine Buchanan, Research Patient & Family Engagement Coordinator at the Hospital for Sick Children, supported the study team’s effort with the family caregiver involvement. This project was supported by the Canadian Institutes of Health Research (no. FDN‐143315). Dr Thomson was supported by the Agency for Healthcare Research and Quality under award no. K08HS025138.
DATA AVAILABILITY STATEMENT
The data that supports the findings of this study are available in the supplementary material of this article.
REFERENCES
- 1. Berry JG, Poduri A, Bonkowsky JL, Zhou J, Graham DA, Welch C, et al. Trends in resource utilization by children with neurological impairment in the United States inpatient health care system: a repeat cross‐sectional study. PLoS Med 2012; 9: e1001158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Thomson J, Hall M, Ambroggio L, Stone B, Srivastava R, Shah SS, Berry JG. Aspiration and non‐aspiration pneumonia in hospitalized children with neurologic impairment. Pediatrics 2016; 137: e20151612. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Cohen E, Kuo DZ, Agrawal R, Berry JG, Bhagat SKM, Simon TD, Srivastava R. Children with medical complexity: an emerging population for clinical and research initiatives. Pediatrics 2011; 127: 529–38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Cohen E, Berry JG, Camacho X, Anderson G, Wodchis W, Guttmann A. Patterns and costs of health care use of children with medical complexity. Pediatrics 2012; 130: e1463–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Cohen E, Berry JG, Sanders L, Schor EL, Wise PH. Status complexicus? The emergence of pediatric complex care. Pediatrics 2018; 141(Suppl. 3): S202–11. [DOI] [PubMed] [Google Scholar]
- 6. Orkin J, Chan CY, Fayed N, Lin JL, Major N, Lim A, et al. Complex care for kids Ontario: protocol for a mixed‐methods randomised controlled trial of a population‐level care coordination initiative for children with medical complexity. BMJ Open 2019; 9: e028121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Thomson JE, Feinstein JA, Hall M, Gay JC, Butts B, Berry JG. Identification of children with high‐intensity neurological impairment. JAMA Pediatr 2019; 173: 989–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Berry JG, Hall M, Hall DE, Kuo DZ, Cohen E, Agrawal R, et al. Inpatient growth and resource use in 28 children’s hospitals: a longitudinal, multi‐institutional study. JAMA Pediatr 2013; 167: 170–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Thomson J, Hall M, Nelson K, Flores JC, Garrity B, DeCourcey DD, et al. Prevalence and timing of co‐occurring chronic conditions in children with neurologic impairment. Pediatrics 2021; 147: e2020009217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Berry JG, Difazio RL, Melvin P, Glader L, Casto E, Shore BJ. Hospital resource use after hip reconstruction surgery in children with neurological complex chronic conditions. Dev Med Child Neurol 2021; 63: 204–10. [DOI] [PubMed] [Google Scholar]
- 11. Berry JG, Glader L, Stevenson RD, Hasan F, Crofton C, Hussain K, Hall M. Associations of coexisting conditions with healthcare spending for children with cerebral palsy. J Pediatr 2018; 200: 111–17.e1. [DOI] [PubMed] [Google Scholar]
- 12. Kuo DZ, Houtrow AJ, Council on Children with Disabilities . Recognition and management of medical complexity. Pediatrics 2016; 138: e20163021. [DOI] [PubMed] [Google Scholar]
- 13. Simon TD, Berry J, Feudtner C, Stone BL, Sheng X, Bratton SL, et al. Children with complex chronic conditions in inpatient hospital settings in the United States. Pediatrics 2010; 126: 647–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Agrawal R. Complex care in pediatrics: great progress, greater challenges. J Pediatr Rehabil Med 2015; 8: 71–4. [DOI] [PubMed] [Google Scholar]
- 15. Kapnadak SG, Dimango E, Hadjiliadis D, Hempstead SE, Tallarico E, Pilewski JM, et al. Cystic fibrosis foundation consensus guidelines for the care of individuals with advanced cystic fibrosis lung disease. J Cyst Fibros 2020; 19: 344–54. [DOI] [PubMed] [Google Scholar]
- 16. Newburger JW, Sleeper LA, Gaynor JW, Hollenbeck‐Pringle D, Frommelt PC, Li JS, et al. Transplant‐free survival and interventions at 6 years in the SVR trial. Circulation 2018; 137: 2246–53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Coller RJ, Berry JG, Kuo DZ, Kuhlthau K, Chung PJ, Perrin JM, et al. Health system research priorities for children and youth with special health care needs. Pediatrics 2020; 145: e20190673. [DOI] [PubMed] [Google Scholar]
- 18. Le Saux N, Robinson JLR. Uncomplicated pneumonia in healthy Canadian children and youth: practice points for management [Internet]. Ottawa, ON: Canadian Paediatric Society; 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Patient‐Centered Outcomes Research Institute . Workshop on methods for setting research priorities: executive summary [Internet]. Baltimore, MD: Patient‐Centered Outcomes Research Institute; 2012. [Google Scholar]
- 20. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Obstet Gynecol 2009; 114: 1341–5. [DOI] [PubMed] [Google Scholar]
- 21. Odgers HL, Tong A, Lopez‐Vargas P, Davidson A, Jaffe A, McKenzie A, et al. Research priority setting in childhood chronic disease: a systematic review. Arch Dis Child 2018; 103: 942–51. [DOI] [PubMed] [Google Scholar]
- 22. Hsu C‐C, Sandford BA. The Delphi technique: making sense of consensus. Pract Asessment Res Eval 2007; 12: 10.7275/pdz9-th90. [DOI] [Google Scholar]
- 23. Bialy L, Plint AC, Freedman SB, Johnson DW, Curran JA, Stang AS. Pediatric Emergency Research Canada (PERC): patient/family‐informed research priorities for pediatric emergency medicine. Acad Emerg Med 2018; 25: 1365–74. [DOI] [PubMed] [Google Scholar]
- 24. Hartshorn S, O’Sullivan R, Maconochie IK, Bevan C, Cleugh F, Lyttle MD. Establishing the research priorities of paediatric emergency medicine clinicians in the UK and Ireland. Emerg Med J 2015; 32: 864–8. [DOI] [PubMed] [Google Scholar]
- 25. Morris C, Simkiss D, Busk M, Morris M, Allard A, Denness J, et al. Setting research priorities to improve the health of children and young people with neurodisability: a British Academy of Childhood Disability‐James Lind Alliance research priority setting partnership. BMJ Open 2015; 5: e006233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Keeney S, Hasson F, McKenna H. e‐Delphi case study. In: Keeney S, Hasson F, McKenna H, editors. The Delphi technique in nursing and health research. Chichester: Wiley‐Blackwell; 2011. p. 142–50. [Google Scholar]
- 27. Bressan S, Titomanlio L, Gomez B, Mintegi S, Gervaix A, Parri N, et al. Research priorities for European paediatric emergency medicine. Arch Dis Child 2019; 104: 869–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Hoffman JM, Keeling NJ, Forrest CB, Tubbs‐Cooley HL, Moore E, Oehler E, et al. Priorities for pediatric patient safety research. Pediatrics 2019; 143: e20180496. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap): a metadata‐driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42: 377–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform 2019; 95: 103208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Hauer J, Houtrow AJ. Pain assessment and treatment in children with significant impairment of the central nervous system. Pediatrics 2017; 139: e20171002. [DOI] [PubMed] [Google Scholar]
- 32. Hauer JM. Pain in children with severe neurologic impairment: undoing assumptions. JAMA Pediatr 2018; 172: 899–900. [DOI] [PubMed] [Google Scholar]
- 33. Aleman B, Merker B. Consciousness without cortex: a hydranencephaly family survey. Acta Paediatr 2014; 103: 1057–65. [DOI] [PubMed] [Google Scholar]
- 34. Hauer J. Feeding intolerance in children with severe impairment of the central nervous system: strategies for treatment and prevention. Children 2017; 5: 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Canadian Institutes of Health Research . Strategy for patient‐oriented research [Internet]. Ottawa, ON: CIHR; 2014. [Google Scholar]
- 36. Lopez‐Vargas P, Tong A, Crowe S, Alexander SI, Caldwell PHY, Campbell DE, et al. Research priorities for childhood chronic conditions: a workshop report. Arch Dis Child 2019; 104: 237–45. [DOI] [PubMed] [Google Scholar]
- 37. Elwyn G, Crowe S, Fenton M, Firkins L, Versnel J, Walker S, et al. Identifying and prioritizing uncertainties: patient and clinician engagement in the identification of research questions. J Eval Clin Pract 2010; 16: 627–31. [DOI] [PubMed] [Google Scholar]
- 38. Rasmussen LA, Grégoire M‐C. Challenging neurological symptoms in paediatric palliative care: an approach to symptom evaluation and management in children with neurological impairment. Paediatr Child Health 2015; 20: 159–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Allshouse C, Comeau M, Rodgers R, Wells N. Families of children with medical complexity: a view from the front lines. Pediatrics 2018; 141: S195–201. [DOI] [PubMed] [Google Scholar]
- 40. Moyson T, Roeyers H. ‘The overall quality of my life as a sibling is all right, but of course, it could always be better’. Quality of life of siblings of children with intellectual disability: the siblings’ perspectives. J Intellect Disabil Res 2012; 56: 87–101. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Figure S1: Flow chart of the study participants (clinician expert panel).
Table S1: Clinical topics as suggested by the clinician expert panel
Table S2: Clinical topics as suggested by the family caregiver expert panel
Appendix S1: Round 1 survey (clinician expert panel).
Appendix S2: Round 1 survey (family caregiver panel).
Appendix S3: Round 2a survey (clinician expert panel).
Appendix S4: Round 2a survey (family caregiver panel).
Appendix S5: Round 2b survey (clinician expert panel).
Appendix S6: Round 3 survey (clinician expert panel).
Appendix S7: Clinical topics and related research questions included in round 2.
Appendix S8: Additional questions included in round 3.
Data Availability Statement
The data that supports the findings of this study are available in the supplementary material of this article.