Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jan 5.
Published in final edited form as: Curr Probl Pediatr Adolesc Health Care. 2022 Jan 5;51(12):101126. doi: 10.1016/j.cppeds.2021.101126

Intervention Research to Improve Care and Outcomes for Children with Medical Complexity and their Families

James A Feinstein 1,2,*, Jay G Berry 3, Chris Feudtner 4
PMCID: PMC8825706  NIHMSID: NIHMS1763925  PMID: 34996708

Abstract

Healthcare and outcomes for children with medical complexity (CMC) and their families can be improved by conducting well-conceived, designed, implemented, and analyzed research studies of clinical interventions. This article presents a framework for how to approach the study of clinical interventions for CMC, including 7 key questions and example answers to each: (1) What intervention questions should be our focus? (2) What barriers to intervention research exist? (3) How do we design and optimize interventions? (4) How do we characterize and select patients to enroll? (5) How can we enhance data collection and integration? (6) How can we improve enrollment and participation? And (7) which intervention experimental designs should we choose? By exploring each of these key aspects of intervention-based research, we hope to expand thinking about and spark ideas for specific research projects focused on clinical interventions for CMC.

INTRODUCTION

We believe that the healthcare and outcomes for children with medical complexity (CMC) and their families can be improved by conducting well-conceived, designed, implemented, and analyzed research studies of clinical interventions.

We are certainly not alone in our belief, although our emphasis on interventions may not yet be commonly held. PubMed currently lists more than 2,000 studies for “children with medical complexity.” These mostly epidemiological, health services, and qualitative studies have commonly focused on the identification and characterization of children with CMC, analyses of their patterns of healthcare utilization including their frequent hospitalizations, studies of associated costs/charges of care, and initial evaluations of complex care programs and care coordination strategies.18 This significant body of research has illuminated the myriad challenges and opportunities for advancing the care of CMC. But far less often have studies rigorously evaluated clinical interventions and program models using experimental study designs.

We encourage the field of complex care to mindfully shift focus to the study of clinical interventions. While all forms of research questions and modes of study are valuable (and we have and will continue to engage in them), our field unquestioningly needs more rigorous intervention studies. In what follows, we pose 7 questions and offer our current best answers to each:

  1. What intervention questions should be our focus?

  2. What barriers to intervention research exist?

  3. How do we design and optimize interventions?

  4. How do we characterize and select patients to enroll?

  5. How can we enhance data collection and integration?

  6. How can we improve enrollment and participation?

  7. Which intervention experimental designs should we choose?

WHAT INTERVENTION QUESTIONS SHOULD BE OUR FOCUS?

The most impactful research questions to answer are not prescribed by others, no matter how well informed, but instead discovered or derived by inquisitive individuals and teams. Certainly, stakeholder-driven prioritization of research topics regarding CMC have their place, including social determinants of health (SDH), caregiving, clinical-model refinement, value, and youth-to-adult transitions, care coordination activities, and health and symptom management10. We encourage the diversity of ideas and questions, and also the fusion of creative insight and rigorous thought needed to transform these topics into answerable research questions.

What we offer, then, is a general framework of research questions (Table 1) meant to expand our thinking and spark ideas for specific research projects. Foundational questions clarify the problem that the intervention is intended to address and inform the intervention design. Intervention design questions seek to improve the intervention’s efficacy. Intervention effectiveness questions address whether the intervention works and to what degree. Value questions evaluate the costs involved and merge that information into the evaluation. Implementation questions probe how to enact the intervention in the real world for best and lasting benefit. Under these broad headings are more specific questions. To illustrate how these can be used, we have presented several specific examples regarding understudied therapies and interventions (Table 2).

Table 1.

Framework of intervention research domains and general clinical questions.

Clinical Question
Formative Research on the Intervention
Why does [health problem] occur in CMC?
What is the pathogenesis of [health problem]?
What is the prevalence of [health problem]?
What are the risk factors for [health problem]?
How does the severity of [health problem] change over time?
Design of the Intervention
What can be done to prevent/mitigate [health problem]?
What is the best user-centered design for [intervention] to address [problem]?
How patient/family centered is [intervention]?
How feasible is [intervention]?
Clinical Effectiveness of the Intervention
How clinically effective is [intervention] for [problem]?
How much does [intervention] improve health / functioning / quality of life?
How well does [intervention] prevent [disease/outcome]?
Is [intervention A] more clinically effective than [intervention B]?
How safe, equitable, and timely is [intervention]?
Value of the Intervention
How cost effective is [intervention]?
Is [intervention A] more cost effective than [intervention B]?
Implementation, Scale, and Spread of the Intervention
What are the barriers and facilitators of implementing [intervention]?
How much variation in [intervention] exists in clinical practice?
What’s the best way to implement [intervention]?
What’s the best way to decide whether to use/undergo [intervention]?
What’s the best way to sustain use of [intervention]?
What’s the best way to pay for [intervention]?
What policies best enable use of [intervention]?

Table 2.

Examples of study designs and data elements well-suited to answer selected research questions.

Example Research Questions Example Interventions Patient-Centered Outcomes Types of Data Required Possible Study Designs
Is trazodone an effective medication for sleep problems in children with NI? Trazodone therapy
  • Sleep quality

  • Participation in school/therapies

  • Caregiver mental health

  • Patient/parent-reported outcomes

  • Caregiver data

  • Pharmacy data

Randomized-controlled trial, either placebo controlled or with active control (melatonin)
How do we best prepare children with medical complexity for major, high-risk surgeries? Are their post-operative outcomes better if we prepare them before surgery? Pre-surgical optimization of nutrition, respiratory condition, and pain management
  • Length of stay

  • ICU utilization

  • Adequate pain control

  • Return to baseline health and functioning

  • Improvement of symptoms

  • Return to school/outpatient therapies

  • Administrative/billing

  • Patient/parent-reported outcomes

  • Clinical and lab data

Randomized-controlled trial, cluster randomized at hospital level
Does access to family navigator services to address needs related to social determinants of health improve health outcomes? Routine provision of family navigation services within complex care programs
  • Connected to services

  • Caregiver mental health

  • Fewer emergency visits and hospitalizations

  • Administrative/billing

  • Patient/parent-reported outcomes

  • Caregiver data

Stepped-wedge cluster-randomized trial
Are bisphosphonates effective for treating osteopenia in children with severe NI? Bisphosphonate therapy
  • Improvement in bone mineral density

  • Reduction in fractures

  • Administrative/billing

  • Clinical and lab data

  • Pharmacy data

Comparison of pre-intervention and post-intervention measurements for the intervention group to an untreated control group
Would a seizure action plan that goes beyond just giving rectal diazepam make a difference in epilepsy hospitalizations? Statewide implementation of a stepwise seizure action plan
  • Reduction in epilepsy-related emergency visits and hospitalizations

  • Administrative/billing

  • Pharmacy data

Interrupted time series analysis

WHAT BARRIERS TO INTERVENTION RESEARCH EXIST?

Conducting experiments to study specific interventions can be difficult. Significant barriers have impeded intervention-based research in CMC, like those experienced in the field of rare disease research.11 Several are worth mentioning. First, there is a tendency to implement and evaluate broad clinical interventions delivered to a heterogenous patient population (e.g., exposure of a CMC to an outpatient complex care clinical program)—even when the care provided lacks specificity and a variety of outcomes are measured—because the clinical need is high. Second, the heterogeneity of the underlying chronic conditions can present difficulties in the identification and recruitment of appropriate study populations. Third, existing data sources (e.g., administrative claims data) containing the necessary analytic variables (for example, clinical data, patient-reported outcomes, etc.) may not be readily available or easily linked. Fourth, a great deal of focus has been placed on hospital-based care; much less attention has been devoted to outpatient, school, and homecare settings, where many CMC spend the bulk of their time. Creative solutions are needed to overcome each of these barriers, and below we will consider different ways that researchers may address these obstacles.

HOW DO WE DESIGN AND OPTIMIZE INTERVENTIONS?

Before designing an experiment, thorough characterization of the intervention is essential. Conceptually, an intervention must move the lever on some target that is a key driver of the main outcome of interest for (ideally) all applicable CMC. Proper targeting of the intervention is important both in intervention design and then in the study, which should only include patients who have the target. Consider a study that exposes all CMC to an intervention (e.g., case manager / care plan) that not all of them clearly need. Because the intervention wasn’t specifically targeted to a relevant group who might benefit from the intervention, a negative study occurs, for which the study team concludes that the intervention was not clinically effective. In contrast, had the intervention focused on a subset of CMC with the target, then the study would have been better calibrated to assess effectiveness.

Next, the components of an intervention must be specified, as well as the doses of each component. For simple interventions, such as a study of a medication to treat a symptom, describing the intervention is straightforward. However, at a clinical program or pathway level, the intervention might consist of a collection of activities to improve clinical outcomes and reduce acute healthcare utilization. For example, consider a clinical intervention for CMC undergoing spinal fusion for neuromuscular scoliosis consisting of a bundle of health services to optimize health before surgery to reduce post-operative morbidity and mortality (Table 2). These more complex multi-component interventions may have inconsistent or vague definitions and/or implementation protocols.12 Clarifying the components is particularly important for program-level interventions, so that feasibility, generalizability, and scalability of the intervention can be assessed for dissemination and implementation across different healthcare systems and settings.

Finally, research methodologists have argued that healthcare researchers often move too quickly from piloting interventions directly to conducting randomized clinical trials (RCT) without first optimizing the intervention, which ultimately may impede efficient evaluations of effectiveness.13, 14 Using the example of CMC undergoing spinal fusion for neuromuscular scoliosis, pilot work may indicate that, among other things, important components may include (A) nutrition management, (B) respiratory optimization, and (C) development of a post-operative pain management plan. A common strategy is to move directly to evaluation of these bundled services on patient outcomes. Design optimization allows the investigator to efficiently determine what combination(s), timing, personnel, setting, etc., of implementation for A, B, and C are most effective.14, 15 The Multiphase Optimization Strategy (MOST) is a framework that is increasingly being applied to multicomponent behavioral and biobehavioral medical interventions.14, 16 MOST involves optimization of the components through factorial experiments to identify the intervention that is expected to be optimally effective.14, 16 Other variations of factorial trials exist that offer investigators the ability to define, for example, the optimal sequencing of components of an intervention.17

HOW DO WE CHARACTERIZE AND SELECT PATIENTS TO ENROLL?

Heterogeneity among CMC presents a significant research challenge, both at the individual and program levels. To date, a relatively small set of markers of clinical severity are routinely utilized in health services research, including variables like number (“dose”) of complex chronic conditions, the presence of technology, and prior healthcare utilization (outpatient, emergency, and inpatient stays). Health services research and quasi-experimental studies will benefit from powerful adjustment capabilities, as will even RCTs, either for block randomization or post-RCT analysis of results.

Markers of Clinical Severity

More robust standardized markers of clinical severity are needed, and these may vary depending on the study population or the outcome of interest. At the population level, the type or number of chronic conditions may be sufficient to identify and adjust for severity of illness. However, diagnosis and procedure code-based adjustments may be less useful in identifying CMC with functional limitations who might benefit from specific clinical interventions, such as home nursing services or outpatient therapies. Additional categories of administrative data that may help distinguish CMC include: specialty care, medications, medical equipment, nursing, diagnostic testing, diet/nutrition, therapies, care coordination, and education.2 Standardized code sets that capture these domains, such as administrative codes to identify respiratory medical equipment and supplies, could serve as add-on modules for current classification schemes.18 Similarly, commonly employed administrative definitions of chronic medication use or polypharmacy may serve as markers of patient acuity or severity.19, 20 Because functional impairments may be associated with receipt and intensity of Early Intervention outpatient therapies, therapy claims may provide an opportunity to assess clinical severity.21

Beyond administrative data, there are opportunities to leverage more detailed clinical information about CMC to improve classification of severity. A variety of clinical severity scores exist in the adult and geriatric literature, but fewer tools have been trialed in the pediatric realm. As an example, the Clinical Frailty Scale is a tool used for geriatric patients to generate a composite frailty score from domains like medical comorbidity, function, and cognition.22 Pediatric cardiologists have adapted the Clinical Frailty Score to define functional phenotypes among children and adolescents with cardiac disease and found that the developmentally adapted domains differentiated severity between children with cardiac disease and controls.23 Similarly, among children with chronic liver disease, the Clinical Frailty Score identified the sickest children not captured by standard laboratory measures alone.24 Other adult measures have shown promise in assessing the physical status of children, including those with chronic conditions, such as the American Society of Anesthesiologists Physical Status classification system to capture pre-operative anesthesia risk measurements.25

Additional Patient Complexity Factors

Social determinants of health (SDH) clearly influence individuals’ health status, but are not robustly accounted for in CMC research.2628 The Centers for Disease Control defines social determinants of health as “life-enhancing resources, such as food supply, housing, economic and social relationships, transportation, education, and health care, whose distribution across populations effectively determines length and quality of life.” Investigators used the 2017 National Survey of Children’s Health to examine associations between a child’s level of medical complexity and SDH variables (e.g., poverty, poor parent mental health, parent incarceration, etc.).26 They observed a high prevalence of SDH challenges, especially among CMC, concluding that longitudinal data are needed to determine the temporal influences and directionality of the relationship between SDH and CMC. To do so, enhanced SDH data are needed. Some complex care programs administer psychosocial screener questionnaires at every patient visit, which capture information about issues like food insecurity or housing issues.29

Mental health conditions among CMC impact healthcare utilization and spending.30 Children with chronic physical conditions and complex chronic conditions who also have mental health diagnoses have been shown to be disproportionally represented among the highest-spending Medicaid populations.30, 31 In a study of hospital readmissions of adolescents and young adults with complex chronic diseases such as type 1 diabetes, sickle cell disease, or cystic fibrosis, mental health diagnoses such as anxiety, depression, and chronic pain were among the most common coexisting chronic conditions.32

Parent/Caregiver Characteristics

Given the significant role of parents and caregivers in caring for CMC, assessing parental characteristics is integral to implementing interventions and understanding healthcare outcomes.33, 34 Factors as simple as who reports a child’s health needs and developmental concerns can result in significantly different assessments; in two parent households, fathers were less likely than mothers to identify special healthcare needs or unmet healthcare needs.35 Parents’ own physical and mental health may be associated with the care they provide to their CMC.36 Parent caregivers commonly report higher levels of stress, poor sleep, depression and anxiety, without consistent access to respite needs3739; interventions for CMC should improve rather than worsen caregiver burden and routine measures of parenting stress should be employed. Validated measures of caregiver burden, such as the Revised Burden Measure, may allow inclusion of parent characteristics in studies.40

HOW CAN WE ENHANCE DATA COLLECTION AND INTEGRATION?

To make sophisticated adjustments and to study patient-centered outcome measures, data elements are required beyond what have typically been available in administrative databases (Table 2). Once collected, this data needs to be integrated to be analyzed.

Clinical Data

Many studies would benefit from the addition of clinical data both from inpatient and outpatient settings. Using the example of the spinal fusion example (Table 2), the inclusion of pre- and post-surgical weights, pain scores, basic lab and radiology results would provide far greater insights than administrative diagnosis and utilization data alone. A different type of research question, such as determining whether bisphosphonates are effective treating osteopenia in children with neurological impairment (Table 2), might require detailed medication data (ingredient, dose, dose frequency, and dosage form), DEXA scan results, and bone health laboratory values. Traditionally, these types of data have been unavailable or difficult to routinely acquire, but institutional data warehouses populated from electronic health record data are increasingly able to facilitate these studies. Clinical research networks, such as PEDSnet, with common data models that can link these data between institutions can enhance sample sizes, especially for CMC with rarer conditions.41 Additionally, patient registries and clinical databases already exist for certain rare disease populations and could potentially provide curated clinical data.42

Patient- (and Parent-) Reported Information and Outcomes

Patient-reported outcomes (PROs) have been used extensively in adult and geriatric research and can provide rich and measurable patient-relevant study data. Because the caregivers of CMC often provide in-home bedside care to their children, their assessments of symptoms over time are particularly valuable. Psychosocial screeners, depression screens, information about current symptoms, and medication reconciliation data are commonly collected during clinical care or even between episodes of care via mobile technology and can provide powerful insights about patient-centered outcomes. Using the example of sleep pharmacotherapy (Table 2), administrative data may allow researchers to assess fills and discontinuations of sleep medications, but these are only proxies for outcomes; parent and patient-reported symptom data are essential to assessing effectiveness of sleep pharmacotherapy. Standardized symptom tools are available, providing tested pediatric outcome tools to measure variety of symptoms43, but care needs to be taken that these tools will work for CMC. Clinicians and researchers within the field of pediatric palliative care have employed a pediatric version of the Memorial Symptom Assessment Scale (MSAS), which measures the frequency, severity, and bother of multiple symptoms, to longitudinally track children’s symptom burdens. Such data have proven useful to direct medication use, therapies, and other interventions.44, 45

HOW CAN WE IMPROVE ENROLLMENT AND PARTICIPATION?

Prospective intervention-based research will require investigators to recruit and enroll patients who meet study criteria, and then to enable them to fully participate, potentially over extended periods of time.

Efficient Patient Identification

Diagnosis-based identification of patients has enabled the conduct of health services research at the population level. However, the use of ICD-based definitions alone to identify CMC for certain clinical interventions or to enroll into clinical trials poses potential problems due to their test characteristics, namely their high sensitivity and low specificity. With broader, more heterogenous collections of codes, data-driven re-evaluations of code schemes may be useful.

For example, in 2012, the original set of neurological impairment codes were published, and were shown to be sensitive for a broad range of severities.7 In 2019, these codes were revised with a focus on those with the highest healthcare utilization to improve identification of children with the most severe neurological impairments.46

Still, as discussed earlier, functional limitations are not easily captured by diagnosis and procedure codes alone, which may increase the risk of misclassification bias and limits their clinical utility for identification of CMC. To address these issues, investigators proposed a stepwise approach for identifying children with medical complexity that has proven useful to enroll CMC in clinical research studies.2, 44 Following the suggested scheme, an investigator would first use diagnosis and procedure schemes to identify an initial population of children. Next, to address variation in functional limitations, the investigator would apply additional claims-based criteria such as the use of certain medications or medical devices, to further restrict the sample of potential study participants. Finally, a more focused clinical screener or questionnaire could be used to identify and target children meeting additional clinical criteria for functional impairments, unmet needs, etc.2

With richer clinical data sources, like the electronic health record, data scientists have started to create computable phenotypes. Akin to the first 2 steps of the aforementioned approach, this strategy involves the use of clinical data elements (beyond just diagnoses and procedure codes) and logical expressions to identify reliable, reproducible phenotypes of patients across different data sources.47 For research networks (like PEDSnet) or clinical rare disease registries that contain the necessary data, this approach has proven efficient to identify research participants.48, 49

Enabling Participation from Home

The 2020 COVID-19 pandemic accelerated the use of electronic modes of research, including the use of digital platforms to manage study enrollments, consents and assents, and even the conduct of studies.50 A variety of tools are available to CMC researchers; REDCap alone includes capabilities to support online consenting, signature capture, document management, online and text-based survey tools; and data management and reporting.51, 52 With the widespread uptake of secure HIPAA-compliant videoconferencing software, video-based research solutions are possible. Broadly, two types of models exist for online research: the “parent-report” model, where information is collected exclusively through the parent/guardian, and the “direct data-collection” model where information is also collected from children through on-screen interactions or digital sensor sources like home monitoring devices.50 A non-exhaustive list of potential benefits of using online platforms for research includes: reducing barriers to participation by eliminating travel for in-person visits that can be difficult for CMC; allowing participants to complete study items on their own time; enabling more frequent, longitudinal contact; and increasing the potential universe from which to enroll CMC with rarer diseases.53

WHICH INTERVENTION EXPERIMENTAL DESIGN SHOULD WE CHOOSE?

A range of rigorous study designs exists that may be applicable to intervention research among CMC, including experimental trials (where investigators assign study participants to intervention groups) to quasi-experimental designs (where investigators do not assign study participants to intervention groups). Within these groupings, many types of specific study designs exist. We will present just a few examples of relevant study designs and discuss the strengths and limitations of each study design as it pertains to individual- or program-level intervention studies in CMC.

Randomized Controlled Trials

Although randomized controlled trials (RCTs) remain the gold standard for evaluation of interventions and therapies, RCTs are infrequently utilized in the population of CMC due to challenges specific to CMC. When appropriate, RCTs should be considered to evaluate interventions, medications, and therapies, for example, to assess the effect of a pre-surgical pathway on reducing length of stay or to assess the effect of trazodone on sleep in CMC (Table 2).54 The most important benefit of an RCT is that the effectiveness of an intervention can be isolated and measured, controlling for other patient characteristics and unmeasured confounding variables. Different types of randomizations can be employed to address practical aspects of an RCT and reduce confounding. In stratified randomization, strata are constructed based on important prognostic variables (for example, by major complex chronic condition organ system category) and then the sample is constructed from simple random sampling from the strata. This can be useful when the study population is heterogeneous and an investigator wishes to understand how the intervention differs between strata. Cluster randomization involves administering an intervention to clusters of subjects (for example, at a clinic or hospital level) by simple randomization. This type of randomization is useful when interventions cannot be directed toward individuals, such as when a hospital- or clinic-wide intervention is implemented (Table 2).

RCTs are not without challenges.11 One major challenge to conducting RCTs is that equipoise must be present, such that no preference exists between 2 or more available treatments, and this is often a limiting factor. Among CMC, clinicians may favor intervention despite uncertainty given the severity of underlying conditions and symptoms, the lack of alternatives, and the lack of data about adverse consequences. In this case, the use of placebo controls or “no-treatment” controls may be unethical, and an active treatment control group who receive the current standard of care treatment is preferable. Furthermore, the heterogeneity of the underlying diagnoses and symptoms among CMC may increase between subjects’ variation and may require unrealistic sample sizes to ensure generalizability within the population. RCTs to evaluate orphan drugs frequently have total sample sizes <50.55 Traditional parallel group trials, where the intervention group is compared concurrently to the control group, may thus be inefficient. Finally, small-sample trials are particularly vulnerable to improper randomization and blinding, and these trials may suffer statistical consequences from participant withdrawal or loss to follow up.

Crossover Trials

Cross-over designs, where each subject is randomized receive both the treatment and control in a different order, reduce the required sample size and avoid the ethical concerns related to placebo arms. In this situation, subjects serve as their own controls which allows researchers to control for within-subjects differences and can help mitigate the issues related to heterogeneity among CMC. Repeated measures studies are thus more efficient than between-subjects designs, meaning that fewer patients are needed to recruit the necessary number of participants. This is particularly relevant for prospective studies of interventions in CMC, where recruitment may be difficult and slow. Downsides are that repeated measures studies are susceptible to time-related effects, including external events, aging of participants during the study period, and participant drop-outs that may introduce bias. Additionally, carryover effects from earlier interventions may impact the measured outcomes of the studied intervention, so crossover designs require a longer study duration with a washout period between interventions, but this is well-suited to CMC, who by definition have chronic medical conditions.

Stepped Wedge Trials

Recruitment and randomization cannot always occur at the level of the patient. For interventions delivered at a provider- or program-level, the stepped wedge cluster randomized trial design improves the ability to evaluate and measure service delivery interventions.56 Consider the example whether the presence of a clinic-based health navigator to address SDH concerns improves health outcomes (Table 2); it may not be practical, feasible, or ethical to randomize individual patients to this intervention. A stepped wedge study design is a pragmatic trial that involves the random, sequential crossover of patient clusters (perhaps clustered at the level of a hospital or a complex care program) from the control state to the intervention phase until all patient clusters have completed the intervention.57

Quasi-Experimental Designs

Several quasi-experimental designs, where the intervention is not randomly assigned, may be appropriate for studies within the population of CMC. Study subjects are still allocated to an intervention or control group, but this assignment occurs due to a naturally occurring assignment mechanism.58 For example, complex care clinics at 2 or more different institutions may treat neurologically impaired patients differentially with respect to bisphosphonates to promote bone health (Table 2), allowing for a natural experiment to evaluate the effectiveness of the medication. Just like with randomized controlled trials, many designs exist with varying degrees of design quality.5860 The strongest quasi-experimental designs utilize pre-intervention and post-intervention measurements for the intervention group and involves an untreated control group. Several methods can adjust for confounding and bias, including matching, stratification, multivariate adjustment, propensity scores, and instrumental variables.61

Interrupted Time Series Analysis

When an intervention is implemented across a population and a suitable control group is not available, an interrupted time series analysis design may be useful. Consider the example where there is statewide adoption of a stepwise seizure action plan to be used by parents and schools (Table 2). Interrupted time series analysis allows investigators to assess program-level interventions by leveraging repeated measures over time before and after the intervention.62 As opposed to simple pre-post analyses, where outcome means are compared once before and once after an intervention, the interrupted time series design accounts for important pre-intervention trends.63

CONCLUSION

Within the field of complex care, a strong foundation of epidemiolocal and health services research has resulted in vast and compelling evidence that CMC are a population of children who require continued special attention and on-going research investigation. With an increasing focus on how to provide effective, comprehensive care to CMC, there exists an urgent need for CMC researchers to study interventions at both the patient and program levels. Rather than relying on extrapolated evidence or descriptive reports, clinicians who care for CMC can instead implement rigorously studied interventions with favorable patient-centered outcomes.

Funding/Support

Dr. Feinstein was supported by the Eunice Kennedy Shriver National Institute of Child Health & Human Development of the National Institutes of Health under Award Number K23HD091295.

Role of the Funder/Sponsor

The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Abbreviations;

CCC

complex chronic condition

CMC

children with medical complexity

MOST

Multiphase Optimization Strategy

PRO

patient reported outcome

RCT

randomized controlled trial

SDH

social determinants of health

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Publisher's Disclaimer: Disclaimer

Publisher's Disclaimer: The content is solely the responsibility of the authors and does not represent the official views of the National Institutes of Health or the U.S. government.

Declaration of Competing Interest

There are no conflicts of interest relevant to this article to disclose.

REFERENCES

  • 1.Feudtner C, Feinstein JA, Zhong W, Hall M, Dai D. Pediatric complex chronic conditions classification system version 2: updated for ICD-10 and complex medical technology dependence and transplantation. BMC Pediatr. Aug 8 2014;14:199. doi: 10.1186/1471-2431-14-199 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Berry JG, Hall M, Cohen E, O’Neill M, Feudtner C. Ways to Identify Children with Medical Complexity and the Importance of Why. J Pediatr. Aug 2015;167(2):229–37. doi: 10.1016/j.jpeds.2015.04.068 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Berry JG, Hall M, Neff J, et al. Children with medical complexity and Medicaid: spending and cost savings. Health Aff (Millwood). Dec 2014;33(12):2199–206. doi: 10.1377/hlthaff.2014.0828 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Cohen E, Kuo DZ, Agrawal R, et al. Children with medical complexity: an emerging population for clinical and research initiatives. Pediatrics. Mar 2011;127(3):529–38. doi: 10.1542/peds.2010-0910 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Agrawal R, Hall M, Cohen E, et al. Trends in Health Care Spending for Children in Medicaid With High Resource Use. Pediatrics. Oct 2016;138(4)doi: 10.1542/peds.2016-0682 [DOI] [PubMed] [Google Scholar]
  • 6.Kuo DZ, Hall M, Agrawal R, et al. Comparison of Health Care Spending and Utilization Among Children With Medicaid Insurance. Pediatrics. Dec 2015;136(6):e1521–9. doi: 10.1542/peds.2015-0871 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Berry JG, Poduri A, Bonkowsky JL, et al. Trends in resource utilization by children with neurological impairment in the United States inpatient health care system: a repeat cross-sectional study. PLoS Med. Jan 2012;9(1):e1001158. doi: 10.1371/journal.pmed.1001158 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Council on Children with D, Medical Home Implementation Project Advisory C. Patient- and family-centered care coordination: a framework for integrating care for children and youth across multiple systems. Pediatrics. May 2014;133(5):e1451–60. doi: 10.1542/peds.2014-0318 [DOI] [PubMed] [Google Scholar]
  • 9.Coller RJ, Berry JG, Kuo DZ, et al. Health System Research Priorities for Children and Youth With Special Health Care Needs. Pediatrics. Mar 2020;145(3)doi: 10.1542/peds.2019-0673 [DOI] [PubMed] [Google Scholar]
  • 10.Barnert ES, Coller RJ, Nelson BB, et al. A Healthy Life for a Child With Medical Complexity: 10 Domains for Conceptualizing Health. Pediatrics. Sep 2018;142(3)doi: 10.1542/peds.2018-0779 [DOI] [PubMed] [Google Scholar]
  • 11.Hilgers R, König F, Molenberghs G, Senn S. Design and analysis of clinical trials for small rare disease populations. Journal of Rare Diseases Research & Treatment. 2016;1(3):53–60. [Google Scholar]
  • 12.Cohen E, Coller RJ. Evaluating Integrated Care for Children: A Clarion Call or a Call for Clarity? Pediatrics. Jan 2020;145(1)doi: 10.1542/peds.2019-3282 [DOI] [PubMed] [Google Scholar]
  • 13.Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol Methods. Sep 2009;14(3):202–24. doi: 10.1037/a0015826 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Collins LM. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions : The Multiphase Optimization Strategy (MOST). 1st ed. Springer International Publishing : Imprint: Springer,; 2018:1 online resource (XXXI, 297 pages 23 illustrations, 8 illustrations in color. [Google Scholar]
  • 15.Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. Am J Prev Med. Oct 2014;47(4):498–504. doi: 10.1016/j.amepre.2014.06.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Collins LM, Baker TB, Mermelstein RJ, et al. The multiphase optimization strategy for engineering effective tobacco use interventions. Ann Behav Med. Apr 2011;41(2):208–26. doi: 10.1007/s12160-010-9253-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Pelham WE Jr., Fabiano GA, Waxmonsky JG, et al. Treatment Sequencing for Childhood ADHD: A Multiple-Randomization Study of Adaptive Medication and Behavioral Interventions. J Clin Child Adolesc Psychol. Jul-Aug 2016;45(4):396–415. doi: 10.1080/15374416.2015.1105138 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Berry JG, Goodman DM, Coller RJ, et al. Association of Home Respiratory Equipment and Supply Use with Health Care Resource Utilization in Children. J Pediatr. Apr 2019;207:169–175 e2. doi: 10.1016/j.jpeds.2018.11.046 [DOI] [PubMed] [Google Scholar]
  • 19.Feinstein JA, Hall M, Antoon JW, et al. Chronic Medication Use in Children Insured by Medicaid: A Multistate Retrospective Cohort Study. Pediatrics. Apr 2019;143(4)doi: 10.1542/peds.2018-3397 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Antoon JW, Hall M, Herndon A, et al. Prevalence of Clinically Significant Drug-Drug Interactions Across US Children’s Hospitals. Pediatrics. Nov 2020;146(5)doi: 10.1542/peds.2020-0858 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Richardson ZS, Khetani MA, Scully E, Dooling-Litfin J, Murphy NJ, McManus BM. Social and Functional Characteristics of Receipt and Service Use Intensity of Core Early Intervention Services. Acad Pediatr. Sep - Oct 2019;19(7):722–732. doi: 10.1016/j.acap.2019.02.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Rockwood K, Song X, MacKnight C, et al. A global clinical measure of fitness and frailty in elderly people. CMAJ. Aug 30 2005;173(5):489–95. doi: 10.1503/cmaj.050051 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Panchangam C, White DA, Goudar S, et al. Translation of the Frailty Paradigm from Older Adults to Children with Cardiac Disease. Pediatr Cardiol. Jun 2020;41(5):1031–1041. doi: 10.1007/s00246-020-02354-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Lurz E, Quammie C, Englesbe M, et al. Frailty in Children with Liver Disease: A Prospective Multicenter Study. J Pediatr. Mar 2018;194:109–115 e4. doi: 10.1016/j.jpeds.2017.10.066 [DOI] [PubMed] [Google Scholar]
  • 25.Ferrari L, Leahy I, Staffa SJ, Berry JG. The Pediatric-Specific American Society of Anesthesiologists Physical Status Score: A Multicenter Study. Anesth Analg. Mar 1 2021;132(3):807–817. doi: 10.1213/ANE.0000000000005025 [DOI] [PubMed] [Google Scholar]
  • 26.Berry JG, Harris D, Coller RJ, et al. The Interwoven Nature of Medical and Social Complexity in US Children. JAMA Pediatr. Sep 1 2020;174(9):891–893. doi: 10.1001/jamapediatrics.2020.0280 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Pankewicz A, Davis RK, Kim J, et al. Children With Special Needs: Social Determinants of Health and Care Coordination. Clin Pediatr (Phila). Nov 2020;59(13):1161–1168. doi: 10.1177/0009922820941206 [DOI] [PubMed] [Google Scholar]
  • 28.Mattson G, Kuo DZ, Committee On Psychosocial Aspects Of C, Family H, Council On Children With D. Psychosocial Factors in Children and Youth With Special Health Care Needs and Their Families. Pediatrics. Jan 2019;143(1)doi: 10.1542/peds.2018-3171 [DOI] [PubMed] [Google Scholar]
  • 29.Verma R, Mehdian Y, Sheth N, et al. Screening for caregiver psychosocial risk in children with medical complexity: a cross-sectional study. BMJ Paediatr Open. 2020;4(1):e000671. doi: 10.1136/bmjpo-2020-000671 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Perrin JM, Asarnow JR, Stancin T, Melek SP, Fritz GK. Mental Health Conditions and Health Care Payments for Children with Chronic Medical Conditions. Acad Pediatr. Jan - Feb 2019;19(1):44–50. doi: 10.1016/j.acap.2018.10.001 [DOI] [PubMed] [Google Scholar]
  • 31.Doupnik SK, Rodean J, Feinstein J, et al. Health Care Utilization and Spending for Children With Mental Health Conditions in Medicaid. Acad Pediatr. Jul 2020;20(5):678–686. doi: 10.1016/j.acap.2020.01.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Dunbar P, Hall M, Gay JC, et al. Hospital Readmission of Adolescents and Young Adults With Complex Chronic Disease. JAMA Netw Open. Jul 3 2019;2(7):e197613. doi: 10.1001/jamanetworkopen.2019.7613 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Allshouse C, Comeau M, Rodgers R, Wells N. Families of Children With Medical Complexity: A View From the Front Lines. Pediatrics. Mar 2018;141(Suppl 3):S195–S201. doi: 10.1542/peds.2017-1284D [DOI] [PubMed] [Google Scholar]
  • 34.Boss RD, Raisanen JC, Detwiler K, et al. Lived Experience of Pediatric Home Health Care Among Families of Children With Medical Complexity. Clin Pediatr (Phila). Feb 2020;59(2):178–187. doi: 10.1177/0009922819894006 [DOI] [PubMed] [Google Scholar]
  • 35.Hagerman TK, Carle AC, Houtrow AJ. Differences in Reporting Child Health Needs and Status and Developmental Concerns between Mothers and Fathers: Findings from the National Survey of Children’s Health. J Pediatr. May 2020;220:254–257. doi: 10.1016/j.jpeds.2019.12.059 [DOI] [PubMed] [Google Scholar]
  • 36.Cousino MK, Hazen RA. Parenting stress among caregivers of children with chronic illness: a systematic review. J Pediatr Psychol. Sep 2013;38(8):809–28. doi: 10.1093/jpepsy/jst049 [DOI] [PubMed] [Google Scholar]
  • 37.Sobotka SA, Lynch E, Quinn MT, Awadalla SS, Agrawal RK, Peek ME. Unmet Respite Needs of Children With Medical Technology Dependence. Clin Pediatr (Phila). Oct 2019;58(11–12):1175–1186. doi: 10.1177/0009922819870251 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Caicedo C Families with special needs children: family health, functioning, and care burden. J Am Psychiatr Nurses Assoc. Nov-Dec 2014;20(6):398–407. doi: 10.1177/1078390314561326 [DOI] [PubMed] [Google Scholar]
  • 39.Scherer N, Verhey I, Kuper H. Depression and anxiety in parents of children with intellectual and developmental disabilities: A systematic review and meta-analysis. PLoS One. 2019;14(7):e0219888. doi: 10.1371/journal.pone.0219888 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Silva N, Pereira M, Canavarro MC, Montgomery R, Carona C. The Applicability of the “Revised Burden Measure” in Pediatric Settings: Measuring Parents’ Caregiving Burdens and Uplifts. Journal of Child and Family Studies. 2020/11/01 2020;29(11):3302–3316. doi: 10.1007/s10826-020-01832-z [DOI] [Google Scholar]
  • 41.Forrest CB, Margolis PA, Bailey LC, et al. PEDSnet: a National Pediatric Learning Health System. J Am Med Inform Assoc. Jul-Aug 2014;21(4):602–6. doi: 10.1136/amiajnl-2014-002743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Gliklich R, Dreyer N, Leavy M. Registries for Evaluating Patient Outcomes: A User’s Guide [Internet]. 3rd edition.. Agency for Healthcare Research and Quality; 2014. [PubMed] [Google Scholar]
  • 43.Jacobson CJ Jr., Kashikar-Zuck S, Farrell J, et al. Qualitative Evaluation of Pediatric Pain Behavior, Quality, and Intensity Item Candidates and the PROMIS Pain Domain Framework in Children With Chronic Pain. J Pain. Dec 2015;16(12):1243–1255. doi: 10.1016/j.jpain.2015.08.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Feinstein JA, Feudtner C, Blackmer AB, et al. Parent-Reported Symptoms and Medications Used Among Children With Severe Neurological Impairment. JAMA Netw Open. Dec 1 2020;3(12):e2029082. doi: 10.1001/jamanetworkopen.2020.29082 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Feinstein JA, Feudtner C, Valuck RJ, et al. Identifying Important Clinical Symptoms in Children With Severe Neurological Impairment Using Parent-Reported Outcomes of Symptoms. JAMA Pediatr. Nov 1 2020;174(11):1114–1117. doi: 10.1001/jamapediatrics.2020.2987 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Thomson JE, Feinstein JA, Hall M, Gay JC, Butts B, Berry JG. Identification of Children With High-Intensity Neurological Impairment. JAMA Pediatr. Aug 19 2019;doi: 10.1001/jamapediatrics.2019.2672 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Richesson R, Smerek M. Electronic Health Records-Based Phenotyping. Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. 2014. [Google Scholar]
  • 48.Khare R, Kappelman MD, Samson C, et al. Development and evaluation of an EHR-based computable phenotype for identification of pediatric Crohn’s disease patients in a National Pediatric Learning Health System. Learn Health Syst. Oct 2020;4(4):e10243. doi: 10.1002/lrh2.10243 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Denburg MR, Razzaghi H, Bailey LC, et al. Using Electronic Health Record Data to Rapidly Identify Children with Glomerular Disease for Clinical Research. Journal of the American Society of Nephrology. 2019;30(12):2427–2435. doi: 10.1681/asn.2019040365 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Brothers KB, Clayton EW, Goldenberg AJ. Online Pediatric Research: Addressing Consent, Assent, and Parental Permission. J Law Med Ethics. Mar 2020;48(1_suppl):129–137. doi: 10.1177/1073110520917038 [DOI] [PubMed] [Google Scholar]
  • 51.Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: Building an international community of software platform partners. Journal of biomedical informatics. Jul 2019;95:103208. doi: 10.1016/j.jbi.2019.103208 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of biomedical informatics. Apr 2009;42(2):377–81. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Nkoy FL, Hofmann MG, Stone BL, et al. Information needs for designing a home monitoring system for children with medical complexity. Int J Med Inform. Feb 2019;122:7–12. doi: 10.1016/j.ijmedinf.2018.11.011 [DOI] [PubMed] [Google Scholar]
  • 54.In: Evans CH Jr., Ildstad ST, eds. Small Clinical Trials: Issues and Challenges. 2001. [PubMed] [Google Scholar]
  • 55.Joppi R, Bertele V, Garattini S. Orphan drugs, orphan diseases. The first decade of orphan drug legislation in the EU. European journal of clinical pharmacology. Apr 2013;69(4):1009–24. doi: 10.1007/s00228-012-1423-2 [DOI] [PubMed] [Google Scholar]
  • 56.Avritscher EBC, Mosquera RA, Tyson JE, et al. Post-Trial Sustainability and Scalability of the Benefits of a Medical Home for High-Risk Children with Medical Complexity. J Pediatr. Mar 2019;206:232–239 e3. doi: 10.1016/j.jpeds.2018.10.035 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. Feb 6 2015;350:h391. doi: 10.1136/bmj.h391 [DOI] [PubMed] [Google Scholar]
  • 58.Maciejewski M Quasi-experimental design. Biostatistics & Epidemiology. 2018;4(1):38–49. doi: 10.1080/24709360.2018.1477468 [DOI] [Google Scholar]
  • 59.Harris AD, McGregor JC, Perencevich EN, et al. The use and interpretation of quasi-experimental studies in medical informatics. J Am Med Inform Assoc. Jan-Feb 2006;13(1):16–23. doi: 10.1197/jamia.M1749 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Reeves BC, Wells GA, Waddington H. Quasi-experimental study designs series-paper 5: a checklist for classifying studies evaluating the effects on health interventions-a taxonomy without labels. J Clin Epidemiol. Sep 2017;89:30–42. doi: 10.1016/j.jclinepi.2017.02.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Wunsch H, Linde-Zwirble WT, Angus DC. Methods to adjust for bias and confounding in critical care health services research involving observational data. J Crit Care. Mar 2006;21(1):1–7. doi: 10.1016/j.jcrc.2006.01.004 [DOI] [PubMed] [Google Scholar]
  • 62.Kontopantelis E, Doran T, Springate DA, Buchan I, Reeves D. Regression based quasi-experimental approach when randomisation is not an option: interrupted time series analysis. BMJ. Jun 9 2015;350:h2750. doi: 10.1136/bmj.h2750 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. Feb 1 2017;46(1):348–355. doi: 10.1093/ije/dyw098 [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES