Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Dec 4.
Published in final edited form as: Cardiol Young. 2021 Jun 4;31(6):876–887. doi: 10.1017/S1047951121002146

Characterisation of neurodevelopmental and psychological outcomes in CHD: a research agenda and recommendations from the cardiac neurodevelopmental outcome collaborative

Jacqueline H Sanz 1, Julia Anixt 2, Laurel Bear 3, Amy Basken 4, John Beca 5, Bradley S Marino 6, Kathleen A Mussatto 7, Wendy N Nembhard 8, Anjali Sadhwani 9, Renee Sananes 10, Lara S Shekerdemian 11, Erica Sood 12, Karen Uzark 13, Elizabeth Willen 14, Dawn Ilardi 15
PMCID: PMC8429101  NIHMSID: NIHMS1703946  PMID: 34082845

Abstract

The Neurodevelopmental and Psychological Outcomes Working Group of the Cardiac Neurodevelopmental Outcome Collaborative was formed in 2018 through support from an R13 grant from the National Heart, Lung, and Blood Institute with the goals of identifying knowledge gaps regarding the neurodevelopmental and psychological outcomes of individuals with CHD and investigations needed to advance science, policy, clinical care, and patient/family outcomes. Accurate characterisation of neurodevelopmental and psychological outcomes in children with CHD will drive improvements in patient and family outcomes through targeted intervention. Decades of research have produced a generalised perspective about neurodevelopmental and psychological outcomes in this heterogeneous population. Future investigations need to shift towards improving methods, measurement, and analyses of outcomes to better inform early identification, prevention, and intervention. Improved definition of underlying developmental, neuropsychological, and social-emotional constructs is needed, with an emphasis on symptom networks and dimensions. Identification of clinically meaningful outcomes that are most important to key stakeholders, including patients, families, schools and providers, is essential, specifically how and which neurodevelopmental differences across the developmental trajectory impact stakeholders. A better understanding of the discontinuity and patterns of neurodevelopment across the lifespan is critical as well, with some areas being more impactful at some ages than others. Finally, the field needs to account for the impact of race/ethnicity, socio-economic status, cultural and linguistic diversity on our measurement, interpretation of data, and approach to intervention and how to improve generalisability to the larger worldwide population of patients and families living with CHD.

Keywords: Neurodevelopmental outcomes, psychological outcomes, CHD, parents and stakeholders


The November 2020 issue of Cardiology in the Young contains the inaugural five manuscripts from the Cardiac Neurodevelopmental Outcome Collaborative15, marking the beginning of the partnership between the Cardiac Neurodevelopmental Outcome Collaborative and Cardiology in the Young. In this issue of Cardiology in the Young, this article is part of the first set of three papers from the Cardiac Neurodevelopmental Outcome Collaborative R13 Grant funded by the National Heart, Lung, and Blood Institute of the National Institutes of Health of the United States of America, which defines the research agenda for the next decade across seven domains of cardiac neurodevelopmental and psychosocial outcomes research.68

The ultimate goal of research within the CHD population is to improve outcomes for patients and families. How we measure, describe, and interpret neurodevelopmental and psychological outcomes can completely alter the effectiveness of research and clinical efforts to improve and optimise outcomes. Thus, future investigations need to expand our current understanding and characterisation of neurodevelopmental and psychological outcomes in children with CHD. While considerable effort has gone into identifying a characteristic “neurodevelopmental signature” of children with CHD, a more nuanced characterisation is critical to guiding work on mechanisms for modifiable change, as well as timely identification, prevention, and intervention strategies.

Research has given us a general sense of relative weaknesses and commonly provided diagnoses (from the Diagnostic and Statistical Manual of Mental Disorders – Fifth Edition) from a cross-sectional perspective.9 A single, characteristic outcome for children with CHD is unlikely given the heterogeneity in risk factors, mechanisms of action, comorbidities, and how neurodevelopmental concerns change over the course of development. In addition, little is known about the impact of cultural, linguistic, geographic, and socio-economic factors on outcomes. While we have identified some key risk factors, additional research is needed to determine which are modifiable and promote resilience.

We must move beyond mere descriptive data to understand the longitudinal trajectory of outcomes, how these present over the course of development, and the functional impact of neurodevelopmental differences. Along with understanding risk factors, we also need to understand those factors that promote resilience and positive outcomes. In collaboration with diverse patients, families, schools, and other stakeholders, this knowledge will support the critical process of prioritising concerns, developing targeted treatment and intervention strategies, improving access to resources, and reducing the burden of long-term care.

The Neurodevelopmental and Psychological Outcomes Working Group of the Cardiac Neurodevelopmental Outcome Collaborative is composed of multidisciplinary topic area experts (in psychology, neuropsychology, cardiology, developmental paediatrics, nursing) from the USA, Canada, and New Zealand, a health disparities expert (W. Nembhard) and a parent stakeholder (A. Basken) (Table 1). The Working Group was formed in 2018 with the goals of identifying (1) significant knowledge gaps related to characterisation of neurodevelopmental and psychological outcomes in CHD; (2) critical questions that must be answered to further knowledge, policy, care, and outcomes; and (3) investigations needed to answer these critical questions. The effort was supported by a National Heart, Lung, and Blood Institute R13 grant awarded to the Cardiac Neurodevelopmental Outcome Collaborative in collaboration with the Ann & Robert H. Lurie Children’s Hospital of Chicago, which funded a two-day meeting of multidisciplinary, multinational experts, and patient/caregiver stakeholders in Kansas City, MO. This paper presents the top five critical questions identified by the Working Group (Table 2) and provides specific recommendations for science and health policy to inform future research on the characterisation of neurodevelopmental and psychological outcomes in CHD.

Table 1.

Neurodevelopmental and psychological outcomes working group participants

WG Participants WG Role/Discipline Institution/Organisation Country
Jacqueline H. Sanz* Pediatric Neuropsychologist Children’s National Hospital, George Washington University School of Medicine USA
Dawn Ilardi* Pediatric Neuropsychologist Children’s Healthcare of Atlanta, Emory University USA
Julia Anixt Developmental Pediatrician Cincinnati Children’s Hospital Medical Center USA
Laurel Bear Developmental Pediatrician Medical College of Wisconsin, Herma Heart Institute, Children’s Wisconsin USA
Amy Basken Parent Stakeholder Conquering CHD USA
John Beca Cardiac Critical Care Starship Children’s Health New Zealand
Kathleen A. Mussatto Nurse Scientist/Clinical Nurse Specialist Milwaukee School of Engineering University, School of Nursing USA
Wendy N. Nembhard** Epidemiologist Fay W. Boozman College of Public Health, University of Arkansas for Medical Sciences USA
Anjali Sadhwani Pediatric Psychologist Boston Children’s Hospital, Harvard Medical School USA
Renee Sananes Pediatric Psychologist The Hospital for Sick Children, The University of Toronto Canada
Lara S. Shekerdemian Cardiac Critical Care Baylor College of Medicine USA
Karen Uzark Nurse Scientist/Clinical Nurse Specialist University of Michigan C.S. Mott Children’s Hospital USA
Elizabeth Willen Pediatric Neuropsychologist Children’s Mercy, Kansas City, University of Missouri-Kansas City School of Medicine USA

WG = Working Group.

*

Working Group Co-Lead

**

Health Disparities Expert.

Table 2.

Neurodevelopmental and psychological outcomes: critical questions, significant gaps in knowledge, and investigations needed

Critical Questions Significant Gaps in Knowledge Investigations Needed

CQ1. How do we characterise and define neurodevelopmental and psychological outcomes in children with CHD? • We need a better understanding of neurodevelopmental outcomes in CHD as networks of co-existent, interactive, and self-sustaining symptoms. • Shift our conceptual frameworks of neurodevelopmental and psychological outcomes towards measurement of dimensional and dynamic variables
• We need to better understand how these networks are unique to CHD and how they overlap with other pediatric medical or developmental conditions • Utilise multivariate analyses to examine patterns and constellations of features in CHD
• Identify key risk factors that predict specific presentations
• Inadequate diversity in our research samples limits our understanding and generalisability of findings • Develop comparative studies with other pediatric medical conditions

CQ2. What are the longitudinal trajectories of neurodevelopment for individuals with CHD across the lifespan? • There are few longitudinal studies, especially those extending beyond school age/adolescence • Conduct longitudinal research to evaluate the trajectories of neurodevelopmental and psychological outcomes
• Few studies use sophisticated models, such as developmental cascades • Utilise sophisticated statistical methods to evaluate the effects of early risk factors on later outcomes
• Little is known regarding short- and long-term impact of medical comorbidities on neurodevelopmental characteristics that emerge with age • Leverage multi-institutional, prospective data registries to facilitate and enhance neurodevelopmental and psychological research

CQ3. What outcomes are clinically meaningful to stakeholders and how do we measure clinically meaningful outcomes and differences? • Neurodevelopmental outcome research in CHD has not typically engaged patient, family, or community stakeholders as partners • Determine which outcomes are considered meaningful to stakeholders
• We need more information regarding priorities for key stakeholders • Identify variables that balance the needs of clinical practice and research and predict meaningful functional outcomes for families and other stakeholders
• It is often unclear how statistically significant findings translate into clinically significant or meaningful findings • Identify neurodevelopmental and psychological assessment tools that balance the needs of clinicians, researchers, and families
• Examine meaningful outcomes with statistical analyses that consider individual factors, longitudinal change, and dynamic latent variables

CQ4. What factors predict resilience and are protective in individuals with CHD across the lifespan? • Studies investigating protective factors associated with resilience or positive outcomes in CHD are lacking. • Identify specific factors that predict resilience and positive outcomes for individuals with CHD and their families
• How does broader literature regarding factors such as positive family functioning, parental mental health, and social support systems apply to patients and families with CHD? • Examine the development of resilience and interactions among resilience and risk factors over time

CQ5. How do we engage diverse populations with CHD to better understand neurodevelopmental and psychological outcomes? • There are few studies on cognitive testing among bilingual or culturally diverse children. • Increase the number of racially, socially, and geographically diverse participants with CHD in neurodevelopmental and psychological outcomes research
• There are no studies examining variations in performance due to cultural or linguistic factors specific to CHD. • Improve our measurement of neurodevelopmental and psychological variables and other important contributing variables
• Little information exists on demographic variability among participants/non-participants in studies, limiting their generalisability. • Identify best practices for the evaluation of language dominance/proficiency for bilingual individuals.
• Identify cross-cultural clinical training needs among providers within the CHD community.

CQ = critical question.

Critical question 1: How do we characterise and define neurodevelopmental and psychological outcomes in children with CHD?

Existing knowledge

Research has demonstrated lower performance in specific neurodevelopmental and psychological skill areas, including attention and executive skills, processing speed, language, visual-spatial and motor skills, memory, reading and math, and adaptive functioning, as well as increased prevalence of emotional and behavioural symptoms in children with CHD.1023 This contributes to increased use of special education and therapeutic services.24,25 Although these findings are often referred to as the “neurodevelopmental signature” of CHD, there is no evidence for a single phenotype, or profile, for children with CHD. Instead, there is significant variability within and across domains of functioning, including age-typical performance for some children. Those children with genetic disorders or syndromes may have more global impairment or specific findings related to those syndromes.2629 With respect to psychological diagnoses with clearly defined constellations of symptoms, there are increased rates of Attention Deficit Hyperactivity Disorder, Autism Spectrum Disorder, and Anxiety Disorders, although these rates also vary based on severity of the CHD and other comorbidities.3034 In addition, there are multiple risk factors for neurodevelopmental and psychological problems, including cardiac (e.g., pre- and peri-operative, current cardiac function) and non-cardiac (e.g., psychosocial and demographic) factors that may substantially influence long-term outcome (see Figure 1, from Cassidy et al.9).

Figure 1.

Figure 1.

Known factors that affect variability in developmental and neuropsychological outcomes for children and adolescents with CHD. ECMO = extracorporeal membrane oxygenation. Reproduced with permission from Cassidy et al. (2018), Congenital Heart Disease: A Primer for the Pediatric Neuropsychologist, Child Neuropsychology, 24 (7) (Taylor & Francis Ltd, http://www.tandfonline.com).

Significant gaps in knowledge

Despite rapid advancements in knowledge, heterogeneous findings and unexplained variance are problematic for guiding early detection and targeted interventions. Conceptually, existing research either uses a categorical approach with respect to diagnostic data (e.g., does a child meet diagnostic criteria for a disorder) or uses symptoms in isolation on a dimensional scale (e.g., identifying weaknesses in attention, executive function, and motor skills).9 These approaches are less helpful in understanding neurodevelopmental profiles that fall outside of strict diagnostic categories from the Diagnostic and Statistical Manual of Mental Disorders – Fifth Edition, where symptoms overlap across multiple diagnoses, or how these symptoms evolve over the course of development. There has been a more recent push towards thinking of neurodevelopmental or psychological disorders as networks of co-existent, interactive, and self-sustaining symptoms, rather than as categorical entities.35,36 This approach would likely provide more flexibility in understanding the range of possible outcomes in children with CHD. It is also unclear how networks of observable neurodevelopmental and psychological problems are unique to CHD, or how they may be similar to other paediatric high-risk medical or developmental conditions.

Finally, there are substantial limitations to our existing knowledge about outcomes given inadequate diversity in our research samples (see Critical Question #5 below). Participants are primarily white, urban, and have higher socio-economic status. This limits our ability to generalise findings to diverse, international populations with CHD, as well as to use neurodevelopmental and psychological outcomes to understand issues and obstacles in accessing care.

Investigations needed

(1). Shift our conceptual frameworks of neurodevelopmental and psychological outcomes towards measurement of dimensional and dynamic variables

In 2009, the National Institute of Mental Health (NIMH) proposed the Research Domain Criteria Project (http://www.nimh.nih.gov/research-priorities/rdoc/index.shtml) as a framework for examining psychopathology in terms of measurable, dimensional behavioural and cognitive constructs that cut across diagnostic categories, that include normal variation,37,38 and that account for evolution and change across development.39 This approach intends to move psychological outcomes research towards the era of precision medicine and conceptually allows us to better integrate genetics and neurosciences in explanations of clinical phenomena.

(2). Utilise multivariate analyses to examine patterns and constellations of features in CHD

The Research Domain Criteria Project approach lends itself to sophisticated, multivariate statistical modelling that examines patterns in data (graph theory, Bayesian modelling, principle component analysis) that could identify those constellations of features that are most prevalent in children with CHD. While an understanding of categorical diagnoses remains important, as it allows us to work within clinical and educational systems, this allows us to move towards conceptualising outcomes as networks of interrelated cognitive and behavioural features and better capture the range and heterogeneity of outcomes in CHD.

(3). Identify key risk factors that predict specific phenotypic presentations

Current studies tend to divide patients into discrete cardiac diagnostic categories; however, these are heterogeneous groups. Shifting our conceptual framework towards the Research Domain Criteria Project model might encourage us to examine shared features across cardiac diagnoses that impact brain development (e.g., aortic arch obstruction, single ventricle status, degree of shunting) along with perioperative or patient-specific factors that also contribute (e.g., use of extracorporeal membrane oxygenation, haemodynamic factors, pre-term birth, socio-economic status). If we are able to move towards identifying specific mechanisms of action, then we may identify potentially modifiable risk factors for specific problems and provide more targeted interventions.

(4). Develop comparative studies with other paediatric medical conditions

Comparative studies of neurodevelopment with other medical populations that impact early brain development, such as prematurity, genetic disorders, epilepsy, or perinatal stroke, will allow us to further explore mechanisms, or root causes of neurodevelopmental and psychological differences. These studies can help differentiate those mechanisms of action that are shared across medical populations from those that may be specific to children with CHD.

Critical question 2: What are the longitudinal trajectories of neurodevelopment for individuals with CHD across the lifespan?

Existing knowledge

The majority of knowledge related to the neurodevelopment of individuals with CHD has been gained from cross-sectional studies in infants, toddlers, school age, and adolescent children,4043 with a limited number of single-cohort longitudinal studies.4446 Through these longitudinal studies, it is apparent that neurodevelopment is somewhat discontinuous. That is, early neurodevelopment has limited predictive value into the school-age years and beyond.17,47 For example, many children with CHD who present as typically developing at age two showed deficits by age four.46 Further, longitudinal neuropsychological data suggest increasing prevalence of neurodevelopmental problems over time, as well as different areas of concern over time. For example, problems with language, speech, motor, and visual-motor development are commonly reported in early life, whereas concerns related to executive function, social cognition, academic achievement, and anxiety/depression are more apparent during school age, adolescence, and young adulthood.19,30,43,4851

Research with preterm infants, a group that has been compared to CHD, has demonstrated how critical longitudinal research is to understanding neurodevelopmental and psychological profiles. The National Institute of Child Health and Human Development Neonatal Research Network, which includes longitudinal follow-up of neurodevelopmental outcomes in preterm infants, recognises that deficiencies may not manifest until later childhood and can only be understood in the context of a child’s overall developmental trajectory.52 In addition, epidemiologic studies from countries with population databases have identified links between prematurity and neurocognitive impairment in late adulthood,53,54 which are increasingly recognised in the CHD population15, again providing evidence for the importance of longitudinal assessment of high-risk neonates.

An understanding of developmental cascades is also critical to longitudinal research. Developmental cascades refer to the cumulative effect of the many interactions, both direct and indirect, occurring between a range of risk factors (i.e., biological, neurodevelopmental, psychosocial, socioeconomic, and cultural) on later development or outcomes.55,56 Developmental cascade models enable better identification of independent or interdependent contributions of each risk factor, including early risk factors that are relatively stable over time (e.g., genetics). In turn, these early factors impact later outcomes in a specific domain through mediating and moderating effects, as well those early factors that can be modified or whose effect seems to dissipate over time.5557 While developmental cascade models have been applied in research to understand normal development58 and development in the preterm population,59,60 the use of developmental cascades to uncover the cumulative risk over time within the CHD population is just emerging.61

Significant gaps in knowledge

There has been only limited research that considers how neurodevelopmental and psychological domains evolve and impact one another over time in the CHD population, and as a result, the potential to target these factors and modify their course has not been studied.61 Few longitudinal studies exist in CHD, and studies beyond school age and adolescence are lacking. As adolescents with CHD transition to adulthood, loss to follow-up is common, limiting opportunities for long-term analysis of outcomes.62 Application of more sophisticated models, such as developmental cascades, is only in its early stages. In addition, little is known about the short- and long-term impact of medical comorbidities (e.g., cardiac status, neurological events, genetic variants) on neurodevelopmental and psychological characteristics that emerge with age. These critical gaps in knowledge around the longitudinal course of development in CHD limit our ability to more comprehensively characterise neurodevelopmental and psychological outcomes.

Investigations needed

(1). Conduct longitudinal research to evaluate the trajectories of neurodevelopmental and psychological outcomes

Longitudinal studies are needed to evaluate neurodevelopmental and psychological trajectories from infancy through adulthood across the spectrum of CHD. These will serve to identify the short- and long-term impact of medical and patient-specific factors on later outcomes. Studies should examine the interaction between neurodevelopmental and psychological characteristics over time and how these interactions may influence later outcomes via developmental cascades. This would also help inform the predictive value of specific standardised measures over time.

(2). Utilise sophisticated statistical methods to evaluate the effects of early risk factors on later outcomes

At a more granular level, longitudinal statistical methods such as structural equation modelling would enable investigators to consider both direct and indirect effects of earlier risk factors on later outcomes. This analytic approach has been successfully performed in several studies in both typically developing children and high-risk populations.60,61,63,64

(3). Leverage multi-institutional, prospective data registries to facilitate and enhance neurodevelopmental and psychological research.

While studies in smaller samples will continue to be helpful in providing further depth of knowledge around specific topic areas, large-scale collaborative data registries are more adequately powered for statistical techniques that model interactive networks of symptoms over time in longitudinal samples and more accurately represent the larger and more diverse population of children with CHD. Indeed, prospective, longitudinal studies that follow populations from birth through adolescence have been successfully implemented in other medical populations, such as premature birth.6466 Multi-institutional, prospective data registries would facilitate collection of longitudinal neurodevelopmental and psychological data in CHD by using data already obtained through clinical practice, thereby increasing feasibility and reducing the costs.

Critical question 3: What outcomes are clinically meaningful to stakeholders and how do we measure clinically meaningful outcomes and differences?

Existing knowledge

Thus far, the majority of neurodevelopmental and psychological outcome research in CHD has been driven by academic researchers and clinician stakeholders working in specialty care settings. The focus has been to describe a broad spectrum of developmental, neuropsychological, and psychological outcomes.1 Assessment tools are variable, including screening instruments and large batteries of tests and rating scales, with analyses focusing on broad index scores and dimensional outcome variables. Analyses commonly evaluate statistically significant differences in neurodevelopmental and psychological outcomes by comparing children with CHD to a normative sample or control group (including siblings), and/or by comparing groups with different types of CHD.1115,18,20,21,10 There are, however, emerging studies that have started to explore the association of these findings with functional outcomes, such as academic functioning or quality of life.61,67,68

Significant gaps in knowledge

Despite increasing emphasis on community-engaged research in other fields,6971 neurodevelopmental and psychological outcome research in CHD has not typically engaged patient, family, or community stakeholders as partners or advisors and has not directly evaluated which neurodevelopmental and psychological outcomes are considered meaningful to different stakeholder groups. As a result, we remain generally unaware of primary neurodevelopmental concerns and priorities across the lifespan for patients with CHD, their parents, teachers, and other stakeholders. In addition, statistically significant findings for a given outcome variable in samples with CHD may not translate into clinically significant or meaningful results, including those that might influence clinical practice, academic functioning, or quality of life.

Investigations needed

(1). Determine which outcomes are considered meaningful to stakeholders

Qualitative and mixed-methods research can be used to explore which outcomes are clinically meaningful to patients, families, teachers,72 medical providers, and other stakeholders.73 Community-engaged methods that include stakeholders as partners or advisors can help to ensure that stakeholder perspectives are incorporated into all phases of research, including identification of priority health concerns and research questions.74 Shifting the focus towards consideration for what is meaningful and significant to various stakeholder groups could help to better identify risks at critical developmental stages, optimal targets of intervention, and mechanisms of change.

(2). Identify variables that balance the needs of clinical practice and research and predict meaningful functional outcomes for families and other stakeholders

Variable selection for research trials and registries should be informed by and balance the needs and perspectives of the clinician and family stakeholders. As an example, both continuous and categorical variables are important to clinical practice and research but may serve different purposes for various stakeholder groups. Continuous variables allow investigation of subthreshold symptoms,7578 are necessary for measuring some domains without a corresponding diagnosis (e.g., visuospatial skills, memory, executive functioning), and allow for the study of psychological networks (i.e., symptom constellations) that may not fit categorical diagnoses.79 In contrast, categorical variables, such as specific diagnoses, may be preferred by clinicians in some areas,31,32 especially for diagnoses that require early targeted intervention (e.g., autism spectrum disorder). As discussed above, there are increasing challenges to the categorical diagnostic framework for psychological disorders. Evidence from genetics and neuroscience suggests that symptoms are dimensional and occur in dynamic inter-related networks that may be present in more than one clinical category or disorder.80,81 This is especially relevant to those with CHD who do not clearly meet clinical criteria for an established neurodevelopmental or psychological diagnosis, but whose symptoms significantly impact day to day life (e.g., quality of life, peer relations, and educational/vocational attainment).

(3). Identify neurodevelopmental and psychological assessment tools that balance the needs of clinicians, researchers, and families

Assessment tools need to identify neurodevelopmental and psychological concerns in an efficient and cost-effective manner, without sacrificing psychometric rigour and sensitivity. Some instruments may be preferred by researchers, but can be problematic for clinical practice. Clinician and family stakeholders should be engaged in the process of selecting assessment tools for research trials and clinical registries to ensure that results are clinically meaningful for various stakeholder groups.74

(4). Examine meaningful outcomes with statistical analyses that consider individual factors, longitudinal change, and dynamic latent variables

Statistical methods that can specifically evaluate meaningful differences should be utilised,82 including those that examine individual-level variables and their association with a child’s outcome across time while controlling for important factors (e.g., disease severity, family factors,83 comorbidities). Statistical analyses should also consider latent factors84 in order to better understand complex neurodevelopmental and psychological constructs and the relationships between them.85,86 The interaction between outcome domains (or symptoms)87,88 or how networks of overlapping symptoms present as comorbidities35 is critical to understanding functional impact (e.g., executive functioning affects adaptive skills that affect adult transition;89 behavioural regulation affects academic functioning61,67).

Critical question 4: What factors predict resilience and are protective in individuals with CHD across the lifespan?

Existing knowledge

Resilience has been defined as “a universal capacity which allows a person, group or community to prevent, minimise or overcome the damaging effects of adversity.”90 Individuals with CHD and their families often experience challenging, threatening, and traumatic experiences related to their medical condition, especially those with more complex disease. An understanding of factors that improve patient and family coping and resilience has the potential to positively impact the psychosocial well-being, physical health, and neurodevelopment of children with CHD. These factors could be closely monitored and leveraged across development to better inform and drive interventions.

Most outcome research among children with complex CHD focuses on impairments or problems related to psychological adjustment, development, cognition, or quality of life, and on specific risk factors for these problems. Only a smaller number of studies have focused on resilience. For example, several studies have found that positive self-concept is associated with better psychosocial adjustment, higher quality of life, and decreased depression for adolescents with CHD.9193 Other studies have also reported that positive self-perceptions regarding global self-worth, competence, and health were associated with better adjustment,92 and higher levels of social support can mitigate stress and contributed to better behavioural outcomes.94

Research with patients and families facing other chronic illnesses or trauma has identified several possible factors that predict resilience or positive outcomes. For example, positive family functioning mediates the relationship between family “hardiness” (a family’s ability to respond to stressful life events) and caregiver state anxiety.95 Higher levels of social connectedness in multiple domains (neighbourhood, friend, parent, sibling, school, peer, and teacher) were associated with lower stress and better coping (such as “benefit finding” or perception of personal growth).96 Similarly, research studies on the experience of adverse childhood events have identified several factors associated with the development of resilience, including a positive appraisal style, good executive functioning, nurturing parenting, maternal mental health, good self-care skills, consistent household routines, as well as an understanding of trauma.97 Continuing to identify positive predictive factors will be critical to monitoring and intervention strategies.

Significant gaps in knowledge

While some information exists regarding risk and protective factors associated with resilience, literature specific to the CHD population is less developed, leaving significant gaps in knowledge regarding possible factors that promote resilience in children with CHD. We need additional research to identify factors such as positive family functioning, parental mental health (including fathers98), and engagement with social support systems that are associated with resilience and to better understand their role in families and patients with CHD.

Investigations needed

(1). Identify specific factors that predict resilience and positive outcomes for individuals with CHD and their families

Future research should focus on identifying specific characteristics of individuals with CHD associated with resilience and optimal neurodevelopmental and psychological outcomes, particularly those characteristics that are modifiable. Literature on resilience in other paediatric medical conditions and adverse childhood events will likely help to identify promising characteristics that can be evaluated among patients and families with CHD, including social support, positive self-concept, and positive coping strategies.96,97,99

(2). Examine the development of resilience and interactions among resilience and risk factors over time

As with neurodevelopmental outcomes, studies examining resilience tend to conceptualise it as a static variable. Instead, resilience could be conceptualised as a skill that develops and varies over time in a child/family, is influenced by other variables in a developmental cascade,55,56 and plays a role in the previously described complex networks/constellations of neurodevelopmental outcomes. Longitudinal models should include those factors that have been shown to promote resilience and positive outcomes for individuals with CHD or other paediatric medical conditions. Models also need to evaluate potential interactions among resilience and risk factors over time, how these interactions may influence later outcomes, and how to approach strategies for intervention.

Critical question 5: How do we engage diverse populations with CHD to better understand neurodevelopmental and psychological outcomes?

Existing knowledge

The population of the United States is growing more diverse, and it has been predicted that white children will be the minority population after 2020, and white adults will be the minority in 2044100 (United States Census Bureau 2014 Projections). Improved understanding of meaningful neurodevelopmental and psychological outcomes for diverse individuals with CHD across the lifespan is critical and will allow providers to better communicate and partner with families, identify risks and resilience, improve referrals to developmental services/supports, and plan treatment, thereby improving neurodevelopmental and psychological outcomes.

Most commonly used measures of neurodevelopmental and psychological functioning were developed primarily within a normative sample of non-Hispanic, white middle class individuals, and derived from western cultural norms that are not necessarily generalisable across other cultures.101103 The skills and abilities considered important within the western culture for whom the tests were developed may have limited value or salience in other cultures.101 In the United States alone, there is also significant heterogeneity between and within cultural groups, which further limits the generalisability of these measures among diverse populations.104 Among populations whose primary language is not English, translations of existing measures may not provide for cultural equivalency and may further decrease validity and reliability.102 For example, development and/or translation of a measure derived from a normative sample of Spanish speakers from Mexico is not likely to apply to a normative sample of Spanish speakers from Nicaragua or Cuba.105 Moreover, the identification of nonverbal tasks as more “culture-fair” measures of cognitive functioning is misleading. Performance differences are common in diverse groups,103 and many of these tests lack cultural relevancy.

In addition, there have been longstanding challenges with recruitment and retention of diverse populations in research and clinical care. There are likely a host of contributing factors, including lack of diversity within institutions, barriers to care (e.g., insurance, geographical), difficulty scheduling because of parent work and/or child’s school schedule, distrust of the medical system due to historical racism and abuses, and lack of understanding about the purpose and potential benefits of research, which may limit recruitment and retention of culturally and linguistically diverse participants.101,106 Nonetheless, guidance is available in the literature about overcoming barriers to recruiting and retaining diverse populations for research studies.104,107110

Significant gaps in knowledge

There are few studies examining normative performance on measures of intellectual skills and cognitive functioning among bilingual or culturally diverse children, and no studies have been published specifically within the CHD population. Thus, it is unclear if test performance discrepancies exist among patients from diverse versus majority cultural backgrounds or, if they do, what are the underlying causes/contributors. Furthermore, little information is available about demographic variability among participants versus non-participants in existing studies and whether differences in clinical outcomes exist. This limits the generalisability of findings to the larger CHD population. To date, there is only one published study designed to explicitly examine some of the socio-economic, educational, and ethnic disparities that may impact access to neurodevelopmental follow-up in children with CHD.111 Understanding the unique contribution of diversity on neurodevelopmental and psychological outcomes, as well as physical health, is critical to the development of viable intervention programmes and outreach for affected individuals and their families.

Investigations needed

(1). Increase the number of racially, socially, and geographically diverse participants with CHD in neurodevelopmental and psychological outcomes research

Future investigations should oversample minority and underrepresented populations to ensure sample sizes are statistically powered for subgroup analyses. Future studies should also conduct qualitative and mixed-methods analyses to elucidate facilitators and barriers to participation of underrepresented racial, ethnic, and underserved populations with CHD in neurodevelopmental and psychological outcomes research109. To facilitate greater success in inclusive research and inform future clinical and community-based studies, it is critical to involve community stakeholders in research design and recruitment, include bilingual and diverse research staff to better support inclusion efforts, include appropriate incentives such as childcare or evening hours for participation, and use a community-based rather than centre-based study design.104,107110

(2). Improve our measurement of neurodevelopmental and psychological variables and other important contributing variables

Future investigations should include additional variables that better represent constructs from racially and ethnically diverse populations, such as quality of education and test-wiseness, acculturation, and language dominance/proficiency, which will improve identification of factors that may influence test performance above and beyond actual neuropsychological impairments.112114 In addition, studies explicitly designed to assess the psychometric properties of assessment tools, utility of race/ethnic based norms, and statistical approaches to data analysis in cross-cultural and longitudinal assessment are needed. This will allow for clarification as to whether constructs measured by these tests are the same for ethnically diverse populations115 and to help in the development of best practice guidelines for analysis of longitudinal trajectories within racially and ethnically diverse populations with CHD (e.g., regression-based norms, estimation of direct and indirect effects, biases in ceiling and floor effects, etc.).116,117

(3). Identify best practices for the evaluation of language dominance/proficiency for bilingual individuals.

As Spanish-English bilinguals represent a large underrepresented group in the United States118, a better understanding of this group is a high priority and could inform clinical practice and research with speakers of other languages. Within the Spanish-speaking population, availability of reliable and valid Spanish language tests is necessary along with careful consideration of the child’s current language proficiency in English and Spanish. Level of acculturation in child and primary caregivers and geographical region of origin should also be explored in order to identify the most appropriate assessment tools.112

(4). Identify cross-cultural clinical training needs among providers within the CHD community

Both within adult and paediatric neuropsychology, proposed guidelines and recommendations for improved practices have been published,113,115,119,120 but it remains unclear how widely used these are, and if a standardised approach is the norm. To our knowledge, there has only been one recent survey of neuropsychology or other child/paediatric psychology practices with regards to assessment of diverse patients.121 Studies evaluating current practices among centers, as well as investigations of the feasibility and effectiveness of previously proposed standardised practices, are needed to create valid and reliable procedures that may be systematically applied across centers and within the diverse CHD community.

Discussion and conclusions

We have identified five critical questions that will improve characterisation of the neurodevelopmental and psychological outcomes in CHD, and thus improve patient outcomes. These critical questions revealed a number of shared themes to guide future research.

First, it is necessary to shift our conceptual framework away from a static model (e.g., a unitary “neurodevelopmental signature”) to a more dynamic framework that includes a range of neurodevelopmental and psychological outcomes conceptualised as a network of symptoms that interact and evolve over time. This conceptual framework provides a number of advantages in that it aligns with newer conceptual models in behavioural health and neurodevelopmental disorders, allows us to integrate outcomes research with other critical content areas (such as research in genetics and neuroscience), and moves us towards the era of personalised precision medicine.37,39,80

To this end, there is a call towards developing a consensus on how to best measure key components of neurodevelopmental and psychological outcomes in CHD. Tools should be used that have good clinical utility and that are sufficiently sensitive and specific to identify known weaknesses in screenings and comprehensive assessments. At the same time, their psychometric properties should be strong enough to provide rigor in research, particularly in longitudinal research that tracks key skill areas over the course of development. There is also a substantial need to identify measures with good cultural and linguistic sensitivity, or to identify alternate, but comparable means of assessing key constructs in diverse populations.

Another common theme is a discussion of what is important and to whom. We need a better understanding of which aspects of neurodevelopmental and psychosocial outcomes are most important to the patients and their family and to their overall quality of life. Input from multiple stakeholders will be critical to answering these questions, and in particular, increased representation of patients, families, and diverse populations is needed. Our findings should directly inform the development of specific interventions and preventative strategies at sensitive and critical stages across the lifespan. In addition to traditional research methodologies, implementation of quality improvement and treatment trials will be important to more effectively improving the lives of our patients and families.

Finally, the optimisation of short- and long-term outcomes for individuals with CHD across the lifespan depends on continued scientific discovery and translation to clinical improvements in a coordinated effort by multiple stakeholders. While high-quality single-centre research will continue to be important, there is also a need to move towards multicentre research. Future investigations in the field will benefit from establishing linkages through multicentre collaborative quality improvement and/or research initiative and clinical registries. For example, the Cardiac Neurodevelopmental Outcome Collaborative clinical registry, which launched in 2019 as a module of the Pediatric Cardiac Critical Care Consortium and Pediatric Acute Care Cardiology Collaborative registries, will ultimately align data, expertise, and resources to improve clinical and functional health outcomes for patients with CHD and their families. This shared data repository represents an opportunity to advance the multicentre, longitudinal, multidimensional integration of data in our rapidly growing field, while minimising redundancy and duplication122. Ultimately, this would enable us to comprehensively describe the developmental and psychosocial trajectories of our patients, to identify potentially modifiable predictors of outcomes, and implement interventions to support needs.

Acknowledgements.

The members of the Neurodevelopmental and Psychological Outcomes Working Group would like to thank Adam Cassidy, Jennifer Butcher, Cheryl Brosig, Gil Wernovsky, and the Publications Committee of the Cardiac Neurodevelopmental Outcome Collaborative for their thoughtful review of this manuscript.

Financial support. This work was supported by the National Heart, Lung, and Blood Institute (grant number 1R13HL142298-01).

Footnotes

Conflicts of interest. None.

References

  • 1.Sood E, Jacobs JP, Marino BS The Cardiac Neurodevelopmental Outcome Collaborative: a new community improving outcomes for individuals with congenital heart disease. Cardiol Young 2020; 30: 1595–1596. [DOI] [PubMed] [Google Scholar]
  • 2.Marino BS, Sood E, Cassidy AR, et al. The origins and development of the Cardiac Neurodevelopmental Outcome Collaborative: creating innovative clinical, quality improvement, and research opportunities. Cardiol Young 2020; 30: 1597–1602. [DOI] [PubMed] [Google Scholar]
  • 3.Miller TA, Sadhwani A, Sanz J, et al. Variations in practice in cardiac neurodevelopmental follow-up programs. Cardiol Young 2020; 30: 1603–1608. [DOI] [PubMed] [Google Scholar]
  • 4.Ware J, Butcher JL, Latal B, et al. Neurodevelopmental evaluation strategies for children with congenital heart disease aged birth through 5 years: recommendations from the cardiac neurodevelopmental outcome collaborative. Cardiol Young 2020; 30: 1609–1622. [DOI] [PubMed] [Google Scholar]
  • 5.Ilardi D, Sanz JH, Cassidy AR, et al. Neurodevelopmental evaluation for school-age children with congenital heart disease: recommendations from the cardiac neurodevelopmental outcome collaborative. Cardiol Young 2020; 30: 1623–1636. [DOI] [PubMed] [Google Scholar]
  • 6.Sood E, Jacobs JP, Marino BS Optimizing neurodevelopmental and psychosocial outcomes for survivors with congenital heart disease: a research agenda for the next decade. Cardiol Young 2021; 31: 876–887. This Issue. [DOI] [PubMed] [Google Scholar]
  • 7.Cassidy AR, Butler SC, Briend J, et al. Neurodevelopmental and psychosocial interventions for individuals with congenital heart disease: A research agenda and recommendations from the Cardiac Neurodevelopmental Outcome Collaborative. Cardiol Young 2021; 31: 876–887. This Issue. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Sood E, Lisanti AJ, Woolf-King SE, et al. Parent mental health and family functioning following diagnosis of congenital heart disease: A research agenda and recommendations from the Cardiac Neurodevelopmental Outcome Collaborative. 2021; 31: 876–887. This Issue. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Cassidy AR, Ilardi D, Bowen SR, et al. Congenital heart disease: A primer for the pediatric neuropsychologist. Child Neuropsychol J Norm Abnorm Dev Child Adolesc 2017; 24: 1–44. [DOI] [PubMed] [Google Scholar]
  • 10.Bellinger DC, Newburger J Neuropsychological, psychosocial, and quality-of-life outcomes in children and adolescents with congenital heart disease. Prog Pediatr Cardiol 2010; 29: 87–92. [Google Scholar]
  • 11.Bellinger DC, Wypij D, duPlessis AJ, et al. Neurodevelopmental status at eight years in children with dextro-transposition of the great arteries: The Boston Circulatory Arrest Trial. J Thorac Cardiovasc Surg 2003; 126: 1385–1396. [DOI] [PubMed] [Google Scholar]
  • 12.Brosig C, Mussatto K, Hoffman G, et al. Neurodevelopmental outcomes for children with hypoplastic left heart syndrome at the age of 5 years. Pediatr Cardiol 2013; 34: 1597–1604. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Cassidy AR, White MT, DeMaso DR, et al. Executive Function in Children and Adolescents with Critical Cyonotic Congenital Heart Disease. J Int Neuropsychol Soc 2015; 21: 34–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Griffin KJ, Elkin TD, Smith CJ Academic outcomes in children with congenital heart disease. Clin Pediatr (Phila) 2003; 42: 401–409. [DOI] [PubMed] [Google Scholar]
  • 15.Ilardi D, Ono KE, McCartney R, et al. Neurocognitive functioning in adults with congenital heart disease. Congenit Heart Dis 2017; 12: 166–173. [DOI] [PubMed] [Google Scholar]
  • 16.King TZ, Smith KM, Burns TG, et al. fMRI investigation of working memory in adolescents with surgically treated congenital heart disease. Appl Neuropsychol Child 2017; 6: 7–21. [DOI] [PubMed] [Google Scholar]
  • 17.McGrath E, Wypij D, Rappaport LA, et al. Prediction of IQ and achievement at age 8 years from neurodevelopmental status at age 1 year in children with D-transposition of the great arteries. Pediatr 2004; 114: e572–6. [DOI] [PubMed] [Google Scholar]
  • 18.Miatton M, De Wolf D, François K, et al. Neuropsychological performance in school-aged children with surgically corrected congenital heart disease. J Pediatr 2007; 151: 73–78. [DOI] [PubMed] [Google Scholar]
  • 19.Mills R, McCusker CG, Tennyson C, et al. Neuropsychological outcomes in CHD beyond childhood: a meta-analysis. Cardiol Young 2018; 28 : 421–431. [DOI] [PubMed] [Google Scholar]
  • 20.Sanz JH, Berl MM, Armour AC, et al. Prevalence and pattern of executive dysfunction in school age children with congenital heart disease. Congenit Heart 2017; 12: 202–209. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Wernovsky G, Stiles KM, Gauvreau K, et al. Cognitive development after the Fontan operation. Circ. 2000; 102: 883–889. [DOI] [PubMed] [Google Scholar]
  • 22.Cassidy AR, Newburger JW, Bellinger DC Learning and Memory in Adolescents With Critical Biventricular Congenital Heart Disease. J Int Neuropsychol Soc 2017; 23: 627–639. [DOI] [PubMed] [Google Scholar]
  • 23.Muñoz-López M, Hoskote A, Chadwick MJ, et al. Hippocampal damage and memory impairment in congenital cyanotic heart disease. Hippocampus 2017; 27: 417–424. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mulkey SB, Bai S, Luo C, et al. School-Age Test Proficiency and Special Education After Congenital Heart Disease Surgery in Infancy. J Pediatr 2016; 178: 47–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Oster ME, Watkins S, Hill KD, et al. Academic Outcomes in Children With Congenital Heart Defects: A Population-Based Cohort Study. Circ Cardiovasc Qual Outcomes 2017; 10: e00307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Carey AS, Liang L, Edwards J, et al. Effect of copy number variants on outcomes for infants with single ventricle heart defects. Circ Cardiovasc Genet 2013; 6: 444–451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Fuller S, Nord AS, Gerdes M, et al. Predictors of impaired neurodevelopmental outcomes at one year of age after infant cardiac surgery. Eur J Cardio-Thorac Surg 2009; 36: 40–47. [DOI] [PubMed] [Google Scholar]
  • 28.Gaynor JW, Wernovsky G, Jarvik GP, et al. Patient characteristics are important determinants of neurodevelopmental outcome at one year of age after neonatal and infant cardiac surgery. J Thorac Cardiovasc Surg 2007; 133: 1344–1353. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Latal B Neurodevelopmental Outcomes of the Child with Congenital Heart Disease. Clin Perinatol 2016; 43: 173–185. [DOI] [PubMed] [Google Scholar]
  • 30.Kovacs AH, Saidi AS, Kuhl EA, et al. Depression and anxiety in adult congenital heart disease: predictors and prevalence. Int J Cardiol 2009; 137158–164. [DOI] [PubMed] [Google Scholar]
  • 31.DeMaso DR, Calderon J, Taylor GA, et al. Psychiatric Disorders in Adolescents With Single Ventricle Congenital Heart Disease. Pediatrics 2017; 139: 320162241. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.DeMaso DR, Labella M, Taylor GA, et al. Psychiatric disorders and function in adolescents with d-transposition of the great arteries. J.Pediatr 2014; 165: 760–766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Holland JE, Cassidy AR, Stopp C, et al. Psychiatric Disorders and Function in Adolescents with Tetralogy of Fallot. J Pediatr 2017; 187: 165–173. [DOI] [PubMed] [Google Scholar]
  • 34.Jaworski JLB, Flynn T, Burnham N, et al. Rates of autism and potential risk factors in children with congenital heart defects. Congenit Heart Dis 2017; 12: 421–429. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Cramer AOJ, Waldorp LJ, van der Maas HLJ, et al. Comorbidity: a network perspective. Behav Brain Sci 2010; 33: 137–193. [DOI] [PubMed] [Google Scholar]
  • 36.Borsboom D, Cramer AOJ Network Analysis: an Integrative Approach to the Structure of Psychopathology. Annu Rev Clin Psychol 2013; 9: 91–121. [DOI] [PubMed] [Google Scholar]
  • 37.Cuthbert BN The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology: Forum - The Research Domain Criteria Project. World Psychiatry 2014; 13: 28–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Insel T, Cuthbert B, Garvey M, et al. Research Domain Criteria (RDoC): Toward a New Classification Framework for Research on Mental Disorders. Am J Psychiatry 2010; 167: 748–751. [DOI] [PubMed] [Google Scholar]
  • 39.Casey BJ, Oliveri ME, Insel TA Neurodevelopmental Perspective on the Research Domain Criteria (RDoC) Framework. Biol Psychiatry 2014; 76: 350–353. [DOI] [PubMed] [Google Scholar]
  • 40.Karsdorp PA, Everaerd W, Kindt M, et al. Psychological and Cognitive Functioning in Children and Adolescents with Congenital Heart Disease: A Meta-Analysis. J Pediatr Psychol 2007; 32: 527–541. [DOI] [PubMed] [Google Scholar]
  • 41.Latal B, Helfricht S, Fischer JE, et al. Psychological adjustment and quality of life in children and adolescents following open-heart surgery for congenital heart disease: a systematic review. BMC Pediatr 2009; 9: 6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Marino BS, Lipkin PH, Newburger WJ, et al. Neurodevelopmental outcomes in children with congenital heart disease: evaluation and management: a scientific statement from the American Heart Association. Circulation 2012; 126: 1143–1172. [DOI] [PubMed] [Google Scholar]
  • 43.Wilson WM, Smith-Parrish M, Marino BS, et al. Neurodevelopmental and psychosocial outcomes across the congenital heart disease lifespan. Prog Pediatr Cardiol 2015; 39: 113–118. [Google Scholar]
  • 44.Bellinger DC, Jonas RA, Rappaport LA, et al. Developmental and neurologic status of children after heart surgery with hypothermic circulatory arrest or low-flow cardiopulmonary bypass. N Engl J Med 1995; 332: 549–555. [DOI] [PubMed] [Google Scholar]
  • 45.Newburger JW, Sleeper LA, Bellinger DC, et al. Early Developmental Outcome in Children With Hypoplastic Left Heart Syndrome and Related Anomalies. Circulation 2012; 125: 2081–2091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Brosig CL, Bear L, Allen S, et al. Neurodevelopmental outcomes at 2 and 4 years in children with congenital heart disease. Congenit Heart Dis 2018; 13: 700–705. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Goldberg C, Lu M, Sleeper LA, et al. Factors Associated with Neurodevelopment for Children with Single Ventricle Lesions. J Pediatr 2014; 165: 490–496. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Bellinger DC, Wypij DW, Kuban KC, et al. Developmental and neurological status of children at 4 years of age after heart surgery with hypothermic circulatory arrest or low-flow cardiopulmonary bypass. Circulation 1999; 100: 526–532. [DOI] [PubMed] [Google Scholar]
  • 49.Bellinger DC, Wypij D, Rivkin MJ, et al. Adolescents with d-transposition of the great arteries corrected with the arterial switch procedure: neuropsychological assessment and structural brain imaging. Circulation 2011; 124: 1361–1369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kovacs AH, Sears SF, Saidi AS Biopsychosocial experiences of adults with congenital heart disease: review of the literature. Am. Heart J 2005; 150: 193–201. [DOI] [PubMed] [Google Scholar]
  • 51.Klouda L, Franklin WJ, Saraf A, et al. Neurocognitive and executive functioning in adult survivors of congenital heart disease. Congenit Heart Dis 2017; 12: 91–98. [DOI] [PubMed] [Google Scholar]
  • 52.Das A, Tyson J, Pedroza C, et al. Methodological issues in the design and analyses of neonatal research studies: experience of the NICHD Neonatal Research Network. Semin Perinatol 2016; 40: 374–384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Heinonen K, Eriksson JG, Lahti J, et al. Late preterm birth and neurocognitive performance in late adulthood: a birth cohort study. Pediatrics 2015; 135: e818–825. [DOI] [PubMed] [Google Scholar]
  • 54.Vohr B Expanding the Definition of Long-term Follow-up to Late Adulthood. Pediatrics 2015; 135: e1038–e1039. [DOI] [PubMed] [Google Scholar]
  • 55.Cox MJ, Mills-Koonce R, Propper C, et al. Systems theory and cascades in developmental psychopathology. Dev Psychopathol 2010; 22: 497–506. [DOI] [PubMed] [Google Scholar]
  • 56.Masten AS, Cicchetti D Developmental cascades. Dev Psychopathol 2010; 22: 491–495. [DOI] [PubMed] [Google Scholar]
  • 57.Bornstein MH, Hahn CS, Wolke D Systems and Cascades in Cognitive Development and Academic Achievement. Child Dev 2013; 84: 154–162. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Wade M, Browne DT, Plamondon A, et al. Cumulative risk disparities in children’s neurocognitive functioning: a developmental cascade model. Dev Sci 2016; 19: 179–194. [DOI] [PubMed] [Google Scholar]
  • 59.Rose SA, Feldman JF, Jankowski JJ Modeling a cascade of effects: the role of speed and executive functioning in preterm/full-term differences in academic achievement. Dev Sci 2011; 14: 1161–1175. [DOI] [PubMed] [Google Scholar]
  • 60.Rose SA, Feldman JF, Jankowski JJ, et al. Information Processing from Infancy to 11 Years: continuities and Prediction of IQ. Intelligence 2012; 40: 445–457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Cassidy AR, White MT, DeMaso DR, et al. Processing speed, executive function, and academic achievement in children with dextro-transposition of the great arteries: Testing a longitudinal developmental cascade model. Neuropsychology 2016; 30: 874–885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Gurvitz M, Valente AM, Broberg C, et al. Prevalence and Predictors of Gaps in Care Among Adult Congenital Heart Disease Patients: HEART-ACHD (The Health, Education, and Access Research Trial). J Am Coll Cardiol 2013; 61: 2180–2184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Masten AS, Roisman GI, Long JD, et al. Developmental cascades: linking academic achievement and externalizing and internalizing symptoms over 20 years. Dev Psychol 2005; 41: 733–746. [DOI] [PubMed] [Google Scholar]
  • 64.O’Shea T, Allred EN, Dommann O, et al. The ELGAN study of the brain and related disorders in extremely low gestational age newborns. Early Hum Dev 2009; 85: 1161–1175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Costeloe K, Hennessy E, Gibson AT, et al. The EPICure study: outcomes to discharge from hospital for infants born at the threshold of viability. Pediatrics 2000; 106: 659–671. [DOI] [PubMed] [Google Scholar]
  • 66.Larroque B, Breart G, Kaminski M, et al. Survival of very preterm infants: Epipage, a population based cohort study. Arch Dis Child Fetal Neonatal Ed 2004; 89: F139–144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Sanz JH, Wang J, Berl MM, et al. Executive Function and Psychosocial Quality of Life in School Age Children with Congenital Heart Disease. J Pediatr 2018; 202: 63–69. [DOI] [PubMed] [Google Scholar]
  • 68.Gerstle M, Beebe DW, Drotar D, et al. Executive Functioning and School Performance among Pediatric Survivors of Complex Congenital Heart Disease. J Pediatr 2016; 173: 154–159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Hollin IL, Donaldson SH, Roman C, et al. Beyond the expected: identifying broad research priorities of researchers and the cystic fibrosis community. J Cyst Fibros 2019; 18: 375–377. [DOI] [PubMed] [Google Scholar]
  • 70.Sheridan S, Schrandt S, Forsythe L, et al. The PCORI Engagement Rubric: promising Practices for Partnering in Research. Ann Fam Med 2017; 15: 165–170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.PCORI Engagement Rubric for Applicants. http://www.pcori.org/sites/default/files/Engagement-Rubric.pdf (2014).
  • 72.Olson A, Seidler A, Goodman D, et al. School Professionals’ Perceptions About the Impact of Chronic Illness in the Classroom. Arch Pediatr Adolesc Med 2004; 158: 53–58. [DOI] [PubMed] [Google Scholar]
  • 73.Alderfer MA, Sood E Using qualitative research methods to improve clinical care in pediatric psychology. Clin Pract Pediatr Psychol 2016; 4: 358–361. [Google Scholar]
  • 74.Israel B, Eng E, Schulz A, et al. Introduction to Methods for Community Based Population Research for Health. In: Israel B, Eng E, Schulz A, Parker E (eds). Methods for Community-Based Participatory Research for Health. Jossey Bass, San Francisco, 2013: 3–37. [Google Scholar]
  • 75.Chumra Kramer H, Noda A, O’Hara R Categorical versus dimensional approaches to diagnosis: methodological challenges. J Psychiatr Res 2004; 38: 17–25. [DOI] [PubMed] [Google Scholar]
  • 76.Toro KT, Miklosi M, Horanyi E, et al. Reading Disability Spectrum: Early and Late Recognition, Subthreshold, and Full Comorbidity. J Learn Disabil 2018; 51: 158–167. [DOI] [PubMed] [Google Scholar]
  • 77.Norén Selinus E, Molero Y, Lichtenstein P, et al. Subthreshold and threshold attention deficit hyperactivity disorder symptoms in childhood: psychosocial outcomes in adolescence in boys and girls. Acta Psychiatr Scand 2016; 134: 533–545. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Helmchen H, Linden M Subthreshold disorders in psychiatry: Clinical reality, methodological artifact, and the double-threshold problem. Compr Psychiatry 2000; 41: 1–7. [DOI] [PubMed] [Google Scholar]
  • 79.Borsboom D A network theory of mental disorders. World Psychiatry 2017; 16: 5–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Carlew AR, Zartman AL DSM Nosology Changes in Neuropsychological Diagnoses through the Years: A Look at ADHD and Mild Neurocognitive Disorder. Behav Sci 2017; 7: 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Kim YS, State MW Recent challenges to the psychiatric diagnostic nosology: a focus on the genetics and genomics of neurodevelopmental disorders. Int J Epidemiol 2014; 43: 465–475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Pugliese CE, Anthony LG, Strang JF, et al. Longitudinal Examination of Adaptive Behavior in Autism Spectrum Disorders: influence of Executive Function. J Autism Dev Disord 2016; 46: 467–477. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Harrison L, McLeod S Risk and protective factors associated with speech and language impairment in a nationally representative sample of 4- to 5-year-old children. J Speech Lang Hear Res JSLHR 2010; 53: 508–529. [DOI] [PubMed] [Google Scholar]
  • 84.Peterson RL, Boada R, McGrath LM, et al. Cognitive Prediction of Reading, Math, and Attention: shared and Unique Influences. J Learn Disabil 2017; 50: 408–421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Daley D, Birchwood J ADHD and academic performance: why does ADHD impact on academic performance and what can be done to support ADHD children in the classroom? Child Care Health Dev 2010; 36: 455–464. [DOI] [PubMed] [Google Scholar]
  • 86.Sabol Tierri J, Pianta RC Patterns of School Readiness Forecast Achievement and Socioemotional Development at the End of Elementary School. Child Dev 2011; 83: 282–299. [DOI] [PubMed] [Google Scholar]
  • 87.Hong S, Dwyer D, Kim J, et al. Subthreshold attention-deficit/hyperactivity disorder is associated with functional impairments across domains: a comprehensive analysis in a large-scale community study. Eur Child Adolesc Psychiatry 2014; 23: 627–636. [DOI] [PubMed] [Google Scholar]
  • 88.Wilms HU, Kanowski S, Baltes MM Limitations in activities of daily living: Towards a better understanding of subthreshold mental disorders in old age. Compr Psychiatry 2000; 41: 19–25. [DOI] [PubMed] [Google Scholar]
  • 89.Jackson JL, Gerardo GM, Monti JD, et al. Executive Function and Internalizing Symptoms in Adolescents and Young Adults With Congenital Heart Disease: the Role of Coping. J Pediatr Psychol 2018; 43: 906–915. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Newman T, Blackburn S. Transitions in the Lives of Children and Young People: Resilience Factors. Scottish Executive Education Department, 2002. [Google Scholar]
  • 91.Cohen M, Mansoor D, Langut H, et al. Quality of life, depressed mood, and self-esteem in adolescents with heart disease. Psychosom Med 2007; 69: 313–318. [DOI] [PubMed] [Google Scholar]
  • 92.Mussatto KA, Sawin KJ, Schiffman R, et al. The importance of self-perceptions to psychosocial adjustment in adolescents with heart disease. J Pediatr Health Care 2014; 28: 251–261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Salzer-Muhar U, Herle M, Floquet P, et al. Self-concept in male and female adolescents with congenital heart disease. Clin Pediatr (Phila.) 2002; 41: 17–24. [DOI] [PubMed] [Google Scholar]
  • 94.Visconti KJ, Saudino KJ, Rappaport LA, et al. Influence of parental stress and social support on the behavioral adjustment of children with transposition of the great arteries. J Dev Behav Pediatr 2002; 23: 314–321. [DOI] [PubMed] [Google Scholar]
  • 95.Nabors LA, Kichler JC, Brassell A, et al. Factors related to caregiver state anxiety and coping with a child’s chronic illness. Fam Syst Health J Collab Fam Healthc 2013; 31: 171–180. [DOI] [PubMed] [Google Scholar]
  • 96.Howard Sharp KM, Willard VW, Okado Y, et al. Profiles of Connectedness: Processes of Resilience and Growth in Children With Cancer. J Pediatr Psychol 2015; 40: 904–913. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Traub F, Boynton-Jarrett R Modifiable Resilience Factors to Childhood Adversity for Clinical Pediatric Practice. Pediatrics 2017; 139: e20162569. [DOI] [PubMed] [Google Scholar]
  • 98.Sood E, Karpyn A, Demianczyk AC, et al. Mothers and Fathers Experience Stress of Congenital Heart Disease Differently: recommendations for Pediatric Critical Care. Pediatr Crit Care Med 2018; 19: 626–634. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Rolland JS, Walsh F Facilitating family resilience with childhood illness and disability. Curr Opin Pediatr 2006; 18: 527–538. [DOI] [PubMed] [Google Scholar]
  • 100.. Flores G, Committee On Pediatric Research Technical report–racial and ethnic disparities in the health and health care of children. Pediatrics 2010; 125: e979–e1020. [DOI] [PubMed] [Google Scholar]
  • 101.Manly JJ Advantages and disadvantages of separate norms for African Americans. Clin Neuropsychol 2005; 19: 270–275. [DOI] [PubMed] [Google Scholar]
  • 102.Norbury C, Sparks A Difference or disorder? Cultural issues in understanding neurodevelopmental disorders. Dev Psychol 2013; 49: 45–58. [DOI] [PubMed] [Google Scholar]
  • 103.Rosselli M, Ardila A The impact of culture and education on non-verbal neuropsychological measurements: a critical review. Brain Cogn 2003; 52: 326–333. [DOI] [PubMed] [Google Scholar]
  • 104.Mikesell L, Bromley E, Khodyakov D Ethical Community-Engaged Research: A Literature Review. Am J Public Health 2013; 103: e7–e14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Llorente A Hispanic Populations: Special Issues in Neuropsychology In Llorente A (ed) Principles of Neuropsychological Assessment With Hispanics. Springer, New York, 2008: 47–56. [Google Scholar]
  • 106.Byrd D, Arentoft A, Scheiner D, et al. State of multicultural neuropsychological assessment in children: current research issues. Neuropsychol Rev 2008; 18: 214–222. [DOI] [PubMed] [Google Scholar]
  • 107.Arevalo M, Heredia NI, Krasny S, et al. Mexican-American perspectives on participation in clinical trials: A qualitative study. Contemp Clin Trials Commun 2016; 4: 52–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Clark LT, Watkins L, Pina IL, et al. Increasing Diversity in Clinical Trials: overcoming Critical Barriers. Cur. Prob. Cardio. 2019; 44: 148–172. [DOI] [PubMed] [Google Scholar]
  • 109.Erves JC, Mayo-Gamble TL, Malin-Fair A, et al. Needs, Priorities, and Recommendations for Engaging Underrepresented Populations in Clinical Research: A Community Perspective. J Community Health 2017; 42: 472–480. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Haley SJ, Southwick LE, Parikh MS, et al. Barriers and Strategies for Recruitment of Racial and Ethnic Minorities: perspectives from Neurological Clinical Research Coordinators. J Racial Ethn Health Disparities 2017; 4: 1225–1236. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Loccoh EC, Yu S, Donohue J, et al. Prevalence and risk factors associated with non-attendance in neurodevelopmental follow-up clinic among infants with CHD. Cardiol Young 2018; 28: 554–560. [DOI] [PubMed] [Google Scholar]
  • 112.Rivera Mindt M, Arentoft A, Germano KK, et al. Neuropsychological, Cognitive, and Theoretical Considerations for Evaluation of Bilingual Individuals. Neuropsychol Rev 2008; 18: 255–268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Olson K, Jacobson K Cross-Cultural Considerations in Pediatric Neuropsychology: A Review and Call to Attention. Appl Neuropsychol Child 2015; 4: 166–177. [DOI] [PubMed] [Google Scholar]
  • 114.Shuttleworth-Edwards AB Generally representative is representative of none: commentary on the pitfalls of IQ test standardization in multicultural settings. Clin Neuropsychol 2016; 30: 975–998. [DOI] [PubMed] [Google Scholar]
  • 115.Rivera Mindt M, Byrd D, Saez P, et al. Increasing culturally competent neuropsychological services for ethnic minority populations: a call to action. Clin Neuropsychol 2019; 24: 429–453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116.Glymour MM, Weuve J, Chen JT Methodological Challenges in Causal Research on Racial and Ethnic Patterns of Cognitive Trajectories: measurement, Selection, and Bias. Neuropsychol Rev 2008; 18: 194–213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Pedraza O, Mungas D Measurement in Cross-Cultural Neuropsychology. Neuropsychol Rev 2008; 18: 184–193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.Ryan C Language Use in the United States, 2011: American Community Survey Reports. U. S. Census Bur. 16 (2013). [Google Scholar]
  • 119.Brickman AM, Cabo R, Manly JJ Ethical issues in cross-cultural neuropsychology. Appl Neuropsychol 2006; 13: 91–100. [DOI] [PubMed] [Google Scholar]
  • 120.Judd T, Capetillo D, Carrion-Baralt J, et al. Professional Considerations for Improving the Neuropsychological Evaluation of Hispanics: A National Academy of Neuropsychology Education Paper. Arch Clin Neuropsychol 2009; 24: 127–135. [DOI] [PubMed] [Google Scholar]
  • 121.Elbulok-Charcape M, Rabin L, Spadaccini A, et al. Trends in the neuropsychological assessment of ethnic/racial minorities: A survey of clinical neuropsychologists in the United States and Canada. Cultur Divers Ethnic Minor Psychol 2014; 20: 353–361. [DOI] [PubMed] [Google Scholar]
  • 122.Gaies M, Anderson J, Kipps A, et al. Cardiac Networks United: an integrated paediatric and congenital cardiovascular research and improvement network. Cardiol Young 2019; 29: 111–118. [DOI] [PubMed] [Google Scholar]

RESOURCES