Abstract
Background
Individuals on the autism spectrum commonly have differences from non-autistic people in expressing their emotions using communicative behaviors, such as facial expressions. However, it is not yet clear if this reduced expressivity stems from reduced physiological reactivity in emotional contexts or if individuals react internally, but do not show these reactions externally to others. We hypothesized that autism is characterized by a discordance between in-the-moment internal psychophysiological arousal and external communicative expressions of emotion.
Methods
Forty-one children on the autism spectrum and 39 non-autistic, typically developing (TD) children of two age groups (2–4 and 8–12 years) participated in a low-level stress task whilst wearing a wireless electrocardiogram. Children’s negative emotional expressions (facial, vocal, bodily) were coded following standardized protocols. Alexithymia traits were assessed using the Children’s Alexithymia Measure with school-aged children only. Data analyses involved ANOVAs, correlations, and sensitivity analyses.
Results
There were no group differences in physiological arousal (heart rate) or in communicative expressions of stress to the stress task. For TD preschoolers, physiological arousal during the stress task was associated with vocal expressions and for TD school-aged children, they were associated with facial and bodily expressions. By contrast, for children on the autism spectrum, physiological arousal during the stress tasks was not associated with communicative expressions across age groups.
Conclusions
Our findings suggest that children on the autism spectrum might experience emotional disconcordance, in that their physiological arousal does not align with their communicative expressions. Therefore, the internally experienced stress of children on the autism spectrum may be inadvertently missed by teachers and caregivers and, consequently, learning opportunities for teaching emotional communication and regulation may be also missed. Our results support the use of wearable biosensors to facilitate such interventions in children on the autism spectrum.
Supplementary Information
The online version contains supplementary material available at 10.1186/s11689-024-09567-4.
Keywords: Emotional concordance, Emotional coherence, Autism, Heart rate, Stress communication
The ability to communicate emotions is integral to healthy psycho-social development [101]. Beginning in infancy, children use communicative expressions to signal distress to parents, creating emotion-regulation learning opportunities whereby parents model and shape effective emotion communication and regulation [25, 70, 92, 109]. Children’s learning of appropriate ways to verbally and nonverbally express their negative emotions through interactions also facilitates the development of social relationships [35] and can prevent escalation to anxiety, aggression, or associated psychopathology [5, 10, 16, 44, 47, 62, 68, 70, 88]. Our use of the term “negative emotions” refers to the valence of emotions. Given the functional utility and importance of negative emotions [75], negative emotions were studied as they are critical for emotional well-being and psychological health [14, 76].
Children on the autism spectrum who are characterized by differences in social communication and interaction as well as restricted and repetitive behaviors and interests [1], exhibit difficulties expressing emotions using clear, unambiguous communicative behaviors (for review, see [71]). Individuals on the autism spectrum, relative to non-autistic, typically developing (TD) peers, may also present with an absence of or reduced emotional expression, such as decreased positive affect, or flat/neutral affect shown by facial expressions [46, 71, 94, 108]. We note however that autism is a complex, nuanced condition with much heterogeneity in autism symptom presentation, and not all individuals on the autism spectrum experience these symptoms [26, 71]. Reduced ability to express negative emotions, such as stress, using typical communication channels may contribute to emotion regulation difficulties downstream. Indeed, many children on the autism spectrum release tension in undesirable ways, for example, via challenging behaviors, such as aggression and self-injury [39, 59, 63, 65].
Communicative expression of emotions is just one of many components of an affective response. According to many models of affective responses, such as the biopsychosocial model of challenge and threat [8], an individual’s affective responses include multiple components (e.g., behaviors/expressions, subjective experiences/cognitive appraisals, and physiological reactivity). Physiological reactivity, such as brain activity, skin conductance, pupil dilation and heart rate, can indicate affective arousal. The advantage of heart rate measurement over other indices is that wearable heart rate devices can be used during everyday activities and reliably so during non-vigorous movement [69, 74, 104, 107]. Measured in beats per minute (BPM), heart rate has long been used as an index of affective arousal during emotional distress tasks, including in children on the autism spectrum, and will therefore be the index for physiological reactivity in this study [2, 9, 34, 100, 103]. Physiological measures are useful to record affective arousal during emotional distress tasks in children on the autism spectrum who have difficulties with emotional expression, complementing self-report and visual observation. Therefore, physiology may reveal moments of affective arousal not shown by other emotional channels in children on the autism spectrum [34, 65, 106].
Multiple studies have found that individuals on the autism spectrum, relative to TD controls, have decreased heart rate variability at baseline, supporting the idea that autism is associated with dysregulation of heart rate (e.g., [2, 34, 103]). Research assessing changes in heart rate from baseline during stress-inducing tasks has shows increased heart rate increases during low-level stress tasks in both TD and autistic individuals (e.g., [90, 103]), though studies show inconsistency in magnitude of this response in individuals on the autism spectrum relative to controls (for review, see [56]). Most studies used stress-inducing tasks that do not involve sensory (e.g., blood draw) or social stimuli (e.g., Trier Social Stress Test). There have been a limited number of studies that have employed psychosocial tasks such as the one used in the current study, the Transparent Box task (see Methods section for details), which mimics a real-life situation involving children waiting to play with toys. Studies that have used psychosocial tasks demonstrate similar physiological response to stress between TD and autistic individuals, with significant individual variability in the autism group [30, 32].
Emotional concordance: coordination between physiological and communicative reactivity
Emotional concordance, also referred to as emotional coherence or emotional congruence, is the coordination between behavioral expression, subjective experience, and physiological arousal [38]. The concept of emotional concordance emerged from traditional emotion theories (James-Lange, Cannon-Bard, and Schachter-Singer) from the notion that affective responses involve some level of coordination across these response systems [38, 51, 73]. Emotional concordance implies that physiological changes are accompanied by analogous communicative behavioral expressions and subjective experience. For example, the emotion of anger would include an increased heart rate (physiological response), furrowing of eyebrows (communicative behavior), and thoughts of fury toward another (subjective experience). Emotional discordance, in contrast, occurs when there is a lack of association between the three emotional response systems [38]. For example, discordance would occur if there were an increase in heart rate but no accompanying communicative or behavioral expression of anger. Rather than being the norm, Lang [51] argued that emotional concordance varies among individuals. Some studies show strong correlations between behavioral expression and subjective experience in TD individuals (i.e., r = 0.74), but only moderate correlations between behavioral expressions and physiological arousal (i.e., r = -0.52) [64]. However, evidence of concordance in the TD population remains limited and inconsistent [38, 52]. Early emotion theories and modern psychological constructionist hypothesis suggest appraisal or interoception of physiological arousal is needed prior to conscious feeling of emotion [3, 4, 53, 58, 87]. Moreover, conscious feeling may be a necessary precursor to intentional outward expression or communication of emotions to others as opposed to automatic bodily responses [11]. Therefore, studying emotional coherence in populations with compromised interoceptive awareness, such as those with alexithymia, is important to understanding the link between appraisal and emotional expression. Alexithymia refers to the inability in perception and verbalization of one’s emotions as well as externally-oriented thinking and is about 50% prevalent in individuals on the autism spectrum compared to about 5% in general population [50, 93]. Those with alexithymia commonly show difficulty detecting and regulating bodily processes. Therefore, more research is needed on emotional concordance, both in typical and atypical child populations.
Few studies have empirically examined emotional concordance in autism. Providing seminal evidence of emotional discordance in autism, Costa et al., [16] found that, relative to TD children, children on the autism spectrum presented with a greater mismatch between facial expression and bodily expression during distressing situations.Children on the autism spectrum have stronger traits of alexithymia [16, 31, 77, 86] found that alexithymia traits accounted for emotional discordance in their sample as well. Keith et al. [48] reported concordance between self-reported, but not parent-reported, anxiety and autonomic arousal in adolescents on the autism spectrum with at least 80 IQ based on Wechsler scale. An unanswered question, however, is whether there is emotional discordance in autism between internal physiological versus external communicative emotional reactions. While children on the autism spectrum exhibit typical physiological distress responses (e.g., [90, 103]), they have difficulties communicating emotions [46, 71]. This suggests reduced emotional concordance compared to TD children. However, research has yet to investigate this question.
The current study
The aim in the current study was to address these research gaps by investigating internal physiological and external communicative emotional concordance in TD children and children on the autism spectrum. Based on the literature, four hypotheses were developed regarding responses during a low-level stress task relative to a resting-state task:
Both groups will have increased physiological response (i.e., heart rate increase)
Relative to TD children, children on the autism spectrum will exhibit fewer communicative behaviors (i.e., facial, vocal, and bodily reactions of fear, sadness or anger)
Relative to TD children, children on the autism spectrum will have less emotional concordance between physiological and communicative reactivity
Alexithymia (assessed via parent report) will account for emotional discordance (i.e., less emotional concordance) in the children on the autism spectrum
Methods
Participants
Children were recruited across two age groups for this study: preschoolers (2–4 years) and school-aged children (8–12 years). The preschooler sample included 20 children on the autism spectrum and 20 typically developing children, and the school-age sample included 21 children on the autism spectrum and 19 typically developing children. The chosen age groups were selected to investigate emotional concordance in both preschoolers and school-aged children, as previous research primarily investigated emotional concordance in individuals on the autism spectrum has been conducted on adolescents and adults [24, 48, 72]. Importantly, neurotypical adolescents and adults can be quite adept at managing their emotions by masking their emotional expressions [81, 84], and this allowed us to explore emotional concordance without the cofounding factor of emotional masking behaviors. The groups were separated to determine developmental changes in emotional expressions and to ensure appropriate use of the Children’s Alexithymia Measure, which is validated only for use with children who are in our school-aged children group. All children were recruited as part of larger studies (see Procedures). Given the novelty of the methods applied to children on the autism spectrum, sample size was based on recruitment rather than a formal power analysis. Therefore, the study was underpowered (based on the observed minimum effect size in this study, 50 participants per group would have been needed). Diagnoses of autism were confirmed with the Autism Diagnostic Observation Schedule, second edition (ADOS-2; [54]). ADOS-2 calibrated Comparison Scores (CS) are provided (see Table 1) on a 10-point scale with scores anchored to ADOS-2 classifications, based on the raw overall scores, module used, and age of the child. Severity scores are provided by the publisher for Modules 1–3 [54]. For the preschool sample, CS for the toddler module were based on algorithms provided by Esler et al. ([21],see also [37]). Five children recruited into the autism group scored below threshold, and two children recruited into the TD group scored above threshold on the ADOS,all were excluded from the analyses (not included in the total participants reported above).
Table 1.
TD | ASD | Comparison | |
---|---|---|---|
Preschool | |||
Age: M (SD) | 3.25 (0.85) | 3.46 (0.54) | p = .35 |
Sex (M:F) | 17:3 | 13:7 | p = .27 |
IQ (MSEL) | 110.05 (17.35) | 80.25 (26.18) | p < .001* |
Autism severity (ADOS) | - | 6.85 (2.62) | - |
School-age | |||
Age: M (SD) | 10.00 (1.29) | 9.67 (1.39) | p = .44 |
Sex (M:F) | 13:6 | 18:4 | p = .47 |
IQ (SB) | 104.11 (11.67) | 89.90 (20.54) | p = .01* |
Autism severity (ADOS) | 1.26 (0.65) | 6.95 (2.21) | p < .001* |
Alexithymia (CAM) | 5.63 (7.28) | 15.09 (8.79) | p < .001* |
ADOS Autism Diagnostic Observation Schedule Comparison Score, CAM Children’s Alexithymia Measure Total Score, MSEL Mullen Scales of Early Learning Standard Score, SB Stanford Binet Abbreviated Battery IQ Standard Score
For the preschool age sample, a developmental quotient (DQ) was obtained using the Mullen Scales of Early Learning [66], and for the school-age sample, IQ was assessed through the Stanford-Binet Intelligence Test from Stanford-Binet Intelligence Scales, Fifth Edition [80] Abbreviated Battery IQ scales (ABIQ). For the school-age sample, two children recruited into the TD group that had below average (< 85) IQs were excluded in the analysis so that typical emotional concordance could be examined (not included in the total participants reported above). Following the recommendations of Dykens and Lense [18], children on the autism spectrum with below average (< 85) DQ or IQ were retained in the sample due to the high prevalence of cognitive and language delays/impairments in autism. Both the preschooler and school-age samples included children on the autism spectrum with a wide range of standard score [45], with 50% and 16%, respectively, with standard score < 70, 10% and 16%, respectively, with standard score 70–84, and 40% and 68%, respectively, with standard score ≥ 85. The IQ ranges for each sub-group were as follows: preschool TD: 85–132, preschool autism: 32–120, school-age TD: 85–121, school-age autism: 47–121. The diagnostic groups (autism, TD) within each age group were matched on age and sex. See Table 1 for participant characteristics and group comparison statistics.
Experimental tasks
Low-level stress task
We used the Transparent Box task from the Preschool and Middle Childhood versions of the Laboratory Temperament Assessment Battery (Lab-TAB; [28, 29]) as a low-level stress task as it was designed to induce frustration and mild distress in children. The child is given a transparent box filled with attractive toys that the child cannot access for a period of time. In the preschool version, the child is asked to choose which toy (of two) he/she would like to play with, is given a container with the toy inside and then the experimenter leaves the room. Toys are in a transparent container, which children this age cannot open (wide cylinder container shut with screw on lid closed extra tight). In the middle childhood version, the child is given a transparent box of attractive toys and the wrong set of keys, and then the experimenter leaves the room. After a set amount of time (2 min for the preschool version, 4 min for the school-age version), the experimenter apologizes (for not opening the container for preschoolers, for the “mix-up” with the keys for the older children) and either opens the container for the child or shows them how to do it themselves. If the child somehow opened the container beforehand, the task is finished (three preschool children and one school-aged child opened the container before the task was over and were excluded from the study (and not counted in Table 1)). As a positive resolution to the task, the experimenter joins in play with the child with the attractive toys or lets him/her play alone if preferred. Lab-TAB tasks have been validated as effective in inducing negative emotions in children (e.g., [57, 67, 70]).
Resting state period
To establish a baseline heart rate for each child, data were collected during a resting state period, when the child was calm (i.e., no negative emotion or high intensity positive emotion), not moving too much (three-coordinate accelerometer and video data were reviewed and data streams were referenced to ensure data did not have movement artifacts) and not interacting with others. In the preschool sample, for 35 children this was during watching a relaxing, developmentally appropriate video (the last 3 min of Sweet Dreams Spot [15]), for five children (all children on the autism spectrum), this was when they were engaged in free play while sitting. The heart rate during resting periods of the five preschoolers on the autism spectrum that were captured during free play while sitting were no different from the heart rate during resting periods of the 15 preschoolers on the autism spectrum that were captured during the relaxing video (t(18) = -0.52, p = 0.61). A 3-min resting state period was selected given the age of children, and used previously as an alternative to 5-min epochs in younger samples [15]. For the school-age sample, the resting state period was while children watched a relaxing video on a computer that was originally designed for fMRI resting-state (Inscapes,[102]). All school-aged children’s baselines were measured during this video, with the first 5 min of the video used as the baseline period.
Physiological data
Heart rate devices
In the preschooler study, children wore vests with sewn-in pockets to house the Biopac BioNomadix ECG and accelerometer module transmitters. ECG electrodes which connected to the transmitters were placed on children’s back (instead of chest) to avoid children pulling at them (e.g., [68]). Transmitters connected wirelessly to the Biopac MP150 receiver, allowing children free movement around the testing room. This system sampled at 1 kHz and no sampling filters were used during recording.
In the school-age study, children wore five consumer-grade devices that recorded physiological responses throughout the tasks, as part of a larger study on wearable devices. For the purposes of the current study, data collected from the Polar H7 ECG chest strap, and if not available, from the Mio Fuse photoplethysmography wristband, were used for analysis, as we and others have found these devices to be valid and reliable devices compared to traditional wired ECG [69, 74, 104, 107]. Data were collected from the Polar H7 if the device had collected at least 80% of the data for the task, otherwise the Mio Fuse was used. The Polar H7 was used for 75% of the participants. This system sampled at 1 kHz and proprietary sampling filtering algorithms embedded in the devices’ microcontrollers, which detect when heartbeats occur, broadcasted directly via Bluetooth Low Energy the inter-beat intervals to the recording computer.
Heart rate event marking, cleaning and extraction
For the preschool sample, offline event marking was used whereby, first, the timing of the low-level stress task and resting state periods were labelled on the software using the synced video stream. ECG data were processed in Biopac AcqKnowledge version 4.4.2. Second, a band-pass (Finite Impulse Response) filter was applied to de-noise the ECG signal, with low frequency fixed at 1 Hz and high frequency at 35 Hz (e.g., [49, 82]). Third, QRS complexes were labelled and visually inspected for artifacts in the marked data sections [99]. In patches of data artifacts, due to movement (accelerometer data were referenced), data were either linearly interpolated in-between R peaks and/or R signals were amplified, so that extracted data metrics were unaffected by artifacts (Task Force of the ESC and [99]). We binned analyses into 30-s epochs, and if more than 5 secs needed to be interpolated, that epoch was excluded from the analyses. Based on these criteria, 7 rest epochs and 5 stress epochs of 5 autism participants were deleted. In both groups, the total amount of data interpolated was similar across the rest (TD: M = 3.85 secs, SD = 4.20 secs; autism: M = 8.64 secs, SD = 9.71 secs) and stress (TD: M = 3.59 secs, SD = 2.81 secs; autism: M = 8.19 secs, SD = 8.40 secs) conditions. For the school-age sample, live event marking was used whereby research assistants watching the session live from a clinical observation room marked the start and end of the low-level stress task and resting state periods on custom-built software created for the project (as described in [61]). The heart rate data collected by the wearable devices were inputted into Kubios HRV software [98]. On Kubios software, if an RR (time in between heart-beat) interval deviates from a median-filtered local average by more than a specific threshold (very low: 0.45 s to very strong: 0.05 s), it is marked for corrections (https://www.kubios.com/blog/preprocessing-of-hrv-data/). A strong threshold filter (0.15 s) was used to correct for artifacts as it was the lowest possible correlation level that effectively corrects abnormal beats without causing overcorrection. For all children, mean heart rate and peak heart rate were extracted from the software for the low-level stress task and resting state periods.
Communicative expressions behavioral coding
A behavioral coding manual was created based on the codes provided in the respective Lab-TAB manuals and the AFFEX Facial Expression Reference Chart [29, 42]. Codes included negative facial and bodily reactions matched to fear, sadness, or anger (a composite of the three emotions comprised the final codes), and negative vocalizations matched to levels of distress. For each, codes ranged from 0 = no expression to 3 = extreme expression, and further specification was given for each communication channel. Facial expression codes referenced to specific facial muscle movements as per the AFFEX Facial Expression Reference Chart, whereby a code of 1 = one facial area involved, 2 = two facial areas involved and 3 = three facial areas involved.
Vocal expression codes differed by intensity (1 = mild, 2 = moderate, 3 = extreme), and coders calibrated to the lead coder on these levels during coding training. Given the wide range of verbal abilities in children on the autism spectrum, ranging from minimally verbal to typically fluent children, vocal codes incorporated sounds (e.g., whines), affective prosody (i.e., pitch, loudness, timbre, speech rate, and pauses), as well as words or content (i.e., meaning of words indicating distress).
Bodily expression codes referenced specific behaviors, for instance with anger: 1 = slight bodily tensing or mild frustration behavior (e.g., sighing with frustration, placing hand/arm on table with more force than necessary); 2 = moderate bodily tensing (e.g., balling the fists) or moderate frustration behavior (e.g., pushing away from the table, sighing heavily, pushing the box away, slamming hand/arm on table with definite intention); 3 = high bodily tensing (e.g., trembling) or high frustration behavior (e.g., throwing the container or keys). The full coding protocol and calibration procedure are available on request.
For both samples, coders blind to diagnostic group and study hypotheses coded behaviors, after group training on the codes and achieving inter-rater reliability (IRR) of 80% or higher on three consecutive training videos with the lead coder. The lead coder also double-coded a minimum of 20% of each coder’s videos (Preschooler sample: IRR M = 0.81, SD = 0.05, Range = 0.71–0.89; School-age sample: IRR M = 0.86, SD = 0.07, Range = 0.78–1.00) to check ongoing reliability maintenance. Any ambiguous child behaviors were discussed in order to reach a consensus. For the preschooler sample, manual coding sheets were used. For the school-age sample, coders used the Behavioral Observation Research Interactive Software (BORIS) to code behaviors [22].
Alexithymia
In order to examine alexithymia traits in the children, we used the Children’s Alexithymia Measure (CAM; [105]), a parent/caregiver report measure that measures alexithymia as a unidimensional factor (difficulties expressing feelings). It is appropriate for children aged 5–17 and was therefore only used with the older school-age sample. As no reliable measures of alexithymia are available for preschool age children, no alexithymia measure was used in the younger sample. The CAM produces a total score, with higher scores indicating higher alexithymia traits. The internal consistency for each diagnostic group was moderate to high in this sample (autism: Cronbach’s α = 0.92; TD: Cronbach’s α = 0.68).
Procedure
Testing was completed at the Olga Tennison Autism Research Center, La Trobe University for the preschool sample, and at the Center for Autism Research, Children’s Hospital of Philadelphia for the school-age sample following common procedures. For both sites, after review of study procedures including reviewing a picture book of tasks included in the study, parents provided their informed consent to participate in the study. For those able, child participants in the school-age sample were invited to give assent to participate. Consent/assent was obtained according to the Declaration of Helsinki (BMJ 1991; 302: 1194). Parents were asked to assist with putting on the devices to record physiological response and were then provided with a laptop or seated at a computer to complete the study questionnaires during the session. The research was approved by the La Trobe University Human Ethics Committee for the preschool sample and the University of Pennsylvania and Children’s Hospital of Philadelphia for the school-age sample.
Data analysis
Data were first analyzed for outliers and normality. As heart rate variables in both samples and communication variables in the school-age sample were non-normally distributed, these variables were log-transformed. As the groups differed on cognitive ability (DQ/IQ), zero-order correlations between cognitive ability and the variables of interest were explored. No variables were significantly associated with cognitive ability in any diagnostic or age group (autism preschool p range = 0.15—0.99; TD preschool p range = 0.26—0.69; autism school-age p range = 0.16—0.94; TD school-age p range = 0.31—0.84), so cognitive ability was not controlled for in subsequent analyses. See Supplementary Table 1 and Table 2 for all zero-order correlations examined for association with cognitive ability for the preschool group and the school-age group, respectively. To test Hypothesis 1 (that groups have comparable physiological stress responses), four 2-way (group [autism, TD] × task [rest, stress]) repeated measures ANOVAs were conducted; one on mean BPM and another on peak BPM during the task, relative to mean BPM at rest, for each child sample. To test Hypothesis 2 (that the autism group would express fewer communicative behaviors than the TD group), two 2-way (group [autism, TD] × communication channel [facial, vocal, bodily]) repeated measures ANOVAs were conducted, one for each child sample. Post-hoc pairwise comparisons were conducted.
The main hypothesis, Hypothesis 3 (that TD children, but not children on the autism spectrum, will show emotional concordance) was tested with two sets of analyses. First, we conducted machine learning Maximal Information Coefficient analyses [78] to determine the probability of bivariate associations. Maximal Information Coefficient analyses offer an advantage over standard inferential statistics/hypothesis testing when sample sizes are very small because they are unconstrained by linear associations and are thus more equipped to capture the nuances of complex data [40, 79, 97]. However, Maximal Information Coefficients do not show directionality and are not subject to a significance level. Second, therefore, to confirm these findings, as sensitivity analyses, we also conducted follow-up partial Pearson’s correlations run between communicative expressions (facial, vocal, bodily) and heart rate (mean and peak BPM) during the stress task, controlling for heart rate (mean BPM) at rest, to examine if variation in analytic practice affected results [36]. A False Discovery Rate correction [7] was applied to the results to control for multiple testing. As PPG-based heart rate data and ECG-based heart rate data may not be equivalent, to test if results were affected by incorporation of PPG as well as ECG data in the school-age group, we conducted partial correlation sensitivity analyses excluding PPG data (with data from 3 TD children and 3 children on the autism spectrum excluded).
To test Hypothesis 4 (that alexithymia accounts for emotional discordance in autism), partial correlations were run for the school-aged sample between alexithymia (CAM total score) and computed heart rate (mean and peak BPM) during the stress task × communicative expressions (facial, vocal, bodily) interaction terms, controlling for heart rate (mean BPM) at rest. As additional sensitivity analyses to examine consistency of findings, throughout each of the above analyses we present both mean and peak BPM during the stress task relative to mean BPM at rest as the decision to use one or the other may have affected results and therefore interpretation [96]. All statistical analyses including ANOVA, correlations, and sensitivity were completed in SPSS.
Results
The mean age of preschool TD group and the autism group were 3.25 ± 0.85 and 3.46 ± 0.54. The mean IQ were 110.05 ± 17.35 and 80.25 ± 26.18 for preschool TD group and the autism group respectively. The mean age of school-age TD group and the autism group were 10.00 ± 1.29 and 9.67 ± 1.39. The mean IQ were 104.11 ± 11.67 and 89.90 ± 20.54 for school-age TD group and the autism group respectively. For preschool autism group, the autism severity score was 6.85 ± 2.62. For school-age autism group, the autism severity score was 6.95 ± 2.21. Full participant characteristics are shown in Table 1.
For Hypotheses 1 and 2, eta-squared (η2) effect sizes are provided for each ANOVA main and interaction effect reported below. For the purposes of the study, we followed Cohen’s [13] guidelines for interpreting effect sizes, whereby 0.01 = small, 0.06 = medium and 0.14 = a large effect. For Hypotheses 3 and 4, Pearson correlation coefficients are provided, whereby 0.10 = small, 0.30 = medium and 0.50 = a large effect [13].
Hypothesis 1: physiological reactivity
We first checked for any difference in resting state heart rate; no diagnostic group differences were found for either the preschool, t(38) = -1.10, p = 0.28, or the school-age group, t(38) = -1.23, p = 0.23. Regarding physiological responses to the stress task, for preschoolers and school-aged children, heart rate (BPM) was higher in the task compared to resting state such that there was a significant main effect of Task for mean BPM, F(1,38) = 19.24, p < 0.001, η2 = 0.35 and F(1,38) = 55.29, p < 0.001, η2 = 0.59, respectively, and peak BPM, F(1,38) = 145.45, p < 0.001, η2 = 0.80 and F(1,38) = 108.18, p < 0.001, η2 = 0.74, respectively. The main effect of group was not significant at either age or heart rate variable (preschool mean: F(1,38) = 0.13, p = 0.72, η2 = 0.004; preschool peak: F(1,38) = 0.56, p = 0.46, η2 = 0.02; school-age mean: F(1,38) = 1.92, p = 0.17, η2 = 0.05; school-age peak: F(1,38) = 0.92, p = 0.34, η2 = 0.02). For the preschool group, there was a marginally significant task × group interaction effect for mean BPM, F(1,38) = 3.92, p = 0.055, η2 = 0.10. Pairwise comparisons showed that the difference between mean BPM in the rest and stress tasks was significant and large in the TD group, p < 0.001, and marginal in the autism group, p = 0.096. The task × group interaction effect for preschool peak BPM (F(1,38) = 1.14, p = 0.29, η2 = 0.03), school-age mean BPM (F(1,38) < 0.001, p = 0.99, η2 < 0.001), and school-age peak BPM (F(1,38) = 0.51, p = 0.48, η2 = 0.01) were all non-significant. Means are displayed in Fig. 1a.
Hypothesis 2: communicative reactivity
For preschool aged children, the main effect of Communication channel was significant, F(2,38) = 10.70, p < 0.001, η2 = 0.37, with no main effect of Group (F(1,38) = 0.03, p = 0.87, η2 = 0.001) or interaction effect (F(2,37) = 1.40, p = 0.26, η2 = 0.07). Pairwise comparisons showed that facial and vocal reactions were higher than bodily reactions during the stress task, p = 0.02, and p < 0.001, respectively, with no differences between facial and vocal reactions, p = 0.36. For school-aged children, there were no Group (F(2,37) = 0.51, p = 0.48, η2 = 0.01), Communication channel (F(2,37) = 0.86, p = 0.43, η2 = 0.04) or interaction effects (F(2,37) = 0.68, p = 0.51, η2 = 0.04). Means are displayed in Fig. 1b.
Hypothesis 3: emotional concordance
The Maximal Information Coefficients findings are presented in Fig. 2. For preschoolers in the TD group but not the autism group there were associations between physiological and vocal reactivity. For school-aged children, by contrast, in the autism group, there were associations of physiological reactivity with all types of reactivity (vocal, facial and bodily), and in the TD group, there were associations of physiological with facial and bodily reactivity.
Follow-up Pearson’s correlation analyses shown in Table 2. These findings confirm the Maximal Information Coefficients findings in that in the preschool group, emotion concordance with vocal expressions was identified in TD but no emotional concordance was identified in autism. In the school-aged sample, findings in TD are also consistent with the previous analyses (although Maximal Information Coefficients findings more specifically suggest this finding is driven by peak, and not mean heart rate). Findings of the school-aged children in the autism group here specify that emotion concordance is with vocal expressions (here, associations with facial and bodily reactivity were not positive or did not approach significance). However, after applying the False Discovery Rate correction [7], the association between physiological and vocal reactivity in the school-age autism group no longer was significant. In the sensitivity analysis excluding PPG data from the school-age group, the pattern of findings was identical (see Supplementary Table 3). We also include raw analyses without any interpolation for comparison (Supplementary Table 4).
Table 2.
Preschoolers | School-Aged Children | |||||||
---|---|---|---|---|---|---|---|---|
TD | ASD | TD | ASD | |||||
Heart Rate (BPM) | Heart Rate (BPM) | |||||||
M | Peak | M | Peak | M | Peak | M | Peak | |
Vocal | .48* | .37# | -.30 | .22 | .10 | -.03 | .28 | .32# |
Facial | .10 | .14 | -.19 | .27 | .43* | .53* | -.26 | -.15 |
Bodily | -.08 | -.11 | -.11 | .06 | .35# | .58** | .23 | .26 |
All correlations are partial, controlling for baseline physiology. # p < .10, * p < .05, ** p < .01. Findings that remain significant at p < .05 after False Discovery Rate correction applied [7] are underlined
Hypothesis 4: alexithymia
For the school-aged children on the autism spectrum, alexithymia traits were related to the physiological and facial reactivity interaction term, whereas for the school-aged TD children, alexithymia traits were associated with the physiological and vocal reactivity interaction term and the physiological and bodily reactivity interaction term. Correlation coefficients are displayed in Supplementary Table 5.
Discussion
In this study, we aimed to examine emotional concordance in TD children and children on the autism spectrum and its association with alexithymia. We found that preschoolers on the autism spectrum had no alignment between physiological and communicative reactions (i.e., they showed a pattern of emotional discordance). In the school-aged children on the autism spectrum, there was only marginal evidence of emotional concordance, which was similar to that found in younger (preschool-aged) TD children (emotional concordance with vocal reactivity). However, after correcting for multiple testing, this finding was no longer significant; confirmation is thus needed in a follow-up study. Together, these findings suggest that children on the autism spectrum appear to have disrupted and possibly delayed emotional concordance, potentially due to general impairments these children experience in using communicative behaviors like facial expression to convey their emotions to others [6, 65, 70, 71].
In line with these findings, we found that emotional concordance in autism was marginally related to alexithymia traits. This latter finding fits with the known challenges individuals on the autism spectrum have in perceiving their own emotions (e.g., [77]), and difficulties in physiological awareness or interoception [17, 24]. Indeed, interoception accuracy has been found to be associated with alexithymia in a study on adults on the autism spectrum [89]. Together these findings suggest that awareness of physiological responses may be key to emotional coherence, and that difficulties in this area underlie reduced emotional coherence in autism. Our findings suggest alexithymia and emotional expressions are associated and extend Schachter and Singer’s [87] seminal work on the relation between emotional appraisal of physiological arousal and conscious feeling. However, all findings with alexithymia were marginal and were not retained after applying the correction for multiple testing,therefore, further research is needed to verify any associations between alexithymia and emotional discordance in autism and to examine conscious feeling as a mediator between emotional appraisal of physiological arousal and emotional expression. Also, given that alexithymia measures have not yet been adapted for younger children, alexithymia was only investigated in half of the sample (the school-aged group), and should be followed up with a larger sample.
The findings are consistent with the idea that typically developing children first develop emotional concordance with vocal expressions, prior to facial and bodily expressions. These findings mirror the developmental sequelae of emotional expressivity throughout the first years of life whereby newborn infants first reactively express stress with crying before engaging the appropriate facial and bodily musculature to express emotions via those channels (e.g., [60]). Throughout early childhood, there is also the shift from automatic, non-cognitively mediated reactions to controlled, cognitively mediated reactions and, across all expression channels, children learn via their social experiences more effective ways to communicate their emotions to others [19, 41]. Although our findings are consistent with the idea of sequential development from vocal to facial and bodily reactions, we acknowledge that our coding system did not pinpoint differing levels of mastery within each expression channel; for instance, our coding system was not designed to differentiate a frustrated grunt from a full syntactical sentence of frustration layered with sarcasm, on anything other than emotional intensity. Therefore, further research is needed to further explore the developmental trajectory of the channels of physiological and communicative emotional concordance in TD children.
Children on the autism spectrum did not differ in their physiological responses to the stress relative to the rest task compared to their TD peers, which is consistent with some reports but not others (for review, see [56]). Contrary to expectations, children on the autism spectrum did not show fewer behaviors overall to express their stress, but rather these were not aligned with their physiological reactions in the way they were in the TD children. This finding suggests that the tendency of children on the autism spectrum to not communicate emotions clearly may specifically be related to expressing internal physiological arousal or stress.
The findings are supportive of a disconnect between internal physiological emotional reactions and external communicative reactions in preschool children on the autism spectrum, such that when children on the autism spectrum are stressed, they do not communicate this in the same way behaviorally as do TD children. This is particularly problematic for the development of emotion regulation, which is socialized throughout development via parental responsiveness to subtle distress cues from their children [19, 20]. Children on the autism spectrum may not be expressing these states to parents and, concomitantly, parents miss opportunities to teach their child strategies for regulating their emotion. Because children’s distress remains unchecked and unregulated, their distress then escalates and culminates in challenging behaviors such as aggression and self-injury (30, 68), setting off a maladaptive distress/expression cycle that is much harder for children and parents to navigate.
The current study does not address the issue of an emotional concordance between physiological reactions and subjective experiences of negative emotion; therefore, it is quite possible that children were aware and cognizant of their emotional states, even if they did not use communication behaviors to express these outwardly to others. Indeed, Keith, Jamieson and Bennettoa [48] found a significant association between self-reported anxiety and autonomic arousal in high-functioning adolescents on the autism spectrum. Interestingly, this association was not found with parent-report of their child’s anxiety, further suggesting that from the outsider’s perspective, individuals on the autism spectrum have impairments in externally expressing their internally experienced stress.
There are practical and therapeutic implications of this study. In a school setting, there can be a buildup of negative emotions internally without communication of distress which can be particularly problematic [83]. Not effectively communicating negative emotion can manifest as aggression, hyperactivity, anxiety, or social isolation [39, 63, 70], and can inhibit academic and social success [35]. Therefore, interventions that target emotional communication and regulation via physiological monitoring particularly noticing mild or rising levels of stress in children on the autism spectrum may be useful. Our previous research suggests that select wearable heart rate trackers are a feasible, valid and reliable means to measure stress in children on the autism spectrum [69]. The recent advances in wearable physiological devices such as wrist-band or chest-strap heart rate trackers present a role for the incorporation of such devices to provide important in-the-moment clinical decision support to caregivers, therapists and teachers. They would be able to monitor real-time physiological stress or arousal of children with ASD in multiple settings. Caregivers, therapists, and teachers may predict challenging behaviors in children on the autism spectrum based on the physiologic data and decide on whether an intervention is needed to de-escalate arousal. This has the potential to be particularly impactful with minimally verbal children on the autism spectrum as it opens up a channel of emotional communication which may not be available otherwise. For more verbally fluent children on the autism spectrum, this technology could help to create learning opportunities in that children may be prompted at times of physiological stress to use their words to communicate their emotions. However, the field of digital health is still emerging and the efficacy of heart rate monitoring for supporting interventions has been yet to be demonstrated empirically. Additionally, given the emotional discordance seen in children on the autism spectrum across age groups in the current study, it will be important to provide psychoeducation to caregivers, therapists and teachers about the potential mismatch between the internal states of children on the autism spectrum and the ways in which they outwardly express their emotions.
Lastly, this study represents another example in which knowledge from autism science can inform affective science/emotion literatures, just as affective science/emotion literatures has informed autism science. For example, data from children on the autism spectrum has helped to elucidate the distinction between cognitive and affective empathy (such that children on the autism spectrum often present with affective but not cognitive empathy; [27]), and knowledge on emotion regulation processes and strategies (e.g., reappraisal vs. suppression; [33]) has informed research on emotion regulation in autism (e.g., [85]). The current study highlights emotional disconcordance seen in children on the autism spectrum and the need to recognize early on that some may not actively communicate physiological distress.
Limitations
First, whilst the inclusion of an age-matched TD group afforded an understanding of normative emotional concordance in the children, the TD and autism groups were unmatched on cognitive ability. Thus, inclusion of a third group of children matched with the autism group on DQ/IQ would have been ideal, although, as indicated, cognitive ability was not associated with the variables of interest in this study. Second, alexithymia was measured in the school-aged children but not in preschoolers, limiting our understanding of the interaction between alexithymia and emotional concordance in younger children. However, to our knowledge, validated measures of alexithymia are currently unavailable for this age group. Indeed, the alexithymia results should be read with caution as measurement of internal processes by external reporters, such as parents, is inherently limited. Third, as preschoolers aged 2–4 years and school-aged children aged 8–12 years participated in the study, we cannot describe emotional concordance in children aged 5–7 years. Future research should aim to incorporate this age group so that we may better chart the development of emotional concordance. Fourth, the emotions of anger, fear, and sadness were grouped as distress. Although these three emotions share characteristics in physiological reactivity and are all emotions of negative affect, they may invoke varying behavioral expressions. Valuable information may have been lost as a result of this grouping, particularly if the task invoked distinct emotions among the two groups; therefore, emotional concordance for specific negative emotions should be studied in further research. Fifth, given the context of the larger school-age study of wearable heart rate trackers, our measure of physiological arousal (heart rate) was not valence-specific or specific to the sympathetic nervous system that is most implicated in stress responses. However, we argue that some insight on affective arousal is still possible with this measure and can, thus, inform the field given the few studies to date that have focused on this topic. Sixth, as this study combined data across two projects, the heart rate data collection and analysis systems were different, and this may have introduced error in the comparisons across age groups. However, previous research has found good reliability and accuracy of wearable PPG and ECG devices for measuring basic indices of cardiac function, like beats per minute, as compared to wired ECG [12, 23, 43, 55, 74, 91, 95, 104, 107], as have we with the devices used in this study [69]. Nevertheless, future research should aim to compare across age groups with the same physiological systems. Lastly, the study was underpowered to find significant group differences in some analyses reported above, hence we urge readers to consider the effect sizes reported herein.
Conclusions
The study findings are suggestive of emotional discordance in preschool children on the autism spectrum. These findings support the use of wearable sensors which may be useful to facilitate the development of emotional communication and regulation in preschool children on the autism spectrum.
Supplementary Information
Acknowledgements
First and foremost, the authors would like to thank the families who took part in this study. We would also like to acknowledge the hard work and dedication of all the students who worked on the testing, behavioral coding, data entry and physiological data processing aspects of the project (in alphabetical order): Rachel Aboodi, Erin Battersby, Luke Bolt, Daniela Calafiore, Lacey Chetcuti, Elizabeth Daniels, Siobhan Ede, Samantha Galea, Ellen Hall, Ilona Jileaeva, Siobhan Korbut, Alice Maier, Jacqueline Maya, Natalie Mizzi, Devin Murphy, Samantha Murphy, Anushka Phal, Meredith Pinheiro, Imogen Redden, Ensu Sahin, William Schmeling, Danielle Smith, Yvonne Tran, Jessica Tsoutsoulis, Pinar Uluer and Jennifer Vong. We thank the funders, without their support this study would have not been possible (Pierce Armstrong Foundation, La Trobe University, Veski Victoria Fellowships, McMorris Family Foundation, Foerderer Grants for Excellence, CHOP Research Institute, and National Institutes of Mental Health [K01MH120509]).
Abbreviations
- ADOS-2
Autism Diagnostic Observation Schedule, second edition
- BPM
Beats per minute
- CS
Comparison scores
- DQ
Developmental quotient
- fMRI
Functional magnetic resonance imaging
- IRR
Inter-rater reliability
- Lab-TAB
Laboratory Temperament Assessment Battery
- TD
Typically developing
Authors’ contributions
Conceptualization, HN, JH and EF. Methodology, HN, DH, JH and EF. Validation, HN, JH, YK, AM and XP. Formal analysis, HN, JH, EF, LT, AM and XP. Investigation, HN, DH, EF and AB. Resources, HN, JH, CD, JP and AM. Data Curation, HN, EF, LT, PT, NP and JT. Writing—Original Draft, HN, EF, LT, JH, DH, and CD. Writing—Review & Editing, HN, ES, MS, EF, LT, JH, DH, and CD. Visualization, HN, ES and MS. Supervision, HN and JH. Project administration, HN. Funding acquisition, HN, JH, CB and JP. The authors read and approved the final manuscript.
Funding
Pierce Armstrong Foundation, La Trobe University, Veski Victoria Fellowships, McMorris Family Foundation, Foerderer Grants for Excellence, CHOP Research Institute, and National Institute of Mental Health (K01MH120509).
Availability of data and materials
Data analyzed during this study are included in this published article and its supplementary information files. Full data will be available on ResearchGate.
Declarations
Ethics approval and consent to participate
Consent/assent was obtained according to the Declaration of Helsinki (BMJ 1991; 302: 1194). The research was approved by the La Trobe University Human Ethics Committee for the preschool sample and the University of Pennsylvania and Children’s Hospital of Philadelphia for the school-age sample.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.American Psychiatric Association, DSMTF, American Psychiatric Association DS. Diagnostic and statistical manual of mental disorders: DSM-5 (Vol. 5, No. 5). Washington, DC: American psychiatric association; 2013.
- 2.Bal E, Harden E, Lamb D, Van Hecke AV, Denver JW, Porges SW. Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state. J Autism Dev Disord. 2010;40(3):358–70. 10.1007/s10803-009-0884-3. 10.1007/s10803-009-0884-3 [DOI] [PubMed] [Google Scholar]
- 3.Barrett LF. Solving the emotion paradox: Categorization and the experience of emotion. Pers Soc Psychol Rev. 2006;10(1):20–46. 10.1207/s15327957pspr1001_2 [DOI] [PubMed] [Google Scholar]
- 4.Barrett LF, Russell JA. An introduction to psychological construction. In: Barrett LF, Russell JA, editors. The psychological construction of emotion. New York: The Guilford Press; 2015. p. 1–17. [Google Scholar]
- 5.Beauchaine TP, Gatzke-Kopp L, Mead HK. Polyvagal Theory and Developmental Psychopathology: Emotion Dysregulation and Conduct Problems from Preschool to Adolescence. Biol Psychol. 2007;74(2):174–84. 10.1016/j.biopsycho.2005.08.008. 10.1016/j.biopsycho.2005.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Begeer S, Koot H, Rieffe C, Meerumterwogt M, Stegge H. Emotional competence in children with autism: Diagnostic criteria and empirical evidence. Dev Rev. 2008;28(3):342–69. 10.1016/j.dr.2007.09.001. 10.1016/j.dr.2007.09.001 [DOI] [Google Scholar]
- 7.Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc. 1995;57(1):289–300. 10.1111/j.2517-6161.1995.tb02031.x. 10.1111/j.2517-6161.1995.tb02031.x [DOI] [Google Scholar]
- 8.Blascovich J, Tomaka J. The biopsychosocial model of arousal regulation. Adv Exp Soc Psychol. 1996;28:1–51. 10.1016/S0065-2601(08)60235-X [DOI] [Google Scholar]
- 9.Bölte S, Feineis-Matthews S, Poustka F. Brief report: Emotional processing in high-functioning autism–physiological reactivity and affective report. J Autism Dev Disord. 2008;38(4):776–81. 10.1007/s10803-007-0443-8. 10.1007/s10803-007-0443-8 [DOI] [PubMed] [Google Scholar]
- 10.Brumariu LE, Kerns KA. Mother–child emotion communication and childhood anxiety symptoms. Cogn Emot. 2015;29(3):416–31. 10.1080/02699931.2014.917070 [DOI] [PubMed] [Google Scholar]
- 11.Buck R, VanLear CA. Verbal and nonverbal communication: Distinguishing symbolic, spontaneous, and pseudo-spontaneous nonverbal behavior. J Commun. 2002;52(3):522–41. 10.1111/j.1460-2466.2002.tb02560.x [DOI] [Google Scholar]
- 12.Cadmus-Bertram L, Gangnon R, Wirkus EJ, Thraen-Borowski KM, Gorzelitz-Liebhauser J. The Accuracy of Heart Rate Monitoring by Some Wrist-Worn Activity Trackers. Ann Intern Med. 2017;166(8):610–2. 10.7326/L16-0353. 10.7326/L16-0353 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Erlbaum; 1988. [Google Scholar]
- 14.Coifman KG, Flynn JJ, Pinto LA. When context matters: Negative emotions predict psychological health and adjustment. Motiv Emot. 2016;40:602–24. 10.1007/s11031-016-9553-y [DOI] [Google Scholar]
- 15.Cooper-Vince CE, DeSerisy M, Cornacchio D, Sanchez A, McLaughlin KA, Comer JS. Parasympathetic reactivity and disruptive behavior problems in young children during interactions with their mothers and other adults: A preliminary investigation. Dev Psychobiol. 2017;59(4):543–50. 10.1002/dev.21511 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Costa AP, Steffgen G, Samson AC. Expressive Incoherence and Alexithymia in Autism Spectrum Disorder. J Autism Dev Disord. 2017;47(6):1659–72. 10.1007/s10803-017-3073-9. 10.1007/s10803-017-3073-9 [DOI] [PubMed] [Google Scholar]
- 17.DuBois D, Ameis SH, Lai M-C, Casanova MF, Desarkar P. Interoception in autism spectrum disorder: A review. Int J Dev Neurosci. 2016;52:104–11. 10.1016/j.ijdevneu.2016.05.001 [DOI] [PubMed] [Google Scholar]
- 18.Dykens EM, Lense M. Intellectual disabilities and autism spectrum disorder: A cautionary note. In: Amaral DG, Dawson G, Geschwind D, editors. Autism spectrum disorders. New York: Oxford University Press; 2011. p. 263–9. 10.1093/med/9780195371826.003.0018.
- 19.Eisenberg N, Cumberland A, Spinrad TL. Parental socialization of emotion. Psychol Inq. 1998;9(4):241–73. 10.1207/s15327965pli0904_1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Eisenberg N, Losoya S, Fabes RA, Guthrie IK, Reiser M, Murphy B, Shepard SA, Poulin R, Padgett SJ. Parental socialization of children’s dysregulated expression of emotion and externalizing problems. J Fam Psychol. 2001;15(2):183. 10.1037/0893-3200.15.2.183 [DOI] [PubMed] [Google Scholar]
- 21.Esler AN, Bal VH, Guthrie W, Wetherby A, Weismer SE, Lord C. The autism diagnostic observation schedule, toddler module: Standardized severity scores. J Autism Dev Disord. 2015;45(9):2704–20. 10.1007/s10803-015-2432-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Friard O, Gamba M. BORIS: A free, versatile open-source event-logging software for video/audio coding and live observations. Methods Ecol Evol. 2016;7(11):1325–30. 10.1111/2041-210X.12584. 10.1111/2041-210X.12584 [DOI] [Google Scholar]
- 23.Fuller D, Colwell E, Low J, Orychock K, Tobin MA, Simango B, Buote R, Van Heerden D, Luan H, Cullen K. Reliability and validity of commercially available wearable devices for measuring steps, energy expenditure, and heart rate: Systematic review. JMIR Mhealth Uhealth. 2020;8(9):e18694. 10.2196/18694 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Garfinkel SN, Tiley C, O’Keeffe S, Harrison NA, Seth AK, Critchley HD. Discrepancies between dimensions of interoception in autism: Implications for emotion and anxiety. Biol Psychol. 2016;114:117–26. 10.1016/j.biopsycho.2015.12.003. ISSN 0301-0511. 10.1016/j.biopsycho.2015.12.003 [DOI] [PubMed] [Google Scholar]
- 25.Gentzler AL, Contreras-Grau JM, Kerns KA, Weimer BL. Parent-Child Emotional Communication and Children’s Coping in Middle Childhood. Soc Dev. 2005;14(4):591–612. 10.1111/j.1467-9507.2005.00319.x. 10.1111/j.1467-9507.2005.00319.x [DOI] [Google Scholar]
- 26.Georgiades S, Szatmari P, Boyle M. Importance of studying heterogeneity in autism. Neuropsychiatry. 2013;3(2):123. 10.2217/npy.13.8 [DOI] [Google Scholar]
- 27.Georgiou G, Demetriou CA, Fanti KA. Distinct empathy profiles in callous unemotional and autistic traits: Investigating unique and interactive associations with affective and cognitive empathy. J Abnorm Child Psychol. 2019;47(11):1863–73. 10.1007/s10802-019-00562-1 [DOI] [PubMed] [Google Scholar]
- 28.Goldsmith HH, Reilly J, Lemery KS, Longley S, Prescott A. Laboratory Temperament Assessment Battery: Preschool Version (version 1.0, Technical Report). Madison, WI: Department of Psychology, University of Wisconsin; 1999. [Google Scholar]
- 29.Goldsmith HH, Reilly J, Lemery KS, Longley S, Prescott A. The Laboratory Temperament Assessment Battery. 2012. p. 124. [Google Scholar]
- 30.Goodwin MS, Groden J, Velicer WF, Lipsitt LP, Baron MG, Hofmann SG, Groden G. Cardiovascular arousal in individuals with autism. Focus Autism Dev Disabil. 2006;21(2):100–23. 10.1177/10883576060210020101 [DOI] [Google Scholar]
- 31.Griffin C, Lombardo MV, Auyeung B. Alexithymia in children with and without autism spectrum disorders. Autism Res. 2016;9(7):773–80. 10.1002/aur.1569 [DOI] [PubMed] [Google Scholar]
- 32.Groden J, Goodwin MS, Baron MG, Groden G, Velicer WF, Lipsitt LP, Hofmann SG, Plummer B. Assessing Cardiovascular Responses to Stressors in Individuals With Autism Spectrum Disorders. Focus Autism Dev Disabil. 2005;20(4):244–52. 10.1177/10883576050200040601. 10.1177/10883576050200040601 [DOI] [Google Scholar]
- 33.Gross JJ. Emotion regulation: Conceptual and empirical foundations. In Handbook of emotion regulation. 2nd ed. New York: The Guilford Press; 2014. p. 3–20.
- 34.Guy L, Souders M, Bradstreet L, DeLussey C, Herrington JD. Brief Report: Emotion Regulation and Respiratory Sinus Arrhythmia in Autism Spectrum Disorder. J Autism Dev Disord. 2014;44(10):2614–20. 10.1007/s10803-014-2124-8. 10.1007/s10803-014-2124-8 [DOI] [PubMed] [Google Scholar]
- 35.Halberstadt AG, Denham SA, Dunsmore JC. Affective Social Competence. Soc Dev. 2001;10(1):79–119. 10.1111/1467-9507.00150. 10.1111/1467-9507.00150 [DOI] [Google Scholar]
- 36.Harder JA. The multiverse of methods: Extending the multiverse analysis to address data-collection decisions. Perspect Psychol Sci. 2020;15(5):1158–77. 10.1177/1745691620917678 [DOI] [PubMed] [Google Scholar]
- 37.Hedley D, Nevill R, Uljarević M, Butter E, Mulick JA. ADOS-2 Toddler and Module 1 standardized severity scores as used by community practitioners. Res Autism Spectrum Disord. 2016;32:84–95. 10.1016/j.rasd.2016.09.005 [DOI] [Google Scholar]
- 38.Hollenstein T, Lanteigne D. Models and methods of emotional concordance. Biol Psychol. 2014;98:1–5. 10.1016/j.biopsycho.2013.12.012. 10.1016/j.biopsycho.2013.12.012 [DOI] [PubMed] [Google Scholar]
- 39.Horner RH, Carr EG, Strain PS, Todd AW, Reed HK. Problem behavior interventions for young children with autism: A research synthesis. J Autism Dev Disord. 2002;32(5):423–46. 10.1023/A:1020593922901 [DOI] [PubMed] [Google Scholar]
- 40.Hu G, Wang J, Feng W. Multivariate Regression Modeling for Home Value Estimates with Evaluation Using Maximum Information Coefficient. In: Lee R, editor. Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing 2012. Studies in Computational Intelligence, vol 443. Berlin, Heidelberg: Springer; 2013. 10.1007/978-3-642-32172-6_6.
- 41.Izard CE. Approaches to developmental research on emotion-cognition relationships. Thought and Emotion: Developmental Perspectives. 1986. p. 21–37. [Google Scholar]
- 42.Izard CE, Dougherty LM, Hembree EA. A system for identifying affect expressions by holistic judgments (AFFEX). Insutrctional Resources Center: University of Delaware; 1983. [Google Scholar]
- 43.Jo E, Lewis K, Directo D, Kim MJ, Dolezal BA. Validation of biofeedback wearables for photoplethysmographic heart rate tracking. J Sports Sci Med. 2016;15(3):540. [PMC free article] [PubMed] [Google Scholar]
- 44.John O, Gross J. Healthy and Unhealthy Emotion Regulation: Personality Processes, Individual Differences, and Life Span Development. J Pers. 2004;72(6):1301–34. 10.1111/j.1467-6494.2004.00298.x [DOI] [PubMed] [Google Scholar]
- 45.Joseph RM. The significance of IQ and differential cognitive abilities for understanding ASD. In: Fein D, editor. The Neuropsychology of Autism. New York: Oxford University Press; 2011. p. 281–94. [Google Scholar]
- 46.Kasari C, Sigman M, Mundy P, Yirmiya N. Affective sharing in the context of joint attention interactions of normal, autistic, and mentally retarded children. J Autism Dev Disord. 1990;20(1):87–100. 10.1007/BF02206859 [DOI] [PubMed] [Google Scholar]
- 47.Keenan K. Emotion Dysregulation as a Risk Factor for Child Psychopathology. Clin Psychol Sci Pract. 2000;7(4):418–34. 10.1093/clipsy.7.4.418. 10.1093/clipsy.7.4.418 [DOI] [Google Scholar]
- 48.Keith JM, Jamieson JP, Bennetto L. The Importance of Adolescent Self-Report in Autism Spectrum Disorder: Integration of Questionnaire and Autonomic Measures. J Abnorm Child Psychol. 2019;47(4):741–54. 10.1007/s10802-018-0455-1. 10.1007/s10802-018-0455-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Khaing AS, Naing ZM. Quantitative Investigation of Digital Filters inElectrocardiogram with Simulated Noises. Int J Inform Electron Eng. 2011;1(3):210. [Google Scholar]
- 50.Kinnaird E, et al. Investigating alexithymia in autism: A systematic review and meta-analysis. Eur Psychiatry. 2019;55:80–9. 10.1016/j.eurpsy.2018.09.004. 10.1016/j.eurpsy.2018.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Lang P. The Varieties of Emotional Experience: A Meditation on James-Lange Theory. Psychol Rev. 1994;101(2):211–21. 10.1037/0033-295X.101.2.211 [DOI] [PubMed] [Google Scholar]
- 52.Levenson RW. The Autonomic Nervous System and Emotion. Emot Rev. 2014;6(2):100–12. 10.1177/1754073913512003. 10.1177/1754073913512003 [DOI] [Google Scholar]
- 53.Lindquist KA. Emotions emerge from more basic psychological ingredients: A modern psychological constructionist model. Emot Rev. 2013;5(4):356–68. 10.1177/1754073913489750 [DOI] [Google Scholar]
- 54.Lord C, Rutter M, DiLavore PC, Risi S, Gotham K, Bishop S. Autism diagnostic observation schedule: ADOS-2. Torrance: Western Psychological Services Torrance; 2012.
- 55.Lu G, Yang F, Taylor JA, Stein JF. A comparison of photoplethysmography and ECG recording to analyse heart rate variability in healthy subjects. J Med Eng Technol. 2009;33(8):634–41. 10.3109/03091900903150998. 10.3109/03091900903150998 [DOI] [PubMed] [Google Scholar]
- 56.Lydon S, Healy O, Reed P, Mulhern T, Hughes BM, Goodwin MS. A systematic review of physiological reactivity to stimuli in autism. Dev Neurorehabil. 2016;19(6):335–55. 10.3109/17518423.2014.971975 [DOI] [PubMed] [Google Scholar]
- 57.Macari SL, Vernetti A, Chawarska K. Attend less, fear more: elevated distress to social threat in toddlers with autism spectrum disorder. Autism Res. 2021;14(5):1025–36. 10.1002/aur.2448. 10.1002/aur.2448 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.MacCormack JK, Lindquist KA. Bodily contributions to emotion: Schachter’s legacy for a psychological constructionist view on emotion. Emot Rev. 2017;9(1):36–45. 10.1177/1754073916639664 [DOI] [Google Scholar]
- 59.Machalicek W, O’Reilly Mark, Beretvas N, Lancioni G. A review of interventions to reduce challenging behavior in school settings for students with autism spectrum disorders. Res Autism Spectrum Disord. 2007;1(3):229–46. 10.1016/j.rasd.2006.10.005 [DOI] [Google Scholar]
- 60.Malatesta CZ. Infant emotion and the vocal affect lexicon. Motiv Emot. 1981;5(1):1–23. 10.1007/BF00993658. 10.1007/BF00993658 [DOI] [Google Scholar]
- 61.Masino AJ, Forsyth D, Nuske H, Herrington J, Pennington J, Kushleyeva Y, Bonafide CP. m-Health and Autism: Recognizing Stress and Anxiety with Machine Learning and Wearables Data. 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS). Cordoba: IEEE; 2019. p. 714–9.
- 62.Mathews BL, Koehn AJ, Abtahi MM, Kerns KA. Emotional competence and anxiety in childhood and adolescence: A meta-analytic review. Clin Child Fam Psychol Rev. 2016;19(2):162–84. 10.1007/s10567-016-0204-3 [DOI] [PubMed] [Google Scholar]
- 63.Matson JL, Nebel-Schwalm M. Assessing challenging behaviors in children with autism spectrum disorders: a review. Res Dev Disabil. 2007;28(6):567–79. 10.1016/j.ridd.2006.08.001. 10.1016/j.ridd.2006.08.001 [DOI] [PubMed] [Google Scholar]
- 64.Mauss I, McCarter L, Levenson R, Wilhelm F. The Tie That Binds? Coherence Emot Exp Behav Physiol. 2005;5(2):175–90. [DOI] [PubMed] [Google Scholar]
- 65.Mazefsky CA, Herrington J, Siegel M, Scarpa A, Maddox BB, Scahill L, White SW. The Role of Emotion Regulation in Autism Spectrum Disorder. J Am Acad Child Adolesc Psychiatry. 2013;52(7):679–88. 10.1016/j.jaac.2013.05.006. 10.1016/j.jaac.2013.05.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Mullen EM. Mullen Scales of Early Learning. American Guidance Service; 1995. [Google Scholar]
- 67.Northrup JB, Goodwin M, Montrenes J, Vezzoli J, Golt J, Peura CB, Siegel M, Mazefsky C. Observed emotional reactivity in response to frustration tasks in psychiatrically hospitalized youth with autism spectrum disorder. Autism. 2020;24(4):968–82. 10.1177/1362361320908108. 10.1177/1362361320908108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Nuske HJ, Finkel E, Hedley D, Parma V, Tomczuk L, Pellecchia M, Herrington J, Marcus SC, Mandell DS, Dissanayake C. Heart rate increase predicts challenging behavior episodes in preschoolers with autism. Stress. 2019;22(3):303–11. 10.1080/10253890.2019.1572744 [DOI] [PubMed] [Google Scholar]
- 69.Nuske HJ, Goodwin MS, Kushleyeva Y, Forsyth D, Pennington JW, Masino AJ, Finkel E, Bhattacharya A, Tan J, Tai H, Atkinson-Diaz Z, Bonafide CP, Herrington JD. Evaluating commercially available wireless cardiovascular monitors for measuring and transmitting real-time physiological responses in children with autism. Autism Res. 2022;15(1):117–30. 10.1002/aur.2633. 10.1002/aur.2633 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Nuske HJ, Hedley D, Woollacott A, Thomson P, Macari S, Dissanayake C. Developmental delays in emotion regulation strategies in preschoolers with autism. Autism Res. 2017;10(11):1808–22. 10.1002/aur.1827. 10.1002/aur.1827 [DOI] [PubMed] [Google Scholar]
- 71.Nuske HJ, Vivanti G, Dissanayake C. Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review. Cognition Emotion. 2013;27(6):1042–61. 10.1080/02699931.2012.762900. 10.1080/02699931.2012.762900 [DOI] [PubMed] [Google Scholar]
- 72.Ola L, Gullon-Scott F. Facial emotion recognition in autistic adult females correlates with alexithymia, not autism. Autism. 2020;24(8):2021–34. 10.1177/1362361320932727. (Epub 2020 Jul 21. PMID: 32689812; PMCID: PMC7539601). 10.1177/1362361320932727 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Ollendick T, Allen B, Benoit K, Cowart M. The Tripartite Model of Fear in Children with Specific Phobias: Assessing Concordance and Discordance Using the Behavioral Approach Test. Behav Res Ther. 2011;49(8):459–65. 10.1016/j.brat.2011.04.003. 10.1016/j.brat.2011.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Parak J, Tarniceriu A, Renevey P, Bertschi M, Delgado-Gonzalo R, Korhonen I. Evaluation of the beat-to-beat detection accuracy of PulseOn wearable optical heart rate monitor. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2015. 8099–8102. 10.1109/EMBC.2015.7320273. [DOI] [PubMed]
- 75.Parrott WG. The functional utility of negative emotions. 2002. [Google Scholar]
- 76.Parrott WG. Feeling, function, and the place of negative emotions in a happy life. The positive side of negative emotions. 2014. p. 273–96. [Google Scholar]
- 77.Poquérusse J, Pastore L, Dellantonio S, Esposito G. Alexithymia and autism spectrum disorder: A complex relationship. Front Psychol. 2018;9:1196. 10.3389/fpsyg.2018.01196 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Reshef DN, Reshef YA, Finucane HK, Grossman SR, McVean G, Turnbaugh PJ, Lander ES, Mitzenmacher M, Sabeti PC. Detecting novel associations in large data sets. Science. 2011;334(6062):1518–24. 10.1126/science.1205438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Reshef D, Reshef Y, Mitzenmacher M, Sabeti P. Equitability analysis of the maximal information coefficient, with comparisons. 2013. arXiv Preprint arXiv:1301.6314 .
- 80.Roid GH. Stanford-Binet intelligence scales. IL: Riverside Publishing Itasca; 2003. [Google Scholar]
- 81.Rosenblum GD, Lewis M. Emotional development in adolescence. In: Adams GR, Berzonsky MD, editors. Blackwell handbook of adolescence. Blackwell Publishing; 2003. p. 269–89. [Google Scholar]
- 82.Ruha A, Sallinen S, Nissila S. A real-time microprocessor QRS detector system with a 1-ms timing accuracy for the measurement of ambulatory HRV. IEEE Trans Biomed Eng. 1997;44(3):159–67. 10.1109/10.554762 [DOI] [PubMed] [Google Scholar]
- 83.Ryan S. ‘Meltdowns’, surveillance and managing emotions; going out with children with autism. Health Place. 2010;16(5):868–75. 10.1016/j.healthplace.2010.04.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Saarni C, Weber H. Emotional displays and dissemblance in childhood: Implications for self-presentation. In: Philippot P, Feldman RS, Coats EJ, editors. The social context of nonverbal behavior. Cambridge University Press; Editions de la Maison des Sciences de l’Homme; 1999. p. 71–105. [Google Scholar]
- 85.Samson AC, Hardan AY, Lee IA, Phillips JM, Gross JJ. Maladaptive Behavior in Autism Spectrum Disorder: The Role of Emotion Experience and Emotion Regulation. J Autism Dev Disord. 2015;45(11):3424–32. 10.1007/s10803-015-2388-7 [DOI] [PubMed] [Google Scholar]
- 86.Samson A, Huber O, J Gross J. Emotion Regulation in Asperger’s Syndrome and High-Functioning Autism. 2012;12. 10.1037/a0027975. [DOI] [PubMed]
- 87.Schachter S, Singer J. Cognitive, social, and physiological determinants of emotional state. Psychol Rev. 1962;69(5):379. 10.1037/h0046234 [DOI] [PubMed] [Google Scholar]
- 88.Semrud-Clikeman M. Social Competence in Children. In Social Competence in Children (pp. 1–9). Springer, Boston, MA. 2007. 10.1007/978-0-387-71366-3_1.
- 89.Shah P, Hall R, Catmur C, Bird G. Alexithymia, not autism, is associated with impaired interoception. Cortex. 2016;81:215–20. 10.1016/j.cortex.2016.03.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Shalom DB, Mostofsky SH, Hazlett RL, Goldberg MC, Landa RJ, Faran Y, McLeod DR, Hoehn-Saric R. Normal Physiological Emotions but Differences in Expression of Conscious Feelings in Children with High-Functioning Autism. J Autism Dev Disord. 2006;36(3):395–400. 10.1007/s10803-006-0077-2. 10.1007/s10803-006-0077-2 [DOI] [PubMed] [Google Scholar]
- 91.Shcherbina A, Mattsson CM, Waggott D, Salisbury H, Christle JW, Hastie T, Wheeler MT, Ashley EA. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. Journal of Personalized Medicine. 2017;7(2):3. 10.3390/jpm7020003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Shipman KL, Zeman J, Nesin AE, Fitzgerald M. Children’s Strategies for Displaying Anger and Sadness: What Works with Whom?, vol. 49. Detroit: Merrill-Palmer Quarterly; 2003. p. 100–22. 10.1353/mpq.2003.0006.
- 93.Sifneos PE, Apfel-Savitz R, Frankel FH. The phenomenon of ‘alexithymia.’ Psychother Psychosom. 1977;28(1–4):47–57. 10.1159/000287043 [DOI] [PubMed] [Google Scholar]
- 94.Snow ME, Hertzig ME, Shapiro T. Expression of Emotion in Young Autistic Children. J Am Acad Child Adolesc Psychiatry. 1987;26(6):836–8. 10.1097/00004583-198726060-00006. 10.1097/00004583-198726060-00006 [DOI] [PubMed] [Google Scholar]
- 95.Stahl SE, An H-S, Dinkel DM, Noble JM, Lee J-M. How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? BMJ Open Sport Exerc Med. 2016;2(1):e000106. 10.1136/bmjsem-2015-000106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Steegen S, Tuerlinckx F, Gelman A, Vanpaemel W. Increasing Transparency Through a Multiverse Analysis. Perspect Psychol Sci. 2016;11(5):702–12. 10.1177/1745691616658637. 10.1177/1745691616658637 [DOI] [PubMed] [Google Scholar]
- 97.Stolovitzky G, Qiu P, Segal E, Noble B, Troyanskaya O, Simon N, Tibshirani R, Dougherty E. Finding correlations in big data. Nat Biotechnol. 2012;30(4):334–5. 10.1038/nbt.2182. 10.1038/nbt.2182 [DOI] [PubMed] [Google Scholar]
- 98.Tarvainen MP, Niskanen J-P, Lipponen JA, Ranta-aho PO, Karjalainen PA. Kubios HRV – Heart rate variability analysis software. Comput Methods Programs Biomed. 2014;113(1):210–20. 10.1016/j.cmpb.2013.07.024. 10.1016/j.cmpb.2013.07.024 [DOI] [PubMed] [Google Scholar]
- 99.Task Force of the ESC and NASPE. Standards of measurement, physiological interpretation, and clinical use Task Force of the European Society of Cardiology (ESC) and the North American Society of Pacing and Electrophysiology (NASPE). Circulation. 1996;93(5):1043–65. [PubMed] [Google Scholar]
- 100.Thayer JF, Åhs F, Fredrikson M, Sollers JJ, Wager TD. A meta-analysis of heart rate variability and neuroimaging studies: Implications for heart rate variability as a marker of stress and health. Neurosci Biobehav Rev. 2012;36(2):747–56. 10.1016/j.neubiorev.2011.11.009. 10.1016/j.neubiorev.2011.11.009 [DOI] [PubMed] [Google Scholar]
- 101.Tronick E. Emotions and emotional communication in infants. 1989. (http://www.psycnet.apa.org/record/1989-25649-001). [DOI] [PubMed] [Google Scholar]
- 102.Vanderwal T, Kelly C, Eilbott J, Mayes LC, Castellanos FX. Inscapes: A movie paradigm to improve compliance in functional magnetic resonance imaging. Neuroimage. 2015;122:222–32. 10.1016/j.neuroimage.2015.07.069 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Vaughan Van Hecke A, Lebow J, Bal E, Lamb D, Harden E, Kramer A, Denver J, Bazhenova O, Porges SW. Electroencephalogram and heart rate regulation to familiar and unfamiliar people in children with autism spectrum disorders. Child Dev. 2009;80(4):1118–33. 10.1111/j.1467-8624.2009.01320.x. 10.1111/j.1467-8624.2009.01320.x [DOI] [PubMed] [Google Scholar]
- 104.Wang R, Blackburn G, Desai M, Phelan D, Gillinov L, Houghtaling P, Gillinov M. Accuracy of Wrist-Worn Heart Rate Monitors. JAMA Cardiol. 2017;2(1):104–6. 10.1001/jamacardio.2016.3340. 10.1001/jamacardio.2016.3340 [DOI] [PubMed] [Google Scholar]
- 105.Way IF, Applegate B, Cai * X, Franck LK, Black-Pond C, Yelsma P, Roberts E, Hyter Y, Muliett M. Children’s Alexithymia Measure (CAM): A New Instrument for Screening Difficulties with Emotional Expression. J Child Adolesc Trauma. 2010;3(4):303–18. 10.1080/19361521.2010.523778. 10.1080/19361521.2010.523778 [DOI] [Google Scholar]
- 106.Weiss JA, Thomson K, Chan L. A systematic literature review of emotion regulation measurement in individuals with autism spectrum disorder. Autism Res. 2014;7(6):629–48. 10.1002/aur.1426. 10.1002/aur.1426 [DOI] [PubMed] [Google Scholar]
- 107.Xie J, Wen D, Liang L, Jia Y, Gao L, Lei J. Evaluating the Validity of Current Mainstream Wearable Devices in Fitness Tracking Under Various Physical Activities: Comparative Study. JMIR Mhealth Uhealth. 2018;6(4): e94. 10.2196/mhealth.9754. 10.2196/mhealth.9754 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Yirmiya N, Kasari C, Sigman M, Mundy P. Facial expressions of affect in autistic, mentally retarded and normal children. J Child Psychol Psychiatry. 1989;30(5):725–35. 10.1111/j.1469-7610.1989.tb00785.x [DOI] [PubMed] [Google Scholar]
- 109.Zeman J, Shipman K. Children’s expression of negative affect: Reasons and methods. Dev Psychol. 1996;32(5):842. 10.1037/0012-1649.32.5.842 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data analyzed during this study are included in this published article and its supplementary information files. Full data will be available on ResearchGate.