Abstract
Parent–child interactions are a critical pathway to emotion socialization, with disruption to these processes associated with risk for childhood behavior problems. Using computational linguistics methods, we tested whether (1) play context influenced parent–child socioemotional language, and (2) child conduct problems or callous-unemotional traits were associated with patterns of socioemotional or nonsocial language across contexts. Seventy-nine parent–child dyads (children, 5–6 years old) played a socioemotional skills (“social context”) or math (“nonsocial context”) game at home. We transcribed and analyzed game play, which had been audio recorded by participants. The social context elicited more socioemotional and cognitive words, while the nonsocial context elicited more mathematical words. The use of socioemotional language by parents and children was more strongly correlated in the social context, but context did not moderate the degree of correlation in cognitive or mathematical word use between parents and children. Children with more conduct problems used fewer socioemotional words in the social context, while children with higher callous-unemotional traits used fewer cognitive words in both contexts. We highlight the role of context in supporting socioemotionally rich parent–child language interactions and provide preliminary evidence for the existence of linguistic markers of child behavior problems. Our results also inform naturalistic assessments of parent–child interactions and home-based interventions for parents and children facing socioemotional or behavioral challenges.
Subject terms: Human behaviour, Psychology
Introduction
Emotional language is fundamental to successful social interactions and plays a central role in human perceptions, actions, and experiences1. On average, children demonstrate an understanding of specific emotion words (e.g., happy, sad) by age 22 and produce complex emotion words (e.g., surprise, disgust) by age 43. Children’s emotional language comprehension and expression increase dramatically across development, roughly doubling every second year until adolescence3. This development occurs synergistically with broader childhood socioemotional development4–6 and precedes the emergence of key social skills, such as the recognition of facial signals of emotion and emotion regulation5,7. Children who are less proficient at verbalizing social or emotional concepts show difficulties with social functioning more broadly8. Children’s socioemotional language could thus serve as an objective marker of risk for future difficulties in social functioning or behavior.
In particular, conduct problems (e.g., aggression, bullying, and deceitfulness) represent one of the most common reasons for childhood referrals to mental health services9. Moreover, children with early conduct problems are at elevated risk for chronic antisocial behavior and other forms of psychopathology across the lifespan10. Childhood conduct problems are linked to general language difficulties, including in language mechanics (e.g., trouble with grammar), emotional expression (e.g., restricted ability to verbalize feelings), and vocabulary (e.g., limited range of word use)11–14. In concert, children with conduct problems have difficulties responding appropriately to and managing complex social situations15,16, expressing empathy17, and developing social relationships18. Restricted empathic displays and low social bonding are particularly pronounced among a subgroup of children with conduct problems and co-occurring callous-unemotional traits19,20, who show specific difficulties recognizing distress-based emotion cues21,22 and are at risk for severe conduct problems across childhood and adolescence23. Thus, charting the intersection between emotion and language may improve our understanding of the development of childhood conduct problems and callous-unemotional traits, including whether, when, and how children use language to communicate about their emotions and social intentions.
Parents play a major role in their children’s socioemotional development24. While overly harsh or punitive parenting behaviors have been linked to childhood conduct problems25,26, parents also have a positive influence on children by scaffolding, shaping, and reinforcing socioemotional language understanding and expression27,28. For example, children whose parents use more emotional labeling during storytelling have higher scores on tests of emotion comprehension29–31. Likewise, children whose parents engage in more extensive and elaborative emotion language show greater empathy32, conscience development33, and social competence34. Taken together, these studies point to parent–child socioemotional language as a potentially fruitful avenue for intervention when children have conduct problems35. Parenting has also been linked to the development of callous-unemotional traits. For example, studies of early childhood have specifically linked callous-unemotional traits to low levels of parental warmth and affection36,37 and disrupted patterns of emotion socialization38, even after accounting for the severity of children’s conduct problems. Thus, an examination of parent–child language during emotion-evoking interactions could provide more granular insight into risk factors for both conduct problems and callous-unemotional traits.
Parental language is known to vary based on context (e.g., toy play vs. storytelling)39. Moreover, the time that parents and children spend together simply interacting may be just as important to socioemotional development as the linguistic content of those interactions39,40. For example, in addition to language, parent–child interactions typically encompass a multitude of nonverbal social bonding behaviors that have been linked to the development of social and behavioral difficulties in children41. Prior studies of parent–child language and conduct problems, however, are limited by a reliance on language data collected using observational designs and within laboratory-based or artificial contexts, which reduces ecological validity42–44. Few prior experimental studies of parent–child language interactions have been conducted in naturalistic contexts (e.g., the home environment) to control for non-linguistic (i.e., social or affiliative) features of parent–child interactions.
The current experiment addresses these knowledge gaps by measuring language use in parent–child dyads in one of two home-based play contexts, and testing links between language and child conduct problems and callous-unemotional traits. Parent–child dyads were randomized to receive either a socioemotional skills game (“social context”) or a mathematics game (“nonsocial context”) by mail. They were asked to play the game four times and parents uploaded an audio recording each time they played the game. Our linguistic analysis focused on words with socioemotional (e.g., love, happy, nervous, and mad), cognitive (e.g., think, know, and can), and mathematical (e.g., one, two, and three; see Supplemental Materials for more information) content. We included socioemotional and cognitive content because emotion recognition, social bonding, and perspective-taking are core difficulties among children with conduct problems and/or callous-unemotional traits16,20. We included mathematical content to serve as a comparison condition that we did not expect to be relevant to conduct problems or callous-unemotional traits. In our first aim, we assessed the proportion of each word type used by children and parents in each context. We hypothesized that dyads would produce more socioemotional and cognitive words in the social context and more mathematical words in the nonsocial context. In our second aim, we examined word use alignment (i.e., correlation between use of word types) between parents and children, hypothesizing greater alignment for socioemotional and cognitive words in the social context and greater alignment for mathematical words in the nonsocial context. Finally, under our third aim, we examined links between word production and parent–child word alignment across contexts and child conduct problems and callous-unemotional traits, hypothesizing that conduct problems and callous-unemotional traits would be related to lower socioemotional and cognitive word production and alignment, specifically in the social context.
Results
Descriptive statistics and bivariate correlations for study variables are presented in Table S1. Our randomization was successful with no significant differences between experimental groups (i.e., social vs. nonsocial) on the basis of demographic characteristics (Table S2). Overall, the total number of words produced by parent–child dyads (N = 79; 75 mothers, 4 fathers; child age, M = 5.4 years, SD = 0.50, range = 5–6 years; 47 Female, 32 Male; 7 Asian, 31 Black, 38 White, and 3 “Other”) did not differ between the social versus nonsocial context (total words social, M = 433.65, SD = 199.58, range = 133–1097; total words nonsocial, M = 446.09, SD = 270.01, range = 119–1717; comparison, t(71.81) = .23, p = .82). Individually, parents did not differ in the number of words produced based on context (parents’ total words social, M = 632.96 vs. parents’ total words nonsocial, M = 572.96; t(75.11) = − .84, p = .40). However, children produced more words in the nonsocial context than in the social context (children total words social, M = 234.35 vs. children total words nonsocial, M = 319.22; t(64.72) = − 2.001, p = .048). Generally, parents spoke more words than children in both contexts (parents social, M = 632.96 vs. children social, M = 234.35, t(54.94) = − 7.83, p < .001; parents nonsocial, M = 572.96 vs. children nonsocial, M = 319.23, t(67.62) = − 3.89, p < .001).
Across both contexts, more than 70% of all words spoken by parents and children were content or function words (i.e., pronouns, determiners, prepositions, and adjectives). In terms of our substantive focus, socioemotional words comprised 2.7% of the total words produced by children and 3.1% of total words produced by parents. Cognitive words comprised 8.03% of words spoken by children and 9.1% of words spoken by parents, and mathematical words comprised 20.8% of words spoken by children and 10.2% of words spoken by parents.
Aim 1: context modulates language content produced during parent–child interactions
As hypothesized, children and parents both produced more socioemotional words in the social context compared to the nonsocial context (children, t(44.95) = 21.613, p < .001, d = 4.89, 95% CI = [3.358–4.048]; parents: t(75.88) = 16.62, p < .001, d = 1.93, 95% CI = 2.49–3.16]; Fig. 1A). Both children and parents also produced more cognitive words in the social context than the nonsocial context (children, t(75.84) = 10.87, p < .001, d = 2.44, 95% CI = [3.81–5.52]; parents, t(75.97) = 14.92, p < .001, d = 3.35, 95% CI = [5.12–6.70]; Fig. 1B). Children and parents also produced more mathematical words in the nonsocial context (children, t(53.43) = 7.36, p < .001, d = − 1.65, 95% CI = [10.60–18.54]; parents, t(48.02) = 5.74, p < .001, d = 1.28, 95% CI = [4.19–8.70]; Fig. 1C). Thus, our experimental manipulation of a naturalistic context (i.e., social vs. nonsocial games) produced distinct patterns of linguistic content among parent–child dyads.
As a post hoc test of convergent validity, we examined whether children’s emotional verbal fluency (i.e., number of emotion words freely produced by the child, a score generated by a separate task as described under Emotional Verbal Fluency), which had been collected during a separate assessment, was related to the proportion of different word categories produced by children in each context. We found that emotional verbal fluency was more strongly associated with the proportion of socioemotional words that children produced in the social context (interaction, b = .20, t = 2.33, p = .02; social context, b = .21, t = 3.34, p = .001; nonsocial context, b = .11, t = 2.61, p = .01). However, context did not moderate the relationship between emotional verbal fluency and cognitive or mathematical word production (see Table S3).
Aim 2: context modulates language alignment during parent–child interactions
Consistent with hypotheses, the proportion of socioemotional words produced by parents was aligned (i.e., positively correlated) with the proportion of socioemotional words produced by their children, but only in the social context (interaction, b = .43, t = 1.98, p = .05; social context, b = .44, t = 2.66, p = .01; nonsocial context, b = .01, t = .09, p = .93) (Fig. 2). In contrast to hypotheses, context did not moderate alignment in parent–child cognitive or mathematical word production (ps > .5; Table S4).
Aim 3: Associations between context, parent–child language, and child conduct problems and callous-unemotional traits
Results revealed an interaction between conduct problems and context (b = − .55, t = − 2.51, p = .02), such that higher levels of child conduct problems related to children using fewer socioemotional words specifically in the social context (b = − .40, t = − 2.79, p = .007; Fig. 3), but not in the nonsocial context (b = .15, t = 0.76, p = .45). In contrast to hypotheses, there was no relationship between the proportion of socioemotional words produced and callous-unemotional traits in either context. However, there was a main effect of callous-unemotional traits on cognitive words, such that children with higher callous-unemotional traits produced fewer cognitive words during both the social and nonsocial contexts (b = − .07, t = − 2.09, p = .04; Table S5). There were no main effects or interactions with context for callous-unemotional traits or conduct problems in relation to the proportion of mathematical words produced by children. There were also no effects or interactions with child callous-unemotional traits or conduct problems for the proportion of socioemotional, cognitive, or mathematical words expressed by the parent (Table S6). Finally, while a significant three-way interaction suggested that parent–child language alignment may have been moderated by conduct problems (b = − .67, t = − 2.16, p = .04), neither of the follow-up two-way interactions reached statistical significance (alignment-by-conduct problems in the social context, b = − .40, t = − 1.95, p = .056; alignment-by-conduct problems in the nonsocial context, b = .27, t = 1.18, p = .24; Table S7). Callous-unemotional traits did not significantly moderate the degree of alignment of parent–child language for the proportion of socioemotional, cognitive, or mathematical words used across contexts (Table S8).
Discussion
We measured parent–child language produced during social and nonsocial gameplay, and documented connections between language content, context, and child conduct problems and callous-unemotional traits. First, we showed that both children and parents used different language according to the context45,46, producing more socioemotional and cognitive words when playing a socioemotional skills game and producing more mathematical language when playing a mathematics-focused game. Additionally, children’s general emotional verbal fluency (measured independently from game play) was associated with children using more socioemotional words during parent–child interactions, indicating that the speech produced during game play reliably indexed children’s broader socioemotional expressive ability. Together, results illustrate the feasibility of manipulating a play context to provoke different types of word production in parents and children47. Importantly, we also demonstrated the feasibility of assessing language naturally in participants’ homes with very minimal prompting (i.e., written instructions that were mailed home) and without the actual physical or virtual presence of a research assistant48–50.
Second, we showed that context specifically modulated the alignment of parent and child word production, though only for socioemotional words and not for cognitive and mathematical word production. The presence of alignment in socioemotional word expression suggests that teaching parents to use socioemotional language could potentially have downstream effects on children’s use of socioemotional language (note, however, that we cannot assume directionality based on the current study)51. Most importantly, our findings suggest that context plays a causal role on the prevalence of socioemotional language produced by parents and children, and that social contexts explicitly facilitate more socioemotional language and greater alignment than nonsocial contexts. This pattern of findings provides supportive evidence for using targeted settings or paradigms to develop more effective family- or parent-based interventions to promote child social and emotional understanding and enhance socioemotional development and regulation.
Third, we found that children with more conduct problems produced fewer socioemotional words, specifically within the social context. This finding adds to research showing links between conduct problems and language difficulties more broadly13,52 and provides evidence for a specific connection between child conduct problems and socioemotional language, but not between conduct problems and child cognitive or mathematical word production. The ability to convey thoughts, feelings, and social intentions via language is vital to effective interpersonal connections, social bonding, and emotional resonance53,54, which are processes that are disrupted in children with conduct problems11,13. In contrast to our original hypotheses, context did not moderate the relationship between callous-unemotional traits and socioemotional word production. However, children higher in callous-unemotional traits produced a smaller proportion of cognitive words across both contexts. On one hand, this relationship contradicts some evidence that callous-unemotional traits are associated with intact perspective-taking and cognitive understanding of the world55,56. On the other hand, the cognitive word category in LIWC (our language analysis software) included words, such as think and feel, which are meaningful in the context of the difficulties experienced among children with high callous-unemotional traits, including lack of sensitivity towards or responding to the needs of others57,58, and our findings are consistent with meta-analytic work that directly linked callous-unemotional traits to lower cognitive empathy20.
Taken together, our findings have implications for etiological models and intervention targets for conduct problems and callous-unemotional traits with a particular focus on understanding and expressing socioemotional language, beginning much earlier in childhood59–61. Examples of this type of approach include interventions that strengthen positive parent–child interactions, promote communication skills in parents, and directly teach children better social and emotional communication skills, all of which have been associated with reductions in child conduct problems and increases in more constructive parent and child relationships in prior literature30,48,49,62,63. The association between callous-unemotional traits and lower cognitive word production highlights an important target for intervention through a focus on language during parent–child interactions, with preliminary evidence that adjunctive treatment modules tailored to the specific cognitive language features of children with high callous-unemotional traits can be effective in directly reducing their callous-unemotional traits, while increasing empathy64,65.
Our results should be interpreted in light of several important limitations. First, the current analysis cannot speak to directionality in the relationship between parent and child language production, as language was analyzed at the conversation level rather than at the turn level, across all four recordings. Future research is necessary to chart, with greater granularity, the dynamics of parent–child conversations, including quantifying who initiates the use of socioemotional language, the latency of parents or children to respond to socioemotional bids, and the possibility that children use fewer socioemotional words because parents initiate them less to begin with (or vice versa)66,67. Second, we analyzed proportions of socioemotional words produced relative to total words, which was derived by computing an average of the proportion of emotion and social behavior words. Within the LIWC dictionary, there was some overlap of these categories (e.g., love and good appear under both categories), which meant there may have been overrepresentation of the overlapping words within our socioemotional word production variable. Nevertheless, results from examining emotion and social word categories separately were similar, as presented in Supplemental Materials. Notably, the LIWC is just one available method to categorize words, and future studies of parent–child interactions are needed to leverage the recent and dramatic changes in natural language processing algorithms within artificial intelligence68. Third, we recruited a small community sample with relatively low levels of conduct problems and callous-unemotional traits (i.e., n = 10 had scores ≥ 4, established as being within the clinical range for the SDQ conduct problems scale)69,70. Thus, while similar associations might be hypothesized in samples exhibiting greater conduct problem severity, future research is warranted to replicate our findings in larger samples that include more children with clinically significant conduct problems. Moreover, subsequent studies, properly powered, have the potential to reveal novel linguistic features that could serve both as risk markers and treatment targets for parent–child interventions aimed at fostering socioemotional development in children with conduct problems and/or high callous-unemotional traits. Fourth, the contexts were not equivalent, with children in the social condition playing four different socioemotional games and those in the nonsocial condition playing the same math game four times. At the same time, socioemotional functioning represents a complex constellation of skills, as captured within the four social games (i.e., empathy, emotions, manners, and friendship), which may have enhanced the validity of our approach. Moreover, there was no effect of the order in which the social games were played on word production. Finally, although the racial diversity within our sample was representative of the city in the northeastern United States from which we recruited, parents were otherwise highly educated and our sample, more broadly, could be categorized as WEIRD (i.e., Western, educated, industrialized, rich and democratic) and not generalizable to all populations71,72. Future studies are needed that are powered and designed to evaluate parental scaffolding and/or use of socioemotional language across different cultures.
In sum, our findings contribute to a growing literature focused on socioemotional language interactions between parents and children during early childhood, provide additional evidence for the critical role of social context in promoting certain types of language expression, and give preliminary evidence for links between parent–child socioemotional language and conduct problems in children. Through an experimental design that randomized parent–child dyads into one of two conditions, we showed that language differed significantly between contexts, while keeping constant the semi-structured nature of the parent–child interaction (i.e., the two “game-playing” situations). Our approach highlights the utility of leveraging brief, naturalistic home-based approaches, which minimize demands on families. This point is salient in the context of the COVID-19 pandemic, which precipitated a new “normal” centered on virtual encounters, with some parents preferring online assessments or services for pediatrician visits73 or parenting support74,75. Indeed, an important takeaway from this study is the high rate of acceptability from parents for uploading recorded samples of interactions between themselves and their children. This willingness to share parent–child recordings on a secure platform opens the door for future distanced, virtual, or asynchronous assessments and interventions. Such options may be more accessible for families, particularly those living in more rural/remote areas or unable to attend in-person sessions due to socioeconomic, family, or employment constraints, while potentially generating greater insights into parent–child interactions that are more naturalistic than might otherwise be obtained through lab-based assessments or interventions76–78.
Methods
Participants
Participants were 79 children aged 5–6 years old (Mage = 5.4 years, SDage = .50; 47 Female, 32 Male; 7 Asian, 31 Black, 38 White, and 3 “Other”) and parents (75 mothers, 4 fathers) recruited from a city in the northeastern United States. 54.4% of parents reported having a graduate-level degree, 30.4% had a bachelor-level degree, 7.6% had some college but no degree, 2.5% had an associates-level qualification, 3.8% had a high school qualification or less, and 1.3% declined to answer. The average monthly household income was $10,026 (SD = 9.236), although 21.5% of the sample reported an annual income that fell below the median for [masked for review] households based on the 2021 census (U.S. Census Bureau, 2021). The sample was recruited for the [name masked for review] study that involved multiple measures of emotional development, a subset of which are presented here. 12 additional participants were recruited into the study but were excluded prior to analysis because they did not upload any recordings (n = 9), the recordings were not clear enough to transcribe (n = 1), or participants did not follow the task instructions (e.g., played the game with multiple children, n = 2). We included the number of games completed as a covariate in analyses (M = 3.59, SD = .809, range = 1–4).
Design and procedure
As a part of the [name masked for review] study, participants were randomly assigned to one of three experimental contexts: (1) Mailed a socioemotional game to play at home (“social context”), (2) Mailed a mathematical game to play at home (“non-social context”), or (3) Received no game to play at home (“control”). The current study focuses on the words that parents and children produced while playing the games, thus the control condition was not included in our data analysis. For the two experimental contexts, parent–child dyads were asked to play the game four times during a 6–8-week period at a time of the day when there would be minimal external distractions. They were asked to audio record each time they played the game using a voice recording application (e.g., “voicenote”), which parents then uploaded to a secure website (www.SendSafely.com).
Participants played the games at their own pace in any order and were instructed that there was no time limit. Accordingly, there was significant variation in the length of the uploaded recordings and the numbers of words produced by children and parents (see “Results” section). Audio recordings were transcribed by the first, fifth, and sixth authors. We double transcribed a randomly selected 25% of recordings to monitor reliability and accuracy (99.96% for social context; 98.70% for nonsocial context). Transcriptions were analyzed using the Linguistic Inquiry and Word Count (LIWC) software, which automatically produced an output of the proportion of words used in different categories (see “Language data” section for more information). Prior to randomization (baseline) and after the 6–8-week study period (follow-up), parents completed a series of surveys using Qualtrics, including completing the questionnaires used in the current study. In addition, at baseline and follow-up, parents and children completed an online “virtual visit” (over Zoom) with a trained research assistant. During this visit, children completed an emotional verbal fluency test. Informed consent for themselves and their child was obtained at the beginning of each Zoom visit from parents who provided an electronic signature. Informed verbal assent was obtained from children. All procedures were approved by the University of Pennsylvania Institutional Review Board and all methods were performed in accordance with the relevant guidelines and regulations.
Social context
Participants randomized to the social context (n = 39) were mailed the game, Social Skills Board Games (JRL426 by Junior Learning), which included four separate board games relating to socioemotional skills: empathy, friendship, manners, and emotions. Having four games allowed us to capture the complexity of socioemotional skills, and the games were designed to promote the use of each specific skill, which are core to socioemotional abilities that are disrupted among children with conduct problems16,20,25. For each game, participants took turns moving their piece forward on a board following a die roll. Players read the scenario on which their piece landed and then spun a spinner, which had a question unique to each of the games. The player responded with a statement relating the scenario and the spinner, and if both players agreed to the statement, the player stayed on the landing spot until their next turn. Players continued to take turns until someone reached the end of the board and won (see Supplemental Materials for game instructions). Parents were instructed to take the time to read the instructions and explain how the task worked to the child before starting the game. The parent and child were asked to play each one of the four games once, in any order, over a 6–8-week period, which would ensure the right balance of novelty and having enough time to capture expressed language without being overly burdensome to participants. Participants audio recorded the game and uploaded recordings to a secure website. There was variability in the order of games (Table S9) and game-related differences for all word types (Table S10; though there was no effect of the order in which the social games were played on word production). In general, the richest dialogue was elicited in the Emotions game and the least rich dialogue was elicited in the Manners game (see Supplemental Materials for more descriptive data across socioemotional board games and Table S11 for pairwise comparisons).
Non-social context
Participants randomized to the non-social condition (n = 40) were mailed the game, Cat Owl (Terribly Interesting Game! Mental Calculation by The Brainy Band), which was a mental arithmetic card game. The parent and child were given a deck of cards, which had pictures of animals with different attributes. One player picked a card and rolled a die, which had names of each attribute. Based on the attribute the player rolled, they stated the number of animals on the card that had the attribute. If the player counted the correct number, they kept the card, and if not, the card was placed back in the stack. The players took turns until all the cards were gone, and the person with the greatest number of cards won the game (see Supplemental Materials for game instructions). The parent and child were asked to play the game four times over 6–8 weeks, audio record the game, and upload recordings to a secure website.
Measures
Conduct problems
We assessed conduct problems using two different measures, which were combined across the baseline and follow-up visits to provide a full index of childhood conduct problems encompassing aggression, rule violations, and disruptive behavior. First, parents completed the 32-item Subtypes of Antisocial Behavior (STAB) Questionnaire79, which assessed physically aggressive (e.g., assaulting and bullying others) and socially aggressive (e.g., excluding others and gossiping) behavior in children80. Items were rated on a 5-point scale (1 = never to 5 = nearly all the time). Second, parents completed the 5-item conduct problems scale from the Strengths and Difficulties Questionnaire (e.g., “fights with other children or bullies them,” “often lies or cheats,” and “steals from home, school or elsewhere”)81,82. Items were rated on a 3-point scale (0 = not true, 2 = certainly true). Since items were available from both baseline and follow-up, we computed a sum of the mean of items from each time point for both the STAB questionnaire and the conduct problems subscale of the SDQ83,84. Scores were highly correlated (r = .73, p < .001) and we combined them into a single conduct problems measure by computing a mean of the z-scores (the results for STAB and SDQ when analyzed separately are in the Supplemental Materials).
Callous-unemotional traits
We assessed callous-unemotional traits using parent reports on the Inventory for Callous-Unemotional Traits (ICU 85;), a 24-item measure assessing callousness (e.g., “is concerned about the feelings of others”), uncaring (e.g., “feels bad or guilting when he/she has done something wrong”), and unemotionality (e.g., “expresses his/her feelings openly”)86,87. Consistent with prior studies88, we excluded items 3 and 10 from the total callous-unemotional traits score. We computed total scores by summing the mean item ratings from data collected at baseline and follow-up83,84.
Emotional verbal fluency
We assessed emotional verbal fluency using a previously validated task89 where children were asked to list all the emotions/feelings words they knew in a 30 s period during online Zoom visits (“Can you tell me all the emotion or feeling words you know? So different words for how you are feeling in your heart? Ready? Go”). Responses were video recorded and then each unique emotion or feeling word produced by the child was coded by trained research assistants and summed to generate a total emotional verbal fluency score. Scores from baseline and follow-up visits did not differ (t(145.98) = − 1.34, p = .18), and we used children’s higher score from either the baseline or follow-up visits in analyses.
Language data
To avoid inconsistency in linguistic coding generated by human coders, we processed the transcribed language data using the 2022 version of Linguistic Inquiry and Word Count (LIWC)67,90. LIWC is a text analysis system that classifies words according to their definitions in the LIWC dictionary and was specially designed for language researchers to associate significant psychosocial concepts and theories with language elements, such as words, phrases, and linguistic structures91 (see Supplemental Materials for more detailed description). For analyses, we used the total word count and four linguistic categories: emotion words (e.g., happy, hope, good) were from the broader LIWC category of affect and included both positive and negative emotion words; social behavior words (e.g., said, care, love) included words centered on politeness, prosocial behavior, conflict, and communication, forming a subcategory of the broader social processes LIWC category; cognitive processes words (e.g., believe, think, know) came from the broader LIWC category of cognition; and mathematical words were those that encapsulated any number-related words spoken. To create a composite of socioemotional speech, we used an average of the emotion and social behavior categories (the results showed very similar patterns for the categories separately, see Supplemental Materials). LIWC calculated the proportion of words in the text that fell into a predetermined category by dividing the number of words in each category by the total number of words produced. Thus, higher scores in any category indicated that the speaker produced a greater proportion of those words during the game play.
Analysis plan
To address our first aim, we compared the proportion of socioemotional, mathematical, and cognitive word produced in the social and non-social contexts for children and parents (two-tailed t-tests, Bonferroni corrected for multiple comparisons). A test of proportions suggested that there was an equivalent number of dyads who completed all 4 games in the social and nonsocial conditions (68% in the nonsocial condition vs. 87% in the social condition; X2(1) = 3.3, p = .07). After averaging the proportion of (socioemotional/cognitive/mathematical) words used during each game, we divided the number of words produced by the number of games played to create the final proportion per context and minimize data loss for those who did not play the game all four times. As a post hoc test of convergent validity, we also tested whether context moderated the relationship between child emotional verbal fluency and words used, with separate models for socioemotional, cognitive, or mathematical words. Specifically, we conducted a linear regression, regressing the proportion of words produced by the child on context (non-social = − .5, social = .5), emotional verbal fluency score (mean-centered), and their interaction. We included the proportion of emotion words produced by the parent, child age, child gender, child race, and number of games completed as covariates. To address our second aim focused on alignment of parent and child word production, we regressed the proportion of words produced by the child, the proportion of different words produced by the parent (mean-centered), and their interaction on context (social vs. non-social). We ran separate models for socioemotional, cognitive, and mathematical words. As before, we controlled for parent, child age, child gender, child race, and number of games completed, as well as emotional verbal fluency. Finally, to test our third aim, we examined whether context moderated the relationship between word production and both child conduct problems and callous-unemotional traits. We regressed the proportion of words produced by the child, conduct problems, callous-unemotional traits, the interactions of context with conduct problems and callous-unemotional traits, and the interaction between conduct problems and callous-unemotional traits, with separate models for parent and child socioemotional, cognitive, and mathematical words, as well as their alignment. Interaction terms were mean-centered, and we included the covariates listed above.
Transparency and openness
De-identified datasets and analysis scripts are on Open Science Framework (https://osf.io/ytzmn/?view_only=a0d03ffcbfc8493f98b8246a3f9135ed). We used R version 2022.02.1 for analyses (R Core Team, 2019), including the tidyverse package92 for data organization, lme4 package93 for linear models, and ggplot294 for visualization. We reported how we determined our sample size, all data exclusions, and all manipulations and measures in the study. The study design and analyses were not pre-registered.
Supplementary Information
Acknowledgements
The preparation of this manuscript was partially supported by funding from the National Institute of Mental Health (R01MH125904, R21MH126162; Waller), institutional funding from the University of Pennsylvania (Waller), the University Scholars program within the Center for Undergraduate Research & Fellowships at the University of Pennsylvania (Sun), and a Postdoctoral Fellowship funded by MindCORE (Mind Center for Outreach, Research, and Education) at the University of Pennsylvania (Plate).
Author contributions
R.W. and C.J. conceptualized the study. S.S. initialized and led the current project with critical intellectual input from J.P.-M. and R.W. S.S., Y.R., and C.J. collected the data, and S.S., C.K., M.M., and J.P. transcribed the audio recordings. S.S. and R.C.P. conducted data analysis and visualization. S.S. wrote the first draft of the manuscript and R.C.P., R.W., and J.P.-M. provided critical revisions. R.W. provided funding and project oversight. All authors provided intellectual input, feedback on experimental design, and manuscript review.
Data availability
De-identified datasets and analysis scripts are on Open Science Framework (https://osf.io/ytzmn/?view_only=a0d03ffcbfc8493f98b8246a3f9135ed).
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
The online version contains supplementary material available at 10.1038/s41598-024-51656-w.
References
- 1.Lindquist KA, MacCormack JK, Shablack H. The role of language in emotion: Predictions from psychological constructionism. Front. Psychol. 2015;6:444. doi: 10.3389/fpsyg.2015.00444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wellman HM, Harris PL, Banerjee M, Sinclair A. Early understanding of emotion: Evidence from natural language. Cogn. Emot. 1995;9:117–149. doi: 10.1080/02699939508409005. [DOI] [Google Scholar]
- 3.Grosse G, Streubel B, Gunzenhauser C, Saalbach H. Let’s Talk About Emotions: The Development of Children’s Emotion Vocabulary from 4 to 11 Years of Age. Affect. Sci. 2021;2:150–162. doi: 10.1007/s42761-021-00040-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Heyman GD, Gelman SA. Young children use motive information to make trait inferences. Dev. Psychol. 1998;34:310–321. doi: 10.1037/0012-1649.34.2.310. [DOI] [PubMed] [Google Scholar]
- 5.Widen SC. Children’s interpretation of facial expressions: The long path from valence-based to specific discrete categories. Emot. Rev. 2013;5:72–77. doi: 10.1177/1754073912451492. [DOI] [Google Scholar]
- 6.Widen SC, Russell JA. The relative power of an emotion’s facial expression, label, and behavioral consequence to evoke preschoolers’ knowledge of its cause. Cogn. Dev. 2004;19:111–125. doi: 10.1016/j.cogdev.2003.11.004. [DOI] [Google Scholar]
- 7.Grady JS, Callan D. Shy toddlers act bold: The roles of respiratory sinus arrhythmia and parent emotion language. Infant Behav. Dev. 2019;55:32–37. doi: 10.1016/j.infbeh.2019.02.005. [DOI] [PubMed] [Google Scholar]
- 8.Arts E, Orobio de Castro B, Luteijn E, Elsendoorn B, Vissers CTWM. Improving social emotional functioning in adolescents with Developmental Language Disorders: A mini review and recommendations. Front. Psychiatry. 2022;13:966008. doi: 10.3389/fpsyt.2022.966008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kazdin AE. Implementation and evaluation of treatments for children and adolescents with conduct problems: Findings, challenges, and future directions. Psychother. Res. 2018;28:3–17. doi: 10.1080/10503307.2016.1208374. [DOI] [PubMed] [Google Scholar]
- 10.Rivenbark JG, et al. The high societal costs of childhood conduct problems: Evidence from administrative records up to age 38 in a longitudinal birth cohort. J. Child Psychol. Psychiatry. 2018;59:703–710. doi: 10.1111/jcpp.12850. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Gallagher TM. Interrelationships among childrenʼs language, behavior, and emotional problems. Top Lang. Disord. 1999;19:1–15. doi: 10.1097/00011363-199902000-00003. [DOI] [Google Scholar]
- 12.Long CE, Gurka MJ, Blackman JA. Family stress and children’s language and behavior problems: Results from the national survey of children’s health. Top. Early Child. Spec. Educ. 2008;28:148–157. doi: 10.1177/0271121408318678. [DOI] [Google Scholar]
- 13.Petersen IT, et al. Language ability predicts the development of behavior problems in children. J. Abnorm. Psychol. 2013;122:542–557. doi: 10.1037/a0031963. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Stansbury K, Zimmermann LK. Relations among child language skills, maternal socialization of emotion regulation, and child behavior problems. Child Psychiatry Hum. Dev. 1999;30:121–142. doi: 10.1023/A:1021954402840. [DOI] [PubMed] [Google Scholar]
- 15.Breitenstein SM, Hill C, Gross D. Understanding disruptive behavior problems in preschool children. J. Pediatr. Nurs. 2009;24:3–12. doi: 10.1016/j.pedn.2007.10.007. [DOI] [PubMed] [Google Scholar]
- 16.Teisl M, Cicchetti D. Physical abuse, cognitive and emotional processes, and aggressive/disruptive behavior problems. Soc. Dev. 2008;17:1–23. doi: 10.1111/j.1467-9507.2007.00412.x. [DOI] [Google Scholar]
- 17.Schultz D, Izard CE, Bear G. Children’s emotion processing: Relations to emotionality and aggression. Dev. Psychopathol. 2004;16:371–387. doi: 10.1017/S0954579404044566. [DOI] [PubMed] [Google Scholar]
- 18.Denham SA, et al. Preschool understanding of emotions: Contributions to classroom anger and aggression. J. Child Psychol. Psychiatry. 2002;43:901–916. doi: 10.1111/1469-7610.00139. [DOI] [PubMed] [Google Scholar]
- 19.Frick PJ, Ray JV, Thornton LC, Kahn RE. Annual research review: A developmental psychopathology approach to understanding callous-unemotional traits in children and adolescents with serious conduct problems. J. Child Psychol. Psychiatry. 2014;55:532–548. doi: 10.1111/jcpp.12152. [DOI] [PubMed] [Google Scholar]
- 20.Waller R, et al. A meta-analysis of the associations between callous-unemotional traits and empathy, prosociality, and guilt. Clin. Psychol. Rev. 2020;75:101809. doi: 10.1016/j.cpr.2019.101809. [DOI] [PubMed] [Google Scholar]
- 21.White SF, et al. Can the fear recognition deficits associated with callous-unemotional traits be identified in early childhood? J. Clin. Exp. Neuropsychol. 2016;38:672–684. doi: 10.1080/13803395.2016.1149154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kimonis ER, et al. Can callous-unemotional traits be reliably measured in preschoolers? J. Abnorm. Child Psychol. 2016;44:625–638. doi: 10.1007/s10802-015-0075-y. [DOI] [PubMed] [Google Scholar]
- 23.Longman T, Hawes DJ, Kohlhoff J. Callous-unemotional traits as markers for conduct problem severity in early childhood: A meta-analysis. Child Psychiatry Hum. Dev. 2016;47:326–334. doi: 10.1007/s10578-015-0564-9. [DOI] [PubMed] [Google Scholar]
- 24.McLoyd VC. The impact of economic hardship on black families and children: Psychological distress, parenting, and socioemotional development. Child Dev. 1990;61:311. doi: 10.2307/1131096. [DOI] [PubMed] [Google Scholar]
- 25.Waller R, Gardner F, Hyde LW. What are the associations between parenting, callous–unemotional traits, and antisocial behavior in youth? A systematic review of evidence. Clin. Psychol. Rev. 2013;33:593–608. doi: 10.1016/j.cpr.2013.03.001. [DOI] [PubMed] [Google Scholar]
- 26.Deater-Deckard K, Wang Z, Chen N, Bell MA. Maternal executive function, harsh parenting, and child conduct problems: Harsh parenting. J. Child Psychol. Psychiatry. 2012;53:1084–1091. doi: 10.1111/j.1469-7610.2012.02582.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Brown JR, Dunn J. Continuities in emotion understanding from three to six years. Child Dev. 1996;67:789. doi: 10.2307/1131861. [DOI] [PubMed] [Google Scholar]
- 28.Nencheva ML, Tamir DI, Lew-Williams C. Caregiver speech predicts the emergence of children’s emotion vocabulary. Child Dev. 2023 doi: 10.1111/cdev.13897. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Aznar A, Tenenbaum HR. Spanish parents’ emotion talk and their children’s understanding of emotion. Front. Psychol. 2013;4:670. doi: 10.3389/fpsyg.2013.00670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dunsmore JC, Her P, Halberstadt AG, Perez-Rivera MB. Parents’ beliefs about emotions and children’s recognition of parents’ emotions. J. Nonverbal Behav. 2009;33:121–140. doi: 10.1007/s10919-008-0066-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Green S, Baker B. Parents’ emotion expression as a predictor of child’s social competence: Children with or without intellectual disability: Parents’ emotion and child’s social skills. J. Intellect. Disabil. Res. 2011;55:324–338. doi: 10.1111/j.1365-2788.2010.01363.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Eisenberg N, Cumberland A, Spinrad TL. Parental socialization of emotion. Psychol. Inq. 1998;9:241–273. doi: 10.1207/s15327965pli0904_1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Laible D. Mother-child discourse surrounding a child’s past behavior at 30 months: Links to emotional understanding and early conscience development at 36 months. Merrill-Palmer Q. 2004;50:159–180. doi: 10.1353/mpq.2004.0013. [DOI] [Google Scholar]
- 34.Laible D. Mother-child discourse in two contexts: Links with child temperament, attachment security, and socioemotional competence. Dev. Psychol. 2004;40:979–992. doi: 10.1037/0012-1649.40.6.979. [DOI] [PubMed] [Google Scholar]
- 35.Salmon K, Dadds MR, Allen J, Hawes DJ. Can emotional language skills be taught during parent training for conduct problem children? Child Psychiatry Hum. Dev. 2009;40:485–498. doi: 10.1007/s10578-009-0139-8. [DOI] [PubMed] [Google Scholar]
- 36.Waller R, et al. Bidirectional associations between parental warmth, callous unemotional behavior, and behavior problems in high-risk preschoolers. J. Abnorm. Child Psychol. 2014;42:1275–1285. doi: 10.1007/s10802-014-9871-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Waller R, Hyde LW, Klump KL, Burt SA. Parenting is an environmental predictor of callous-unemotional traits and aggression: A monozygotic twin differences study. J. Am. Acad. Child Adolesc. Psychiatry. 2018;57:955–963. doi: 10.1016/j.jaac.2018.07.882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Pasalich DS, Waschbusch DA, Dadds MR, Hawes DJ. Emotion socialization style in parents of children with callous-unemotional traits. Child Psychiatry Hum. Dev. 2014;45:229–242. doi: 10.1007/s10578-013-0395-5. [DOI] [PubMed] [Google Scholar]
- 39.Crain-Thoreson C, Dahlin MP, Powell TA. Parent–child interaction in three conversational contexts: Variations in style and strategy. New Dir. Child Adolesc. Dev. 2001;2001:23. doi: 10.1002/cd.13. [DOI] [PubMed] [Google Scholar]
- 40.Hoff-Ginsberg E. Mother–child conversation in different social classes and communicative settings. Child Dev. 1991;62:782. doi: 10.2307/1131177. [DOI] [PubMed] [Google Scholar]
- 41.Ginsburg KR, The Committee on Communications. The Committee on Psychosocial Aspects of Child and Family Health The importance of play in promoting healthy child development and maintaining strong parent-child bonds. Pediatrics. 2007;119:182–191. doi: 10.1542/peds.2006-2697. [DOI] [PubMed] [Google Scholar]
- 42.VanDam M, De Palma P. A modular, extensible approach to massive ecologically valid behavioral data. Behav. Res. Methods. 2019;51:1754–1765. doi: 10.3758/s13428-018-1167-8. [DOI] [PubMed] [Google Scholar]
- 43.Gilkerson J, et al. Mapping the early language environment using all-day recordings and automated analysis. Am. J. Speech Lang. Pathol. 2017;26:248–265. doi: 10.1044/2016_AJSLP-15-0169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Shamay-Tsoory SG, Mendelsohn A. Real-life neuroscience: An ecological approach to brain and behavior research. Perspect. Psychol. Sci. 2019;14:841–859. doi: 10.1177/1745691619856350. [DOI] [PubMed] [Google Scholar]
- 45.Hoff E. Context effects on young children’s language use: The influence of conversational setting and partner. First Lang. 2010;30:461–472. doi: 10.1177/0142723710370525. [DOI] [Google Scholar]
- 46.Ramírez-Esparza N, García-Sierra A, Kuhl PK. Look who’s talking: Speech style and social context in language input to infants are linked to concurrent and future speech development. Dev. Sci. 2014;17:880–891. doi: 10.1111/desc.12172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Castro VL, Halberstadt AG, Lozada FT, Craig AB. Parents’ emotion-related beliefs, behaviours, and skills predict children’s recognition of emotion: Parents’ emotion beliefs behaviours. Infant Child Dev. 2015;24:1–22. doi: 10.1002/icd.1868. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Cristia A, et al. A thorough evaluation of the Language Environment Analysis (LENA) system. Behav. Res. Methods. 2021;53:467–486. doi: 10.3758/s13428-020-01393-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Greenwood CR, Thiemann-Bourque K, Walker D, Buzhardt J, Gilkerson J. Assessing children’s home language environments using automatic speech recognition technology. Commun. Disord. Q. 2011;32:83–92. doi: 10.1177/1525740110367826. [DOI] [Google Scholar]
- 50.Oller DK, et al. Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development. Proc. Natl. Acad. Sci. 2010;107:13354–13359. doi: 10.1073/pnas.1003882107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Schwab JF, Lew-Williams C. Language learning, socioeconomic status, and child-directed speech: Language learning, socioeconomic status, and child-directed speech. Wiley Interdiscip. Rev. Cogn. Sci. 2016;7:264–275. doi: 10.1002/wcs.1393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Carpenter JL, Drabick DAG. Co-occurrence of linguistic and behavioural difficulties in early childhood: A developmental psychopathology perspective. Early Child Dev. Care. 2011;181:1021–1045. doi: 10.1080/03004430.2010.509795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Bonica C, Arnold DH, Fisher PH, Zeljo A, Yershova K. Relational Aggression, Relational Victimization, and Language Development in Preschoolers. Soc. Dev. 2003;12:551–562. doi: 10.1111/1467-9507.00248. [DOI] [Google Scholar]
- 54.Warren, S. F. & Walker, D. in Handbook of Research Methods in Developmental Science (ed. Teti, D. M.) 249–270 (Blackwell Publishing Ltd, 2005). 10.1002/9780470756676.ch13.
- 55.Jones AP, Happé FGE, Gilbert F, Burnett S, Viding E. Feeling, caring, knowing: Different types of empathy deficit in boys with psychopathic tendencies and autism spectrum disorder. J. Child Psychol. Psychiatry. 2010;51:1188–1197. doi: 10.1111/j.1469-7610.2010.02280.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Satlof-Bedrick E, Waller R, Olson SL. Emotion versus cognition: Differential pathways to theory of mind for children with high versus low callous-unemotional traits. J. Child Psychol. Psychiatry. 2019;60:1300–1308. doi: 10.1111/jcpp.13078. [DOI] [PubMed] [Google Scholar]
- 57.Lui JHL, Barry CT, Sacco DF. Callous-unemotional traits and empathy deficits: Mediating effects of affective perspective-taking and facial emotion recognition. Cogn. Emot. 2016;30:1049–1062. doi: 10.1080/02699931.2015.1047327. [DOI] [PubMed] [Google Scholar]
- 58.Vasconcelos M, et al. Callous-unemotional traits moderate anticipated guilt and wrongness judgments to everyday moral transgressions in adolescents. Front. Psychiatry. 2021;12:625328. doi: 10.3389/fpsyt.2021.625328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Gervain J. Plasticity in early language acquisition: The effects of prenatal and early childhood experience. Curr. Opin. Neurobiol. 2015;35:13–20. doi: 10.1016/j.conb.2015.05.004. [DOI] [PubMed] [Google Scholar]
- 60.Walker D, et al. Language intervention research in early childhood care and education: A systematic survey of the literature. Early Child. Res. Q. 2020;50:68–85. doi: 10.1016/j.ecresq.2019.02.010. [DOI] [Google Scholar]
- 61.Havighurst SS, et al. An emotion-focused early intervention for children with emerging conduct problems. J. Abnorm. Child Psychol. 2015;43:749–760. doi: 10.1007/s10802-014-9944-z. [DOI] [PubMed] [Google Scholar]
- 62.Lundahl B, Risser H, Lovejoy M. A meta-analysis of parent training: Moderators and follow-up effects. Clin. Psychol. Rev. 2006;26:86–104. doi: 10.1016/j.cpr.2005.07.004. [DOI] [PubMed] [Google Scholar]
- 63.Webster-Stratton C, Reid MJ, Hammond M. Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. J. Clin. Child Adolesc. Psychol. 2004;33:105–124. doi: 10.1207/S15374424JCCP3301_11. [DOI] [PubMed] [Google Scholar]
- 64.Fleming GE, et al. Parent training adapted to the needs of children with callous-unemotional traits: A randomized controlled trial. Behav. Ther. 2022;53:1265–1281. doi: 10.1016/j.beth.2022.07.001. [DOI] [PubMed] [Google Scholar]
- 65.Kimonis ER, et al. Parent-child interaction therapy adapted for preschoolers with callous-unemotional traits: An open trial pilot study. J. Clin. Child Adolesc. Psychol. 2019;48:S347–S361. doi: 10.1080/15374416.2018.1479966. [DOI] [PubMed] [Google Scholar]
- 66.Mermelshtine R. Parent-child learning interactions: A review of the literature on scaffolding. Br. J. Educ. Psychol. 2017;87:241–254. doi: 10.1111/bjep.12147. [DOI] [PubMed] [Google Scholar]
- 67.McDonnell M, Owen JE, Bantum EO. Identification of emotional expression with cancer survivors: Validation of linguistic inquiry and word count. JMIR Form. Res. 2020;4:e18246. doi: 10.2196/18246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Tausczik YR, Pennebaker JW. The psychological meaning of words: LIWC and computerized text analysis methods. J. Lang. Soc. Psychol. 2010;29:24–54. doi: 10.1177/0261927X09351676. [DOI] [Google Scholar]
- 69.Cianchetti C. Early detection of behavioral and emotional problems in school-aged children and adolescents: The parent questionnaires. Clin. Pract. Epidemiol. Ment. Health. 2020;16:7–16. doi: 10.2174/1745017902016010007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Kovacs S, Sharp C. Criterion validity of the Strengths and Difficulties Questionnaire (SDQ) with inpatient adolescents. Psychiatry Res. 2014;219:651–657. doi: 10.1016/j.psychres.2014.06.019. [DOI] [PubMed] [Google Scholar]
- 71.Apicella C, Norenzayan A, Henrich J. Beyond WEIRD: A review of the last decade and a look ahead to the global laboratory of the future. Evol. Hum. Behav. 2020;41:319–329. doi: 10.1016/j.evolhumbehav.2020.07.015. [DOI] [Google Scholar]
- 72.Henrich J, Heine SJ, Norenzayan A. Most people are not WEIRD. Nature. 2010;466:29–29. doi: 10.1038/466029a. [DOI] [PubMed] [Google Scholar]
- 73.Sprecher E, et al. A mixed-methods assessment of coronavirus disease of 2019–era telehealth acute care visits in the medical home. J. Pediatr. 2023;255:121–127.e2. doi: 10.1016/j.jpeds.2022.10.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Adams SN, Seedat J, Neille J. Life under lockdown for children with autism spectrum disorder: Insights from families in South Africa. Child Care Health Dev. 2022;48:1008–1016. doi: 10.1111/cch.12996. [DOI] [PubMed] [Google Scholar]
- 75.Choi Y, et al. Feasibility and acceptability of an online family literacy program in an under-resourced community during the COVID-19 pandemic. J. Dev. Behav. Pediatr. 2023;44:e104–e110. doi: 10.1097/DBP.0000000000001155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Barbaro K. Automated sensing of daily activity: A new lens into development. Dev. Psychobiol. 2019;61:444–464. doi: 10.1002/dev.21831. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Mehl MR. The electronically activated recorder (EAR): A method for the naturalistic observation of daily social behavior. Curr. Dir. Psychol. Sci. 2017;26:184–190. doi: 10.1177/0963721416680611. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Allen, S. F. & Tracy, E. M. in Encyclopedia of Social Work (NASW Press and Oxford University Press, 2013). 10.1093/acrefore/9780199975839.013.181.
- 79.Burt SA, Donnellan MB. Development and validation of the subtypes of antisocial behavior questionnaire. Aggress. Behav. 2009;35:376–398. doi: 10.1002/ab.20314. [DOI] [PubMed] [Google Scholar]
- 80.Burt SA, Donnellan MB. Evidence that the subtypes of antisocial behavior questionnaire (STAB) predicts momentary reports of acting-out behaviors. Personal. Individ. Differ. 2010;48:917–920. doi: 10.1016/j.paid.2010.02.021. [DOI] [Google Scholar]
- 81.Goodman R. The strengths and difficulties questionnaire: A research note. J. Child Psychol. Psychiatry. 1997;38:581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x. [DOI] [PubMed] [Google Scholar]
- 82.Vostanis P. Strengths and difficulties questionnaire: Research and clinical applications. Curr. Opin. Psychiatry. 2006;19:367–372. doi: 10.1097/01.yco.0000228755.72366.05. [DOI] [PubMed] [Google Scholar]
- 83.Piacentini JC, Cohen P, Cohen J. Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones? J. Abnorm. Child Psychol. 1992;20:51–63. doi: 10.1007/BF00927116. [DOI] [PubMed] [Google Scholar]
- 84.Kimonis ER, et al. Callous-unemotional features, behavioral inhibition, and parenting: Independent predictors of aggression in a high-risk preschool sample. J. Child Fam. Stud. 2006;15:741–752. doi: 10.1007/s10826-006-9047-8. [DOI] [Google Scholar]
- 85.Frick PJ. Inventory of callous–unemotional traits. PLoS One. 2004 doi: 10.1037/t62639-000. [DOI] [Google Scholar]
- 86.Kimonis ER, et al. Assessing callous–unemotional traits in adolescent offenders: Validation of the inventory of callous–unemotional traits. Int. J. Law Psychiatry. 2008;31:241–252. doi: 10.1016/j.ijlp.2008.04.002. [DOI] [PubMed] [Google Scholar]
- 87.Bansal PS, Babinski DE, Waxmonsky JG, Waschbusch DA. Psychometric properties of parent ratings on the inventory of callous–unemotional traits in a nationally representative sample of 5- to 12-year-olds. Assessment. 2022;29:242–256. doi: 10.1177/1073191120964562. [DOI] [PubMed] [Google Scholar]
- 88.Waller R, et al. Factor structure and construct validity of the parent-reported inventory of callous–unemotional traits among high-risk 9-year-olds. Assessment. 2015;22:561–580. doi: 10.1177/1073191114556101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Hegefeld HM, Satpute AB, Ochsner KN, Davidow JY, Nook EC. Fluency generating emotion words correlates with verbal measures but not emotion regulation, alexithymia, or depressive symptoms. Emotion. 2023 doi: 10.1037/emo0001229. [DOI] [PubMed] [Google Scholar]
- 90.Pennebaker, J., Chung, C., Ireland, M. & Gonzales, A. Linguistic Inquiry and Word Count: LIWC [Computer software]. LIWC.net. LIWC.net (2007).
- 91.Boyd, R. L., Ashokkumar, A., Seraj, S. & Pennebaker, J. W. The development and psychometric properties of LIWC-22. https://www.liwc.app (2022).
- 92.Wickham H, et al. Welcome to the Tidyverse. J. Open Source Softw. 2019;4:1686. doi: 10.21105/joss.01686. [DOI] [Google Scholar]
- 93.Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting Linear Mixed-Effects Models using lme4. ArXiv14065823 Stat. http://arxiv.org/abs/1406.5823 (2014).
- 94.Wickham H. ggplot2. Springer; 2016. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
De-identified datasets and analysis scripts are on Open Science Framework (https://osf.io/ytzmn/?view_only=a0d03ffcbfc8493f98b8246a3f9135ed).