TABLE 1.
List of salient developmental constructs across the lifespan, paired with theoretically-relevant daily activities and sensing solutions. All mention of annotation refers to coding of data by trained human annotators; all mention of “detection” refers to automated coding via trained machine learning algorithms
Developmental construct | Relevant behaviors/exposures | Sensing possibilities | Sample studies |
---|---|---|---|
Temperament & Personality | Activity Daily behavior, routines |
Amount of motion from accelerometer Annotated from wearable camera; EMA |
Buss et al. (1980) Brown et al. (2017) |
Child stress and emotional adaptation | Child mood & distress Regulation Context of child distress |
Early: Crying or laughing detected from wearable audio Later: EMA Early: Duration to soothe detected via wearable audio; Later: EMA Sporadic annotation (e.g. time locked to tantrums detected from wearable audio) |
Rao et al. (2014); Kim and Clements (2015) Gunthert and Wenze (2011); Silk et al. (2011) Ludwig (2018); Silk, Steinberg, and Morris (2003) |
Caregiving characteristics | Tone of interactions Physical presence and contact Joint activity Contingent language Parental Sensitivity |
Detected from wearable audio Detected from bluetooth or wearable motion sensors Annotated reading or playing; detected mutual gaze from wearable camera or audio Detected via LENA wearable audio algorithms Sporadic annotation (e.g. event-locked to distress detected from wearable audio or within audio “snippets”) |
Black et al. (2013); Weusthoff et al. (2013)
Olguin et al. (2009); Yao et al. (under review) Rehg et al. (2013); Soderstrom and Wittebolle (2013) Zimmerman et al. (2009) Tobin et al. (2015) |
Parental stress | Mood Neurobiological stress reactivity |
EMA Ambulatory cortisol, wearable physiology monitors |
Gunthert and Wenze (2011) Schlotz (2011); Hovsepian et al. (2015) |
Household characteristics | Chaos of home environment Household routines Food availability |
Detected via wearable or static audio or camera Regularity of meal-time detected via water or electrical meter Wearable camera |
Cook etal. (2018) Froehlich et al. (2009); Gupta et al. (2010) Jia etal. (2018) |
Early perceptual development | Visual and auditory experience Gross motor experience Fine motor experience |
Wearable cameras and audio recorders Posture and fall detected via wearable motion sensors Wrist-worn motion sensors; toys with embedded motion sensing |
Smith et al. (2015) Nam and Park (2013) Varkey, Pompili, and Walls (2012); Verplaetse (1996); Westeyn et al. (2012) |
Language learning | Language input and contingency of parental speech | Detected via wearable audio (e.g. via LENA algorithms) | Zimmerman et al. (2009) |
Attention & executive function | Daily Cognitive assessments Time spent distracted in attentional focus |
Active assessment collected via mobile phone app Detected via wearable motion sensors Cellphone use monitoring application |
Maekawa, Anderson, de Brecht, and Yamagishi (2018) Tawari et al. (2014) Wang, Chen et al. (2014) |
Peer, teacher, or family interactions (incl. e.g. marital or sibling conflict) | Quantity of interactions Classroom activity Quality of interactions |
Contingent speech detected via wearable audio Proximity detected via wearable Bluetooth sensors Detected via static audio recordings Conflict or supportiveness annotated from snippets via wearable audio recorder |
Berke et al. (2011) Olguin et al. (2009) Wang, Pan, Miller, and Cortina (2014) Slatcher and Trentacosta (2012); Tobin etal. (2015) |
Puberty | Hormonal changes | Ambulatory assessment of saliva samples | Schlotz (2011) |
Identity formation | Visible advertising or stereotypes | Wearable camera with some automated assistance | Zhang and Rehg (2018) |
Academic success | Time spent studying Afterschool activities Classroom engagement |
Detected via multimodal cellphone sensor monitoring Geocoded from GPS data Detected via pressure-sensitive seats, motion and physiological sensors |
Wang, Chen et al. (2014) Byrnes et al. (2017) Dragon et al. (2008) |
Risky activity (sex, drug abuse) | Frequency of content words Alcohol or other substance use Common activity by location |
Transcription of snippets from wearable audio Detected via multimodal cellphone sensor monitoring; specialized biomarker sensors Geocoded from GPS data |
Pennebaker, Mehl, and Niederhoffer (2003) Bae et al. (2017);Bertz et al. (2018) Byrnes et al. (2017) |
Aging | Cognitive and physical decline | Detected via static multimodal platforms | Kaye et al.(2011) |
Physical & mental health | Psychiatric symptoms Sleep; physical activity; eating episodes |
EMA Detected via motion sensors |
aan het Rot, (2012) Bussmann and Ebner-Priemer(2012); Robillard et al. (2015); Thomaz et al. (2015) |
Other relevant exposures | Phone use Nutrition Sugar consumption |
Cell phone monitoring application Annotated via participant-collected photo logs Continuous glucose monitoring sensors |
Harari et al. (2017) Cordeiro et al. (2015) Juvenile Diabetes Research Foundation (2008) |