Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 5;16(2):e0245793. doi: 10.1371/journal.pone.0245793

A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research

Laurel A Fish 1,*,#, Emily J H Jones 2,#
Editor: Barbara Schouten3
PMCID: PMC7864397  PMID: 33544777

Abstract

Remote in-home infant monitoring technologies hold great promise for increasing the scalability and safety of infant research (including in regard to the current Covid-19 pandemic), but remain rarely employed. These technologies hold a number of fundamental challenges and ethical concerns that need addressing to aid the success of this fast-growing field. In particular, the responsible development of such technologies requires caregiver input. We conducted a survey of the opinions of 410 caregivers on the viability, privacy and data access of remote in-home monitoring technologies and study designs. Infant-friendly wearable devices (such as sensing body suits) were viewed favourably. Caregivers were marginally more likely to accept video and audio recording in the home if data was anonymised (through automated processing) at point of collection, particularly when observations were lengthy. Caregivers were more open to international data sharing for anonymous data. Caregivers were interested in viewing all types of data, but were particularly keen to access video and audio recordings for censoring purposes (i.e., to delete data segments). Taken together, our results indicate generally positive attitudes to remote in-home monitoring technologies and studies for infant research but highlight specific considerations such as safety, privacy and family practicalities (e.g. multiple caregivers, visitors and varying schedules) that must be taken into account when developing future studies.

Introduction

Our burgeoning understanding of neurocognitive development has been made possible by the development of novel technologies [13]. Often requiring a team of trained specialists working in highly controlled testing environments [4,5], these measures are typically administered in university babylabs [4,6]. Although there are a number of merits to lab-based experimental designs, such as the control of testing environments and structured assessments to elicit behaviours of interest [7,8]; there are broadening debates over the ecological validity of the measures obtained. Babylabs are unnatural settings [6,7,9], which may distort the targeted natural behaviour under observation [10]. Additionally, babylabs can only facilitate relatively small windows of data collection, and in longitudinal designs this can result in data points scaled months apart. Researchers are unable to capture the range of environments infants experience during development, limiting the range of measurable behaviours [7,8]. Finally, testing in babylabs across the world has recently been suspended due to the Covid-19 pandemic; this disruption to data collection will be particularly damaging for longitudinal cohorts.

A more ecologically valid, representative and Covid-safe alternative is in-home monitoring of an infant’s daily activity using remote technology [8]. In addition to allowing the measurement of an infant’s behaviour in their natural environment, such approaches allow longer and more frequent epochs of recording. These provide the opportunity to capture a range of behaviours, including those that happen rarely [11] (e.g. a child’s first steps) and/or infrequently [8] (e.g. tantrums). Such techniques can capture more accurately the temporal structure and variability of dynamic interacting behaviours and environments [8,12]. Similarly, longer measurement periods may also shed new light on behaviours that have traditionally been measured over relatively short epochs of data collection [12,13]. Additionally, as remote technologies can be implemented by caregivers, they also provide an opportunity for socially distanced data collection at a more scalable level and may facilitate the participation of families who would find it difficult to come to a lab-based study (e.g. those with disabilities, working caregivers or remotely located families).

Commercially, remote home-monitoring technology for infants is not a new concept, with an abundant and expanding range of devices targeted towards and readily accepted by caregivers [14]. User-friendly, commercial devices do not allow access to raw, high resolution data and are therefore poorly equipped for more complex research questions [14]. For research, customized devices are preferable, where a team of multidisciplinary experts manufacture measurement tools with research-grade functionality that are also usable and aesthetic [8]. Such devices include baby bodysuits woven with sensing threads (herein refered to a smart suits; [1517]), sensing ankle/wrist bands [18,19], sensing sticker electrodes [2022], home camera/audio devices [23,24] and smartphone apps [25,26]. Such remote devices are providing unique research potential for in-home infant monitoring. For example, using a specially designed infant baby-grow with a built in actigraph, GPS and microphone, researchers demonstrated, in the home, extreme low and high levels of ambient noise are associated with reduction in spontaneous movement in infants [27].

Despite the growing promise, the implementation of home-monitoring tools in developmental research is still limited to a small number of studies with relatively small populations [28]. One critical area that has received limited attention is the views of primary caregivers on these tools. A user-centered model is essential for the development of first-rate technology which elicits minimum caregiver burdens and sacrifice [29,30]. Equally, determining caregiver opinions on this technology alongside the context of possible assessment designs is important. This knowledge is critical to optimise the successful development and broader deployment of remote monitoring technologies as well as shaping the possible questions and designs that researchers are able implement [28]. To our knowledge there have been few systematic attempts to canvass caregiver opinions on remote infant monitoring technology in the context of potential study designs on a UK cohort. In our view, to gauge acceptance of UK caregivers feedback is most critical in three areas; tool viability, privacy and data access.

Viability

First, optimising the viability of tools and assessment designs so they are deemed acceptable, practical and minimally disruptive by caregivers is necessary for ensuring engagement and uptake in future investigations. In terms of viability, remote tools and assessments can be categorised by the required amount of active care [8]. For example, when measuring heart rate, having to carefully apply and remove adhesive sticker sensing electrodes requires a lot more active care relative to using sensing smart suit or bands. These can be easily and quickly put on/taken off the infant and are not too far removed from daily dressing routines, thus are low active care devices. However, currently available sensing suits and bands do not provide sufficient data quality, particularly for physiological data where sensors often require good contact with skin and are prone to movement artefacts [31,32]. Similarly, video and audio devices can be bracketed into levels of active care. Static devices (e.g. those attached to cot or ceiling) require a lot less active care than on-body devices, which require charging or general maintenance (e.g. placing on infant and positioning). Although merited, static devices can often restrict research designs, with the need for careful consideration as to the spatial location of the behaviour of interest [8]. LENA [33], a lightweight wearable audio device, is already showing high feasibility and acceptance having been deployed in a large number of studies in the field of infant development [1]. Despite this, caregivers’ opinions on static low active care versus on-body high active care video devices is unclear. Knowledge of parent’s opinions of different remote devices with differing levels of required active care will equip researchers to consider the trade-off between quality/richness and viability–an important consideration for more lengthy or longitudinal studies where attrition is an inherent concern.

The contextualisation of data is another key requirement of remote designs (e.g. physiological measures that do not provide identifiable data). In a lab setting, environments are controlled, but in a home setting the context in which the data is being collected can vary dramatically both between infants (e.g. single child, multi-generational household, etc) and within an infant across a day (e.g. dinner time, playtime, bedtime etc). Recording this contextual information is sometimes required in order to understand the data (e.g. did an infant’s heartrate increase because they were crying or laughing?). Contextualising information could be collected using smartphones via self-reporting [34]. For example, a caregiver could input their infant’s current activity in response to a prompt. The increasing societal ubiquity of smartphones [35] make them an ideal tool for the collection of both contextualisation data and primary data [35,36], where timely notifications for question responses may reduce biasing retrospective reporting. Furthermore, many infant sensing devices in the commercial market already utilise smartphone apps for end-user device interaction-platform [37]. Utilising smartphones alongside wearable sensing technologies hold potential to enrich remote monitoring datasets, making them more informative. Understanding caregivers’ opinions on the use of smartphones for interacting with remote infant monitoring studies will gauge acceptability for future investigations.

Privacy

Using remote technologies for infant monitoring protocols in the home raises critical questions concerning privacy, particularly regarding transmission, storage and analysis of data. Such concerns of privacy are in part covered by legal frameworks such as the General Data Protection Regulation (GDPR) in the EU (2016/679; [38]), but the additional oversight of local and national ethics boards should be informed by the opinions of caregivers.

These privacy concerns are particularly relevant for non-anonymous, highly identifiable data (e.g. video and audio). A recent report on a USA-based sample of parents indicated privacy-preserving techniques minorly improved willingness to participate in the collection of identifiable data on their infant [28]. Such privacy-preserving techniques included the implementation of computer algorithms to automatically extract measures of behaviour and remove identifiable information [28]. However, this research did not investigate the impact of privacy-preserving techniques on willingness to participate across different assessment structures (e.g. across differing periods/times of day) [24]. Considering how participants view the efficacy of privacy-preserving measures in the context of different research designs will enable researchers to make informed decisions on the trade-off between data quality and participant uptake/attrition.

Data sharing is another issue bracketed within privacy. Data sharing is encouraged by the Open Data Movement [39], a campaign to render datasets accessible and reusable. This is useful for improving the transparency and reproducibility of original data, and can facilitate interdisciplinary and new research [40]. To adhere with American Psychological Association research standards [41] and General Data Protection Regulations [38] consent for data sharing must be taken explicitly. However, it is critical to gather caregiver views on their degree of comfort with different types of data sharing, particularly across data with differing levels of anonymity (e.g. raw data or those that have been anonymised through aforementioned privacy-preserving techniques). A previous survey on caregivers opinions established that anonymisation of data produced a weak non-significant increase in willingness to share [28]. However, this study was conducted in the US and did not gauge the willingness to share data across different geographic areas, which will ultimately determine the degree to which data is “open” within the research community.

Data access

One potential application of intense in-home data collection is to identify patterns of development. This raises the question of data access–to what extent do caregivers want to access the data collected on their child, and in what format can and should that be provided? In lab-based studies it is common for parents to have no access to collected data unless official requests are made (e.g. through the Data Protection Act in the UK). However, this may not be desirable when considering more intense multi-device remote home-based approaches. This is particularly relevant considering previous investigations have established a 66–67% increase in willingness to share sensitive data when provided the opportunity to receive access to summary data [28]. However, it remains unclear as to whether caregivers value data access because of curiosity about their infant’s development, or whether they want to be able to check over data streams from more intrusive measures (e.g. video data). The latter is particularly relevant when considering both ethical rights for participant withdrawal/retrospective data redaction as well as EU GDPR’s right to erasure of identifiable data [38]. Gauging reasons for desiring data access (e.g. for viewing or censoring) across data with differing levels of anonymity will enable researchers to consider the pro/cons as well as the format of data access they should provide in their studies.

Study goals

The goal of our study was to canvass the opinions of UK caregivers on the use of remote monitoring technologies in order to provide guidance for future research studies employing these approaches in similar UK based labs/research groups. Specifically, we developed an online survey to gauge the attitudes of caregivers of young children/infants towards a range of home-based technologies and assessment designs for research into infant psychophysiology/motor and behavioural development. Our questions were delivered in the context of real-world examples of such technologies and assessments to provide a concrete framing in which to ascertain realistic opinions from responders. We addressed our core themes, operationalising preferences through the specific metrics of likelihood, practicality and duration/time of participation.

Viability

  • Sticker sensing electrodes versus smart suits: For the collection of infant psychophysiological/motor data, are lower active care infant wearable technologies (e.g. smart suits) preferable to more traditional higher active care technologies (e.g. sensing electrode stickers)?

  • Static versus body image-only video recording devices: Are static low active care video recording devices preferable to all-encompassing high active care on-body video recording devices?

  • Smartphones: To what degree would caregivers wish to interact with researchers via smartphone technology?

Privacy

  • Video and audio recording with/without privacy preservation: For the collection of more highly identifiable data, do caregivers prefer image-only video or audio recording of their infants, and how do caregivers view privacy-preserving automatic pre-processing versus manual non-anonymising pre-processing of video/audio data?

  • Data sharing: Does type of technology alter who caregivers are willing to share their data with?

Data access

  • What types of data access do caregivers want?

Future participation

  • What extent are caregivers interested in the participation of remote in-home infant monitoring studies?

Methods

Recruitment procedure

We distributed the survey (See S1 File) to participants via two main streams over 6 months. First, an invitation containing a weblink was emailed via the SurveyMonkey Platform (surveymonkey.com), a public online platform for survey distribution and response collection. We emailed 1061 Birkbeck University of London’s BabyLab UK-based database volunteers. Participants are recruited into this database via word of mouth, magazine adverts, social media and search engines. All members of the database had previously consented for such contact, making them a relevant sample as they would be likely to participate in future studies incorporating the topics mentioned in the survey. Weblinks were also shared via social media (Twitter and Facebook) accounts belonging to Birkbeck University of London’s BabyLab. In both recruitment methods, weblinks redirected responders to a webpage containing the survey debrief and instructions. Consent was indicated via tick box, with non-consenters redirected to an “end of survey” webpage to close manually. Participants received no monetary compensation for their time.

Participants

In total 513 people clicked on the weblink that directed them to the survey. Eight people declined consent and a further 95 people consented but did not answer any questions, therefore were not included in analysis. In total, we retained data from 410 individuals, with 333 individuals completing the entire survey (See S2 Table 1 and S2 Fig 1 for attrition rates in S2 File).

We developed the survey for the purpose of this study (See S1 File for the full non-copyright survey). The survey consisted of 61 questions (8 sections), which took an average of 12 minutes 18 seconds to complete. First, all responders provided basic information about their youngest child (age, gender and ethnicity) and family (parent education, household income, family health). Sections 2–7 asked about the responder’s attitudes to the following technologies: smart suits, sensing electrode stickers, wrist/ankle bands, image-only video recording, audio recording, and smartphones (see S3 Table 1 for summary of technologies in S2 File). Section 8 asked attitudes to data access and sharing. Finally, we asked whether responders would be interested in future participation in a similar study.

The survey consisted of multiple-choice questions on the following topics: a) the likelihood of participation in studies with different designs; b) the practicality of technologies over different time scales (to assess overall practicality while accounting for the possible effect of length of study on practicality); c) the optimum length/time of participation; d) contact preference during the study (e.g. acceptable number of smartphone prompts). Likert style response options were offered to responders for questions corresponding to likelihood of participation (5 options: “Not at all”, “Slightly”, “Moderately”, “Very”, “Extremely”) and practicality (4 option “Not at all”, “Somewhat Impractical”, “Somewhat Practical”, “Practical”). Nominal multiple-choice options were offered for all other questions. To provide insight into unprecedented opinions, optional general comment boxes were provided in most sections for open-ended responses. Before being distributed, the survey was piloted on a small group of caregivers and adjusted accordingly. Once scripted, the survey was made available using SurveyMonkey.

Ethical approval

Ethical approval was provided by Birkbeck University of London Research Ethics Committee (ID: 161776).

Analysis

For each multiple-choice question, participants were given the option “prefer not to answer”, which were considered as missing data in the analysis. For each comparative analysis, missing data were pairwise deleted. The Likert style scale responses were transformed to ordinal scales starting at 1 for the least favourable response and ending with 4 (practicality) or 5 (likelihood) for the most favourable. Statistical analysis was conducted using SPSS (IBM version 25.0.0.1; [42]) and R (version 3.5.1; [43]) using non-parametric tests due to the ordinal and categorical nature of the data. We used Leximancer Desktop 5.0 [44] to generate concepts and themes from open field answers for each general comment box. This analysis was not intended to be exhaustive, but to highlight themes beyond those considered when designing the survey. The Leximancer’s concept map tool was utilised to display topographically the prevalence and co-occurrence of generated themes/concepts within the text (See S4 for more methodological detail on Leximancer in S2 File). Analysis was divided into our three core themes (discussed above) assessed in the context of a set of technologies that, in our minds, are furthest advanced for remote infant monitoring research.

Viability

One important factor influencing viability is the type of technological approach employed. We examined participant ratings to questions regarding acceptability and practicality of the remote collection of infant data using a) sticker sensing electrodes versus smart suits, b) static versus body image-only video recording devices, and c) smartphones.

Sticker sensing electrodes versus smart suits. We compared ratings given to sticker sensing electrodes and smart suits for questions regarding the following: a) likelihood of participating with each technology; b) practicality of using each technology for a “Short Period” or “Extended Period”; c) preferred length of participation for each technology. We used Wilcoxon Match-Pairs Signed-Ranks Test (WMPSR) to analyse the effect of technology on changes to likelihood rating. We employed a Friedman analysis of Variance (FANOVA) with pairwise Dunn-Bonferroni test to investigate differences in practicality responses to the four technology/length of study combinations (smart suits for “Short Period”, smart suits for “Extended Period”, sticker sensing electrodes for “Short Period”, sticker sensing electrodes for “Extended Period”. Using Chi-Square test with Bonferroni corrected binominal pairwise comparisons, we analysed whether, for smart suit and sticker electrodes invidually, responses to preferred length of participation were evenly distributed across time intervals (“Month”, “Week”, “Weekend”, “Now and then”, “Once”, “Not at all”). Finally, to investigate whether preferred time interval for participation length differed between smart suits and sticker sensing electrodes, we used Bhapkar tests with 2*2 contingency Bonferroni corrected McNemar post-hoc test to compare selecting versus not selecting each time interval. Separate Leximancer concept/theme maps were generated to depict key themes and concepts noted within open-ended response boxes for each technology. Similar analysis comparing smart suits and sensing electrode stickers to wrist/ankle bands was also conducted (Methods and Results are reported in S5 in S2 File).

Static versus body image-only video recording devices. To examine acceptability of image-only video recording with differing levels of active care, we compared likelihood ratings given to static cot cameras with low active care or high active care body cameras. We conducted a Wilcoxon Match-Pairs Signed-Ranks Test (WMPSR) to determine the effect of video recording device on changes to likelihood rating.

Smartphones. To examine the acceptability of smartphones for the remote assessment of infants, we analysed responses to questions regarding: a) likelihood of using smartphones; b) practicality of using smart for a “Short Period” or “Extended Period”; c) preferred response time; c) preferred number of prompts. We employed One-Sample Wilcoxon Signed Rank Tests (O-SWSRT) to examine the degree to which the sample median of likelihood answers differed from the response median (2.5). We analysed how opinions on practicality changed for different durations of app interaction using WMPSR. We then analysed preferred response time (“Morning, “Afternoon”, “Evening”, “Anytime” or “Never”) and prompt number (“Six”, “Four”, “Two”, “One”, “None” or “No Limit”) using Chi-square with Bonferroni corrected binomial pairwise comparisons to determine if frequency of responders per response option significantly differed. A Leximancer concept/theme map was generated to depict open-ended response regarding smartphones.

Privacy

In-home remote monitoring of infant participants raises privacy issues. We examine caregiver ratings to questions regarding a) video and audio recording with/without privacy preservation and b) data sharing.

Video and audio recording with/without privacy preservation. We compared ratings of video and audio recordings with and without privacy preserving pre-processing for questions regarding a) likelihood of participation, b) preferred length of participation, and c) when they would be willing to be recorded. We also compared ratings on practicality of participating with video or audio recording for a “Short Period” or “Extended Period”. We used Friedman Analysis of Variance (FANOVA) with pairwise Dunn-Bonferroni test to analyse whether: a) different recording device/processing option combinations affect participation likelihood ratings; and b) different recording device/recording duration combinations affect practicality ratings. Within each recording device/processing option combination, we conducted Chi-square with Bonferroni corrected binomial pairwise comparisons to determine whether participants’ preferences were evenly distributed across participation length intervals (“Month”, “Week”, “Weekend”, “Now and then”, “Once”, “Not at all”) and recording time intervals (“Day and Night”, “Day”, “Night”, “Specific time”, “Never”). Using Bhapkar tests with Bonferroni corrected McNemar pairwise comparisons, we examined the effect of technology and processing method on a) preferred participation length and b) time of recording. Separate Leximancer concept/theme maps were generated to depict themes within free text comments for video and audio recording.

Data sharing. To determine responders’ opinions on sharing data with research teams, we assessed responses to questions asking who responders would be willing to share their data with. As the survey question allowed multiple responses per individual, we considered the most international answer as the preferred data sharing option (“Across the world” and “All” were considered as the same response “International”). Chi-squared goodness-of-fit tests were employed to determine whether the frequency of data sharing preference was evenly distributed across different research teams (e.g. “International”, “Europe”, “UK”, “Babylab” or “None”) for a) anonymous data (e.g. heart rate) and b) non-anonymous data (e.g. video recording). Using Bhapkar tests with Bonferroni corrected McNemar pairwise comparisons, we also investigated whether participants responses to likelihood of sharing data with different research teams varied between the degree of identifiability of the data format.

Data access

Understanding whether participants may want to view their data and/or censor by accepting/deleting their recordings is crucial because it raises important questions over the appropriate types of data access researchers need to plan to provide. This could have significant resource and ethical implications in future investigations, as well as a potential impact on data redaction or participant withdrawal. To determine what types of data access caregivers wanted for each type of data, we examined responses to questions regarding accessing data for the purpose of a) viewing and b) censoring. We used Cochran’s Q test with Dunn-Bonferroni pairwise comparisons to determine if the frequency of responders wanting to view or censor data significantly differed between technologies.

Future participation

Finally, we investigated interest and eligibility to participate by conducting Chi-Square Goodness-of-Fit analysis with Binomial pairwise comparisons. We also asked whether caregivers would be happy to use clean suits other families have used (S12 Note A in S2 File). Separate Leximancer concept/theme maps were generated for open-ended response. These results will provide an overall estimate of the likely scalability of such research approaches.

Results

Sample demographics

Throughout the survey, we asked responders to consider their youngest child (Mean age = 29.90 months, SD = 27.66 months) when answering questions. Of the 410 responders, 393 were the child’s mother, 16 the father and one the grandparent. Sample demographics are presented in Table 1. See S6 for additional demographics on parent health and primary caregivers in S2 File.

Table 1. Sample demographics.

%
Child’s Gender
Female 51.20
Male 48.00
Non-binary 0.20
Child’s Ethnicity
White 80.24
Black, Asian or Minority Ethnic Group 19.02
Household Annual Income
< £20,000 3.80
£20,000 - £29,000 8.59
£30,000 - £39,000 10.39
£40,000 - £59,000 14.39
£60,000 - £79,000 17.38
£80,000 - £99,000 13.59
£100,000 - £149,000 16.68
>£149,999 10.39
Parental Education Mother Father
Primary 0.30 1.50
Secondary 10.60 22.40
Tertiary 88.90 74.90
Unknown 0.00 0.80

Note: Those that skipped each question have not been included in the percentage calculation for that question. For each category, the remaining percentage is for those who responded, “prefer not to answer”.

Viability

The type of technological approach is an important factor than can influence the viability of remote in-home monitoring. Our analysis is divided into the following subheadings as per the research topic: Sticker sensory electrodes versus smart suits, cot versus body image-only video recording and smartphones.

Sticker sensing electrodes versus smart suits

To examine acceptability and practicality, for each question we report comparisons between ratings assigned to sticker sensing electrodes and smart suits (for further analysis with comparisons to wrist-/ankle-bands see S5 in S2 File).

Comparison of likelihood. More participants indicated they would be more likely to use smart suits (Mdn = 5.00, M = 4.37, SD = 0.79) than sensing electrode stickers (Mdn = 3.00, M = 2.91, SD = 1.32), (see Fig 1A). Wilcoxon Matched-Pairs Signed-Ranks Test (WMPSR) revealed significantly more participants (72.56%) rated using smart suits more likely than sensing electrode stickers than the opposite (2.37%), z = -14.24, p < .001, with moderate effect size (r = -0.52). Of the total sample, 24.80% rated participation with each technology as equally likely.

Fig 1. Percentages of response frequency for questions concerning viability of smart suits and sticker (electrode) technologies.

Fig 1

(A) Participation likelihood rating; (B) Practicality rating over differing durations. (C) Preferred participation duration. Note. Percentages were calculated out of all responders who answered per question, including “Prefer not to answer” responses.

Comparison of practicality. Averaged across both lengths of time, 73.97% of participants indicated smart suits as more practical than sensing electrode stickers (Fig 1B). A Friedman Analysis of Variance (FANOVA) identified a significant difference in practicality rating between using smart suits for a “Short Period” (Mdn = 4.00, M = 3.50, SD = 0.62), smart suits for an “Extended Period” (Mdn = 3.00, M = 2.85, SD = 0.88), sensing electrode stickers for a “Short Period” (Mdn = 2.00, M = 2.14, SD = 0.92) and sensing electrode stickers for an “Extended Period” (Mdn = 1.00, M = 1.58, SD = 0.74), χ2(3, N = 358) = 686.17, p < 0.001. A Kendall W of .639 was reported, indicating a good level of agreement among responders. Dunn post-hoc tests with Bonferroni adjustments (S7 Table 1 in S2 File) revealed responders significantly rated using smart suits for a “Short Period” as most practical (p< 0.001).

Comparison of length of participation. Participants were willing to use smart suits for extended periods (“Week” or “Month”) but sensing electrode stickers were rated more preferred for shorter periods (Fig 1C). A Bhapkar test confirmed that participation length was significantly longer for smart suit than sensing electrode sticker technologies, χ2(5, N = 372) = 554, p < 0.001. See S7 Note A for detailed description of results in S2 File.

Open-ended responses. Concept maps depicting the prevalence and co-occurrence of themes and concepts in the open-ended response question for smart suits and sensing electrode stickers were generated (see Fig 2A & 2B). “Hygiene” was the most commented theme for smart suits. Concerns surrounding “Wires” was most commonly mentioned for sensing electrode stickers (see Tables in Fig 2A & 2B).

Fig 2. Theme/concept maps depicting prevalence and co-occurrence of words from open-ended response questions for.

Fig 2

(A) smart suits and (B) sticker electrodes. Tables display each theme and its relative hit number for relative technology.

Static versus body image-only video recording devices. To examine acceptability of video recording with differing levels of active care, we compared participants ratings on static cot camera versus body camera for image-only video recording.

Comparison of likelihood. The majority of the group (76.31%) indicted no differences in likelihood ratings between cot camera (Mdn = 4.00, M = 3.79, SD = 1.18) and body camera (Mdn = 4.00, M = 3.79, SD = 1.16), (Fig 6A). Of the 23.69% of participants who changed their response, WMPSR revealed no significant preference between on-body camera and the cot camera, z = -112.00, p = .91.

Fig 6. Theme/concept maps depicting prevalence and co-occurrence of words from open-ended response questions.

Fig 6

(A) Video recording and (B) audio recording. Tables display each theme and its relative hit number.

Smartphones

Comparison of likelihood. Of the total sample, 91.37% of participants indicated they would be “Moderately” to “Extremely” likely to use a smartphone to record/interact with the study (Fig 3A). Median likelihood rating (Mdn = 5.00, M = 4.16, SD = 1.06) was significantly higher than the score median (2.5), Z = 15.169, p < .001, with a moderate effect size (r = .83).

Fig 3. Percentages of responses to questions on interacting with home testing via smartphones.

Fig 3

(A) Participation likelihood rating. (B) Practicality of different participation durations. (C) Best time for immediate response. (D) Preferred prompt number. Note. Percentages were calculated out of all responders who answered per question, including “Prefer not to answer” responses. SW = Somewhat.

Comparison of practicality. Of the total sample, 62.02% of people did not think duration of the study would affect the practicality of smartphone use (Fig 3B). Overall, median practicality responses were equal for using the smartphones for a “Short Period” (Mdn = 4.00, M = 3.11, SD = 0.81) and for an “Extended Period” (Mdn = 4.00, M = 2.63, SD = 0.89). For the 37.98% of the sample who expressed a preference, WMPSR revealed significantly more participants (92.97%) indicated using smartphones for a “Short Period” more practical than over an “Extended Period” than those who indicated the opposite (7.03%), z = -9.341, p < .001, to a small effect (r = 0.35).

Preferential response time. Of the total sample, 73.33% of caregivers would be more likely to respond to smartphone prompts “Anytime” or in the “Evening” respectively, (Fig 3C). Proportions of preferred response time were unequal, χ2(4, N = 335) = 155.49, p < .001, with a small chance-corrected effect size (R = 0.11). “Evening” and “Anytime” were deemed more favourable than all other options (p < 0.001), with no significant difference between the two (p = 1.00; S8 Table 1 in S2 File).

Prompt number. Of the total sample, 77.46% of caregivers would be most likely to respond to 2–4 prompts a day (Fig 3D). Responses were not equally distributed, χ2(5, N = 335) = 244.49, p < .001, Cramer’s V = 0.38. Bonferroni corrected binomial tests (S8 Table 2 in S2 File) revealed two prompts (39.68%) and four prompts (37.78%) were equally favoured (p = 1.00), and were both significantly more preferred than all other prompt options (p < 0.001).

Open-ended responses. Concept maps depicting the prevalence and co-occurrence of themes and concepts in the open-ended response question for smartphones were generated (see Fig 4). As indicated by the number of hits, “Time-consuming” was the most commented theme (see Fig 4).

Fig 4. Theme/concept maps depicting prevalence and co-occurrence of words from open-ended response questions regarding smartphones.

Fig 4

Table displaying each theme and its relative hit number.

Privacy

In-home remote infant monitoring studies, particularly those with highly identifiable image-only video and audio recording, raise privacy issues. One way to address this concern is to pre-processing video and audio data such that the original identifiable recordings are not stored. We aimed to examine caregiver opinions according to the following two subsections: video and audio recording with/without privacy preservation and data sharing.

Video and audio recording with/without privacy preservation

Comparison of likelihood. Respectively, 51.66%, 55.37% and 55.75% of caregivers did not consider privacy preserving technique to change their likelihood of participation with on-body camera, cot camera and audio recording. Of those who changed their response, 84%, 84.57%, and 86.67% preferred automatic processing options over manual processing, respectively for on-body camera, cot camera and audio recording (Fig 5A). FANOVA identified an overall significant difference in ratings of likelihood in accepting manually processed body camera (Mdn = 3.00, M = 3.30, SD = 1.26), automatically processed body camera (Mdn = 4.00, M = 3.79, SD = 1.16), manually processed cot camera (Mdn = 4.00, M = 3.39, SD = 1.28), automatically processed cot camera (Mdn = 4.00, M = 3.79, SD = 1.18), manually processed audio (Mdn = 3.00, M = 3.43, SD = 1.17) and automatically processed audio (Mdn = 4.00, M = 3.85, SD = 1.11), χ2(5, N = 335) = 219.633, p < 0.001. Kendall W of .131 indicating a weak level of agreement among responders. Dunn post-hoc tests with Bonferroni adjustments (S9 Table 1 in S2 File) revealed significant differences in ratings between manual and automatic processing for all technologies (p < 0.001), with automatic processing rated higher than manual. No significant differences were found within processing types between video and audio recordings (p = 1.00).

Fig 5. Percentages of responses for questions concerning recording technology combinations within the theme of privacy.

Fig 5

(A) Participation likelihood rating. (B) Practicality ratings. (C) Preferred participation duration. (D) Preferred participation time. Key: (m) = manual processing, (a) = automatic processing. Note. Percentages were calculated out of all responders who answered per question, including “Prefer not to answer” responses SW = Somewhat.

Comparison of practicality. Averaged across both lengths of time, 58.31% of participants indicated video and audio as equally practical (Fig 5B). A FANOVA with pairwise Dunn post-hoc tests with Bonferroni corrections indicated a “Short Period” of video (Mdn = 3.00, M = 3.11, SD = 0.82) and audio (Mdn = 3.00, M = 3.11, SD = 0.81) more practical than “Extended Period” of video (Mdn = 3.00, M = 2.57, SD = 0.90) or audio (Mdn = 3.00, M = 2.63, SD = 0.89), χ2(3, N = 337) = 229.20, p < 0.001, (see Fig 5B). Though this was to a weak effect (Kendall W = 0.227), with 47.21% and 42.40% of the sample indicating “Short Period” of recording more practical than “Extended Period” for video and audio respectively. No significant difference to the ratings of practicality between video and audio recording for each recording session length (i.e. “Short Period” or “Extended Period”) was reported (p = 1.00; S9 Table 2 in S2 File).

Comparison of preferred length of participation. Most caregivers favoured participation time “Now and Then” for all technologies except automatically processed video, for which most indicated they would be happy to use for at least a “Month”. Averaged across recording technology, 66.67% of responders did not change their response when given the privacy preserving option. For the third of the sample that did change their response, 79% and 87.74% of participants opted for longer periods of privacy-preserved (i.e. automatically processed) video and audio recording, respectively, over their manually processed counterpart. Bhapkar tests revealed privacy-preserving processing significantly increased the length of time participants were willing to record with both video, χ2(5, N = 358) = 59.40, p < .001, and audio, χ2(5, N = 343) = 56, p < .001, though this was to a small effect as displayed in Fig 5C. See S9 Note A for detailed breakdown of results on preferred length of participation for video and audio recording in S2 File.

Comparison of when willing to participate per day. The majority of caregivers were happy to participate in audio and video recordings during both “Day and Night” (Fig 5D). See S9 Note B for detailed breakdown of results on preferences on when caregivers were willing to participate per day in S2 File.

Open-ended Response. Concept maps depicting the prevalence and co-occurrence of themes and concepts in the open-ended response question for video and audio recording were generated (see Fig 6A & 6B, respectively). As indicated by the number of hits, comments on “Study Specifics” was the top theme for camera recording, whereas the themes of “Auto-Pre-processing” and “Privacy/Consent” were dually most commented on for audio recording (see tables in Fig 6A & 6B).

Data sharing

Of the total sample, 43.26% of caregivers were happier to share data more broadly when it could be anonymised (Fig 7A). For anonymous data, preferred research team was not equally distributed to a large effect, χ2(4, N = 324) = 524.94, p < .001, Cramer’s V = 0.74; significantly more people said they would be most likely to consent to sharing data with “International” research teams (p < 0.001; S10 Table 1 in S2 File). Participants also indicated a preference of research team with whom to share non-anonymous data, χ2 (4, N = 327) = 286.90, p < .001, Cramer’s V = 0.47; Participants equally preferred “BabyLab” (N = 151) and “International” (N = 127; p = 1.00) significantly above all other response options (p < 0.001; S10 Table 2 in S2 File). Bhapkar test indicated a significant effect of anonymity on data sharing preference, χ2(4, N = 319) = 249.90, p < .001. Of the 46% of responders who changed their response between anonymised and non-anonymised data, 100% chose more local research groups if their data was not anonymised (see S10 Table 3 in S2 File for McNemar post-hoc comparisons).

Fig 7. Percentages of responses for questions concerning.

Fig 7

(A) Preferred data Sharing option; (B) Access to view and access to censor preferences; (C) Interest rating for future participation; (D) Willingness to participate.

Data access

Caregivers generally were interested in viewing their infant’s data, with the highest interest in sleep (Fig 8B). Cochran’s Q test indicated significant differences to the proportions of those who opted a preference to view each type of data, χ2(5, N = 331) = 258.727, p < .001, with a small chance-corrected effect size (R = 0.09); caregivers were more interested in viewing sleep data (90.90% of sample) than all other choices (p < 0.001), except for video (84.90%; p = 0.56) (S11 Table 1 in S2 File). The proportion of those who opted a preference to censor each type of data significantly differed, χ2(6, N = 331) = 881.468, p < .001, with a small chance-corrected effect size (R = 0.34); caregivers were more likely to want to censor video (80.70%) and audio data (75.50%) than all other choices (p < 0.001), with no significant differences indicated between these two technologies (p = 1.00; S11 Table 2 in S2 File).

Fig 8. Theme/concept map depicting prevalence and co-occurrence of words from open-ended response questions regarding the entire study.

Fig 8

Table displaying each theme and its relative hit number.

Future participation

Participants were very open to the prospect of participating in future studies similar to those described in the survey (Fig 7C & 7D). Of the total sample, 59% of responders indicating they would be “Very” or “Extremely” interested to in future investigations, with 57% of responders indicating they were eligible (had a child under 12 months) and were willing to participate.

Open-ended response

Concept maps depicting the prevalence and co-occurrence of themes and concepts in the open-ended response question for the overall investigation are displayed in Fig 8A. According to the number of hits, the top three most commonly mentioned themes were “Video”, “Study” and “Child”. See table in Fig 8 for number of hits for all generated themes.

Discussion

The present study investigated opinions of a UK based cohort of caregivers on remote in-home monitoring technology and study designs with an overarching goal to provide guidance for future research with similar aims. We discuss each of our core themes in turn.

Viability

To maximise participant uptake and minimise attrition on studies implementing such promising technologies and assessment designs, we must optimise viability. To do so, we collected feedback on remote monitoring technologies such as wearable devices, video/audio recording and smartphone apps.

Sticker sensing electrodes versus smart suits/sensing bands

Participants rated smart suits (garments with integrated sensors) and sensing wrist/ankle bands device similarly, both being more favourable than the traditional stick-on electrodes commonly used in the lab and associated with generally better data quality. Smart suits and sensing bands were also rated more preferable for longer studies than sensing electrode stickers. Parents indicated a marginal likelihood of the longest duration of use for bands, possibly due to them being easy to use and thus least disruptive. Taken together, these results demonstrate the heightened acceptability of low-care remote monitoring technologies (e.g. smart suits and sensing bands), and allude to their potential of increasing uptake in remote monitoring study designs with infant subjects; particularly for designs taking place over longer periods. Notably, using smart suits for an “Extended Period” was indicated as significantly more practical than using sensing electrode stickers for a “Short Period”, and participants rated a “Month” long usage as their most preferred option for sensing bands and smart suits, but not for sensing electrode stickers. This highlights the further potential of both smart suits and bands for longitudinal designs, with the possibility to decrease attrition in lengthy/time-intensive designs. This finding also warrants the investment in the development of sensing bands/suits for future studies (e.g. sensors wirelessly connected to apps that would pre-process data remotely, and upload anonymised derived data).

Concept/theme maps of the open-ended response items provide insight into concerns and reasonings behind corresponding multiple-choice answers (though it is important to note that these represent a simple summation of the most common words used, and future work should employ more extensive qualitative methods). The most commonly used words indicated a consensus across all three wearable technologies; that the devices must not impact on the child’s physical health/wellbeing (e.g. “sensitive skin” for smart suits and sensing electrode stickers and “circulation” for bands). This finding was consistent with a previous qualitative report on potential barriers for participation with ambulatory infant sensing devices; caregivers expressed concerns about the comfort of the physical placement of the sensor on their child [28]. Though such concerns are likely to be addressed by manufacturers of the technologies as well as local ethics boards prior to implementation, future researchers should explicitly state the safety of these measures during advertising/consent to improve participant uptake.

For smart suits, the top theme was “Hygiene”. This consisted of concepts “Wash”, “Material” and “Nappy”, highlighting a top concern for caregivers regarding smart suits was the cleanliness of the device. Reiterating this concern of hygiene, 76% of the sample indicated they were not willing to use smart suits other families have. For sensing bands, the top theme was “Water/Baby-Proof”. This theme reflects concerns to the durability of equipment when being worn by the infant. For sticker electrodes, the top theme was “Wires”, consisting of concepts “Wires”, “Pocket”, “Uncomfortable”. “Wires” overlapped with other themes of “Pulling” and “Alternative Devices”. Taken together, this highlights main topics raised by caregivers to centre around the relative safety, practicality and comfort of the sticker electrode wires compared to other devices. This disparity in the top extrapolated themes may account for the differing viability rating between these technologies. It is plausible that smart suits and sensing bands were rated more favourable than sticker electrodes because concerns of safety and comfort issues outweigh issues of hygiene and durability of the device.

It must be noted that although bands/body suits were rated more favourably in the quantitative rating, stickers were not completely disregarded by caregivers. Potentially, by addressing the highlighted concerns, all three monitoring technologies may be seen more favourably in future research.

Static versus body image-only video recording devices

Caregivers indicated similar levels of usage likelihood for static cot cameras versus on-body camera for image-only video recording. This results indicates that for the collection of a highly identifiable video recording, the means with which this data is collected is not of any importance. The implication of this finding for future researchers is that studies involving video data can be flexible with their recording approach.

Smartphones

Caregivers were generally positive about smartphones in the context of home recording studies. A majority of responders indicated that they would be “extremely” or “very” likely to use this approach, which is consistent with the increasing number of publications using this design for self-monitoring of psychological and behaviour states [36]. Both short or long periods of smartphone use was rated above the median practicality; the majority of responders rating both recording lengths to be equally practical. This finding aligns with the ubiquity of smartphones in society and the notion that using smartphones for research interaction are unlikely to cause significant burden on participants [8]. This overall favourable rating of smartphone use likelihood and practicality, as well as the additional benefits of smartphones (e.g. sensing device interaction-platform; [37]), highlight a positive prospective for the inclusion of smartphones in future remote infant investigations.

An additional benefit of using smartphones in remote investigations is the timely collection of additional data (e.g. questionnaires) through prompts/notifications. The majority of participants would prefer 2–4 prompts per day, which if implemented would allow multiple data collections or allow large data collections to be spread across multiple time points. However, as indicated by two time-related themes on the theme/concept map “Quick” and “Time-consuming”, caregivers raised that responses need to be short, particularly for those requiring “immediate” responses. If multiple prompts/collection times are desired, future investigations should consider responses to be short and quick to minimise data loss.

A relatively large proportion of responders were happy to respond “Anytime” to prompts. Having immediate responses throughout a 24-hour period would reduce retrospective data recording, that may impede validity and increase the possibility for skewed results to particular times in the day/behaviour. This would defer from the ubiquitous benefits of remote monitoring that is often unachievable in lab-based study designs [8]. The majority of those who indicated a preference indicated “Evening”, highlighting how responses are likely to covary with less busier times of the day (e.g. in the evening when the infant is likely to be asleep). The notion of differing schedules was raised within the theme of “Options” in the open responses. Many comments in this theme centred around the variability of daily life, and how this could determine the ability to answer prompts; thus, needing response options pertaining to the “number”, “day” and “length”. Implementing a means with which participants can easily communicate with investigators (e.g. smartphone app) about daily/weekly availability will enable researchers to establish whether data is missing at random or whether it is related to other factors (e.g. busier family); an important consideration to prevent incorrect conclusions.

Similarly, family dynamics can fluctuate both across families and within families across time. This was highlighted as a key consideration for caregivers by the “Multiple carer” theme. When requiring multiple data collection points or employing a longitudinal design, investigators need to consider how they may overcome reporting consistence when a child has different caregivers across different times of the day/week. Facilitating data collection across multiple caregivers (for example, using an app that can be downloaded on multiple devices with different family member/caregiver platforms) will allow families with complex structures to participate.

Ultimately, accounting for individual schedules will be important for future remote studies in general, particularly when employing experience sampling methods.

Privacy

In-home infant monitoring studies can be somewhat intrusive on privacy. To optimise the success of such study designs, we must consider caregiver’s feedback on different types of highly identifiable data collection and possible privacy-preserving techniques as well as with whom participants are comfortable sharing remotely collected data.

Image-only video versus audio recording with/without privacy preservation

Similar to smartphones, audio or image-only video recording not only contribute contextualising data, but additional informative data–thus making them a promising, and increasingly used tool in infant remote monitoring studies [11,4547]. There was no effect of recording technology (i.e. video/audio) on likelihood ratings. Privacy preserving techniques (i.e. data anonymised on collection via automatic processing) did increase favourability of technology but to a moderate degrees, with approximately half of participants responding the same with and without the option of privacy preserving processing within technology. We also considered opinions on practicality of video and audio devices, as well as most preferred time of day to record with each recording device/processing option combination. No significant differences between technology were reported and there was little difference between device/processing combination preference for time of recording, with “Day and Night” significantly the most preferred for all combinations. Taken together our results are consistent with previous findings of no difference in willingness between video and audio recording and is somewhat consistent with previous non-significant trends to increased recording willingness if privacy-preserving techniques are applied [28].

The lack of preference to either image-only video or audio, as well as the moderate favourability to privacy preserving processing was reiterated in responses to preferred study duration. The majority of participants did not change their response between technologies nor between privacy preserving option. Of the sample that did change their response within each technology, privacy preserving processing option significantly increased preferred study duration. Although this was only for approximately a third of the sample, this finding still highlights potential of privacy preservation to increase uptake in longer studies. The level of privacy and intrusion when conducting remote infant monitoring studies with identifiable data should be considered by future investigators, particularly for longer studies. This preference to privacy preservation corroborated in the open-ended response sections whereby theme/concept maps extrapolated “Privacy” and “Intrusive” as themes for both video/audio recording, and “Auto-Pre-Processing” for audio recording. Yet, implementing such measures for uptake improvement can be problematic. Anonymising data on collection means raw data will not be stored. Researchers must therefore thoroughly consider beforehand what variables are needed for analysis, and the validity of extracted data using the chosen method given the data collection setting (e.g. will the infant’s vocal pitch be validly extracted if collected in a noisy household). Although this fits with pushes towards preregistration of analytic plans [48]; it limits opportunity for prospective secondary analysis, particularly when raw data is no longer available. This reduces scope for cost effective and efficient research where unforeseen questions that have arisen from the results of the initial analysis can be answered with the original dataset. Future researchers must consider whether the potential increase in uptake/decrease in attrition out-weighs future secondary/unforeseen analysis limitations, particularly when conducting time and resource intensive studies.

In the open-ended responses to audio recording, the themes of “Privacy/Consent” and “Other People” were extracted interconnectedly, encapsulating raised concerns about recording people without consent (e.g. visitors). The issue of recording others was also raised in the video open-ended response (particularly centred around issues with nursery), though was not prevalent enough to warrant its own theme or concept. These concerns raise the important logistical consideration for future researchers to align with General Data Protection Regulations [38] by taking the consent of all participants, including those who are not necessarily enrolled in the study but are nonetheless in recordings (e.g. visitors). This is problematic for busy families; whose infant may have multiple caregivers and/or participate in multiple activities where there are other people. A number of caregivers indicated recording would be problematic as their infant goes to nursery where video/audio recording is prohibited. Indeed, recording could be limited to in-home when only the infant’s family is present–but such specific circumstances may limit the range of data collection, potentially skewing results away from all-encompassing naturalistic observations. Alternatively, recording only in the home may dissuade more active families who spend a lot of time out of the home–a concern raised by caregivers and mentioned within audio’s “Other People” theme and “Playdate/Classes” concept and video’s “Home” concept. Studies requiring long periods within the home may not be accommodating to every family daily life. If these families were to stay indoors, recording would no longer be completely naturalistic. Alternatively, such families may not participate, creating generalisability issues. This is an important issue that needs careful consideration by future investigators.

Our findings ultimately suggest an initial high and equal acceptance of video and audio recording, which is slightly increased when privacy persevering techniques such as automated processing are applied. However, acceptability may differ when such studies are proposed in the context of more lengthy designs, where future investigators must consider the type of recording device and the application of privacy preserving techniques alongside more complex issues such as consent of those who are not immediately involve in the study.

Data sharing

Findings from our question on data sharing uncovered an effect of anonymity on data sharing preference. The majority were willing to share anonymous data with “international” research groups. For non-anonymous opinions were split, “BabyLab” indicated only minorly more favoured to “International” research groups. This suggests there may be two subgroups within our sample that have differing thoughts on privacy with regards to data sharing, a consideration that we preliminarily explored (see S14 Note A for analysis in S2 File). Maternal education was associated with the preferred choice of research group with whom to share non-anonymous data. These findings indicated that maternal education may influence readiness to share data internationally, a notion that should be investigated in future research.

Taken together these results somewhat corroborate the above findings highlighting a preference for anonymous data. Although anonymising data may provide a route to appease privacy concerns, it may be problematic when considering pushes for the Open Data Movement [40]. Having participants unwilling to allow their data, particularly raw non-anonymous data, to be used outside of the recruiting research group may limit transparency and reproducibility (thus potentially the credibility) of findings, and impede research collaborations [39,40].

Data access

We wanted to gauge whether caregivers wanted access to their infant’s data to view or to censor (i.e. OK/Delete collected data). The majority of participants were interested in viewing sleep, video and audio data. Given the interest in viewing data, plus previous reports of data access increasing willingness to participate [28], it could be considered a priority for researchers to incorporate a data access option to encourage enrolment onto such intensive investigations. This need for encouragement is backed by the “Reward” concept generated in the theme of “Parents’ Needs” from the open-ended responses regarding the overall investigations. To illustrate, one commenter said “sounds like a big commitment from parents. It would need a reward”. For censoring purposes, the strongest preference was for video and audio recordings. This highlights caregivers’ wish for an added layer of privacy on identifiable data by being able to select what is given to researchers. Although providing this option may increase uptake, it has the potential to skew results to only more flattering views of the infant’s life—limiting obtaining comprehensiveness. Future researchers need to carefully consider the purpose of data access and hence ensure data access is informative and relevant for caregivers, without being overwhelming, complex or concerning.

Future participation

Over half the sample indicated they would be “Extremely” or “Very” likely to participate in future remote in-home monitoring investigations, and a similar amount said they had an eligible infant (younger than 12 months; S12 Table 1, 2 in S2 File). Taken together, these findings are promising, suggesting a high level of acceptability for such investigations. Many open-ended responses corroborated this notion, as highlighted by the generated themes of “Sounds Good”. Other themes and concepts reiterated previously mentioned concerns, particularly regarding “Technology”, “Privacy” issues of “Video” and “Audio” recording, “Intrusive[ness]” and “Practicality”. Additional topics previously unmentioned were highlighted. The concept of “Babylab Environment” was generated, which referred to how the babylab environment made caregivers more confident with the equipment that was being deployed on their child. Taking similar equipment out of the babylab may require a lot more briefing on the technology, how it works and how to implement it–which may be a big commitment for time-restrained participants (as suggested in the theme of “Time”). Therefore, future researchers must carefully consider how and to what level is necessary when informing participants.

Limitations

A major limitation of the survey is that our sample may not have been representative. Firstly, the mean of our target child was 29 months. This means that some of the caregivers were answering the questions retrospectively, which may have altered their opinion. Similarly, our sample may not have represented families that would benefit most from in-home remote monitoring technologies. Families of low SES tend to be underreported in lab-based investigations as, among many reasons, travelling to the lab is a burden on limited resources [4]. We used Birkbeck University of London’s Babylab database and social media accounts to recruit participant, thus people who responded to the survey were probably those already likely to engage in and would have an already high level of acceptance of our research, limiting the scope of generalisation to a degree. The recruitment stream used may have particularly limited access to low SES families, as noticed in the demographic of our sample. This illustrates that to engage boarder communities targeted outreach efforts, alongside the proposed accessible in-home study designs, need to be addressed in future investigations.

In light of this limitation we conducted additional analysis on a subset of individuals from our sample who were of relatively lower SES (e.g. infant’s caregivers’ education was no higher than secondary and the family was in the lower third of annual income; S13, in S2 File). Findings from this small sub-sample (20 responders) were relatively similar to the overall sample’s response. Trends demonstrated smart suits were preferred over sensing electrode stickers, smartphones were relatively accepted, and automatic processing of video/audio recording may increase acceptability. Similarly, automatic processing may increase willingness to share data internationally. However, this analysis is, of course, underpowered.

Several questions in our survey were open-ended response, requiring qualitative analysis to draw inferences on response themes/concepts. The motivation and benefit of collecting of this data means topics of interest for caregivers, that may not have been considered priori, can be investigated. We attempted to conduct a rudimentary qualitative analysis using topographic maps that extrapolated themes/concepts based on the number of mentions. However, this was not an exhaustive systematic analysis of the qualitative data, therefore limits the thoroughness of conclusions we can draw.

When describing potential technology, we incorporated an example image in order to contextualise the question. Some of these images were of commercially available technology, which, are often more aesthetically pleasing than equipment that is developed in the lab without multidisciplinary collaboration. This may have inflated acceptance in our sample, and must be considered by future researchers who are using our findings to guide the implementation of less aesthetic technology. Similarly, the descriptions in the survey for the purpose of collecting each type of data was limited, in order to improve the generalisability of our findings. However, the description of the technology may have influenced responses, which may differ with more information or because of study specifics. Information pertaining to security and participant confidentiality for questions regarding data sharing were also limited. Providing information on the protocols of data across specific collaborating labs may influence opinions on data sharing. Ultimately, the level of participant understanding of the technology/assessment specific is likely to influence opinion, thus, needs to be taken into account by future investigators.

In order to comprehensively canvass caregivers’ opinions on remote monitoring technologies and study designs, we asked a large number of question. Consequently, we conducted a large number of comparisons for which we attempted to correct for multiple comparisons within each analysis using Bonferroni correction. Nonetheless there is the potential for false positives. Therefore, we present all analysis alongside appropriate effects size and graphs, and have made the data available. This is to enable future investigators to evaluate the information that be most relevant to their particular study.

Summary

The present survey indicates remote in-home infant monitoring to be perceived as feasible and acceptable by families with infants. The development of new technologies thus holds great potential for researchers to conduct naturalistic investigations remotely. This (if coupled with appropriate outreach approaches) may enable researchers to incorporate individuals who may not usually be able to participate in lab-based research e.g. families with more restricted resources. Although generalisability should be considered, our work indicates significant areas to be addressed to take this new frontier of infant research forward. We have summarised our top five key factors in Fig 9. Caregivers must feel confident that wearable equipment is not disruptive or impede on their safety. Caregivers raised important practical issues for remote designs regarding individual schedules and multiple caregivers. This could be overcome by participants interacting with the study using smartphone applications, which were considered as highly favourable. Privacy preserving techniques on video and audio data were deemed somewhat important, particularly when participating in more lengthy investigations. This requires researchers to carefully plan the variables they need to extract before the study begins, which limits raw data availability for replication and further secondary explorations. Reiterating privacy concerns, data access for censoring purposes on video and audio was rated highly, which may increase acceptability though may introduce biases with regards to what data is available for analysis. The tension between privacy issues and data sharing was also highlighted, with innovative new solutions required to comply both with legal frameworks governing data sharing, the views and wishes of caregivers to maintain their privacy and geographical data sharing concerns (particularly for non-anonymous data), and the drive towards greater sharing of raw datasets. Taken together, our work highlights both opportunities and challenges associated with moving towards remote infant research practices.

Fig 9. Call out box of top five factors for future researchers to consider when conducting in-home monitoring with infant participants in the UK.

Fig 9

Supporting information

S1 File. Survey.

(PDF)

S2 File. Analysis supplementary information.

(DOCX)

Acknowledgments

We would like to thank the participants who completed our survey as well as Dr. Lucas Noldus and team for helpful comments on the manuscript and support.

Data Availability

All data files are available from the OSF database (osf.io/fbhd8).

Funding Statement

This collection of data has been supported by a grant from the European Community’s Horizon 2020 Program (https://ec.europa.eu/programmes/horizon2020/en) under grant agreement n° 642990 (EJ), and the Innovative Medicines Initiative Joint Undertaking (https://www.eu-aims.eu/imprint/) under grant agreement n° 115300 (EJ), resources of which are composed of financial contribution from the European Union's Seventh Framework Programme (FP7/2007 - 2013) and EFPIA companies' in kind contribution. The results leading to this project has been supported by AIMS2 (https://www.aims-2-trials.eu), which received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 777394 (EJ). This Joint Undertaking receives support from the European Union's Horizon 2020 research. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Wang Y, Hartman M, Abdul Aziz NA, Arora S, Shi L, Tunison E. A systematic review of the use of LENA technology. American Annals of the Deaf. 2017. 10.1353/aad.2017.0028 [DOI] [PubMed] [Google Scholar]
  • 2.Singh Y, Jackson D, Bhardwaj S, Titus N, Goga A. National surveillance using mobile systems for health monitoring: complexity, functionality and feasibility. BMC Infect Dis. 2019. 10.1186/s12879-019-4338-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Azhari A, Truzzi A, Neoh MJY, Balagtas JPM, Tan HAH, Goh PLP, et al. A decade of infant neuroimaging research: What have we learned and where are we going? Infant Behavior and Development. 2020. 10.1016/j.infbeh.2019.101389 [DOI] [PubMed] [Google Scholar]
  • 4.Ballieux H, Tomalski P, Kushnerneko E, Johnson MH, Karmiloff-Smith A, Moore DG. Feasibility of Undertaking Off-Site Infant Eye-Tracking Assessments of Neuro-Cognitive Functioning in Early-Intervention Centres. Infant Child Dev. 2016. 10.1002/icd.1914 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: Evidence for action. The Lancet. 2011. 10.1016/S0140-6736(11)60827-1 [DOI] [PubMed] [Google Scholar]
  • 6.Bronfenbrenner U. Toward an experimental ecology of human development. Am Psychol. 2006. 10.1037/0003-066x.32.7.513 [DOI] [Google Scholar]
  • 7.Dahl A. Ecological Commitments: Why Developmental Science Needs Naturalistic Methods. Child Dev Perspect. 2017. 10.1111/cdep.12217 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.de Barbaro K. Automated sensing of daily activity: A new lens into development. Developmental Psychobiology. 2019. 10.1002/dev.21831 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Schmuckler MA. What is Ecological Validity? A Dimensional Analysis. Infancy. 2001. 10.1207/S15327078IN0204_02 [DOI] [PubMed] [Google Scholar]
  • 10.Lee DK, Cole WG, Golenia L, Adolph KE. The cost of simplifying complex developmental phenomena: a new perspective on learning to walk. Dev Sci. 2018. 10.1111/desc.12615 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.VanDam M, Warlaumont AS, Bergelson E, Cristia A, Soderstrom M, De Palma P, et al. HomeBank: An Online Repository of Daylong Child-Centered Audio Recordings. Semin Speech Lang. 2016. 10.1055/s-0036-1580745 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Bergelson E, Amatuni A, Dailey S, Koorathota S, Tor S. Day by day, hour by hour: Naturalistic language input to infants. Dev Sci. 2019. 10.1111/desc.12715 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Casillas M, Cristia A. A step-by-step guide to collecting and analyzing long-format speech environment (LFSE) recordings. Collabra: Psychology. 2019. 10.1525/collabra.209 [DOI] [Google Scholar]
  • 14.Wang J, O’Kane AA, Newhouse N, Sethu-Jones GR, De Barbaro K. Quantified baby: Parenting and the use of a baby wearable in the wild. Proc ACM Human-Computer Interact. 2017. 10.1145/3134743 [DOI] [Google Scholar]
  • 15.Chen W, Dols S, Oetomo SB, Feijs L. Monitoring body temperature of newborn infants at neonatal intensive care units using wearable sensors. Proceedings of the Fifth International Conference on Body Area Networks—BodyNets ‘10. 2010. 10.1145/2221924.2221960 [DOI]
  • 16.Bouwstra S, Chen W, Feijs L, Oetomo SB. Smart jacket design for neonatal monitoring with wearable sensors. Proceedings—2009 6th International Workshop on Wearable and Implantable Body Sensor Networks, BSN 2009. 2009. 10.1109/BSN.2009.40 [DOI]
  • 17.Rogers E, Polygerinos P, Walsh C, Goldfield E. Smart and Connected Actuated Mobile and Sensing Suit to Encourage Motion in Developmentally Delayed Infants 1. J Med Device. 2015. 10.1115/1.4030550 [DOI] [Google Scholar]
  • 18.Singh M, Patterson DJ. Involuntary gesture recognition for predicting cerebral palsy in high-risk infants. Proceedings—International Symposium on Wearable Computers, ISWC. 2010. 10.1109/ISWC.2010.5665874 [DOI]
  • 19.Yao X, Plötz T, Johnson M, Barbaro K de. Automated Detection of Infant Holding Using Wearable Sensing. Proc ACM Interactive, Mobile, Wearable Ubiquitous Technol. 2019. 10.1145/3328935 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Curtindale LM, Bahrick LE, Lickliter R, Colombo J. Effects of multimodal synchrony on infant attention and heart rate during events with social and nonsocial stimuli. J Exp Child Psychol. 2019. 10.1016/j.jecp.2018.10.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Nava E, Romano D, Grassi M, Turati C. Skin conductance reveals the early development of the unconscious processing of emotions. Cortex. 2016. 10.1016/j.cortex.2016.07.011 [DOI] [PubMed] [Google Scholar]
  • 22.Porges SW, Davila MI, Lewis GF, Kolacz J, Okonmah-Obazee S, Hane AA, et al. Autonomic regulation of preterm infants is enhanced by Family Nurture Intervention. Dev Psychobiol. 2019. 10.1002/dev.21841 [DOI] [PubMed] [Google Scholar]
  • 23.Fausey CM, Jayaraman S, Smith LB. From faces to hands: Changing visual input in the first two years. Cognition. 2016. 10.1016/j.cognition.2016.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Gilkerson J, Richards JA, Warren SF, Montgomery JK, Greenwood CR, Oller DK, et al. Mapping the early language environment using all-day recordings and automated analysis. Am J Speech-Language Pathol. 2017. 10.1044/2016_AJSLP-15-0169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Mindell JA, Leichman ES, Composto J, Lee C, Bhullar B, Walters RM. Development of infant and toddler sleep patterns: real-world data from a mobile application. J Sleep Res. 2016. 10.1111/jsr.12414 [DOI] [PubMed] [Google Scholar]
  • 26.Spittle AJ, Olsen J, Kwong A, Doyle LW, Marschik PB, Einspieler C, et al. The Baby Moves prospective cohort study protocol: Using a smartphone application with the General Movements Assessment to predict neurodevelopmental outcomes at age 2 years for extremely preterm or extremely low birthweight infants. BMJ Open. 2016. 10.1136/bmjopen-2016-013446 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wass S. Fall asleep or freeze? In home settings, extreme low and high levels of ambient noise associate with reductions in infants’ spontaneous movement. psyarxiv. 2020. 10.31234/osf.io/5zvuf [DOI] [Google Scholar]
  • 28.Levin H, Egger D, Johnson M, Barbaro K de. Parent Willingness to Collect and Share Children’s Mobile-Sensing Data. J Chem Inf Model. 2019. 10.1017/CBO9781107415324.004 [DOI] [Google Scholar]
  • 29.Lobo MA, Hall ML, Greenspan B, Rohloff P, Prosser LA, Smith BA. Wearables for Pediatric Rehabilitation: How to Optimally Design and Use Products to Meet the Needs of Users. Physical Therapy. 2019. 10.1093/ptj/pzz024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Hall ML, Lobo MA. Design and development of the first exoskeletal garment to enhance arm mobility for children with movement impairments. Assist Technol. 2018. 10.1080/10400435.2017.1320690 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Muhammad Sayem AS, Hon Teay S, Shahariar H, Fink PL, Albarbar A. Review on Smart Electro-Clothing Systems (SeCSs). Sensors (Basel). 2020. 10.20944/preprints201903.0164.v1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Memon SF, Memon M, Bhatti S. Wearable technology for infant health monitoring: A survey. IET Circuits, Devices and Systems. 2020. 10.1049/iet-cds.2018.5447 [DOI] [Google Scholar]
  • 33.Richards JA, Gilkerson J, Paul T, Xu D. The LENA Automatic Vocalization Assessment (LTR-08-1). 2008. [Google Scholar]
  • 34.Miller G. The Smartphone Psychology Manifesto. Perspect Psychol Sci. 2012. 10.1177/1745691612441215 [DOI] [PubMed] [Google Scholar]
  • 35.Taylor K, Silver L. Smartphone Ownership is Growing Rapidly Around the World, but Not Always Equally. 2018. [Google Scholar]
  • 36.Harari GM, Lane ND, Wang R, Crosier BS, Campbell AT, Gosling SD. Using Smartphones to Collect Behavioral Data in Psychological Science: Opportunities, Practical Considerations, and Challenges. Perspect Psychol Sci. 2016. 10.1177/1745691616650285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Bonafide CP, Jamison DT, Fogila EE. The emerging market of smartphone-integrated infant physiologic monitors. JAMA—J Am Med Assoc. 2017;317: 353–354. 10.1001/jama.2016.19137 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.General Data Protection Regulation (GDPR). General Data Protection Regulation (GDPR)–Final text neatly arranged [online]. 2018. [Google Scholar]
  • 39.Kidwell MC, Lazarević LB, Baranski E, Hardwicke TE, Piechowski S, Falkenberg LS, et al. Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency. PLoS Biol. 2016. 10.1371/journal.pbio.1002456 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Iqbal SA, Wallach JD, Khoury MJ, Schully SD, Ioannidis JPA. Reproducible Research Practices and Transparency across the Biomedical Literature. PLoS Biol. 2016. 10.1371/journal.pbio.1002333 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.APA. APA Ethics Code Addresses When Obtaining Informed Consent From Research Participants Is Necessary. In: American Psychological Association; 2014. [Google Scholar]
  • 42.IBM. IBM SPSS Statistics Software for Windows, Version 25. In: IBM; 2017. [Google Scholar]
  • 43.R Development Core Team R. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; 2011. 10.1007/978-3-540-74686-7 [DOI] [Google Scholar]
  • 44.Smith A. Leximancer Pty Ltd; Brisbane, Australia; 2009. Available: https://info.leximancer.com [Google Scholar]
  • 45.Zimmerman FJ, Gilkerson J, Richards JA, Christakis DA, Xu D, Gray S, et al. Teaching by listening: The importance of adult-child conversations to language development. Pediatrics. 2009. 10.1542/peds.2008-2267 [DOI] [PubMed] [Google Scholar]
  • 46.Boonzaaijer M, Van Wesel F, Nuysink J, Volman MJM, Jongmans MJ. A home-video method to assess infant gross motor development: Parent perspectives on feasibility. BMC Pediatr. 2019. 10.1186/s12887-019-1779-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Sugden NA, Moulson MC. The infant’s face diet: Data on 3-month-old infant-perspective experience with faces video-recorded in their typical, daily environment. Data Br. 2020. 10.1016/j.dib.2019.105070 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Nosek BA, Ebersole CR, DeHaven AC, Mellor DT. The preregistration revolution. Proc Natl Acad Sci U S A. 2018. 10.1073/pnas.1708274114 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Barbara Schouten

25 Aug 2020

PONE-D-20-20163

A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research.

PLOS ONE

Dear Dr. Fish,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by September 30th. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Barbara Schouten

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend either the title on the online submission form (via Edit Submission) or the title in the manuscript so that they are identical.

3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright license more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information

4. Please note that PLOS ONE uses a single-blind peer review procedure. We would therefore be grateful if you could include in the information that has been redacted for peer review in the manuscript.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I will start by saying that I am aware that I am not supposed to be reviewing for "impact" or "interest level" and I have tried to bear this in mind in my review. I am not sure whether some of my comments have more to do with "clarity" or "impact", so I will present them here and leave it between the editor and the author how/to what extent they should be addressed.

Please note also that I am somewhat unfamiliar with some of the statistical tests used and with the qualitative analysis. However, to the extent that I am able to judge, the statistics appear appropriate and technical standards are met. I have no concerns about the quality of the research that was conducted, and the study is presented in a very transparent way.

My primary concern is the framing of the study appears to be centred around the needs of the particular lab for a study they are planning. However, they attempt to draw much broader conclusions that would be of interest to the larger infant research community, and the introduction sets up these themes in very broad terms. I don't believe that they have been entirely successful in drawing conclusions of relevance to the broader research community, and I don't know whether it would work to frame the study solely around the conclusions relevant to this particular lab, or even specifically labs that do smartsuit testing (it's not clear to me how many that is)?

I selected "no" for intelligibility not being there is a problem with the clarity of the English per se, but rather because there are some structural issues that make reading challenging. Two broad concerns: 1. The sub-headers are inconsistent, making it hard to match up the research questions with the data use to test these questions. For example, it took me a fair amount of searching to figure out what the sub-section "Study Interaction" was referring to. It appears to be a sub-section of the question(s) about practicality, but is listed separately in the Analysis section. 2. Relatedly, there are quite a lot of questions that are tested in a number of different ways, and the reader gets a little lost in the trees for the forest. I did not find the figures particularly helpful in this respect in visualizing the findings - the authors could take a step back and consider which aspects of the findngs they most want to highlight.

Throughout the study it is difficult to know the extent to which some of the findings might generalize beyond the specific lab/study under question. I went back to the wording of the questionnaire on a few occasions for this reason. A few things jumped out at me: 1. The described purpose of the audio/video may play a key role in the participants responses. Here the survey suggests that the need for video/audio is fairly limited so participants may be more inclined to request that the data be anonymized. In my lab, participants tend to be quite willing to share their raw audio with us, as they understand that it is necessary for the research. 2. The question about sharing with researchers outside of the lab does not describe any processes that might be in place to ensure participant confidentiality, which may also skew the responses toward a more conservative answer.

There are also a few typographical issues (e.g. "Lena" should be "LENA", "on-significant"?)

Reviewer #2: The authors conducted a survey with 410 parents on their perspectives on the challenges and ethical concerns of use of in-home infant monitoring technologies. The authors found that parents were more likely to accept video and audio recording in the home if data was anonymized and that they were open to the international sharing of the anonymized data. The authors generally found positive support for in-home monitoring devices and studies, but noted specific considerations surrounding privacy, safety, and family dynamics for different technologies.

This article is extremely relevant and critical for the field for the current pandemic and for the future of the field. Though many labs are quickly adapting to in-person testing restrictions, we know little about how families perceive the use of such technologies in their homes. I agree with the authors that a model that mitigates the burdens and sacrifices on the families will be essential to the growing adoption of research technologies by families.

I have some general suggestions for the authors, and more detailed notes below. First, I found the structure of the paper a bit confusing where in the Introduction and Research Questions there seem to be three main areas of focus (i.e., Practicality, Privacy, and Feedback), but the Analysis plan and Results separate those themes into a few more headers, and then the discussion creates new sub headers as well. My preference would be for more alignment or a way to introduce this organization to the reader. Because there is a lot of information in this manuscript, having some consistency in structure would be helpful for the reader. Second, I felt like the themes raised in the Introduction were at times broader than the scope of the article. For example, the authors discuss many issues related to practicality but it seems that this is examined specifically in relation to duration of use in a day. The authors also raise an important issue of feedback and the potential of noticing atypical behaviors, but these concerns do not seem to be addressed in the analyses and the discussion. I would suggest specifying the scope of the paper earlier in the introduction and research questions. Third, the authors present this work to be important for COVID-safe measures and ‘socially-distanced’ data, which of course is extremely relevant to our times now. However, adopting in-home infant monitoring technologies are likely important for issues of including many different families who may not always have the time or access to research studies, as well as performing research at a very high scale (as the authors acknowledge). I think it would benefit the manuscript to emphasize these latter points, because the implications of this work are much broader than for the pandemic alone. Finally, the authors seem to focus on specific comparisons between technologies in their analyses, which are not immediately obvious to the reader. It would be helpful to include this specificity in their research questions.

Introduction

- Page 4 line 69: “Although user-friendly, commercial devices allow limited access to raw, high resolution data and are therefore poorly equipped for more complex research questions” – I don’t understand why high-resolution data is poorly equipped for more complex research questions? It seems that high-resolution data would in fact be great for more complex research questions?

- The authors discuss practicality here in many ways, but the analyses seem to focus on duration of use in a day? I suggest to specify that focus here to help orient the reader. The terminology of practicality and practicability are also used interchangeably, I would suggest using one for consistency unless they convey different meanings.

- I’m not sure I understand the paragraph on the ‘contextualization’ of data (starting line 114). Aren’t all in-home technologies providing the contextualization of a more ecological setting?

- The authors mention the use of resolution in a couple of places but it doesn’t seem consistent (e.g., line 69 high resolution data vs. line 115 lower resolution data like physiological measures). Are physiological measures considered lower resolution because they are not identifiable like audio or video recordings?

- Rather than “Feedback”, perhaps using a different term specific to families’ access to the data is better? It doesn’t seem like the authors examine findings related to the issues of caregiver concerns of atypical behavior.

Method

- I appreciate that the authors included general comment boxes for open-ended responses.

- How were families compensated?

- Do the authors have information on how long it took caregivers to respond to the surveys (e.g., mean and range) ?

- I had difficulty understanding this sentence on page 12 lines 260 – 263: “Note that all McNemar tests in this paper conducted for each categorical option on 2*2 contingency tables constructed with number of responders selecting that categorical option versus number of responders not selecting that category across the items being assessed e.g. technology.”

- Is there a table that could help readers understand the different technologies targeted in the survey?

- “Now and Then” – what does this mean? Was this described for the caregivers?

Results

- The authors seem to use a number of non-parametric tests, I assume this is because data are categorical? It would be helpful to include this justification.

Discussion

- This discussion was comprehensive but also a bit long. Not sure if there is a way to make this more concise but still include the information that the authors would like to convey?

- The authors include a header of “Wearable” devices, but their research questions seemed specific to smart suits and electrodes? Also, their questions regarding video and audio recordings were grouped in the results regarding issues of privacy, which seems different from whether they would adopt the use of the technology?

- I think it is also important to acknowledge the valence of caregivers’ responses. For example, while smart suits were preferred over sensing electrode stickers, the median score was 3 for sensing electrode stickers. Does this mean that participants feelings’ may be on average neutral? And perhaps with some concerns addressed they would be interested?

- I appreciate that the authors included images of the technology in conducting the survey.

- Another limitation with practicality (the authors do not need to note this in an already lengthy manuscript, but just sharing my views), is that while some technologies are meant to be easily integrated into infants’ daily lives, there are ways that caregivers adjust to the technology that may impact data collection. For example, in my own experience with LENA audio recording devices (a small recorder places inside a child’s front shirt pocket), there are times in the day when children fiddle with the recorder and remove it, or the caregiver needs to reverse the shirt so that the pocket is on the child’s back. These variations in the location of the LENA can influence what is being recorded. So, while some technologies seem easily adapted and thus fairly practical, there is still some level of maintenance on the part of the researcher to ensure the technology was appropriately adopted.

Figures

- The concept maps are interesting, but it can be hard to read some of the text when it overlaps with the nodes.

Minor

- I see that the authors acknowledge caregivers and parents on page 4 line 83, but I think it would be more inclusive of different family structures to switch to ‘caregivers’ as the main term over ‘parents’.

- Page 5 line 108 – Lena is an acronym and is generally capitalized as LENA

- Page 3 line 44: “has been made possibly” – do the authors mean “has been made possible”?

- There are a few typos throughout e.g., “user-centred”, “on-significant”, “Crochran’s Q”, “illustrative except examples”, “participating in more length investigations”, among some others.

- I believe it is more common to use “Wilcoxon” rather than “Wilcox”

Reviewer #3: This study summarizes responses to a questionnaire, sent to hundreds out households in the UK, regarding comfort with, concerns about, and orientations toward multiple types of infant developmental data collection technology that is aimed at use in the infant's home. I am happy to see that the authors have conducted this survey and think it's great that they are sharing the results. I think their work will be very useful to others thinking about collecting these types of data who are weighing the costs and benefits of more/less intrusive technologies. I have a number of small comments, but I think the manuscript is already in pretty good form:

- Please make it clear from the start that these data are limited to families in the UK. I can imagine that cultural context will influence a number of the measured outcomes, e.g., what times of day work best, what is perceived as "international", etc.

- In some cases where there is a significant difference between categories, a look at the graphical data makes apparent that, while significant, some of the differences aren't actually large in size. Since, e.g., PIs of research projects might use these data to get an idea of what a certain decision will "cost" them in terms of recruitment, it'd be useful to remind readers what significant translates to in terms of, e.g., % difference, rather than relying on the figures.

- The LENA recording device is named with an acronym ("Language ENvironment Analysis") and should be in all capital letters

- Regarding daylong audio recordings with the LENA device, a convenient overview of methodological and ethical concerns that may be useful for the current paper is Casillas & Cristia (2019; Collabra, A step-by-step guide to collecting and analyzing long-format speech environment (LFSE) recordings.) and a paper demonstrating the large shift in perspective for short vs. long at-home recordings is Bergelson et al., (2019; Dev Sci, Day by day, hour by hour: Naturalistic language input to infants). These two papers help round out some of the audio vs. video and short vs. long recording issues brought up by the authors already.

- The explanation for the preference of video over audio strikes me as somewhat unexpected given that video includes audio, could the authors please explain?

- The use of automated tools to anonymize rich data sources like audio and video are brought up, but I think need more expansion vis-a-vis the quite significant limitations they can bring, especially how accurate the tools are for any given use case (e.g., across household types, other data collection settings, cultural groups, etc.) and the extent to which validity data are needed to effectively use them.

- Regarding the previous point, if the authors have any information on how the parents understood or conceived of these automated tools, that would be useful as a standard to which these tools are expected to be held in real use cases.

- "only to be practical for shorter periods" (p. 16) >> this seems not true on the basis of the descriptive data captured in the figures. Please make a pass for these types of claims to make it clear what the distinction is between significant and meaningfully large effects, as relates to my second point.

- The "General Comments" subheader makes sense in the context of the questionnaire but always misled me. Perhaps the authors can call these "Open responses" or something along those lines?

- "Majority of stakeholders" >> It is my understanding that stakeholders includes more than the participants (e.g., the researchers and the tech developers too), so it may be useful to stick to "parents" or "guardians". Please check elsewhere for appropriate use of this term.

- "warrants investment in developing higher-grade quality versions of sensing bands/suits" >> I would like the authors to please expand a little on this. Could they propose some useful directions to go in, based on their data? (e.g., integration with custom apps via bluetooth connection, etc.)

- I found it hard to wrap my head around some of the analyses where the response categories overlap, e.g., "Day and Night", "Day", and "Night" are similar in a way that "Specific time" is not—can the authors please justify comparing these (actually) overlapping response categories as independent types?

- Finally, while I appreciate that the authors took the time to collect open responses, I found the Leximancer analyses totally unconvincing. I would advocate for removing them entirely from the paper, or reporting on individual representative examples.

Note: The manuscript cover page details state that the data are fully available without restriction, but I did not find a link to these materials in the draft.

Thanks for an interesting read!

Reviewer #4: This paper evaluates parents'/caregivers' acceptance of remote monitoring technologies to assess child development. They use three constructs to capture acceptability: 1. Practicability, 2. Privacy, 3. Feedback.

The authors' main argument is that the views parents and caregivers, the primary stakeholders, are important for the future adoption of these technologies. They note the limited research in this area (references 27 and 28). Prior research was also done in the US with a diverse population. It seems like the added value of this paper is the use of a sample from the UK and some more nuanced surveying of respondents.

The methodology is primary quantitative (i.e., survey), but they do content analysis using free text responses.

The paper would benefit from addressing methodological concerns and better structuring of their manuscript as mentioned in the comments below.

INTRODUCTION

MINOR COMMENTS

- LENA should be capitalized in line 108

- Contextualization is never defined in the introduction

METHODS

MAJOR COMMENTS

- The Methods section formatting is hard for the reader to follow. In general, it is good to have the participant recruitment/study population in the first section of the methods before mentioning the survey assessments. Further, because methods section does not align with their three constructs (practicability, privacy, feedback). Rather than having subheadings (study interaction, data sharing) under their three constructs (practicability, privacy, feedback), each is presented as headings. For example, data sharing would presumably be under privacy.

- The authors ran an extraordinary number of analyses, which though using Bonferroni corrections is concerning for false positives.

- They made their non-validated Likert responses ordinal, without displaying the number responses to participants, which means participants could ascribe differing values to the response choices. The concern, particularly given missing data, is that individual participant comparisons may not be possible.

MINOR COMMENTS

- The survey was piloted and revised, which is good

- Non-random sampling - It is worth noting that a lot of online advertising was used for recruitment, so the sample may be more tech-saavy. Also, some of the sample was from a pool of volunteers, which could also affect generalizability of results. This limitation is mentioned in part in the discussion, but primarily in regards to low SES population.

RESULTS

MAJOR COMMENTS

- Authors have a lot of figures describing demographic data where a fewer number of tables with the same data would suffice

MINOR COMMENTS

- Some of the heading formatting is off

DISCUSSION

MAJOR COMMENTS

The discussion is very long. Many results are discussed in the conclusion, which seems makes it seem unfocused. Discussing a more limited set of main findings with less numbers and percentages would be better for the reader.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Janet Y. Bang

Reviewer #3: No

Reviewer #4: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 5;16(2):e0245793. doi: 10.1371/journal.pone.0245793.r002

Author response to Decision Letter 0


29 Sep 2020

Reviewer #1

Comment 1: My primary concern is the framing of the study appears to be centred around the needs of the particular lab for a study they are planning. However, they attempt to draw much broader conclusions that would be of interest to the larger infant research community, and the introduction sets up these themes in very broad terms. I don't believe that they have been entirely successful in drawing conclusions of relevance to the broader research community, and I don't know whether it would work to frame the study solely around the conclusions relevant to this particular lab, or even specifically labs that do smartsuit testing (it's not clear to me how many that is)?

Response: We decided to frame the questions within a concrete context to help families to give opinions that might be more closely related to how they would act in an actual study (rather than a more abstract framing). We think there is increasing interest in the developmental research community in methods for home assessment using these kinds of technologies, and this has been greatly accelerated by the current pandemic. As such, we think our results may contain insights that would be of interest to a range of labs who might be considering embarking on this path. However, we agree that our sample and framing also places some constraints on the breadth of conclusions we can draw. To be clearer, we have clarified that insights might be most relevant to researchers planning to conduct similar research in the future:

LINE 188: “…for research into psychophysiology/motor and behavioural infant development.” To specify which technologies were addressed.

LINE 188: “Our questions were delivered in the context of real-world examples of such technologies and assessments to provide a concrete framing in which to ascertain realistic opinions from responders.” To justify why we were quite specific in our questions.

� Also see response to reviewer 3, comment 1.

Comment 2: I selected "no" for intelligibility not being there is a problem with the clarity of the English per se, but rather because there are some structural issues that make reading challenging. Two broad concerns: 1. The sub-headers are inconsistent, making it hard to match up the research questions with the data use to test these questions. For example, it took me a fair amount of searching to figure out what the sub-section "Study Interaction" was referring to. It appears to be a sub-section of the question(s) about practicality, but is listed separately in the Analysis section.

Response: We have aligned all headings throughout the manuscript with analysis, results and discussion structured under our initial themes as set in the introduction under study goals: Viability (subheadings: Sticker sensing electrodes versus smart suits/sensing bands, Static versus body video recording devices, Smartphones), Privacy (subheadings: Video and audio recording with/without privacy preservation, Data sharing), Data Access, and Future Participation.

Comment 3: Relatedly, there are quite a lot of questions that are tested in a number of different ways, and the reader gets a little lost in the trees for the forest. I did not find the figures particularly helpful in this respect in visualizing the findings - the authors could take a step back and consider which aspects of the findings they most want to highlight.

Response: We have added percentages to the text in the results section to aid understand of the figures as well as to highlight the main finding. Additionally, we have amended a number of subsections to more concisely describe findings for example, in “Comparison of length of participation” results we have moved the mcnemar post-hoc text to SM. Within Privacy section, we have added to the results descriptions of percentages of those who did not change their response between the technologies to highlight the weak effects. We have also added a few sentences at the beginning of each results subsection to remind the reader of the purpose of each sub-investigation to aid understanding.

Comment 4: The question about sharing with researchers outside of the lab does not describe any processes that might be in place to ensure participant confidentiality, which may also skew the responses toward a more conservative answer. The described purpose of the audio/video may play a key role in the participants responses. Here the survey suggests that the need for video/audio is fairly limited so participants may be more inclined to request that the data be anonymized. In my lab, participants tend to be quite willing to share their raw audio with us, as they understand that it is necessary for the research.

Response: Although we added descriptions of the technology for context, we kept the description of the purpose for all measurements relatively limited to increase generalisability, but we agree this may have influenced responses. We have added this as a point to our limitations in the manuscript.

LINE 820: “Similarly, the descriptions in the survey for the purpose of collecting each type of data was limited, in order to improve the generalisability of our findings. However, the description of the technology may have influenced responses, which may differ with more information or because of study specifics. Information pertaining to security and participant confidentiality for questions regarding data sharing were also limited. Providing information on the protocols of data across specific collaborating labs may influence opinions on data sharing. This needs to be taken into account by future investigators.”

Reviewer #2

Comment 1: I found the structure of the paper a bit confusing where in the Introduction and Research Questions there seem to be three main areas of focus (i.e., Practicality, Privacy, and Feedback), but the Analysis plan and Results separate those themes into a few more headers, and then the discussion creates new sub headers as well. My preference would be for more alignment or a way to introduce this organization to the reader. Because there is a lot of information in this manuscript, having some consistency in structure would be helpful for the reader.

Response: See above response to Reviewer 1’s comment 2.

Comment 2: Second, I felt like the themes raised in the Introduction were at times broader than the scope of the article. For example, the authors discuss many issues related to practicality but it seems that this is examined specifically in relation to duration of use in a day.

Response: We agree that this was not clear. During our piloting, we noted a number of participants commenting on the length of study determining the practicality of technologies: with longer investigations being less practical. Therefore, in order to prevent ambiguity in the interpretation of the question we added to the questionnaire, specifying length of study over two questions regarding practicality. We specifically focused on reporting differing practicality rating with length of study as we believe this the most informative for the widest variety of future investigations. Additionally, we also provided open field response boxes within each practicality question for more specific concerns of practicality to be highlighted. However, we have not reported on these for conciseness of an already very comprehensive paper, as we did not identify any additional relevant themes. We have also eliminated these from the open data sharing as responders at times answered these questions non-anonymously.

We have added to the introduction to specify this reasoning of asking questions in this manor: LINE 255: “The survey consisted of multiple-choice questions on the following topics “ …… “The practicality of technologies over different time scales (to assess overall practicality while accounting for the possible effect length of study on practicality).”

Comment 3: The authors also raise an important issue of feedback and the potential of noticing atypical behaviours, but these concerns do not seem to be addressed in the analyses and the discussion. I would suggest specifying the scope of the paper earlier in the introduction and research questions.

Response: In response to different reviewer’s comment, we have changed the section on “feedback” to “data access”, as we believe this is a more accurate description of our questions. Because of this, as well as the angle of our questions, we have eliminating the comment on atypical behaviours in the new section “data access”. We also acknowledge that specifying the scope earlier in the paper as an important comment and we have addressed this: see our response to reviewer 1 comment 1 and reviewer 3 comment 1.

Comment 4: The authors present this work to be important for COVID-safe measures and ‘socially-distanced’ data, which of course is extremely relevant to our times now. However, adopting in-home infant monitoring technologies are likely important for issues of including many different families who may not always have the time or access to research studies, as well as performing research at a very high scale (as the authors acknowledge). I think it would benefit the manuscript to emphasize these latter points, because the implications of this work are much broader than for the pandemic alone.

Response: We have acknowledged this comment and have added:

LINE 67: “as remote technologies can be implemented by caregivers, they also provide an opportunity for socially distanced data collection at a more scalable level and may facilitate the participation of participant groups who would find it difficult to come to a lab (e.g. those with disabilities, working caregivers or remotely located families).”

Comment 5: the authors seem to focus on specific comparisons between technologies in their analyses, which are not immediately obvious to the reader. It would be helpful to include this specificity in their research questions.

Response: The comparison of technologies falls into broad categories of low or high active care (stickers are high active care as they require more time and technique to apply, as described in the introduction paragraph titled “viability”. We wanted to compare across the levels of active care within particular data types (e.g. physiology or video capture of behaviour). We have reworded some of the viability subsection of the introduction for clarity. See below for examples:

LINE 198: “For video data, are static low active care recording devices preferable to all-encompassing high active care on-body video recording devices?”

LINE 100: “In terms of viability, remote tools and assessments can be categorised by the required amount of active care.”

LINE 103: “The latter can be easily and quickly put on/taken off the infant and are not too far removed from daily dressing routines and are therefore low active care devices.”

LINE 114: “Despite this, caregivers’ opinions on static low active cares versus on-body high active care video devices is unclear”

Additionally, for clarification of this we have added to our viability study research questions:

LINE 194: “For the collection of infant psychophysiological/motor data, are lower active care infant wearable technologies (e.g. smart suits and wrist/ankle bands) preferable to more traditional higher active care technologies (e.g. sensing electrode stickers)?”

LINE 198: “Are static low active care recording devices preferable to all-encompassing high active care on-body video recording devices?”

Comment 6: Page 4 line 69: “Although user-friendly, commercial devices allow limited access to raw, high resolution data and are therefore poorly equipped for more complex research questions” – I don’t understand why high-resolution data is poorly equipped for more complex research questions? It seems that high-resolution data would in fact be great for more complex research questions?

Response: We apologise this wasn’t clear – we meant that access to that kind of data is often not possible or highly limited (rather than that that type of data wouldn’t be useful) – we have re-worded this:

LINE 73: “User-friendly, commercial devices do not allow access to raw, high resolution data and are therefore poorly equipped for more complex research questions”.

Comment 7: The authors discuss practicality here in many ways, but the analyses seem to focus on duration of use in a day? I suggest to specify that focus here to help orient the reader. The terminology of practicality and practicability are also used interchangeably, I would suggest using one for consistency unless they convey different meanings.

Response: See response to comment 1. Also, Practicability means whether it is “viable” or “possible” for caregivers. Practicality is whether it is easy or efficient. We acknowledge the similarity of these two words, so we have changed the use of Practicability to Viability so that the reader can easily distinguish the points we are making,

Comment 8: I’m not sure I understand the paragraph on the ‘contextualization’ of data (starting line 114). Aren’t all in-home technologies providing the contextualization of a more ecological setting?

Response: We agree that home-based technologies are designed to enable capture in a natural context. We meant to convey that researchers may want additional information about the nature of that context. Homes will naturally vary more than a single lab setting, so additional measures of that context may be needed to aid interpretation. For example, for physiological data we might want to ask how changes in an infant’s heart rate are coupled with variation in noise levels in their environment. Contextualisation in this sense is being used to refer to the video recording or parent reports on a smart phone that can be used to understand what is happening in the environment.

We have amended the paragraph for clarity:

LINE 120: “The contextualisation of data is another key requirement of remote designs, particularly for relatively lower resolution data (e.g. physiological measures that do not provide identifiable data). In a lab setting, environments are often controlled but, in a home setting the context in which the data is being collected can vary substantially (e.g. dinner time, playtime, bedtime etc). Recording this contextual information is sometimes required in order to understand the data (e.g. did an infant’s heartrate increase because they were crying or laughing?). The increasing societal ubiquity of smartphones (33) make them an ideal tool for the collection of both contextualisation data and primary data (33,34)”

Comment 9: The authors mention the use of resolution in a couple of places but it doesn’t seem consistent (e.g., line 69 high resolution data vs. line 115 lower resolution data like physiological measures). Are physiological measures considered lower resolution because they are not identifiable like audio or video recordings?

Response: Yes this is what we meant. But this sentence has now be redacted and our point has been clarified within the new contextualisation paragraph starting from LINE 120.

Comment 10: Rather than “Feedback”, perhaps using a different term specific to families’ access to the data is better? It doesn’t seem like the authors examine findings related to the issues of caregiver concerns of atypical behaviour.

Response: We have changed “feedback” to “data access”.

Comment 11: How were families compensated?

Response: We have added:

LINE 242: “Participants received no monetary compensation for their time.” To the end of the “recruitment procedure” section of the methods.

Comment 12: Do the authors have information on how long it took caregivers to respond to the surveys (e.g., mean and range)?

Response: We only have the average as this is the only statistic from survey monkey – we have added:

LINE 246: “which took an average of 12 minutes 18 seconds to complete.”

Comment 13: I had difficulty understanding this sentence on page 12 lines 260 – 263: “Note that all McNemar tests in this paper conducted for each categorical option on 2*2 contingency tables constructed with number of responders selecting that categorical option versus number of responders not selecting that category across the items being assessed e.g. technology.”

Response: We added this sentence to clarify the sentence before, but after revisions we are aware this may have confused the reader. We have opted to remove this sentence and added to the previous sentence so that it now reads:

LINE 295: “We used Bhapkar tests with 2*2 contingency Bonferroni corrected McNemar post-hoc test to compare selecting versus not selecting the response category between technologies for each response separately.”

Comment 14: Is there a table that could help readers understand the different technologies targeted in the survey?

Response: We have added this:

LINE 249: “Sections 2-7 asked about the responder’s attitudes to the following technologies: smart suits, sensing electrode stickers, wrist/ankle bands, video recording, audio recording, and smartphones (see S4 Table A for summary of technologies)”.

Comment 15: “Now and Then” – what does this mean? Was this described for the caregivers?

Response: Now and then is a common phrase meaning occasionally in British English, this was not explained to participants but we assumed our British sample would be accustomed to the phrase and its meaning.https://www.collinsdictionary.com/dictionary/english/now-and-then

Comment 16: The authors seem to use a number of non-parametric tests, I assume this is because data are categorical? It would be helpful to include this justification.

Response: Yes, as the data was categorical and ordinal. We have added:

LINE 276: “using non-parametric tests due to the ordinal and categorical nature of the data.” to the analysis section for clarity.

Comment 17: This discussion was comprehensive but also a bit long. Not sure if there is a way to make this more concise but still include the information that the authors would like to convey?

We have streamlined the discussion by eliminating numbers and percentages (as these are merely reiterations from the results). We have also revised throughout to improve concision, shortening lengthy sentences and removing excerpts. To streamline the points make in the discussion, we have also removed the point within the Privacy subheading on the difference between video and audio on length of study as after review this point was overly elaborate connection between the results and the open response and potentially inflate the relatively small effect size of the results.

Comment 18: The authors include a header of “Wearable” devices, but their research questions seemed specific to smart suits and electrodes? Also, their questions regarding video and audio recordings were grouped in the results regarding issues of privacy, which seems different from whether they would adopt the use of the technology?

Response: See above response to Reviewer 1’s comment 2. Additionally, we have grouped video/audio technologies under privacy as the primary concern families are likely to have with these modalities concerns privacy (rather than practicality – as is demonstrated by themes of privacy in the open responses to audio and video). Furthermore, we compared these technologies with and without privacy preserving techniques, providing further justification to group in the privacy section to prevent reptation of analysis.

Comment 19: I think it is also important to acknowledge the valence of caregivers’ responses. For example, while smart suits were preferred over sensing electrode stickers, the median score was 3 for sensing electrode stickers. Does this mean that participants feelings’ may be on average neutral? And perhaps with some concerns addressed they would be interested?

Response: We have considered this comment and added to the discussion:

LINE 512: “It must be noted that although bands/body suits were rated more favourably in the qualitative rating, stickers were viewed neutrally by caregivers (selecting a median score of 3/neutral on the rating scale). Potentially, by addressing the safety concerns highlighted in the open responses, stickers may be seen more favourably.”

Comment 20: The concept maps are interesting, but it can be hard to read some of the text when it overlaps with the nodes.

Response: Unfortunately, this is the way the Leximancer software creates the maps. We tried to make it as legible as possible by adjusting the character size. We believe that although some words overlap slightly, in our opinion all are readable as different colours have been used.

Comment 21: I see that the authors acknowledge caregivers and parents on page 4 line 83, but I think it would be more inclusive of different family structures to switch to ‘caregivers’ as the main term over ‘parents’

Response: All “parents” are changed to “caregiver” other than those that were included in the illustrative quotes from responders.

Comment 22: Page 5 line 108 – Lena is an acronym and is generally capitalized as LENA

Response: lena changed to LENA

Comment 23: Page 3 line 44: “has been made possibly” – do the authors mean “has been made possible”?

Response: Corrected typo to “possible”

Comment 34: There are a few typos throughout e.g., “user-centred”, “on-significant”, “Crochran’s Q”, “illustrative except examples”, “participating in more length investigations”, among some others.

Response: We have amended these that have been noted and amended others throughout (as seen in the tracked changes document)

Comment 35: I believe it is more common to use “Wilcoxon” rather than “Wilcox”

Response: This typo has been corrected

Reviewer #3:

Comment 1: Please make it clear from the start that these data are limited to families in the UK. I can imagine that cultural context will influence a number of the measured outcomes, e.g., what times of day work best, what is perceived as "international", etc.

Response: We have revised the text to emphasise that the insights may be most relevant to the UK, and their cultural generalisability should be explored:

Line 92-96. We state our rational that there hasn’t been any canvassing of the opinions of a UK cohort and this is our goal.

Line 180: we state our goal is to canvass opions of a UK caregivers. I have clarified the potential of the research to provide guidance to (line 182) “similar UK based lab/research groups”

IINE XXX : “UK caregiver” to clarify our aim.

Line 562 – 564: we have added “a Uk based cohort”, “with similar aims”

Comment 2: In some cases where there is a significant difference between categories, a look at the graphical data makes apparent that, while significant, some of the differences aren't actually large in size. Since, e.g., PIs of research projects might use these data to get an idea of what a certain decision will "cost" them in terms of recruitment, it'd be useful to remind readers what significant translates to in terms of, e.g., % difference, rather than relying on the figures.

Response: We have noted this and added percentages to the results section to highlight our main findings. We have also reiterated small effect sizes by acknowledging the percentages of response that do not change in the results and highlighting this in the discussion.

Addition of percentages can be noted throughout results.

Addition of clarity to the small effect sizes can be notes by the following additions.

Results:

LINE 460: “Respectively, 51.66%, 55.37% and 55.75% of caregivers did not consider privacy preserving technique to change their likelihood of participation with on-body camera, cot camera and audio recording”

LINE 476: Comparison of practicality. “Averaged across both lengths of time, 58.31% of participants indicated video and audio as equally practical (Fig 2B).”

LINE 481: “Though this was to a weak effect (Kendall W = 0.227), with 47.21% and 42.40% of the sample indicating “Short Period” of recording more practical than “Extended Period” for video and audio respectively.”

LINE 490: “Averaged across recording technology, 66.67% of responders did not change their response when given the privacy preserving option.”

Discussion:

LINE 677: “did increase favourability of technology but to a moderate degrees, with the approximately half of participants responding the same with and without the option of privacy preserving processing within technology”

LINE 688: “The lack of preference to either video or audio, as well as the minimal favourability to privacy preserving processing was reiterated in responses to preferred study duration. The majority of participants did not change their response between technologies nor between privacy preserving option.”

Comment 3: The LENA recording device is named with an acronym ("Language ENvironment Analysis") and should be in all capital letters

Response: lena changed to LENA

Comment 4: Regarding daylong audio recordings with the LENA device, a convenient overview of methodological and ethical concerns that may be useful for the current paper is Casillas & Cristia (2019; Collabra, A step-by-step guide to collecting and analyzing long-format speech environment (LFSE) recordings.) and a paper demonstrating the large shift in perspective for short vs. long at-home recordings is Bergelson et al., (2019; Dev Sci, Day by day, hour by hour: Naturalistic language input to infants). These two papers help round out some of the audio vs. video and short vs. long recording issues brought up by the authors already.

Response: We agree that here two papers are very relevant to our manuscript and have added both of these reference to our paper:

LINE 65: “Similarly, longer measurement periods may also shed new light on behaviours that have traditionally been measured over relatively short epochs of data collection (12,13)”

Comment 5: The explanation for the preference of video over audio strikes me as somewhat unexpected given that video includes audio, could the authors please explain?

Response: Video does not necessarily always include audio – in our survey we were questioning moving image recording only (video without audio) and audio separately. As we have different responses across the two we assume participants interpreted this in this way. Nonetheless we have added to our discussion the ambiguity of this questioning.

Comment 6: The use of automated tools to anonymize rich data sources like audio and video are brought up, but I think need more expansion vis-a-vis the quite significant limitations they can bring, especially how accurate the tools are for any given use case (e.g., across household types, other data collection settings, cultural groups, etc.) and the extent to which validity data are needed to effectively use them.

Response: We have addressed this comment and added it to the discussion .

LINE 701: “Researchers must therefore thoroughly consider beforehand what variables are needed for analysis, and the validity of extracted data using the chosen method given the data collection setting (e.g. will the infant’s vocal pitch be validly extracted if collected in a noisy household).”.

We have also alluded to the privacy-preserving technique having pitfalls in the introduction LINE 148: “Considering how participants view the efficacy of privacy-preserving measures in the context of different research designs will enable researchers to make informed decisions on the trade-off between data quality and participant uptake/attrition.”

Comment 7: Regarding the previous point, if the authors have any information on how the parents understood or conceived of these automated tools, that would be useful as a standard to which these tools are expected to be held in real use cases.

Response: We agree that this would be really interesting. Unfortunately, we do not have any information on this, but we have noted the impact of differing perceptions/understanding of the technology on the opinion in the discussion:

LINE 822: “the description of the technology may have influenced responses, which may differ with more information or because study specifics.”

LINE 826: “Ultimately, the level of participant understanding of the technology/assessment specific is likely to influence opinion, thus, needs to be taken into account by future investigators.”

Comment 8: - "only to be practical for shorter periods" (p. 16) >> this seems not true on the basis of the descriptive data captured in the figures. Please make a pass for these types of claims to make it clear what the distinction is between significant and meaningfully large effects, as relates to my second point.

Response: We are aware that the wording of this comment may have been misleading. We have now changed this to “would be more preferred for shorter periods”. We have also gone through the whole manuscript and made sure that the interpretations are consistent with the effect sizes on the graph. And have added percentages to the results section to reiterate this. See response to comment 2.

Comment 9: The "General Comments" subheader makes sense in the context of the questionnaire but always misled me. Perhaps the authors can call these "Open responses" or something along those lines?

Response: We have changed all “general comments” to “open-ended responses”

Comment 10: "Majority of stakeholders" >> It is my understanding that stakeholders includes more than the participants (e.g., the researchers and the tech developers too), so it may be useful to stick to "parents" or "guardians". Please check elsewhere for appropriate use of this term.

Response: Changed all “stakeholders” to “caregivers”

Comment 11: - "warrants investment in developing higher-grade quality versions of sensing bands/suits" >> I would like the authors to please expand a little on this. Could they propose some useful directions to go in, based on their data? (e.g., integration with custom apps via bluetooth connection, etc.)

Response In terms of development we were considering more generally, and have added an example to the end of the sentence the reviewer mentioned:

LINE 586: “e.g. sensors wirelessly connected to apps that would pre-process data remotely, and upload anonymised derived data.”.

Comment 12: I found it hard to wrap my head around some of the analyses where the response categories overlap, e.g., "Day and Night", "Day", and "Night" are similar in a way that "Specific time" is not—can the authors please justify comparing these (actually) overlapping response categories as independent types?

Response: We included response options in this manner, as “Day and Night” refers to the total 24hour period of day and night. Whereas “Day” and “Night” refer to only the day period or only the night period, but not both. We believe the way our participants interpreted it as there was a difference as it was a forced choice (i.e. the could not choose both “day and night” and “night”).

Comment 13: Finally, while I appreciate that the authors took the time to collect open responses, I found the Leximancer analyses totally unconvincing. I would advocate for removing them entirely from the paper, or reporting on individual representative examples.

Response: We acknowledge the shortcomings of the Leximancer approach in the limitation section of the discussion.

LINE 811: “We attempted to conduct a rudimentary qualitative analysis using topographic maps that extrapolated themes/concepts based on the number of mentions. However, this was not an exhaustive systematic analysis of the qualitative data, qualifying the depth of conclusions we can draw.”.

LINE 589: “(though it is important to note that these represent a simple summation of the most common words used, and future work should employ more extensive qualitative methods).”

We have chosen not to report on individual representative examples because we are concerned that would run the risk of bias or misrepresenting our data. We want to retain this data in the paper as we believe it valuable to understanding the motivation behind quantitative findings and highlightly themes/concepts that we had not considered. A notion we have added to the introduction.

LINE 278: “This analysis was not intended to be exhaustive, but to highlight themes beyond those considered when designing the survey.”

Comment 14: : The manuscript cover page details state that the data are fully available without restriction, but I did not find a link to these materials in the draft.

Response: We added the link to the PLOS one submission. Unsure why this reviewer had an issue with finding it?

Reviewer #4

Comment 1: LENA should be capitalized in line 108

Response: lena changed to LENA

Comment 2: Contextualization is never defined in the introduction

Response: Added the following for clarity:

LINE 120: The contextualisation of data is another key requirement of remote designs (e.g. physiological measures that do not provide identifiable data). In a lab setting environments are controlled, but in a home setting the context in which the data is being collected can vary dramatically both within and between infants (e.g. dinner time, playtime, bedtime etc). Recording this contextual information is sometimes required in order to understand the data (e.g. did an infant’s heartrate increase because they were crying or laughing?). The increasing societal ubiquity of smartphones (33) make them an ideal tool for the collection of both contextualisation data and primary data (33,34).

Comment 3: The Methods section formatting is hard for the reader to follow. In general, it is good to have the participant recruitment/study population in the first section of the methods before mentioning the survey assessments. Further, because methods section does not align with their three constructs (practicability, privacy, feedback). Rather than having subheadings (study interaction, data sharing) under their three constructs (practicability, privacy, feedback), each is presented as headings. For example, data sharing would presumably be under privacy.

Response: We have reformatted the manuscript methods section to start with participants, where the sample characteristics have been described. This is followed by recruitment and then the survey. We have aligned all headings throughout the manuscript with analysis, results and discussion structured under our initial themes as set in the introduction under study goals.

Comment 4: The authors ran an extraordinary number of analyses, which though using Bonferroni corrections is concerning for false positives.

Response: We have noted this in the limitations section.

LINE 829: “In order to comprehensively cavass caregivers’ opinions on remote monitoring technologies and study designs, we asked a large number of question. Consequently, we conducted a large number of comparisons for which we attempted to correct for multiple comparisons within each analysis using Bonferroni correction. Nonetheless there is the potential for false positives. Therefore, we present all analysis alongside appropriate effects size and graphs, as well as made the data available. This is to enable future investigators to evaluate the information that be most relevant to their particular study.”

Comment 5: They made their non-validated Likert responses ordinal, without displaying the number responses to participants, which means participants could ascribe differing values to the response choices. The concern, particularly given missing data, is that individual participant comparisons may not be possible.

Response: The response options were not presented to the participants in a numerical likert scale as we considered separate qualitative options e.g. “Extremely likely”, to reduce likelihood of participants ascribing differing meaning to the answer. Retrospectively, we are aware that different participants may ascribe different differences between the responses, as they were not numerically scaled. However, most comparisons were conducted within subject, therefore we believe should reduce the possibility of this influencing the results as within individual’s are likely to use the same construct.

Comment 6: Non-random sampling - It is worth noting that a lot of online advertising was used for recruitment, so the sample may be more tech-saavy. Also, some of the sample was from a pool of volunteers, which could also affect generalizability of results. This limitation is mentioned in part in the discussion, but primarily in regards to low SES population.

Response: We have added to our limitations to make this point more explicit.

LINE 794: “, thus people who responded to the survey were probably those already likely to engage in and would have an already high level of acceptance of our research, limiting the scope of generalisation to a degree. The recruitment stream used may have particularly limited access to low SES families, as noticed in the demographic of our sample.”

Comment 7: Authors have a lot of figures describing demographic data where a fewer number of tables with the same data would suffice

Response: This is now in a table

Comment 8: Some of the heading formatting is off

Response: We have corrected this

Comment 9: The discussion is very long. Many results are discussed in the conclusion, which makes it seem unfocused. Discussing a more limited set of main findings with less numbers and percentages would be better for the reader.

Response: see response to reviewers 2 comment 7.

Editor response:

Comment 1: Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Response: we have considered the mentioned links and believe we have followed the guidance provided. We have amended

Comment 2: Please amend either the title on the online submission form (via Edit Submission) or the title in the manuscript so that they are identical.

Response: we have aligned both title pages.

Comment 3: Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright license more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information

Response: we have added to the manuscript that the questionnaire was developed for the purpose of the study.

LINE 245: “We developed the survey for the purpose of this study (See S1 for the full non-copyright survey).”

Comment 4: Please note that PLOS ONE uses a single-blind peer review procedure. We would therefore be grateful if you could include in the information that has been redacted for peer review in the manuscript.

Response: We have included all identifiable information.

Kind regards,

Laurel Fish

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Barbara Schouten

11 Nov 2020

PONE-D-20-20163R1

A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research.

PLOS ONE

Dear Drs. Fisher,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Overall, as you will see reviewers were quite satisfied with your revised manuscript, but had some additional remarks to further improve upon it. Please try to incorporate these as much as possible in the revised version of your manuscript, 

Please submit your revised manuscript by Dec 26 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Barbara Schouten

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: (No Response)

Reviewer #3: (No Response)

Reviewer #4: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The structure of the paper is much more readable, and the authors have been very responsive to prior critiques. I still feel that some of the conclusions are a little broad given the limitations of the survey. I appreciate the need to give specific examples, but I still feel that this may skew the responding in ways that are not known. They have added some wording to acknowledge this, however, and the findings more generally would be of interest to a broader audience even if care must be taken in generalizing these findings to other labs.

Reviewer #2: I appreciate the author’s detailed responses to the comments. I think this revision is an improvement, with clearer goals and in a more concise and organized format. I believe that this will be an interesting contribution to the literature. Many of my comments have been addressed appropriately. I have a few more comments below:

Intro

- Unclear how smartphones are helping the contextualization? The explanation here doesn’t address contextualization in the ways addressed earlier in the paragraph.

Methods

- Lines 254 – 259 seem like a list? I think this would be better set up as an enumerated list or with a colon or semi-colons to group these together.

Results

- It seems like there are results presented here that don’t follow from the research questions? For example, the authors pose research questions as related to 1) preferences of lower active vs. higher active technologies, 2) static vs. all-encompassing technologies, and 3) smartphones, but the research questions are framed as preferences and without the different analytic headers as seen in the results re likelihood practicality, and duration with different technologies (although I see the Results and Discussion headers follow consistently).

- Additionally, in the research question the authors mention write/ankle bands, but in the Results we are routed to the supplemental material – making that consistent from the beginning would be helpful (I may be misunderstanding this?). They also use the term sensing bands here in the header – which seems to encompass wrist/ankle bands? The organization in the Results in relation to the Research Questions was still a bit confusing for me.

- I have no comment on the use of “Bhapkar tests with a 2*2 contingency Bonferroni corrected McNemar post-hoc test” “. I am just unfamiliar with this test.

Reviewer #3: I am overall satisfied with the revisions and I thank the authors for their changes. I have only a few minor remaining comments:

- Without revealing anything about this study I contacted a British English speaking colleague as well as a non-native English-speaking colleague about what "video" means to them in this context. While the BrEng colleague's judgment fell well in line with the authors' the non-native English speaking colleague's judgments fell in line with my own: that "video" without further specification is ambiguous as to an image-only stream or an audio-visual stream. Please add just a very short clarification to avoid dialectical issues in interpretation.

- There is still at least one case of "stakeholder" that needs to be replaced: "it is critical to gather stakeholder’s views" >> should be "caregivers'" or perhaps "participating families'"; please check again for other cases.

- The context for sending the weblink comes after it's first mentioned (i.e., after information about participant responses), which may be confusing. Could the recruitment information come first?

- Please mention "UK" again at the top of the summary as it's appropriate to specify scope in a discussion section

- There are a number of minor typos/grammatical errors throughout the manuscript (e.g., some possessive apostrophes, extra capitalization, extra/missing spaces).

Thanks!

Reviewer #4: INTRODUCTION

Minor comment, Line 122: This sentence is slightly confusing as written. Adding a comma after "lab setting" would make it more readable. "In a lab setting environments are controlled, but in a home setting the context in which the data is being collected can vary dramatically both between infants (e.g. single child, multi-generational household, etc) and within infant across a day (e.g. dinner time, playtime, bedtime etc)."

Minor comment, Line 144: Please revise this sentence for clarity: " A previous parent opinion survey established privacy-preserving techniques (e.g. the implementation of computer algorithms to automatically extract behaviour markers independent of identity), to only minorly improve willingness to participate in the collection of identifiable measures."

METHODS:

Minor comment, Line 222: Some people may oppose the demographic results being in the methods section as opposed to the results section. Please make sure this aligns with the journal guidelines

Minor comment: Is the abbreviation B.A.M.E necessary in Table 1? Can this be spelled out?

Minor comment, Line 278: Please add a reference for researchers who may want replicate the text mining analysis. In the supplement there are reference citations, but I do not see actual references.

RESULTS:

Minor comment: Some sentences start with numerical percentages. Please make sure this aligns with journal guidelines.

DISCUSSION:

Major comment: Given the limitations of this text mining analysis, it would be nice to put the results about caregivers' concerns for safety in the context of the existing literature. Is there literature finding similar or different results regarding safety?

Minor comment, Line 830: Canvass is misspelled: "In order to comprehensively cavass caregivers’ opinions on remote monitoring technologies and study designs, we asked a large number of question."

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Reviewer #4: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 5;16(2):e0245793. doi: 10.1371/journal.pone.0245793.r004

Author response to Decision Letter 1


21 Dec 2020

Reviewer #1:

The structure of the paper is much more readable, and the authors have been very responsive to prior critiques. I still feel that some of the conclusions are a little broad given the limitations of the survey. I appreciate the need to give specific examples, but I still feel that this may skew the responding in ways that are not known. They have added some wording to acknowledge this, however, and the findings more generally would be of interest to a broader audience even if care must be taken in generalizing these findings to other labs.

Response: We have added to our conclusions “Although generalisability should be considered,” to re-highlight this limitation (line 1146)

Reviewer #2:

I appreciate the author’s detailed responses to the comments. I think this revision is an improvement, with clearer goals and in a more concise and organized format. I believe that this will be an interesting contribution to the literature. Many of my comments have been addressed appropriately. I have a few more comments below:

Comment 1: Intro: Unclear how smartphones are helping the contextualization? The explanation here doesn’t address contextualization in the ways addressed earlier in the paragraph.

Response: We have added: “Contextualising information could be collected using smartphones via self-reporting (37). For example, a caregiver could input infant’s current activity in response to a prompt.” (lines 136 – 138)

Comment 2: Methods: Lines 254 – 259 seem like a list? I think this would be better set up as an enumerated list or with a colon or semi-colons to group these together.

Response: we have added colon and semi-colon to group this together.

Comment 3: Results: It seems like there are results presented here that don’t follow from the research questions? For example, the authors pose research questions as related to 1) preferences of lower active vs. higher active technologies, 2) static vs. all-encompassing technologies, and 3) smartphones, but the research questions are framed as preferences and without the different analytic headers as seen in the results re likelihood practicality, and duration with different technologies (although I see the Results and Discussion headers follow consistently).

Response: We have added subheadings such as “Sticker sensing electrodes versus smart suits” into both the study goals section and the methods that are consistent with the results and discussion to make this clearer. We’ve also reworded some of the method section under these subheadings to make it clearer which questions (e.g. likelihood, practicality and length of participation) were asked in each section.

Comment 3: Additionally, in the research question the authors mention write/ankle bands, but in the Results we are routed to the supplemental material – making that consistent from the beginning would be helpful (I may be misunderstanding this?). They also use the term sensing bands here in the header – which seems to encompass wrist/ankle bands? The organization in the Results in relation to the Research Questions was still a bit confusing for me.

Response: We wanted to point the reader to the SM for this analysis as the paper is already very long as previous comments on this paper have pointed out. Also the question/findings from this analysis are similar to the stickers v smart suits so they are more complementary, so they were put in the SM. To make this clearer we’ve removed “sensing bands” from the subheadings and research question, and have “Similar analysis comparing smart suits and sensing electrode stickers to wrist/ankle bands was also conducted (Methods and Results are reported in S6).”, in the methods section’s analysis section under Sticker sensing electrodes versus smart suits, so that it is more of a sub/complementary analysis.

Reviewer #3

I am overall satisfied with the revisions and I thank the authors for their changes. I have only a few minor remaining comments:

Comment 1: Without revealing anything about this study I contacted a British English speaking colleague as well as a non-native English-speaking colleague about what "video" means to them in this context. While the BrEng colleague's judgment fell well in line with the authors' the non-native English speaking colleague's judgments fell in line with my own: that "video" without further specification is ambiguous as to an image-only stream or an audio-visual stream. Please add just a very short clarification to avoid dialectical issues in interpretation.

Response: We have added “image-only video” where appropriate throughout the paper:

- Aims:

- Privacy section of methods:

- Results section: “Static versus body image-only video recording devices”.

- Results Privacy section overview paragraph: “In-home remote infant monitoring studies, particularly those with highly identifiable image-only video and audio recording, raise privacy issues.”

- Discussion: “Static versus body image-only video recording devices” section title and we added to the first line: “Caregivers indicated similar levels of usage likelihood for static cot cameras versus on-body camera for image-only video recording”

- Discussion: “Image-only video versus audio recording with/without privacy preservation” section title. “And Similar to smartphones, audio or image-only video recording not only contribute contextualising data, but additional informative data”…. “The lack of preference to either image-only video or audio”

-

Comment 2: There is still at least one case of "stakeholder" that needs to be replaced: "it is critical to gather stakeholder’s views" >> should be "caregivers'" or perhaps "participating families'"; please check again for other cases.

Response: Corrected to caregivers

Comment 3: The context for sending the weblink comes after it's first mentioned (i.e., after information about participant responses), which may be confusing. Could the recruitment information come first?

Response: We have moved the Recruitment procedure to come before Participants section.

Comment 4: Please mention "UK" again at the top of the summary as it's appropriate to specify scope in a discussion section

Response: Added “in the UK” to Fig 9. Description. And “ in-home monitoring with infant participants in the UK” to the figure title.

Comment 5: There are a number of minor typos/grammatical errors throughout the manuscript (e.g., some possessive apostrophes, extra capitalization, extra/missing spaces).

Response: With careful review, we have now corrected all those we are aware of.

Reviewer #4

Comment 1: INTRODUCTION: Minor comment, Line 122: This sentence is slightly confusing as written. Adding a comma after "lab setting" would make it more readable. "In a lab setting environments are controlled, but in a home setting the context in which the data is being collected can vary dramatically both between infants (e.g. single child, multi-generational household, etc) and within infant across a day (e.g. dinner time, playtime, bedtime etc)."

Response: The comma has been added.

Comment 2: Minor comment, Line 144: Please revise this sentence for clarity: " A previous parent opinion survey established privacy-preserving techniques (e.g. the implementation of computer algorithms to automatically extract behaviour markers independent of identity), to only minorly improve willingness to participate in the collection of identifiable measures."

Response: We have reviewed this sentence and hope it is now clear. “A recent report on a USA-based sample of parents indicated privacy-preserving techniques to minorly improve willingness to participate in the collection of identifiable data on their infant (29). Such privacy-preserving techniques included the implementation of computer algorithms to automatically extract measures of behaviour and remove identifiable information (29).”

Comment 3: METHODS: Minor comment, Line 222: Some people may oppose the demographic results being in the methods section as opposed to the results section. Please make sure this aligns with the journal guidelines

Response: We have divided the “Participants” section. In the methods we explain how many people participated and refer to the attrition SM. The demographics part of that paragraph has now been moved to the beginning of the results section under “Sample Demographics”

Comment 4: Minor comment: Is the abbreviation B.A.M.E necessary in Table 1? Can this be spelled out?

Response: We have changed this to “Black, Asian and Minority Ethnic Group”.

Comment 5: Minor comment, Line 278: Please add a reference for researchers who may want replicate the text mining analysis. In the supplement there are reference citations, but I do not see actual references.

Response: Reference has been added (Smith A. Leximancer Pty Ltd [Internet]. Brisbane, Australia; 2009. Available from: https://info.leximancer.com)

Comment 6: RESULTS: Minor comment: Some sentences start with numerical percentages. Please make sure this aligns with journal guidelines.

Response: We have now corrected this throughout the paper.

Comment 7: DISCUSSION: Major comment: Given the limitations of this text mining analysis, it would be nice to put the results about caregivers' concerns for safety in the context of the existing literature. Is there literature finding similar or different results regarding safety?

Response: This has been noted in previous literature, we have added (line 868) “This finding was consistent with a previous qualitative report on potential barriers for participation with ambulatory infant sensing devices; caregivers expressed concerns about the comfort of the physical placement of the sensor on their child (29). Though such concerns are likely to be addressed by manufacturers of the technologies as well as local ethics boards prior to implementation, future researchers should explicitly state the safety of these measures during advertising/consent to improve participant uptake.”

Comment 8: Minor comment, Line 830: Canvass is misspelled: "In order to comprehensively cavass caregivers’ opinions on remote monitoring technologies and study designs, we asked a large number of question."

Response: Corrected.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Barbara Schouten

8 Jan 2021

A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research.

PONE-D-20-20163R2

Dear Dr. Fish,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Barbara Schouten

Academic Editor

PLOS ONE

Acceptance letter

Barbara Schouten

18 Jan 2021

PONE-D-20-20163R2

A survey on the attitudes of parents with young children on in-home monitoring technologies and study designs for infant research.

Dear Dr. Fish:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Barbara Schouten

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Survey.

    (PDF)

    S2 File. Analysis supplementary information.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All data files are available from the OSF database (osf.io/fbhd8).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES