Skip to main content
PLOS One logoLink to PLOS One
. 2023 Jul 13;18(7):e0288488. doi: 10.1371/journal.pone.0288488

The PiNe box: Development and validation of an electronic device to time-lock multimodal responses to sensory stimuli in hospitalised infants

Alan Worley 1, Kirubin Pillay 2, Maria M Cobo 2, Gabriela Schmidt Mellado 2, Marianne van der Vaart 2, Aomesh Bhatt 2, Caroline Hartley 2,*
Editor: Talib Al-Ameri3
PMCID: PMC10343045  PMID: 37440586

Abstract

Recording multimodal responses to sensory stimuli in infants provides an integrative approach to investigate the developing nervous system. Accurate time-locking across modalities is essential to ensure that responses are interpreted correctly, and could also improve clinical care, for example, by facilitating automatic and objective multimodal pain assessment. Here we develop and assess a system to time-lock stimuli (including clinically-required heel lances and experimental visual, auditory and tactile stimuli) to electrophysiological research recordings and data recorded directly from a hospitalised infant’s vital signs monitor. The electronic device presented here (that we have called ‘the PiNe box’) integrates a previously developed system to time-lock stimuli to electrophysiological recordings and can simultaneously time-lock the stimuli to recordings from hospital vital signs monitors with an average precision of 105 ms (standard deviation: 19 ms), which is sufficient for the analysis of changes in vital signs. Our method permits reliable and precise synchronisation of data recordings from equipment with legacy ports such as TTL (transistor-transistor logic) and RS-232, and patient-connected networkable devices, is easy to implement, flexible and inexpensive. Unlike current all-in-one systems, it enables existing hospital equipment to be easily used and could be used for patients of any age. We demonstrate the utility of the system in infants using visual and noxious (clinically-required heel lance) stimuli as representative examples.

Introduction

Premature-born infants experience a plethora of sensory stimulation when exposed to the extrauterine environment. These may have negative consequences for the infant, including possible long-term neurodevelopmental effects [14]. In contrast, positive touch, such as breastfeeding or skin-to-skin contact, may be important for neurodevelopment [5] and may mitigate alterations in sensory processing related to noxious stimuli [6]. Visual, auditory, tactile and noxious stimuli can all elicit responses at many levels of the nervous system, including increases in heart rate, whole body reflexes, and evoked cortical responses [712]. Investigating how an infant responds to a stimulus, at all levels of the nervous system, is essential to understand nervous system development and long-term effects.

Vital signs, such as heart rate, respiratory rate and oxygen saturation, are monitored routinely in hospitalised infants. Time-locking recordings of routine hospital monitoring to experimental or clinical stimuli (such as noxious, visual, tactile, auditory), and linking to research-related recordings of electrophysiological activity such as electroencephalography (EEG) and electromyography (EMG), provides a valuable approach to investigate multimodal sensory responses. Current methods to integrate EEG devices, vital signs devices and stimulus triggers exist but require purchase of all-in-one systems that generally offer a limited number of physiological recording channels, which could reduce research potential. Furthermore, integrating specific stimuli with such systems usually requires additional pre-processing devices to be added upstream to correctly pre-condition the triggers. Ultimately, this results in a solution that is costly and still requires multiple devices to be integrated together. Instead, a more ideal solution would be to develop a device that allows seamless integration of a broad range of available electrophysiological recording equipment and hospital vital sign monitors, with stimulus triggers utilising common network communication protocols in a cost-effective, efficient and robust manner. Furthermore, this approach would not be limited to electrophysiological and vital signs equipment but could be adopted by a range of standard clinical equipment, leading to greater resource utilisation for research studies.

Here, we describe the development of a new device known as the PiNe (Raspberry Pi to Network) box, which integrates an existing event-detection interface, originally created to time-lock stimulus events to an electrophysiological research recording system [13]. The PiNe box additionally allows simultaneous time-locking of these events to recordings of data continuously downloaded from a hospital vital signs monitor. The PiNe box can connect equipment using legacy ports such as TTL (transistor-transistor logic) with modern network devices, communicating using established network protocols. It runs using a small low-cost and widely available (approximately $40) single-board computer (Raspberry Pi, Raspberry Pi Foundation). Moreover, it is flexible, with the ability to integrate different sensory stimulation equipment, research devices and clinical devices. We used three approaches to test the accuracy and clinical utility of the PiNe box. Firstly, we calculated the precision in time-locking of events on the vital signs recordings in a controlled laboratory setting. Secondly, we assessed the synchronisation of the recordings between the electrophysiological recording system and the vital signs monitor in a clinical setting. Finally, we demonstrated the utility of the system across multimodal recordings in infants.

Materials and methods

The PiNe box and event detection interface

Fig 1A shows a schematic of the overall system including the PiNe box. Overall, the system allows events (sensory stimuli or a push button device) to be simultaneously triggered and marked onto electrophysiological research recordings and recordings from a hospital vital signs monitor. An event detection interface for clinically-required heel lances and experimental tactile stimuli has been previously described [13] and can be used to generate these external triggers. Commercially available stimulators (such as auditory and visual stimulators) can also be easily integrated.

Fig 1. The PiNe box.

Fig 1

(A) Schematic of the full system. Grey shading illustrates the newly developed parts of the monitoring system including the PiNe box and its associated connections. Abbreviations: TTL: Transistor-transistor logic, GPIO: General-Purpose Input Output, UDP: User Datagram Protocol, IP: Internet protocol. (B) A photograph of the PiNe box. (C) The graphical user interface (GUI) on the PiNe box.

Our new device—the PiNe box—reads in TTL (transistor-transistor logic) triggers from the external triggering devices which are sent to its internal Raspberry Pi. These TTL triggers are simultaneously sent to the PiNe box and to the General-Purpose Input Output (GPIO) ports of the electrophysiological recording equipment (which allows simultaneous time-locking of stimulus onset to the electrophysiological activity, as described in previous publications [13]). The Raspberry Pi in the PiNe box converts the TTL signal to a UDP (User Datagram Protocol) message which is sent to an acquisition laptop that also continuously records the signals from the hospital vital signs monitor. The laptop is connected via an ethernet connection to the PiNe box and to the vital signs monitor, simultaneously receiving the vital signs data and UDP messages. A network switch is used to allow these multiple ethernet connections to the laptop. A network isolator is connected between the hospital vital signs monitor and the network switch to ensure a secure connection to the hospital monitor.

To record the vital signs data from the hospital monitor the separate acquisition laptop uses ixTrend software (ixitos GmbH, Germany), but alternative software to record vital signs is available [14]. The ixTrend software has inbuilt functionality to mark external network events onto data recordings and we use this feature here to allow the transmitted UDP messages (i.e., the stimulus triggers) to be time-locked to the vital signs data. UDP network messages were used as the ixTrend software requires this protocol, however, TCP (Transmission Control Protocol) could also be straightforwardly used and is implemented in the PiNe box as an alternative option. The PiNe box includes a touch screen (run by the Raspberry Pi) which presents a Graphical User Interface (GUI) allowing the user to select the appropriate IP address and listening ports to link to the monitoring laptop and to determine whether there is a successful connection (Fig 1B and 1C).

A unique user-defined message can be generated for different triggers from the stimulus equipment so that different stimulus types can have independent event markers. We developed our system to receive and send six independent markers (clinically-required heel lance, experimental visual, tactile, auditory, and noxious stimuli, and a push button device which can be used to simultaneously manually mark events on both devices e.g. background periods or other clinical procedures).

The system has been approved for use within our hospital by the local clinical engineering team.

Running the GUI, establishing connections, reading of the input stimulus triggers, generation of the UDP output messages and transmission to the monitoring laptop are all controlled by a bespoke module that is written fully in Python 3. The overall process of the code is summarised in the pseudo code given in S1 Fig.

Assessment of the PiNe box

Study design and participants

We assessed the use of the PiNe box in three studies. In Study 1 the precision of time-locking of events to the vital signs monitor was assessed in seven recordings of background noise (the monitor was not connected to an infant during these recordings). The push button was pressed onto one of the ECG electrodes to generate an artefact and a time-locked event mark. The time difference between the event mark and the artefact onset was used to calculate the precision in time-locking of events on the vital signs recordings.

In Study 2, the synchronisation of the event markers between the electrophysiological recordings and the recordings of the hospital vital signs monitor was investigated in recordings from 48 infants. Infant demographics are given in S1 Table.

In Study 3, recordings from two infants are presented as representative examples to demonstrate the utility of the system; visual-evoked responses are shown from an infant who was born at 32 weeks (+ 2 days) gestation with a birth weight of 1.66 kg and studied at 34 weeks (+ 4) postmenstrual age (PMA); noxious-evoked responses (recorded to a clinically-required heel lance) are shown from an infant who was born at 37 weeks’ (+ 0) gestation with a birth weight of 2.14 kg and studied when they were 3 days old.

All infants were recruited as part of other ongoing studies. The infants were recruited from the Newborn Care Unit and Maternity wards of the John Radcliffe Hospital (Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom). Ethical approval was obtained from the National Research Ethics Service (references: 19/LO/1085, 12/SC/0447, 21/LO/0523) and parental written informed consent was obtained before each participant was studied. The studies were conducted in accordance with the standards set by the Declaration of Helsinki and Good Clinical Practice guidelines.

Recording techniques

Electrophysiological research recordings were acquired from DC to 800 Hz using a SynAmps RT 64-channel headbox and amplifiers (Compumedics Neuroscan). Activity was recorded using CURRY scan7 neuroimaging suite (Compumedics Neuroscan) with a sampling rate of 2000 Hz. EEG was recorded from eight electrode sites (Cz, CPz, C3, C4, Oz, FCz, T3, T4) according to the modified international 10–20 system with reference at Fz and ground at Fpz. The scalp was cleaned with preparation gel (Nuprep gel, D.O. Weaver and Co.) and disposable Ag/AgCl cup electrodes (Ambu Neuroline) were placed with conductive paste (Elefix EEG paste, Nihon Kohden). Electrocardiograph (ECG) was recorded on this system using a single electrode placed on the infant’s chest, referenced to Fz and with the ground electrode at Fpz.

Infants’ vital signs were monitored using a Philips IntelliVue MX800 or MX750 clinical monitor, and data was continuously downloaded from the monitor to an external laptop using ixTrend software (ixitos GmbH, Germany). Heart rate, oxygen saturation and respiratory rate (calculated by the monitor) were downloaded onto the laptop at a sampling rate of 1 Hz; the ECG was downloaded onto the laptop at a sampling rate of 250 Hz and recorded with three electrodes placed on the infant’s chest, the impedance pneumograph was downloaded onto the laptop at a sampling rate of 62.5 Hz and recorded from the chest electrodes, and the photoplethysmography was downloaded onto the laptop at a sampling rate of 125 Hz from a probe placed on the infant’s foot. The sampling rates of the signals are set by the Philips monitor rather than the software on the laptop; the PiNe box does not rely on certain sampling rates and could be used with clinical monitors with different sampling rates. Alternative software is available to download data from Philips or other monitors [14].

To assess the precision of time-locking to the recordings of the vital signs (Study 1), recordings of the impedance pneumograph were taken using three ECG electrodes attached to each other using conductive paste (Elefix EEG paste, Nihon Kohden) applied to a table—the electrodes were not connected to an infant during these recordings. This set-up allowed the push button device to be pressed on to the electrodes generating both an event mark and an artefact on the recordings, the timings of which could be compared. As the vital signs monitor has built-in filters that cannot be turned off, the electrodes needed to be connected to each other via conductive paste so that background noise and the push button artefact could be recorded. To assess replicability of the precision, we pressed the push button onto the electrodes 5 times per recording in 7 separate recordings.

Stimuli

Visual, tactile and clinically-required heel lances were performed in Studies 2 and 3. Infants were recruited as part of other ongoing research studies and so the type of stimulus presented was dependent on the particular research question. In study 2, on 15 test occasions visual stimuli were performed, on 7 occasions touch stimuli were performed and on 35 occasions clinically-required heel lances were performed.

Visual stimulus. Trains of approximately 10 visual stimuli were presented with an inter-stimulus interval of at least 10 seconds. This interval was extended if the infant was unsettled. The stimulus was a flash of light presented using a Lifelines Photic Stimulator (intensity level 4, approximately 514 lumens), which was held approximately 30 cm directly in front of the infant’s eyes.

Tactile stimulus. Trains of approximately 10 tactile stimuli were presented with an inter-stimulus interval of at least 10 seconds. This interval was extended if the infant was unsettled. The infant’s foot was lightly tapped with a tendon hammer. The tendon hammer was modified to include a built-in force transducer (Brüel & Kjær) that sends a trigger pulse at the point of stimulation [13].

Clinically-required heel lance. Heel lances were only performed when required clinically to obtain a blood sample. Heel lances were performed on the medial or lateral plantar surface of the heel. Release of the lancet blade was time-locked to the recordings using the event detection interface previously described [13]. The single infant presented in Study 3 clinically-required a heel lance blood test to assess bilirubin levels (SBR). The lance was performed on the right foot (side chosen based on clinical judgement) using a Smiths Medical Neoheel Safety Lancet (Newborn, 1.0 mm Depth, model 1052N).

Analysis

Study 1: Precision of time-locking of events to vital signs monitor. Analysis was performed using MATLAB (R2021a, MathWorks). To assess the precision of time-locking of events to the vital signs monitor the push button was pressed onto one of the ECG electrodes simultaneously generating an event mark on the recording from the vital signs monitor and a visible artefact (S2 Fig). This process was repeated 5 times per recording, and in 7 recordings to assess replicability. As the push button was pressed on the ECG electrodes this generated an artefact on the ECG trace and the impedance pneumograph (which is a recording of changes in the resistance between ECG electrodes). The artefact was most visible on the impedance pneumograph and so this signal was used in the analysis (S2 and S3 Figs). Precision was calculated as the time difference between the event mark (generated using the PiNe box) and the start of the artefact. The signal was first epoched from 1 second before to 1 second after the event mark, and baseline corrected to the pre-event mark mean. The start of the artefact was calculated automatically as the point at which the signal went below a threshold defined as 3% of the minimum signal value in the 1 second after the event mark (S2 Fig). This threshold was chosen based on visual inspection of the data; in 2 files the start time was manually adjusted to better fit the data. Code for this analysis is provided as S1 Code and the associated data in S1 Data.

Study 2: Precision of time-synchronisation between devices. To assess the synchronisation of event markers across the two recording devices, the ECG signal was recorded on both devices and the cross-correlation calculated to identify the time differences between the signals. This was assessed in relation to event marks from visual, tactile and clinically-required noxious stimuli. The ECG signal from the Philips monitor (the clinical vital signs monitor) is filtered during acquisition using the settings built into the monitor itself (the filter was set to ‘monitor’ mode). To eliminate slow frequency drift due to movement artefacts and to make the filters comparable to those used for the ECG signal acquired using Curry 7 we additionally filtered the signal after acquisition from 12–40 Hz using EEGlab [15]. The ECG signal acquired using Curry 7 (Compumedics Neuroscan—the electrophysiological research recording device) was filtered after acquisition from 12–40 Hz using EEGlab, with a notch filter at 50 Hz, and down-sampled using the MATLAB resample function to a sampling rate of 250 Hz to match that of the signal from the Philips monitor. The ECG signal from both recordings were epoched 5 seconds before and after each stimulus event, according to the time of the event marked on the individual recordings. The alignment of the signals between the two devices (and consequently the alignment of the event time-locking) was calculated as the time corresponding to the maximum cross-correlation, and the values were visually checked for spurious results due to artefact and for good alignment between the shifted signals. For recording sessions where multiple stimuli were performed in a single recording session, the average time-difference between devices across all stimuli was calculated. A total of 51 test occasions were included in the analysis (recorded in 48 infants).

Study 3: Demonstration of system utility. To demonstrate the utility of the system in the simultaneous assessment of electrophysiological and vital signs responses we recorded EEG and vital signs responses to visual stimuli and a clinical-required heel lance, detailing the response in two separate infants. EEG signals were filtered from 0.5–30 Hz, with a notch filter at 50 Hz, using EEGlab [15]. The signal was epoched from 0.5 seconds before the stimulus until 1 second afterwards and baseline corrected to the pre-stimulus mean. In response to the heel lance, which was a single event, the EEG response is shown at the Cz electrode, and Woody filtered by ±100 ms to the previously described and validated template of noxious-evoked brain activity [16]. In response to the visual stimulus, the average response across 10 stimuli and following a single stimulus is shown at the Oz electrode, the electrode with the dominant response to the visual stimulus [17].

Heart rate and oxygen saturation responses were calculated using the values obtained directly from the vital signs monitors. A one-minute epoch (with 15 seconds before the stimulus) was taken for the single heel lance; for visual stimuli the data was epoched with 5 seconds before the stimulus to 10 seconds afterwards due to the inter-stimulus interval. To calculate the average response to the visual stimulus, values were first baseline corrected by subtracting the pre-stimulus mean.

Inter-breath intervals (IBIs) were calculated from the impedance pneumography (IP) using a previously described algorithm which is validated for use in infants and more sensitive than the monitor-derived respiratory rate [18]. The algorithm uses an adaptive amplitude threshold to identify the timing of individual breaths within the IP signal, as shown in Figs 2 and 3. Prior to breath detection the IP signal is filtered and cardiac interference removed using the ECG signal [18,19]; this filtered IP signal is shown in Figs 2 and 3. From the IBIs, the respiratory rate was calculated in 20 second windows with increments of 1 second. In each window the respiratory rate was calculated as 60 divided by the mean IBI. To account for prolonged pauses in breathing overlapping the edge of the window (and leading to spurious results), if the first or last breath were greater than 1.5 seconds (equivalent to 40 breaths per minute) from the edge of the window then an additional IBI equal to the duration of the breath from the edge of the window was included in the IBI sequence for that window.

Fig 2. Time-locked physiological responses to a visual stimulus in a single infant.

Fig 2

Electrophysiological and vital signs responses to a single visual flash stimulus (A) and averaged across a train of 10 visual stimuli (B). Change in vital signs are calculated by baseline correcting to the pre-stimulus mean. Blue signals are from the electrophysiological research recordings, green signals from the hospital vital signs monitor. Black dashed line indicates the point of stimulation. Red dashed lines on the IP indicate the time at which the amplitude threshold used for breath detection was crossed (see Methods—Analysis: Study 3 Demonstration of system utility). EEG responses are shown at the Oz recording electrode. Abbreviations: Stim.: Stimulus/stimuli, ECG: Electrocardiograph, HR: Heart rate in beats per minute, PPG: Photoplethysmography, a.u.: Arbitrary units, IP: Impedance pneumography, RR: Respiratory rate in breaths per minute, EEG: Electroencephalograph.

Fig 3. Time-locked physiological responses to a clinically-required heel lance in a single infant.

Fig 3

Electrophysiological and vital signs responses to a single heel lance. Black dashed line indicates the point of stimulation. The EEG response is shown at the Cz recording electrode. The previously described template of noxious-evoked brain activity [16] is projected on to the EEG response and shown in red. Before the template is projected, the data is first Woody filtered (with a maximum of +/-100ms) to account for latency differences in the response. The raw trace (not Woody filtered) and Woody filtered traces are shown. Red dashed lines on the IP indicate the time at which the amplitude threshold used for breath detection was crossed (see Methods—Analysis: Study 3 Demonstration of system utility). Blue signals are from the electrophysiological research recordings, green signals from the hospital vital signs monitor. Abbreviations: ECG: Electrocardiograph, HR: Heart rate in beats per minute, PPG: Photoplethysmography, a.u.: Arbitrary units, IP: Impedance pneumography, RR: Respiratory rate in breaths per minute, EEG: Electroencephalograph.

Results

Study 1: Precision of time-locking of events to vital signs monitor

Events were time-locked to the recordings from the hospital vital signs monitor with a precision of 105 ms (range: 40–136, standard deviation: 19, N = 35 events, S2 Fig). The mean across the seven recording sessions ranged from 82 to 123 ms (N = 5 events per recording).

Study 2: Precision of time-synchronisation between devices

The average (median) absolute time difference between event markers on the two recording devices was 115 ms (N = 51 recording sessions, interquartile range: 56 ms, range: 0–2993 ms—one recordings session was an extreme outlier, excluding this session the range of time differences was 0–334 ms). This is consistent with the results from Study 1; precision of time-locking to the electrophysiological recording equipment has previously been shown to be less than 1 ms [13]. As expected, due to differences in sampling rate and filtering between the devices, where multiple stimuli were recorded in a single session the time difference within the session between devices was low (average difference within a recording: 20 ms, range 0–68 ms, N = 15).

Study 3: Demonstration of system utility

Simultaneous electrophysiological and vital signs recordings are presented in response to a visual stimulus in one infant (Fig 2) and a clinically-required heel lance in a separate infant (Fig 3), demonstrating the utility of the system in recording multimodal responses to a single stimulus and for the characterisation of average evoked responses.

Discussion

Here we describe the development of a new device known as ‘the PiNe box’ and integrate it into a system to time-lock stimuli across multiple recording devices in infants, including the continuous data downloaded from the infant’s hospital vital signs monitor. This enables multimodal recordings, including electrophysiological and physiological activity, of responses to experimental and clinically-required stimuli in hospitalised infants at the cotside. By linking with the infant’s hospital monitor, no additional probes or electrodes are necessary, thus reducing the time an infant is handled. This is particularly important in the youngest and sickest infants. Moreover, hospital staff are already familiar with existing equipment, thereby enabling easier integration of research into the clinical setting. We demonstrated the utility of the system by recording responses to visual stimuli and a clinically-required heel lance. However, the PiNe box can be used with a range of other stimuli including auditory and tactile stimuli [13], and to record other clinically-required procedures such as cannulation and immunisation [2022]. To date we have successfully used the system in more than 50 research studies, including investigating the responses to experimental sensory stimuli and clinically-required heel lances. The PiNe box is not limited for use in infants but could be used in patients of any age, and is not restricted to the recording devices used here but could be used to link other network devices with recording equipment with TTL or similar communication ports (e.g. RS-232, USB) or extended to include data synchronisation from wireless devices.

We demonstrated excellent precision of time-locking of the stimuli to the recordings of the hospital vital signs monitor and synchronisation between recording devices. The event detection interface used here has been previously shown to have an accuracy of less than 1 ms to time-lock events to EEG recordings [13]. A precision of approximately 100 ms to time-lock stimuli to recordings of the hospital vital signs monitor provides sufficient accuracy for the analysis of changes in vital signs, which occur over a longer time scale than evoked EEG activity.

Multimodal recordings are essential to improve our understanding of the development of the nervous system in premature infants and could enhance clinical care, for example, through improving the assessment and treatment of pain [2325]. Moreover, multimodal recordings of responses to noxious stimuli are essential to adequately assess the efficacy and safety of analgesics in randomised controlled trials [24] and easy-to-use acquisition methods which can work seamlessly alongside hospital monitoring devices will facilitate this [26]. The PiNe box is currently being used in the Petal randomised controlled trial assessing the benefits of parental touch for relieving pain in newborn infants [27], which provides a direct example of how this system can be used to easily acquire multimodal recordings in a clinical trial. In response to a clinically-required heel lance, the single infant shown in this paper has a clear physiological and neurophysiological response, including an increase in heart rate and an evoked potential in the EEG recording characterised well by the previously described and validated template of noxious-evoked brain activity [16]. The infant also has a short pause in breathing following the heel lance; short pauses in breathing occurred sporadically throughout the recording in this infant and investigation of whether this change in breathing is more likely to occur following a heel lance or occurred by chance here is beyond the scope of this paper. Infants can be more physiologically unstable following painful procedures [18,28], however, relatively little investigation of breathing patterns immediately after heel lances have been undertaken, perhaps in part due to inherent problems with hospital monitor-derived measures of respiratory rate in infants [18,19,29]. Whether changes in breathing patterns occur following sensory stimuli in infants warrants further investigation and could be achieved by combining the acquisition methods presented here with new analysis methods validated for use in infants [18,19].

Conclusions

In summary, we describe an inexpensive and easily adaptable approach to time-lock stimuli across multiple recording devices by developing a new device based on a Raspberry Pi that links network equipment, in particular a patient’s vital signs monitor, with other network devices or those with ports such as TTL. This approach is relatively straightforward to implement and is cost effective. It is not limited to the stimuli presented here but could be used to time-lock a variety of both experimental and clinically-required stimuli. Characterising infant responses to stimuli at all levels of the nervous system is important to better understand development and improve clinical care.

Supporting information

S1 Fig. PiNe box pseudo code.

Running the Graphical User Interface, establishing connections, reading of the input stimulus triggers, generation of the UDP (User Datagram Protocol) output messages and transmission to the monitoring laptop, and switching on an LED on the PiNe box following stimulus triggers are all controlled by a bespoke module that is written fully in Python 3. The overall process of the code is summarised in this pseudo code.

(PNG)

S2 Fig. Precision of time-locking of events to vital signs monitor.

To assess the precision of time-locking of events to the vital signs monitor (Study 2) the push button was pressed onto one of the ECG electrodes during recordings of background noise, generating a visible artefact on the IP (impedance pneumography) signal. The recording during 35 button presses is shown here, with each row a single recording session. The blue lines are the IP signal, time = 0 (black dashed lines) is the time of the event mark annotation from the push button (marked on the recordings via the PiNe box), red dot indicates the start of the artefact generated by the push button calculated as the point at which the signal went below a threshold defined as 3% of the minimum signal value in the 1 second after the event mark.

(PNG)

S3 Fig. Precision of time-locking of events to vital signs monitor—ECG traces.

To assess the precision of time-locking of events to the vital signs monitor (Study 2) the push button was pressed onto one of the ECG electrodes during recordings of background noise. Whilst this always generated a visible artefact on the IP (impedance pneumography) signal (S2 Fig), there was only a large visible artefact on the ECG trace on some occasions. This difference is due to the inbuilt filtering of the Philips monitor which is different for the different signals. The recording during 35 button presses is shown here, with each row a single recording session. The blue lines are the ECG signal, time = 0 is the time of the event mark annotation from the push button (marked on the recordings via the PiNe box).

(PNG)

S1 Table. Infant demographics for Study 2.

Values are median (lower quartile, upper quartile) or number (%). PMA = postmenstrual age. Apgar scores were missing from 2 infants.

(DOCX)

S1 Data. Data file for Study 1.

Data files for Study 1, which consisted of 7 recordings where the push button device was manually pressed onto the ECG electrodes to investigate the time difference between the event annotation and recording artefact. Code to analyse this data is provided in S1 Code.

(ZIP)

S1 Code. Code for analysis of Study 1.

MATLAB code for analysis of Study 1. The associated data are provided in S1 Data.

(M)

Acknowledgments

We would like to thank Daniel Crankshaw, Annalisa Hauck, Fiona Moultrie, Shellie Robinson and Fatima Usman for help with data collection.

Data Availability

Data for Study 1 is provided as S1 Data file. Due to ethical constraints and the sensitive nature of medical data collection, data for Study 2 and 3 are available from the corresponding author on request. Requests can be made directly to caroline.hartley@paediatrics.ox.ac.uk or directed to the Paediatric Neuroimaging Group, University of Oxford through the institutional email neonatal.research@ouh.nhs.uk.

Funding Statement

This work was funded by the Wellcome Trust and Royal Society through a Sir Henry Dale Fellowship awarded to CH (Grant reference: 213486/Z/18/Z). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Almadhoob A, Ohlsson A. Sound reduction management in the neonatal intensive care unit for preterm or very low birth weight infants. Cochrane Database Syst Rev. 2020;1(1):CD010333. doi: 10.1002/14651858.CD010333.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Abou Turk C, Williams AL, Lasky RE. A randomized clinical trial evaluating silicone earplugs for very low birth weight newborns in intensive care. J Perinatol. 2009;29(5):358–63. doi: 10.1038/jp.2008.236 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Grunau R. Neonatal Pain in Very Preterm Infants: Long-Term Effects on Brain, Neurodevelopment and Pain Reactivity. Rambam Maimonides Med J. 2013;4(4):e0025. doi: 10.5041/RMMJ.10132 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Vinall J, Miller SP, Bjornson BH, Fitzpatrick KP V., Poskitt KJ, Brant R, et al. Invasive Procedures in Preterm Children: Brain and Cognitive Development at School Age. Pediatrics. 2014;133(3):412–21. doi: 10.1542/peds.2013-1863 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Als H, Duffy FH, McAnulty G, Butler SC, Lightbody L, Kosta S, et al. NIDCAP improves brain function and structure in preterm infants with severe intrauterine growth restriction. J Perinatol. 2012;32(10):797–803. doi: 10.1038/jp.2011.201 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Maitre NL, Key AP, Chorna OD, Slaughter JC, Matusz PJ, Wallace MT, et al. The Dual Nature of Early-Life Experience on Somatosensory Processing in the Human Infant Brain. Curr Biol. 2017;27(7):1048–54. doi: 10.1016/j.cub.2017.02.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Morris BH, Philbin MK, Bose C. Physiological Effects of Sound on the Newborn. J Perinatol. 2000;20:S55–60. doi: 10.1038/sj.jp.7200451 [DOI] [PubMed] [Google Scholar]
  • 8.Wachman EM, Lahav A. The effects of noise on preterm infants in the NICU. Arch Dis Child Fetal Neonatal Ed. 2011;96:F305–9. doi: 10.1136/adc.2009.182014 [DOI] [PubMed] [Google Scholar]
  • 9.Cornelissen L, Fabrizi L, Patten D, Worley A, Meek J, Boyd S, et al. Postnatal Temporal, Spatial and Modality Tuning of Nociceptive Cutaneous Flexion Reflexes in Human Infants. PLoS One. 2013;8(10):e76470. doi: 10.1371/journal.pone.0076470 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Fabrizi L, Slater R, Worley A, Meek J, Boyd S, Olhede S, et al. A Shift in Sensory Processing that Enables the Developing Human Brain to Discriminate Touch from Pain. Curr Biol. 2011;21(18):1552–8. doi: 10.1016/j.cub.2011.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Chipaux M, Colonnese MT, Mauguen A, Fellous L, Mokhtari M, Lezcano O, et al. Auditory stimuli mimicking ambient sounds drive temporal “delta-brushes” in premature infants. PLoS One. 2013;8:e79028. doi: 10.1371/journal.pone.0079028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Colonnese MT, Kaminska A, Minlebaev M, Milh M, Bloem B, Lescure S, et al. A Conserved Switch in Sensory Processing Prepares Developing Neocortex for Vision. Neuron. 2010;67(3):480–98. doi: 10.1016/j.neuron.2010.07.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Worley A, Fabrizi L, Boyd S, Slater R. Multi-modal pain measurements in infants. J Neurosci Methods. 2012;205(2):252–7. doi: 10.1016/j.jneumeth.2012.01.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lee HC, Jung CW. Vital Recorder- A free research tool for automatic recording of high-resolution time-synchronised physiological data from multiple anaesthesia devices. Sci Rep. 2018;8(1):1527. doi: 10.1038/s41598-018-20062-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Delorme A, Makeig S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134:9–21. doi: 10.1016/j.jneumeth.2003.10.009 [DOI] [PubMed] [Google Scholar]
  • 16.Hartley C, Duff EP, Green G, Mellado GS, Worley A, Rogers R, et al. Nociceptive brain activity as a measure of analgesic efficacy in infants. Sci Transl Med. 2017;9(388):eaah6122. doi: 10.1126/scitranslmed.aah6122 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Schmidt Mellado G, Pillay K, Adams E, Alarcon A, Andritsou F, Cobo MM, et al. The impact of premature extrauterine exposure on infants’ stimulus-evoked brain activity across multiple sensory systems. NeuroImage Clin. 2022;33:102914. doi: 10.1016/j.nicl.2021.102914 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Adjei T, Purdy R, Jorge J, Adams E, Buckle M, Fry RE, et al. New method to measure interbreath intervals in infants for the assessment of apnoea and respiration. BMJ Open Respir Res. 2021;8(1):e001042. doi: 10.1136/bmjresp-2021-001042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Lee H, Rusin CG, Lake DE, Clark MT, Guin L, Smoot TJ, et al. A new algorithm for detecting central apnea in neonates. Physiol Meas. 2012. Jan 1;33(1):1–17. doi: 10.1088/0967-3334/33/1/1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Verriotis M, Fabrizi L, Lee A, Ledwidge S, Meek J, Fitzgerald M. Cortical activity evoked by inoculation needle prick in infants up to one-year old. Pain. 2015;156(2):222–30. doi: 10.1097/01.j.pain.0000460302.56325.0c [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Hartley C, Poorun R, Goksan S, Worley A, Boyd S, Rogers R, et al. Noxious stimulation in children receiving general anaesthesia evokes an increase in delta frequency brain activity. Pain. 2014;155(11). doi: 10.1016/j.pain.2014.09.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Cobo MM, Hartley C, Gursul D, Andritsou F, van der Vaart M, Mellado GS, et al. Quantifying noxious-evoked baseline sensitivity in neonates to optimise analgesic trials. Elife. 2021;10:e65266. doi: 10.7554/eLife.65266 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.van der Vaart M, Duff E, Raafat N, Rogers R, Hartley C, Slater R. Multimodal pain assessment improves discrimination between noxious and non-noxious stimuli in infants. Paediatr Neonatal Pain. 2019;1(1):21–30. doi: 10.1002/pne2.12007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Moultrie F, Slater R, Hartley C. Improving the treatment of infant pain. Curr Opin Support Palliat Care. 2017;11(2). doi: 10.1097/SPC.0000000000000270 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.van der Vaart M, Hartley C, Baxter L, Schmidt Mellado G, Cobo MM, Evans Fry R, et al. Premature infants display discriminable behavioural, physiological and brain responses to noxious and non-noxious stimuli. Cereb Cortex. 2022;32(17):3799–3815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Baxter L, Poorun R, Rogers R, van der Vaart M, Worley A, Hartley C. Using changes in brain activity to assess pain-relief in infants: Methodological considerations with Benoit et al. (2021). Early Hum Dev. 2021;157:105361. doi: 10.1016/j.earlhumdev.2021.105361 [DOI] [PubMed] [Google Scholar]
  • 27.Cobo MM, Moultrie F, Hauck AG V, Crankshaw D, Monk V, Hartley C, et al. Multicentre, randomised controlled trial to investigate the effects of parental touch on relieving acute procedural pain in neonates (Petal). BMJ Open. 2022;12(7):e061841. doi: 10.1136/bmjopen-2022-061841 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Mitchell AJ, Green A, Jeffs DA, Roberson PK. Physiologic effects of retinopathy of prematurity screening examinations. Adv Neonatal Care. 2011;11:291–7. doi: 10.1097/ANC.0b013e318225a332 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Vergales BD, Paget-Brown AO, Lee H, Guin LE, Smoot TJ, Rusin CG, et al. Accurate automated apnea analysis in preterm infants. Am J Perinatol. 2014. Feb;31(2):157–62. doi: 10.1055/s-0033-1343769 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Talib Al-Ameri

17 Apr 2023

PONE-D-23-03921The PiNe box: Development and validation of an electronic device to time-lock multimodal responses to sensory stimuli in hospitalised infantsPLOS ONE

Dear Dr. Hartley,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 01 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Talib Al-Ameri, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, all author-generated code must be made available without restrictions upon publication of the work.

Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

"This work was funded by the Wellcome Trust and Royal Society through a Sir Henry Dale Fellowship (Grant reference: 213486/Z/18/Z).." 

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

"This work was funded by the Wellcome Trust and Royal Society through a Sir Henry Dale Fellowship awarded to CH (Grant reference: 213486/Z/18/Z). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. We note that you have a patent relating to material pertinent to this article:

"KP, MMC, AB and CH are inventors/contributors to Patent Application Number: PCT/GB2022/052836: SYSTEMS AND METHODS FOR MEASURING A RESPONSE OF A SUBJECT TO AN EVENT. The authors declare no other competing interests."

Please provide an amended statement of Competing Interests to declare this patent (with details including name and number), along with any other relevant declarations relating to employment, consultancy, patents, products in development or modified products etc. 

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials."

If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

This information should be included in your cover letter; we will change the online submission form on your behalf.

6. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

8. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a well written article that describes the validation of a new system to synchronise electrophysiological recordings with clinical vital signs monitors and event-mark both recordings simultaneously. This is a great system which would much improve research, and more importantly, reduce the time and handling required to set-up a study involving vulnerable neonates.

Major points:

Lines 183-189: Please clarify if the raw traces of the ECG, respiration and saturation also exported to the laptop, or just the pre-calculated rates. It isn't clear if these sampling rates pertain to the information received by the Philips monitor or the laptop, as it only explicitly states that the pre-calculated rates were downloaded.

If not, this is a limitation of the system, researchers may be interested in exploring heart rate in more depth, like HRV or presence of arrhythmias., and respiration traces are an important component of accurate sleep staging due to potential irregularities like apnoeas.

Lines 237-238: ‘The artefact was most visible on the impedance pneumograph and so this signal was used in the analysis.’

There is no mention of the pneumograph before this point. Not sure why there is an artefact on the pneumograph based on the description of the procedure. This must be described in the methods.

Lines 265-267: It is important to include more detail regarding the technical difficulties to clarify that the issue is not likely to occur again. Otherwise it is misleading to exclude an extreme value from this analysis. Also, without knowing what the difficultly was, this could be an issue that others may face, which is important information for a product that would be sold.

Minor points:

Abstract: the use of the term ‘noxious’ in ‘experimental visual, auditory, tactile and noxious stimuli’. I believe that the authors are referring to the 128mN pinprick stimulator but I think we should be careful calling this noxious and instead refer to this as a mechanical punctate stimulus. It is done experimentally so is perhaps not ethical to assume it is noxious. The conclusion that this stimulus is a less intense noxious stimulus compared to a skin breaking procedure, is built upon the use of template analysis using woody-filtering techniques that may force similarities between two different cortical responses, indeed there is no behavioural distress following the pinprick and the afferent fibre activation following the two stimuli will certainly be different. Moreover, the template assumes that this one event at a single electrode reflects the complexity of pain.

Lines 50-51: ‘a complete picture’, ‘better understand’. This is vague statement, think about expanding.

Lines 101-103: ‘the General-Purpose Input Output (GPIO) ports of the electrophysiological recording equipment (which allows simultaneous time-locking of stimulus onset to the electrophysiological activity).’

To help with clarity, it would be useful to add here that this is the connection which already exist.

Lines 191-199: You should state here how often you repeated the process. You provide this information for the other stimuli but only mention the number of repetitions for this study in the analysis.

Lines 251-256: As there is no mention of the acquisition filters applied by the Philips monitor, it is not clear if adding the extra 50Hz notch filter is sufficient to match the filters applied to both datasets.

Lines 277-278: This is very minor, but it would be nice to see the raw activity rather than the altered version, especially since the analysis of the brain activity is not relevant to the point being made by study 3.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Jul 13;18(7):e0288488. doi: 10.1371/journal.pone.0288488.r002

Author response to Decision Letter 0


9 Jun 2023

Reviewer #1: This is a well written article that describes the validation of a new system to synchronise electrophysiological recordings with clinical vital signs monitors and event-mark both recordings simultaneously. This is a great system which would much improve research, and more importantly, reduce the time and handling required to set-up a study involving vulnerable neonates.

Thank you for your review. We have addressed them in the manuscript as outlined below, which has allowed us to substantially improve the paper.

Major points:

Lines 183-189: Please clarify if the raw traces of the ECG, respiration and saturation also exported to the laptop, or just the pre-calculated rates. It isn't clear if these sampling rates pertain to the information received by the Philips monitor or the laptop, as it only explicitly states that the pre-calculated rates were downloaded.

If not, this is a limitation of the system, researchers may be interested in exploring heart rate in more depth, like HRV or presence of arrhythmias., and respiration traces are an important component of accurate sleep staging due to potential irregularities like apnoeas.

Thank you for highlighting this important point. All raw traces were also downloaded. We have clarified this in the text which now states (lines 187-196):

Heart rate, oxygen saturation and respiratory rate (calculated by the monitor) were downloaded onto the laptop at a sampling rate of 1 Hz; the ECG was downloaded onto the laptop at a sampling rate of 250 Hz and recorded with three electrodes placed on the infant’s chest, the impedance pneumograph was downloaded onto the laptop at a sampling rate of 62.5 Hz and recorded from the chest electrodes, and the photoplethysmography was downloaded onto the laptop at a sampling rate of 125 Hz from a probe placed on the infant’s foot. The sampling rates of the signals are set by the Philips monitor rather than the software on the laptop; the PiNe box does not rely on certain sampling rates and could be used with clinical monitors with different sampling rates. Alternative software is available to download data from Philips or other monitors (14).

Lines 237-238: ‘The artefact was most visible on the impedance pneumograph and so this signal was used in the analysis.’

There is no mention of the pneumograph before this point. Not sure why there is an artefact on the pneumograph based on the description of the procedure. This must be described in the methods.

The impedance pneumograph signal is measured by the Philips monitor using the same electrodes for the ECG trace. When we pressed the push button onto the ECG electrode this generated an artefact on the ECG signal and the impedance pneumograph. The artefact was larger on the IP signal. We have clarified this in the text on lines 248-251 by stating:

As the push button was pressed on the ECG electrodes this generated an artefact on the ECG trace and the impedance pneumograph (which is a recording of changes in the resistance between ECG electrodes). The artefact was most visible on the impedance pneumograph and so this signal was used in the analysis (S2,3 Figs).

We have also added Supplementary Figure 3 which shows the ECG traces.

Lines 265-267: It is important to include more detail regarding the technical difficulties to clarify that the issue is not likely to occur again. Otherwise it is misleading to exclude an extreme value from this analysis. Also, without knowing what the difficultly was, this could be an issue that others may face, which is important information for a product that would be sold.

Thank you for your important point. We have now included this value in the analysis and revised the results accordingly (lines 331-334):

The average (median) absolute time difference between event markers on the two recording devices was 115 ms (N=51 recording sessions, interquartile range: 56 ms, range: 0 – 2993 ms – one recordings session was an extreme outlier, excluding this session the range of time differences was 0-334 ms).

Minor points:

Abstract: the use of the term ‘noxious’ in ‘experimental visual, auditory, tactile and noxious stimuli’. I believe that the authors are referring to the 128mN pinprick stimulator but I think we should be careful calling this noxious and instead refer to this as a mechanical punctate stimulus. It is done experimentally so is perhaps not ethical to assume it is noxious. The conclusion that this stimulus is a less intense noxious stimulus compared to a skin breaking procedure, is built upon the use of template analysis using woody-filtering techniques that may force similarities between two different cortical responses, indeed there is no behavioural distress following the pinprick and the afferent fibre activation following the two stimuli will certainly be different. Moreover, the template assumes that this one event at a single electrode reflects the complexity of pain.

You are correct that we were referring to the pinprick stimulator here. This stimulator is produced by MRC systems (Germany), and we refer to it as a noxious stimulator as the company produced the stimulator to activate nociceptors. However, to avoid confusion, as this stimulator is not used and not relevant for the current paper, we have removed reference to experimental noxious stimuli in the abstract.

Lines 50-51: ‘a complete picture’, ‘better understand’. This is vague statement, think about expanding.

This sentence has been revised to read (lines 50-51):

Investigating how an infant responds to a stimulus, at all levels of the nervous system, is essential to understand nervous system development and long-term effects.

Lines 101-103: ‘the General-Purpose Input Output (GPIO) ports of the electrophysiological recording equipment (which allows simultaneous time-locking of stimulus onset to the electrophysiological activity).’

To help with clarity, it would be useful to add here that this is the connection which already exist.

This has been added (line 110).

Lines 191-199: You should state here how often you repeated the process. You provide this information for the other stimuli but only mention the number of repetitions for this study in the analysis.

Thank you, we have now added this to this part of the methods as well (lines 208-209).

Lines 251-256: As there is no mention of the acquisition filters applied by the Philips monitor, it is not clear if adding the extra 50Hz notch filter is sufficient to match the filters applied to both datasets.

Philips do not describe the filters they apply during the acquisition. They have different modes and we used the default mode which is described as ‘monitor’ mode by Philips. We have added this to the manuscript, and clarified that we applied the 12-40 Hz filter after acquisition in line with the filter we also apply to the signal acquired through the Curry system. We have edited lines 264-269 to read:

The ECG signal from the Philips monitor (the clinical vital signs monitor) is filtered during acquisition using the settings built into the monitor itself (the filter was set to ‘monitor’ mode). To eliminate slow frequency drift due to movement artefacts and to make the filters comparable to those used for the ECG signal acquired using Curry 7 we additionally filtered the signal after acquisition from 12-40 Hz using EEGlab (15). The ECG signal acquired using Curry 7 (Compumedics Neuroscan - the electrophysiological research recording device) was filtered after acquisition from 12-40 Hz using EEGlab…

Lines 277-278: This is very minor, but it would be nice to see the raw activity rather than the altered version, especially since the analysis of the brain activity is not relevant to the point being made by study 3.

This has been added to Figure 3 – shown below.

Attachment

Submitted filename: Worley_etal_rebuttal.docx

Decision Letter 1

Talib Al-Ameri

29 Jun 2023

The PiNe box: Development and validation of an electronic device to time-lock multimodal responses to sensory stimuli in hospitalised infants

PONE-D-23-03921R1

Dear Dr. Hartley,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Talib Al-Ameri, Ph.D

Academic Editor

PLOS ONE

Acceptance letter

Talib Al-Ameri

6 Jul 2023

PONE-D-23-03921R1

The PiNe box: Development and validation of an electronic device to time-lock multimodal responses to sensory stimuli in hospitalised infants

Dear Dr. Hartley:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Talib Al-Ameri

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. PiNe box pseudo code.

    Running the Graphical User Interface, establishing connections, reading of the input stimulus triggers, generation of the UDP (User Datagram Protocol) output messages and transmission to the monitoring laptop, and switching on an LED on the PiNe box following stimulus triggers are all controlled by a bespoke module that is written fully in Python 3. The overall process of the code is summarised in this pseudo code.

    (PNG)

    S2 Fig. Precision of time-locking of events to vital signs monitor.

    To assess the precision of time-locking of events to the vital signs monitor (Study 2) the push button was pressed onto one of the ECG electrodes during recordings of background noise, generating a visible artefact on the IP (impedance pneumography) signal. The recording during 35 button presses is shown here, with each row a single recording session. The blue lines are the IP signal, time = 0 (black dashed lines) is the time of the event mark annotation from the push button (marked on the recordings via the PiNe box), red dot indicates the start of the artefact generated by the push button calculated as the point at which the signal went below a threshold defined as 3% of the minimum signal value in the 1 second after the event mark.

    (PNG)

    S3 Fig. Precision of time-locking of events to vital signs monitor—ECG traces.

    To assess the precision of time-locking of events to the vital signs monitor (Study 2) the push button was pressed onto one of the ECG electrodes during recordings of background noise. Whilst this always generated a visible artefact on the IP (impedance pneumography) signal (S2 Fig), there was only a large visible artefact on the ECG trace on some occasions. This difference is due to the inbuilt filtering of the Philips monitor which is different for the different signals. The recording during 35 button presses is shown here, with each row a single recording session. The blue lines are the ECG signal, time = 0 is the time of the event mark annotation from the push button (marked on the recordings via the PiNe box).

    (PNG)

    S1 Table. Infant demographics for Study 2.

    Values are median (lower quartile, upper quartile) or number (%). PMA = postmenstrual age. Apgar scores were missing from 2 infants.

    (DOCX)

    S1 Data. Data file for Study 1.

    Data files for Study 1, which consisted of 7 recordings where the push button device was manually pressed onto the ECG electrodes to investigate the time difference between the event annotation and recording artefact. Code to analyse this data is provided in S1 Code.

    (ZIP)

    S1 Code. Code for analysis of Study 1.

    MATLAB code for analysis of Study 1. The associated data are provided in S1 Data.

    (M)

    Attachment

    Submitted filename: Worley_etal_rebuttal.docx

    Data Availability Statement

    Data for Study 1 is provided as S1 Data file. Due to ethical constraints and the sensitive nature of medical data collection, data for Study 2 and 3 are available from the corresponding author on request. Requests can be made directly to caroline.hartley@paediatrics.ox.ac.uk or directed to the Paediatric Neuroimaging Group, University of Oxford through the institutional email neonatal.research@ouh.nhs.uk.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES