Abstract
Driving a motor vehicle is an inherently complex task that requires robust control to avoid catastrophic accidents. Drivers must maintain their vehicle in the middle of the travel lane to avoid high speed collisions with other traffic. Interestingly, while a vehicle’s lane deviation (LD) is critical, studies have demonstrated that heading error (HE) is one of the primary variables drivers use to determine a steering response, which directly controls the position of the vehicle in the lane. In this study, we examined how the brain represents the dichotomy between control/response parameters (heading, reaction time (RT), and steering wheel corrections) and task-critical parameters (LD). Specifically, we examined electroencephalography (EEG) alpha band power (8–13 Hz) from estimated sources in right and left parietal regions, and related this activity to four metrics of driving performance. Our results demonstrate differential task involvement between the two hemispheres: right parietal activity was most closely related to LD, whereas left parietal activity was most closely related to HE, RT and steering responses. Furthermore, HE, RT and steering wheel corrections increased over the duration of the experiment while LD did not. Collectively, our results suggest that the brain uses differential monitoring and control strategies in the right and left parietal regions to control a motor vehicle. Our results suggest that the regulation of this control changes over time while maintaining critical task performance. These results are interpreted in two complementary theoretical frameworks: the uncontrolled manifold and compensatory control theories. The central tenet of these frameworks permits performance variability in parameters (i.e., HE, RT and steering) so far as it does not interfere with critical task execution (i.e., LD). Our results extend the existing research by demonstrating potential neural substrates for this phenomenon which may serve as potential targets for brain-computer interfaces that predict poor driving performance.
Keywords: driving, attention, heading error, parietal lobe, alpha rhythm, lane deviation, steering wheel
Introduction
Everyday visual-motor tasks involve complex interactions of multiple sensory signals that are converted into descending motor commands and translated to movement. This concept has been formalized from a number of frameworks including sensorimotor transformations (Pouget and Snyder, 2000) and motor (feedback) control theory (reviewed in Shadmehr et al., 2010). Within feedback theory, one of the major control challenges that has emerged arises from the large degrees of freedom and redundancies for a given visual-motor movement. For example, a reaching movement that places the hand at a particular location can be achieved with variable orientations of the shoulder, elbow and wrist joints. To address this issue, a theoretical framework emerged in which these degrees of freedom are allowed to freely vary so long as they do not interfere with the primary objective of acquiring the desired end state of the movement (reviewed in Todorov and Jordan, 2002; Scott, 2004). Here, we examine how these control parameters may be monitored by the brain to ensure successful task execution.
To contend with superfluous redundancies for a visual-motor movement, the brain must monitor perceptual input and sensory feedback to efficiently execute visual-motor tasks, and previous research posits that attention may give priority to behaviorally relevant actions (Wulf et al., 2001). Using electroencephalography (EEG), a relationship between alpha band power and attentional state has been identified in the seconds preceding a stimulus (reviewed in Hanslmayr et al., 2011). Studies have suggested that this prestimulus alpha activity is correlated with gain and processing of the visual stream, and prestimulus alpha may be subject to top-down visuospatial attention mechanisms (Engel et al., 2001; van Dijk et al., 2008; Gould et al., 2011; Sonnleitner et al., 2012; Gilbert and Li, 2013). Further investigations have suggested that increased alpha power is associated with the inhibition of distracting sensory information (i.e., functional inhibition; Jokisch and Jensen, 2007) and gating of sensory input (Jones et al., 2010; Klimesch et al., 2011; Sonnleitner et al., 2012). Consequently, fluctuations in alpha may reflect changes in visuospatial attention that are related to tracking the relevant sensory parameters needed to successfully execute a visual-motor task.
In this experiment, we examine the interactions between visuospatial attention and visual-motor movements during a highly learned naturalistic task, driving a motor vehicle. Behavioral studies have suggested that a vehicle’s heading error (HE) is one of the primary parameters used by humans to control the steering wheel (Hildreth et al., 2000; Wallis et al., 2002; Cloete and Wallis, 2009). Complementary research has modeled the steering of a vehicle as a feedback control system and demonstrated the importance of visual information for this control (Donges, 1978; Hess and Modjtahedzadeh, 1990; Salvucci and Gray, 2004). While there is behavioral evidence to support the relevance of HE, several EEG studies have identified the importance of additional driving performance metrics, including lane deviation (LD), lane crossing incidence, and reaction time (RT). These neuroimaging analyses have demonstrated that increasing levels of alpha (8–13 Hz) power are associated with decrements in driving performance (Horne and Baulk, 2004; Lin et al., 2005, 2010; Huang et al., 2009; reviewed in Lin et al., 2012). In addition to these frequency effects in EEG, several functional magnetic resonance imaging (fMRI) studies have shown that activity in parietal brain regions is associated with vehicle heading, obstacle avoidance and path estimation from optic flow (Walter et al., 2001; Horikawa et al., 2005; Field et al., 2007; Spiers and Maguire, 2007). Taken together, these studies suggest that the parietal cortex may monitor vehicle dynamics to maintain control during driving, but it is unclear what driving metric best reflects the relationship between parietal activity and subsequent visual-motor performance.
Here, we recorded EEG while participants performed a simulated continuous driving task. They were required to make corrective steering movements in response to periodic perturbations that simulated a wind gust and pushed the vehicle off course. The EEG data were decomposed using independent component (IC) analysis, and a cluster of components in both right and left parietal cortex were used in a generalized linear model (GLM) to examine relationships between driving performance and fluctuations in alpha activity as an index of visuospatial attention. We hypothesized that periods of relatively higher alpha power in parietal regions prior to the onset of the perturbation would show a strong relationship with four metrics of driving performance (LD, HE, RT and steering response). Furthermore, we expected that differential parietal activity with these four metrics would reveal how the brain imparts control on a moving vehicle in a continuous, naturalistic task. Our results found pre-stimulus alpha power in the right parietal cortex was related to variability in LD, while pre-stimulus alpha in left parietal was linked to HE, RT and steering. These findings suggest that the brain uses a dynamic control strategy to maintain central task requirements, and this strategy relies on fluctuations in alpha power which likely reflects dynamic attention allocation needed to track sensory parameters relevant for successfully executing a visual-motor task.
Materials and Methods
Participants
The participants were neurologically intact, healthy, adult right-hand- and right-eye-dominant males (N = 10; age range 27–39). The voluntary informed consent of the participants was obtained following US Army human use regulations approved by the Army Research Laboratory Institutional Review Board (32 CFR 219 and DoDI 3216.02).
Experimental Design
The driving simulator consisted of a 24″ monitor, computer speakers, and a steering wheel with accelerator and brake foot pedals situated in an acoustically-attenuated room. Simulation of the visual and audio task environment was developed and rendered in real-time using SimCreator (Real Time Technologies, Ann Arbor, MI, USA). The simulation environment consisted of a long straight four-lane highway with minimal scenery (highway, roadside and horizon) and no traffic or changes in roadside stimuli, with the exception of a speed limit sign that was presented approximately every 10 min (Figure 1A). Vehicle and environmental sounds were muted, except for a tone that activated if the participants drove beyond the shoulder of the right-most lane (off the road) or across the median of the highway (into oncoming traffic lane).
The participants first acclimated to the simulation environment and vehicle dynamics during a 15-min drive where the vehicle speed was constant at 45 mph and the participants only had to control steering. Following a 5-min break, participants drove for 45 min. They were instructed to steer the vehicle to maintain the vehicle in the center of the right-most lane and adjust their speed in accordance to speed limit signs (25 mph or 45 mph). The participants were informed that a perturbation force would occasionally occur, causing the vehicle to veer left or right in a manner similar to the effects experienced when a gust of wind crosses a real vehicle (e.g., see Thiffault and Bergeron, 2003; Lin et al., 2005). They were asked to correct the vehicle by steering it back to the center as soon as possible in the event of a perturbation. The environment included perturbations that were randomly distributed in right and left directions at a rate of one per 8 s (+0–2 s) with the criteria that participants maintain the vehicle within the right-most lane boundaries for at least 8 s before the next perturbation would occur (Lin et al., 2005). The perturbation force was canceled once participants turned the steering wheel 4° in the compensatory direction. If they did not respond within a few seconds, the force would angle the vehicle into the left or right side boundaries and trigger the warning tone. Every 15 min, the experimenter talked to the participant over an intercom and asked the participant to verbally report their sleepiness rating from 1 (extremely alert) to 9 (extremely sleepy, fighting sleep) when prompted. In the present article, our analysis focuses only on the data during the 45 min drive.
Behavioral Analysis
Although the participants drove continuously, three metrics were computed around each perturbation event. The LD was measured in meters and computed as the absolute value of the vehicle’s position from the center of the participant’s traveling lane (Figure 1B, top). The HE was measured in degrees and computed by determining the angular difference between the vehicle’s current course and an infinitely straight line that is parallel to the road edge (Figure 1C, top). Finally, the integrated steering response (ISR) was the integral of the steering wheel position from the time of response to 3 s after the perturbation started (Figure 1D, top). Each calculation occurred when the participant’s steering wheel response was ≥4° in the direction counteractive to the perturbation force. The time elapsed between the initiation of the perturbation and the response determined the RT (circle, Figures 1B–D, bottom). Simple t-tests showed no differences (all p > 0.1) in the steering responses, HE, RT or LD as a function of leftward or rightward perturbations. Therefore, in our subsequent analyses, we collapsed across right and left perturbations, and this decision did not impact the brain data analysis which examined the 3 s before perturbation onset. Finally, to compare measures across subjects, each driving performance measure was z-scored separately within each subject so that across subject variability was normalized.
Electroencephalography (EEG) Acquisition
EEG data were acquired using a BioSemi system (Amsterdam, Netherlands). Continuous recordings were sampled at 2048 Hz and acquired from 64 standard scalp locations (10–10 system; Chatrian et al., 1988) referenced online to the Common Mode Sense (CMS) electrode. Six additional channels were also recorded with online reference to CMS: left/right mastoids (M1/M2), two horizontal (left/right; HEOL/HEOR) and two vertical (upper/lower right eye; VEOU/VEOL) electro-ocular electrodes. EEG data were synchronized with the driving simulator CPU’s via an Arduino-based system.
EEG Preprocessing
All signal processing was applied using EEGLAB (ver 11.0.0.0b; Delorme and Makeig, 20041) and in-house code using Matlab (R2012a) on a 64-bit Linux operating system. Following established preprocessing procedures (Onton et al., 2006), all electrodes (64 EEG + 4 EOG) were first re-referenced to the average of the two mastoid electrodes (M1 and M2) before being bandpass filtered between 1 Hz and 50 Hz using a zero-phase finite impulse response filter (EEGLAB function pop_eegfilt). The EEG data for each participant was epoched into non-event-locked, adjacent (non-overlapping), 500-ms windows, and automatic artifact-rejection algorithms were applied to the epoched data using EEGLAB function pop_rejmenu with the following rejection criteria: (1) amplitude threshold (> ±100 μV); (2) joint probability (>5 SD); (3) abnormal trends (max slope 75 μV/500-ms epoch; R-squared limit 0.3); and (4) kurtosis (>5 SD). Finally, we visually inspected all epochs and confirmed automatically-tagged epochs containing artifacts or manually accepted or rejected epochs if incongruent with visual inspection.
EEG Analysis
We applied infomax independent component analysis (ICA; Bell and Sejnowski, 1995; Lee et al., 1999) and obtained spatially fixed, maximally temporally IC processes (Makeig et al., 1996) for each participant. A single model decomposition was used with default extended-mode training parameters (EEGLAB function runica). We then obtained dipoles for all ICs using EEGLAB plugin dipfit and selected features for clustering ICs using EEGLAB function pop_preclust (spectra = 1, ERSP = 1 and dipole models = 10). By default this technique uses the Four-Shell spherical head model. Clustering was performed using the k-means algorithm (EEGLAB function pop_clust) with number of clusters set to 19 and outliers set to >2.5 standard deviation from cluster centers.
Based on our a priori hypothesis, our analysis focused on two of the identified clusters in left and right parietal regions. The algorithm assigned 10 total ICs to each of the parietal clusters (Figure 2), including one component per participant whose dipole was proximal to parietal cortex so no manual adjustments were made to the output clusters. For each IC in each parietal cluster, we generated epochs around each perturbation event (−3000 ms to 3000 ms) and z-scored the power on a trial-by-trial basis using a wavelet decomposition (Morlet) to obtain average dynamic changes in spectral amplitude within the alpha band (8–13 Hz). This procedure aligns with previous research that demonstrated less sensitivity to noisy trials by using the entirety of the trial epoch period, instead of the traditional pre-stimulus period, when computing spectral power estimates (Grandchamp and Delorme, 2011). This normalization procedure (using the newtimef function in EEGLAB) also ensured common units of standard deviation so that we could directly compare behavior to neural data. The regression analysis, then, focused on the pre-perturbation period and used the averaged z-scored values of alpha power from −3000 ms to 0 ms. As confirmatory analyses, we also verified that the inclusion of the post-perturbation period in the normalization procedure did not bias the results by comparing the correlation between pre- and post-perturbation values (R2 = 0.1 for left hemisphere and R2 = 0.1 for right), and we did not find significant correlations between the alpha activity during the post-perturbation and any of the four metrics of driving performance (p > 0/05).
Statistical Analysis
We used a GLM to investigate the relationship between driving performance and alpha activity in right (Rα) and left (Lα) parietal dipole IC sources. Four separate models were run for the four driving metrics of interest (Behavior): LD, RT, HE and steering response. We controlled for time-on-task effects that may also modulate alpha activity and changes in vehicle-road kinematics (Otmani et al., 2005; Wascher et al., 2016) by including a parameter for time elapsed from the beginning of the experiment to the time of the trial measured in seconds (Time). In the equation, the * denotes that all main effects, pairwise effects, and three-way interactions were modeled simultaneously.
For each GLM, a backward selection procedure was used to select the most parsimonious model that was able to account for the variability in behavioral performance across 1896 trials. First, the model was fit with coefficients for the three main effects (Right, Left and Time), the pairwise effects (Right-Left, Right-Time, Left-Time), the three-way interaction (Right-Left-Time) and the intercept. The coefficients were then sorted by p-values, and the coefficient with the largest, insignificant p-value (p > 0.05) was eliminated from the model. If that coefficient represented a main effect, all higher order interaction terms containing that effect were eliminated. This procedure continued until all remaining coefficients were significant (p < 0.05) and identified terms with a significant relationship to the driving behavior, or the procedure terminated when no terms remained in the model which indicated no relationship with the driving behavior. To control for multiple comparisons, we performed false discovery rate correction (Benjamini and Hochberg, 1995). As a confirmatory analysis, we also examined within-subject variability by including a subject-specific term in the regression model, but the direction and significance of the identified coefficients in Table 1 remained the same with only small fluctuations in magnitude.
Table 1.
Behavior | Right | Left | Time | Right:Left | Right:Time | Left:Time | Right:Left:Time |
---|---|---|---|---|---|---|---|
LD | 0.049 (0.05) | −0.036 | 0.02 | 0.008 | 0.0065 | 0.042 | 0.053 (0.02) |
HE | −0.005 | 0.088 (<0.001) | 0.11 (<0.001) | 0.027 | 0.017 | −0.002 | 0.014 |
Steering | 0.013 | 0.055 (0.03) | 0.094 (<0.001) | 0.027 | 0.009 | 0.0373 | 0.044 |
RT | 0.01 | 0.09 (<0.001) | 0.07 (<0.01) | 0.017 | −0.02 | 0.05 | 0.009 |
Each row shows the model results for three driving behaviors: lane deviation (LD), heading error (HE), and integrated steering response (Steering). Each column shows model coefficients and their respective p-values in parentheses for the terms in the final model, including alpha power in two parietal clusters (Right and Left) as well as a time on task term (Time). Columns with colons indicate interaction terms. Significant effects retained in the final model are in italicized bold. Terms not included in the final model appear in regular text.
Results
In this study, 10 participants performed a simulated continuous driving task for 45 min on an infinitely long straight highway. Periodic perturbations that simulated a wind gust were imposed, resulting in a subsequent LD, HE and required a steering response and associated RT. We hypothesized that periods of relatively higher alpha power in parietal regions prior to the onset of the perturbation would show a strong relationship with these four driving performance metrics and that differential activity may provide insight into how the brain imparts control on a moving vehicle.
Behavioral Results
The average number of total perturbations across participants: 189, standard deviation (SD): 29. As visualized in Figure 1, we computed four performance metrics around each perturbation event, LD, HE, RT and steering response. These metrics were calculated at the onset of the participant’s steering response to counteract the perturbation force. The average RT across all participants: 1.16 s, SD: 0.46 s; the mean LD: 0.373 m, SD: 0.33 m. The average HE at the time of response: 23.49°, SD: 29.28°; and the average ISR: 6.71°, SD: 4.88°.
Relationship between Lane Deviation and Parietal Alpha Activity
We computed a general linear model to examine driving performance as measured by LD as a linear combination of left and right parietal alpha power, time-on-task effects, and the interaction of these variables. In the initial model fit (F(7,1888) = 2.6, corrected p-value = 0.02), prior to the backward selection procedure, the p-value for all terms were larger than 0.1 except for the main effect for right parietal alpha activity and the three way interaction term (see Table 1). After the model selection procedure; however, the only term that remained in the model was the right parietal alpha activity (coefficient = 0.047 with a 95% confidence interval of [0.002–0.09], p-value = 0.038). The relationship between right alpha power and LD for all subjects is plotted in Figure 3.
Relationship between Heading Error and Parietal Alpha Activity
Following the same procedure used for LD, we computed a general linear model to examine driving performance as measured by the vehicle HE as a linear combination of left and right parietal alpha power, time-on-task effects and the interaction of these variables. In the initial model fit (F(7,1888) = 6.76, corrected p-value < 0.01), prior to the backward selection procedure, the p-value for all terms were larger than 0.1 except for the main effect for left parietal alpha activity and the main effect for time-on-task (see Table 1). After the model selection procedure, however, the same two terms remained in the model, left parietal alpha activity (coefficient = 0.09 with a 95% confidence interval of [0.046–0.13], p-value < 0.01) and the time-on-task (coefficient = 0.11 with a 95% confidence interval of [0.07–0.16], p-value < 0.01). The relationship between left alpha power and HE for all subjects is plotted in Figure 4A, and the relationship between time-on-task and HE for all subjects is plotted in Figure 4B.
Relationship between Steering Response and Parietal Alpha Activity
The last model we examined was the relationship between the ISR, parietal alpha activity, and time. In the initial model fit (F(7,1888) = 6.5, corrected p-value < 0.01), prior to the backward selection procedure, the p-value for all terms were larger than 0.1 except for the main effect for left parietal alpha activity and the main effect for time-on-task (see Table 1). The same two terms remained in the model after the model selection procedure, left parietal alpha activity (coefficient = 0.07 with a 95% confidence interval of [0.052–0.114], p-value < 0.01) and the time-on-task (coefficient = 0.11 with a 95% confidence interval of [0.065–0.154], p-value < 0.01). The relationship between left alpha power and the ISR for all subjects is plotted in Figure 5A, and the relationship between time-on-task and ISR for all subjects is plotted in Figure 5B.
Relationship between Reaction Time and Parietal Alpha Activity
The last model we examined was the relationship between the RT, parietal alpha activity, and time. In the initial model fit (F(7,1888) = 5.13, corrected p-value < 0.01), prior to the backward selection procedure, the p-value for all terms were larger than 0.07 except for the main effect for left parietal alpha activity and the main effect for time-on-task (see Table 1). The same two terms remained in the model after the model selection procedure, left parietal alpha activity (coefficient = 0.1 with a 95% confidence interval of [0.059–0.148], p-value < 0.01) and the time-on-task (coefficient = 0.07 with a 95% confidence interval of [0.023–0.113], p-value < 0.01). The relationship between left alpha power and the RT for all subjects is plotted in Figure 6A, and the relationship between time-on-task and RT for all subjects is plotted in Figure 6B.
Discussion
Participants drove a simulated vehicle for 45 min on an infinitely long, straight highway, and periodic perturbations occurred that pushed the vehicle off course and caused a subsequent LD and HE. Participants were required to steer the vehicle back to the center of the lane, and we hypothesized the variability in prestimulus alpha to the perturbation event would relate to variability in driving performance. EEG was decomposed using IC analysis, and a cluster of components in left and right parietal cortex was used to examine the relationship between alpha power and four driving performance metrics: LD, HE, RT and steering response. We uncovered differential relationships in the left and right parietal cluster, revealing that HE, RT and steering response track with activity in left parietal sources while LD links to alpha activity in the right parietal sources. Our findings overall suggest that right parietal activity is related to attentional states that orient the vehicle on the road in support of the central visual-motor task whereas left parietal alpha activity reflects attentional processing that focuses on HE in preparation for minimizing the RT to make corrective steering responses.
Relationship between Driving Performance and Parietal Alpha Activity
The right parietal component cluster demonstrated a significant, positive relationship with LD. Previous work has demonstrated that activity in right parietal cortex supports visuospatial processing and orienting (Whitehead, 1991; Rushworth et al., 2001; Foxe et al., 2003; Thut, 2006), and additional research has refined its role, suggesting that the right hemisphere is more closely aligned to events with higher temporal predictability, increased arousal, or heightened vigilance (Fernández and Siéroff, 2014). In line with these findings, right parietal alpha activity increased when the participant was slow to correct for the recent wind perturbation and allowed the amount of LD to increase. Increased pre-stimulus alpha power has been linked to decrements in subsequent performance (Hanslmayr et al., 2011), and in the context of driving, it has been interpreted as decreased arousal with impaired vigilance (Lin et al., 2012). Our findings suggest that the right parietal cortex reflects visuospatial processing that is critical for tracking vehicle kinematics for the central task (maintaining a zero LD), and fluctuations in alpha may capture fluctuations in attention that are critical for driving performance. Interestingly, recent clinical work supports this interpretation by demonstrating the patients with right hemisphere lesions have significantly more lane crossing incidents that those with left hemispheric lesions, and furthermore, this study found that left hemisphere patients demonstrated longer RT for braking responses than those with right hemisphere lesions (Park, 2015). These clinical findings nicely complement our results from healthy participants.
The left parietal component cluster demonstrated a significant, positive relationship with HE and steering response. Previous behavioral research has shown that HE is closely related to upcoming steering responses (Hildreth et al., 2000; Field et al., 2007). Our results align well with previous research that suggested that left parietal regions may direct attention for upcoming movements (Rushworth et al., 2001) as well as studies where preparatory attention is modulated by the left hemisphere (Fernández and Siéroff, 2014). Collectively, our current results suggest that left parietal alpha activity relates to processes which monitor the current heading of the vehicle to determine the timing and magnitude of the response for subsequent corrective action.
These results also align with previous research that uncovered differential network activity related to adaptive and stable task control (Dosenbach et al., 2007). Their study uncovered a frontoparietal network that demonstrated error-related activity on a trial by trial basis, and a secondary network that had sustained activity throughout the task. Our results are similar. Activity in the left parietal cluster related to HE, RT and coordinated steering control—all of which were dynamic over the course of the experiment. Conversely, the right parietal region had sustained activity related to the critical task parameter, LD, which did not change over the course of the experiment. These findings suggest that parietal activity may reflect a dynamic control strategy to maintain critical performance when executing a visual-motor task.
Differential Effects of Time on Task on Driving Performance
Across the models for the four driving performance metrics, LD did not show a time on task effect, while both HE, RT and steering response increased over the course of the long drive. Previous research has suggested that humans are exceedingly vigilant against infractions of the central task requirement (Hockey, 1997; Grier et al., 2003; van der Linden et al., 2003), and in our study, the participants were instructed to keep their vehicle in the center of the traveling lane. In support of this previous literature, our results revealed that LD did not show a main effect of time, indicating that participants successfully minimized performance decrements in their primary task.
In contrast, the models for both HE and steering response revealed a main effect of time. The behavioral coupling between these two driving metrics has been previously shown suggesting that they may be incorporated in a complex feedback control system wherein the HE is perceived and transformed into a steering response. In support of this, behavioral research has found that the HE is more closely linked to steering responses than to LD (Hildreth et al., 2000; Wallis et al., 2002; Cloete and Wallis, 2009; Li and Cheng, 2011). In our study, we extended these results and observed that both driving metrics increase over the duration of the experiment. When construed as a change in the control parameter, the increase in HE over time suggests that the brain permits increased error in this regulatory dimension, but in order to maintain the LD near zero for the central task requirement, the participant utilized larger steering wheel corrections. This paired increase in HE and steering response is analogous to uncontrolled manifold hypotheses (Scholz and Schöner, 1999; Todorov, 2004) wherein a number of different heading/steering corrections over time can lead to a small, near zero LD. Combined, our results suggest that the brain utilizes HE to estimate steering responses, and as time on task effects negatively impact driving performance (Matthews and Desmond, 2002), the increased tolerance for larger HEs leads to a concomitant change to larger steering wheel corrections. This is supported by the observation that RTs increased over the course of the experiment which may suggest that monitoring processes degraded over the course of the experiment and resulted in larger heading responses and subsequent increases in steering responses. Our data cannot be directly interpreted as an explicit feedback control model since we do not model the dynamics of this relationship (e.g., steering responses over time), but this pattern can be interpreted in terms of a feedback control system that allows varying levels of error in control parameters while maintaining accuracy in the central visual-motor task. More specifically, right parietal activity in our study was associated with monitoring of LD (the central, critical task requirement), while left parietal activity associated with feedback control perhaps in the computation of the control signal. Future research can target experimental designs to test these interpretations.
Future Directions
The main motivation for our work targets a driver error detection system to mitigate accidents that occur due to lapses in attention and visuomotor control. Consequently, we focused on four driving performance metrics that are the most amenable to study a closed loop control problem, but additional measures such as standard deviation of lane position (SDLP) or steering wheel reversal rate (SWRR) could provide interesting insights about driving performance more generally (for a complete review of driving metrics, see Sandberg et al., 2011). Likewise, we narrowed our focus to alpha activity due to its role in attention and strong relationship to subsequent task performance (Hanslmayr et al., 2011); however, it would be interesting to examine the contribution from other frequency bands. Previous work has shown that alpha and theta positively related with incidents (r from 0.72 to 0.90; Horne and Baulk, 2004), and preparatory action has been associated with the beta band (Tzagarakis et al., 2015), suggesting an interesting avenue for future driving research. We also only examined the brain activity before the pre-perturbation period when participants were maintaining ongoing driving performance, but there are several, critical cognitive processes that occur after perturbation onset that must capture the ongoing demands of the task in order to execute an efficient and accurate response. Work to capture the dynamics of these processes may also be essential for the successful implementation and adoption of driver error detection systems. Finally, our targeted focus on parietal activity could be expanded to look at additional regions robustly identified in previous driving research (Calhoun et al., 2002; Spiers and Maguire, 2007; Huang et al., 2009) to better delineate the distributed neural substrates that support accurate driving performance. All of these future directions would nicely extend our findings, and with larger sample sizes, the research could also target within-subject analyses using more advanced approaches (e.g., hierarchical mixed effects) in order to better understand how driver error detection system can be adapted to differences between individuals.
Conclusion
In this realistic, continuous driving task, we have demonstrated differential relationships between neural activity in parietal EEG sources and variations in LD, HE and steering response. Right parietal alpha activity was positively correlated with LD. This result indicates that participants deviated farther from the center of the lane when pre-stimulus alpha power was high, confirming its negative relationship with subsequent behavior (Hanslmayr et al., 2011). This fluctuation did not change significantly over time, indicating that participants were very good at maintaining the central task requirement. Combined, these results support the interpretation that the right parietal regions are involved in spatial processing and orienting, and when inactive (as indexed by high alpha power), driving performance is impaired as indexed by increased LD.
Simultaneously, the brain activity in the left parietal EEG sources may support ongoing assessment of HE and preparation for a corrective steering wheel movement that minimizes RT. The models for these three driving metrics found a main effect of time on task, and this may reflect changes in control over time suggesting that perhaps the control strategy changes to allow larger HEs that are met with larger steering corrections and slower RTs to ensure accuracy in the central task. The control strategy among these measures may be attributable to learned skills in participants who have driven for 10–20 years (age range 27–39) as evidenced by the lack of interaction between parietal activity and time on task for any of these driving metrics. More generally, these results suggest that left parietal alpha activity tracks control parameters necessary for steering corrections in support of the task objective. From a practical perspective, this research provides a framework within which one can consider implementing a driver error detection system. With the advent of autonomous vehicles that require strategic transfer of control between a human driver and an autonomous system, our findings suggest that monitoring brain activity may identify time frames when human error is more likely and trigger the shift in control from the human to the autonomous system.
Our results encapsulate theoretical predictions from two typically disparate areas of research. The compensatory control hypothesis within the psychology literature posits that central task requirements are preserved, even if participants must utilize more variable, often less efficient strategies (Hockey, 1997). Similarly, the uncontrolled manifold hypothesis in motor control theory posits that the primary performance criterion is prioritized, but variance is permitted in any variable that has redundant degrees of freedom (Scholz and Schöner, 1999). The core prediction of both theories was reflected in our results where participants allowed increased variation in HE, RT, and steering response while LD remained constant. Although nuances between the two theories exist, they both describe the human as a system which attempts to maintain critical task performance by permitting variability in redundant dimensions, and in our study, we identify differential neural substrates in the parietal cortex that may subserve these functions by using alpha to dynamically allocate attention to track sensory parameters relevant for successfully executing a visual-motor task.
Author Contributions
JRB analyzed the data and wrote the majority of the manuscript. JOG assisted with the analysis, presentation of the data and writing. SEK and JMV also wrote and assisted with theoretical interpretation.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was sponsored by the US Army Research Laboratory, including work under Cooperative Agreement Number W911NF-10-2-0022. The authors would like to thank colleagues within the Future Soldier Technologies Division for insightful discussion about these results, with particular thanks to Piotr Franaszczuk and Kelvin Oie for their feedback.
Footnotes
References
- Bell A. J., Sejnowski T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129–1159. 10.1162/neco.1995.7.6.1129 [DOI] [PubMed] [Google Scholar]
- Benjamini Y., Hochberg Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Series B Methodol. 57, 289–300. [Google Scholar]
- Calhoun V. D., Pekar J. J., McGinty V. B., Adali T., Watson T. D., Pearlson G. D. (2002). Different activation dynamics in multiple neural systems during simulated driving. Hum. Brain Mapp. 16, 158–167. 10.1002/hbm.10032 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chatrian G.-E., Lettich E., Nelson P. L. (1988). Modified nomenclature for the “10%” electrode system. J. Clin. Neurophysiol. 5, 183–186. 10.1097/00004691-198804000-00005 [DOI] [PubMed] [Google Scholar]
- Cloete S. R., Wallis G. (2009). Limitations of feedforward control in multiple-phase steering movements. Exp. Brain Res. 195, 481–487. 10.1007/s00221-009-1813-6 [DOI] [PubMed] [Google Scholar]
- Delorme A., Makeig S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. 10.1016/j.jneumeth.2003.10.009 [DOI] [PubMed] [Google Scholar]
- Donges E. (1978). A two-level model of driver steering behavior. Hum. Factors J. Hum. Factors Ergon. Soc. 20, 691–707. [Google Scholar]
- Dosenbach N. U. F., Fair D. A., Miezin F. M., Cohen A. L., Wenger K. K., Dosenbach R. A. T., et al. (2007). Distinct brain networks for adaptive and stable task control in humans. Proc. Natl. Acad. Sci. U S A 104, 11073–11078. 10.1073/pnas.0704320104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Engel A. K., Fries P., Singer W. (2001). Dynamic predictions: oscillations and synchrony in top-down processing. Nat. Rev. Neurosci. 2, 704–716. 10.1038/35094565 [DOI] [PubMed] [Google Scholar]
- Fernández L. G., Siéroff E. (2014). Differential hemispheric modulation of preparatory attention. Brain Cogn. 87, 57–68. 10.1016/j.bandc.2014.03.006 [DOI] [PubMed] [Google Scholar]
- Field D. T., Wilkie R. M., Wann J. P. (2007). Neural systems in the visual control of steering. J. Neurosci. 27, 8002–8010. 10.1523/JNEUROSCI.2130-07.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foxe J. J., McCourt M. E., Javitt D. C. (2003). Right hemisphere control of visuospatial attention: line-bisection judgments evaluated with high-density electrical mapping and source analysis. Neuroimage 19, 710–726. 10.1016/s1053-8119(03)00057-0 [DOI] [PubMed] [Google Scholar]
- Gilbert C. D., Li W. (2013). Top-down influences on visual processing. Nat. Rev. Neurosci. 14, 350–363. 10.1038/nrn3476 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gould I. C., Rushworth M. F., Nobre A. C. (2011). Indexing the graded allocation of visuospatial attention using anticipatory alpha oscillations. J. Neurophysiol. 105, 1318–1326. 10.1152/jn.00653.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grier R. A., Warm J. S., Dember W. N., Matthews G., Galinsky T. L., Parasuraman R. (2003). The vigilance decrement reflects limitations in effortful attention, not mindlessness. Hum. Factors 45, 349–359. 10.1518/hfes.45.3.349.27253 [DOI] [PubMed] [Google Scholar]
- Grandchamp R., Delorme A. (2011). Single-trial normalization for event-related spectral decomposition reduces sensitivity to noisy trials. Front. Psychol. 2:236. 10.3389/fpsyg.2011.00236 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanslmayr S., Gross J., Klimesch W., Shapiro K. L. (2011). The role of alpha oscillations in temporal attention. Brain Res. Rev. 67, 331–343. 10.1016/j.brainresrev.2011.04.002 [DOI] [PubMed] [Google Scholar]
- Hess R. A., Modjtahedzadeh A. (1990). A control theoretic model of driver steering behavior. IEEE Control Syst. Mag. 10, 3–8. 10.1109/37.60415 [DOI] [Google Scholar]
- Hildreth E. C., Beusmans J. M. H., Boer E. R., Royden C. S. (2000). From vision to action: experiments and models of steering control during driving. J. Exp. Psychol. Hum. Percept. Perform. 26, 1106–1132. 10.1037/0096-1523.26.3.1106 [DOI] [PubMed] [Google Scholar]
- Hockey G. R. (1997). Compensatory control in the regulation of human performance under stress and high workload: a cognitive-energetical framework. Biol. Psychol. 45, 73–93. 10.1016/s0301-0511(96)05223-4 [DOI] [PubMed] [Google Scholar]
- Horikawa E., Okamura N., Tashiro M., Sakurada Y., Maruyama M., Arai H., et al. (2005). The neural correlates of driving performance identified using positron emission tomography. Brain Cogn. 58, 166–171. 10.1016/j.bandc.2004.10.002 [DOI] [PubMed] [Google Scholar]
- Horne J. A., Baulk S. D. (2004). Awareness of sleepiness when driving. Psychophysiology 41, 161–165. 10.1046/j.1469-8986.2003.00130.x [DOI] [PubMed] [Google Scholar]
- Huang R.-S., Jung T.-P., Makeig S. (2009). “Tonic changes in EEG power spectra during simulated driving,” in Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience, eds Schmorrow D. D., Estabrooke I. V., Grootjen M. (Berlin, Heidelberg: Springer; ), 394–403. [Google Scholar]
- Jokisch D., Jensen O. (2007). Modulation of gamma and alpha activity during a working memory task engaging the dorsal or ventral stream. J. Neurosci. 27, 3244–3251. 10.1523/JNEUROSCI.5399-06.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jones S. R., Kerr C. E., Wan Q., Pritchett D. L., Hämäläinen M., Moore C. I. (2010). Cued spatial attention drives functionally relevant modulation of the mu rhythm in primary somatosensory cortex. J. Neurosci. 30, 13760–13765. 10.1523/JNEUROSCI.2969-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimesch W., Fellinger R., Freunberger R. (2011). Alpha oscillations and early stages of visual encoding. Front. Psychol. 2:118. 10.3389/fpsyg.2011.00118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee T.-W., Girolami M., Sejnowski T. J. (1999). Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Comput. 11, 417–441. 10.1162/089976699300016719 [DOI] [PubMed] [Google Scholar]
- Li L., Cheng J. C. K. (2011). Heading but not path or the tau-equalization strategy is used in the visual control of steering toward a goal. J. Vis. 11:20. 10.1167/11.12.20 [DOI] [PubMed] [Google Scholar]
- Lin C.-T., Chuang C.-H., Wang Y.-K., Tsai S.-F., Chiu T.-C., Ko L.-W. (2012). Neurocognitive characteristics of the driver: A review on drowsiness, distraction, navigation, and motion sickness. J. Neurosci. Neuroeng. 1, 61–81. 10.1166/jnsne.2012.1010 [DOI] [Google Scholar]
- Lin C.-T., Huang K.-C., Chao C.-F., Chen J.-A., Chiu T.-W., Ko L.-W., et al. (2010). Tonic and phasic EEG and behavioral changes induced by arousing feedback. Neuroimage 52, 633–642. 10.1016/j.neuroimage.2010.04.250 [DOI] [PubMed] [Google Scholar]
- Lin C.-T., Wu R.-C., Liang S.-F., Chao W.-H., Chen Y.-J., Jung T.-P. (2005). EEG-based drowsiness estimation for safety driving using independent component analysis. IEEE Trans. Circuits Syst. I Regul. Pap. 52, 2726–2738. 10.1109/tcsi.2005.857555 [DOI] [Google Scholar]
- Makeig S., Bell A. J., Jung T.-P., Sejnowski T. J. (1996). “Independent component analysis of electroencephalographic data” in Advances in Neural Information Processing Systems 8, eds Touretzky D. S., Hasselmo M. E. (Cambridge, MA: MIT Press; ), 145–151. [Google Scholar]
- Matthews G., Desmond P. A. (2002). Task-induced fatigue states and simulated driving performance. Q. J. Exp. Psychol. A 55, 659–686. 10.1080/02724980143000505 [DOI] [PubMed] [Google Scholar]
- Onton J., Westerfield M., Townsend J., Makeig S. (2006). Imaging human EEG dynamics using independent component analysis. Neurosci. Biobehav. Rev. 30, 808–822. 10.1016/j.neubiorev.2006.06.007 [DOI] [PubMed] [Google Scholar]
- Otmani S., Pebayle T., Roge J., Muzet A. (2005). Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers. Physiol. Behav. 84, 715–724. 10.1016/j.physbeh.2005.02.021 [DOI] [PubMed] [Google Scholar]
- Park M.-O. (2015). A comparison of driving errors in patients with left or right hemispheric lesions after stroke. J. Phys. Ther. Sci. 27, 3469–3471. 10.1589/jpts.27.3469 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pouget A., Snyder L. H. (2000). Computational approaches to sensorimotor transformations. Nat. Neurosci. 3, 1192–1198. 10.1038/81469 [DOI] [PubMed] [Google Scholar]
- Rushworth M. F. S., Krams M., Passingham R. E. (2001). The attentional role of the left parietal cortex: the distinct lateralization and localization of motor attention in the human brain. J. Cogn. Neurosci. 13, 698–710. 10.1162/089892901750363244 [DOI] [PubMed] [Google Scholar]
- Salvucci D. D., Gray R. (2004). A two-point visual control model of steering. Perception 33, 1233–1248. 10.1068/p5343 [DOI] [PubMed] [Google Scholar]
- Sandberg D., Akerstedt T., Anund A., Kecklund G., Wahde M. (2011). Detecting driver sleepiness using optimized nonlinear combinations of sleepiness indicators. IEEE Trans. Intell. Transp. Syst. 12, 97–108. 10.1109/tits.2010.2077281 [DOI] [Google Scholar]
- Scholz J. P., Schöner G. (1999). The uncontrolled manifold concept: identifying control variables for a functional task. Exp. Brain Res. 126, 289–306. 10.1007/s002210050738 [DOI] [PubMed] [Google Scholar]
- Scott S. H. (2004). Optimal feedback control and the neural basis of volitional motor control. Nat. Rev. Neurosci. 5, 532–546. 10.1038/nrn1427 [DOI] [PubMed] [Google Scholar]
- Shadmehr R., Smith M. A., Krakauer J. W. (2010). Error correction, sensory prediction and adaptation in motor control. Annu. Rev. Neurosci. 33, 89–108. 10.1146/annurev-neuro-060909-153135 [DOI] [PubMed] [Google Scholar]
- Sonnleitner A., Simon M., Kincses W. E., Buchner A., Schrauf M. (2012). Alpha spindles as neurophysiological correlates indicating attentional shift in a simulated driving task. Int. J. Psychophysiol. 83, 110–118. 10.1016/j.ijpsycho.2011.10.013 [DOI] [PubMed] [Google Scholar]
- Spiers H. J., Maguire E. A. (2007). Neural substrates of driving behaviour. Neuroimage 36, 245–255. 10.1016/j.neuroimage.2007.02.032 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thiffault P., Bergeron J. (2003). Monotony of road environment and driver fatigue: a simulator study. Accid. Anal. Prev. 35, 381–391. 10.1016/s0001-4575(02)00014-3 [DOI] [PubMed] [Google Scholar]
- Thut G. (2006). α-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection. J. Neurosci. 26, 9494–9502. 10.1523/JNEUROSCI.0875-06.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todorov E. (2004). Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907–915. 10.1038/nn1309 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todorov E., Jordan M. I. (2002). Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226–1235. 10.1038/nn963 [DOI] [PubMed] [Google Scholar]
- Tzagarakis C., West S., Pellizzer G. (2015). Brain oscillatory activity during motor preparation: effect of directional uncertainty on beta, but not alpha, frequency band. Front. Neurosci. 9:246. 10.3389/fnins.2015.00246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van der Linden D., Frese M., Meijman T. F. (2003). Mental fatigue and the control of cognitive processes: effects on perseveration and planning. Acta Psychol. 113, 45–65. 10.1016/s0001-6918(02)00150-6 [DOI] [PubMed] [Google Scholar]
- van Dijk H., Schoffelen J.-M., Oostenveld R., Jensen O. (2008). Prestimulus oscillatory activity in the alpha band predicts visual discrimination ability. J. Neurosci. 28, 1816–1823. 10.1523/JNEUROSCI.1853-07.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wallis G., Chatziastros A., Bülthoff H. (2002). An unexpected role for visual feedback in vehicle steering control. Curr. Biol. 12, 295–299. 10.1016/s0960-9822(02)00685-1 [DOI] [PubMed] [Google Scholar]
- Walter H., Vetter S. C., Grothe J., Wunderlich A. P., Hahn S., Spitzer M. (2001). The neural correlates of driving. Neuroreport 12, 1763–1767. 10.1097/00001756-200106130-00049 [DOI] [PubMed] [Google Scholar]
- Wascher E., Getzmann S., Karthaus M. (2016). Driver state examination–Treading new paths. Accid. Anal. Prev. 91, 157–165. 10.1016/j.aap.2016.02.029 [DOI] [PubMed] [Google Scholar]
- Whitehead R. (1991). Right hemisphere processing superiority during sustained visual attention. J. Cogn. Neurosci. 3, 329–334. 10.1162/jocn.1991.3.4.329 [DOI] [PubMed] [Google Scholar]
- Wulf G., McNevin N., Shea C. H. (2001). The automaticity of complex motor skill learning as a function of attentional focus. Q. J. Exp. Psychol. A 54, 1143–1154. 10.1080/02724980143000118 [DOI] [PubMed] [Google Scholar]