Abstract
To err is human, and hence even professional musicians make errors occasionally during their performances. This paper summarizes recent work investigating error monitoring in musicians, i.e., the processes and their neural correlates associated with the monitoring of ongoing actions and the detection of deviations from intended sounds. Electroencephalography (EEG) studies reported an early component of the event-related potential (ERP) occurring before the onsets of pitch errors. This component, which can be altered in musicians with focal dystonia, likely reflects processes of error detection and/or error compensation, i.e., attempts to cancel the undesired sensory consequence (a wrong tone) a musician is about to perceive. Thus, auditory feedback seems not to be a prerequisite for error detection, consistent with previous behavioral results. In contrast, when auditory feedback is externally manipulated and thus unexpected, motor performance can be severely distorted, although not all feedback alterations result in performance impairments. Recent studies investigating the neural correlates of feedback processing showed that unexpected feedback elicits an ERP component after note onsets, which shows larger amplitudes during music performance than during mere perception of the same musical sequences. Hence, these results stress the role of motor actions for the processing of auditory information. Furthermore, recent methodological advances like the combination of 3D motion capture techniques with EEG will be discussed. Such combinations of different measures can potentially help to disentangle the roles of different feedback types such as proprioceptive and auditory feedback, and in general to derive at a better understanding of the complex interactions between the motor and auditory domain during error monitoring. Finally, outstanding questions and future directions in this context will be discussed.
Keywords: EEG, performance monitoring, music performance, motor control, errors
Introduction
Research into errors occurring during skilled human behavior has a long tradition, and has revealed important insights into planning and execution of complex tasks, such as speech, typing, and music performance (for the music domain, see e.g., Palmer and van de Sande, 1993, 1995; Palmer, 1997, 2005; Palmer and Pfordresher, 2003; Pfordresher, 2006). From the perspective of the experienced performer, errors (defined as the unintended result of an action) are usually something that has to be avoided. Nevertheless, even highly trained musicians commit errors occasionally. In contrast, errors provide an important source of information during music learning. Only if we are aware of our errors, e.g., when we realize that a keystroke sounded wrong (whether in terms of pitch, timing, or intensity), we can learn and try to prevent them in the future. Thus, the constant monitoring of our actions, detecting errors, and appropriately responding after we have realized that our actions did not result in what was intended is an important feature of human behavior.
Early investigations of errors during skilled behavior such as typing (Rabbitt, 1978) showed that participants can detect their own errors immediately, possibly even before the result of an erroneous action can be perceived. In addition, participants showed slower responses on trials following errors (“post-error slowing”), suggesting that they adjusted their behavioral strategies after error commissions. Consequently, it was assumed that the functioning of an action-monitoring system is responsible for the detection of errors and initiation of performance adjustments when appropriate.
The neurophysiological correlates of erroneous responses, compared to correct responses, were investigated in the 1990s. A seminal finding was a sharp, negative-going deflection in the ERP occurring around 50–100 ms after participants responded incorrectly during choice-reaction tasks (for reviews, see e.g., Falkenstein et al., 2000; van Veen and Carter, 2006; Taylor et al., 2007). This component, termed “Error Negativity” (Ne) (Falkenstein et al., 1990) or “error-related negativity” (ERN) (Gehring et al., 1993) seemed to be elicited independently of the modality in which the stimulus is presented in (Falkenstein et al., 2000), and independently of the effector (hand or foot) with which the erroneous response was made (Holroyd et al., 1998). Converging evidence from source localization of EEG data (e.g., van Veen and Carter, 2002; Herrmann et al., 2004), primate studies (e.g., Gemba et al., 1986), and functional magnetic resonance imaging (fMRI) (e.g., Ullsperger and von Cramon, 2001; Debener et al., 2005) indicate that the ERN is generated in the anterior cingulate cortex (ACC) (for a review, see Ridderinkhof et al., 2004). Several theories try to account for the ERN findings: one of the first hypotheses was that the ERN is induced when the comparison between the neural representation of the correct response with the representation of the actual response shows a mismatch (Falkenstein et al., 2000). The reinforcement-learning theory posits that the ERN is elicited whenever an outcome (based on a response or on the feedback given to participants) is worse than expected (Holroyd and Coles, 2002), and the conflict monitoring theory assumes that the ERN is elicited when the ACC detects conflict due to the simultaneous activation of two competing response representations (Carter et al., 1998; Botvinick et al., 2001; van Veen et al., 2001).
However, the neural correlates of errors during the performance of time-based sequential behaviors like music remained largely elusive. In the following, recent approaches in this domain (focusing on piano performance) and their findings will be summarized.
Errors during music performance
Many errors committed during the performance of a complex piece of music go unnoticed by the listener, presumably because of the context they appear in, their loudness, and whether the listener is familiar with the piece of music or not (Repp, 1996). Although the relevance of an error that is not perceived by a listener is, for the purpose of musical communication, arguable, errors can be identified on a more objective level. This can be realized because a great deal of music in the western traditional music culture is passed on in a written form (i.e., musical scores), and the identification of errors can be achieved by comparing the notation with the actually performed notes. When the performance is compared to a score, at least three different types of errors can be differentiated: substitutions occur when a note is performed with a wrong pitch, omissions occur when a note is not performed at all, and intrusions (or additions) occur when a note is played that is not in the score (although further distinctions within these types can be made, and error coding can be ambiguous; Palmer and van de Sande, 1993; Repp, 1996). In addition to these errors, musicians can make mistakes during fingering, e.g., when a note is produced with a different finger than originally intended (the problem of fingering is especially pronounced with keyboard instruments, because a clear finger-key mapping is missing). These fingering errors will usually not directly result in a wrong or missing note; however, they might cause problems in motor planning and execution of the following events, possibly resulting in a substitution, deletion, or addition at later positions in a performance.
Recently, a couple of studies using EEG started to investigate the neural correlates of such substitution errors during piano performances (Maidhof et al., 2009; Ruiz et al., 2009, 2011; Strübing et al., 2012). The study of neural correlates of errors can provide insights into the mechanisms of human action monitoring during a complex, multimodal task such as music performance, and error processing in general.
In these studies, highly-trained pianists (mostly piano students or graduated pianists from music conservatories) were asked to perform either right-hand excerpts from pieces of the classical piano literature (Ruiz et al., 2009, 2011; Strübing et al., 2012), or bimanually scales and fingering patterns (Maidhof et al., 2009). To exclude the influence of visual feedback and to provoke pianists committing errors, these sequences were performed without visual feedback from the keys and hands, and at relatively fast tempos, ranging from 125–360 ms inter-onset intervals (IOIs). In addition to the EEG, the timing of note on- and offsets as well as an estimate of the key press velocity (corresponding to the loudness of the auditory feedback of a keystroke) were recorded in form of musical instrument data interface (MIDI) events.
On a behavioral level, two consistent findings across these studies were reported. First, erroneous keystrokes were performed with a lower velocity than correctly performed keystrokes, independently of whether correct keystrokes were performed with the same hand (at other positions in the score; Ruiz et al., 2009, 2011; Strübing et al., 2012), or simultaneously with the other hand (Maidhof et al., 2009). Furthermore, the analysis of bimanual sequence production revealed that the velocity of correct keystrokes when an error was present in the other hand did not differ from the velocity of correct keystrokes when no error was present. This indicated that the velocity of erroneous keystrokes in one hand did not influence the velocity of the simultaneous correct keystroke (Maidhof et al., 2009). Second, the IOIs, measured from the previous note to the current note, of incorrect keystrokes were increased compared to correct keystrokes, i.e., errors were produced slower than correct key presses (“pre-error slowing”). Although not analyzed by Maidhof et al. (2009), the studies by Ruiz et al. (2009, 2011) and Strübing et al. (2012) consistently reported also post-error slowing, i.e., the IOIs of correct notes directly following errors (measured from the current note to the next one) were prolonged. When stimuli were produced bimanually, the IOIs of both, the correct key press and the simultaneous incorrect key press were prolonged, compared to IOIs when no error was present in either hand. That is, whereas the keystroke velocity differed between incorrect and simultaneous correct keystrokes performed with two hands, timing affected both hands.
The study by Ruiz et al. (2009) employed also a condition in which pianists performed in the absence of auditory feedback. However, behavioral indices of “muted” piano performances did not differ in terms of timing, key press velocities, error rates, and behavioral features of errors; that is, results of silent piano performances showed pre-and post-error slowing, as well as reduced keystroke velocities during erroneous keystrokes. These findings are consistent with previous studies showing that the complete absence of auditory feedback seems to have no effects on performances of well-learned piano pieces (Finney, 1997; Finney and Palmer, 2003; Pfordresher, 2003; Pfordresher and Palmer, 2006; see also section below).
On a neurophysiological level, these studies (Maidhof et al., 2009; Ruiz et al., 2009; Strübing et al., 2012) consistently reported that ERPs elicited during incorrect and correct key presses showed a negative difference occurring prior to the note onset (determined by the onset of the MIDI signal; see Figure 1). Thus, ERPs differed before the erroneous movement was fully executed and before auditory feedback was available (this effect was termed pre-error negativity or pre-error-related negativity (pre-ERN). The latency of this effect appears to be influenced by the tempo with which pianists produced the sequences: when participants played with a relatively slower tempo (IOI of around 360 ms), the difference occurred earlier around 150–80 ms prior to note onset (Maidhof et al., 2009), whereas the difference occurred somewhat later around 70–20 ms prior to note onset when stimuli were produced in a relatively fast tempo (IOI of around 125 ms; Ruiz et al., 2009, 2011; Strübing et al., 2012). One might speculate that during slower performance tempi, there is more time to prepare, initiate, and execute the following keystroke; consequently, error detection and/or error correction mechanisms can start at an earlier stage, resulting in the different latency of the pre-error negativity during slower performances. Alternatively, one might speculate that the latency differences of the early negativity occurring during slower and faster tempi are due to an artifact of the ERP analyses. Because one could assume that ERPs of the wrong notes overlap with the ERPs of the previous notes, differences in the performed tempo might result in latency differences of the sum amplitude of this overlap, possibly causing a pseudo-shift of pre-ERN latencies. However, in the study of Ruiz et al. (2009), a symbolic resonance analysis was performed, which can be used to disentangle possible overlapping brain responses due to short IOIs (Beim Graben and Kurths, 2003). The results of this analysis confirmed the ERP analysis in the time window of the pre-ERN. Thus, it seems unlikely that the different latencies of the pre-ERN obtained during varying performance tempi are only due to the above mentioned ERP artifact. Similarly, the pre-ERN might be influenced by the different tempi of correct and incorrect notes. To further exclude this possibility, future experiments could compare a subset of correct notes which are performed with a tempo that is comparable to that of incorrect notes. If the pre-ERN would still be elicited, it would indicate that the different tempi of correct and incorrect notes can have only a minor influence on the pre-ERN.
Figure 1.

(A) Grand-averaged ERPs for correct and one-handed incorrect key presses during bimanual performance of technical piano exercises. The arrow indicates the note onset determined by the MIDI signal and hence the onset of auditory feedback. The gray areas show the time windows used for statistical analysis (−150 to −80 ms and 240–320 ms). (B) shows the scalp distributions for the difference potential for correct keystrokes subtracted from incorrect keystrokes. Figure taken from Maidhof et al., 2009.
Despite the latency differences, the ERP effect showed consistently a (fronto-) central topographical distribution, and was estimated to be generated by brain structures in the rostral part of ACC (Ruiz et al., 2009), consistent with an explanation in terms of error-related processes (Ridderinkhof et al., 2004). Separate analysis of errors committed with the right or left hand did not show any lateralization effects (Maidhof et al., 2009), which indicates that the ERP difference is not due to low-level motor-related processes which could be the cause of the error, but rather due to cognitive processes of error detection and/or correction: simpler motor-related execution processes would be expected to occur lateralized or bilaterally when averaged across left- and right-hand errors.
Interestingly, the pre-error negativity was also elicited in the absence of auditory feedback, and its amplitude did statistically not differ between the two feedback conditions (although it occurred in the condition without feedback around 50–0 ms prior to note onset). However, the results of a symbolic resonance analysis and the ERP difference waves of Ruiz et al. (2009) suggest that the pre-error negativity elicited in the absence of auditory feedback might actually consist of two superimposed components of slightly different amplitudes. Thus, future work is needed to disentangle the exact differences between error processing with and without auditory feedback. Nevertheless, it is important to note here that these findings indicate that not the processing of auditory input (which differs between correct and incorrect key presses) can account for the pre-error negativity.
Another finding of the above mentioned studies was that incorrect keystrokes elicited, compared to correct keystrokes, an increased positivity around 250 ms after the onset of errors (see also Figure 1). This potential showed a fronto-central scalp topography and resembles the Error Positivity (Pe) or the P3a, which is frequently observed in the context of error processing during choice-reaction time tasks (Overbeek et al., 2005) and during the processing of novel or unexpected events (Polich and Kok, 1995; Comerchero and Polich, 1999; Polich, 2007). However, it has also been suggested that the Pe and P300 might actually reflect similar neuronal and functional processes (Overbeek et al., 2005; Ridderinkhof et al., 2009), paralleling the suggestion that the ERN and the novelty-related N2 ERP component share an underlying neural network (Wessel et al., 2012). The latency of the Pe seemed to be less influenced by the performance tempo, but by the presence/absence of auditory feedback: in the condition without auditory feedback, it already occurred around 200 ms and its amplitude was decreased, compared to when auditory feedback was available (Ruiz et al., 2009). This component is probably related to the conscious recognition of an error (“error-awareness hypothesis”, e.g., Nieuwenhuis et al., 2001). In addition, the conscious recognition of an error might also lead to the adaptation of response strategies (“behavior-adaptation hypothesis”, Hajcak et al., 2003), which could be reflected in the post-error slowing after performance errors (Ruiz et al., 2009, 2011; Strübing et al., 2012). Finally, the recognition of errors might also lead to affective responses, including autonomic changes, e.g., in heart and respiration rate, and sweat production (see also the “affective processing hypothesis”, summarized in Overbeek et al., 2005). These changes might be especially pronounced in musicians, considering that their expertise is the product of thousands of hours of deliberate practice (Ericsson et al., 1993; Ericsson and Lehmann, 1996; Sloboda et al., 1996), and they could be particularly obstructive in a concert situation, because increased amounts of sweat might constrain the proper manipulation of the instrument. In addition, these physiological changes might conflict with the emotional aspects of a performance. However, empirical studies investigating the affective responses following performance errors are lacking, and it might be interesting to investigate the various factors, including auditory feedback, modulating possible affective responses.
The ERP effect occurring prior to the execution of performance errors (and before auditory feedback was available) suggests that errors were detected before they were committed. Considering that it is unlikely that fast sequential behaviors such as piano performance are planned and executed element by element (i.e., note by note; see e.g., Lashley, 1951), it is reasonable to assume that also error detection occurs in a predictive manner.
Borrowing from recent models of motor control (Wolpert et al., 1995; Miall and Wolpert, 1996; Wolpert et al., 1998; Desmurget and Grafton, 2000; Wolpert and Ghahramani, 2000), it has been argued that error detection during piano performance is based on internal forward models. These models consist basically of a motor controller, which sends motor commands to an effector, resulting in overt movements. In addition, sensory systems receive for example proprioceptive, tactile, and visual feedback about the ongoing movements. The forward model receives an efference copy of motor commands. Based on learned associations between motor commands and their sensory consequences and the current state of the body, it generates predictions about the next state of the effector as well as about the sensory consequences of a movement. A comparator element identifies if there is a difference between the actual and predicted sensory consequences, and triggers an error signal in case of a mismatch. This error signal can in turn be used for corrective modulation of motor commands and to rapidly correct ongoing actions (for example, in a pointing task, it was reported that participants made corrections to their hand trajectory already 30 ms after start of the movement; van Sonderen et al., 1989). The pre-error slowing and the decreased key press velocity during piano performance errors (Maidhof et al., 2009; Ruiz et al., 2009, 2011; Strübing et al., 2012) might have been the result of this corrective modulation of the motor command.
Although internal forward models provide a theoretical account for the ERP effect prior to performance errors and the behavioral findings, it remained unclear whether the pre-error negativity reflects an error signal itself or is associated to the implementation of behavioral adjustments. This question was investigated by a study that looked at interactions between different brain regions during the commission of errors (Ruiz et al., 2011). More specifically, that study investigated the interaction, in terms of neural oscillatory synchronization, between the posterior frontomedial cortex (pFMC) (particularly the ACC, where the pre-error negativity is presumably generated) and the lateral prefrontal cortex (lPFC). The rationale behind this approach was based on recent theories of action monitoring postulating that these regions interact as part of a dynamic loop during goal-directed behavior, with the pFMC involved in action monitoring, and the lPFC involved in cognitive control (MacDonald et al., 2000; Botvinick et al., 2001; Ridderinkhof et al., 2004). In that view, the ACC detects unfavorable outcomes, conflicts and errors, and signals the need for increased cognitive control to the lPFC, which then implements performance adjustments (Miller, 2000; Cavanagh et al., 2009; Wittfoth et al., 2009). The results of the study by Ruiz et al. (2011) showed increased theta and beta band oscillations prior to errors (and also extending until after errors) over the pFMC. Importantly, the phase synchronization in the beta band (ca. 14–18 Hz) between electrodes F4 and FCZ (corresponding to lPFC and pFMC, respectively) increased around 100 ms prior to errors, and this increase was associated with more efficient corrective mechanisms. The latter was indicated by a positive correlation between the synchronization index and the decrease in loudness of errors, and by a negative correlation between the synchronization index and pre-error slowing. Based on these findings, it was suggested that the error signal is indexed by pre-error beta and theta oscillations of pMFC, and this information is conveyed to the lPFC, which then implements behavioral adjustments (like slowing down the next key press).
Auditory feedback and motor performance
The above summarized findings strongly indicate that auditory feedback is not a prerequisite for the detection of errors committed during music (piano) performances. An interesting question is then what role auditory feedback actually plays during music production. A common approach to study this question is to look at motor performance in response to manipulations of the auditory feedback (in the so-called “altered auditory feedback” paradigm). Motor performance is usually quantified in terms of error rates, IOIs, and timing variability, all of which are conceptualized to represent deviations from the intended performance.
In line with the notion that auditory feedback plays a minor role for error monitoring, several studies showed that the absence of sound had negligible effects on performances of trained pianists (Finney, 1997; Repp, 1999; Finney and Palmer, 2003), as well as on untrained pianists (Pfordresher, 2005). In contrast to these negligible effects on piano performance, it has been shown that error detection and correction crucially depend on the presence of auditory feedback, for example, during cello performances (Chen et al., 2008). On the other hand, specific alterations of feedback can profoundly disrupt piano performance (Finney, 1997; Pfordresher and Palmer, 2002; Pfordresher, 2003; Furuya and Soechting, 2010). Furthermore, there appears to be a dissociation between two components of auditory feedback, namely pitch and timing: pitch manipulations of auditory feedback resulted mainly in higher error rates, but did not influence timing (especially in serial shifts, i.e., when the feedback matches an event intended at a different location in a sequence; Pfordresher, 2003; Pfordresher and Palmer, 2006); in contrast, delays between key press and onset of auditory feedback increased timing variability and IOIs, but error rates were only marginally increased. More specifically, the disruption from feedback delays seems to depend on the relative phase (rhythmic) relationship between keystroke and feedback onset (e.g., Pfordresher and Palmer, 2002; Pfordresher, 2003; Pfordresher and Benitez, 2007; for an account how these sensorimotor associations might be learned, see Pfordresher, 2012).
Recently, there were also some attempts to study the neural mechanisms underlying the processing of auditory feedback manipulations during piano performance. In these studies (Katahira et al., 2008; Maidhof et al., 2010), pianists and participants with no formal music training performed sequences and were provided occasionally (< 5%) with manipulated auditory feedback, so that the pitch of one tone was lowered by one semitone (Maidhof et al., 2010) or shifted up by one semitone (Katahira et al., 2008).
Results showed that ERPs of correct key presses with feedback manipulations, compared to correct key presses with the corresponding correct feedback, elicited a negativity that was maximal around 200 ms after tone onset and showed a fronto-central scalp distribution, and that was present only in musicians. Although termed differently by Katahira et al. (2008), it was argued that this potential reflects mainly a feedback error-related negativity (a potential usually observed after negative performance feedback indicating loss or punishment in time estimation tasks, guessing tasks, and gambling tasks; Miltner et al., 1997; Hajcak et al., 2005, 2007), with potential contribution of MMN/ERAN potentials (Maidhof et al., 2010). The negativity was followed by two positive potentials, resembling the P3a and P3b (or Pe).
Because the perception of manipulated feedback presumably elicits not only action-related processes, but also cognitive processes related to the perception of acoustic deviants, the ERPs during the production of musical sequences were also compared to ERPs elicited during the mere perception of the same stimulus material. Results of this comparison showed that the negative potential is also elicited during perception, but clearly reduced (Katahira et al., 2008; Maidhof et al., 2010). Therefore, it was assumed that similar (expectancy) mechanisms operate during production and perception of music, but that the intention and action of producing a certain auditory effect by performing key presses influences the processing of the unexpected auditory input.
Outlook
This brief review summarized recent investigations into the neural mechanisms underlying error and feedback processing during music performance. The few mentioned studies provided some initial insights; however, because this is a relatively new line of research, many questions remain naturally unsolved. Some of these questions–in the hope that they will motivate further research in this domain–will be addressed in the following.
With regards to error monitoring, information about the kinetic and kinematic features of movements were lacking, and neural correlates could only be related to performance parameters yielded at discrete time points like tone on- and offsets (indicated by the MIDI signal, providing information about when a key was pressed down or released) or key velocities. However, information about different movements or movement stages (e.g., movement onset, touching the surface of a piano key, downward movement during the actual key press) could help to disentangle the different contributions of tactile and proprioceptive feedback for error monitoring processes. Detailed movement data with high spatial and temporal accuracy could be provided by so-called motion capture techniques. Studies using these techniques investigated a variety of research questions, like the role of tactile feedback in timing accuracy during piano and clarinet performance (Goebl and Palmer, 2008; Palmer et al., 2009), disruptive effects of delayed auditory feedback during rhythm production and the role of the ongoing movement trajectory (Pfordresher and Bella, 2011), the effect of tempo on finger kinematics in pianists (Bella and Palmer, 2011), or movements involved in emotional expressions (Livingstone et al., 2009) and as cues for other performers in ensemble performance (e.g., Keller and Appel, 2010). Thus, the simultaneous recording of electrophysiological data and movement data could lead to a more behaviorally informed brain research that could help to answer important questions in the domain of error monitoring (for a setup combining EEG, MIDI, and motion capture for investigating music performance, see Maidhof et al., in press; for a general-purpose setup, see Makeig et al., 2009). Thus, new methodological developments will also advance our understanding of neural processes of error monitoring.
With regards to the nature of performance errors, it has been shown that the frequency and kind of errors are influenced by the musical structure (e.g., musical phrase structure) and underlying planning processes, and that not all errors are equally important for listeners (Palmer and van de Sande, 1993, 1995; Repp, 1996). However, we do not know if the neural correlates of different types of errors occurring in different musical contexts differ from each other. In addition, the neural mechanisms underlying other types of errors such as fingering errors remain elusive. It would thus be interesting to investigate the influence of the musical context on the neural correlates of error processing, and thus to know if the same neural mechanisms underlie different error types occurring in different musical contexts. For example, are errors at phrase boundaries processed differently than errors within phrases, or are there any differences between the neural correlates of errors with different metrical accentuations? How are omission errors (i.e., if a note in the score was not played) processed, given that auditory ERPs can be elicited even when a stimulus is omitted from a regular auditory pattern (so-called omission-evoked potentials), and given that these potentials can be influenced by expectancy and musical training (Jongsma et al., 2005)? Because fingering in piano performance seems to depend, at least partially, also on the metrical and melodic structure (Clarke et al., 1997; Parncutt et al., 1997), it might also be interesting to compare the neural correlates of fingering errors at different positions in a performance. The main question is therefore to reveal any interactions between the error processing system and higher-level processing of musical regularities.
Similarly, with regards to auditory feedback, we do not know if and what influence the musical context and its structure has on the processing of auditory feedback (for example, is auditory feedback of metrically weak notes equally important as metrically strong notes), and it would be interesting to reveal any interactions between the processing of auditory feedback and higher-level musical regularities. This could be achieved by comparing the neural responses to careful manipulations of feedback (of varying sizes in pitch or temporal delay) at different positions within a sequence.
Another topic for further research could be investigations into the affective responses to errors. Although there has been progress studying affective responses during the performing of choice reaction-time tasks (e.g., Fiehler et al., 2003; Hajcak et al., 2003; Critchley et al., 2005), this issue has not yet been investigated for music performance. Furthermore, individual differences in error processing and in affective responses to errors remain elusive.
The ultimate goal would be to arrive at a better understanding of error monitoring and action control during music performance. This knowledge could help to learn how errors during performance could be prevented in the first place, but probably even more important, also to improve skill learning. To reach this goal, a fruitful approach could be to look for similarities to errors in the speech domain. Recently, Hickok (2012) proposed a “hierarchical state feedback control model” of speech production, which is partly based on findings from speech error analysis. These findings indicated a hierarchical organization of speech production, which is similar to findings in music performance (Palmer and van de Sande, 1993, 1995). The speech production model of Hickok (2012) incorporates these hierarchies by postulating multiple levels of control that interact during speech production. Error detection and correction are realized by postulating forward predictions that are compared to auditory and somatosensory feedback. Thus, it is conceivable that a future model of error processing during music performance can benefit from theoretical work in the speech domain.
Finally, music performance is mostly a social situation, with different performers and listeners participating in an interactive situation (for a recent ERP study investigating feedback processing in a piano duet situation, see Loehr et al., 2013; for a study investigating alpha oscillations and empathy in saxophone quartets, see Babiloni et al., 2012; for a review about ensemble music, see Palmer, 2012). Hence, the question for future research will also be if and how models of individual behavior like error monitoring and feedback processing can be applied to such contexts.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was financially supported by the Academy of Finland and the Center for International Mobility (CIMO), Finland.
References
- Babiloni C., Buffo P., Vecchio F., Marzano N., Del Percio C., Spada D., et al. (2012). Brains “in concert”: frontal oscillatory alpha rhythms and empathy in professional musicians. Neuroimage 60, 105–116 10.1016/j.neuroimage.2011.12.008 [DOI] [PubMed] [Google Scholar]
- Beim Graben P., Kurths J. (2003). Detecting subthreshold events in noisy data by symbolic dynamics. Phys. Rev. Lett. 90, 100602 10.1103/physrevlett.90.100602 [DOI] [PubMed] [Google Scholar]
- Bella S. D., Palmer C. (2011). Rate effects on timing, key velocity, and finger kinematics in piano performance. PLoS One 6:e20518 10.1371/journal.pone.0020518 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Botvinick M. M., Braver T. S., Barch D. M., Carter C. S., Cohen J. D. (2001). Conflict monitoring and cognitive control. Psychol. Rev. 108, 624–652 10.3410/f.1000198.3501 [DOI] [PubMed] [Google Scholar]
- Carter C. S., Braver T. S., Barch D. M., Botvinick M. M., Noll D., Cohen J. D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280, 747–749 10.1126/science.280.5364.747 [DOI] [PubMed] [Google Scholar]
- Cavanagh J. F., Cohen M. X., Allen J. J. B. (2009). Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. J. Neurosci. 29, 98–105 10.1523/jneurosci.4137-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen J., Woollacott M. H., Pologe S., Moore G. P. (2008). Pitch and space maps of skilled cellists: accuracy, variability, and error correction. Exp. Brain Res. 188, 493–503 10.1007/s00221-008-1380-2 [DOI] [PubMed] [Google Scholar]
- Clarke E., Parncutt R., Raekallio M., Sloboda J. (1997). Talking fingers: an interview study of pianits’ views on fingering. Music. Sci. 1, 87–107. 10.1177/102986499700100106 [Google Scholar]
- Comerchero M. D., Polich J. (1999). P3a and P3b from typical auditory and visual stimuli. Clin. Neurophysiol. 110, 24–30 10.1016/s0168-5597(98)00033-1 [DOI] [PubMed] [Google Scholar]
- Critchley H. D., Tang J., Glaser D., Butterworth B., Dolan R. J. (2005). Anterior cingulate activity during error and autonomic response. Neuroimage 27, 885–895 10.1016/j.neuroimage.2005.05.047 [DOI] [PubMed] [Google Scholar]
- Debener S., Ullsperger M., Siegel M., Fiehler K., von Cramon D. Y., Engel A. K. (2005). Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 25, 11730–11737 10.1523/jneurosci.3286-05.2005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Desmurget M., Grafton S. (2000). Forward modeling allows feedback control for fast reaching movements. Trends Cogn. Sci. 4, 423–431 10.1016/s1364-6613(00)01537-0 [DOI] [PubMed] [Google Scholar]
- Ericsson K. A., Lehmann A. C. (1996). Expert and exceptional performance: evidence of maximal adaptation to task constraints. Annu. Rev. Psychol. 47, 273–305 10.1146/annurev.psych.47.1.273 [DOI] [PubMed] [Google Scholar]
- Ericsson K. A., Krampe R. T., Tesch-Römer C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 363–406 10.1037//0033-295x.100.3.363 [DOI] [Google Scholar]
- Falkenstein M., Hohnsbein J., Hoormann J., Blanke L. (1990). “Effects of errors in choice reaction tasks on the ERP under focused and divided attention,” in Psychophysiological Brain Research, eds Brunia C. H. M., Gaillard A. W. K., Kok A. (Tilburg, Netherlands: Tilburg University Press; ), 192–195 [Google Scholar]
- Falkenstein M., Hoormann J., Christ S., Hohnsbein J. (2000). ERP components on reaction errors and their functional significance: a tutorial. Biol. Psychol. 51, 87–107 10.1016/s0301-0511(99)00031-9 [DOI] [PubMed] [Google Scholar]
- Fiehler K., Ullsperger M., Grigutsch M., von Cramon D. Y. (2003). “Cardiac responses to error processing and response conflict,” in Errors, Conflict, and the Brain. Current Opinions on Performance Monitoring, eds Ullsperger M., Falkenstein M. (Leipzig: MPI for Human Cognitive and Brain Sciences; ), 135–147 [Google Scholar]
- Finney S. A. (1997). Auditory feedback and musical keyboard performance. Music Percept. 15, 153–174 10.2307/40285747 [DOI] [Google Scholar]
- Finney S. A., Palmer C. (2003). Auditory feedback and memory for music performance: sound evidence for an encoding effect. Mem. Cognit. 31, 51–64 10.3758/bf03196082 [DOI] [PubMed] [Google Scholar]
- Furuya S., Soechting J. F. (2010). Role of auditory feedback in the control of successive keystrokes during piano playing. Exp. Brain Res. 204, 223–237 10.1007/s00221-010-2307-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gehring W. J., Goss B., Coles M. G. H., Meyer D. E., Donchin E. (1993). A neural system for error detection and compensation. Psychol. Sci. 4, 385–390 10.1111/j.1467-9280.1993.tb00586.x [DOI] [Google Scholar]
- Gemba H., Sasaki K., Brooks V. B. (1986). “Error” potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neurosci. Lett. 70, 223–227 10.1016/0304-3940(86)90467-2 [DOI] [PubMed] [Google Scholar]
- Goebl W., Palmer C. (2008). Tactile feedback and timing accuracy in piano performance. Exp. Brain Res. 186, 471–479 10.1007/s00221-007-1252-1 [DOI] [PubMed] [Google Scholar]
- Hajcak G., Holroyd C. B., Moser J. S., Simons R. F. (2005). Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology 42, 161–170 10.1111/j.1469-8986.2005.00278.x [DOI] [PubMed] [Google Scholar]
- Hajcak G., McDonald N., Simons R. F. (2003). To err is autonomic: error-related brain potentials, ANS activity, and post-error compensatory behavior. Psychophysiology 40, 895–903 10.1111/1469-8986.00107 [DOI] [PubMed] [Google Scholar]
- Hajcak G., Moser J. S., Holroyd C. B., Simons R. F. (2007). It’s worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology 44, 905–912 10.1111/j.1469-8986.2007.00567.x [DOI] [PubMed] [Google Scholar]
- Herrmann M. J., Römmler J., Ehlis A.C., Heidrich A., Fallgatter A. J. (2004). Source localization (LORETA) of the error-related-negativity (ERN/Ne) and positivity (Pe). Brain Res. Cogn. Brain Res. 20, 294–299 10.1016/j.cogbrainres.2004.02.013 [DOI] [PubMed] [Google Scholar]
- Hickok G. (2012). Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13, 135–145 10.1038/nrn3158 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holroyd C. B., Coles M. G. H. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679–709 10.1037//0033-295x.109.4.679 [DOI] [PubMed] [Google Scholar]
- Holroyd C. B., Dien J., Coles M. G. (1998). Error-related scalp potentials elicited by hand and foot movements: evidence for an output-independent error-processing system in humans. Neurosci. Lett. 242, 65–68 10.1016/s0304-3940(98)00035-4 [DOI] [PubMed] [Google Scholar]
- Jongsma M. L., Eichele T., Quian Quiroga R., Jenks K. M., Desain P., Honing H., et al. (2005). Expectancy effects on omission evoked potentials in musicians and non-musicians. Psychophysiology 42, 191–201 10.1111/j.1469-8986.2005.00269.x [DOI] [PubMed] [Google Scholar]
- Katahira K., Abla D., Masuda S., Okanoya K. (2008). Feedback-based error monitoring processes during musical performance: an ERP study. Neurosci. Res. 61, 120–128 10.1016/j.neures.2008.02.001 [DOI] [PubMed] [Google Scholar]
- Keller P. E., Appel M. (2010). Individual differences, auditory imagery, and the coordination of body movements and sounds in musical ensembles. Music Percept. 28, 27–46 10.1525/mp.2010.28.1.27 [DOI] [Google Scholar]
- Lashley K. S. (1951). “The problem of serial order in behavior,” in Cerebral Mechanisms in Behavior, ed Jeffress L. A. (New York: Wiley; ), 112–136 [Google Scholar]
- Livingstone S. R., Thompson W. F., Russo F. A. (2009). Facial expressions and emotional singing: a study of perception and production with motion capture and electromyography. Music Percept. 26, 475–488 10.1525/mp.2009.26.5.475 [DOI] [Google Scholar]
- Loehr J., Kourtis D., Vesper C. (2013). Monitoring individual and joint action outcomes in duet music performance. J. Cogn. Neurosci. 25, 1049–1061 10.1162/jocn_a_00388 [DOI] [PubMed] [Google Scholar]
- MacDonald A. W., Cohen J. D., Stenger V. A., Carter C. S. (2000). Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 288, 1835–1838 10.1126/science.288.5472.1835 [DOI] [PubMed] [Google Scholar]
- Maidhof C., Kästner T., Makkonen T. Combining EEG, MIDI, and motion capture techniques for investigating musical performance. Behav. Res. Methods10.3758/s13428-013-0363-9 [DOI] [PubMed] [Google Scholar]
- Maidhof C., Rieger M., Prinz W., Koelsch S. (2009). Nobody is perfect: ERP effects prior to performance errors in musicians indicate fast monitoring processes. PLoS One 4:e5032 10.1371/journal.pone.0005032 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maidhof C., Vavatzanidis N., Prinz W., Rieger M., Koelsch S. (2010). Processing expectancy violations during music performance and perception: an ERP study. J. Cogn. Neurosci. 22, 2401–2413 10.1162/jocn.2009.21332 [DOI] [PubMed] [Google Scholar]
- Makeig S., Gramann K., Jung T.-P., Sejnowski T. J., Poizner H. (2009). Linking brain, mind and behavior. Int. J. Psychophysiol. 73, 95–100 10.1016/j.ijpsycho.2008.11.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miall R. C., Wolpert D. M. (1996). Forward models for physiological motor control. Neural Netw. 9, 1265–1279 10.1016/s0893-6080(96)00035-4 [DOI] [PubMed] [Google Scholar]
- Miller E. K. (2000). The prefrontal cortex and cognitive control. Nat. Rev. Neurosci. 1, 59–65 10.1038/35036228 [DOI] [PubMed] [Google Scholar]
- Miltner W. H. R., Braun C. H., Coles M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a “generic” neural system for error detection. J. Cogn. Neurosci. 9, 788–798 10.1162/jocn.1997.9.6.788 [DOI] [PubMed] [Google Scholar]
- Nieuwenhuis S., Ridderinkhof K. R., Blom J., Band G. P., Kok A. (2001). Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. Psychophysiology 38, 752–760 10.1111/1469-8986.3850752 [DOI] [PubMed] [Google Scholar]
- Overbeek T. J. M., Nieuwenhuis S., Ridderinkhof K. R. (2005). Dissociable components of error processing. J. Psychophysiol. 19, 319–329 10.1027/0269-8803.19.4.319 [DOI] [Google Scholar]
- Palmer C. (1997). Music performance. Annu. Rev. Psychol. 48, 115–138 10.1146/annurev.psych.48.1.115 [DOI] [PubMed] [Google Scholar]
- Palmer C. (2005). Sequence memory in music performance. Curr. Dir. Psychol. Sci. 14, 247–250 10.1111/j.0963-7214.2005.00374.x [DOI] [Google Scholar]
- Palmer C. (2012). “Music performance: movement and coordination,” in The Psychology of Music, 3rd Edn. ed Deutsch D. (Amsterdam, Netherlands: Elsevier Press; ), 405–422 [Google Scholar]
- Palmer C., Pfordresher P. Q. (2003). Incremental planning in sequence production. Psychol. Rev. 110, 683–712 10.1037/0033-295x.110.4.683 [DOI] [PubMed] [Google Scholar]
- Palmer C., van de Sande C. (1993). Units of knowledge in music performance. J. Exp. Psychol. Learn. Mem. Cogn. 19, 457–470 10.1037//0278-7393.19.2.457 [DOI] [PubMed] [Google Scholar]
- Palmer C., van de Sande C. (1995). Range of planning in music performance. J. Exp. Psychol. Hum. Percept. Perform. 21, 947–962 10.1037//0096-1523.21.5.947 [DOI] [PubMed] [Google Scholar]
- Palmer C., Koopmans E., Loehr J. D., Carter C. (2009). Movement-related feedback and temporal accuracy in clarinet performance. Music Percept. 26, 439–449 10.1525/mp.2009.26.5.439 [DOI] [Google Scholar]
- Parncutt R., Sloboda J. A., Clarke E. F., Raekallio M., Desain P. (1997). An ergonomic model of keyboard fingering for melodic fragments. Music Percept. 14, 341–382 10.2307/40285730 [DOI] [Google Scholar]
- Pfordresher P. (2003). Auditory feedback in music performance: evidence for a dissociation of sequencing and timing. J. Exp. Psychol. Hum. Percept. Perform. 29, 949–964 10.1037/0096-1523.29.5.949 [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q. (2005). Auditory feedback in music performance: the role of melodic structure and musical skill. J. Exp. Psychol. Hum. Percept. Perform. 31, 1331–1345 10.1037/0096-1523.31.6.1331 [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q. (2006). Coordination of perception and action in music performance. Adv. Cogn. Psychol. 2, 183–198 10.2478/v10053-008-0054-8 [DOI] [Google Scholar]
- Pfordresher P. Q. (2012). Musical training and the role of auditory feedback during performance. Ann. NY Acad. Sci. 1252, 171–178 10.1111/j.1749-6632.2011.06408.x [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q., Benitez B. (2007). Temporal coordination between actions and sound during sequence production. Hum. Mov. Sci. 26, 742–756 10.1016/j.humov.2007.07.006 [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q., Bella S. D. (2011). Delayed auditory feedback and movement. J. Exp. Psychol. Hum. Percept. Perform. 37, 566–579 10.1037/a0021487 [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q., Palmer C. (2002). Effects of delayed auditory feedback on timing of music performance. Psychol. Res. 66, 71–79 10.1007/s004260100075 [DOI] [PubMed] [Google Scholar]
- Pfordresher P. Q., Palmer C. (2006). Effects of hearing the past, present, or future during music performance. Percept. Psychophys. 68, 362–376 10.3758/bf03193683 [DOI] [PubMed] [Google Scholar]
- Polich J. (2007). Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol. 118, 2128–2148 10.1016/j.clinph.2007.04.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Polich J., Kok A. (1995). Cognitive and biological determinants of P300: an integrative review. Biol. Psychol. 41, 103–146 10.1016/0301-0511(95)05130-9 [DOI] [PubMed] [Google Scholar]
- Rabbitt P. (1978). Detection of errors by skilled typists. Ergonomics 21, 945–958 10.1080/00140137808931800 [DOI] [Google Scholar]
- Repp B. H. (1996). The art of inaccuracy: why pianists’ errors are difficult to hear. Music Percept. 14, 161–184 10.2307/40285716 [DOI] [Google Scholar]
- Repp B. H. (1999). Effects of auditory feedback deprivation on expressive piano performance. Music Percept. 16, 409–438 10.2307/40285802 [DOI] [Google Scholar]
- Ridderinkhof K. R., Ramautar J. R., Wijnen J. G. (2009). To Pe or not to Pe: a P3-like ERP component reflecting the processing of response errors. Psychophysiology 46, 531–538 10.1111/j.1469-8986.2009.00790.x [DOI] [PubMed] [Google Scholar]
- Ridderinkhof K. R., Ullsperger M., Crone E. A., Nieuwenhuis S. (2004). The role of the medial frontal cortex in cognitive control. Science 306, 443–447 10.1126/science.1100301 [DOI] [PubMed] [Google Scholar]
- Ruiz M. H., Jabusch H.-C., Altenmüller E. (2009). Detecting wrong notes in advance: neuronal correlates of error monitoring in pianists. Cereb. Cortex 19, 2625–2639 10.1093/cercor/bhp021 [DOI] [PubMed] [Google Scholar]
- Ruiz M. H., Strübing F., Jabusch H.C., Altenmüller E. (2011). EEG oscillatory patterns are associated with error prediction during music performance and are altered in musician’s dystonia. Neuroimage 55, 1791–1803 10.1016/j.neuroimage.2010.12.050 [DOI] [PubMed] [Google Scholar]
- Sloboda J. A., Davidson J. W., Howe M. J. A., Moore D. G. (1996). The role of practice in the development of performing musicians. Br. J. Psychol. 87, 287–309 10.1111/j.2044-8295.1996.tb02591.x [DOI] [Google Scholar]
- Strübing F., Ruiz M. H., Jabusch H. C., Altenmüller E. O. (2012). Error monitoring is altered in musician’s dystonia: evidence from ERP-based studies. Ann. NY Acad. Sci. 1252, 192–199 10.1111/j.1749-6632.2011.06417.x [DOI] [PubMed] [Google Scholar]
- Taylor S. F., Stern E. R., Gehring W. J. (2007). Neural systems for error monitoring: recent findings and theoretical perspectives. Neuroscientist 13, 160–172 10.1177/1073858406298184 [DOI] [PubMed] [Google Scholar]
- Ullsperger M., von Cramon D. Y. (2001). Subprocesses of performance monitoring: a dissociation of error processing and response competition revealed by event-related fMRI and ERPs. Neuroimage 14, 1387–1401 10.1006/nimg.2001.0935 [DOI] [PubMed] [Google Scholar]
- van Sonderen J. F., Gielen C. C. A. M., Van der Gon J. J. D. (1989). Motor programmes for goa-directed movements are continously adjusted according to changes in target location. Exp. Brain Res. 78, 139–146 10.1007/bf00230693 [DOI] [PubMed] [Google Scholar]
- van Veen V., Carter C. (2006). Error detection, correction, and prevention in the brain: a brief review of data and theories. Clin. EEG Neurosci. 37, 330–335 10.1177/155005940603700411 [DOI] [PubMed] [Google Scholar]
- van Veen V., Carter C. S. (2002). The timing of action-monitoring processes in the anterior cingulate cortex. J. Cogn. Neurosci. 14, 593–602 10.1162/08989290260045837 [DOI] [PubMed] [Google Scholar]
- van Veen V., Cohen J. D., Botvinick M. M., Stenger V. A., Carter C. S. (2001). Anterior cingulate cortex, conflict monitoring, and levels of processing. Neuroimage 14, 1302–1308 10.1006/nimg.2001.0923 [DOI] [PubMed] [Google Scholar]
- Wessel J. R., Danielmeier C., Morton J. B., Ullsperger M. (2012). Surprise and error: common neuronal architecture for the processing of errors and novelty. J. Neurosci. 32, 7528–7537 10.1523/jneurosci.6352-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wittfoth M., Schardt D. M., Fahle M., Herrmann M. (2009). How the brain resolves high conflict situations: double conflict involvement of dorsolateral prefrontal cortex. Neuroimage 44, 1201–1209 10.1016/j.neuroimage.2008.09.026 [DOI] [PubMed] [Google Scholar]
- Wolpert D. M., Ghahramani Z. (2000). Computational principles of movement neuroscience. Nat. Neurosci. 3(Suppl), 1212–1217 10.1038/81497 [DOI] [PubMed] [Google Scholar]
- Wolpert D. M., Ghahramani Z., Jordan M. I. (1995). An internal model for sensorimotor integration. Science 269, 1880–1882 10.1126/science.7569931 [DOI] [PubMed] [Google Scholar]
- Wolpert D. M., Miall R. C., Kawato M. (1998). Internal models in the cerebellum. Trends Cogn. Sci. 2, 338–347 10.1016/S1364-6613(98)01221-2 [DOI] [PubMed] [Google Scholar]
