Abstract
Motor resonance mechanisms are known to affect humans' ability to interact with others, yielding the kind of “mutual understanding” that is the basis of social interaction. However, it remains unclear how the partner's action features combine or compete to promote or prevent motor resonance during interaction. To clarify this point, the present study tested whether and how the nature of the visual stimulus and the properties of the observed actions influence observer's motor response, being motor contagion one of the behavioral manifestations of motor resonance. Participants observed a humanoid robot and a human agent move their hands into a pre-specified final position or put an object into a container at various velocities. Their movements, both in the object- and non-object- directed conditions, were characterized by either a smooth/curvilinear or a jerky/segmented trajectory. These trajectories were covered with biological or non-biological kinematics (the latter only by the humanoid robot). After action observation, participants were requested to either reach the indicated final position or to transport a similar object into another container. Results showed that motor contagion appeared for both the interactive partner except when the humanoid robot violated the biological laws of motion. These findings suggest that the observer may transiently match his/her own motor repertoire to that of the observed agent. This matching might mediate the activation of motor resonance, and modulate the spontaneity and the pleasantness of the interaction, whatever the nature of the communication partner.
Introduction
It is well known that movement observation has measurable effects on the observer's motor system, and that these are attributable to the activation of mirror neuron circuits [1]. These brain areas give rise to a series of “resonance behaviors” in which, during the observation of actions performed by others, motor representation congruent with the observed actions becomes automatically activated in the observers' brain [2]. In such a context, if the motor system is prepared to produce a motor response to the observed motion, this might result in motor contagion: namely, the observer's motor performance might automatically replicate some features of the stimulus. Since motor resonance was proposed to affect humans' ability to interact with others, yielding the kind of “mutual understanding” at the basis of social interaction [3], [4], several behavioral, neurophysiological and neuroimaging studies have dealt with this matter. However, it remains still unclear how different action features combine/compete to promote or prevent motor resonance, and specifically motor contagion (for a review see [5]).
Indeed, when observing a moving agent there are several sources of information that can influence the observer's motor response (for a review on bottom-up and top-down effects see [6]). The nature of the observed agent in its physical appearance might affect on the way people react to his/her actions. For instance, whether a mechanical device (e.g., a robot) is able to evoke motor resonance has been a source of debate. Early studies on the mirror neurons system in the monkey [7], [8] and behavioral [9] and neuroimaging findings in humans [10] suggest that only biological stimuli evoke motor resonance. However, recent neuroimaging, neurophysiological and behavioral experiments contradicted these results by showing that the observation of human and robotic movements induced comparable neural activations [11], [12] and behavioral motor responses [13]. A more subtle explanation going beyond the simple physical appearance of the agent was tested by a series of studies that compared the interference effect measured during the interaction with either a human agent or a robotic arm. These works suggested that motor priming is modulated by the attribution of a social intention to the interactive agent: an attribution that is feasible in the case of a human partner but is precluded when interacting with a robot [14], [15]. However, the robot employed in these experiments was a simple robotic hand wearing a glove and mounted on a metal frame. Thus the stimulus was perhaps not sufficiently humanoid to trigger motor resonance and consequent modulation of motor behavior.
There are other elements of an action that might play a role in making interaction smooth or awkward. Indeed, actions can be described on at least two levels: by considering their meaning (the goal of the action) or their kinematic properties (the features of the movement itself).
The action meaning can be seen as a high level property, which may vary according to the presence or the absence of an object during motion – object-directedness. Behavioral studies on humans showed that when the observed action was goal oriented, participants naturally focused on and imitated its goal, rather than other action features such as movement kinematics [16]. Indeed, it seems that the presence or absence of objects as goals of the movement has a decisive influence on imitation behavior [17]. In particular, goal-oriented movements seem to be imitated correctly with respect to the goal, but the movement itself is frequently ignored [18], [19]. However, other studies contradicted these results by showing that even in the presence of goal objects, participants focused on the motor components of the actions [20]–[22]. Furthermore, daily-life activities often imply actions that have to be considered for both their goal and motion components. For instance, when a person gives an object to another person, the latter has to focus on the object (i.e., the goal), but also on the temporal components of the giver's movement (i.e., kinematics), so as to be ready to receive the object. Therefore, disregarding the kinematic features of an action in favor of its goal may not always be optimal. Nevertheless, no agreement was reached on the relative contributions of movement goal and kinematics when reacting to an observed movement.
Moving to a low-level action representation, movement kinematics, such as the velocity profile and the trajectory of the limb, might also vary the degree of motor resonance evoked in the observer. Previous researches have shown that an impoverished visual display of motion (i.e., a single dot) was sufficient to help participants to infer the missing part of an observed trajectory [23] and to evoke motor contagion in the observers' motor response [24], but only when it moved according to the biological laws of motion. A functional magnetic resonance imaging (fMRI) study failed to find increased metabolic response in the conventional mirror neuron areas during the observation or imitation of finger movements as opposed to a dot moving with the same velocity profile [25]. This result suggests that either the paradigm was not the most appropriate to unveil the differences between the two stimuli (as suggested by the authors) or that the biological velocity profile was sufficient to elicit the same neural activity as the moving finger. Conversely, the efficacy of a biologically plausible velocity profile to evoke motor resonance with a robotic device was supported by neuroimaging investigations showing that non-living agents, such as industrial robots, moving with an artificial constant velocity evoke the same neural response generated by natural human movement observation [11]. Although an interesting and detailed review suggested that a biological origin of the observed agent is a crucial factor to activate the action-observation network [26], the need of the observer to recognize his/her motor repertoire in the observed visual model still needs to be clarified.
A further low-level action property is represented by movement shape, i.e., the geometrical shape of the trajectory of the effector. Human actions are characterized by smooth, curved shapes, while robotic motion is typically thought of as jerky and squared. How much the trajectory shape should correspond to the nature of the moving demonstrator to evoke motor resonance in the observer is poorly documented. To the best of our knowledge only one study tested this factor by means of neuroimaging techniques, showing that the action-observation network is substantially activated by the observation of artificial movement shape, irrespective of the nature of the agent [27].
The goal of the present study was to investigate how the nature of the observed agent, the object-directedness, and the kinematic properties of the observed movement influence a human observer when interacting with an external agent. To this aim a humanoid robot and a human agent were monitored by the participant while performing transitive or intransitive actions, characterized by either a smooth-curvilinear or a jerky-artificial trajectory, and following biological kinematics. Furthermore, by using a humanoid robot, we could include an additional condition in which the robot moved with a non-biological velocity profile. Thus, we were able to test the role of correspondence between the internal motor repertoire of the observer and the one exhibited by the demonstrator. Participants were requested either to move their hands into a pre-specified final position or to put an object into a container after they had seen the demonstrator performing the same task at various execution velocities. We measured the degree of motor contagion (i.e., how much participants' velocity was affected by demonstrator' velocity), considering that the more motor resonance is evoked, the more participants' motor response is influenced by the observed motion [24], [28]. If the activation of the motor resonance mechanisms relies mostly on the possibility to match the observer's motor repertoire with that of the visual model, motor contagion will appear in all conditions, irrespective of the nature of the demonstrator (human/robot) and the shape of the covered trajectory (smooth-curvilinear/jerky-artificial), but will be absent when the demonstrator exhibits non-biological kinematics. Furthermore, if the presence of an object as action goal induces participants to ignore movement kinematics, then participants' velocities will not be modulated by the demonstrator's velocity during the observation of transitive (i.e., object-directed) actions.
Materials and Methods
Participants
A total of 28 healthy young adults (10 women, age 24.4±6, mean±SD) took part in the experiments. The population was split into two groups (14 participants per group, randomly assigned): one group observed the human demonstrator (H; 6 women, mean age ±SD = 22.7±2.4), whereas the other group observed movements performed by a humanoid robot (R; 4 women, mean age ±SD = 26.3±7.9). Since one participant of the H group did not perform all the experimental conditions, her data were not included in the analysis. Consequently, the H group was composed of 13 participants. An independent t-test on the age of the two groups did not find any significant difference. All participants were right-handed according to an informal interview, and had normal or corrected-to-normal vision. Written informed consent was obtained from each participant in the study, which was approved by the local ethics committee ASL-3 (“Azienda Sanitaria Locale”, local health unit), Genoa, and was in agreement with the Helsinki Declaration of 1975, as revised in 1983. The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these pictures.
Apparatus
The experiment took place in a large room. The participant and the demonstrator (robot or human) were oriented toward a wall to avoid possible disturbance that might occur during the study. Two blue cardboards squares (area: 4 cm2) were placed about 5 cm from the border of a table to indicate the starting movement position of the demonstrator and the participant. The table was covered in black fabric. Two blue cardboards circles, 13 cm in diameter, indicated participant's and demonstrator's motion end positions. The need to precisely reach the final position was not emphasized to prevent movement final adjustments. The distance between the centres of the square and the circle was fixed at 20 cm. This distance was determined by the motor constraints of the robot in the sagittal plane, since 20 cm represented the maximum length the robot could cover with very limited trunk displacement.
Participants were seated on a chair at the table in a comfortable position. They were sufficiently close to the table to move their arm from their start to their end position in an unrestrained manner. To guarantee that participants paid attention only to demonstrator's arm kinematics and not to other cues, such as gaze direction, a black curtain was placed between participant and demonstrator. Curtain height was adjusted for each participant so that he/she could see only the right arm of the demonstrator, while the face was hidden from view (Figure 1). Participants were seated on the right side of the demonstrator. This position was selected to allow the subject to appreciate the kinematic features of the reaching movement (especially the shape and the velocity profile) that evolved mostly in the sagittal plane.
A VICON Motion Capture System with six infrared cameras fixed on appropriate steel structure mounted on the wall (minimum and maximum linear distances from the table: 2 and 3.5 m) was used to record the demonstrator's and participant's movements at a sampling frequency of 100 Hz. The demonstrator's and participant's hands were kept in a palm down position throughout the experiment. One passive infrared reflective marker (diameter 9.5 mm) was applied to the back of the right hand of the participant and the demonstrator (Figure 1). In particular, the marker was positioned between the first and the second metacarpal bones, just above the metacarpophalangeal joint. This location was chosen by taking into account the robot structural features.
Experimental paradigm
To consider whether the nature of the agent is a crucial factor to evoke motor contagion, participants observed a human agent and a humanoid robot during the execution of reaching movements performed with the right upper limb (Figure 1). The two demonstrators covered both smooth-curvilinear (SC) and jerky-segmented (JS) trajectories to test the role of motion shape (Figure 2). Additionally, in order to assess whether and how the presence of an object as goal for the reaching task influences motor resonance, the previously described movements were either intransitive (I) or transitive (T). In the Intransitive condition both the human demonstrator and the humanoid robot performed a hand displacement from the start to the end position, while in the Transitive task they moved a plastic octopus from the start position into a toy fishpond. Finally, the role of the observed movement kinematics in motion contagion was tested by letting the humanoid robot move according to biological (B) or non-biological (NB) laws of motion (see paragraph Stimuli for more details). Since it is not possible for a human agent to violate the biological laws of motion, the NB condition was tested only for the humanoid robot.
The participant was requested “to observe the demonstrator's movement and, when it/she stopped, to move the hand into the blue circle in front of her/him” in Intransitive condition. In the Transitive condition two plastic octopuses were placed over the starting squares and two blue plastic plates covered the final circles in front of both the demonstrator and the participant. Here the participant was requested “to observe the demonstrator's movement and, when it/she stopped, to move the octopus into the fishpond in front of her/him”. Participant's reaching movements ought to be one shot (i.e., without final adjustments or intermediate stops) and mainly occurred in the sagittal plane, as those of the two visual models. Each experimental condition was run in separate blocks and in each of them the stimulus moved at three different velocities: Slow, Medium and Fast (S, M, F).
Trajectory (SC, JS), Object-Directedness (I, T) and Velocity (S, M, F) were considered as sources of variability, resulting in a total of 120 trials (10 replications per each velocity) for each stimulus (Group: H, R). Since the R group performed an additional condition, namely the observation of non-biological movement kinematics over a curvilinear trajectory with three velocities (30 movements, for a total of 150 trials), Kinematics (B, NB) was a further source of variability only for R group.
Participants paused for at least one minute after a block of 30 trials, or as desired. The experimenter reminded participants of the instructions after each pause. The order of execution of the experimental conditions was counterbalanced in both groups, and inside each condition the 10 repetitions of the stimulus velocities occurred randomly.
Stimuli
During the observation of the human demonstrator the person who acted as model was a woman and was the same in all the experiments. She was previously trained to make movements at three different velocities. In order to reduce variability in her movement duration, she wore a headphone connected to a PC on which a MATLAB code generated a rhythmic “beep”. This informed her on the movement duration she had to produce in each trial.
The robot used as a stimulus in this work was iCub [29], a humanoid model developed as part of the EU project RobotCub. It is approximately 1m tall with the appearance of a 3.5 year old child. To produce robot biological hand movements (B), we recorded the human demonstrator's reaching movements while covering both smooth-curvilinear and jerky-segmented trajectories at three different velocities. To design the non-biological (NB) robot movements we started from B movements and we made the velocity profile reach a maximum after a very brief initial acceleration phase, and remain approximately constant for a minimum of 1 s, before rapidly decelerating. The non-biological motion was intransitive (I) and characterized by a curvilinear shape (SC). It is worth noting that if the jerky-segmented trajectory was an unusual, but human-feasible movement, in the non-biological condition the robot violated the biological laws of motion, though covering a smooth-curvilinear path.
To evaluate the possible differences among the movements of the two demonstrators in different conditions [30], which could in turn affect participants' motor response, we statistically compared the robot and human demonstrator's total movement duration, mean and maximum velocities, minimum and maximum accelerations, length and maximum height of the trajectory. The latter parameters refer to spatial components of the movement, whereas the previous ones provide a temporal description of the motions of the demonstrators. ANOVAs with Trajectory (2 levels, SC and JS), Object-Directedness (2 levels, I and T), and Velocity (3 levels, S, M and F) as within-subjects factors, and Group (2 levels, R and H) as between-subjects factor were applied on these kinematic parameters. Statistically significant differences were found between the two demonstrators in all the mentioned parameters.
The mean values of these parameters over the 10 repetitions in each experimental condition (2 Trajectory ×2 Meaning ×3 Velocities for participants of the two Groups –13 for H and 14 for iC) were submitted to a principal component analysis (PCA) to deeply investigate the source of differences between the two demonstrators. Results indicated that the first two components accounted for the 90% (72% and 18%, respectively) of the variance. The coefficients for the first two components are reported in the Table 1.
Table 1. Coefficients of the kinematic parameters for the first two components.
Component 1 | Component 2 | |
Movement duration | −0.39 | −0.04 |
Mean velocity | 0.43 | −0.14 |
Max velocity | 0.42 | −0.25 |
Max acceleration | 0.43 | −0.16 |
Min acceleration | −0.43 | 0.15 |
Trajectory length | −0.15 | −0.76 |
Trajectory height | −0.29 | −0.54 |
The first component had a positive coefficient (≥.30) for mean and maximum velocities and maximum acceleration, whereas a negative component for movement duration and minimum acceleration. The path length and the trajectory height weighted substantially on the second component. These results suggested that the first component was strongly connected to the temporal features of demonstrators' movements, whereas the second component was related to its spatial features. We performed univariate ANOVAs to compare the two types of stimuli with respect to the two kinematic components. The effect of the stimulus type was significant for both components (Component 1: F(1,322) = 301.73, p<<0.01; Component 2: F(1,322) = 47.69, p<<0.01).
Data treatment
Kinematic analysis
Kinematic data were low-pass filtered at 5 Hz using a 2nd order Butterworth filter. To define the onset and end of the movement, we chose a threshold corresponding to 2% of the maximum value of the movement velocity profile. The same processing method was applied to analyse the movements of the participants and the stimuli.
To quantify the occurrence of motor contagion we used the same procedure already applied in our previous studies [24], [28] and we considered movement mean velocity (V) as outcome parameter. Thus, we tested if the velocity of the visual model influenced participants' velocity. In each experimental condition participants and models' V were obtained by averaging mean movement velocity over the 10 repetitions.
Statistical analysis
The statistical analysis on demonstrators' mean movement velocities revealed that the interactions Group*Object-Directedness*Velocity (F2,50 = 4.4, p<0.05) and Group*Trajectory*Velocity (F2,50 = 53.61, p<0.01) were statistically significant. For the complete results of the statistical analysis please see Table 2. To summarize the results of the Post-Hoc comparisons applied to the previously significant interactions, we will report hereafter only the data that were useful to plan the statistical analysis of participants' performance. Smooth-curvilinear movement trajectories were always faster than jerky-segmented trajectories (VSC>VJR, p<<0.01) for both agents. Furthermore, the human demonstrator's mean velocities were always significantly higher than the robot velocities for both trajectories (VH>VR, p<<0.01) at each speed level (S, M and F). Therefore, to account for the differences in stimulus velocities, participants' motor responses were classified on the basis of Group (R and H) and Trajectory (SC and JS), for a total of four repeated-measures ANOVAs (R-SC, R-JS and H-SC, H-JS) with Object-Directedness and Velocity as factors.
Table 2. Results of the statistical analyses comparing human and robotic demonstrators' movement velocities.
Mixed-design ANOVA on demonstrators' V | Newman-Keuls post hoc |
R-I < H-I for S, M and F, p<0.001 | |
Velocity*Object-Directedness*Group | R-T < H-T for S, M and F, p<0.01 |
F2,50 = 4.4, p<0.05 | H-T < H-I for S, M and F, p<0.001 |
R-T and R-I for S, M and F, Not significant | |
Group*Trajectory*Velocity | R-SC < H-SC for S, M and F, p<0.001 |
F2,50 = 53.61, p<0.01 | R-JS < H-JS for S, M and F, p<0.001 |
The results of the mixed-design ANOVA on human (H) and robotic (R) demonstrators' mean movement velocities. On the left the interactions among the within-subject factors Velocity, Trajectory and Object-Directedness and the between-subject factor Group. On the right the result of the Newman-Keuls post-hoc comparisons focused on the differences between human and robotic movements performing transitive (T) and intransitive (I) motions, while covering smooth-curvilinear (SC) and jerky-segmented (JS) trajectories at different velocities (Slow, Medium and Fast).
Four repeated-measures ANOVAs – with Object-Directedness (2 levels, I and T) and Velocity (3 levels, S, M and F) as within-subjects factors – were applied on participants' mean movement velocity to assess whether motor contagion appeared when observing the robotic and the human demonstrator performing smooth-curvilinear and jerky-segmented trajectories.
Moreover, since in the case of motor contagion demonstrator's and participant's velocities varied coherently, for each participant a linear regression model was applied to illustrate the relationship between the observed and the performed movement mean velocities. The slopes of the model were considered as a percentage of contagion: 0 meant no modulation, while 1 referred to the perfect reproduction of the velocity of the observed action. Slope values were mainly used to compare the effects induced by motion observation on participants' responses, regardless of the differences in stimulus mean velocities. The statistical evaluation was obtained by means of a mixed-design ANOVA (Group as between-subject factor, Trajectory and Object-Directedness as within subject factors).
A repeated-measure ANOVA (with three levels of the factor Velocity) was performed on participants' mean movement velocities after the observation of the humanoid robot non-biological movement kinematics. The slopes of the regression lines obtained for each participant after non-biological and biological movement observation were statistically evaluated by means of a paired t-test to assess whether movement kinematics affected motor contagion mechanisms.
Significant interactions were always interpreted with Post-Hoc Newman-Keuls comparisons.
Results
Observers' movements were influenced by both human and robotic actions
From a graphical inspection of Figure 3 it appears evident that participants' velocities varied consistently with stimulus velocities.
This was confirmed by the result of the statistical analysis on participants' mean movement velocities, which found a significant effect of the factor Velocity for both demonstrators and trajectories (see Table 3). Furthermore, a significant effect of Object-Directedness appeared when the robot moved along a smooth-curvilinear trajectory: i.e., participants' velocities were higher in the intransitive than in transitive condition. A significant interaction between Velocity and Object-Directedness was found only when observing the human demonstrator performing smooth trajectories. In particular, post hoc analysis showed that in the transitive condition the three movement velocities differed from each other (VS<VM<VF, p<0.01), whereas in the intransitive condition, VS was found to be significantly lower than VM and VF (p<0.01 in both cases).
Table 3. Results of the statistical analyses on the participants' mean velocity values (VP) in the different experimental conditions.
Curvilinear trajectory | Segmented trajectory | ||
Humanoid robot | Velocity | F2,26 = 12.38, p<0.01 | F2,26 = 3.96, p<0.05 |
Object-Directedness | F1,13 = 7.53, p<0.05 | Not significant | |
Velocity*Object-Directedness | Not significant | Not significant | |
Human demonstrator | Velocity | F2,24 = 18.83, p<0.01 | F2,24 = 14.84, p<0.01 |
Object-Directedness | Not significant (p = 0.066) | Not significant (p = 0.055) | |
Velocity*Object-Directedness | F2,24 = 8.08, p<0.01 | Not significant |
To account for the differences in stimuli mean velocities a total of four repeated-measures ANOVAs were applied on VP when observing the humanoid robot and the human demonstrator performing transitive and intransitive actions, while covering a smooth-curvilinear and jerky-segmented trajectories at different velocities.
Additionally, since the human demonstrator's velocity was found to be significantly higher when performing intransitive than transitive movements (p<0.01), to avoid any effect of this difference on participants' responses, we separately assessed the effect of Velocity in the transitive and intransitive conditions. Thus, we performed four additional ANOVAs (SC-T, SC-I, JS-T, JS-I) with Velocity as a unique factor. Results showed that participants' velocities varied coherently with stimulus velocities in each condition (always p<0.01).
The statistical analysis on the slopes of the regression lines that modeled the relationship between demonstrator's and participants' V values in each experimental condition revealed only a significant Meaning*Group interaction (F1,25 = 11.15, p<0.01). In particular, post-hoc analysis showed that, when observing the human demonstrator, motor contagion increased significantly in transitive condition with respect to the intransitive task (p<0.05) (see Figure 4). Instead, no specific differences appeared between H and R for both Meaning conditions.
Participants' movement velocity was not modulated by the observation of the humanoid robot when it moved with non-biological kinematics
The role of the observed movement kinematics in speed contagion was evaluated. Since making the human demonstrator move according to a non-biological kinematics was not feasible, this analysis was performed only for the observation of the humanoid robot. Hence, the robot was programmed to move according to a biological (B) or non-biological (NB) law of motion (Figure 5A). Since the robot moved at different mean velocities in B and NB (Kinematics: F(1,13) = 470.08, p<<0.01), two separate one-way ANOVAs were employed to statistically evaluate participants' responses to B and NB kinematics observation.
When looking at biological motion, participants modulated their motor response coherently with stimulus velocity (Velocity: F2,26 = 13.9, p<0.01). In contrast, no differences appeared among participants' velocities when observing non-biological movement kinematics (Figure 5B).
The paired t-test used to compare the slopes of the regression lines that modelled the relationship among participants and robot mean velocities revealed a significant effect of the factor Kinematics (slopeNB = 0.06<0.24 = slopeB: t = 2.35, p<0.05).
Therefore, altogether these data suggest that whereas after biological movement observation participants were influenced by robot movement velocity, in non-biological condition motor contagion disappeared.
Discussion
This study aimed at understanding whether and how the nature of the visual stimulus and the properties of the observed actions influence the motor response of the observer. In particular, we focused on the comparison between properties with higher and lower cognitive value, namely the meaning and the kinematics, respectively. To investigate this issue, we applied a novel motor contagion paradigm in which participants were requested to look at a visual model, either human or humanoid, and to move their hands from one place to another, while handling or not handling an object, after the observation of the action of the demonstrator. The movement trajectory could be either smooth-curvilinear or jerky-segmented and was covered with a biological velocity profile. When the demonstrator was a robot we added a condition in which the smooth-curvilinear trajectory was performed also with a non-biological velocity profile. The results showed that the observed movement kinematics, namely an action property at low cognitive value, modulated the resonance mechanisms, whatever the nature of the observed stimulus, except when the humanoid robot violated the biological law of motion.
In case of biological kinematics, the same degree of motor contagion resulted from human and humanoid action observation. This finding was not easily predictable because the literature on human-robot interaction proposed contrasting results. In fact, both the early studies on mirror neurons system in the monkey [7], [8], and neuroimaging findings in humans [10] have cast doubts on the possibility for a humanoid agent to activate motor resonance. Our results are instead in line with more recent neuroimaging and neurophysiological experiments showing that the observation of a mechanical device induces motor resonance in humans (for reviews see [31], [32]). Moreover, we did not find a modulation in the resonating mechanism associated to humanoid action observation, confirming similar findings previously obtained in studies which applied different behavioral paradigms (i.e., [14], [33]–[40]). It is worth noting that the present work did not test the role of the robot appearance.
Although the non-human nature of the stimulus per se did not cancel motor resonance, a property of its movement – the velocity profile – was crucial to induce motor contagion. Indeed, when participants observed the demonstrators moving according to a biological law of motion, their movement velocity varied coherently with that of the stimulus. In contrast, when participants observed the robot performing movements with kinematics that where outside the human motor repertoire – i.e., violated the biological laws of motions – the stimulus velocity did not influence their responses. These results confirmed our previous findings [24], which showed that motor contagion appeared only when the observer was able to match his/her motor repertoire with that of the stylized visual model (i.e., a dot). Accordingly, motion inference was demonstrated to be dependent on the recognition of the observed motion repertoire [23]. A similar dominance of movement kinematics over the nature of the agent has been illustrated in a study by Grosjean et al. [41], in which the authors showed that Fitt's Law holds for action perception of both biological and non-biological agents. Thus, we propose that the biological kinematics of a moving stimulus played a predominant role to induce behavioral speed contagion with respect to other aspects of the observed motion. We speculate that this low-level property of the action is responsible for the activation of motor resonance mechanisms. Indeed, an action is stored in term of its kinematic and dynamic properties: thus, we suggest that the process of motor contagion originates from these components, namely from the observer's motor repertoire and not from the stimulus by itself. That is, motor contagion would appear only if the stimulus is compatible with the subjective motor properties.
The appearance of motor contagion when observing both smooth-curvilinear and jerky-segmented trajectories supports this interpretation. Indeed, even though unconventional, the “jerky-segmented” trajectory was feasible by a human agent, and thus it did not violate the biological law of motions. This idea is strengthened by a recent neuroimaging study showing that the observation of video depicting both human and robot performing either natural or rigid dancing movements induced activity in the action-observation network (i.e. parietal, premotor and occipito-temporal regions) [27]. Furthermore, these findings are in line with a series of neurophysiological studies focused on evaluating the contribution of different dimensions of action, such as the kinematics and the goal, indicating that the observed action matched the observer motor system at low (i.e., kinematics) level [20]–[22]. Thus, our findings suggest that low-level representation of movement is crucial to evoke motor contagion while other properties, such as the congruence between the nature of the visual stimulus and the shape of its motion, do not affect motor resonance mechanisms. Furthermore, it is worth noting that this work, for the first time, successfully dissociated the consequences of the observation of two aspects of movement kinematics that are usually not disentangled, namely the path and the velocity profile, by showing how they differently affected motor contagion processes.
In conclusion, the present results suggest that motor resonance is a very robust mechanism, not limited by the nature of the visual model and by the external appearance of its motion. On the contrary, its occurrence seems to rely on the possibility for the observer to match her/his motor repertoire with that of the model. This idea is in line with the direct matching hypothesis stating that motor resonance might be based on a mechanism directly matching the observed action onto an internal motor representation of that action [3].
Interestingly, however, when looking at the human agent, the influence of the stimulus increased for transitive relative to intransitive movement observation. Notably, in the intransitive condition participants just moved the hand from one place to another, while in the transitive condition the action she/he observed and executed had an explicit meaning, namely to put the octopus in its container. Thus, the goal of the action seems to affect the contamination process. One can hypothesize that when facing a moving agent the observer aims to understand his future action. Although the recognition of his movement kinematics could help to predict action evolution [3], [23], other contextual static visual input, such as the presence of an object, can feed the “intention tracking” mechanism, boosting the resonance process. No such increase of motor contagion for transitive movement observation occurred when the humanoid robot performed actions. We speculate that this effect could depend on a less refined intention-attribution mechanism, which in case of a robotic agent, does not distinguish between low level (or location) goals and more concrete, object-related goals. Indeed, the fact that the observed motion may exert different effects on observer's motor response might depend on the perceived intentionality of the agent's gesture, as suggested by Sartori and colleagues [15]. A growing body of literature investigated cues for triggering intention attribution [42], [43] and factors, such as goal-directedness actions [44] and gaze direction [14], [45] have been invoked as responsible for intention attribution. Nevertheless, in order to provide clearer explanation, this result needs to be specifically addressed in future works.
Conclusions
In this work we showed that motor resonance mechanisms, in the form of motor contagion, can appear when observing both human and non-human actions. Although the shape of the trajectory did not affect these processes, the observation of non-biological velocity profile prevented the observer's motor system from resonating with that of the model. Thus, we can conclude that the possibility for the observer to match his/her own motor repertoire with that of the observed stimulus might mediate the activation of motor resonance and, consequently, modulate the spontaneity and the pleasantness of the interaction, whatever the nature of the communication partner.
Together with the characterization of the behavioral consequences of motor resonance mechanism during human-human interaction, this work offers an insight into the way humans perceive and react to non-human agents. Indeed, the present findings shed light on the kind of interaction humans can establish with humanoid robots [31], [32], a new kind of social agents expected to co-exist with humans, sharing the same working space and assisting them during daily life activities. Indeed, since motor resonance was proposed to underlie spontaneous and pleasant relations [4], [46]–[48], the activation of these mechanisms during human-robot interaction would guarantee natural and human-like communication also with non-human beings. In summary, in light of a scenario in which humans will co-exist and cooperate with humanoid robots, the possibility to consider robots as a social, interaction partners and to establish a natural relationship with them seems to be inevitable.
Acknowledgments
We are grateful to Dr. Matthew Tata for his constructive revision of the manuscript. We thank also Marco Jacono and Laura Taverna for their technical support.
Funding Statement
The work has been conducted in the framework of the European projects ITALK (Grant ICT-FP7-214668). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Rizzolatti G, Craighero L (2004) The mirror-neuron system. Annu Rev Neurosci 27: 169–192 Available: 10.1146/annurev.neuro.27.070203.144230. [DOI] [PubMed] [Google Scholar]
- 2. Rizzolatti G, Fadiga L, Fogassi L, Gallese V (1999) Resonance behaviors and mirror neurons. Arch Ital Biol 137: 85–100. [PubMed] [Google Scholar]
- 3. Iacoboni M, Woods RP, Brass M, Bekkering H, Mazziotta JC, et al. (1999) Cortical mechanisms of human imitation. Science 286: 2526–2528. [DOI] [PubMed] [Google Scholar]
- 4. Chartrand TL, Bargh JA (1999) The chameleon effect: the perception-behavior link and social interaction. J Pers Soc Psychol 76: 893–910. [DOI] [PubMed] [Google Scholar]
- 5. Heyes C (2011) Automatic imitation. Psychol Bull 137: 463–483 10.1037/a0022288 [DOI] [PubMed] [Google Scholar]
- 6. Gowen E, Poliakoff E (2012) How does visuomotor priming differ for biological and non-biological stimuli? A review of the evidence. Psychol Res 76: 407–420 10.1007/s00426-011-0389-5 [DOI] [PubMed] [Google Scholar]
- 7. Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119: 593–609. [DOI] [PubMed] [Google Scholar]
- 8. Rizzolatti G, Fadiga L, Gallese V, Fogassi L (1996) Premotor cortex and the recognition of motor actions. Brain Res Cogn Brain Res 3: 131–141. [DOI] [PubMed] [Google Scholar]
- 9.Castiello U, Lusher D, Mari M, Edwards M, Humphreys GW (2002) Observing a human or a robotic hand grasping an object: differential motor priming effects. Common Mech Percept Action 19: 315–333. Available: <Go to ISI>://000189493700016.
- 10. Tai YF, Scherfler C, Brooks DJ, Sawamoto N, Castiello U (2004) The human premotor cortex is “mirror” only for biological actions. Curr Biol 14: 117–120. [DOI] [PubMed] [Google Scholar]
- 11. Gazzola V, Rizzolatti G, Wicker B, Keysers C (2007) The anthropomorphic brain: the mirror neuron system responds to human and robotic actions. Neuroimage 35: 1674–1684 Available: 10.1016/j.neuroimage.2007.02.003. [DOI] [PubMed] [Google Scholar]
- 12. Oberman LM, McCleery JP, Ramachandran VS, Pineda JA (2007) EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots. Neurocomputing 70: 2194–2203 10.1016/j.neucom.2006.02.024 [DOI] [Google Scholar]
- 13. Kilner J, Hamilton AF de C, Blakemore S-J (2007) Interference effect of observed human movement on action is due to velocity profile of biological motion. Soc Neurosci 2: 158–166 Available: 10.1080/17470910701428190. [DOI] [PubMed] [Google Scholar]
- 14. Castiello U (2003) Understanding other people's actions: intention and attention. J Exp Psychol Hum Percept Perform 29: 416–430. [DOI] [PubMed] [Google Scholar]
- 15. Sartori L, Becchio C, Bulgheroni M, Castiello U (2009) Modulation of the action control system by social intention: unexpected social requests override preplanned action. J Exp Psychol Hum Percept Perform 35: 1490–1500 10.1037/a0015777 [DOI] [PubMed] [Google Scholar]
- 16. Grafton ST, Hamilton AF de C (2007) Evidence for a distributed hierarchy of action representation in the brain. Hum Mov Sci 26: 590–616 Available: 10.1016/j.humov.2007.05.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Bekkering H, Wohlschläger A, Gattis M (2000) Imitation of gestures in children is goal-directed. Q J Exp Psychol A 53: 153–164 10.1080/713755872 [DOI] [PubMed] [Google Scholar]
- 18. Wohlschläger A, Gattis M, Bekkering H (2003) Action generation and action perception in imitation: an instance of the ideomotor principle. Philos Trans R Soc Lond B Biol Sci 358: 501–515 10.1098/rstb.2002.1257 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Tessari A, Rumiati RI (2004) The strategic control of multiple routes in imitation of actions. J Exp Psychol Hum Percept Perform 30: 1107–1116 10.1037/0096-1523.30.6.1107 [DOI] [PubMed] [Google Scholar]
- 20. Cavallo A, Sartori L, Castiello U (2011) Corticospinal excitability modulation to hand muscles during the observation of appropriate versus inappropriate actions. Cogn Neurosci 2: 83–90 10.1080/17588928.2010.533163 [DOI] [PubMed] [Google Scholar]
- 21. Cavallo A, Becchio C, Sartori L, Bucchioni G, Castiello U (2012) Grasping with tools: corticospinal excitability reflects observed hand movements. Cereb Cortex 22: 710–716 Available: http://www.ncbi.nlm.nih.gov/pubmed/21685400. [DOI] [PubMed] [Google Scholar]
- 22. Sartori L, Bucchioni G, Castiello U (2012) Motor cortex excitability is tightly coupled to observed movements. Neuropsychologia 50: 2341–2347 10.1016/j.neuropsychologia.2012.06.002 [DOI] [PubMed] [Google Scholar]
- 23. Pozzo T, Papaxanthis C, Petit JL, Schweighofer N, Stucchi N (2006) Kinematic features of movement tunes perception and action coupling. Behav Brain Res 169: 75–82 Available: http://www.sciencedirect.com/science/article/pii/S0166432805005462. [DOI] [PubMed] [Google Scholar]
- 24. Bisio A, Stucchi N, Jacono M, Fadiga L, Pozzo T (2010) Automatic versus voluntary motor imitation: effect of visual context and stimulus velocity. PLoS One 5: e13506 Available: 10.1371/journal.pone.0013506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Jonas M, Siebner HR, Biermann-Ruben K, Kessler K, Bäumer T, et al. (2007) Do simple intransitive finger movements consistently activate frontoparietal mirror neuron areas in humans? Neuroimage 36 10.1016/j.neuroimage.2007.03.028 [DOI] [PubMed] [Google Scholar]
- 26. Press C (2011) Action observation and robotic agents: Learning and anthropomorphism. Neurosci Biobehav Rev 35: 1410–1418 10.1016/j.neubiorev.2011.03.004 [DOI] [PubMed] [Google Scholar]
- 27. Cross ES, Liepelt R, de C Hamilton AF, Parkinson J, Ramsey R, et al. (2012) Robotic movement preferentially engages the action observation network. Hum Brain Mapp 33 (9): 2238–2254 Available: 10.1002/hbm.21361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Bisio A, Casteran M, Ballay Y, Manckoundia P, Mourey F, et al. (2012) Motor resonance mechanisms are preserved in Alzheimer's disease patients. Neuroscience 222: 58–68 Available: 10.1016/j.neuroscience.2012.07.017. [DOI] [PubMed] [Google Scholar]
- 29. Metta G, Natale L, Nori F, Sandini G, Vernon D, et al. (2010) The iCub humanoid robot: an open-systems platform for research in cognitive development. Neural Netw 23: 1125–1134 Available: 10.1016/j.neunet.2010.08.010. [DOI] [PubMed] [Google Scholar]
- 30. Manera V, Becchio C, Cavallo A, Sartori L, Castiello U (2011) Cooperation or competition? Discriminating between social intentions by observing prehensile movements. Exp Brain Res 211: 547–556 10.1007/s00221-011-2649-4 [DOI] [PubMed] [Google Scholar]
- 31. Sciutti A, Bisio A, Nori F, Metta G, Fadiga L, et al. (2012) Measuring Human-Robot Interaction Through Motor Resonance. Int J Soc Robot: 1–12. 10.1007/s12369-012-0143-1 [DOI] [Google Scholar]
- 32. Chaminade T, Cheng G (2009) Social cognitive neuroscience and humanoid robotics. J Physiol Paris 103: 286–295 Available: 10.1016/j.jphysparis.2009.08.011. [DOI] [PubMed] [Google Scholar]
- 33. Brass M, Bekkering H, Prinz W (2001) Movement observation affects movement execution in a simple response task. Acta Psychol 106: 3–22. [DOI] [PubMed] [Google Scholar]
- 34. Kilner JM, Paulignan Y, Blakemore SJ (2003) An interference effect of observed biological movement on action. Curr Biol 13: 522–525. [DOI] [PubMed] [Google Scholar]
- 35. Press C, Bird G, Flach R, Heyes C (2005) Robotic movement elicits automatic imitation. Brain Res Cogn Brain Res 25: 632–640 Available: 10.1016/j.cogbrainres.2005.08.020. [DOI] [PubMed] [Google Scholar]
- 36. Watanabe K (2008) Behavioral speed contagion: automatic modulation of movement timing by observation of body movements. Cognition 106: 1514–1524 Available: 10.1016/j.cognition.2007.06.001. [DOI] [PubMed] [Google Scholar]
- 37. Kupferberg A, Glasauer S, Huber M, Rickert M, Knoll A, et al. (2011) Biological movement increases acceptance of humanoid robots as human partners in motor interaction. AI Soc 26: 339–345 Available: http://link.springer.com/article/10.1007/s00146-010-0314-2. [Google Scholar]
- 38.Wykowska A, Chellali R, Al-Amin MM, Müller HJ (2012) Does observing artificial robotic systems influence human perceptual processing in the same way as observing humans? Social Robotics. Springer. 327–337. Available: http://link.springer.com/chapter/10.1007/978-3-642-34103-8_33.
- 39.Sciutti A, Bisio A, Nori F, Metta G, Fadiga L, et al. (2012) Anticipatory gaze in human-robot interactions. Gaze in HRI from modeling to communication. Workshop at the 7th ACM/IEEE international conference on human-robot interaction, Boston, Massachusetts, USA.
- 40.Sciutti A, Bisio A, Nori F, Metta G, Fadiga L, et al. (n.d.) Robots can be perceived as goal-oriented agents. Accept Interact Stud.
- 41. Grosjean M, Shiffrar M, Knoblich G (2007) Fitts's law holds for action perception. Psychol Sci 18: 95–99 Available: http://pss.sagepub.com/content/18/2/95.short. [DOI] [PubMed] [Google Scholar]
- 42. Gallagher HL, Happé F, Brunswick N, Fletcher PC, Frith U, et al. (2000) Reading the mind in cartoons and stories: An fMRI study of “theory of mind” in verbal and nonverbal tasks. Neuropsychologia 38: 11–21 10.1016/S0028-3932(99)00053-6 [DOI] [PubMed] [Google Scholar]
- 43. Gallagher HL, Frith CD (2003) Functional imaging of “theory of mind.”. Trends Cogn Sci 7: 77–83 10.1016/S1364-6613(02)00025-6 [DOI] [PubMed] [Google Scholar]
- 44. Premack D, Premack AJ (1997) Infants Attribute Value± to the Goal-Directed Actions of Self-propelled Objects. J Cogn Neurosci 9: 848–856 10.1162/jocn.1997.9.6.848 [DOI] [PubMed] [Google Scholar]
- 45. Baron-Cohen S, Campbell R, Karmiloff-Smith A, Grant J, Walker J (1995) Are children with autism blind to the mentalistic significance of the eyes? Br J Dev Psychol 13: 379–398 Available: http://onlinelibrary.wiley.com/doi/10.1111/j.2044-835X.1995.tb00687.x/abstract. [Google Scholar]
- 46. Lakin JL, Chartrand TL (2003) Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol Sci 14: 334–339. [DOI] [PubMed] [Google Scholar]
- 47. Van Baaren RB, Holland RW, Kawakami K, van Knippenberg A (2004) Mimicry and prosocial behavior. Psychol Sci 15: 71–74. [DOI] [PubMed] [Google Scholar]
- 48. Knoblich G, Butterfill S, Sebanz N (2011) Psychological Research on Joint Action: Theory and Data Burlington: Academic Press, Vol. 54(3): 59–101. [Google Scholar]