Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Jun 1.
Published in final edited form as: J Exp Child Psychol. 2015 Mar 25;134:62–77. doi: 10.1016/j.jecp.2015.01.012

Linguistic Labels, Dynamic Visual Features, and Attention in Infant Category Learning

Wei (Sophia) Deng 1, Vladimir M Sloutsky 1
PMCID: PMC4394365  NIHMSID: NIHMS675698  PMID: 25819100

Abstract

How do words affect categorization? According to some accounts, even early in development, words are category markers and are different from other features. According to other accounts, early in development, words are part of the input and are akin to other features. The current study addressed this issue by examining the role of words and dynamic visual features in category learning in 8- to 12- month infants. Infants were familiarized with exemplars from one category in a label-defined or motion-defined condition and then tested with prototypes from the studied category and from a novel contrast category. Eye tracking results indicated that infants exhibited better category learning in the motion-defined than in the label-defined condition and their attention was more distributed among different features when there was a dynamic visual feature compared to the label-defined condition. These results provide little evidence for the idea that linguistic labels are category markers that facilitate category learning.


The ability to form categories is an important component of human cognition that appears early in development: infants exhibit evidence of category learning during the first months of life (Quinn et al., 1993; Younger & Cohen, 1985). There is also evidence suggesting that language may affect this process, although the mechanisms underlying the effects of language remain a matter of debate.

Some suggested that words accompanying category members have the special status of category markers and, as such, they guide or supervise category learning in infancy (Waxman & Markow, 1995; see also Westermann & Mareschal, 2014). At the same time, others suggested that early in development words are akin to other features, but they may become category markers in the course of development (Gliozzi et al., 2009; Sloutsky, 2010; Sloutsky & Lo, 1999; Sloutsky & Fisher, 2004; Sloutsky et al., 2001). As we discuss below, distinguishing between these positions has profound consequences for our understanding of the relationships between language and cognition and the nature of learning early in development.

According to the former theory, “infants embark on the task of word learning equipped with a broad, universally shared expectation, linking words to commonalities among objects” (Waxman, 2003, p. 220). As a result, words, but not other kinds of auditory input, facilitate infants’ category learning by attracting attention to within-category commonalities (Waxman & Markow, 1995; Waxman & Booth, 2001), thus effectively supervising category learning. These effects are supervisory because labels guide learning by attracting attention to commonalities.

There is some evidence consistent with this view. First, words may facilitate infants’ categorization above and beyond other kinds of auditory input (Balaban & Waxman, 1997; Fulkerson & Haaf, 2003; Ferry et al., 2010). Second, facilitative effects of words were reported for basic-level as well as at superordinate or global levels (Balaban & Waxman, 1997; Waxman & Booth, 2003; Waxman & Markow, 1995). Third, there are reports that facilitative effects of labels are specific rather than general in nature: count nouns and adjectives have initially similar effects on category learning, whereas around 14-months of age count nouns are more likely to facilitate category learning than adjectives (Waxman & Booth, 2001). This finding suggests that count nouns may play a special role in category learning. And finally, labels may facilitate property induction above other kinds of input (Keates & Graham, 2008).

There are challenges, however, to the idea that words are category markers in infancy. First, even if words affect category learning in infancy, they do not have to function as category markers supervising learning, but can be instead part of the stimulus input and influence learning in a bottom-up fashion. For example, Plunkett et al (2008) presented 10-month-old infants with a category-learning task, such that the to-be-learned category consisted of two clusters of artificial creatures (i.e., a broad category somewhat analogous to a global category encompassing cats and horses). When the category was presented in silence, participants learned two narrow categories, whereas when one common label accompanied each item, participants learned the single broad category. Although it is tempting to conclude that these results indicate that labels supervised category learning, this conclusion is unwarranted. Specifically, when Gliozzi et al (2009) modeled data reported by Plunkett et al (2008) using self-organizing maps, a model that assumed that labels are features and function as input rather than top-down supervisory signals was able to account for the reported pattern.

Second, findings that labels facilitate infant category learning are tenuous at best – facilitation transpires in some studies and does not transpire in others. This is because many studies compared the effects of labels with those of unfamiliar sounds, but not with a silent condition. When a silent baseline was introduced (e.g., Robinson & Sloutsky, 2007), labels were not found to facilitate infants’ category learning above the silent baseline.

And finally, even studies demonstrating facilitative effects of labels have generated inconsistent findings regarding the age at which labels facilitate category learning. For example, Booth and Waxman (2002) demonstrated that for an artifact category, words alone facilitated category learning only at 18-months of age, whereas around 14-months of age, words had to be paired with object function to facilitate learning above the baseline. It was argued that both words and functions (a) indicate human agency and (b) highlight commonalities among objects. Results of this study seem to be in a sharp contrast with studies where words were claimed to facilitate category learning in very young infants. In particular, Ferry et al (2010) found evidence that labels facilitate category learning in 3- to 4-month-olds. Why do labels facilitate category learning in 3–4 months-olds, while failing to facilitate learning in much older infants (e.g., Booth & Waxman, 2002; Robinson & Sloutsky, 2007, 2008)?

According to the label-as-feature proposal, at least early in development, words are part of input – they are features of items rather than category markers (Gliozzi et al., 2009; Sloutsky & Lo, 1999; Sloutsky & Fisher, 2004; Sloutsky et al., 2001). For example, there is evidence that early in development auditory input overshadows (or attenuates processing of) corresponding visual input (Lewkowicz, 1988a, 1988b; Napolitano & Sloutsky, 2004; Robinson & Sloutsky, 2004a, 2004b, 2008; Sloutsky & Napolitano, 2003). Therefore, under most conditions words do not facilitate infant category learning, but, under some conditions, they may interfere with learning.

Of course, even if words start out as features, they may become category markers later in development (e.g., Deng & Sloutsky, 2012). For example, Deng and Sloutsky (2012) used a variant of Yamauchi and Markman’s (1998, 2000) category learning paradigm to teach preschoolers and adults two novel categories. During training, the category label correlated perfectly with a pattern of motion, which is a highly salient visual feature (Egeth & Yantis, 1997, for review), whereas the rest of the category features were probabilistic. At test, the label was pitted against the pattern of motion and participants had to predict one of the features of a test item. The researchers found that unlike many adults, who relied on a category label, children relied on the salient feature, despite the fact that their memory for the label was as good as that of adults. These results raised interesting questions. If a visual feature that is a part of input has a greater effect on category learning than a label, what makes the label a category marker? And if words are not category markers for preschoolers, how can they be category markers for infants?

In sum, there are two theoretical positions with respect to the role of words in category learning, which differ with respect to the underlying mechanism and a developmental trajectory. Distinguishing between these possibilities and understanding the mechanisms underlying the effect of words on category learning is of critical importance for understanding cognitive development. If from early in development words function as category markers supervising learning, then top-down effects may play a significant role in early cognitive development. Also, given that supervision results in the ability to learn substantially more complex categories than unsupervised learning (Rumelhart, 1989), if words are supervisory signals for infants, our construal of what infants can and cannot learn will be subject to substantial revision.

Effects of Words and Other Features on Category Learning in Infancy: Potential Mechanisms

Although the reviewed evidence is controversial with respect to the idea that labels are category markers, none of the reviewed studies examined the mechanisms hypothesized by each theoretical position. At the same time, each position gives divergent predictions as to how words should affect category learning in comparison with other features. According to the label-as-category-marker position, attracting attention to commonalities is the mechanism via which labels facilitate category learning (e.g., Waxman, 2003). Therefore, when labels are presented, category learning should be accompanied by some form of attention optimization (Blair et al. 2009; Hoffman & Rehder, 2010) — diffused attention early in learning and followed by shifting attention to within-category commonalities. Furthermore, attention optimization when labels are present should be greater than in no-label conditions, and this attention optimization should lead to better category learning.

In contrast, according to the label-as-feature position, (a) labels should not attract attention to commonalities and (b) due to possible auditory overshadowing effects, labels should either interfere with infant category learning or not affect it at all. Furthermore, there is evidence that successful category learning in 6–8-months-old infants is accompanied not by increased attention to commonalities (which is often the case in adults), but by broader exploration of features and thus more broadly distributed attention (e.g., Best, Yim, & Sloutsky, 2013). This prediction is based on a substantial body of literature demonstrating that distributed attention (with shorter individual fixations and frequent gaze shifts) is generally associated with better learning in infancy (e.g., Bronson, 1991; Colombo et al., 1991; Jankowski et al., 2001; Rose et al., 2003). There is also evidence that distributed attention is not merely associated, but it leads to better learning. In one study (Jankowski et al., 2001), researchers introduced a peripheral dynamic cue (a dynamic engager appearing in various parts of the screen) to induce shorter fixations, multiple gaze shifts, and thus a more distributed pattern of attention in 5-month-old infants. Results indicated that training resulted in more distributed attention (compared to no training) and in more efficient learning of presented items. This finding suggests that dynamic visual features (especially those that appear peripherally) may encourage distributed attention, thus facilitating learning. Given that successful category learning in infancy is also accompanied by distributed attention (e.g., Best et al., 2013), it is possible that such dynamic visual features may also affect infant category learning.

Why do dynamic visual features encourage distributed attention? In contrast to static visual features that maintain their salience throughout the trial, dynamic visual features become highly salient only during the period when they are dynamic. As a result, if a dynamic visual feature is presented peripherally, at the very minimum participants would need to move their gaze from the point of their initial fixation to the moving part and then, when the motion ceases to the point of their final fixation. Each of these gaze shifts may be accompanied by short fixations (and thus attention to) multiple regions of the stimulus (see Jankowski et al., 2001, for a discussion).

Therefore, compared to labels, these dynamic visual features may result in more gaze shifts, more distributed attention, and better, more robust learning. This prediction contrasts sharply with that of the label-as-category-marker position, which predicts that labels facilitate category learning by attracting attention to commonalities. The goal of the current research was to test this prediction by using a combination of eye tracking and a more traditional novelty preference paradigm.

Overview of Current Study

The study reported here presents two experiments designed to examine the effects of labels and dynamic visual features on category learning in infancy. Experiment 1 included two between-subjects conditions: label-defined condition and motion-defined condition. In both conditions, infants were familiarized with exemplars from one category and then tested with the prototype of this category and that of the contrast category. Infants saw the same testing stimuli in both conditions, with neither label nor motion being presented during testing. Experiment 2 was aimed at further comparing the effects of labels with a silent control condition. In both experiments, eye gaze data were collected. Recall, that, according to the label-as-category-marker position, labels should (a) facilitate category learning compared to the other conditions and (b) lead to greater attention to commonalities than in the other two conditions. In contrast, according to the label-as-feature view, (a) because of auditory overshadowing, labels should not facilitate category learning and (b) more robust category learning may be accompanied by more distributed attention

EXPERIMENT 1

Method

Participants

Fifty-one infants (30 girls) ranging in age from 8 to 12 months (M = 10 months, 11 days; SD = 1 month, 20 days) were recruited. Ten infants were excluded from the analyses (two due to fussiness and eight for not looking at a single test trial).

Apparatus

A Tobii T60 eye-tracker with the sampling rate of 60 Hz was used to collect eye gaze data. The eye-tracker was integrated into a 17-inch computer monitor and located on a table inside a booth enclosed by black curtains. A trained experimenter monitored the experiment using Tobii Studio gaze analysis software installed on a 19-inch Dell OptiPlex 755 computer outside the booth. A video stream displaying participants’ activities was projected onto a 9-inch black and white Sony SSM-930 CE television for the experimenter’s online monitoring. Two Dell speakers were located behind a black curtain on each side of the eye-tracker.

Materials and Design

The materials were colorful drawings of artificial creatures and novel labels “flurp” and “jalet” (see Figure 1A). The creatures had five features varying in color and shape and consisted of two categories. As shown in Table 1, the categories had a family-resemblance structure, which was derived from two prototypes (A0 and B0) by modifying the values of one of five features – head, antennae, hands, body, or feet. We used these novel categories to ensure that none of the infants was familiar with these categories prior to the experiment and all participants had to learn these categories de novo. Another advantage of these stimuli is that they have been extensively tested in previous work with preschoolers (Deng & Sloutsky, 2012; 2013).

Figure 1.

Figure 1

Example Stimuli. A. Prototypes of stimuli from Categories A and B; B. Procedures used in this study. C. Areas of interest (AOIs) shown as gray ellipses.

Table 1.

Category structure used in training.

Category A
Category B
Stimuli Head Body Hands Feet Antenna Label/Motion Stimuli Head Body Hands Feet Antenna Label/Motion
A1 1 1 1 1 0 1 B1 0 0 0 0 1 0
A2 1 1 1 0 1 1 B2 0 0 0 1 0 0
A3 1 1 0 1 1 1 B3 0 0 1 0 0 0
A4 1 0 1 1 1 1 B4 0 1 0 0 0 0
A5 0 1 1 1 1 1 B5 1 0 0 0 0 0
A0 1 1 1 1 1 1 B0 0 0 0 0 0 0

Note. The value 1 = any of five dimensions identical to “Flurp” (see Figure 1). The value 0 = any of five dimensions identical to “Jalet” (see Figure 1). A0 and B0 are prototypes of each category.

There were two between-subjects conditions: label-defined and motion-defined. In the label-defined condition, the label presented during training was the same for all the exemplars, whereas in the motion-defined condition the pattern of motion presented during training was the same. To create a dynamic visual feature, the feet were animated using Macromedia Flash MX software. For all “flurps” the feet stretched up and down, whereas for all “jalets” the feet moved sideways. Because the goal was to examine effects of labels and dynamic visual features on category learning, neither labels nor patterns of motion were presented at test.

Procedure

Infants were seated on parents’ laps approximately 60 cm away from the eye-tracker. Parents were instructed not to interact with infants and to avoid speaking or pointing. Prior to the experiment, infants completed a 5-point calibration sequence. The calibration consisted of dynamic kitten images accompanied by a “bouncing” sound appearing in different locations on the screen.

The experiment proper consisted of 20 familiarization and 4 test trials. The trials were mixed and pseudo-randomly assigned to four blocks, with each block consisting of five familiarization trials followed by one test trial (see Figure 1B for the overall sequence in a block). On each familiarization trial, infants saw a creature generated from the same category (one of the categories shown in Table 1) on a white background lasting for 8000 ms and heard a phrase starting at the onset of each trial. A subset of infants studied Category A whereas the rest of the infants studied Category B. In the label-defined condition, the phrase (e.g., “Look! This is a Flurp”) was presented at the beginning of each trial and lasted for approximately 2800 ms, whereas, in the motion-defined condition, the phrase did not include the label (e.g., “Look at this one!”). The feet of the creature started moving after the phrase ended and the motion lasted for 3000 ms. The onset of motion was approximately the same as that of the label in the label-defined condition (i.e., 2300 ms into the trial).

Each test trial lasted for 8000 ms and presented a pair of items – the prototype of the studied category and the prototype of the non-studied category, with the left-right position of each prototype counterbalanced across test trials. Note that neither prototype was presented during training. These test items (these were the same across the conditions) were different from training trials as they were presented without either label or motion. A dynamic bouncing ball was presented between trials within each block, whereas a short and task-irrelevant cartoon video was presented between blocks to maintain engagement of infant participants. All gaze data were recorded by the computer using Tobii Studio gaze analysis software.

Results and Discussion

Gaze data were exported using Tobii Studio gaze analysis software. For each stimulus seven areas of interest (AOIs) for fixations were defined: ellipses (ranging in visual angle from 2.4° by 2.4° to 3.8° by 5.7°) surrounding each feature of the creatures. Given that hands, feet, and antennae appeared in pairs, each pair was treated as a single AOI, which resulted in five AOIs used for data analyses: head, body, hands, feet, and antennae (see Figure 1C for AOIs). The gaze durations were weighted by the area of each AOI. The analyses focused on (1) looking time at familiarization; (2) novelty preference score based on the proportion of looking time to the prototype of the novel category as compared to the total looking time to both of the prototypes at test; and (3) patterns of attention during test and familiarization based on (a) the proportion of looking time to different features and (b) the number of gaze shifts between AOIs.

Looking Time at Familiarization

To ascertain that the levels of engagement with the stimuli were comparable across the conditions, we compared accumulated looking time to the stimuli on familiarization trials in the label-defined condition with that in the motion-defined condition. The accumulated looking time data were submitted to a 4 (Block: 1 vs. 2 vs. 3 vs. 4) by 2 (Condition: label-defined vs. motion-defined) mixed ANOVA, with block as a within-subjects factor and condition as a between-subjects factor. Results revealed a main effect of block, F(3, 117) = 37.26, MSE = 0.02, p < .01, ηp2 = 0.296, with infants’ accumulated looking time decreasing through blocks. However, infants’ accumulated looking time did not differ between the label-defined and motion-defined conditions, p = .52. These results indicated that infants exhibited comparable levels of engagement across the two conditions.

To further examine whether infants became more familiarized with stimuli in the course of learning, we compared the average looking time on the first-three and the last-three familiarization trials in the label-defined condition with that in the motion-defined condition (see Figure 2). These data were submitted to a 2 (Trial: first-three vs. last-three) by 2 (Condition: label-defined vs. motion-defined) mixed ANOVA, with trial as a within-subjects factor and condition as a between-subjects factor. There was a main effect of trial, F(1, 39) = 57.78, p < .001, ηp2 = 0.597, with infants in both conditions decreasing looking during familiarization, paired-samples ps < .001. There was a significant trial by condition interaction, F(1, 39) = 4.62, p = .038, ηp2 = 0.106. The interaction indicated that infants in the label-defined condition started with longer looking on the first-three trials than those in the motion-defined condition, independent-samples t(31.7) = 2.44, p = .021, d = 0.75, whereas there was no difference in the last three trials, p = .629. Therefore, infants in the label-defined condition exhibited somewhat greater familiarization than infants in the motion-defined condition.

Figure 2.

Figure 2

Average looking time on the first-three and last-three familiarization trials in the label-defined and motion-defined conditions.

Novelty Preference

To examine how labels or patterns of motion affected infants’ categorization, a novelty preference score was calculated for each test trial. Because there was only one test trial per block, we averaged test trials for blocks 1–2 and for blocks 3–4 (see Figure 3). The data in Figure 3 were submitted to a 2 (Block: 1–2 vs. 3–4) by 2 (Condition: label-defined vs. motion-defined) mixed ANOVA, with block as a within-subjects factor and condition as a between-subjects factor. There was a significant main effect of condition, with infants having higher novelty preference scores in the motion-defined condition, F(1, 39) = 5.78, MSE = 0.12, p = .021, ηp2 = 0.129. Neither the effect of block (p = .079), nor the interaction (p = .325) reached significance.

Figure 3.

Figure 3

Novelty preference scores on first two test trials and second two test trials in the label-defined and motion-defined conditions.

In addition, infants in the motion-defined condition exhibited above-chance novelty preference in Blocks 3–4, one-sample t(19) = 2.87, p = .010, d = 0.64, but not in Blocks 1–2, p = .949; whereas in the label-defined condition, novelty preference was not different from chance in either block, both ps > .251. Therefore, after four blocks of training participants in the motion-defined condition exhibited evidence of category learning, whereas participants in the label-defined condition failed to learn.

Distributions of individual novelty preference scores by condition are presented in Figure 4. As shown in Figure 4, in the first half of training (Blocks 1–2) there were comparable numbers of participants exhibiting novelty preference in either condition, whereas in the second half of training (Blocks 3–4), there were more participants exhibiting novelty preference in the motion-defined condition. To perform statistical analyses, we identified participants with novelty preference scores of 55%1 or higher as “learners”, while identifying the rest as “non-learners”. For Blocks 1–2, in the label-defined condition there were 4 out 21 learners (19%) and in the motion-defined condition there were 7 out 20 learners (35%), which was not statistically different, χ2 (1, N = 41) = 1.33, p = .249. However, in Blocks 3–4, there were 13 out 20 learners (65%) in the motion-defined condition, which exceeded the number of learners in the label-defined condition 7 out of 21, (33.3%), χ2 (1, N = 41) = 4.11, p = .043. Therefore, despite the fact that there was no advantage for the motion-defined condition during familiarization, there was greater evidence of category learning in this condition than in the label-defined condition.

Figure 4.

Figure 4

Individual novelty preference scores in the label-defined and motion-defined conditions in Blocks 1–2 (A) and in blocks 3–4 (B).

Patterns of Attention

We also examined how attention was distributed among different features of the stimuli on test trials (recall that neither labels nor motion was presented during these trials). Since there was no main effect of block (p = .54), the data were collapsed across blocks and results are presented in Figure 5. There was a significant main effect of feature, F(4, 156) = 112.04, MSE = 2.39, p < .001, ηp2 = 0.742. Neither the interaction nor the main effect of condition was significant (ps > .117). These results suggest that the difference in novelty preference between the label-defined and the motion-defined conditions did not stem from patterns of attention at test.

Figure 5.

Figure 5

Proportion of accumulated looking time to each feature averaged across 4 blocks at test in the label-defined and motion-defined conditions.

Similar analyses were conducted to examine the patterns of attention on familiarization trials. (see Figure 6). The proportion of looking time to each feature was calculated within each trial (8000 ms) and then averaged across five familiarization trials within each block. These data were submitted to a 5 (Feature: head vs. body vs. hands vs. feet vs. antennae) by 4 (Block: 1 vs. 2 vs. 3 vs. 4) by 2 (Condition: label-defined vs. motion-defined) mixed ANOVA, with feature and block as within-subjects factors and condition as a between-subjects factor. Because there was no effect of block (p = .155), data were collapsed across the four blocks. There was a feature by condition interaction, F(4, 156) = 30.95, MSE = 0.391, p < .001, ηp2 = 0.442. Infants’ accumulated more looking to the head in the label-defined condition compared to the motion-defined condition, independent sample t(39) = 4.94, p < .001, d = 1.54, whereas they looked significantly longer at the feet in motion-defined condition than in label-defined condition, independent sample t(20.74) = 7.71, p < .001, d = 2.46.

Figure 6.

Figure 6

Proportion of accumulated looking time to each feature averaged across 4 blocks at familiarization in the label-defined and motion-defined conditions.

Although greater attention to the feet in the motion-defined condition may not be surprising, it was nevertheless associated with better learning. Note that feet motion was introduced about 2000 ms into the trial and ended about 3000 ms before the end of the trial. Given that participants spent most of the time looking at the head, it is likely that they moved their gaze at least twice: first from the head to the feet and then back from the feet to the head. Therefore, participants in the motion-defined condition were likely to have more gaze shifts, and this more distributed pattern of attention may have led to better category learning.

In order to examine this possibility, we further analyzed the number of fixation shifts between AOIs after the onset of label or motion during familiarization. To perform statistical analyses, we identified a fixation shift as a valid one if the looking time accumulated in the AOI before the shift and in the AOI after the shift were at least 100 ms respectively. The average number of valid fixation shifts within each block across the conditions is presented in Figure 7. These data were submitted to a 4 (Block: 1 vs. 2 vs. 3 vs. 4) by 2 (Condition: label-defined vs. motion-defined) mixed ANOVA, with block as a within-subjects factor and condition as a between-subjects factor. Results revealed a main effect of block, F (3, 117) = 3.92, MSE = 79.22, p = .010, ηp2 = 0.091, with the number of valid fixation shifts decreasing through blocks. And more importantly, there was a main effect of condition, F (1, 39) = 5.09, MSE = 442.85, p = .013, ηp2 = 0.149, with infants making more shifts after the onset of motion in the motion-defined condition than that after the onset of label in the label-defined condition.

Figure 7.

Figure 7

Average number of valid fixation shifts within each block during familiarization in the label-defined and motion-defined conditions.

However, one may argue that greater attention to the head in the label condition (see Figure 6) is indicative of the fact that labels attracted attention to commonalities, with participants optimizing attention by shifting it to the head. Another possibility is that participants in the label-defined condition merely exhibited a head bias (see Quinn et al., 2009, for evidence of head bias in infancy). We therefore deemed it necessary to directly examine these possibilities by examining whether infants exhibited focused attention after the label was introduced and whether infants differentiated the novel head from the familiar head at familiarization.

Dynamics of attention

If labels attract attention to commonalities, attention may be diffused early in the trial, but should become more focused on the head after the label was introduced. However, if attention to the head stems from a bias, attention after the introduction of a label should be no more focused than before. To examine the dynamics of infants’ attention within familiarization trials, attention shifts were calculated every 1000 ms, and then averaged across four blocks at each time point for the total duration of 8000 ms. Data between 1000 ms (i.e., after the word “Look” was introduced in both conditions) and 7000 ms (when infants looking started to decrease rapidly) were used for analysis and were shown in Figure 8. Results presented in Figure 8 indicate that labels did not attract attention to commonalities (i.e., if they did, the number of shifts should have dropped rapidly after the onset of the label). In contrast, there was an increase in the number of shifts after the introduction of motion. Therefore, motion resulted in a more distributed pattern of attention and in better learning. A 6 (Time Point: 1 vs. 2 vs. 3 vs. 4 vs. 5 vs. 6) by 2 (Condition: label vs. motion) mixed ANOVA confirmed these findings. There was a main effect of condition, F (1, 39) = 7.51, MSE = 34.18, p = .009, ηp2 = 0.161, with more shifts transpiring in the motion-defined than the label-defined condition. There was also a main effect of time point, F (5, 195) = 22.28, MSE = 13.57, p < .001, ηp2 = 0.364, with a quadratic trend showing that shifts increased early in the trial and then decreased later in the trial, F (1, 39) = 54.94, p < .001, ηp2 = 0.585. In addition, there was a significant time point by condition interaction, F (5, 195) = 5.07, MSE = 3.09, p < .001, ηp2 = 0.115. To examine the interaction, we compared the number of shifts at each time point after the introduction of the label or motion to that before the introduction (i.e., at the first time point). These pair-wise comparisons with Bonferroni correction indicated that in the label-defined condition, the number of shifts at the three consecutive time points after the onset of the label was comparable to that before the label, ps > .203, whereas in the motion-defined condition, there were more shifts at the three consecutive time points after the onset of motion than before, ps < .010. Therefore, there was no evidence that attention became more focused after the label was introduced, but it became more distributed after motion was introduced.

Figure 8.

Figure 8

Average number of valid fixation shifts averaged across four blocks at each time point within familiarization trials in the label-defined and motion-defined conditions. Each time point represents a 1000 ms time window.

Looking time to novel vs. familiar head

Another way of examining whether longer looking to the head in the label condition stemmed from a head bias or from increased attention to commonalities, we examined novelty preference during familiarization. Recall that because the categories had the family resemblance structure (see Table 1), each familiarization item had one out-of-category (i.e., novel) feature. Therefore, in each training block, there were four familiarization items with a given head and one familiarization item with a novel head. If labels attract attention to the common head, infants should look longer to the novel head during familiarization. However, if attention to the head stems from a head bias, infants should be interested in the head, whether it is familiar or novel. To examine this, we compared infants’ looking time to the novel head (i.e., the head of item A5 or B5 as shown in Table 1) with the average looking time to the four familiar heads (i.e., the head of items A1–A4 or B1–B4 as shown in Table 1) for each block in the label-defined condition. These data were submitted to a 4 (Block: 1 vs. 2 vs. 3 vs. 4) by 2 (Head Type: novel vs. familiar) within-subjects ANOVA. The results showed that infants did not differentiate the two types of head, with neither the interaction (p = .467) nor the main effect of head type (p = .139) being significant. These results suggest that looking to the head stemmed from a head bias rather than from labels attracting attention to commonalities. Similarly, their looking at other features did not differ when these features were familiar or novel (all ps > .1).

Overall, participants exhibited evidence of category learning in the motion-defined but not in the label-defined condition. This outcome is compatible with two possibilities: (1) label interfering with category learning or (2) motion facilitating category learning. To distinguish between these possibilities, we needed a baseline, in which neither labels nor motion were presented. If participants succeed in the baseline and exhibit patterns of attention comparable to those in the motion-defined condition, then labels interfered with learning. In contrast, if participants fail in the baseline and exhibit patterns of attention comparable to those in the label-defined condition, then motion facilitated learning. The goal of experiment 2 was to distinguish between these possibilities

Experiment 2

Method

Participants

Twenty-three infants (12 girls) ranging in age from 8 to 12 months (M = 11 months, 1 day; SD = 1 month, 10 days) were recruited. Five infants were excluded from the analyses due to fussiness or not looking at a single test trial.

Apparatus, Materials, Design, and Procedure

The apparatus, materials and procedure in Experiment 2 were similar to Experiment 1, with one critical difference: neither labels nor motion patterns were introduced during training (see Figure 1B).

Results and Discussion

Similar to the data analyses in Experiment 1, five AOIs (i.e., head, body, hands, feet, and antennae, see Figure 1C) were used and the gaze durations were weighted by the area of each AOI. The analyses focused on (1) looking time at familiarization; (2) novelty preference score based on the proportion of looking time to the prototype of the novel category as compared to the total looking time to both of the prototypes at test; and (3) patterns of attention based on the proportion of looking time to different features on test and familiarization trials.

Similar to Experiment 1, infants in Experiment 2 exhibited a drop in looking time in the last three familiarization trials compared to the first three trials, paired-sample t(17) = 2.11, p = .05, d = 0.75. Also, similar to the label-defined condition, novelty preference score in Blocks 1–2 was not different from that in Blocks 3–4, p = .574 and neither was different from chance, ps > .628. This was in contrast to the motion-defined condition, in which participants exhibited above-chance novelty preference by the second part of the experiment. Finally, patterns of attention at familiarization and test, as shown in Figure 9, were also similar to the label-defined condition: infants exhibited a head bias, Bonferroni adjusted ps < .001, and the proportion of looking to the head in the baseline condition did not differ from that in the label-defined condition (ps > .144). However, compared to the motion-defined condition, infants exhibited a stronger head bias in the baseline condition, with the proportion of looking to the head at familiarization being significantly higher (p = .002). Taken together these results suggest that labels did little compared to the no-label baseline, whereas patterns of motion changed infants’ patterns of attention which resulted in better category learning.

Figure 9.

Figure 9

Proportion of accumulated looking time to each feature averaged across 4 blocks at familiarization (A) and test (B) in Experiment 2.

General Discussion

The reported study investigated how labels and dynamic visual features affected patterns of attention and outcomes of category learning in infants. The study revealed several important findings. First, infants exhibited better category learning in the motion-defined condition than in the label-defined or the no-label conditions. Second, the motion condition resulted in a different pattern of attention during category learning compared to the label condition. And third, labels failed to either facilitate category learning or attract attention to commonalities. Therefore, whereas there was little evidence of labels either affecting attention or facilitating category learning in infants, dynamic visual features did both. Specifically, the presence of the dynamic visual feature resulted in more robust learning and in more distributed attention than in the other two conditions (cf. Jankowski et al., 2001).

The Role of Attention in Infant Category Learning

There is much evidence demonstrating the role of selective attention in adult category learning and there is more recent eye-tracking evidence (Blair et al., 2009; Hoffman & Rehder, 2010) indicating that category learning in adults is accompanied by attention optimization – shifting of attention to within-category commonalities. There is also a related argument pertaining to category learning in infancy: according to the label-as-category-marker position, even in infancy labels should facilitate category learning by attracting attention to commonalities (i.e., by facilitating attention optimization). Therefore, labels are expected to facilitate category learning by affecting selective attention. However, there is evidence that makes this mechanism unlikely.

In particular, there are recent findings that successful category learning in infancy is not accompanied by attention optimization (Best et al., 2013). This finding is important given previous evidence that distributed attention (with frequent fixation shifts) may result in better learning (e.g., Bronson, 1991; Colombo et al., 1991; Jankowski et al., 2001; Rose et al., 2003). Therefore, a feature that encourages a more distributed pattern may also facilitate learning. One candidate is a dynamic visual feature, especially if it is presented peripherally. Such features may affect attention because at the very minimum participants would need to move their gaze from the point of their initial fixation to the moving part and then, when the motion ceases, to the point of their final fixation. These ideas, while consistent with the label-as-feature view, run counter to the very core of the label-as-category-marker view.

Many studies have examined the role of labels in infants’ categorization, but this is the first study to demonstrate that effects of dynamic visual features on category learning are greater than those of labels. By comparing the outcome of category learning and examining the patterns of attention in the label-defined and motion-defined conditions, the current study provides novel evidence elucidating how different features may affect category learning in infancy. The results indicate that distributed attention results in successful category learning in infancy and that features that elicit more distributed attention may also lead to better learning.

What is the Role of Words in Early Category Learning?

Recall that two proposals have been advanced as to the role of words in early category learning: label-as-category-marker and label-as-feature. The label-as-category marker position makes two critical predictions. First, labels should change patterns of attention (compared to no-label baseline) by attracting attention to within-category commonalities. And second, labels should facilitate category learning above the no-label baseline. To our knowledge, the first prediction has not been tested before and the reported study is the first such test. The results clearly indicate that labels failed to attract attention to commonalities.

In contrast to the first prediction, the second prediction has been tested extensively in previous research, and generated conflicting evidence, with some studies finding facilitative effects of labels and others failing to find such effects. Two sources of supporting evidence are worth considering: (1) differential effects of labels on learning of basic-level and superordinate categories and (2) differential effects of nouns and adjectives on category learning. As we discuss below, many of these effects are inconclusive.

One of the first studies demonstrating such differential effects was the study conducted by Waxman and Markow (1995). In this study with 9-to-20-month-olds two variables were crossed: (1) the category structure (i.e., Basic level vs. Superordinate) and (2) labeling condition (Noun vs. No Word). Results indicated that novelty preference was above chance in all conditions, except for the Superordinate Category-No Word condition. On the basis of these results, it was concluded that words facilitate infants’ attention to superordinate categories, whereas labels have little effect on learning of basic-level categories labels (see also Fulkerson & Haaf, 2003). In contrast, Balaban and Waxman (1997) reported facilitative effects of labels for the basic-level categories in 9-month-olds. Therefore, there is no clear evidence that words have consistently different effects for categories of different levels.

The second source of support has to do with putatively different effects of nouns and adjectives on categorization. For example, in one study (Booth & Waxman, 2009) with 14- and 18-month-olds the category structure (i.e., Basic level vs. Superordinate) was fully crossed with lexical category (i.e., nouns vs. adjectives). The analyses revealed greater novelty preference in the noun condition compared to the other two conditions, but only for a single time window in the third quarter of the trial. In contrast, in a similar study conducted by the same researchers with a slightly different paradigm (Waxman & Booth, 2001), 14-month-olds exhibited equivalent novelty preference in the noun and in the adjective conditions. Therefore, evidence for different effects of nouns and adjectives on category learning in infancy is rather weak and inconclusive.

Whereas findings used to support the label-as-category-marker position are inconclusive, the reported results contribute to the growing body of evidence suggesting that labels are similar to other features, in that they are part of input rather than category markers. Data reported here include both negative and positive evidence. Negative evidence indicates that labels fail to facilitate category learning, change pattern of attention compared to the no-label baseline, or attract attention to commonalities. Although this evidence disputes the role of labels in this specific design, it does leave the possibility that perhaps under some other condition(s) labels facilitate category learning by attracting attention to commonalities.

Positive evidence is stronger because it disputes the very core of the label-as-category-marker approach. In particular, if distributed attention results in more successful category learning in infancy, then even if labels are found to attract attention to commonalities, they are unlikely to facilitate category learning. Alternatively, if labels do not attract attention to commonalities, then little is left of the label-as-category-marker position, even if labels are found to facilitate category learning. This is because if labels do not attract attention to commonalities these putative facilitative effects of labels would not uniquely support the label-as-category-marker position. These findings are important because distinguishing between these positions is consequential for our understanding of the relationships between language and cognition and the nature of learning early in development.

Conclusion

The reported study provides negative evidence suggesting that, under current conditions, labels do not facilitate category learning and do not attract attention to commonalities. The study also provides positive evidence, suggesting that dynamic visual features eliciting more distributed attention may facilitate category learning. Positive evidence has the most important implications because it points to a mechanism by which features may affect category learning in infancy.

Highlights.

  • How do infants learn categories and how do words affect this process?

  • Some believe that words facilitate category learning by attracting attention to commonalities.

  • We demonstrate that category learning in 10-month-old infants is accompanied by distributed rather than by focused attention

  • We also demonstrate that, while words do little to affect visual attention, dynamic visual features trigger a more distributed pattern of attention.

Acknowledgments

Research Support: This research is supported by the NSF grant BCS-1323963 and by NIH grant R01HD078545 to Vladimir Sloutsky.

Footnotes

1

We also performed chi-square analyses by identifying participants with novelty preference scores of 60% or higher and 65% or higher as “learners” (which resulted in a substantial decrease in the number of learners in the label-defined condition) and results remained the same. In Blocks 1–2, there were comparable numbers of participants exhibiting novelty preference in either condition (ps > .269), whereas in Blocks 3–4, there were more participants exhibiting novelty preference in the motion-defined condition (ps < .006).

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  1. Balaban MT, Waxman SR. Do words facilitate object categorization in 9-month-old infants? Journal of Experimental Child Psychology. 1997;64:3–26. doi: 10.1006/jecp.1996.2332. [DOI] [PubMed] [Google Scholar]
  2. Best CA, Yim H, Sloutsky VM. The Cost of Selective Attention in Category Learning: Developmental Differences between Adults and Infants. Journal of Experimental Child Psychology. 2013;116:105–199. doi: 10.1016/j.jecp.2013.05.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Blair M, Watson MR, Meier KM. Errors, efficiency, and the interplay between attention and category learning. Cognition. 2009;112:330–336. doi: 10.1016/j.cognition.2009.04.008. [DOI] [PubMed] [Google Scholar]
  4. Booth AE, Waxman SR. Object names and object functions serve as cues to categories for infants. Developmental Psychology. 2002;38:948–957. doi: 10.1037//0012-1649.38.6.948. [DOI] [PubMed] [Google Scholar]
  5. Booth AE, Waxman SR. A Horse of a Different Color: Specifying with Precision Infants’ Mappings of Novel Nouns and Adjectives. Child Development. 2009;80:15–22. doi: 10.1111/j.1467-8624.2008.01242.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bronson GW. Infant differences in rate of visual encoding. Child Development. 1991;62:44–54. [PubMed] [Google Scholar]
  7. Colombo J, Mitchell DW, Coldren JT, Freeseman LJ. Individual Differences in Infant Visual Attention: Are Short Lookers Faster Processors or Feature Processors? Child Development. 1991;62:1247–1257. [PubMed] [Google Scholar]
  8. Deng W, Sloutsky VM. Carrot-eaters and moving heads: Salient features provide greater support for inductive inference than category labels. Psychological Science. 2012;23:178–186. doi: 10.1177/0956797611429133. [DOI] [PubMed] [Google Scholar]
  9. Deng W, Sloutsky VM. The role of linguistic labels in inductive generalization. Journal of Experimental Child Psychology. 2013;114:432–455. doi: 10.1016/j.jecp.2012.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Egeth HE, Yantis S. Visual attention: Control, representation, and time course. Annual Review of Psychology. 1997;48:269–297. doi: 10.1146/annurev.psych.48.1.269. [DOI] [PubMed] [Google Scholar]
  11. Ferry A, Hespos SJ, Waxman S. Language facilitates category formation in 3-month-old infants. Child Development. 2010;81:472–479. doi: 10.1111/j.1467-8624.2009.01408.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Fulkerson AL, Haaf RA. The influence of labels, non-labeling sounds, and source of auditory input on 9- and 15-month-olds’ object categorization. Infancy. 2003;4:349–369. [Google Scholar]
  13. Gliozzi V, Mayor J, Hu JF, Plunkett K. Labels as features (not names) for infant categorization: A neuro-computational approach. Cognitive Science. 2009;33:709–738. doi: 10.1111/j.1551-6709.2009.01026.x. [DOI] [PubMed] [Google Scholar]
  14. Hoffman AB, Rehder B. The costs of supervised classification: The effect of learning task on conceptual flexibility. Journal of Experimental Psychology: General. 2010;139:319–340. doi: 10.1037/a0019042. [DOI] [PubMed] [Google Scholar]
  15. Jankowski JJ, Rose SA, Feldman JF. Modifying the distribution of attention in infants. Child Development. 2001;72:339–351. doi: 10.1111/1467-8624.00282. [DOI] [PubMed] [Google Scholar]
  16. Keates J, Graham SA. Category markers or attributes: Why do labels guide infants’ inductive inferences? Psychological Science. 2008;19:1287–1293. doi: 10.1111/j.1467-9280.2008.02237.x. [DOI] [PubMed] [Google Scholar]
  17. Lewkowicz DJ. Sensory dominance in infants: 1. Six-month-old infants’ response to auditory-visual compounds. Developmental Psychology. 1988a;24:155–171. [Google Scholar]
  18. Lewkowicz DJ. Sensory dominance in infants: 2. Ten-month-old infants’ response to auditory-visual compounds. Developmental Psychology. 1988b;24:172–182. [Google Scholar]
  19. Napolitano AC, Sloutsky VM. Is a picture worth a thousand words? The flexible nature of modality dominance in young children. Child Development. 2004;75:1850–1870. doi: 10.1111/j.1467-8624.2004.00821.x. [DOI] [PubMed] [Google Scholar]
  20. Plunkett K, Hu JF, Cohen LB. Labels can override perceptual categories in early infancy. Cognition. 2008;106:665–681. doi: 10.1016/j.cognition.2007.04.003. [DOI] [PubMed] [Google Scholar]
  21. Quinn PC, Doran MM, Reiss JE, Hoffman JE. Time course of visual attention in infant categorization of cats versus dogs: Evidence for a head bias as revealed through eye tracking. Child Development. 2009;80:151–161. doi: 10.1111/j.1467-8624.2008.01251.x. [DOI] [PubMed] [Google Scholar]
  22. Quinn PC, Eimas PD, Rosenkrantz SL. Evidence for representations of perceptually similar natural categories by 3-month-old and 4-month-old infants. Perception. 1993;22:463–475. doi: 10.1068/p220463. [DOI] [PubMed] [Google Scholar]
  23. Robinson CW, Sloutsky VM. Auditory dominance and its change in the course of development. Child Development. 2004a;75:1387–1401. doi: 10.1111/j.1467-8624.2004.00747.x. [DOI] [PubMed] [Google Scholar]
  24. Robinson CW, Sloutsky VM. The effect of stimulus familiarity on modality dominance. In: Forbus K, Gentner D, Regier T, editors. Proceedings of the XXVI annual conference of the Cognitive Science Society. Mahwah, NJ: Lawrence Erlbaum Associates, Inc; 2004b. pp. 1167–1172. [Google Scholar]
  25. Robinson CW, Sloutsky VM. Linguistic labels and categorization in infancy: Do labels facilitate or hinder? Infancy. 2007;11:233–253. doi: 10.1111/j.1532-7078.2007.tb00225.x. [DOI] [PubMed] [Google Scholar]
  26. Robinson CW, Sloutsky VM. Effects of auditory input in individuation tasks. Developmental Science. 2008;11:869–881. doi: 10.1111/j.1467-7687.2008.00751.x. [DOI] [PubMed] [Google Scholar]
  27. Rose SA, Feldman JF, Jankowski JJ. Infant visual recognition memory: Independent contributions of speed and attention. Developmental Psychology. 2003;39:563–571. doi: 10.1037/0012-1649.39.3.563. [DOI] [PubMed] [Google Scholar]
  28. Rumelhart DE. The architecture of mind: A connectionist approach. In: Posner M, editor. Foundations of Cognitive Science. Cambridge, MA: MIT Press; 1989. pp. 133–159. [Google Scholar]
  29. Sloutsky VM. From perceptual categories to concepts: What develops? Cognitive Science. 2010;34:1244–1286. doi: 10.1111/j.1551-6709.2010.01129.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Sloutsky VM, Fisher AV. Induction and categorization in young children: A similarity-based model. Journal of Experimental Psychology: General. 2004;133:166–188. doi: 10.1037/0096-3445.133.2.166. [DOI] [PubMed] [Google Scholar]
  31. Sloutsky VM, Lo YF. How much does a shared name make things similar? Part 1: Linguistic labels and the development of similarity judgment. Developmental Psychology. 1999;35:1478–1492. doi: 10.1037//0012-1649.35.6.1478. [DOI] [PubMed] [Google Scholar]
  32. Sloutsky VM, Lo YF, Fisher AV. How much does a shared name make things similar? Linguistic Labels and the development of inductive inference. Child Development. 2001;72:1695–1709. doi: 10.1111/1467-8624.00373. [DOI] [PubMed] [Google Scholar]
  33. Sloutsky VM, Napolitano A. Is a picture worth a thousand words? Preference for auditory modality in young children. Child development. 2003;74:822–833. doi: 10.1111/1467-8624.00570. [DOI] [PubMed] [Google Scholar]
  34. Waxman SR. Links between object categorization and naming: origins and emergence in human infants. In: Rakison DH, Oakes LM, editors. Early category and concept development: Making sense of the blooming, buzzing confusion. London: Oxford University Press; 2003. pp. 213–241. [Google Scholar]
  35. Waxman SR, Booth AE. Seeing pink elephants: Fourteen-month-olds’ interpretations of novel nouns and adjectives. Cognitive Psychology. 2001;43:217–242. doi: 10.1006/cogp.2001.0764. [DOI] [PubMed] [Google Scholar]
  36. Waxman SR, Booth AE. The origins and evolution of links between word learning and conceptual organization: New evidence from 11-month-olds. Developmental Science. 2003;6:130–137. [Google Scholar]
  37. Waxman SR, Markow DB. Words as invitations to form categories: Evidence from 12–13-month-old infants. Cognitive Psychology. 1995;29:257–302. doi: 10.1006/cogp.1995.1016. [DOI] [PubMed] [Google Scholar]
  38. Westermann G, Mareschal D. From perceptual to language-mediated categorization. Philosophical Transactions of the Royal Society B: Biological Sciences. 2014;369(1634):20120391. doi: 10.1098/rstb.2012.0391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Yamauchi T, Markman AB. Category learning by inference and classification. Journal of Memory and Language. 1998;39:124–148. [Google Scholar]
  40. Yamauchi T, Markman AB. Inference using categories. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2000;26:776–795. doi: 10.1037//0278-7393.26.3.776. [DOI] [PubMed] [Google Scholar]
  41. Younger BA, Cohen LB. How infants form categories. In: Bower G, editor. The psychology of learning and motivation: Advances in research and theory. Vol. 19. New York: Academic Press; 1985. pp. 211–247. [Google Scholar]

RESOURCES