Abstract
Conclusions:
In prelingually deaf children with cochlear implants, tone perception and production performance are highly correlated. This result is consistent with the hypothesis that tone perception is the prerequisite for good tone production.
Objectives:
Previous research has shown remarkable deficits in tone perception and production in native tone languagespeaking, prelingually deafened children with cochlear implants. The purpose of the present study was to investigate the relationship between tone perception and production in those children.
Methods:
Twenty-five prelingually deaf children with cochlear implants participated in the study. All subjects were Advanced Bionics CII/90K users with various lengths of implant use. To evaluate tone perception performance, subjects completed a computerized tone contrast test. For tone production performance, an artificial neural network was used to evaluate the accuracy of tones recorded from each of the 25 subjects.
Results:
Large individual differences in tone perception and production performance were observed in these subjects. Tone perception accuracy ranged from 50.0 to 96.9% correct (chance performance = 50% correct; mean = 71.0% correct). Tone production performance ranged from 19.4 to 97.2% correct (mean = 52.0% correct). A strong correlation was found between tone perception and production performance in this group of subjects (r = 0.805).
Keywords: Tone language, children, prelingual deafness, lexical tone
Introduction
Lexical tone, defined as the fundamental frequency (F0) variation of the vocalic part of a syllable, is important for tone languages such as Mandarin Chinese. Mandarin Chinese has four distinct tone patterns (see Xu et al. [1] for details) whereas Cantonese, a Chinese dialect, has six distinct tone patterns (see Ciocca et al. [2] for details). Contemporary multichannel cochlear implants typically stimulate a subset of 16–22 electrodes with a constant-rate electric pulse train that is modulated in amplitude by the temporal envelope of corresponding bandpass filters (see Loizou [3] for a review). Thus, pitch information is not explicitly presented in the electrical stimulations in current cochlear implant technology [4]. Therefore, lexical tone presents a particular challenge to cochlear implant users who speak tone languages.
Many studies have demonstrated that prelingually deafened children with cochlear implants who speak tone languages have difficulties in perceiving lexical tones. While the average accuracy in tone recognition in Cantonese or Mandarin Chinese ranged from 60% to 70% correct [2,5–8], there was a large variation in tone recognition performance (ranging from chance to nearly perfect) across the cochlear implant users (see Xu and Zhou [9] for a review).
Several studies examined tone production performance in prelingually deafened children with cochlear implants who speak tone languages [10–14]. Consistent with the data on tone recognition performance, tone production in prelingually deafened children with cochlear implants showed enormous individual differences in production accuracy as assessed by subjective judgment [10–12] or perceptual recognition by normal-hearing adults [13], and objective acoustic analysis [14]. While most of the prelingually deafened children with cochlear implants had fairly poor tone production, a small portion of them reached a performance that is equivalent to that of normal-hearing children [13,14].
Results from a limited number of studies on the relationship between tone perception and production were inconclusive. In a previous study [11], Peng et al. reported a weak but significant correlation (r = 0.44, p = 0.015) between tone identification and production accuracy in a group of 30 pediatric Mandarinspeaking implantees aged from 6 to 12.6 years old. However, when the three best performers were removed from the analysis, the correlation was no longer statistically significant (r = 0.01, p = 0.98). In the present study, we sought to test the hypothesis that good tone perception is a prerequisite for good tone production in prelingually deafened children with cochlear implants. Our results confirmed a strong correlation between tone perception and production.
Material and methods
Twenty-five prelingually deafened children with cochlear implants (18 boys and 7 girls) who are native Mandarin Chinese speakers were recruited from Beijing and Shanghai, the two largest cities in China. The mean age was 9.5 years (range 2.1–21.5 years; SD = 5.4). All children were Advanced Bionics CII/90K HiResolution or HiResolution 120 users, with 0.1–8.1 years of implant experience (3.1 ± 2.5 years). The age at implantation was 1.3–20.8 years (6.4 ± 5.2 years). The use of human subjects was reviewed and approved by the Institutional Review Boards ofOhio University, Beijing Tongren Hospital, and East China Normal University.
Tone perception test
A computerized tone contrast test (see Han et al. [15] for details) was administered to each of the subjects. The tone perception test involved identifying tones from six Mandarin tone contrasts using a two-alternative forced choice paradigm. In each presentation, a tone token was played via a loudspeaker while two pictures of the tone contrast being tested were shown on the computer screen. All the monosyllabic words used in the test are simple Chinese words that the children of this age group were familiar with. The child was instructed to point to the picture that corresponded to the meaning of the word that he/she heard. The testing consisted of 48 presentations [12 words (i.e. 6 tone contrasts) × 2 speakers × 2 repetitions] without feedback. Training with feedback was provided before the test.
Tone production test
Speech materials were recorded using a picture-naming procedure. In each trial, 1 of the 36 pictures used in the tone perception test was displayed on the computer screen, and the task of the child was to name the picture (see Han et al. [15] for the list of the 36 words). The elicited speech was recorded at a sampling rate of 44100 Hz with a 16-bit resolution in quiet rooms.
The F0 contours of the vowel part of the recorded words were extracted using an auto-correlation method. The update rate of the F0 extraction was 8 ms with a frame size of 24 ms. The accuracy of the extracted F0 contours was manually examined with reference to the narrowband spectrograms of the tokens [10,14].
An artificial neural network [16,17] was used to objectively assess the tone production accuracy of the children. Our previous studies have demonstrated that results of the neural network analysis show a strong correlation with the perceptual measure using normal-hearing adult listeners [14,16,17]. The neural network was first trained with F0 data of the tone tokens from the 61 normal-hearing children that were reported in a previous study [16]. The trained neural network was then fed with the F0 data of the tone tokens from the 25 children with cochlear implants. By comparing the outputs of the neural network and the target tones, a percent correct score for tone production was derived for each of the children with a cochlear implant.
Results
Tone perception scores of the 25 subjects ranged from 50.0 to 96.9% correct (chance = 50% correct) with an average of 71.0% correct (SD = 15.0%). Tone production accuracy of the subjects ranged from 19.4 to 97.2% correct (chance = 25% correct) with an average of 52.0% correct (SD = 23.8%). Figure 1 shows the scatter plot of tone perception (abscissa) and tone production (ordinate) performance. The correlation between tone perception and production performance was statistically significant (r = 0.805; p < 0.001).
Although it was not the focus of the present study, we performed correlational analysis between tone perception and production performance and various demographic variables (such as age at implantation, duration of implant use, chronological age, etc.). Age at implantation was found to be the only significant predictor for tone production performance. Figure 2 shows the scatter plot of tone production performance versus age at implantation. The correlation coefficient (r) of the linear fit was 0.495 (r2 = 0.245, p = 0.011). With a quadratic fit of the data, the r2 slightly increased to 0.276.
Discussion
The results of the present study showed a strong correlation between tone perception and tone production performance in prelingually deafened children with cochlear implants. Consistent with the assumption that perception precedes production in typical developing children [18], children with good tone perception tend to perform better in tone production. Although correlation does not imply causality, our result is consistent with the hypothesis that tone perception is the prerequisite for good tone production in children with cochlear implants.
In a previous study [11], a weak but significant correlation was reported between Mandarin tone perception and production in 30 prelingually deaf children with either MedEl or Nucleus cochlear implants (r = 0.44, p = 0.015). However, when the three top performers were removed from the analysis, the correlation disappeared (r = 0.01, p = 0.98). In a more recent study [19], 24 prelingually deafened children with Nucleus cochlear implants were tested for the English intonation perception and production accuracy. The correlation coefficient between the intonation utterance accuracy and identification accuracy was moderately high at 0.627 (p = 0.001). The present study examined lexical tone perception and production in children with the Advanced Bionics CII or 90K cochlear implants. With this particular population of subjects, we found a strong correlation between tone perception and production (r = 0.805, p < 0.001). The effects of implant devices on the relationship between tone perception and production are worth exploring in future studies, especially when other variables, such as age at implantation, duration of implant use, device type, etc., are partialled out.
Individual variability has become a persistent characteristic in the findings of the previous studies that measured tone perception or production performance in implanted children [2,5–8,10–15]. The present study again demonstrated that both tone perception and tone production ranged from chance level to nearly perfect level. When we examined the potential contributing factors for the large variability in performance, only age at implantation was found to be a significant contributor for tone production. A recent study of Cantonese tone production in congenitally deaf children with cochlear implants also indicated that early implantation (before the age of 4 years) is crucial for good tone production [12]. Our results showed that all good performers of tone production (i.e. ≥80% correct) had received their cochlear implants before approximately 6 years of age (Figure 2). However, age at implantation accounted for only a quarter of the variance in tone production performance. Our ongoing studies are targeting to recruit a much larger sample size than that used in the present study. Such studies will have the statistical power to perform multiple regression analysis and to identify multiple variables that might contribute to the performance in tone perception and tone production in children with cochlear implants.
Acknowledgments
We thank the graduate and undergraduate students at Ohio University, Marisol Gliatas, Jiong Hu, Yuntao Hu, and Fangchan Liang, for their technical support. The study was supported in part by China Ministry of Education Open Research Fund Program of Key Laboratory of Speech and Hearing Sciences (East China Normal University) 2010SHZ01, NIH NIDCD Grant R15-DC009504, and Advanced Bionics, LLC.
Footnotes
Declaration of interest: The authors report no conflicts of interest. The authors alone are responsible for the content and writing of the paper.
References
- [1].Xu L, Tsai Y, Pfingst BE. Features of stimulation affecting tonal-speech perception: implications for cochlear prostheses. J Acoust Soc Am 2002;112:247–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2].Ciocca V, Francis AL, Aisha R, Wong L. The perception of Cantonese lexical tones by early-deafened cochlear implantees. J Acoust Soc Am 2002;111:2250–6. [DOI] [PubMed] [Google Scholar]
- [3].Loizou P Speech processing in vocoder-centric cochlear implants. Adv Otorhinolaryngol 2006;64:109–43. [DOI] [PubMed] [Google Scholar]
- [4].Moore BCJ. Coding ofsounds in the auditory system and its relevance to signal processing and coding in cochlear implants. Otol Neurootol 2003;24:243–54. [DOI] [PubMed] [Google Scholar]
- [5].Wei WI, Wong R, Hui Y, Au DKK, Wong BYK, Ho WK, et al. Chinese tonal language rehabilitation following cochlear implantation in children. Acta Otolaryn gol 2000;120:218–21. [DOI] [PubMed] [Google Scholar]
- [6].Lee KYS, van Hasselt CA, Chiu SN, Cheung DM C. Cantonese tone perception ability of cochlear implant children in comparison with normal-hearing children. Int J Pediatr Otorhinolaryngol 2002;63:137–47. [DOI] [PubMed] [Google Scholar]
- [7].Wong AOC, Wong LLN. Tone perception of Cantonese speaking prelingually hearing-impaired children with cochlear implants. Otolaryngol Head Neck Surg 2004;130: 751–8. [DOI] [PubMed] [Google Scholar]
- [8].Xu L, Zhou N, Huang J, Chen X, Li Y, Zhao X, et al. Lexical tone development in prelingually-deafened children with cochlear implants. The 12th International Symposium on Cochlear Implants in Children, Seattle, WA, 2009. [Google Scholar]
- [9].Xu L, Zhou N. Tonal languages and cochlear implants In: Zeng F-G, Fay RR, Popper AN, Springer handbook of auditory research: Vol 23. Auditory prostheses: cochlear implants and beyond. New York: Springer-Verlag (in press). [Google Scholar]
- [10].Xu L, Li Y, Hao J, Chen X, Xue SA, Han D. Tone production in Mandarin-speaking children with cochlear implants: a preliminary study. Acta Otolaryngol 2004;124: 363–7. [DOI] [PubMed] [Google Scholar]
- [11].Peng SC, Tomblin JB, Cheung H, Lin Y-S, Wang L-S. Perception and production of Mandarin tones in prelingually deaf children with cochlear implants. Ear Hear 2004;25: 251–64. [DOI] [PubMed] [Google Scholar]
- [12].Lee KYS, van Hasselt CA, Tong MCF. Age sensitivity in the acquisition of lexical tone production: evidence from children with profound congenital hearing impairment after cochlear implantation. Ann Otol Rhinol Laryngol 2010; 119:258–65. [DOI] [PubMed] [Google Scholar]
- [13].Han D, Zhou N, Li Y, Chen X, Zhao X, Xu L. Tone production of Mandarin-Chinese-speaking children with cochlear implants. Int J Pediatr Otorhinolaryngol 2007;71: 875–80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Zhou N, Xu L. Development and evaluation of methods for assessing tone production skills in Mandarin-speaking children with cochlear implants. J Acoust Soc Am 2008;123: 1653–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [15].Han D, Liu B, Zhou N, Chen X, Kong Y, Liu H, et al. Lexical tone perception with HiResolution and HiResolution 120 sound-processing strategies in pediatric Mandarinspeaking cochlear implant users. Ear Hear 2009;30: 169–77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [16].Xu L, Chen X, Zhou N, Li Y, Zhao X, Han D. Recognition of lexical tone production of children with an artificial neural network. Acta Otolaryngol 2007;127:365–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [17].Zhou N, Zhang W, Lee C-Y, Xu L. Lexical tone recognition with an artificial neural network. Ear Hear 2008;29: 326–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Edwards ML. Perception and production in child phonology: the testing of four hypotheses. J Child Lang 1974;1: 205–19. [Google Scholar]
- [19].Peng SC, Tomblin JB, Turner CW. Production and perception of speech intonation in pediatric cochlear implant recipients and individuals with normal hearing. Ear Hear 2008; 29:336–51. [DOI] [PubMed] [Google Scholar]