Emmorey, Giezen and Gollan (in press) address the fascinating question of what can be learnt about language, cognition and the brain from the unique group of people who have grown up learning both a signed and a spoken language. The focus of their review is hearing individuals – referred to as hearing bimodal bilinguals. The review presents an excellent overview of research in this field and highlights the unique insights that this population can provide.
However, the review leaves open an important question: to what extent can research with hearing bimodal bilinguals inform our understanding of the consequences of sign-speech bilingualism in deaf people? The answer is probably less than we would wish.
The first issue to consider is one of terminology. Emmorey, Giezen and Gollan (in press) refer to deaf bilinguals as ‘deaf bimodal bilinguals’ just as the term is applied to ‘hearing bimodal bilinguals’. However, the use of the term ‘bimodal’ is confusing. Hearing individuals who are bilingual in sign and speech indeed access their languages via two different modalities (here meaning senses): primarily auditory for speech and visual for sign. For those born deaf, access to both languages is through the visual modality. Thus, the application of the term ‘bimodal’ to this group appears misleading. For the sake of clarity in the field it is perhaps more appropriate to refer to these individuals as ‘deaf unimodal sign – speech bilinguals’ or for precision ‘deaf sign language and spoken/written language bilinguals’.
The use of these terms may be rejected by some in the field who prefer the term sign-print bilinguals (Piñar et al., 2011; Kubus et al., 2014). This makes the strong assumption that written text exists in isolation of what it actually represents – speech. Yet there is ample evidence that deaf signers make use of elements that are recognisable as being derived from spoken language.
As Emmorey, Giezen and Gollan (in press) comment in the final section of their paper ‘….mouthings from spoken language words .. .are often produced silently and simultaneously with signs.” The mouthings referred to are mouth actions (silent – not whispered) produced by deaf signers which represent words from the surrounding dominant spoken language. For the most part the semantics of the mouthing and sign are the same (Bank, Crasborn & van Hout, 2011). This phenomenon has been observed and studied in a large number of sign languages, beginning with the work of Vogt-Svendsen on Norwegian Sign Language (Vogt-Svendsen 1981; 2001), and including studies of non-Western sign languages such as Adamorobe Sign Language (Ghana) (Nyst, 2007) , and Inuit Sign Language (Schuit, 2013) as well as studies of British Sign Language (Sutton-Spence & Day, 2001; Sutton-Spence, 2007)Irish Sign Language (Mohr, 2012), German Sign Language (Hohenberger & Happ, 2001), Sign Language of the Netherlands (Schermer, 1990). Although there has been very little study of mouthing in ASL, Nadolske & Rosenstock (2007) have demonstrated that the use of mouthing in ASL is comparable to that found in other sign languages. Indeed, the only sign language which has been reported not to make use of mouthings is Kata Kolok, a sign language used by a village community on Bali (de Vos & Zeshan, 2012).
There is ongoing debate about the linguistic status of mouthings, with many studies describing mouthings as part of the sign language lexicon – i.e. the lexical representations of signs includes both oral and manual information (Vogt-Svendsen, 2001; van de Sande & Crasborn, 2009); other researchers have argued the opposite: mouthings and signs are represented and accessed independently and reflect knowledge of two languages (Ebbinghaus & Hessmann, 2001; Vinson et al., 2010). Using fMRI with deaf native signers we have reported that BSL signs with speech-like mouth actions showed greater superior temporal activation, whereas signs made with nonspeech-like mouth actions showed more activation in posterior and inferior temporal regions (Capek et al., 2008). Thus, the brain does appear to care about the status of mouthings used in signed languages. This finding suggests that consideration of mouthings, vis a vis code-blends, is crucial to any discussion of bilingualism in a signed and spoken language, especially in relation to deaf signers.
Evidence for the influence of elements of speech on signed languages also comes from fingerspelling. The pattern of ‘reductions’ in fingerspelling by skilled signers indicate that they do not reduce fingerspellings randomly or arbitrarily. Rather their reductions reflect speech rather than simply orthography. For example, in reducing the fingerspelling of the name CHARLES, this is more likely to be reduced to -C-H- than to –C- (Sutton-Spence, 1994).
Research which considers deaf individuals as bilinguals is much rarer than studies of their hearing siblings, which reflects the size of the different populations. An additional factor influencing the difficulty of conducting research in this field is, as Emmorey, Giezen and Gollan (in press) point out, the great variability in spoken (and signed) language proficiency within the deaf population, in terms of spoken language comprehension (lipreading) (e.g. Mohammed, et al., 2006), and production, and indeed in accessing a spoken language via text – reading (e.g. Mayberry et al., 2011). However, this variability should not be a reason to ignore the role of spoken language when considering deaf sign-speech bilinguals.
Although the literature is mixed, at least some studies with deaf adults and children indicate a role for speech phonology when deaf people read text (see Mayberry et al., 2011). This variability suggests that there may be many routes to successful reading for a deaf person. That some deaf people do not appear to make use of speech phonology in their skilled reading is not, we argue, cause to ignore the role that awareness of speech structure may play in the development of reading skills or indeed the enduring role it may play in reading and reading-related skills for some deaf people (e.g. MacSweeney et al., 2009; Emmorey et al., 2013).
Whilst studies of hearing bimodal bilinguals can provide great insights into language, cognition and the brain - future research which considers their deaf siblings as ‘sign language – spoken language’ bilinguals may prove even richer.
References
- Bank R. The ubiquity of mouthings in NGT: a corpus study. Utrecht: LOT; 2015. [Google Scholar]
- Bank R, Crasborn O, van Hout R. Variation in mouth actions with manual signs in Sign Language of the Netherlands (NGT) Sign Language & Linguistics. 2011;14(2):248–270. [Google Scholar]
- Capek C, Campbell R, Woll B. The bimodal bilingual brain: fMRI investigations concerning the cortical distribution and differentiation of signed language and speechreading. Rivista di Psycolinguistica Applicata. 2008;8(3):97–112. [Google Scholar]
- Capek C, Woll B, MacSweeney M, Waters D, David AS, McGuire PK, Brammer M, Campbell R. Both Hand and Mouth: Cortical correlates of lexical processing in BSL and speechreading. Journal of Cognitive Neuroscience. 2008;20(7):1220–1234. doi: 10.1162/jocn.2008.20084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Vos C, Zeshan U. Demographic, sociocultural and lingusitic variation across rural signing communities. In: Zeshan U, de Vos C, editors. Sign languages in village communities: anthropological and linguistic insights. Berlin: Walter de Gruyter; 2012. pp. 2–23. [Google Scholar]
- Ebbinghaus H, Hessmann J. Sign language as multidimensional communication: why manual signs, mouthings and mouth gestures are three different things. In: Boyes-Braem P, Sutton-Spence RL, editors. The hands are the head of the mouth: the mouth as articulator in sign languages. Hamburg: Signum Press; 2001. pp. 133–151. [Google Scholar]
- Emmorey K, Weisberg J, McCullough S, Petrich JAF. Mapping the reading circuitry for skilled deaf readers: An fMRI study of semantic and phonological processing. Brain and Language. 2013;126:169–180. doi: 10.1016/j.bandl.2013.05.001. [DOI] [PubMed] [Google Scholar]
- Hohenberger A, Happ D. The linguistic primacy of signs and mouth gestures over mouthing: evidence from language production in German Sign Language. In: Boyes-Braem P, Sutton-Spence RL, editors. The hands are the head of the mouth: the mouth as articulator in sign languages. Hamburg: Signum Press; 2001. pp. 153–190. [Google Scholar]
- Kubus O, Villwock A, Morford JP, Rathmann C. Word recognition in deaf readers: Cross-language activation of German Sign Language and German. Applied Psycholinguistics. 2014 doi: 10.1017/S0142716413000520. Published online: 27 January 2014. [DOI] [Google Scholar]
- MacSweeney M, Brammer M, Waters D, Goswami U. Enhanced activation of the left inferior frontal gyrus in deaf and dyslexic adults during rhyming. Brain. 2009;132:1928–1940. doi: 10.1093/brain/awp129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mayberry RI, del Giudice AA, Lieberman AM. Reading achievement in relation to phonological coding and awareness in deaf readers: A meta-analysis. Journal of Deaf Studies and Deaf Education. 2011;16(2):164–188. doi: 10.1093/deafed/enq049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mohammed T, Campbell R, MacSweeney M, Barry F, Coleman M. Speechreading and its association with reading among deaf, hearing and dyslexic individuals. Clinical Linguistics & Phonetics. 2006;20(7-8):621–630. doi: 10.1080/02699200500266745. [DOI] [PubMed] [Google Scholar]
- Mohr S. The visual-gestural modality and beyond: mouthings as a language contact phenomenon in Irish Sign Language. Sign Language & Lingusitics. 2012;15(2):185–211. [Google Scholar]
- Nadolske MA, Rosenstock R. The occurrence of mouthings in American Sign Language: a preliminary study. In: Perniss P, Pfau R, Steinbach M, editors. Visible variation: comparatie studies on sign language structure. Berlin: Mouton de Gruyter; 2007. pp. 35–62. [Google Scholar]
- Nyst VAS. A descriptive analysis of Adamorobe Sign Language (Ghana) Utrecht: LOT; 2007. [Google Scholar]
- Piñar P, Dussias P, Morford J. Deaf readers as bilinguals: an examination of Deaf readers’ print comprehension in light of current advances in bilingualism and second language processing. Language and Linguistics Compass. 2011;5:691–704. [Google Scholar]
- van de Sande I, Crasborn O. Lexically bound mouth actions in Sign Language of the Netherlands: a comparison between different registers and age groups. Linguistics in the Netherlands. 2009;26:78–90. [Google Scholar]
- Schermer T. In search of a language: Influences from spoken Dutch on Sign Language of the Netherlands. Delft: Eburon; 1990. [Google Scholar]
- Schuit J. Signing in the Arctic: external influences on Inuit Sign Language. In: Zeshan U, de Vos C, editors. Sign languages in village communities: anthropological and linguistic insights. Berlin: Walter de Gruyter; 2013. pp. 181–208. [Google Scholar]
- Sutton-Spence RL. The role of the manual alphabet and fingerspelling in British Sign Language. PhD Thesis; University of Bristol: 1994. [Google Scholar]
- Sutton-Spence RL. Mouthings and simultaneity in British Sign Language. In: Vermeerbergen M, Leeson L, Crasborn O, editors. Simultaneity in signed languages. Amsterdam: John Benjamins; 2007. pp. 147–162. [Google Scholar]
- Sutton-Spence RL, Day L. Mouthings and mouth gestures in British Sign Language (BSL) In: Boyes-Braem P, Sutton-Spence RL, editors. The hands are the head of the mouth: the mouth as articulator in sign languages. Hamburg: Signum Press; 2001. pp. 69–86. [Google Scholar]
- Vinson DP, Thompson R, Skinner R, Fox N, Vigliocco G. The hands and mouth do not always slip together in British Sign Language: dissociating articulatory channels in the lexicon. Psychological Science. 2010;21(8):1158–1167. doi: 10.1177/0956797610377340. [DOI] [PubMed] [Google Scholar]
- Vogt-Svendsen M. Mouth position & mouth movement in Norwegian Sign Language. Sign Language Studies. 1981;33(1):363–376. [Google Scholar]
- Vogt-Svendsen M. A comparison of mouth gestures and mouthings in Norwegian Sign Language (NSL) In: Boyes-Braem P, Sutton-Spence RL, editors. The hands are the head of the mouth: the mouth as articulator in sign languages. Hamburg: Signum Press; 2001. pp. 9–40. [Google Scholar]