Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Apr 21;15(4):e0231288. doi: 10.1371/journal.pone.0231288

A role for the cerebellum in the control of verbal interference: Comparison of bilingual and monolingual adults

Roberto Filippi 1,2,*, Eva Periche Tomas 1,2, Andriani Papageorgiou 1,2, Peter Bright 2,3
Editor: Claudio Mulatti4
PMCID: PMC7173859  PMID: 32315339

Abstract

We evaluate brain structure sensitivity to verbal interference in a sentence interpretation task, building on previously reported evidence that those with better control of verbal interference show higher grey matter density in the posterior paravermis of the right cerebellum. We compare brain structure sensitivity to verbal interference control across two groups, English monolingual (N = 41) and multilingual (N = 46) adults. Using voxel-based morphometry, our primary goal was to identify and explore differences in regional patterns of grey matter sensitivity to performance on the sentence interpretation task, controlling for group variability in age, nonverbal reasoning and vocabulary knowledge. There was no group difference in performance but there was a significant group effect in grey matter sensitivity to task performance in our region of interest: stronger sensitivity in the paravermis in bilinguals compared to monolinguals in accuracy performance in the high (relative to low) verbal interference condition. This effect was observed when the linguistic interference was presented in an unfamiliar language (Greek) but not when presented in the familiar language (English). Our findings suggest that multilanguage acquisition mediates regional involvement within the language network, conferring enhanced functional plasticity within structures (including the paravermis) in the service of control of linguistic interference.

Introduction

Auditory control of interference is the cognitive ability to inhibit the processing of concurrent irrelevant auditory stimuli. This ability could be particularly beneficial for people who have to monitor, process and communicate in more than one language (i.e., the bilingual population). The aim of the current study was to use MRI structural imaging to investigate the neural correlates of verbal interference during speech comprehension in monolingual and bilingual populations, with specific focus on the cerebellum. Previous studies looking into the control of verbal interference have highlighted the involvement of the left caudate during an inhibitory control task based on colour naming [1] and left inferior or middle frontal regions when bilinguals were making decisions on a semantic written task in their native language [2,3]. However, until recently, the literature has been relatively silent on the candidate role of the cerebellum in this function, perhaps due in part to the tendency in many functional MRI studies to remove the cerebellum in its entirety prior to statistical analysis. Over the past decade or so functional, lesion and developmental studies have shown and highlighted the importance of this structure in language processing [4,5,6,7,8].

A specific area in the cerebellum, the most medial part of lobule VIIIA that lies within the posterior paravermis has been associated with the control of motor movements [9]. Furthermore, a more recent study has shown that the right posterior paravermis is involved in the control of verbal interference [10] indicating a role for this structure in both motor and language functions. These authors employed structural neuroimaging in a sample of Italian bilingual participants (mean age 33 years old) who were late English learners, to identify brain regions that were positively correlated with the ability to control verbal interference. This was achieved through the administration of a dichotic listening task primarily adapted from a paradigm designed by Bates and colleagues [11,12] in which the participants were required to identify the agent in a series of sentences that differed in terms of structural complexity and in the absence and/or presence of interfering sentences. Results indicated that a cerebellar area, the right posterior paravermis, had higher grey matter density in those who were better at controlling verbal interference. These findings were consistent with a functional imaging study which investigated areas of activation when bilingual German participants (age range 23–62), who had been speaking English for more than 4 years, completed a semantic decision task while reading a list of words in the presence of distracting written stimuli [10].

Filippi and colleagues' work provided novel data about structural and functional effects on a specific cerebellar area in the control of verbal interference. However, the sample used in that study was a group of highly-proficient bilingual adults. To date, the question of whether these effects are a unique characteristic of the bilingual population or can also be observed in monolinguals has remained unanswered. Therefore, the rationale to conduct the current study is to address this question by comparing the performance of English monolingual and bilingual adults. This approach allows us to systematically address whether multilanguage acquisition causes structural change observed within the cerebellum.

The procedure implemented in the Filippi et al. [10] study was followed, building on the experimental tasks and the target population. In this new study, the sample included a large group of English monolingual speakers who were compared with bilinguals from different linguistic backgrounds. Any potential differences within the two language groups were explored, both at behavioural and neural levels. This study further modified the original experimental design by increasing the upper age threshold from approximately 40 to 80 years old in order to incorporate possible age-related structural differences in the region of interest (ROI).

Methods

Participants

This project has been approved by the Science and Technology Research Ethics panel at Anglia Ruskin University (FST/FREP/15/505). The study included 87 right-handed adults between 18 and 80 years old (48 females, mean age 45.9 SD = 19.3) of which 41 were English monolinguals and 46 were bilinguals from different linguistic backgrounds. All participants were residents in the UK at the time of testing. Bilingual participants completed a language history questionnaire adapted from Papageorgiou et al. [13], which revealed that, overall, the group had high levels of English language proficiency (see Table 1).

Table 1. Bilingual participants’ linguistic information.

Linguistic background First language
Catalan (n = 1)
Danish (n = 1)
Dutch (n = 2)
English (n = 21)
French (n = 4)
German (n = 3)
Hebrew (n = 1)
Italian (n = 4)
Mandarin (n = 2)
Polish (n = 2)
Portuguese (n = 1)
Russian (n = 2)
Spanish (n = 2)
Second language Arabic (n = 1)
English (n = 25)
Finnish (n = 1)
French (n = 9)
German (n = 2)
Hungarian (n = 1)
Italian (n = 2)
Polish (n = 1)
Spanish (n = 3)
Urdu (n = 1)
Age of first exposure Birth-6 years (n = 27)
7–12 years (n = 19)
Average Years of learning/Using L2
27
Self-rated proficiency (1–7) Reading M = 6.1; SD = 0.7
Writing M = 5.6; SD = 0.9
Speaking M = 5.9; SD = 0.8
Listening M = 6.2; SD = 0.7

The study was approved by the local ethics committee and all participants gave written informed consent.

Materials and procedure

Participants completed a background online questionnaire [14,15] and were pre-screened for MRI safety before attending the testing sessions. Eligible participants were invited to complete a behavioural and structural imaging session which took place at UCL. The behavioural procedure included a battery of 4 tasks that measured vocabulary knowledge in English language (BPVS III), non-verbal reasoning (Raven’s), verbal working memory (Digit span) and an auditory interference task (Sentence interpretation task). All information and instructions were given in English.

BPVS III (British picture vocabulary scale III)

This task uses 14 sets of 12 slides [16]. Each slide presents four pictures (1 target and 3 distracters) with an auditory cue corresponding to the target image. All participants started from set 10, designated for ages of 14 and above and progressed to the next set only if all items where correct. One or more errors in set 10 results in moving to set 9 and this rule applies until all items within a set are correct. The task was completed if they reached set 14 or if they made 8 mistakes in a particular set. The final score was computed by subtracting the number of errors from the highest possible score.

Raven’s advanced progressive matrices task (set 1)

This test of non-verbal fluid intelligence includes 12 increasingly complex trials [17] with an estimated completion time of ten minutes. Each trial involves identifying the missing part from a geometric shape. Participants were required to select the correct part from eight candidate choices. One point is awarded for each correct answer.

Digit span

Participants are instructed to listen to a sequence of numerical digits [18]. The aim is to repeat the sequence verbatim or in reverse order as instructed by the researcher. Participants were presented with two sequences of two digits. If at least one sequence was answered correctly the next set of sequences including one additional digit was subsequently presented. This was repeated until either two consecutive mistakes for a given sequence length were made or a sequence with nine digits was reached. This process was followed first for the forwards and then for the backwards condition. Scores were recorded according to the number of sequences answered correctly.

Sentence interpretation task

The sentence interpretation task [14,15] was programmed and conducted using E-Prime (version 2.0; [19]). This study extended Filippi et al.’s [14,15] sentence interpretation task to the comprehension of English target sentences in the presence of competing speech in English or in Greek, a language that was not known by any participant. Each sentence featured two animals and participants were asked to determine which of the two animals was performing a bad action towards the other (e.g., biting, bumping, pushing). For example, in the sentence the rabbit is scared by the horse, the horse is the bad animal. The animals featured in the target sentence simultaneously appeared on the screen, one animal on the left and one on the right; the participant pressed the corresponding left/right button on the gamepad to indicate which animal was being bad (see Fig 1).

Fig 1. An illustration of the sentence interpretation task.

Fig 1

Participants were instructed to indicate the animal doing the bad action as fast and accurately as possible. Target sentences were always in English. Competing sentences were either in English or in Greek and always spoken by the opposite gender (e.g., target: man's voice, interference: woman's voice or vice-versa). Control trials were administered without verbal interference.

The target sentences varied in their syntactic complexity, which altered their cognitive load [20]. The easy canonical sentences (Subject-Verb-Object: S-V-O) are less cognitively demanding than the hard non-canonical sentences (Object-Verb-Subject: O-V-S or Object-Subject-Verb: O-S-V; [20]). Examples sentences are shown in Table 2.

Table 2. Example of sentence type (the agent is in bold).

Sentence Type Constituent Order Sentence
Canonical Active (S-V-O) The whale is pushing the frog
Subject Cleft (S-V-O) It's the seal that is pushing the cow
Non-canonical Passive (O-V-S) The whale is pushed by the seal
Object cleft (O-V-S) It's the monkey that the cow is pushing

Each of the English target sentences were presented binaurally with one of three levels of audible interference: (1) no interference–control condition, (2) English speaking interference, (3) Greek speaking interference. Competing sentences in English and Greek always featured a different animal and had different grammatical constructions. A pseudorandom pairing of target and interference sentences ensured that there was no overlap within trials between target animals and actions and interfering animals and actions.

Participants were provided with instructions that included listening to the sentence first and then choosing the bad animal. A practice run was first presented which included two blocks, one with a male and the other one with a female voice, uttering the target sentence. Participants were instructed to listen only to the voice stated at the beginning of each block and ignore the voice of the opposite gender.

Block presentation for the two practice blocks and two experimental blocks were counterbalanced so that half of the participants had a male target voice for the first block and female for the second block and vice versa). The practice blocks included eight trials each and the experimental block included 144 trials. For each trial the animal stimuli appeared on the screen for a maximum of 3000 ms or until a response was selected.

Visual stimuli consisted of black and white animal drawings on a grey background (70 mm x 50 mm) taken from picture databases [21,22]. Verbal auditory stimuli were 144 target sentences spoken by an English female, 144 target sentences spoken by an English male, 24 English interference sentences spoken by an English female and 24 English interference sentences spoken by an English male, 24 Greek interference sentences spoken by a Greek female and 24 Greek interference sentences spoken by a Greek male. Trials were presented in a random order.

Structural image acquisition

Whole brain anatomical T1-weighted images were acquired on a Siemens Sonata scanner housed in the Birkbeck-UCL Centre for Neuroimaging (BUCNI). For each of the 87 participants, 176 sagittal slices were collected with a 256 x 224mm image matrix, providing a 1mm3 voxel resolution (TR/TE/TI = 12.24/3.56/530ms).

Structural image analysis

Pre-processing was applied using the Computational Anatomy Toolbox (cat12) for SPM12 (http://www.neuro.uni-jena.de/cat/). After manual inspection to ensure approximate alignment, initial segmentation was applied using the SPM tissue probability maps and subsequently the tissue probability atlases provided by the International Consortium for Brain Mapping (ICBM). Spatial registration was undertaken in MNI space using a DARTEL template derived from 555 healthy control subjects in the IXI-database (https://brain-development.org/ixi-dataset/) and the shooting template supplied as part of the cat12 toolbox. In order to correct for volumetric changes associated with nonlinear spatial normalisation, voxel values in the segmented grey matter were multiplied by the Jacobian determinant (volume changes) derived from the spatial normalisation stage. These modulated images, therefore, retained the total amount of grey matter from the original images, thereby providing the basis for analysis of volumetric differences between monolingual and bilingual brains and detection of regional volume sensitivity to behavioural performance on our tasks. Images were normalised to Montreal Neurological Institute (MNI) stereotaxic space, and smoothed using an isotropic kernel of 8 mm at full-width half-maximum (FWHM).

Statistical analysis of structural data

A full factorial interaction model was built to identify group effects (ML vs BL) while factoring out variance associated with i. age, ii. Raven’s Matrices raw score, iii. BPVS III scores. Mean task scores on the non-canonical (i.e., ‘difficult’), canonical (‘easy’) interference and control trials in the sentence interpretation task were entered as covariates separately modelled for each group (ML, BL). Scores in both English interference and Greek interference conditions were included in the model. We used volumes of interest within the cerebellum based on findings reported in Filippi et al. [10], as described below.

Results

Behavioural analyses

Accuracy scores in the control condition (i.e., without language interference) were subtracted from those in the verbal interference conditions to obtain a task ability score. The scores are on a negative scale because performance on non-interference (baseline) tasks was generally better than that of interference conditions. As a result, a less negative score indicates better ability to manage interference. All analyses were controlled for age, English vocabulary knowledge, working memory and non-verbal reasoning ability scores. For control of interference, participants had worse performance when the task involved non-canonical sentences with English interference. Ability scores (means and standard errors) are reported and illustrated in Fig 2.

Fig 2. Monolinguals' and bilinguals' ability scores for errors with SE bars in the sentence interpretation task for both canonical and non-canonical sentences in the presence of English and Greek interference.

Fig 2

A 2*2*2 mixed ANOVA with the between-subject factor being Language group (bilinguals, monolinguals) and the within-subjects factors being Sentence type (canonical, non-canonical) and Interference type (English, Greek) was conducted. ANOVA revealed a main effect of Interference type, F(1,85) = 72.12, p < 0.001, ηp2 = .46, and a main effect of Sentence type, F(1,85) = 13.52, p = 0.001, ηp2 = .14. However, there was no significant main effect of Language group, F(1,85) = .91, p = 0.34, ηp2 = .01, indicating that the English monolingual and the bilingual participants had comparable performance in all experimental conditions.

There were no significant Language group * Sentence type and Language group * Interference type interactions, F(1,85) = 2.85, p = 0.10, ηp2 = .03; F(1,85) = .68, p = 0.78, ηp2 = .01, respectively. The three-way interaction Sentence type * Interference type * Language group was also non-significant, F(1,85) .71, p = 0.40- = , ηp2 = .01.

In summary, behavioural analysis for errors did not reveal any significant group differences in comprehension of English target sentences in the presence of English or Greek interference.

Voxel-based morphometry results

We identified a priori volumes of interest within the cerebellum. We took the peak coordinate reported in Filippi et al. [10] where there was a positive correlation between grey matter density and control of interference in the sentence interpretation task, and applied a 10mm radius volume of interest at that coordinate (x = +12 y = -64 z = -42). For completeness we ran analyses in both hemispheres. All reported effects were significant at p = .001, FWE corrected for multiple comparisons at p = .05.

A direct group comparison revealed more grey matter volume in bilinguals over monolinguals within our volume of interest in the right hemisphere as shown in Table 3 and Fig 3. No effects were observed in the left hemisphere, or for monolinguals over bilinguals.

Table 3. Differences in grey matter volume for bilinguals relative to monolinguals.

Effect Region Peak Z P (FWE corr)
Bilinguals > monolinguals Right hemisphere:
10mm VOI at x +12 y -64 z -42 18–63–48 3.5 .009
Left hemisphere:
10mm VOI at x -12 y -64 z -42 - - -

No effects were observed for monolinguals over bilinguals.

Fig 3. Group comparison of cerebellar grey matter volume, greater in bilinguals.

Fig 3

Sections taken at x = 18 y = -63 z = -48. There were no effects for monolinguals > bilinguals.

Volumetric sensitivity to performance on the sentence interference task

There was no main effect for interference (averaged across English and Greek conditions) relative to control trials or sentence type (canonical vs noncanonical) within our volumes of interest. Furthermore, there was no evidence for differences in volumetric sensitivity to the control of English (i.e., familiar) interference relative to control performance within our full sample, within either group or by sentence type (canonical/noncanonical). There was no main effect for control of Greek interference across all participants. However, when we modelled monolingual and bilingual performance on noncanonical sentences relative to control performance separately we found significant volumetric sensitivity in our bilinguals but not our monolinguals and there was a significant group (bilingual/monolingual) x condition (Greek interference/control) interaction. These effects held in both hemispheres, as shown in Table 4. Fig 4C shows the spatial extent of the volumetric sensitivity for the interaction effect below the structural effects (4a) and functional effects (4b) reported in Filippi et al. [10].

Table 4. Volumetric sensitivity within the cerebellum to performance (ability scores) on the sentence interpretation task.
Effect Region Peak Z P (FWE corr)
Right hemisphere:
Condition: 10mm VOI at x +12 y -64 z -42
Greek interference vs control: - - -
Group: Bilinguals 9–62–51 3.40 .012
Monolinguals - - -
Group x condition interaction 9–63–51 3.87 .003
Left hemisphere:
Condition: 10mm VOI at x -12 y -64 z -42
Greek interference vs control: - - -
Group: Bilinguals -15–65–48 3.47 .010
Monolinguals - - -
Group x condition interaction -14–65–50 4.74 < .001

There were no group differences in grey matter sensitivity to ability scores in the context of English interference and no areas of the cerebellum that showed greater sensitivity to task performance in monolinguals relative to bilinguals.

Fig 4.

Fig 4

a) Structural imaging results from Filippi et al. [10] shown at x = 12, y = -64, z = -42. White area shows where grey matter density was higher in those bilinguals (N = 26) with better control of interference; b) Functional imaging results from Filippi et al. [10] shown at x = 20, y = -64, z = -42. White area shows where activation was higher when German participants (N = 8) performed semantic decisions on written words in native vs English interference; c. Results from the current study shown at x = 12, y = -64, z = -42. White area shows where the difference in volumetric sensitivity across conditions (Greek interference and control trials) differed significantly as a function of group (bilingual/monolingual).

The source of the group x condition interaction, in both the right and left VOI is demonstrated in Fig 5. Here, raw beta values (i.e., unadjusted for the other covariates in our model) are plotted against ability scores (interference minus control performance) on the noncanonical sentences. There was a significant positive correlation between ability score and grey matter volume in our bilingual participants, but this correlation was nonsignificant (and negative) in our monolinguals, a pattern which held true in both hemispheres. In both VOIs, using the Fisher r-to-z transformation, correlation coefficients were significantly stronger in the bilingual sample (LH: z = 3.19, p < .01; RH: z = 2.78, p < .01, two-tailed).

Fig 5. Plots show correlations of raw beta values (grey matter volume) within 10mm radius spherical ROIs (centred around -12–64–42 and +12–64–42) against task ability score in the context of Greek interference.

Fig 5

Discussion

In this study, we investigated the role of cerebellar areas in the control of interference in speech comprehension. We extended our previous research (which employed only a bilingual sample) to include a sample of English monolinguals. This new design allowed us to systematically address whether multilanguage acquisition causes structural change observed within the cerebellum.

We acquired raw structural images from a large group of adult individuals (N = 87), split in two groups: English monolinguals (N = 41) and bilinguals of different linguistic backgrounds (N = 46). Their age ranged from 18 to 80 years old. Voxel-based morphometry was used to identify grey matter markers of processing ability on brain structure across the adult lifespan. Consistent with previous work [10] we first acquired data on a behavioural test and then acquired structural MRI data. As a result, all participants performed a sentence interpretation task with different levels of grammatical complexity (canonical and non-canonical sentences), in the presence of verbal interference outside the scanner. Verbal interference was generated by the simultaneous presentation of competing speech in English and Greek. Statistical analysis on behavioural data, that is, ability scores in sentence comprehension accuracy, did not provide any significant difference between the two groups in all experimental conditions. MRI results demonstrated greater absolute volume and volumetric GM sensitivity to Greek interference in bilinguals relative to monolinguals in the same area of lobule VIII reported by Filippi et al. [10].

In what ways does this study differ from our previous findings?

Our findings support the claim [10] that the cerebellum is functionally involved in controlling verbal interference. Unlike the earlier study involving only bilinguals, however, the task sensitivity effects were bilateral, perhaps indicating shared/interhemispheric functionality rather than strong lateralisation for language processing and control in the cerebellum. Moreover, in the current study the structure-performance correlations were observed in the modulated rather than unmodulated data, indicating volumetric rather than density sensitivity in the cerebellum.

Our data support the claim that the acquisition of a second language impacts on the distributed networks underpinning language processing but also that these effects are not associated with better performance, as indicated by statistically equivalent performance across the groups. Thus, while we have detected robust differences in volumetric sensitivity within the cerebellum in the control of verbal interference, as well as greater absolute cerebellar volume in bilinguals, there was no cognitive advantage at the behavioural level. These findings are inconsistent with our earlier behavioural work with the sentence interference task [14]. However, in the present study, the task was modified to include a linguistic but semantically non-meaningful condition (i.e., in which the interference was presented in Greek, a language unfamiliar to all participants). Moreover, rather than testing a relatively homogenous group of bilinguals (Italian/English in the 2012 study) and presenting target sentences in the first language in the bilingual group (Italian) and English in the monolingual group, the bilinguals in the present study were drawn from a broad range of linguistic groups and the target sentences were presented only in English. Given these systematic differences in task design and sample characteristics, a clear-cut interpretation of the inconsistent behavioural results across our studies is not straightforward. It is possible that the simpler task design and more constrained sample characteristics employed in our 2012 study may have conferred greater sensitivity for detecting group effects but this is purely speculative. Nevertheless, our current set of findings are consistent with other authors who have also highlighted a complex and ambiguous relationship between structural variability and performance/ability [23,24,25,26,27,28]. These authors have provided evidence that contradicts earlier findings for a possible bilingual advantage in cognitive control (see [29], for an extensive review).

Why did we find the effect in the control of unfamiliar (Greek) linguistic interference?

We expected that structure/performance correlations would be strongest when controlling interference in the familiar target language (English sentences with English interference). Contrary to our predictions the effect was reliable only in the unfamiliar language interference condition (English sentences with Greek interference). This unexpected finding suggests that the role of the cerebellum might relate more to the orienting of attention than interference control per se. Although speculative, we suggest that bilinguals may show more sensitivity to unfamiliar languages and therefore develop resources to manage the additional processing demands associated with selectively attending to a known target language against unfamiliar linguistic noise. Therefore, the bilateral volumetric sensitivity in the cerebellum may reflect this requirement to selectively attend to the target language while monitoring concurrent unfamiliar verbal information. To our knowledge, whether attention in bilinguals is more likely to be automatically engaged by the linguistic properties of an unfamiliar language is currently unknown but, if so, it might provide a parsimonious explanation for our findings. Nevertheless, we are also alert to the possibility of false positives recently highlighted as particularly problematic in structural MRI studies on bilingualism [30]. Our sample size of 87 (46 bilinguals) is notably larger than most in this literature, and the findings themselves part-replicate our earlier work [10], yet we would encourage replication and attempts to further delineate the role of the cerebellum in bilingual cognition.

Summary

Traditionally, the cerebellum has not been included in models of language processing. More recent research indicates an important role in the cerebellum in language comprehension [31], language perception [32] and language production [33]. Our paper contributes to this literature, demonstrating that bilingualism confers structural differences within lobule VIII and may play an important role in the resolution of linguistic competition in noisy environments. Further work should explore the role of the cerebellum in selective attention in language processing at a functional level. Research should also exploit structural MRI to resolve the comparative significance of volumetric and density sensitivity within the cerebellum in the control of linguistic interference.

Acknowledgments

We thank Prof. Cathy Price for her valuable comments. A special thought goes to Prof. Annette Karmiloff-Smith who inspired our research.

Data Availability

The data are available on Figshare (DOI: 10.6084/m9.figshare.12024795).

Funding Statement

This work was supported by the Leverhulme Trust UK [RPG-2015-024], obtained by RF and PB. https://www.leverhulme.ac.uk/ The funders had no role in the design or any other components of this study.

References

  • 1.Ali N, Green DW, Kherif F, Devlin JT, Price CJ (2010) The role of the left head of caudate in suppressing irrelevant words. J Cogn Neurosci 22:2369–2386. 10.1162/jocn.2009.21352 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Rodriguez-Fornells A, Rotte M, Heinze HJ, No¨sselt T, Münte TF (2002) Brain potential and functional MRI evidence for how to handle two languages with one brain. Nature 415:1026–1029. 10.1038/4151026a [DOI] [PubMed] [Google Scholar]
  • 3.Rodriguez-Fornells A, van der Lugt A, Rotte M, Britti B, Heinze HJ, Münte TF (2005) Second language interferes with word production in fluent bilinguals: brain potential and functional imaging evidence. J Cogn Neurosci 17:422–433. 10.1162/0898929053279559 [DOI] [PubMed] [Google Scholar]
  • 4.Jansen A, Flöel A, Van Randenborgh J, Konrad C, Rotte M, Fo¨rster AF, et al. (2005) Crossed cerebro-cerebellar language dominance. Hum Brain Mapp 24:165–172. 10.1002/hbm.20077 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Schweizer TA, Alexander MP, Susan Gillingham BA, Cusimano M, Stuss DT (2010) Lateralized cerebellar contributions to word generation: a phonemic and semantic fluency study. Behav Neurol 23:31–37. 10.3233/BEN-2010-0269 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Alexander MP, Stuss DT, Picton T, Shallice T, Gillingham S (2007) Regional frontal injuries cause distinct impairments in cognitive control. Neurology 68:1515–1523. 10.1212/01.wnl.0000261482.99569.fb [DOI] [PubMed] [Google Scholar]
  • 7.Krienen FM, Bucker RL (2009) Segregated fronto-cerebellar circuits revealed by intrinsic functional connectivity. Cereb Cortex 19:2485–2497. 10.1093/cercor/bhp135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hodge SM, Makris N, Kennedy DN, Caviness VS Jr, Howard J, McGrath L, et al. (2010) Cerebellum, language, and cognition in autism and specific language impairment. J Autism Dev Disord 40:300–316. 10.1007/s10803-009-0872-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Stoodley CJ, Schmahmann JD (2009) Functional topography in the human cerebellum: a meta-analysis of neuroimaging studies. Neuroimage 44:489–501. 10.1016/j.neuroimage.2008.08.039 [DOI] [PubMed] [Google Scholar]
  • 10.Filippi R, Richardson FM, Dick F, Leech R, Green DW, Thomas MSC, et al. (2011) The Right Posterior Paravermis and the Control of Language Interference. J Cogn Neurosci 31:10732–10740. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bates E., Devescovi A., & Wulfeck B. (2001). Psycholinguistics: A cross-language perspective. Annu Rev Psychol 52:369–398. 10.1146/annurev.psych.52.1.369 [DOI] [PubMed] [Google Scholar]
  • 12.MacWhinney B, Bates E (1989). Cross-linguistic study of sentence processing. New York: Cambridge University Press. [Google Scholar]
  • 13.Papageorgiou A, Bright P, Periche Tomas E, Filippi R. (2019) Evidence against a cognitive advantage in the older bilingual population. Quarterly Journal of Experimental Psychology. June;72(6):1354–63. [DOI] [PubMed] [Google Scholar]
  • 14.Filippi R, Leech R, Thomas MS, Green DW, Dick F (2012) A bilingual advantage in controlling language interference during sentence comprehension. Biling-Lang Cogn 15: 858–872. [Google Scholar]
  • 15.Filippi R, Morris J, Richardson FM, Bright P, Thomas MS, Karmiloff-Smith A, et al. (2015) Bilingual children show an advantage in controlling verbal interference during spoken language comprehension. Biling-Lang Cogn 18: 490–501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Dunn M, Dunn LM (1997) Peabody Picture Vocabulary Test: Circle Pines (3rd ed). Minneapolis, MN: AGS. [Google Scholar]
  • 17.Raven J, Raven JC, Court JH (1998) Manual for Raven’s Progressive Matrices and Vocabulary scales Section 1: General overview. Oxford, UK: Oxford Psychologists Press. [Google Scholar]
  • 18.Wechsler D (2008) Wechsler Adult Intelligence Scale (4th ed). Houston, TX: Pearson. [Google Scholar]
  • 19.Schneider W, Eschman A, Zuccolotto A (2002) E-Prime (version 2.0) [Computer software and manual]. Pittsburgh, PA: Psychology Software Tools. [Google Scholar]
  • 20.Roland D, Dick F, Elman JL (2007) Frequency of basic English grammatical structures: A corpus analysis. J Mem Lang 57:348–379. 10.1016/j.jml.2007.03.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Abbate MS, LaChapelle NB (1984) Pictures, please! Tucson (AZ): Communication Skill Builders. [Google Scholar]
  • 22.Snodgrass J G, Vanderwart M (1980) A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. J Exp Psychol Learn Mem Cogn. 6:174–215. [DOI] [PubMed] [Google Scholar]
  • 23.Paap KR, Greenberg ZI (2013) There is no coherent evidence for a bilingual advantage in executive processing. Cogn Psychol 66:232–258. 10.1016/j.cogpsych.2012.12.002 [DOI] [PubMed] [Google Scholar]
  • 24.Paap KR, Johnson HA, Sawi O (2015) Bilingual advantages in executive functioning either do not exist or are restricted to very specific an undetermined circumstances. Cortex 68:265–278. [DOI] [PubMed] [Google Scholar]
  • 25.Duñabeitia JA, Hernandez JA, Anton E, Macizo P, Estevez A, Fuentes LJ, et al. (2014) The inhibitory advantage in bilingual children revisited myth or reality? Exp Psychol 61:234–251. 10.1027/1618-3169/a000243 [DOI] [PubMed] [Google Scholar]
  • 26.Duñabeitia JA, Carreiras M (2015) The bilingual advantage: Acta est fabulosa. Cortex 73:371–372. 10.1016/j.cortex.2015.06.009 [DOI] [PubMed] [Google Scholar]
  • 27.Hilchey MD, Klein RM (2011) Are there bilingual advantages on non-linguistic interference tasks? Implications for the plasticity of executive control processes. Psychon Bull Rev 18:625–658. 10.3758/s13423-011-0116-7 [DOI] [PubMed] [Google Scholar]
  • 28.Klein RM (2015) Is there a benefit of bilingualism of executive functioning? Biling-Lang Cogn 18:29–31. [Google Scholar]
  • 29.Bialystok E. (2017). The bilingual adaptation: How minds accommodate experience. Psychological bulletin, 143(3), 233 10.1037/bul0000099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Munson BA, Hernandez AE. Inconsistency of findings due to low power: A structural MRI study of bilingualism. (2019) Brain and language. August 1;195:104642 10.1016/j.bandl.2019.104642 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Moberget T, Ivry RB (2016) Cerebellar contributions to motor control and language comprehension: Searching for common computational principles. Ann N Y Acad Sci 1369: 154–171. 10.1111/nyas.13094 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Schwartz M, Kotz SA (2016) Contributions of cerebellar event-based temporal processing and preparatory function to speech perception. Brain Lang 161:28–32. 10.1016/j.bandl.2015.08.005 [DOI] [PubMed] [Google Scholar]
  • 33.Pleger B, Timmann D (2018) The role of the human cerebellum in linguistic prediction, word generation and verbal working memory: Evidence for brain imaging, non-invasive cerebellar stimulation and lesion studies. Neuropsychologia 115:204–210. 10.1016/j.neuropsychologia.2018.03.012 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Claudio Mulatti

28 Jan 2020

PONE-D-19-34005

A role for the cerebellum in the control of verbal interference: comparison of bilingual and monolingual adults

PLOS ONE

Dear Dr Filippi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As you will see, both reviewers have some concerns: Reviewer 1 (Kenneth R. Paap) suggested minor revisions; Reviewer 2 suggested major revisions. I have read the manuscript myself, and I agree with the reviewers as there are some issues that need to be addressed properly before publication – I refer to the reviews for details. If you will decide to revise your manuscript, please pay particular attention to point 1) of Reviewer 2.

We would appreciate receiving your revised manuscript by Mar 13 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Claudio Mulatti, Ph.D.

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

3. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

4. We note you have included tables to which you do not refer in the text of your manuscript. Please ensure that you refer to Tables 3 and 4 in your text; if accepted, production will need this reference to link the reader to the Tables.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: One purpose of the study was to compare bilinguals to monolinguals in ability to comprehend spoken sentences in the presence of verbal interference. No differences were observed. The authors could say more regarding the implications of these null results. An additional purpose was to examine grey matter density in the cerebellum and how individual differences in density relate to differences in verbal interference. The interesting result with respect to this second question was that there was a significant positive correlation, but only for the bilinguals and only when the interference was from an unfamiliar language (Greek). I did not understand the logic underlying the conjecture that this pattern reflected selective attention rather than the control of interference. The study should be of interest to cognitive neuroscience types who have keen interests in localizing cognitive functions. The fact that the behavioral results showed no difference between bilinguals and monolinguals is surprising.

Reviewer #2: The author's present a work that links structural differences in the vermis is related to control of interference in a sentence interpretation task. Overall, the manuscript finds a link between verbal interference and brain structure. I had three particular comments on the work:

1) It was not clear whether the first author was simply referring to previous work of his when referring to the sentence intepretation task. The original task developed by Bates and Macwhinney was tested in multiple languages and also tested with bilinguals. It seems as if the authors are trying to claim credit for work developed by others in the field.

2) The presence of two groups of over 40 subjects per group is relatively high for fMRI studies. However, recent work in the field particularly from Munson and Hernandez (BRLN, 2019) suggests that even this number of subjects may lead to unreliability of the findings. Specifically, it opens up the possibility of a false positive. This should be discussed at the very least as a limitation. Possible steps for ameliorating the situation could be taken, including using multivariate analyses.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Kenneth R. Paap

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Apr 21;15(4):e0231288. doi: 10.1371/journal.pone.0231288.r002

Author response to Decision Letter 0


4 Feb 2020

We thank both Reviewers for confirming that our work is technically sound, has appropriate control and sample sizes and meets all other requirements for being recognised as a rigorous study.

We address all their specific comments below.

Reviewers' comments:

Reviewer 1: One purpose of the study was to compare bilinguals to monolinguals in ability to comprehend spoken sentences in the presence of verbal interference. No differences were observed. The authors could say more regarding the implications of these null results.

Our response: We have included further considerations with respect of our previous study (Filippi et al., 2012). The amended text has been added to the manuscript on page 19.

These findings are inconsistent with our earlier behavioural work with the sentence interference task (Filippi et al., 2012). However, in the present study, the task was modified to include a linguistic but semantically non-meaningful condition (i.e., in which the interference was presented in Greek, a language unfamiliar to all participants). Moreover, rather than testing a relatively homogenous group of bilinguals (Italian/English in the 2012 study) and presenting target sentences in the first language in the bilingual group (Italian) and English in the monolingual group, the bilinguals in the present study were drawn from a broad range of linguistic groups and the target sentences were presented only in English. Given these systematic differences in task design and sample characteristics, a clear-cut interpretation of the inconsistent behavioural results across our studies is not straightforward. It is possible that the simpler task design and more constrained sample characteristics employed in our 2012 study may have conferred greater sensitivity for detecting group effects but this is purely speculative. Nevertheless, our current set of findings are consistent with other authors who have also highlighted a complex and ambiguous relationship between structural variability and performance/ability (Paap & Greenberg, 2013; Paap, Johnson and Sawi, 2015; Dunabeitia et al., 2014, Dunabeitia & Carreiras, 2015; Hiltchey & Klein, 2011; Klein, 2015).

-----

An additional purpose was to examine grey matter density in the cerebellum and how individual differences in density relate to differences in verbal interference. The interesting result with respect to this second question was that there was a significant positive correlation, but only for the bilinguals and only when the interference was from an unfamiliar language (Greek). I did not understand the logic underlying the conjecture that this pattern reflected selective attention rather than the control of interference. The study should be of interest to cognitive neuroscience types who have keen interests in localizing cognitive functions. The fact that the behavioral results showed no difference between bilinguals and monolinguals is surprising.

Our response: We have included additional clarification suggesting that attention in bilinguals is more likely to be automatically engaged by unfamiliar linguistic information and made this point on page 20 (amended text below)

To our knowledge, whether attention in bilinguals is more likely to be automatically engaged by the linguistic properties of an unfamiliar language is currently unknown but, if so, it might provide a parsimonious explanation for our findings.

-----

Reviewer 2: The author's present a work that links structural differences in the vermis is related to control of interference in a sentence interpretation task. Overall, the manuscript finds a link between verbal interference and brain structure. I had three particular comments on the work:

It was not clear whether the first author was simply referring to previous work of his when referring to the sentence intepretation task. The original task developed by Bates and Macwhinney was tested in multiple languages and also tested with bilinguals. It seems as if the authors are trying to claim credit for work developed by others in the field.

Our response: This was certainly not our intention and we apologize for giving this impression. In our previous work we provide ample reference to the work of Bates and others. We have now included reference to the paradigm developed by Bates and colleagues which underpins our task. Please find the amended text below and on page 4 in the manuscript.

This was achieved through the administration of a dichotic listening task primarily adapted from a paradigm designed by Bates and colleagues (Bates et al., 2001; MacWhinney & Bates, 1989) in which the participants were required to identify the agent in a series of sentences that differed in terms of structural complexity and in the absence and/or presence of interfering sentences.

The presence of two groups of over 40 subjects per group is relatively high for fMRI studies. However, recent work in the field particularly from Munson and Hernandez (BRLN, 2019) suggests that even this number of subjects may lead to unreliability of the findings. Specifically, it opens up the possibility of a false positive. This should be discussed at the very least as a limitation. Possible steps for ameliorating the situation could be taken, including using multivariate analyses.

Our response: We thank the Reviewer for alerting us to this important work by Munson & Hernandez (2019). We have included consideration in the amended text below (page 20 in the manuscript).

Nevertheless, we are also alert to the possibility of false positives recently highlighted as particularly problematic in structural MRI studies on bilingualism (Munson & Hernandez, 2019). Our sample size of 87 (46 bilinguals) is notably larger than most in this literature, and the findings themselves part-replicate our earlier work (Filippi et al., 2011), yet we would encourage replication and attempts to further delineate the role of the cerebellum in bilingual cognition.

We considered our manuscript improved and thank the Reviewers for their very useful comments. We hope that this revised manuscript is now considered suitable for publication in PLoS ONE.

Yours sincerely,

Roberto Filippi & Peter Bright

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Claudio Mulatti

20 Mar 2020

A role for the cerebellum in the control of verbal interference: comparison of bilingual and monolingual adults

PONE-D-19-34005R1

Dear Dr. Filippi,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Claudio Mulatti, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: The authors have done a very good job of revising the manuscript. They have addressed all of the issues raised in the initial review.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Kenneth R Paap

Reviewer #2: No

Acceptance letter

Claudio Mulatti

3 Apr 2020

PONE-D-19-34005R1

A role for the cerebellum in the control of verbal interference: comparison of bilingual and monolingual adults

Dear Dr. Filippi:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Claudio Mulatti

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    The data are available on Figshare (DOI: 10.6084/m9.figshare.12024795).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES