Abstract
Due to increasing cultural, linguistic, and educational diversity in older populations across Europe, accurate assessment of cognitive functioning in people from diverse backgrounds becomes increasingly important. This paper aims to provide a state-of-the-art review of cognitive assessment in culturally, linguistically, and educationally diverse older populations in Europe, focusing on challenges and recent advances in cross-cultural assessment. Significant work has been carried out on the identification of challenges in cognitive assessment in culturally, linguistically, and educationally diverse older populations and on development and validation of cross-cultural cognitive tests. Most research has addressed the influences of language barriers, education and literacy, and culture and acculturation and in particular, the European Cross-Cultural Neuropsychological Test Battery (CNTB) and the Rowland Universal Dementia Assessment Scale (RUDAS) are well-validated across European countries. However, cross-cultural cognitive assessment is largely still a developing field in Europe, and there is a continuing need for developments within the field.
Keywords: cognitive assessment, diversity, culture, language, education, illiteracy, dementia, Alzheimer’s disease
Introduction
Due to demographic aging, the global prevalence of cognitive disorders is expected to increase significantly over the coming decades. 1 At the same time, migration and globalization are currently changing populations throughout most World regions, resulting in increasingly culturally, linguistically, and educationally diverse older populations. Although a certain degree of ethnic diversity has always been present in European countries, this diversity has increased greatly over the last decades. This began with the immigration of labor workers from countries outside the European Union (EU) from 1950 to 1974 and the immigration of people from once-colonized countries, followed by the influx of asylum seekers and refugees in more recent years. 2 In 2019, non-EU immigrants made up about 5% (21.8 million people) of the total EU population. 3 Incidence, prevalence and clinical presentation of cognitive disorders may differ between ethnic or cultural groups depending on their geographical origin, genetic background, gender and age. 4 At the same time, the presence of cultural, language and educational barriers may significantly affect diagnosis, treatment and care of cognitive disorders.5-7 Several minority ethnic groups in European countries are at an increased risk of medical conditions that increase risk of cognitive disorders, such as stroke, diabetes mellitus, and hypertension.8,9 As a result, patients from minority ethnic groups are increasingly being referred for assessment in European memory clinics and other diagnostic services. 10
Despite recent progress in the development and implementation of biomarkers in the diagnostic workup for Alzheimer’s disease (AD) and other cognitive disorders, formal cognitive testing retains a key role in the clinical assessment and is fundamental for early accurate diagnosis and for planning treatment, support and care. 11 However, most routinely used cognitive tests originate from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) cultures 12 and may be inappropriate or even misleading when assessing people with different cultural backgrounds. This is particularly evident in the case of older migrants with limited schooling and proficiency in the majority language in the receiving country. 13 As cultural, linguistic and educational diversity significantly influences cognitive assessment, assessment practices need to be adapted to suit these diverse populations – a need that has been internationally recognized and is reflected in the standpoints of the European Consortium on Cross-Cultural Neuropsychology (ECCroN). 14
The aim of this paper is to provide a state-of-the-art review of cognitive assessment in culturally, linguistically, and educationally diverse older populations in Europe, focusing on challenges and recent advances in cross-cultural assessment.
Challenges in Cross-Cultural Cognitive Assessment
Several issues may pose unique challenges to cognitive assessment in older minority ethnic populations in Europe. However, to date most research has addressed the influences of language barriers, education and literacy, and culture and acculturation.
Language Barriers
Limited proficiency in the host country language is widespread among older people in some minority ethnic groups, including Moroccans and Turks in the Netherlands, South Asians in the United Kingdom, Turks in Germany, and Turks and Vietnamese in Belgium.15-17 The language in which cognitive tests are administered, as well as the level of formality used, has been shown to significantly impact communication, rapport, and subsequent test scores. 18 As only few European clinicians speak relevant minority languages, interpretation through (formal or informal) interpreters is often needed to assess patients in their native language. 19 Otherwise, cognitive assessment may take place in the second, third or even fourth language, which is likely to affect test performance. Thus, a Swedish study on second language effects on cognitive test performance found that assumptions of Swedish fluency based on a short interview may be misleading and that second language effects may contribute to misclassification of non-native speakers. 20 Furthermore, cognitive tests have rarely been developed for interpreter-mediated assessment and the validity of test items after in-situ interpretation from 1 language to another is generally unknown. 21 For instance, it may be highly challenging to provide quick and accurate translation during a verbal fluency test, or to translate the content of syntactically complex sentences used for repetition tasks in a meaningful way,22,23 including the sentences included in the Mini-Mental State Examination (MMSE) 24 and Montreal Cognitive Assessment (MoCA). 25
Several studies have explored communicative, relational, and ethical issues when informal interpreters are used in clinical contexts and the use of relatives as interpreters is generally discouraged.14,26 However, this is complicated by the fact that access to interpreter services and the training of formal interpreters differ greatly between and within European countries.19,22 Thus, the use of formal interpreters may be challenging as well, especially for cognitive tests with high demands on the abilities of the interpreter or when interpreters have received little formal training.22,23 Despite these limitations of conducting interpreter-mediated cognitive assessments, involvement of formal interpreters in cognitive assessment of linguistically diverse patients is generally recommended by ECCroN. 14
Education and Literacy
Although the level of education is heterogeneous both across and within minority ethnic groups, low education levels or illiteracy are common among older people from various minority ethnic groups in Europe.16,17 For example, 17%–36% of older Turkish and Moroccan first-generation immigrants in the Netherlands are illiterate, and more than half (50%–90%), especially women, have not completed any form of formal education. 27 Illiteracy, a limited number of years of education, as well as a low quality of education significantly impact cognitive tests scores across several cognitive domains.27-34 Patients who are illiterate may also experience more discomfort in testing situations due to unfamiliarity with the setting, the content of the tests, or differences in what is considered a good response. 35 Several studies indicate that the effect of schooling and education on cognitive test performance is not linear but rather represents a negatively accelerated curve tending to a plateau.36-38 For instance, a Danish study found MMSE and clock drawing test performances in middle-aged and older Turkish migrants in to increase rapidly between groups with no formal schooling and (some) primary schooling, less rapidly between groups with primary schooling and secondary schooling, and little further beyond secondary schooling. 37 Also, as the length, quality, and content of the school day and year may vary considerably from country to country and even from school to school in some countries, 39 it may be inappropriate or even misleading to apply European norms to immigrants who have their education from a school system that differs greatly from the Western ones.
Illiteracy is frequently higher among migrant women due to cultural attitudes found in some countries. This is more pronounced in older women as it is generally easier and considered more important to attend school today than it was several decades ago. 33 As most cognitive tests originate from WEIRD cultures, information on the normal or expected range of test performance in people with very little or no formal schooling is generally not widely available. This may make it challenging to interpret test results from people who are illiterate and without formal schooling as they are likely to perform like patients with cognitive disorders on routinely used cognitive tests. 39 Striking examples from studies in unschooled illiterate Turkish migrants in Denmark are performances on visuocontructional tests such as the clock drawing test, overlapping pentagons and Necker cube included in the MMSE, 24 MoCA 25 and Addenbrookes Cognitive Examination (ACE), 40 which may be extremely difficult for people without formal school experience due to little geometric knowledge and experience with using a pen. 39 However, it has been suggested that the influence of illiteracy and little formal school experience on test performance can be reduced by using tests with higher ecological relevance for people without formal school experience; that is, tests relying on elements and strategies from everyday life rather than the classroom.31,41,42
Culture and Acculturation
Minority ethnic groups and immigration patterns differ between European countries. However, the largest minority ethnic groups across Europe originate from South Asian, Middle Eastern, and North African, predominantly collectivist Muslim, cultures. 43 Other significant minority ethnic groups are mainly found in specific European countries, including groups of Sub-Saharan African origin in the United Kingdom and France and of Latin American origin in Spain. Additionally, notable minority ethnic groups include the Roma, who are found across most of Europe, indigenous peoples such as the Saami in Sweden, Norway, Finland, and Russia, and Irish Travelers. Acculturation toward the dominant culture differs greatly between and within minority ethnic groups and is closely associated with other factors, such as generation in the country, language proficiency, migration history, and level of education. 44 In particular the “guest workers,” who came to Europe as labor migrants in the post-World War II period, generally have limited levels of acculturation toward the dominant culture as they were initially expected to return to their countries of origin after a number of years - often resulting in a delay of decades in the development of policies promoting social integration and acculturation. 2
It often poses a significant challenge to European clinicians to determine which tests and normative data are most appropriate for these heterogeneous populations. 19 Cultural differences may impact the cognitive assessment in several ways. The patient may have different expectations of (the purpose of) the assessment, of what is relevant information, and of what information may be shared with a stranger. 45 A clinician from the majority group may not automatically be trusted. Some patients and families fear unfair treatment or misunderstanding of their complaints and way of life. For example, if asked about the burden of providing informal care for an older family member, relatives from collectivist, family-oriented, cultures may object to this as they do not consider themselves to be caregivers. They just do their expected duty as a daughter or son. 7 Additionally, culture influences communication styles, idioms of distress, and the way symptoms may manifest themselves.6,35 Also, a Danish study showed found lower levels of acculturation towards mainstream Danish culture to be associated with poorer performance on tests of mental speed and executive functioning - even when tests were administered in the person’s native language and scores were corrected for other demographics. 44 Finally, culture and acculturation may influence test scores when tests include “Western items” or when the tests involve culture-specific testing elements and strategies.13,18 Culture-dependent elements are evident in many cognitive tests, including the figures, pictures, words, sentences, etc. included in widely used cognitive screening tests such as the MMSE, MoCA and ACE46-48 Questions about national royalty or political leaders may be familiar to most people in the majority culture. However, they may be unfamiliar or virtually unknown to people from minority cultures, including those who have migrated from a different geographical area. 49 Also, cognitive assessment using the discrepancy between age and date of birth may disadvantage older people born in rural areas with poor birth registration facilities, and those who may have altered age and date of birth to facilitate migration. 49 Different concepts of orientation in time and place in different cultures and preferential use of the Western (Gregorian) or another calendar system may also influence performance on the orientation questions included in many commonly used cognitive screening tests. 18
All these factors related to language barriers, education and literacy, and culture and acculturation pose challenges to the assessment of older patients from minority ethnic groups and have initiated recent developments in cross-cultural cognitive assessment in Europe. In contrast to most North American initiatives that have generally focused on adapting and standardizing well-established tests or batteries for specific languages or ethnic groups (eg, Hispanics or African Americans),50,51 European efforts have generally aimed at developing and validating cognitive tests and batteries for use across diverse ethnic groups.
Advances in Cross-Cultural Cognitive Assessment
Strategies for overcoming some of the challenges associated with cognitive assessment in diverse older populations include the use of cross-culturally validated cognitive tests. Internationally, several cognitive tests have been adapted, validated and normed for cognitive examination in specific languages, cultures and educational groups, including cognitive screening tests such as the MMSE, MoCA, and ACE46-48 However, to develop a feasible solution for the clinical reality in Europe, in which patients may differ widely in their cultural, language, and educational characteristics, the general approach has been to design and/or validate instruments with potential applicability across groups with diverse sociocultural characteristics. A recent Delphi expert study found that considerable work has been carried out in the development and validation of cross-cultural cognitive tests for older minority ethnic populations in Europe 19 (See Table 1). In particular, the European Cross-Cultural Neuropsychological Test Battery (CNTB) 43 and the Rowland Universal Dementia Assessment Scale (RUDAS), 52 which was originally developed for multicultural populations in Australia, were found to be well-validated across European countries. These instruments have been studied in people from numerous minority groups, with a wide variety of education levels, in studies from across multiple European countries.27,30,31,44,53-59 More recently, the RUDAS has also been validated in an older Innuit population in Greenland. 60 Together, these instruments measure a variety of cognitive functions including general cognitive functioning (RUDAS), memory (Recall of Pictures Test, Enhanced Cued Recall and recall of a semi-complex figure), language (Picture naming and semantic verbal fluency), executive functions (Color Trails Test, 5 Digit Test and Serial Threes), and visuospatial functions (Clock Reading Test, Clock Drawing Test and copying of simple and semi-complex figures). For some of the other instruments identified in this study, only few validation studies had been published for the target population. 19 However, better cross-culturally validated instruments used in some countries include the Cross-Cultural Dementia screening, 61 modified Visual Association Test, 62 and Naming Assessment in Multicultural Europe 63 in the Netherlands, the Multicultural Cognitive Examination 57 in Denmark, Norway and Sweden, and 9 Images test of the district of Seine-Saint-Denis, 64 Memory Associative Test of the district of Seine-Saint-Denis, 65 and Switching Verbal Fluency Test 66 in France.
Table 1.
Cognitive Instruments Designed and/or Validated for Cross-Cultural Cognitive Assessment in Diverse Older Populations in Europe.
Instrument | Primary reference(s) |
---|---|
Cognitive screening tests | |
Rowland universal dementia assessment scale (RUDAS) | 52,56 |
Cross-cultural dementia screener (CCD) | 61 |
EASY | 78 |
Multicultural cognitive examination (MCE) | 57 |
Neuropsychological test battery | |
European cross-cultural neuropsychological test battery (CNTB) | 43,58 |
Memory tests | |
Nine images test of the district of seine-saint-denis (TNI-93) | 64 |
Memory associative test of the district of seine-saint-denis (TMA-93) | 65 |
Modified visual association test | 62 |
Language tests | |
Cross-linguistic naming test | 79,80 |
Naming assessment in multicultural Europe (NAME) | 63 |
Executive functions tests | |
Switching verbal fluency test (TFA-93) | 66 |
In order to make them suitable for use across diverse ethnic groups, languages, education, and literacy levels, these instruments were designed without using culture- or language-specific stimuli, 18 black-and-white line drawings,62,67,68 or test elements that require skills learned in school. 33 Generally, the influence of limited education and illiteracy has been reduced by using test procedures with higher ecological relevance for people without formal school experience; that is, test procedures relying on elements and strategies from everyday life rather than the classroom.13,41 Often, smaller modifications of existing test paradigms have been sufficient to make tests more ecologically relevant. For instance, in the RUDAS the memory subtest requires memorization and recall of a shopping list rather than a list of unrelated words, and in the Multicultural Cognitive Examination the semantic verbal fluency subtest adopts a supermarket category rather than the commonly used animal category. Whereas knowledge about supermarkets is usually obtained through everyday life experience, knowledge about animals and strategies for memorizing and recalling words is largely obtained through formal school experience.31,32,39,42 Also, efforts to overcome the educational barrier in formal cognitive testing include the use of the informant-report instruments such as the short form of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). 69 Thus, a Dutch study found that the IQCODE had slightly better diagnostic accuracy in an older illiterate migrant population compared with the RUDAS. Further, it was found that combining the IQCODE and RUDAS in a diagnostic algorithm resulted in superior diagnostic accuracy compared to using either of the 2 instruments alone. 27 These instruments and approaches all represent important contributions to the field of cross-cultural cognitive assessment in Europe. However, many European clinicians are not familiar with these newer cognitive instruments, and there is a need for better publication and implementation of the instruments across Europe. 19
Aside from looking into cognitive tests in themselves, European experts on cross-cultural cognitive assessment have also recognized the importance of taking the cultural context of cognitive assessment into consideration.14,19 These contextual factors have neatly been summarized by the acronym of the ECLECTIC framework: 35 Education and literacy, Culture and acculturation, Language, Economics (eg, socioeconomic status), Communication, Testing situation, Comfort and motivation, Intelligence conceptualization, and Context of immigration. Although this framework has not been formally assessed or implemented in Europe, several key contextual factors have been included in research and clinical practice. For example, short acculturation scales (C) are used in research and clinical practice in several countries, including a modified version of the Short Acculturation Scale for Hispanics. 70 Additionally, the effects of language abilities in both native and host country languages (L) are recognized by European experts in the field,14,19 as well as the effects of stereotype threat, of being unfamiliar with cognitive testing, and of examinee–examiner ethnic discordance (T) on the assessment. Experts in the field also recognize that it is important to take lifetime (socio)demographic factors and access to and availability of healthcare services into account (E).14,19 Some aspects from the ECLECTIC framework, particularly communication styles and intelligence conceptualization, has received less explicit attention among European researchers. Other specific examples of relevant issues to take into consideration in working with minority ethnic groups in the European context are traumatic experiences, migration-related distress or grief, 71 exposure to discrimination, 72 differences in explanatory models of illness,73,74 and differences in symptom manifestation and idioms of distress, such as mixed affective and somatic presentations of depression in Moroccan and Turkish patients. 74 Consistent with this, a survey among European dementia experts found that 84% perceived cultural differences in the presentation of symptoms to frequently affect clinical assessments of clients from minority ethnic groups. 75
Conclusion
With increasing demographic aging, migration and globalization, there is an increasing need for researchers and clinicians to address the challenges of conducting cognitive assessment in culturally, linguistically, and educationally diverse older populations. During the last decade, significant work has been carried out on the identification of challenges in cognitive assessment in culturally, linguistically, and educationally diverse older populations and on development and validation of cross-cultural cognitive tests. However, the field of cross-cultural cognitive assessment is largely still a developing field in Europe, and formal expertise is localized rather than widespread. Thus, there is a continuing need for development of cross-cultural cognitive assessment instruments and normative data, for culture-sensitive clinical training, awareness, and knowledge among European clinicians, and for recruitment of culturally and linguistically diverse clinicians into the field. An important step forward was the establishment of ECCroN in 2019. This constitutes the first collaborative attempt of European experts in cross-cultural cognitive assessment to move the field forward. The first research initiative from ECCroN is the Timely Diagnosis of Dementia in Minority Ethnic Groups in Europe (TIMING) project, which aims to identify enduring challenges in clinical practice for dementia diagnostics in minority ethnic populations in European memory clinics and to validate brief case-finding tools that combine culture-sensitive cognitive assessment with patient and informant report, namely the Brief Assessment of Impaired Cognition (BASIC) 76 and BASIC Questionnaire (BASIC-Q). 77 The reviewed challenges and advances in cognitive assessment in culturally, linguistically, and educationally diverse older populations do not seem specific to the European context. Cross-cultural cognitive assessment is a challenge worldwide and some of the advances in Europe may potentially contribute to developments in other world regions characterized by diversity and multiculturalism.
Footnotes
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The Danish Dementia Research Centre is supported by the Danish Ministry of Health.
ORCID iD
T. Rune Nielsen https://orcid.org/0000-0002-8128-2294
References
- 1.Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: A systematic review and metaanalysis. Alzheimers Dement. 2013;9(1):63-75. [DOI] [PubMed] [Google Scholar]
- 2.Van Mol C, De Valk H. Migration and immigrants in Europe: A historical and demographic perspective. In: Integration processes and policies in Europe. Cham: Springer; 2016:31-55. [Google Scholar]
- 3.Eurostat . Migration and Migrant Population Statistics; 2020. [Google Scholar]
- 4.Parlevliet JL, Uysal-Bozkir O, Goudsmit M, et al. Prevalence of mild cognitive impairment and dementia in older non-western immigrants in the Netherlands: A cross-sectional study. Int J Geriatr Psychiatr. 2016;31(9):1040-1049. [DOI] [PubMed] [Google Scholar]
- 5.Kenning C, Daker-White G, Blakemore A, Panagioti M, Waheed W. Barriers and facilitators in accessing dementia care by ethnic minority groups: A meta-synthesis of qualitative studies. BMC Psychiatr. 2017;17(1):316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Nielsen TR, Vogel A, Riepe MW, et al. Assessment of dementia in ethnic minority patients in Europe: A European Alzheimer’s disease consortium survey. Int Psychogeriatr. 2011;23(1):86-95. [DOI] [PubMed] [Google Scholar]
- 7.Nielsen TR, Nielsen DS, Waldemar G. Barriers in access to dementia care in minority ethnic groups in Denmark: A qualitative study. Aging Ment Health. 2020;25:1-9. [DOI] [PubMed] [Google Scholar]
- 8.van Laer SD, Snijder MB, Agyemang C, Peters RJ, van den Born BH. Ethnic differences in hypertension prevalence and contributing determinants - the HELIUS study. Eur J Prev Cardiol. 2018;25(18):1914-1922. [DOI] [PubMed] [Google Scholar]
- 9.Kunst AE, Stronks K, Agyemang C. Non-communicable diseases. Migrat Health Eur Union. 2011;1:101-120. [Google Scholar]
- 10.Segers K, Benoit F, Colson C, et al. Pioneers in migration, pioneering in dementia: First generation immigrants in a European metropolitan memory clinic. Acta Neurol Belg. 2013;113:435-440. [DOI] [PubMed] [Google Scholar]
- 11.Fields JA, Ferman TJ, Boeve BF, Smith GE. Neuropsychological assessment of patients with dementing illness. Nat Rev Neurol. 2011;7(12):677-687. [DOI] [PubMed] [Google Scholar]
- 12.Henrich J, Heine SJ, Norenzayan A. The weirdest people in the world? Behav Brain Sci. 2010;33(2-3):61-83; discussion 83-135. [DOI] [PubMed] [Google Scholar]
- 13.Franzen S, van den Berg E, Goudsmit M, et al. A systematic review of neuropsychological tests for the assessment of dementia in non-western, low-educated or illiterate populations. J Int Neuropsychol Soc. 2020;26(3):331-351. [DOI] [PubMed] [Google Scholar]
- 14.Franzen S, European Consortium on Cross-Cultural Neuropsychology. Watermeyer TJ, et al. Cross-cultural neuropsychological assessment in Europe: Position statement of the European consortium on cross-cultural neuropsychology (ECCroN). Clin Neuropsychol. 2022;36:546-557. [DOI] [PubMed] [Google Scholar]
- 15.Van Tubergen F, Kalmijn M. Destination-language proficiency in cross-national perspective: A study of immigrant groups in nine western countries. Am J Sociol. 2005;110(5):1412-1457. [Google Scholar]
- 16.Blakemore A, Kenning C, Mirza N, et al. Dementia in UK South Asians: A scoping review of the literature. BMJ Open. 2018;8(4):e020290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Schellingerhout R. Gezondheid en welzijn van allochtone ouderen; 2004. [Google Scholar]
- 18.Ardila A. Cultural values underlying psychometric cognitive testing. Neuropsychol Rev. 2005;15(4):185-195. [DOI] [PubMed] [Google Scholar]
- 19.Franzen S, Papma JM, van den Berg E, Nielsen TR. Cross-cultural neuropsychological assessment in the European Union: A Delphi expert study. Arch Clin Neuropsychol. 2021;36(5):815-830. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Stålhammar J, Hellström P, Eckerström C, Wallin A. Neuropsychological Test Performance among native and non-native Swedes: Second language effects. Arch Clin Neuropsychol. 2022;37:826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Uzzell BP. Grasping the cross-cultural reality. In: Uzzell PB, Marcel P, Ardila A, eds. International Handbook of Cross-Cultural Neuropsychology. London: Lawrence Erlbaum Associated; 2007:1-21. [Google Scholar]
- 22.Plejert C, Antelius E, Yazdanpanah M, Nielsen TR. There’s a letter called ef' on challenges and repair in interpreter-mediated tests of cognitive functioning in dementia evaluations: A case study. J Cross Cult Gerontol. 2015;30(2):163-187. [DOI] [PubMed] [Google Scholar]
- 23.Torkpoor R, Fioretos I, Essen B, Londos E. I Know Hyena. Do you know Hyena?” Challenges in interpreter-mediated dementia assessment, focusing on the role of the interpreter. J Cross Cult Gerontol. 2022;37:45-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189-198. [DOI] [PubMed] [Google Scholar]
- 25.Nasreddine ZS, Phillips NA, Bedirian V, et al. The montreal cognitive assessment, MoCA: A brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-699. [DOI] [PubMed] [Google Scholar]
- 26.Zendedel R, Schouten BC, van Weert JC, van den Putte B. Informal interpreting in general practice: The migrant patient’s voice. Ethn Health. 2018;23(2):158-173. [DOI] [PubMed] [Google Scholar]
- 27.Goudsmit M, van Campen J, Franzen S, et al. Dementia detection with a combination of informant-based and performance-based measures in low-educated and illiterate elderly migrants. Clin Neuropsychol. 2020;35:1-19. [DOI] [PubMed] [Google Scholar]
- 28.Goudsmit M, van de Vorst I, van Campen J, Parlevliet J, Schmand B. Clinical characteristics and presenting symptoms of dementia-a case-control study of older ethnic minority patients in a Dutch urban memory clinic. Aging Ment Health 2021; E-pub ahead of print:1-8. doi: 10.1080/13607863.2021.1963416. [DOI] [PubMed] [Google Scholar]
- 29.Franzen S, van den Berg E, Bossenbroek W. Neuropsychological assessment in the multicultural memory clinic: Development and feasibility of the TULIPA battery. Clin Neuropsychol 2022; Online ahead of print:1-21. doi: 10.1080/13854046.2022.2043447. [DOI] [PubMed] [Google Scholar]
- 30.Goudsmit M, van Campen J, Schilt T, et al. One size does not fit all: Comparative diagnostic accuracy of the Rowland universal dementia assessment scale and the mini mental state examination in a memory clinic population with very low education. Dementia Geriatric Cognitive Disorder Extra. 2018;8(2):290-305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Nielsen TR. Effects of illiteracy on the European cross-cultural neuropsychological test battery (CNTB). Arch Clin Neuropsychol. 2019;34(5):713-720. [DOI] [PubMed] [Google Scholar]
- 32.Nielsen TR, Waldemar G. Effects of literacy on semantic verbal fluency in an immigrant population. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2016;23(5):578-590. [DOI] [PubMed] [Google Scholar]
- 33.Nielsen TR, Jorgensen K. Visuoconstructional abilities in cognitively healthy illiterate Turkish immigrants: A quantitative and qualitative investigation. Clin Neuropsychol. 2013;27(4):681-692. [DOI] [PubMed] [Google Scholar]
- 34.Nielsen TR, Vogel A, Gade A, Waldemar G. Cognitive testing in non-demented Turkish immigrants--comparison of the RUDAS and the MMSE. Scand J Psychol. 2012;53(6):455-460. [DOI] [PubMed] [Google Scholar]
- 35.Fujii DEM. Developing a cultural context for conducting a neuropsychological evaluation with a culturally diverse client: The ECLECTIC framework. Clin Neuropsychol. 2018;32(8):1356-1392. [DOI] [PubMed] [Google Scholar]
- 36.Ostrosky-Solis F, Ardila A, Rosselli M, Lopez-Arango G, Uriel-Mendoza V. Neuropsychological test performance in illiterate subjects. Arch Clin Neuropsychol. 1998;13(7):645-660. [DOI] [PubMed] [Google Scholar]
- 37.Nielsen TR. Cross-cultural cognitive examination in aging migrants. In: El Alaoui-Faris M, Federico A, Grisold W, eds. Neurology in Migrants and Refugees. Cham, Switzerland: Springer; 2022. [Google Scholar]
- 38.Kim JI, Sunwoo MK, Sohn YH, Lee PH, Hong JY. The MMSE and MoCA for screening cognitive impairment in less educated patients with parkinson’s disease. J Mod Dynam. 2016;9(3):152-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Ardila A, Bertolucci PH, Braga LW, et al. Illiteracy: The neuropsychology of cognition without reading. Arch Clin Neuropsychol. 2010;25(8):689-712. [DOI] [PubMed] [Google Scholar]
- 40.Hsieh S, Schubert S, Hoon C, Mioshi E, Hodges JR. Validation of the addenbrooke’s cognitive examination III in frontotemporal dementia and Alzheimer’s disease. Dement Geriatr Cognit Disord. 2013;36(3-4):242-250. [DOI] [PubMed] [Google Scholar]
- 41.Kosmidis MH. Challenges in the neuropsychological assessment of illiterate older adults. Lang Cognition Neurosci. 2018;33(3):373-386. [Google Scholar]
- 42.da Silva CG, Petersson KM, Faisca L, Ingvar M, Reis A. The effects of literacy and education on the quantitative and qualitative aspects of semantic verbal fluency. J Clin Exp Neuropsychol. 2004;26(2):266-277. [DOI] [PubMed] [Google Scholar]
- 43.Nielsen TR, Segers K, Vanderaspoilden V, et al. Performance of middle-aged and elderly European minority and majority populations on a Cross-Cultural Neuropsychological Test Battery (CNTB). Clin Neuropsychol. 2018;32:1-20. [DOI] [PubMed] [Google Scholar]
- 44.Al-Jawahiri F, Nielsen TR. Effects of acculturation on the cross-cultural neuropsychological test battery (CNTB) in a culturally and linguistically diverse population in Denmark. Arch Clin Neuropsychol. 2021;36:381. [DOI] [PubMed] [Google Scholar]
- 45.Greenfield PM. You can’t take it with you: Why ability assessments don't cross cultures. Am Psychol. 1997;52(10):1115-1124. [Google Scholar]
- 46.Mirza N, Panagioti M, Waheed MW, Waheed W. Reporting of the translation and cultural adaptation procedures of the addenbrooke’s cognitive examination version III (ACE-III) and its predecessors: A systematic review. BMC Med Res Methodol. 2017;17(1):141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.O'Driscoll C, Shaikh M. Cross-cultural applicability of the montreal cognitive assessment (MoCA): A systematic review. J Alzheimers Dis. 2017;58(3):789-801. [DOI] [PubMed] [Google Scholar]
- 48.Steis MR, Schrauf RW. A review of translations and adaptations of the Mini-Mental State Examination in languages other than English and Spanish. Res Gerontol Nurs. 2009;2(3):214-224. [DOI] [PubMed] [Google Scholar]
- 49.McCracken CF, Boneham MA, Copeland JR, et al. Prevalence of dementia and depression among elderly people in black and ethnic minorities. Br J Psychiatr. 1997;171:269-273. [DOI] [PubMed] [Google Scholar]
- 50.Lucas JA, Ivnik RJ, Willis FB, et al. Mayo’s older African Americans normative studies: Normative data for commonly used clinical neuropsychological measures. Clin Neuropsychol. 2005;19(2):162-183. [DOI] [PubMed] [Google Scholar]
- 51.Ponton MO, Satz P, Herrera L, et al. Normative data stratified by age and education for the Neuropsychological screening battery for hispanics (NeSBHIS): Initial report. J Int Neuropsychol Soc. 1996;2(2):96-104. [DOI] [PubMed] [Google Scholar]
- 52.Storey JE, Rowland JT, Basic D, Conforti DA, Dickson HG. The Rowland Universal Dementia Assessment Scale (RUDAS): A multicultural cognitive assessment scale. Int Psychogeriatr. 2004;16(1):13-31. [DOI] [PubMed] [Google Scholar]
- 53.Celik S, Onur O, Yener G, et al. Cross-cultural comparison of MMSE and RUDAS in German and Turkish patients with Alzheimer's disease. Neuropsychology. 2021;36:195-205. [DOI] [PubMed] [Google Scholar]
- 54.Matias-Guiu JA, Valles-Salgado M, Rognoni T, et al. Comparative diagnostic accuracy of the ACE-III, MIS, MMSE, MoCA, and RUDAS for screening of Alzheimer disease. Dement Geriatr Cognit Disord. 2017;43(5-6):237-246. [DOI] [PubMed] [Google Scholar]
- 55.Nielsen TR, Jorgensen K. Cross-cultural dementia screening using the Rowland Universal Dementia Assessment Scale: A systematic review and meta-analysis. Int Psychogeriatr. 2020;32:1-14. [DOI] [PubMed] [Google Scholar]
- 56.Nielsen TR, Segers K, Vanderaspoilden V, et al. Validation of the Rowland Universal dementia assessment scale (RUDAS) in a multicultural sample across five Western European countries: Diagnostic accuracy and normative data. Int Psychogeriatr. 2019;31(2):287-296. [DOI] [PubMed] [Google Scholar]
- 57.Nielsen TR, Segers K, Vanderaspoilden V, et al. Validation of a brief multicultural cognitive examination (MCE) for evaluation of dementia. Int J Geriatr Psychiatr. 2019;34(7):982-989. [DOI] [PubMed] [Google Scholar]
- 58.Nielsen TR, Segers K, Vanderaspoilden V, et al. Validation of a European cross-cultural neuropsychological test battery (CNTB) for evaluation of dementia. Int J Geriatr Psychiatr. 2019;34(1):144-152. [DOI] [PubMed] [Google Scholar]
- 59.Nielsen TR, Andersen BB, Gottrup H, et al. Validation of the Rowland Universal dementia assessment scale for multicultural screening in danish memory clinics. Dement Geriatr Cognit Disord. 2013;36(5-6):354-362. [DOI] [PubMed] [Google Scholar]
- 60.Kleist I, Noahsen P, Gredal O, Riis J, Andersen S. Diagnosing dementia in the Arctic: Translating tools and developing and validating an algorithm for assessment of impaired cognitive function in Greenland Inuit. Int J Circumpolar Health. 2021;80(1):1948247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Goudsmit M, Uysal-Bozkir O, Parlevliet JL, et al. The cross-cultural dementia screening (CCD): A new neuropsychological screening instrument for dementia in elderly immigrants. J Clin Exp Neuropsychol. 2016;39:1-10. [DOI] [PubMed] [Google Scholar]
- 62.Franzen S, van den Berg E, Kalkisim Y, et al. Assessment of visual association memory in low-educated, non-western immigrants with the modified visual association test. Dement Geriatr Cognit Disord. 2019;47(4-6):345-354. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Franzen S, van den Berg E, Ayhan Y. The naming assessment in multicultural Europe (NAME): Development and validation in a multicultural memory clinic. J Int Neuropsychol Soc 2022;Online ahead of print:1-13. doi: 10.1017/s135561772100148x. [DOI] [PubMed] [Google Scholar]
- 64.Maillet D, Matharan F, Le Clésiau H, et al. TNI-93: A new memory test for dementia detection in illiterate and low-educated patients. Arch Clin Neuropsychol. 2016;31(8):896-903. [DOI] [PubMed] [Google Scholar]
- 65.Maillet D, Narme P, Amieva H, et al. The TMA-93: A new memory test for Alzheimer’s disease in illiterate and less educated people. Am J Alzheimer’s Dis Other Dementias. 2017;32(8):461-467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Narme P, Maillet D, Palisson J, Le Clésiau H, Moroni C, Belin C. How to assess executive functions in a low-educated and multicultural population using a switching verbal fluency test (the TFA-93) in neurodegenerative diseases? Am J Alzheimer’s Dis Other Dementias. 2019;34(7-8):469-477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Reis A, Faisca L, Ingvar M, Petersson KM. Color makes a difference: Two-dimensional object naming in literate and illiterate subjects. Brain Cogn. 2006;60(1):49-54. [DOI] [PubMed] [Google Scholar]
- 68.Reis A, Petersson KM, Castro-Caldas A, Ingvar M. Formal schooling influences two- but not three-dimensional naming skills. Brain Cogn. 2001;47(3):397-411. [DOI] [PubMed] [Google Scholar]
- 69.Jorm AF. A short form of the informant questionnaire on cognitive decline in the elderly (IQCODE): Development and cross-validation. Psychol Med. 1994;24(1):145-153. [DOI] [PubMed] [Google Scholar]
- 70.Marín G, Sabogal F, Marín BV, Otero-Sabogal R, Perez-Stable EJ. Development of a short acculturation scale for Hispanics. Hisp J Behav Sci. 1987;9:183-205. [Google Scholar]
- 71.Carta MG, Bernal M, Hardoy MC, Haro-Abad JM. Migration and mental health in Europe (the state of the mental health in Europe working group: Appendix 1). Clin Pract Epidemiol Ment Health. 2005;1(1):13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.de Freitas DF, Fernandes-Jesus M, Ferreira PD, et al. Psychological correlates of perceived ethnic discrimination in Europe: A meta-analysis. Psychology of violence. 2018;8(6):712-725. [Google Scholar]
- 73.Fazil Q, Wallace L, Hussain A. An exploration of the explanatory models of illness amongst Pushtuun families living in the UK who are high attenders in general practice. Divers Equal Health Care 2006;3:171-181. [Google Scholar]
- 74.Sempértegui GA, Knipscheer JW, Baliatsas C, Bekker MH. Symptom manifestation and treatment effectiveness, -obstacles and-facilitators in Turkish and Moroccan groups with depression in European countries: A systematic review. J Affect Disord. 2019;247:134-155. [DOI] [PubMed] [Google Scholar]
- 75.Nielsen TR, Vogel A, Riepe MW, de Mendonca A, Rodriguez G, Nobili F, et al. Assessment of dementia in ethnic minority patients in Europe: A European alzheimer's disease consortium survey. Int Psychogeriatr. 2010;23:1-10. [DOI] [PubMed] [Google Scholar]
- 76.Jorgensen K, Nielsen TR, Nielsen A, et al. Brief assessment of impaired cognition (BASIC)-validation of a new dementia case-finding instrument integrating cognitive assessment with patient and informant report. Int J Geriatr Psychiatr. 2019;34(11):1724-1733. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Jorgensen K, Nielsen TR, Nielsen A, Waldorff FB, Waldemar G. Brief assessment of impaired cognition questionnaire (BASIC-Q)-development and validation of a new tool for identification of cognitive impairment in community settings. Int J Geriatr Psychiatr. 2020;35:693-701. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Kalbe E, Calabrese P, Fengler S, Kessler J. DemTect, PANDA, EASY, and MUSIC: Cognitive screening tools with age correction and weighting of subtests according to their sensitivity and specificity. J Alzheimers Dis. 2013;34(4):813-834. [DOI] [PubMed] [Google Scholar]
- 79.Ardila A. Toward the development of a cross-linguistic naming test. Arch Clin Neuropsychol. 2007;22(3):297-307. [DOI] [PubMed] [Google Scholar]
- 80.Gálvez-Lara M, Moriana JA, Vilar-López R, Fasfous AF, Hidalgo-Ruzzante N, Pérez-García M. Validation of the cross-linguistic naming test: A naming test for different cultures? A preliminary study in the Spanish population. J Clin Exp Neuropsychol. 2015;37(1):102-112. [DOI] [PubMed] [Google Scholar]