Abstract
Background
There is a global need for brief screening instruments that can identify key indicators for autism to support frontline professionals in their referral decision-making. Although a universal set of conditions, there may be subtle differences in expression, identification and reporting of autistic traits across cultures. In order to assess the potential for any measure for cross-cultural screening use, it is important to understand the relative performance of such measures in different cultures. Our study aimed to identify the items on the Autism Spectrum Quotient (AQ)-Child that are most predictive of an autism diagnosis among children aged 4–9 years across samples from India, Japan and the UK.
Methods
We analysed parent-reported AQ-Child data from India (73 children with an autism diagnosis and 81 neurotypical children), Japan (116 children with autism and 190 neurotypical children) and the UK (488 children with autism and 532 neurotypical children). None of the children had a reported existing diagnosis of intellectual disability. Discrimination indices (DI) and positive predictive values (PPV) were used to identify the most predictive items in each country.
Results
Sixteen items in the Indian sample, 15 items in the Japanese sample and 28 items in the UK sample demonstrated excellent discriminatory power (DI ≥ 0.5 and PPV ≥ 0.7), suggesting these items represent the strongest indicators for predicting an autism diagnosis within these countries. Across cultures, good performing items were largely overlapping, with five key indicator items appearing across all three countries (can easily keep track of several different people’s conversations, enjoys social chit-chat, knows how to tell if someone listening to him/her is getting bored, good at social chit-chat, finds it difficult to work out people’s intentions). Four items indicated potential cultural differences. One item was highly discriminative in Japan but poorly discriminative (DI < 0.3) in the UK and India, and a further item had excellent discrimination properties in the UK but poorly discriminated in the Indian and Japanese samples. Two additional items were highly discriminative in two cultures but poor in the third.
Conclusions
Cross-cultural overlap in the items most predictive of an autism diagnosis supports the general notion of universality in autistic traits whilst also highlighting that there can be cultural differences associated with certain autistic traits. These findings have the potential to inform the development of a brief global screening tool for autism. Further development and evaluation work is needed.
Electronic supplementary material
The online version of this article (10.1186/s13229-018-0235-3) contains supplementary material, which is available to authorized users.
Keywords: Autism, Culture, Cross-cultural comparison, Positive predictive values
Background
Autism spectrum disorders (ASD), henceforth ‘autism’, are neurodevelopmental conditions, characterised by difficulties with social interaction and communication, unusually repetitive and restricted behaviours and interests and sensory hyper-sensitivity [1]. Despite a considerable amount of research into autism [2], the majority of studies have been conducted in Western, higher income countries [3–6]. Consequently, assumptions surrounding the epidemiology, diagnosis and treatment of autism have not been adequately tested across different cultures and socioeconomic settings.
A diagnosis of autism is based on the behavioural characteristics of an individual. Though core autism characteristics are believed to be universal, there is preliminary evidence to suggest that cultural differences may exert subtle influence over the expression, identification and/or reporting of symptomatology [5, 7–9]. Culturally specific stigmas, norms and priorities may mask or emphasise relative distinctions between autistic traits and typically developing behaviours [3, 7, 9]. For example, previous work validating screening measures in Japan reported that parent judgements of whether their child is interested in their peers do not correlate with autism in Japanese communities as it does in the US [10]. If this example reflects a true cultural difference, such disparities could reflect a relative higher peer interest for Japanese children with autism, a relative lower peer interest for the Japanese typically developing children or that the salience of these symptoms is weaker for Japanese parents. Consequently, the profile of autism symptoms as measured by parent report may not be globally consistent [5, 7].
Tools developed for screening autism are increasingly being used outside their original cultural context [11, 12], with the majority developed in Europe and North America [13, 14]. Due to the emphasis on behavioural symptoms of such tools, if the presentation, salience and reporting of autistic characteristics are not globally consistent, this could impact the ability to use tools developed in one culture (typically the West) in other countries [15]. Developing new screening tools requires extensive resources and effort that may not be feasible for lower income countries. Existing Western screening tools have been translated into other languages [10, 16–20] but not always without difficulties [6, 21, 22], and validation studies of these screening tools in other cultures have typically examined overall mean group differences, rather than item-level analyses [16, 18–20, 23]. Moreover, the previous literature has often focused on toddlers [21, 24, 25]. However, children with autism without intellectual disability are less likely to exhibit salient symptoms at the preschool age and often only receive a diagnosis in mid-late childhood [26–28]. This is particularly problematic since behavioural expectations of children in different countries may differ according to age [29], suggesting that findings on toddler screening measures may neither be translatable to school-aged children, nor necessarily be equivalent across cultures.
There is thus a need for cross-cultural research exploring screening tools for this age group. An important consideration, particularly when aiming to develop a short screening tool, is whether the autistic traits that best predict an autism diagnosis are similar across different cultures. Initial research exploring such ‘key indicators’ has been conducted using the Autism Spectrum Quotient (AQ), a 50-item open-access and free to use questionnaire developed in the UK, adapted for different ages and validated in several languages [19, 24, 30–37]. Researchers developed shorter versions for different age groups (AQ-10) by examining which items best discriminate between cases and controls in UK samples, identifying ten highly predictive items [38]. The AQ-10 exhibited high test accuracy properties and internal consistency and is as effective as the original questionnaire in identifying high-risk autism cases across a range of different ages [38]. However, this analysis has so far only been conducted within a UK sample.
This study aimed to contribute towards a greater understanding of expression and recognition of childhood autism symptoms across cultures by identifying key indicator items across three distinct cultural settings: the UK, Japan and India.
Methods
Study sample
The sample from India has been described previously [23]. In brief, participants were recruited from Delhi and Kolkata, using Hindi and Bengali translations of the AQ-Child respectively. Children with a formal autism diagnosis were recruited from not-for-profit organisations in both cities that provide support for people with autism and their families. Typically developing children were recruited from mainstream schools and the general population through word of mouth. Overall, 75 children with autism and 81 typically developing children between the ages of four and eight were recruited from both locations. No children had a reported existing diagnosis of comorbid intellectual disability. Information on the AQ-Child was provided by either parent.
The sample of Japanese participants has not previously been reported; the data collection was coordinated through Chiba University in Japan. Children with a formal autism diagnosis were recruited through special education schools for children with developmental disorders in Tokyo and the surrounding area, typically developing children via mainstream schools. Overall, 116 children with autism and 190 typically developing children between the ages of four and nine were recruited. No children had a comorbid diagnosis other than autism, including no diagnoses of intellectual disability. The AQ-Child was completed by the child’s mother in all instances.
The UK sample was collected by the Autism Research Centre (ARC) at the University of Cambridge. Children with autism were recruited from the ARC’s volunteer database and typically developing children through an epidemiological study of social and communication skills recruited via mainstream primary schools. Overall, the sample consisted of 488 children with autism and 532 typically developing children. The participants included in the current study partly overlaps with the sample reported in previous studies [32, 38]. In contrast to these previous studies, the current project only used data from children aged 4–9 years who resided in the UK. Since the publication of the previous studies, additional data from UK children with ASD has been collected through the volunteer database; these new data are also included in the current study. Further details on the methodology employed in the data collection in the three countries are presented in Table 1.
Table 1.
UK | Japan | India | |
---|---|---|---|
Inclusion criteria |
All
Aged 4–9 years Lives in UK No diagnosed ID No siblings in the study |
All
Aged 4–9 years Lives in Tokyo No diagnosed ID No siblings in the study |
All
Aged 4–9 years Lives in Kolkata or Delhi No diagnosed ID Primary language Hindi (if in Delhi) or Bengali (if in Kolkata) No visual, hearing, motor, neurological or mental health disorder No siblings in the study |
Cases
Diagnosed by recognised clinical service, according to DSM-IVa or DSM-5b criteria. |
Cases
Diagnosis confirmed by school and/or clinic Diagnosis by DSM-IVa/ICD-10c No additional diagnosis other than ASD |
Cases
Diagnosis by DSM-IVa/ICD-10c |
|
Controls
No neurodevelopmental disorder |
Controls
No diagnosable condition |
Controls
No formal diagnosis of any mental health condition |
|
Autism recruitment | Via ARC’s volunteer database | Special education schools for children with developmental disorders | Not-for-profit organisations providing support for people with ASD |
Control recruitment | Mainstream schools in Cambridgeshire, UK | Mainstream schools in Tokyo | Mainstream schools in Kolkata and Delhi, general population |
AQ-Child method of completion | Cases online; controls pen and paper | Pen and paper | Pen and paper |
Informant | Either parent | Mothers | Either parent |
Autism Spectrum Quotient (AQ-Child)
The Autism Spectrum Quotient (AQ-Child) [32] consists of 50 statements relating to autistic traits, where parents indicate on a 4-point Likert scale whether they definitely disagree, slightly disagree, slightly agree or definitely agree with each statement. The AQ includes items assessing a range of autism-characteristic domains, including attention switching, attention to detail, communication, social skills and imagination. The AQ-Child has previously been translated into Japanese [19], Hindi and Bengali [23], with all three versions exhibiting similar psychometric properties to the original [32]. Translation involved blind back translation and multiple cycles of translations until all parties reached consensus. Further details can be found in the respective validation papers [19, 23].
Statistical analyses
Statistical analyses were conducted with the use of Stata 14.2. AQ item scores were converted from the Likert format into binary scoring for the purpose of these analyses in line with previous work [38]. Relevant items were inverse scored so that a score of 1 indicated the presence of an autistic trait and a score of 0 a negative response.
We randomly split the samples from each country into a derivation and validation sample (Table 2; [38]). Discrimination indices (DI) for each item were calculated using the derivation samples by subtracting the percentage of controls who scored 1 (false positives) from the percentage of cases who scored 1 (true positives). Positive predictive values (PPV) were calculated for each item using the validation samples by dividing the number of true positives by the total number of positives (cases and controls scoring 1).
Table 2.
Control derivation sample | Autism derivation sample | Control validation sample | Autism validation sample | Total | |
---|---|---|---|---|---|
Japan | |||||
n | 88 | 65 | 102 | 51 | 306 |
Sex | |||||
Female | 37 | 8 | 60 | 11 | 116 |
Male | 51 | 57 | 42 | 40 | 190 |
Mean age in years (SD) | 7.74 (0.10) (n = 88) | 7.55 (0.16) (n = 65) | 7.88 (0.09) (n = 102) | 7.82 (0.19) (n = 51) | |
India | |||||
n | 36 | 42 | 45 | 33 | 156 |
Sex | |||||
Female | 9 | 3 | 12 | 0 | 24 |
Male | 9 | 19 | 11 | 16 | 55 |
Missing | 18 | 20 | 22 | 17 | 77 |
Mean age in years (SD) | 6.24 (0.87) (n = 34) | 5.11 (1.09) (n = 40) | 6.14 (0.24) (n = 45) | 6.69 (0.27) (n = 33) | |
UK | |||||
n | 269 | 241 | 263 | 247 | 1020 |
Sex | |||||
Female | 152 | 44 | 143 | 42 | 381 |
Male | 117 | 197 | 120 | 205 | 639 |
Mean age in years (SD) | 8.84 (0.81) | 6.26 (1.65) | 8.76 (0.88) | 6.49 (1.66) |
n Number of participants, SD standard deviation
In order to identify a list of key indicator items most predictive of an autism diagnosis within each country, all items per country with a DI ≥ 0.5 (in line with Allison et al.’s previous paper with a UK-based sample [38]) and PPV ≥ 0.7 were selected. Receiver Operating Characteristic (ROC) curves were calculated and compared for these key indicator items and the original 50 items for each country. Optimal cut-offs were determined using the highest percentage correctly classified as guidelines. The area under the curve (AUC) indicates overall predictive validity, with AUC > 0.90 indicating excellent validity. Recommended sensitivity and specificity for developmental screening measures is 70–80% [39]. Cronbach’s Alpha was calculated for each measure with a value of > 0.80 indicating excellent internal consistency. Independent t tests were used to assess whether the key indicator items exhibited the expected difference between cases and controls, and Pearson correlations were calculated between key indicator items and AQ-50 total scores for each country.
The relative discrimination properties of all AQ-50 items were compared cross-culturally using the following criteria: DI ≥ 0.5 and PPV ≥ 0.7 = ‘excellent’ discrimination, DI ≥ 0.3 = ‘acceptable’ discrimination and DI < 0.3 = ‘poor’ discrimination [38, 40]. Any item that had ‘excellent’ discrimination in at least one country but ‘poor’ in the other(s) was considered to represent a potential cultural difference. In the UK dataset, there was a significant age difference between controls and cases (see Table 2 and the ‘Results’ section). Therefore, an additional sensitivity analysis was run on the UK dataset to examine whether this age difference could account for the findings.
Results
Children’s demographic characteristics are summarised in Table 2. There were no age differences between cases and controls in the Japanese and Indian samples; in the UK, the autism group was younger than the control group (p < .001) (Table 2).
DI and PPV analyses for each item are summarised in Table 3, with a summary of case/control responses per country for each item included in Additional file 1. Inspection of the DI and PPV values revealed 16 items for the Indian sample with DI ≥ 0.5 and PPV ≥ 0.7 (cells labelled with ‘a’ in Table 3), indicating that these items provided excellent differentiation between autism cases and controls. Similarly, 15 AQ-Child items for the Japanese sample and 28 items for the UK sample surpassed the excellent item performance thresholds (in the middle and right-hand columns of Table 3).
Table 3.
India | Japan | UK | ||||
---|---|---|---|---|---|---|
AQ item summary | DI | PPV | DI | PPV | DI | PPV |
1. Prefers to do things with others rather than alone | .06c | .66c | .38b | .56b | .43b | .75b |
2. Prefers to do things the same way over and over again | .52b | .60b | .54b | .59b | .62a | .70a |
3. Finds it very easy to create a picture in her/his mind | .67a | .94a | .45b | .89b | .55a | .81a |
4. Gets absorbed in one thing and loses sight of other things | .29c | .59c | .40b | .49b | .32b | .60b |
5. Notices small sounds when others do not | .20c | .46c | .35b | .61b | .52b | .68b |
6. Notices house numbers or similar strings of information | -.25c | .33c | .37b | .80b | .30b | .61b |
7. Has difficulty understanding rules for polite behaviour | .58a | .78a | .44b | .96b | .80a | .89a |
8. Can easily imagine what characters in a story look like | .86a | 1a | .44b | .64b | .67a | .93a |
9. Fascinated by dates | -.22c | .22c | .19c | .66c | .16c | .62c |
10. Can easily keep track of different conversations | .57 a | .89 a | .51 a | .76 a | .69 a | .79 a |
11. Finds social situations easy | .68a | .90a | .60b | .66b | .75a | .86a |
12. Tends to notice details that others do not | .08c | .36c | .32b | .49b | .24c | .56c |
13. Would rather go to a library than a birthday party | .17c | .50c | .26c | .60c | .40b | .91b |
14. Finds making up stories easy | .87a | .81a | .38b | .45b | .59a | .79a |
15. Drawn more strongly to people than to things | .39b | .50b | .36b | .49b | .55a | .74a |
16. Has strong interests, gets upset if cannot pursue | .30b | .56b | .53a | .81a | .36b | .63b |
17. Enjoys social chit-chat | .75 a | .75 a | .52 a | .97 a | .71 a | .90 a |
18. When talking, it is not easy to get a word in edgeways | .02 c | .31 c | .60 a | .83 a | .17 c | .57 c |
19. Fascinated | -.03c | .44c | .39b | .81b | .20c | .66c |
20. Finds it difficult to work out characters’ feelings in a story | .39b | .58b | .37b | .68b | .72a | .88a |
21. Does not particularly enjoy fictional stories | .42b | .83b | .31b | .63b | .34b | .80b |
22. Finds it hard to make new friends | .64a | .74a | .39b | .67b | .67a | .85a |
23. Notices patterns in things all the time | .10c | .57c | .24c | .63c | .37b | .66b |
24. Would rather go to the cinema than a museum | -.24c | .36c | .44b | .63b | .28c | .68c |
25. Is not upset if daily routine is disturbed | .13c | .45c | .34b | .67b | .63a | .78a |
26. Does not know how to keep a conversation going | .64b | .68b | .78a | 1a | .86a | .92a |
27. Finds it easy to “read between the lines” in conversation | .47b | .81b | .85a | .84a | .61a | .76a |
28. Concentrates more on a whole picture, rather than details | .23c | .86c | .58b | .59b | .49b | .69b |
29. Not very good at remembering phone numbers | .03c | .32c | -.08c | .26c | -.17c | .45c |
30. Does not usually notice small changes | -.12c | .36c | -.13c | .35c | -.09c | .42c |
31. Knows if someone listening is getting bored | .65 a | .72 a | .80 a | .87 a | .66 a | .74 a |
32. Finds it easy to alternate between different activities | .58a | .92a | .52b | .54b | .72a | .81a |
33. Not sure when it is her/his turn to speak on the phone | .48b | .62b | .52a | .93a | .69a | .84a |
34. Enjoys doing things spontaneously | .23 c | .50 c | .26 c | .82 c | .57 a | .89 a |
35. Often the last to understand the point of a joke | .14 c | .54 c | .71 a | 1 a | .62 a | .81 a |
36. Finds it easy to tell how someone feels from their face | .68a | .80a | .59b | .60b | .69a | .87a |
37. Can switch back to what they were doing if interrupted | .30b | .80b | .51a | .87a | .63a | .84a |
38. Good at social chit-chat | .75 a | .86 a | .73 a | .98 a | .80 a | .90 a |
39. People say they go on and on about the same thing | .44b | .68b | .59a | .94a | .41b | .70b |
40. Enjoyed playing pretend games with others in preschool | .78a | .87a | .38b | .69b | .71a | .86a |
41. Likes to collect information about categories of things | -.40c | .34c | .26c | .52c | .22c | .61c |
42. Finds it difficult to imagine being someone else | .38b | .55b | .79a | .85a | .62a | .79a |
43. Likes to plan any activities s/he participates in carefully | -.51c | .25c | .08c | .30c | .18c | .56c |
44. Enjoys social occasions | .23 c | .66 c | .51 a | .87 a | .56 a | .92 a |
45. Finds it difficult to work out people’s intentions | .50 a | .72 a | .80 a | .83 a | .63 a | .76 a |
46. New situations make him/her anxious | .61b | .59b | .50b | .59b | .45b | .65b |
47. Enjoys meeting new people | .40b | .82b | .25c | .51c | .49b | .84b |
48. Is good at taking care not to hurt other people’s feelings | .60a | .79a | .41b | .61b | .73a | .88a |
49. Not very good at remembering people’s date of birth | -.26c | .27c | .19c | .42c | -.18c | .46c |
50. Finds it easy to play pretend games with children | .73a | .93a | .36b | .63b | .69a | .89a |
aKey indicator item: excellent item performance (DI ≥ 0.5 and PPV ≥ 0.7); bitem performed acceptably (DI ≥ 0.3); citem performed poorly (DI < 0.3) Bold text: ‘Universal’ key indicator item with excellent performance across all three countries. Italics: ‘Cultural Difference’ item with variable item performance across countries
Psychometric properties
Internal consistency was very high for both the India AQ-16 (α = 0.94) and AQ-50 (α = 0.92). The AUC for both versions indicated excellent validity (AUC > 0.90). The AQ-16 and AQ-50 correlated strongly (r = 0.89, p < .001). At a cut-off point of 5 on the AQ-16, sensitivity was 0.96, specificity was 0.97 and the proportion of correctly classified cases was 0.97. Internal consistency was very high for both the Japanese AQ-15 (α = 0.95) and AQ-50 (α = 0.95). The AUC for both versions indicated excellent validity (AUC > 0.90), and both versions correlated strongly with each other(r = 0.95, p < .001). At a cut-off point of 12 on the AQ-15, sensitivity was 0.96, specificity was 0.96 and proportion correctly classified was 0.92. Internal consistency was very high for both the UK AQ-28 (α = 0.97) and UK AQ-50 (α = 0.96). The AUC for both versions indicated excellent validity (AUC > 0.90). There was a significant correlation between the AQ-28 and AQ-50 (r = 0.97, p < .001). At a cut-off point of 14 on the AQ-28, sensitivity was 0.98, specificity was 0.97 and proportion correctly classified was 0.97.
Cross-cultural comparisons
Five items were identified to be universal key indicators, as they were consistently excellent at discriminating between children with autism and controls in all three countries (see bold items in Table 3). In a social group, s/he can easily keep track of several different people’s conversations; s/he enjoys social chit-chat; s/he knows how to tell if someone listening to him/her is getting bored; s/he is good at social chit-chat and s/he finds it difficult to work out people’s intentions. There were an additional 23 items that performed excellently or acceptably across all three countries.
Four items were identified as indicating potential cultural differences (see items in italics in Table 3). Item 34 (‘S/he enjoys doing things spontaneously’) had excellent discrimination properties in the UK, but discriminated poorly in the Indian and Japanese samples. In contrast, item 18 (‘When s/he talks, it isn’t always easy for others to get a word in edgeways’) performed well in Japan, but poorly in the UK and India. A further two items (35, ‘S/he is often the last to understand the point of a joke’, and 44, ‘S/he enjoys social occasions’) were found to perform poorly in India whilst exhibiting excellent predictive value in the UK and Japan. Further information on how cases and controls in each country responded to the AQ items is available in Additional file 1: Tables S1–S3.
A subgroup analysis restricting the age group to 7–9 years for cases and controls in the UK sample, indicated that age differences between cases and controls in the full UK sample did not explain the pattern of results (Additional file 1: Table S4).
Discussion
This study aimed to identify which items on the AQ-Child were most predictive of an autism diagnosis among children from India, Japan and the UK. Sixteen items in the Indian sample, 15 in the Japanese sample and 28 items in the UK sample demonstrated high discriminant and predictive ability of ASD cases, excellent psychometric properties and similar sensitivity and specificity values to the original AQ-50. This suggests that at least within cultures, it is possible to adapt existing measures into psychometrically sound brief tools that successfully differentiate children with and without autism.
When comparing the ‘key indicator’ items across cultures, our findings suggest that there is substantial overlap in the items most predictive of an autism diagnosis cross-culturally. Overall, 28 items were found to have acceptable or excellent discrimination properties in all three countries. This suggests that a number of autistic traits are consistently expressed, salient for parents and thus reliably identified and reported across different countries. This provides support for the position that screening measures developed in one country can indeed be used in different cultures. Five items were identified to be consistently excellent at discriminating between children with autism and controls in all three countries and identified as universal key indicators. However, it should be noted that two of these universal items (item 17; s/he enjoys social chit-chat and item 38; s/he is good at social chit-chat) are similarly worded and therefore may be overlapping measurements of the same aspect of behaviour.
The present study also identified four autistic traits that may represent cultural differences. Item 34 (s/he enjoys doing things spontaneously) was a highly predictive item in the UK sample, but not in Japan or India. In the UK, two-thirds of the autism children in the derivation sample were reported to not enjoy spontaneity (in line with autism symptomatology). This ratio was much reduced in the Indian and Japanese samples, where only around 30% of the children with autism were reported to not enjoy spontaneity. By contrast, control children across all three countries were reported to enjoy spontaneity at similar levels (91–97%), suggesting that this difference is specific to the autism group. Cross-cultural studies show that societies differ in their tolerance for uncertainty. For instance, Japan is characterised as a highly uncertainty avoidant society, whereas India and the UK score much lower on uncertainty avoidance [41]. It is possible that as a result of Japanese society’s tendency towards reducing uncertainty, any spontaneous activity is more structured in Japan than in the other cultures, resulting in relatively few children objecting to spontaneous activities. Indian children with autism also appear more accepting of spontaneity that could reflect the prevalence of an authoritarian parenting style in India, resulting in a general reduction in spontaneity across diagnostic groups and so accounting for the reduced predictive power of this item [42]. Alternatively, these differences may be due to linguistic variation rather than a cultural difference: in the Japanese translation of the AQ-Child, the meaning of item 34 was perceived ambiguously by parents and so had to be clarified with a supplemental explanation in addition to the original question [19]. In the supplemental explanation, more emphasis was placed on the meaning of spontaneous as ‘doing something on your own initiative, without suggestions from others’, rather than on ‘doing something without much prior planning’. Similarly, the terms used in the Bengali and Hindi translations of the AQ-Child for ‘spontaneous’ are more common in written than in spoken language. Therefore, these differences in response patterns may reflect a lack of familiarity or ambiguity for parents interpreting the question.
Item 18 (when s/he talks, it is not always easy for others to get a word in edgeways) has strong predictive properties in the Japan sample but not in India or the UK. As expected from a highly predictive item, this item is endorsed (suggesting the presence of the autistic trait) in a larger proportion of the cases (64%) and very few controls (3%) in Japan. In contrast, although endorsed for a large proportion of UK cases (70%), it is also reported in a large proportion of UK controls (53%). For India, the proportion of children for whom it is reported are very similar for both cases (61%) and controls (63%). While lack of qualitative research or cognitive interviewing data prevents us from drawing strong inferences on the causes of these differences, we speculate that parents in the UK and India may have interpreted the item to mean their child was very chatty. While excessive chatting by children is culturally acceptable in the UK and India, the stronger emphasis in Japanese society on social conformity [9, 43–45], politeness and respect for elders may make this characteristic much less acceptable and/or more salient to the reporting parents in Japan.
Items 35 (s/he is often the last to understand the point of a joke) and 44 (s/he enjoys social occasions) were both highly discriminative in the UK and Japan samples but not in India. Although these may be indicative of cultural differences, the smaller size of the Indian sample leads us to interpret these with caution. Moreover, these questions may represent a translation issue: in the versions for India, both ‘joke’ and ‘social occasion’ were translated using more formal language.
Strengths and limitations
The comparatively smaller number of key indicator items in the India and Japan samples (n = 15 and n = 16, respectively) in comparison to that of the UK sample (n = 28) may reflect the smaller size of the samples for Japan and India compared to the UK. Alternatively, it may indicate that cross-cultural differences generally limit the discriminating power of certain items when the instrument is used outside of the UK culture in which it was originally developed. Moreover, our three samples have come from different research studies, and therefore, subtle differences exist in their sampling characteristics and recruitment procedures. While in all three countries ASD diagnoses were made by a qualified professional using DSM-IV criteria, the exact diagnostic procedures may have varied both within and across country. No data were available on ethnicity, specific IQ information and socio-economic status; all of which may have influenced the results. Additionally, given the vast regional and cultural differences that exist in India, our findings based on relatively small urban population samples may not generalise across all Indian cultures and contexts, particularly rural areas which were not sampled in this study [46]. In all three countries, the autism samples were purposely selected, rather than derived from a population based survey and may therefore not be fully representative of the population of children with autism in each country. In India and Japan, children with autism were recruited from special schools; this sample may represent a subset of autistic trait profiles within the countries and the most predictive items reported in this study may not be as sensitive to more subtle presentations in the community [47]. This highlights the importance of future studies using population-based samples; although this is challenging in low resource contexts.
Across all three countries, data in clinical samples were collected in children in whom autism had previously been diagnosed. This may have resulted in enhanced awareness of parents of their child’s autistic traits and thus increased likelihood of endorsement on corresponding autistic traits. It will be imperative for the development of effective screening tools that future studies explore cross-cultural differences in parent-reports prior to clinical autism diagnoses. It will also be important for comparisons to be conducted in the discrimination of children with ASD and other neurodevelopmental disorders, as this is the more informative contrast for clinicians.
A strength of this study is the exclusion of children with reported diagnoses of intellectual disability, resulting in a more homogenous group of children who are more likely to be left undiagnosed until this primary school age. However, it would also be important to confirm that any measure was equally effective across autism severity, intelligence level and age in each cultural setting. Any global screening initiative would also need to explore any cultural differences in the expression or latent structure of autistic symptomatology in this age group.
Evaluating the utility of the five universal items as a brief screener was beyond the scope of this paper as this would require a different type of psychometric evaluation on a multi-country population-based sample of participants, and we do not recommend use of these items in the place of current screening tools on the basis of these results. However, our findings are informative for the future development of a global screening tool for autism for early-mid childhood, the age when children with autism without intellectual disability are likely to still remain undetected and without formal diagnosis. We identified five items that show consistently excellent performance across all three cultures, suggesting these items hold promise as universal key indicators of autism. This study also identified four items suggesting subtle cultural differences, indicating that researchers should not assume that all autistic traits are equally salient across all cultures. An alternative explanation for the subtle cultural differences identified in this study is the semantic differences in the items concerned. In addition, some of the differences may be of socio-economic rather than cultural origin. To further explore whether the semantics or interpretation of items may be constraining their discriminating abilities and to identify any unique socio-economic or cultural nuances not currently captured by the AQ items, qualitative research (e.g. using cognitive interviews and focus groups) is needed.
Conclusions
Our analyses have demonstrated that taking the most discriminating items from the AQ-Child from three countries results in psychometrically sound brief measures that correctly classify children with autism and typically developing controls. Items with good discriminating power were, to a large extent, universal across the UK, Japan and India samples, but there were also some potential cultural differences. These findings suggest that five items included in the AQ-50 have consistent excellent power to discriminate autism from control children across three distinct cultures and thus hold promise as cross-cultural key indicators for autism. Additional research is needed to further advance our understanding of the cross-cultural nature of autism symptomatology before a ‘universal’ screening instrument for autism can be derived.
Additional file
Acknowledgements
The authors would like to thank all of the participants for being involved in the study.
Funding
Sophie Carruthers and Emma Kinnaird are supported by the UK Medical Research Council (MRC) (MR/N013700/1) and King’s College London member of the MRC Doctoral Training Partnership in Biomedical Sciences. The Indian data collection was funded by Autism Speaks, the Japanese data collection by The Grant-in-Aid for Scientific Research from the Japan Society for the Promotion of Science and the UK data collection by the Nancy Lurie-Marks Family Foundation and the MRC, UK. SBC, CA and PS were supported by the Autism Research Trust during the period of this work. IB is supported by the NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and by the NIHR Collaboration for Leadership in Applied Health Research and Care South London at King’s College Hospital NHS Foundation Trust, King’s College London.
Availability of data and materials
Data cannot be made publicly available as participants have not given consent to this form of data sharing. However, researchers can contact the authors who will on reasonable request share the anonymised data included in the study.
Abbreviations
- AQ-Child
Autism Spectrum Quotient-Child Version
- ARC
Autism Research Centre, University of Cambridge
- ASD
Autism spectrum disorder
- AUC
Area under the curve
- DI
Discrimination indices
- DSM-5
Diagnostic and Statistical Manual of Mental Disorders—5th edition
- DSM-IV
Diagnostic and Statistical Manual of Mental Disorders—4th edition
- ICD-10
International Statistical Classification of Diseases and Related Health Problems, tenth edition
- ID
Intellectual disability
- N
Number of participants
- PPV
Positive predictive value
- ROC
Receiver Operating Characteristic curve
- SD
Standard deviation
- UK
United Kingdom
- US
United States
Authors’ contributions
SC, EK, RH and IB designed the study and conducted the analyses. AR, BC, AW, BA, CA and SBC were involved in the original data collection. PS contributed to data analysis. SC and EK wrote the first and final draft of the manuscript. All authors read, contributed to and approved the final manuscript.
Ethics approval and consent to participate
Parents/legal guardians provided written informed consent. Ethical approval for the original collection of data was obtained by ethics committees in India, Japan and the UK for each country’s data collection separately.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Footnotes
Sophie Carruthers and Emma Kinnaird are joint first authors.
Ioannis Bakolis and Rosa A. Hoekstra are joint last authors.
Contributor Information
Sophie Carruthers, Email: sophie.carruthers@kcl.ac.uk.
Emma Kinnaird, Email: emma.kinnaird@kcl.ac.uk.
Alokananda Rudra, Email: alokanandarudra@gmail.com.
Paula Smith, Email: pls28@medschl.cam.ac.uk.
Carrie Allison, Email: cla29@cam.ac.uk.
Bonnie Auyeung, Email: bauyeung@exseed.ed.ac.uk.
Bhismadev Chakrabarti, Email: b.chakrabarti@reading.ac.uk.
Akio Wakabayashi, Email: akiowcam@mac.com.
Simon Baron-Cohen, Email: sb205@cam.ac.uk.
Ioannis Bakolis, Email: ioannis.bakolis@kcl.ac.uk.
Rosa A Hoekstra, Email: rosa.hoekstra@kcl.ac.uk.
References
- 1.American Psychiatric Association . Diagnostic and statistical manual of mental disorders (DSM-5) Washington, DC: American Psychiatric Association; 2013. [Google Scholar]
- 2.Bishop DV. Which neurodevelopmental disorders get researched and why? PLoS One. 2010;5:e15112. doi: 10.1371/journal.pone.0015112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Daley TC. The need for cross-cultural research on the pervasive developmental disorders. Transcult Psychiatry. 2002;39:531–550. doi: 10.1177/136346150203900409. [DOI] [Google Scholar]
- 4.Dyches TT, Wilder LK, Sudweeks RR, Obiakor FE, Algozzine B. Multicultural issues in autism. J Autism Dev Disord. 2004;34:211–222. doi: 10.1023/B:JADD.0000022611.80478.73. [DOI] [PubMed] [Google Scholar]
- 5.Freeth M, Sheppard E, Ramachandran R, Milne E. A cross-cultural comparison of autistic traits in the UK, India and Malaysia. J Autism Dev Disord. 2013;43:2569–2583. doi: 10.1007/s10803-013-1808-9. [DOI] [PubMed] [Google Scholar]
- 6.Durkin MS, Elsabbagh M, Barbaro J, Gladstone M, Happe F, Hoekstra RA, Lee LC, Rattazzi A, Stapel-Wax J, Stone WL, et al. Autism screening and diagnosis in low resource settings: challenges and opportunities to enhance research and services worldwide. Autism Res. 2015;8:473–476. doi: 10.1002/aur.1575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Norbury CF, Sparks A. Difference or disorder? Cultural issues in understanding neurodevelopmental disorders. Dev Psychol. 2013;49:45–58. doi: 10.1037/a0027446. [DOI] [PubMed] [Google Scholar]
- 8.Caron KG, Schaaf RC, Benevides TW, Gal E. Cross-cultural comparison of sensory behaviors in children with autism. Am J Occup Ther. 2012;66:e77–e80. doi: 10.5014/ajot.2012.004226. [DOI] [PubMed] [Google Scholar]
- 9.Freeth M, Milne E, Sheppard E, Ramachandran R. Handbook of Autism and Pervasive Developmental Disorders. 4 2014. Autism across cultures: perspectives from non-Western cultures and implications for research. [Google Scholar]
- 10.Inada N, Koyama T, Inokuchi E, Kuroda M, Kamio Y. Reliability and validity of the Japanese version of the modified checklist for autism in toddlers (M-CHAT) Res Autism Spectr Disord. 2011;5:330–336. doi: 10.1016/j.rasd.2010.04.016. [DOI] [Google Scholar]
- 11.Soto S, Linas K, Jacobstein D, Biel M, Migdal T, Anthony BJ. A review of cultural adaptations of screening tools for autism spectrum disorders. Autism. 2015;19:646–661. doi: 10.1177/1362361314541012. [DOI] [PubMed] [Google Scholar]
- 12.Stewart LA, Lee LC. Screening for autism spectrum disorder in low- and middle-income countries: a systematic review. Autism. 2017;21:527–539. doi: 10.1177/1362361316677025. [DOI] [PubMed] [Google Scholar]
- 13.Charman T, Gotham K. Measurement issues: screening and diagnostic instruments for autism spectrum disorders - lessons from research and practice. Child Adolesc Ment Health. 2013;18:52–63. doi: 10.1111/j.1475-3588.2012.00664.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Charman T, Baird G, Simonoff E, Chandler S, Davison-Jenkins A, Sharma A, O'Sullivan T, Pickles A. Testing two screening instruments for autism spectrum disorder in UK community child health services. Dev Med Child Neurol. 2016;58:369–375. doi: 10.1111/dmcn.12874. [DOI] [PubMed] [Google Scholar]
- 15.Henrich J, Heine SJ, Norenzayan A. Most people are not WEIRD. Nature. 2010;466:29. doi: 10.1038/466029a. [DOI] [PubMed] [Google Scholar]
- 16.Perera H, Wijewardena K, Aluthwelage R. Screening of 18-24-month-old children for autism in a semi-urban community in Sri Lanka. J Trop Pediatr. 2009;55:402–405. doi: 10.1093/tropej/fmp031. [DOI] [PubMed] [Google Scholar]
- 17.Seif Eldin A, Habib D, Noufal A, Farrag S, Bazaid K, Al-Sharbati M, Badr H, Moussa S, Essali A, Gaddour N. Use of M-CHAT for a multinational screening of young children with autism in the Arab countries. Int Rev Psychiatry. 2008;20:281–289. doi: 10.1080/09540260801990324. [DOI] [PubMed] [Google Scholar]
- 18.Srisinghasongkram P, Pruksananonda C, Chonchaiya W. Two-step screening of the modified checklist for autism in toddlers in Thai children with language delay and typically developing children. J Autism Dev Disord. 2016;46:3317–3329. doi: 10.1007/s10803-016-2876-4. [DOI] [PubMed] [Google Scholar]
- 19.Wakabayashi A, Baron-Cohen S, Uchiyama T, Yoshida Y, Tojo Y, Kuroda M, Wheelwright S. The Autism-Spectrum Quotient (AQ) Children's Version in Japan: a cross-cultural comparison. J Autism Dev Disord. 2007;37:491–500. doi: 10.1007/s10803-006-0181-3. [DOI] [PubMed] [Google Scholar]
- 20.Albores-Gallo L, Roldán-Ceballos O, Villarreal-Valdes G, Betanzos-Cruz BX, Santos-Sánchez C, Martínez-Jaime MM, Lemus-Espinosa I, Hilton CL. M-CHAT Mexican version validity and reliability and some cultural considerations. ISRN Neurol. 2012;2012:408694. doi: 10.5402/2012/408694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Samadi SA, McConkey R. Screening for autism in Iranian preschoolers: contrasting M-CHAT and a scale developed in Iran. J Autism Dev Disord. 2015;45:2908–2916. doi: 10.1007/s10803-015-2454-1. [DOI] [PubMed] [Google Scholar]
- 22.Brennan L, Fein D, Como A, Rathwell IC, Chen C-M. Use of the modified checklist for autism, revised with follow up-Albanian to screen for ASD in Albania. J Autism Dev Dis. 2016;46:3392–3407. doi: 10.1007/s10803-016-2875-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Rudra A, Banerjee S, Singhal N, Barua M, Mukerji S, Chakrabarti B. Translation and usability of autism screening and diagnostic tools for autism spectrum conditions in India. Autism Res. 2014;7:598–607. doi: 10.1002/aur.1404. [DOI] [PubMed] [Google Scholar]
- 24.Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31:131–144. doi: 10.1023/A:1010738829569. [DOI] [PubMed] [Google Scholar]
- 25.Siu A. Screening for autism spectrum disorder in young children: US Preventive Services Task Force recommendation statement. JAMA. 2016;315:691–696. doi: 10.1001/jama.2016.0018. [DOI] [PubMed] [Google Scholar]
- 26.Kamio Y, Inada N, Koyama T. A nationwide survey on quality of life and associated factors of adults with high-functioning autism spectrum disorders. Autism. 2013;17:15–26. doi: 10.1177/1362361312436848. [DOI] [PubMed] [Google Scholar]
- 27.Mandell DS, Novak MM, Zubritsky CD. Factors associated with age of diagnosis among children with autism spectrum disorders. Pediatrics. 2005;116:1480–1486. doi: 10.1542/peds.2005-0185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Shattuck PT, Durkin M, Maenner M, Newschaffer C, Mandell DS, Wiggins L, Lee LC, Rice C, Giarelli E, Kirby R, et al. Timing of identification among children with an autism spectrum disorder: findings from a population-based surveillance study. J Am Acad Child Adolesc Psychiatry. 2009;48:474–483. doi: 10.1097/CHI.0b013e31819b3848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Joshi MS, Maclean M. Maternal expectations of child development in India, Japan, and England. J Cross-Cult Psychol. 1997;28:219–234. doi: 10.1177/0022022197282005. [DOI] [Google Scholar]
- 30.Hoekstra RA, Bartels M, Cath DC, Boomsma DI. Factor structure, reliability and criterion validity of the Autism-Spectrum Quotient (AQ): a study in Dutch population and patient groups. J Autism Dev Disord. 2008;38:1555–1566. doi: 10.1007/s10803-008-0538-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ruta L, Mazzone D, Mazzone L, Wheelwright S, Baron-Cohen S. The Autism-Spectrum Quotient--Italian version: a cross-cultural confirmation of the broader autism phenotype. J Autism Dev Disord. 2012;42:625–633. doi: 10.1007/s10803-011-1290-1. [DOI] [PubMed] [Google Scholar]
- 32.Auyeung B, Baron-Cohen S, Wheelwright S, Allison C. The Autism Spectrum Quotient: Children's Version (AQ-Child) J Autism Dev Disord. 2008;38:1230–1240. doi: 10.1007/s10803-007-0504-z. [DOI] [PubMed] [Google Scholar]
- 33.Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E. The Autism-Spectrum Quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism Dev Disord. 2001;31:5–17. doi: 10.1023/A:1005653411471. [DOI] [PubMed] [Google Scholar]
- 34.Baron-Cohen S, Hoekstra RA, Knickmeyer R, Wheelwright S. The Autism-Spectrum Quotient (AQ)--adolescent version. J Autism Dev Disord. 2006;36:343–350. doi: 10.1007/s10803-006-0073-6. [DOI] [PubMed] [Google Scholar]
- 35.Murray Aja Louise, Allison Carrie, Smith Paula L., Baron-Cohen Simon, Booth Tom, Auyeung Bonnie. Investigating diagnostic bias in autism spectrum conditions: An item response theory analysis of sex bias in the AQ-10. Autism Research. 2016;10(5):790–800. doi: 10.1002/aur.1724. [DOI] [PubMed] [Google Scholar]
- 36.James RJ, Dubey I, Smith D, Ropar D, Tunney RJ. The latent structure of autistic traits: a taxometric, latent class and latent profile analysis of the adult Autism Spectrum Quotient. J Autism Dev Disord. 2016;46:3712–3728. doi: 10.1007/s10803-016-2897-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ashwood KL, Gillan N, Horder J, Hayward H, Woodhouse E, McEwen FS, Findon J, Eklund H, Spain D, Wilson CE, et al. Predicting the diagnosis of autism in adults using the Autism-Spectrum Quotient (AQ) questionnaire. Psychol Med. 2016;46:2595–2604. doi: 10.1017/S0033291716001082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Allison C, Auyeung B, Baron-Cohen S. Toward brief “Red Flags” for autism screening: the short Autism Spectrum Quotient and the short Quantitative Checklist for Autism in toddlers in 1,000 cases and 3,000 controls [corrected] J Am Acad Child Adolesc Psychiatry. 2012;51:202–212. doi: 10.1016/j.jaac.2011.11.003. [DOI] [PubMed] [Google Scholar]
- 39.Glascoe FP. Parents’ concerns about children’s development: prescreening technique or screening test? Pediatrics. 1996;99:522–528. doi: 10.1542/peds.99.4.522. [DOI] [PubMed] [Google Scholar]
- 40.Gillis JM, Callahan EH, Romanczyk RG. Assessment of social behavior in children with autism: the development of the behavioral assessment of social interactions in young children. Res Autism Spectr Disord. 2011;5:351–360. doi: 10.1016/j.rasd.2010.04.019. [DOI] [Google Scholar]
- 41.Hofstede G. Culture's Consequences: Comparing Values, Behaviors, Institutions and Organizations Across Nations. 2. Thousand Oaks: Sage Publications; 2001. [Google Scholar]
- 42.Rose GM, Dalakas V, Kropp F. Consumer socialization and parental style across cultures: findings from Australia, Greece, and India. J Consum Psychol. 2003;13:366–376. doi: 10.1207/S15327663JCP1304_04. [DOI] [Google Scholar]
- 43.Aron A, Aron EN, Tudor M, Nelson G. Close relationships as including other in the self. J Pers Soc Psychol. 1991;60:241. doi: 10.1037/0022-3514.60.2.241. [DOI] [Google Scholar]
- 44.Fiske A, Kitayama S, Markus HR, Nisbett RE. The cultural matrix of social psychology. In: Gilbert SF D, Lindzey G, editors. The handbook of social psychology. 4. San Francisco: McGraw-Hill; 1998. pp. 915–981. [Google Scholar]
- 45.Rosenberger NR. Japanese sense of self. New York: Cambridge University Press; 1992. [Google Scholar]
- 46.Girimaji SC, Srinath S. Perspectives of intellectual disability in India: epidemiology, policy, services for children and adults. Curr Opin Psychiatry. 2010;23:441–446. doi: 10.1097/YCO.0b013e32833ad95c. [DOI] [PubMed] [Google Scholar]
- 47.Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529–536. doi: 10.7326/0003-4819-155-8-201110180-00009. [DOI] [PubMed] [Google Scholar]
- 48.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 4th, text revision edn. Washington, DC: American Psychiatric Association; 2000. [Google Scholar]
- 49.World Health Organisation . The ICD-10 classification of mental and behavioural disorders: Clinical descriptions and diagnostic guidelines. Geneva: World Health Organisation; 1992. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data cannot be made publicly available as participants have not given consent to this form of data sharing. However, researchers can contact the authors who will on reasonable request share the anonymised data included in the study.