Skip to main content
Journal of Migration and Health logoLink to Journal of Migration and Health
. 2023 Mar 17;7:100177. doi: 10.1016/j.jmh.2023.100177

Unaccompanied foreign minors and mental health: Implementation and evaluation of the RHS-15 screening procedure for unaccompanied foreign minors

Marco Fontana b, Francesco Fattori a,, Sofia Trezzi b, Massimo Conte a, Laura Bernardini b, Laura Marando b, Giovanni Michelini c, Andrea Trapani a, Maria Antonella Costantino b
PMCID: PMC10033743  PMID: 36968561

Abstract

Background and objective

The recent notable increase in refugees' flows, with refugee children and adolescents relocating worldwide, posed severe challenges to the different national healthcare systems. Social groups such as refugees fleeing from their countries because of persecution, wars and violence are considered at high risk of developing mental health-related problems. Despite international and national policies legally regulating the reception process and protecting health-related rights, including the mental well-being of refugee migrants, there is a theoretical and applied need for evidence-based instruments and procedures to support mental health within this population. Recent evidence refers to the Refugee Health Screener-15 (RHS-15) as a reliable and valid instrument for the early detection of trauma-related mental health problems. In this scenario, this study aimed to test the RHS screening process within a multidisciplinary first intervention reception context for unaccompanied refugee minors.

Design

The RHS-15 was administered with the support of cultural-linguistic mediators to 81 unaccompanied minor residents in a first intervention facility in Milan, Italy. This study aimed to assess psychometric characteristics, such as reliability, sensitivity and specificity feasibility and its implementation within a first intervention reception process.

Results

The analysis resulted in the validation of the RHS in its 13-item format. The results highlighted and confirmed an efficient delivery, excellent reliability and a positive predictive and convergent validity of the 13-item version. Further analysis showed an excellent ability to avoid false negatives, although there was a clear tendency to identify false positives.

Conclusions

The early identification of vulnerabilities among refugee minors is recommended to promote their long-term overall well-being. Integrating the screening results with additional observational elements and more specific diagnostic tools is recommended to gain a comprehensive perspective of the minors’ well-being.

Keywords: Unaccompanied foreign minors, Screening process, RHS-15, Mental health, Trauma, Migrations

1. Introduction

1.1. Unaccompanied refugee minors and psycho-social health-related issues

The current geopolitical situation is characterised by uninterrupted trends and flows of migrant people fleeing from their countries because of conflicts and persecution (Beversluis et al., 2017). According to the United Nations High Commissioner for Refugees (UNHCR) most recent data collection (October 2022), 103 million people are of concern worldwide, with 36.5 million (41%) being children below 18 years of age.

Italy's refugee population has almost quadrupled in the last fourteen years, growing from 56,397 in 2009 to a maximum of 189,243 in 2019. Figures increased by 13.14% after the Covid-19 pandemic, reaching 144,862 refugees in 2021 (UNHCR Population Statistics Database).

Being a refugee means often experiencing stressful and traumatic situations before, during, and after migration (Bjärtå et al., 2018). These experiences can act as risk factors for the development of mental health-related issues that can often impact the integration within the destination territory through consequences such as unemployment (Bjärtå et al., 2018) and non-integration within the social life of the destination community (Beversluis et al., 2017). In fact, within the refugee population, psychic disorders' prevalence is significantly high, ranging between 30 and 70% (Stingl et al., 2019). Experience of adverse events, lack of support and continuous exposure to the mentioned risk factors, both in their country of origin and in the destination country, may lead to the development of psychological disturbances such as sleep disturbance, anxiety and post-traumatic stress disorder (PTSD) (Fängström et al., 2019; Fazel et al., 2012; Huemer et al., 2009).

Referring to a specific sub-group, such as refugee minors, evidence from a systematic review highlighted higher levels of PTSD-related symptoms among unaccompanied refugee minors than norm populations and accompanied refugee minors (Fazel and Stein, 2002, Huemer et al., 2009). Accordingly, Fazel et al. (2012) focused on refugee minors and unveiled the components of the three stages of the journey. When in their home countries (first stage), young people are usually forced to flee because of wars and exposure to violence, with kids experiencing high instability both at the educational and family level. The journey (second stage) conditions can expose minors to dangers, often separated from their family by accident or for safety reasons. Once in the destination country (third stage), children may experience “secondary trauma”, settling in a new cultural and educational context and often assuming adult roles.

Risk factors impact refugee minors for protracted periods and at critical stages of personality and social identity development, increasing the magnitude of the effect on such fragile personality structures (Gadeberg and Norredam, 2016). Moreover, refugee children and adolescents, in particular once relocated to high-income countries, usually live in disadvantaged areas and are integrated into new education systems (Alpak et al., 2015), with insecurity, cultural differences, racial discrimination and bullying being realities they often face (Fängström et al., 2019; Fazel et al., 2012). Accordingly, “children are especially vulnerable to developing mental health problems because they might find it difficult to adapt to new circumstances and to understand the consequences of the migration” [(Bean et al., 2006), p. 2]. In addition, the long waiting times and the uncertainty around the asylum-seeking process can negatively impact the mental health of refugee minors (ibidem).

1.2. European policies and screening tools

At the European level, the growing focus on migrants’ mental health was supported by the increasing number of refugees reporting mental health issues (Alpak et al., 2015). This focus has been formalised through directive statements calling the states to systematically address and assess refugees’ psychological issues, especially for the most vulnerable ones, such as children and adolescents. The global aim and priority are identifying refugee minors presenting with warning signs for mental health issues. This identification should be included within a framework of strategies and appropriate procedures activating an early and targeted delivery to specialised services and placement in adequate facilities. Over the last decade, public services addressed these issues and reported an increasing interest and need for available and effective screening tools to use from the early stages of contact with unaccompanied foreign minors (Bean et al., 2006).

At the national and local level, the exponential increase in the population of asylum seekers in Italy and Milan in the last five years, including unaccompanied foreign minors, has led to the creation of extraordinary reception facilities facing the need to identify valid and reliable quantitative and qualitative tools assessing mental health issues for refugee minors that can be used in less structured reception contexts within a short timeframe.

In this sense, despite the increasing relevance of the refugee phenomenon and the shreds of evidence associating mental health problems and refugee minors, few psychometric mental health screening instruments have been developed and validated for these populations (Gadeberg and Norredam, 2016). Bean et al. (2007) assessed the preliminary psychometric properties for the Hopkins Symptoms Checklist-37A (HSC-37A) among four heterogeneous groups of refugee adolescents and unaccompanied refugee minors, while in a second study, Bean et al. (2006) examined the preliminary psychometric properties of the Reaction of Adolescents to Traumatic Stress questionnaire (RATS) among the same population (Huemer et al., 2009).

This paper answers the call for further assessment of the applicability of mental health screening instruments (Jakobsen et al., 2011; Mewes et al., 2018) to the specific need to detect mental health disturbance among unaccompanied refugee minors (Fazel et al., 2012; Huemer et al., 2009; Gadeberg and Norredam, 2016). To our knowledge, no studies assessed screening tools with an exclusive focus on this specific population.

This study aimed to assess the administration of the Refugee Health Screener-15 (Kaltenbach et al., 2017) (RHS-15) as an early screening tool for unaccompanied foreign minors in the Italian context. The RHS-15 (Hollifield et al., 2016) assesses some of the primary mental health issues among refugees, such as PTSD, depression and anxiety problems and can be administered as a self-report or within an interview session (see paragraph 2.4 for further details).

The general objective of this study was to assess the implementation process and the validity and reliability of the RHS-15 screening process within this population.

Then, following published validations procedures (Kaltenbach et al., 2017), we specifically aimed to assess:

  • (1)

    the RHS-15 and RHS-13 factorial structures and their reliability;

  • (2)

    Convergent validity of the RHS-15 and RHS-13 using BSI-18 and PCL-5 as comparing screening tools;

  • (3)

    RHS-15 and RHS-13 predictive validity.

2. Method

2.1. Study design

The study consisted of two consecutive parts. In the first part, respondents completed the RHS-15 in approximately 20 minutes. After two weeks, respondents were administered a screening tools battery to complete the RHS-15 validation process.

The following instruments composed the screening tools battery: a) RHS-15 (Hollifield et al., 2013); b) Brief Symptom Inventory-18 (BSI-18: (Derogatis, 2000; Franke et al., 2017; Meijer et al., 2011)); and c) Post Traumatic Stress Disorder Checklist-5 (PCL-5: (Bovin et al., 2016)) (see paragraph 2.4 for further details about measures).

Due to very low or no proficiency in the Italian language, all tools were administered during an interview conducted by a neuropsychiatric unit specialist assisted by a linguistic-cultural mediator to improve the participants’ comprehension of the items.

Before the mediator's assisted administration, the translated format of the items was presented to the participants in their native languages. Then, a double-blind translation procedure was performed between mediators from the same language to ensure accuracy. The item translations have been double-checked for accuracy by native bi-lingual speakers to reduce any possible bias.

The interviews were completed at the reception centers where the participants lived, followed by a discussion between the centre's educational staff and the professionals who administered it. This procedure helped to connect the subjects' overall score to the empirical observations led by the staff within the everyday real-life context.

2.2. Sample

The Italian expression “unaccompanied foreign minors” for unaccompanied asylum-seeking minors or unaccompanied refugee minors defines those minors not having Italian or other EU citizenship that did not apply for asylum and are, for any reason, within the territory of the State without care or representation by their parents or other adults who are legally responsible for them (Accorinti, 2016).

The sample who completed the RHS-15 was selected through convenience sampling (Etikan, 2016) and composed of unaccompanied foreign minors living for six months in reception facilities with medium to low educational regimes. The facilities considered were the Extraordinary Reception Centres (Centri di Accoglienza Straordinaria, CAS), reserved semi-autonomy apartments or youth communities for minors, with the children-educators ratio equal to or less than 5 to 1.

Eighty-one unaccompanied foreign minors were administered the RHS-15 during the first part of the study and completed the battery of tools chosen for the validation process two weeks after the RHS-15 screening. The average age of this final subsample was 16.49 (SD = 0.896, range 13–18, n = 81), the totality was male (100%), and the majority came from Albania (n = 22, 27.2%), followed by Eritrea (n = 16, 19.8%), Tunisia (n = 11, 13.6%) and Kosovo (n = 10, 12.3%).

2.3. Measures

The Refugee Health Screener-15 (Hollifield et al., 2013) is a 15-item screening tool developed to detect and treat refugees experiencing emotional or psychological stress early. The rationale of the RHS-15 arises from the observation that the refugee population is composed of heterogeneous groups experiencing different stress-related symptoms on emotional, psychological and somatic levels (Hollifield et al., 2016). The authors aimed at having a screening tool that could efficiently predict the development of mental health-related issues in heterogeneous refugee groups. The tool includes thirteen items from the New Mexico Refugee Symptoms Checklist-121 (NMRSC-121) (Hollifield et al., 2009), a diagnostic tool assessing the intensity of traumatic experiences in refugee populations. These first thirteen items are on a 5-point Likert scale (from 0 “not at all” to 4 “extremely”), assessing the intensity of symptoms related to depression, anxiety and post-traumatic stress. An additional item (item 14) and a distress thermometer (DT – item 15) (ranging from 0 “no distress, everything is going well” to 10 “extreme distress, worse than ever”) were added to the item pool to investigate participants’ coping skills and how they react to stress. Specifically, the DT asks the participants to evaluate the distress experienced during the last week. The development and initial evaluation of this tool resulted in high reliability (Cronbach's alpha 0.95) and excellent predictive and concurrent validity, significantly correlating with PTSD, anxiety and depression proxies (Hollifield et al., 2016). According to the authors, using the 13-item format may result in more efficiency without compromising sensitivity and specificity. RHS can be self-administered or administered by clinical and educational personnel with the help of an interpreter or mediator in case of low language proficiency of the participant. When using the RHS-15, it is recommended to classify as positive those cases scoring equal to or greater than 12 (equal or greater than 11 when using the 13-item format) in the first fourteen items and scoring equal to or greater than 5 on the DT (item 15) (Hollifield et al., 2016). Two studies on a refugee population in Germany confirmed the tool's applicability (Stingl et al., 2019) and screening qualities (Kaltenbach et al., 2017), demonstrating its cross-cultural ability to detect mental health-related aspects of PTSD, depression, anxiety and somatisation. The RHS has also proven to be a reliable and valid screening tool in its 13-item version. Considering the first 13 items and excluding the additional item (item 14) and the DT (Bjärtå et al., 2018), RHS-13 showed similar psychometric properties compared with the original 15-item version, with a strengthened internal consistency and without impacting its concurrent and predictive validity (Hollifield et al., 2016).

The BSI-18 (Derogatis, 2000; Andreu et al., 2008; Asner-Self et al., 2006) is an assessment tool used to measure psychological distress in the general population. It contains three scales composed of six items each, evaluating somatisation, depression and anxiety traits rated on a 5-point Likert scale (0=not at all to 4=extremely). In addition to scores for individual scales, the three scales determine an overall score called the Global Severity Index (GSI). The identified cut-off threshold for positive cases is a GSI greater than 63 (Derogatis, 2000).

This tool was initially developed for the adult population (aged 18 and over), but BSI-18 has also been widely used and validated in many studies focusing on youth and young adults exposed to violence and trauma, both to assess reliability and validity or directly as an assessment tool in younger, especially if at risk, populations (Asner-Self et al., 2006; Al-Krenawi et al., 2009; Berman et al., 2006; Canada et al., 2007; Contractor et al., 2014; Grenon et al., 2019; Kim et al., 2021; Lancaster et al., 2016; Moscardino, 2008; Mustanski et al., 2010).

The PLC-5 (Blevins et al., 2015) is a tool containing 20 items (0 = not at all to 4 = extremely) estimating the presence and seriousness of PTSD symptoms. It is usually paired with clinical interviews to determine the symptoms' complex nature and relevance within a set of trauma-related symptoms. The literature does not define the cut-off threshold, but scholars indicate 33 as a valid threshold in its practical application (Murphy et al., 2017; Weathers et al., 2013), even if further analysis of the psychometric properties of the tool has indicated thresholds higher than 33 (Blevins et al., 2015). This value corresponds to the total scores on the scale items, as the value is reliable enough to differentiate people with potential post-traumatic stress. Therefore, we adopted 33 as a cut-off justified by scholars’ recommendations and the authors’ clinical expertise for this study.

Recent studies showed that the PCL-5 is applicable for adolescents (Yang et al., 2017), and it has been used in traumatised Chinese youths (Liu et al., 2016; Wang et al., 2015; Li et al., 2020) after the Tianjin explosions, with excellent reliability indexes. In 2018, PCL-5 was used with Malaysian adolescents finding excellent reliability and validity (Murphy et al., 2018). This tool was used with adolescents and young people also in RCTs (Osorio, 2018), in mediation analyzes (Ogińska-Bulik and Michalska, 2020), used with Eye Movement Desensitization and Reprocessing (EMDR) methodology, specifically with adolescent refugees (Smyth-Dent et al., 2019) and proved to have a better diagnostic accuracy compared to the CAPS-5 in a German sample (Krüger-Gottschalk et al., 2017). Other scholars used PCL-5 as a screening instrument for PTSD with displaced populations (Ibrahim et al., 2018) to explain the factorial structure of PTSD (Fresno et al., 2020), to evaluate treatment outcomes for complex PTSD (Bongaerts et al., 2021) and in association with EMDR therapy in pregnant women affected by PTSD (Baas et al., 2017).

BSI-18 and PCL-5 have been used in a previous study as standards for the RHS validation process (Kaltenbach et al., 2017).

2.4. Data analysis

To achieve objective 1, we tested the monofactorial structure through confirmatory factor analysis (CFA) performed with MPlus v.8. The overall fit of the model was evaluated, considering acceptable absolute, relative, and parsimony fit indexes. These indexes were selected based on their statistical power and widespread use in the relevant statistical literature (Hu and Bentler, 1999; Kline, 2011). As indicative of absolute fit, we considered the values of the Standardised Chi-square (χ2/df < 5), the Root Mean Square Error of Approximation (RMSEA <0.08), and the Standardised Root Mean Square Residual (SRMR < 0.08). As a relative fit index, we used the values of the Comparative fit index (CFI > 0.90) (Hu and Bentler, 1999; Kline, 2011). We adopted a maximum likelihood estimation with robust standard errors (MLR estimation) because of items normality and variance issues. The reliability and internal consistency of the two versions of the instruments were assessed using Cronbach's alpha.

To assess the convergent validity, we tested the correlations (Pearson coefficient) between the two versions of the RHS and the PCL-5 and BSI-18.

To assess the predictive validity of the RHS, sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and Fisher's exact tests were calculated, with positive cases defined for PCL-5 as higher than the cut-off threshold and a symptom score above the cut-off for the BSI-18.

3. Results

The results of the RHS-15 have been estimated and reported separating for the first block of 13 items, adding item 14 scores and highlighting the results of the DT (item 15) alone.

The DT contributed significantly to the increase of positive cases, as shown in Table 1, displaying the number of positive cases for the different RHS formats.

Table 1.

Positive RHS screening results.

N %
RHS-13 score greater than or equal to 11 34 42%
RHS-14 score greater than or equal to 12 38 46,9%
DT score greater than or equal to 5 71 87,7%
RHS-15 score greater than or equal to 12 for the first 14 items or DT greater than or equal to 5 78 96,3%

The BSI-18 results were calculated summing up the three sub-scales (somatisation, depression and anxiety) with the total score allowing us to calculate the GSI. Thirteen cases (16.05%) reported a GSI greater than 63 and were then considered positive (Derogatis, 2000).

Considering the results on the PCL-5, 14 cases were positive (17.28%), scoring equal or greater than 33.

3.1. Factor analysis and reliability study

Previous factor analysis (Kaltenbach et al., 2017) revealed a one-factor structure for both RHS-13 and 15-item versions. Accordingly, we tested the monofactorial structure through confirmatory factor analysis (CFA) performed with MPlus v.8.

The 15-items version of the instrument revealed acceptable fit indexes to the data (15-item version: χ2 (91) = 128, p < .001, χ2 /df = 1.4; CFI = 0.866, RMSEA = 0.063, SRMR =0.074) while the 13-item version showed excellent fit (χ2 (64) = 80.162, p < .001, χ2 /df = 1.25; CFI = 0.938, RMSEA = 0.048, SRMR =0.063) with item 14 presenting not significant factor loading and item 5 having a low loading (0.387).

The reliability and internal consistency of the two versions of the instruments were assessed using Cronbach's alpha. The alpha of the different versions of the RHS increased significantly when the DT was removed. Cronbach's alpha increased from 0.76 for the 15-item version to 0.84 for the 13-item version, still below the ones obtained by Hollifield and coll. (2012) (α=0.92 and α= 0.93) and Kaltenbach and coll. (Kaltenbach et al., 2017) (2017) (α= 0.91 and α= 0.93).

3.2. Convergent and predictive validity

The predictive and convergent validity measures are instrumental in understanding the tool's validity in gathering distress signals requiring a detailed diagnostic and more careful observation of the minor.

Referring to convergent validity, we tested the correlations between the two different versions of the RHS and the other mental health measures used for convergent validity.

Table 2 shows that the instrument's 13-item version had an excellent correlation with the PCL-5, BSI-18 and relative sub-scales.

Table 2.

Correlations between RHS and other measures.

PCL BSI-18 Somatisation Depression Anxiety
RHS13 .717⁎⁎⁎a .721⁎⁎⁎c .638⁎⁎⁎c .672⁎⁎⁎c .641⁎⁎⁎c
RHS15 .654⁎⁎⁎a .632⁎⁎⁎c .528⁎⁎⁎c .614⁎⁎⁎c .564⁎⁎⁎c
⁎⁎⁎

p = .000;

⁎⁎p < .01;.

a

n=74,

bn=77,.

c

n=78,

dn=81.

Concerning predictive validity, as highlighted by previous studies (Kaltenbach et al., 2017; Hollifield et al., 2016) and confirmed by these results (see Table 1), the 13-item format showed a greater ability to differentiate positive cases (34 participants [42%] scored higher or equal to 11) compared to the 15-item format and was considered for predictive validity.

The RHS-13 showed a good ability to identify subjects who experience distress (see Table 3). The instrument resulted in high sensitivity coefficients related to the PCL-5 and the BSI-18, while the ability of RHS-13 to identify people who did not experience a distressing situation (specificity) was weaker and reported lower values than the two comparison measures. Sensitivity and specificity are often inversely related. Generally, a screening test, such as the RHS, should be highly sensitive, while a follow-up test should result in high specificity (McNamara and Stacey, 2018).

Table 3.

Predictive validity and sensitivity/specificity analysis.

BSI-18 PCL-5
Positive Negative Positive Negative
RHS-13 Positive 11 23 13 21
Negative 2 45 1 46
Statistic Χ2 = 11.56 p = .001 Χ2 = 17.99 p = .000
Effect size Φ = 0.38 Φ = 0.47
PPV/NPV .32/0.96 .38/0.98
Sens/Spec .85/0.66 .93/0.69

In agreement with sensitivity and specificity results, RHS-13 showed adequate negative predictive capacity (Negative Predictive Value – NPV). Specifically, comparing the values obtained for PCL-5 and BSI-18 highlighted the instrument's ability to avoid false negatives but showed its tendency to identify false positives (Positive predictive value – PPV). NPVs are, in fact, very high in line with what was also reported in Kaltenbach (2017), while PPVs values, on the other hand, are lower and very different from what is reported in Kaltenbach et al. (2017).

4. Discussion

The RHS-15 is a screening tool designed for the early detection of distressing situations within the refugee population. This tool was not originally designed and validated for a population of unaccompanied foreign minors. This population comprises people of different nationalities, with highly diverse ages, backgrounds and trauma sources such as the contexts of origin, destination and the journey's conditions. In this sense, this study assessed the feasibility and psychometric properties of the RHS screening procedure in an Italian reception context for unaccompanied foreign minors.

Consistenly with previous studies on refugee samples (Kaltenbach et al., 2017; Johnson-Agbakwu et al., 2014; Polcher and Calloway, 2016), results showed that the RHS, used as a screening tool for unaccompanied foreign minors, respected its psychometric qualities. The RHS-15, administered as a self-report instrument, showed good feasibility and psychometric properties validity in the examined sample. The shorter version, the RHS-13, proved to be even more time-efficient (Stingl et al., 2019) and resulted in having excellent psychometric qualities, better than its 15-item version, confirming what resulted in previous studies (Kaltenbach et al., 2017; Hollifield et al., 2016) and without compromising sensitivity and specificity.

As suggested by Hollifield and coll. (2016): “Current users of the RHS-15 may continue to implement it with confidence in its usefulness. If efficiency and time are key considerations, removal of either the coping item (item 14) and the DT (item 15) appears acceptable from a metric perspective” (p. 251).

Accordingly, some doubts can be raised about the DT's capacity (item 15) to adequately distinguish the distress experienced by minors and sufficiently differentiate between positive and negative cases. The DT is administered in the initial stages of the reception process because of institutional and legislative needs. This could impact its ability to efficiently differentiate between positive and negative cases: an increased feeling of distress may be caused by the migratory pattern impacting personal identity and planning capacity. Within the first weeks of an unaccompanied foreign minor life in a reception center, there are likely to be strong feelings of unease and frustration caused by institutional processes and not by personal conditions. The RHS-13 showed a high capacity to identify minors experiencing stressful situations, confirming the ability to avoid false negatives, even if there is a clear tendency to identify false positives. Therefore, to avoid susceptibility, it is recommended to consistently integrate the screening results with additional observation and screening elements and use more specific diagnostic tools (Stingl et al., 2019).

The one-factor solution of both versions of the RHS found in Kaltenbach and coll. (2017) and Hollifield and coll. (2016) has been confirmed in our results.

The heterogeneity in terms of nationalities of the sample did not impact the psychometric properties of the RHS-13 that were excellent, with high predictability in detecting mental health problems.

Especially in its 13-item format, RHS resulted in high fairness and transparency relating to cross-cultural validity, guaranteed a simple implementation and proved to be easily understandable for the minors involved, thanks to the translation and the support of linguistic-cultural mediators working alongside the specialist throughout the administration process. Translators and mediators are widely used in mental health screening procedures with refugees and displaced populations (Hollifield et al., 2013). Previous studies recommended the presence of an interpreter to support the screening process (Derogatis, 2000). In our experience, linguistic-cultural mediators are crucial to facilitate the minor in understanding the questions and offer a confidential and culturally sensitive setting where the person does not feel stigmatised or medicalised (Hollifield et al., 2013; Al-Obaidi et al., 2015).

Mediators facilitate the RHS process but may also cause possible biases. Thanks to their ability, they translate concepts not present in the minors’ native languages, such as the “flashback” when discussing the trauma. In this adaptation of concepts, the professional supervising the screening has no control. In other situations, a minor may be numerical illiterate and have problems assessing their experience's intensity on a Likert scale. In these cases, the mediator should use words such as “not much” or “a lot”. Another difficulty concerns the impossibility of using a varied psychological/emotional vocabulary. For example, the difference between “nervous” and “agitated” may cause misunderstanding or terms such as “helpless”, which in some cultures may mean “feeling alone”. The difficulty is to re-signify psychological experiences whose translation complexity can represent a bias.

The main limitation of this study is the complete absence of female participants. At the same time, the limited sample size has been impacted by the difficulty in reaching such a specific population in a fast-changing scenario, with a consistent number of participants dropping out after the first administration. This situation limited the possibility of assessing the instrument's qualities by country of origin (Hollifield et al., 2016), not allowing for a consistent differentiation in accounting for the various cultural backgrounds (Kaltenbach et al., 2017). Nevertheless, this study addressed the need to assess RHS in a real-world public health setting (Hollifield et al., 2013).

5. Conclusions

This study aimed to fill the need for reliable mental health screening tools for refugee minors in Europe, validating the RHS for unaccompanied foreign minors in the Italian context for the first time. The results confirmed the RHS quality in its 13-item format as a valuable, valid and reliable tool for early risk identification. Therefore, the RHS-13 can be included in a screening procedure agreed upon between the main subjects involved in the care and promotion of unaccompanied foreign minors’ mental health (Social Services, Reception Facilities, Neuropsychiatry Services).

The high acceptance rates (Derogatis, 2000; Franke et al., 2017) of the RHS are especially important in the extent to which, administered as self-rating, could be more easily included in an initial screening or be used by people working with unaccompanied foreign minors, such as social workers, teachers or also lay people (Söndergaard et al., 2003).

Based on results from thorough programmes (Savin et al., 2005), our clinical expertise and protocols experimentations in the Italian context, the inclusion of a mental health screening such as the RHS at the beginning of the minors’ care path is recommended, even if more research about reliability in various ethnic groups is needed.

The recommended procedure concerns early risk identification of neuropsychiatric disorders and the reduction of false-positive cases by comparing the screening results retrieved with the RHS, educational observation and specific in-depth studies.

The results obtained in this study may strengthen the national and international network and share good practices for promoting mental health policies and good practices favoring unaccompanied foreign minors and setting an example for other national and international realities addressing the same challenges.

Ethics

The study was authorised by the Milan Area 2 Ethics Committee with provision n. 1788 of 09/20/2018. The authorization covered a non-pharmacological, single institution, spontaneous, non-profit study entitled: "Validating a tool for early identification of mental health warning signs for unaccompanied foreign minors during initial reception: Refugee Health Screener (study typology: validation of a predictive diagnostic tool for prospective cohorts)”, protocol code UONPIA_MIGRANTI_01, promoter Fondazione IRCSS Ca’ Granda Ospedale Maggiore Policlinico di Milano, to be held at the Child and Adolescent Neuropsychiatry Unit.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

The European Commission Asylum, Migration and Integration Fund (AMIF) supported this research. For their contribution to this study, we want to acknowledge: Rossana Mazzoni, Barbara Dal Lago, Paola Maffeis, Chiara Bellantoni, Chiara Berrini, Laura Bernardini, Stefano Piccioni, Silvia Beghelli, Giulia Chitolina, Chiara Fornoni.

We thank all participants, interpreters, cultural mediators, translators and the staff of the facilities and centres as well as the Fondazione IRCSS Ca’ Granda Ospedale Maggiore Policlinico di Milano, for supporting the study.

References

  1. Beversluis D., Schoeller-Diaz D., Anderson M., Anderson N., Slaughter A., Patel R.B. Developing and validating the refugee integration scale in Nairobi, Kenya. J. Refug. Stud. 2017;30(1):106–132. doi: 10.1093/jrs/few018. [DOI] [Google Scholar]
  2. Bjärtå A., Leiler A., Ekdahl J., Wasteson E. Assessing severity of psychological distress among refugees with the refugee health screener, 13-item version. J. Nerv. Ment. Dis. 2018;206(11):834–839. doi: 10.1097/NMD.0000000000000886. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Stingl M., et al. Assessing the special need for protection of vulnerable refugees: testing the applicability of a screening method (RHS-15) to detect traumatic disorders in a refugee sample in Germany. Ethn. Health. 2019;24(8):897–908. doi: 10.1080/13557858.2017.1379598. [DOI] [PubMed] [Google Scholar]
  4. Fängström K., et al. Is the strengths and difficulties questionnaire with a trauma supplement a valuable tool in screening refugee children for mental health problems? J. Refug. Stud. 2019;32:i122–i140. doi: 10.1093/jrs/fey073. special issue 1. [DOI] [Google Scholar]
  5. Fazel M., Reed R.V., Panter-Brick C., Stein A. Mental health of displaced and refugee children resettled in high-income countries: risk and protective factors. Lancet. 2012;379(9812):266–282. doi: 10.1016/S0140-6736(11)60051-2. [DOI] [PubMed] [Google Scholar]
  6. Huemer J., Karnik N.S., Voelkl-Kernstock S., Granditsch E., Dervic K., Friedrich M.H., Steiner H. Mental health issues in unaccompanied refugee minors. Child and adolescent psychiatry and mental health. 2009;3:1–10. doi: 10.1186/1753-2000-3-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Fazel M., Stein A. The mental health of refugee children. Arch. Dis. Child. 2002;87(5):366–370. doi: 10.1136/adc.87.5.366. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Gadeberg A.K., Norredam M. Urgent need for validated trauma and mental health screening tools for refugee children and youth. Eur. Child Adolesc. Psychiatry. 2016;25(8):929–931. doi: 10.1007/s00787-016-0837-2. [DOI] [PubMed] [Google Scholar]
  9. Alpak G., et al. Post-traumatic stress disorder among Syrian refugees in Turkey: a cross-sectional study. Int. J. Psychiatry Clin. Pract. 2015;19(1):45–50. doi: 10.3109/13651501.2014.961930. [DOI] [PubMed] [Google Scholar]
  10. Bean T., Derluyn I., Eurelings-Bontekoe E., Broekaert E., Spinhoven P. Validation of the multiple language versions of the reactions of adolescents to traumatic stress questionnaire. J. Trauma. Stress. 2006;9(2):241–255. doi: 10.1002/jts.20093. [DOI] [PubMed] [Google Scholar]
  11. Bean T., Derluyn I., Eurelings-Bontekoe E., Broekaert E., Spinhoven P. Validation of the multiple language versions of the hopkins symptom checklist-37 for refugee adolescents. Adolescence. 2007;42:51–71. [PubMed] [Google Scholar]
  12. Jakobsen M., Thoresen S., Johansen L.E.E. The validity of screening for post-traumatic stress disorder and other mental health problems among asylum seekers from different countries. J. Refug. Stud. 2011;24(1):171–186. doi: 10.1093/jrs/feq053. [DOI] [Google Scholar]
  13. Mewes R., Friele B., Bloemen E. Validation of the protect questionnaire: a tool to detect mental health problems in asylum seekers by non-health professionals. Torture J. 2018;28(2):56–71. doi: 10.7146/torture.v28i2.106884. [DOI] [Google Scholar]
  14. Kaltenbach E., Härdtner E., Hermenau K., Schauer M., Elbert T. Efficient identification of mental health problems in refugees in Germany: the refugee health screener. Eur. J. Psychotraumatol. 2017;8(2) doi: 10.1080/20008198.2017.1389205. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Hollifield M., et al. Effective screening for emotional distress in refugees: the refugee health screener. J. Nerv. Ment. Dis. 2016;204(4):247–253. doi: 10.1097/NMD.0000000000000469. [DOI] [PubMed] [Google Scholar]
  16. Hollifield M., et al. The refugee health screener-15 (RHS-15): development and validation of an instrument for anxiety, depression, and PTSD in refugees. Gen. Hosp. Psychiatry. 2013;35(2):202–209. doi: 10.1016/j.genhosppsych.2012.12.002. [DOI] [PubMed] [Google Scholar]
  17. Derogatis L.R. NCS Pearson; Minneapolis, MN: 2000. BSI-18: Brief Symptom Inventory 18. Administration, Scoring, and Procedures Manual. [Google Scholar]
  18. Franke G.H., Jaeger S., Glaesmer H., Barkmann C., Petrowski K., Braehler E. Psychometric analysis of the brief symptom inventory 18 (BSI-18) in a representative German sample. BMC Med. Res. Methodol. 2017;17(1):1–7. doi: 10.1186/s12874-016-0283-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Meijer R.R., de Vries R.M., van Bruggen V. An evaluation of the brief symptom inventory–18 using item response theory: which items are most strongly related to psychological distress? Psychol. Assess. 2011;23(1):193–202. doi: 10.1037/a0021292. [DOI] [PubMed] [Google Scholar]
  20. Bovin M.J., et al. Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental disorders–fifth edition (PCL-5) in veterans. Psychol. Assess. 2016;28(11):1379–1391. doi: 10.1037/pas0000254. [DOI] [PubMed] [Google Scholar]
  21. Accorinti M. Unaccompanied foreign minors in Italy: a political and social analysis. Soc. Sci. Learn. Educ. J. 2016;1(9):27–41. [Google Scholar]
  22. Etikan I. Comparison of convenience sampling and purposive sampling. Am. J. Theor. Appl. Stat. 2016;5(1):1–4. doi: 10.11648/j.ajtas.20160501.11. [DOI] [Google Scholar]
  23. Hollifield M., Warner T.D., Krakow B., Jenkins J., Westermeyer J. The range of symptoms in refugees of war: the new mexico refugee symptom checklist-121. J. Nerv. Ment. Dis. 2009;197(2):117–125. doi: 10.1097/NMD.0b013e31819642dc. [DOI] [PubMed] [Google Scholar]
  24. Andreu Y., et al. Psychometric properties of the brief symptoms inventory-18 (BSI-18) in a Spanish sample of outpatients with psychiatric disorders. Psicothema. 2008;20(8):844–850. [PubMed] [Google Scholar]
  25. Asner-Self K.K., Schreiber J.B., Marotta S.A. A cross-cultural analysis of the brief symptom inventory-18. Cultur. Divers. Ethnic Minor. Psychol. 2006;12(2):367–375. doi: 10.1037/1099-9809.12.2.367. [DOI] [PubMed] [Google Scholar]
  26. Al-Krenawi A., Graham J.R., Kanat-Maymon Y. Analysis of trauma exposure, symptomatology and functioning in Jewish Israeli and Palestinian adolescents. Br. J. Psychiatry. 2009;195(5):427–432. doi: 10.1192/bjp.bp.108.050393. [DOI] [PubMed] [Google Scholar]
  27. Berman S.L., Weems C.F., Stickle T.R. Existential anxiety in adolescents: prevalence, structure, association with psychological symptoms and identity development. J. Youth Adolesc. 2006;35(3):285–292. doi: 10.1007/s10964-006-9032-y. [DOI] [Google Scholar]
  28. Canada A.L., Schover L.R., Li Y. A pilot intervention to enhance psychosexual development in adolescents and young adults with cancer. Pediatr. Blood Cancer. 2007;49(6):824–828. doi: 10.1002/pbc.21130. [DOI] [PubMed] [Google Scholar]
  29. Contractor A.A., et al. Relations between PTSD and distress dimensions in an indian child/adolescent sample following the 2008 mumbai terrorist attacks. J. Abnorm. Child Psychol. 2014;42(6):925–935. doi: 10.1007/s10802-013-9846-5. [DOI] [PubMed] [Google Scholar]
  30. Grenon M., Consigny M., Lemey C., Simson J.P., Coulon N. Impact of a terrorist attack on the mental health of directly exposed french adolescents: study protocol for the first step of the AVAL cohort study. Front. Psychiatry. 2019;10:744. doi: 10.3389/fpsyt.2019.00744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kim D.H., Michalopoulos L.M., Voisin D.R. Validation of the brief symptom inventory–18 among low-income African American adolescents exposed to community violence. J. Interpers. Violence. 2021;36(1–2):NP984–NP1002. doi: 10.1177/0886260517738778. [DOI] [PubMed] [Google Scholar]
  32. Lancaster M.A., McCrea M.A., Nelson L.D. Psychometric properties and normative data for the brief symptom inventory-18 (BSI-18) in high school and collegiate athletes. Clin. Neuropsychol. 2016;30(2):321–333. doi: 10.1080/13854046.2016.1138504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Moscardino U. Psychological adjustment of adolescents 18 months after the terrorist attack in beslan, russia: a cross-sectional study. J. Clin. Psychiatry. 2008;69(5):854–859. doi: 10.4088/jcp.v69n0520. [DOI] [PubMed] [Google Scholar]
  34. Mustanski B.S., Garofalo R., Emerson E.M. Mental health disorders, psychological distress, and suicidality in a diverse sample of lesbian, gay, bisexual, and transgender youths. Am. J. Public Health. 2010;100(12):2426–2432. doi: 10.2105/AJPH.2009.178319. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Blevins C.A., Weathers F.W., Davis M.T., Witte T.K., Domino J.L. The posttraumatic stress disorder checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J. Trauma. Stress. 2015;28(6):489–498. doi: 10.1002/jts.22059. [DOI] [PubMed] [Google Scholar]
  36. Murphy D., Ross J., Ashwick R., Armour C., Busuttil W. Exploring optimum cut-off scores to screen for probable posttraumatic stress disorder within a sample of UK treatment-seeking veterans. Eur. J. Psychotraumatol. 2017;8(1) doi: 10.1080/20008198.2017.1398001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. F.W. Weathers, B.T. Litz, T.M. Keane, P.A. Palmieri, B.P. Marx, P.P. Schnurr, The PTSD Checklist for DSM-5 (PCL-5), 2013.
  38. Blevins C.A., Weathers F.W., Davis M.T., Witte T.K., Domino J.L. The posttraumatic stress disorder checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J. Trauma. Stress. 2015;28:489–498. doi: 10.1002/jts.22059. [DOI] [PubMed] [Google Scholar]
  39. Yang H., et al. The underlying dimensions of DSM-5 PTSD symptoms and their relations with anxiety and depression in a sample of adolescents exposed to an explosion accident. Eur. J. Psychotraumatol. 2017;8(1) doi: 10.1080/20008198.2016.1272789. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Liu L., Wang L., Cao C., Qing Y., Armour C. Testing the dimensional structure of DSM-5 posttraumatic stress disorder symptoms in a nonclinical trauma-exposed adolescent sample. J. Child Psychol. Psychiatry. 2016;57(2):204–212. doi: 10.1111/jcpp.12462. [DOI] [PubMed] [Google Scholar]
  41. Wang L., et al. Assessing the underlying dimensionality of DSM-5 PTSD symptoms in Chinese adolescents surviving the 2008 Wenchuan earthquake. J. Anxiety Disord. 2015;31:90–97. doi: 10.1016/j.janxdis.2015.02.006. [DOI] [PubMed] [Google Scholar]
  42. Li G., et al. Test of the dynamic interplay between DSM-5 PTSD symptom clusters in children and adolescents. J. Anxiety Disord. 2020;76 doi: 10.1016/j.janxdis.2020.102319. [DOI] [PubMed] [Google Scholar]
  43. Murphy S., Hansen M., Elklit A., Chen Y.Y., Ghazali S.R., Shevlin M. Alternative models of DSM-5 PTSD: examining diagnostic implications. Psychiatry Res. 2018;262:378–383. doi: 10.1016/j.psychres.2017.09.011. [DOI] [PubMed] [Google Scholar]
  44. Osorio A. Randomized controlled trial on the EMDR integrative group treatment protocol for ongoing traumatic stress with adolescents and young adults patients with cancer. Am. J. Appl. Psychol. 2018;7(4):50–56. doi: 10.11648/j.ajap.20180704.11. [DOI] [Google Scholar]
  45. Ogińska-Bulik N., Michalska P. Type D personality in adolescents – the mediating role between depression and PTSD. Curr. Psychol. 2020;40:6145–6154. doi: 10.1007/s12144-020-00935-6. [DOI] [Google Scholar]
  46. Smyth-Dent K., Fitzgerald J., Hagos Y. A field study on the EMDR integrative group treatment protocol for ongoing traumatic stress provided to adolescent Eritrean refugees living in Ethiopia. Psychol. Behav. Sci. Int. J. 2019;12(4):1–12. [Google Scholar]
  47. Krüger-Gottschalk A., et al. The German version of the posttraumatic stress disorder checklist for DSM-5 (PCL-5): psychometric properties and diagnostic utility. BMC Psychiatry. 2017;17(1):1–9. doi: 10.1186/s12888-017-1541-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Ibrahim H., Ertl V., Catani C., Ismail A.A., Neuner F. The validity of posttraumatic stress disorder checklist for DSM-5 (PCL-5) as screening instrument with Kurdish and Arab displaced populations living in the Kurdistan region of Iraq. BMC Psychiatry. 2018;18(1):1–8. doi: 10.1186/s12888-018-1839-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Fresno A., et al. Using exploratory structural equation modeling (ESEM) to examine the internal structure of posttraumatic stress disorder symptoms. Span. J. Psychol. 2020;23:e48. doi: 10.1017/SJP.2020.46. [DOI] [PubMed] [Google Scholar]
  50. Bongaerts H., Voorendonk E.M., van Minnen A., de Jongh A. Safety and effectiveness of intensive treatment for complex PTSD delivered via home-based telehealth. Eur. J. Psychotraumatol. 2021;12(1) doi: 10.1080/20008198.2020.1860346. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Baas M.A.M., Stramrood C.A.I., Dijksman L.M., de Jongh A., van Pampus M.G. The OptiMUM-study: EMDR therapy in pregnant women with posttraumatic stress disorder after previous childbirth and pregnant women with fear of childbirth: design of a multicentre randomized controlled trial. Eur. J. Psychotraumatol. 2017;8(1) doi: 10.1080/20008198.2017.1293315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 1999;6(1):1–55. doi: 10.1080/10705519909540118. [DOI] [Google Scholar]
  53. Kline R.B. Guilford Press; New York: 2011. Principles and Practice of Structural Equation Modeling. [Google Scholar]
  54. McNamara L., Stacey W.M. 5th ed. Elsevier; Amsterdam: 2018. Principles of Epidemiology and Public Health, in: Principles and Practice of Pediatric Infectious Diseases; pp. 1–9. [Google Scholar]
  55. Johnson-Agbakwu C.E., Allen J., Nizigiyimana J.F., Ramirez G., Hollifield M. Mental health screening among newly arrived refugees seeking routine obstetric and gynecologic care. Psychol. Serv. 2014;11(4):470–476. doi: 10.1037/a0036400. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Polcher K., Calloway S. Addressing the need for mental health screening of newly resettled refugees: a pilot project. J. Prim. Care Community Health. 2016;7(3):199–203. doi: 10.1177/2150131916636630. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Al-Obaidi A., West B., Fox A., Savin D. Incorporating preliminary mental health assessment in the initial healthcare for refugees in New Jersey. Community Ment. Health J. 2015;51(5):567–574. doi: 10.1007/s10597-015-9862-8. [DOI] [PubMed] [Google Scholar]
  58. Söndergaard H.P., Ekblad S., Theorell T. Screening for post-traumatic stress disorder among refugees in Stockholm. Nord. J. Psychiatry. 2003;57(3):185–189. doi: 10.1080/08039480310001328. [DOI] [PubMed] [Google Scholar]
  59. Savin D., Seymour D.J., Littleford L.N., Bettridge J., Giese A. Findings from mental health screening of newly arrived refugees in Colorado. Public Health Rep. 2005;120(3):224–229. doi: 10.1177/003335490512000303. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Migration and Health are provided here courtesy of Elsevier

RESOURCES