Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2021 Apr 1;18(7):3681. doi: 10.3390/ijerph18073681

Alice in Suicideland: Exploring the Suicidal Ideation Mechanism through the Sense of Connectedness and Help-Seeking Behaviors

Minh-Hoang Nguyen 1,2, Tam-Tri Le 1,2,*, Hong-Kong To Nguyen 1,2, Manh-Toan Ho 1,2, Huyen T Thanh Nguyen 1,2, Quan-Hoang Vuong 1,2,*
Editor: Paul Tchounwou
PMCID: PMC8037954  PMID: 33916123

Abstract

On average, one person dies by suicide every 40 s. However, extant studies have largely focused on the risk factors for suicidal behaviors, not so much on the formation of suicidal thoughts. Therefore, we attempt to explain how suicidal thoughts arise and persist inside one’s mind using a multifiltering information mechanism called Mindsponge. Bayesian analysis with Hamiltonian Markov Chain Monte Carlo (MCMC) technique was run on a dataset of multinational students (N = 268) of an international university in Japan. Item 9 in the PHQ-9 was used to survey suicidal ideation. The associations among four main variables, namely, (i) suicidal ideation, (ii) help-seeking willingness (informal and formal sources), (iii) sense of connectedness, and (iv) information inaccessibility (represented by being international students), were tested in four models. Sense of connectedness is negatively associated with suicidal ideation, but its effect becomes less impactful when interacting with international students. The impact of a sense of connectedness on informal help-seeking willingness (toward family members) among international students is also lessened. Informal help-seeking is negatively associated with suicidal ideation, whereas formal help is positive. The findings support our assumption on three fundamental conditions for preventing suicidal thoughts: (i) a high degree of belongingness, (ii) accessibility to help-related information, and (iii) healthy perceived cultural responses towards mental health. Therefore, systematically coordinated programs are necessary to effectively tackle suicidal ideation.

Keywords: suicidal ideation mechanism, Bayesian inference, sense of connectedness, help-seeking behavior, transcultural psychiatry, mindsponge


And how do you know that you’re mad?’ ‘To begin with,’ said the Cat, ‘a dog’s not mad. You grant that?’ ‘I suppose so,’ said Alice. ‘Well, then,’ the Cat went on, ‘you see, a dog growls when it’s angry, and wags its tail when it’s pleased. Now I growl when I’m pleased, and wag my tail when I’m angry. Therefore I’m mad.

—Lewis Carroll [1]—

1. Introduction

The very basic human instinct of self-preservation presupposes that any life is too precious to be ended. However, according to recent data, one person dies due to suicide every 40 s [2]. This means over 800,000 people die by suicide every year, accounting for about 1.4% of all deaths worldwide [2,3]. In Japan, where the suicide rate is one of the highest in the world, the total number of deaths from suicide in October 2020 is higher than the total number of deaths from the new coronavirus disease (COVID-19) up to that point [4]. Suicide is the leading cause of death for Japanese aged 15–39, with students being especially more vulnerable [5]. Particularly, depression, as a major contributor to suicide [3,6], was found to be highly prevalent among international university students in Japan [7,8]. To explain why this is the case, we need to explore how suicidal thoughts arise and persist inside one’s mind, taking into account a complex set of factors.

From the perspective of evolutionary biology, the act of self-killing is seen as maladaptive [9]. It is an act that can only be realized once humans have gained the necessary cognitive skills to contemplate the implications of no longer existing in the world [9]. No single approach, whether Western philosophy [10,11] or Eastern traditions [12,13], portrays suicide as a simple, straightforward subject even as it is commonly understood as some kind of desire for one’s pain, bodily or mental, to stop. A certain cost–benefit judgment likely happens every time one faces suicidal thoughts. Analyses on the components of such a judgment, however, vary depending on the applied theories.

Regarding contributing factors of suicidal ideation, two major schools of thought stand out [14,15,16,17,18,19,20]. Joiner and Van Orden et al. suggested that thwarted belongingness and perceived burdensomeness together lead to dangerous suicidal desire [15,18]. At the same time, O’Connor and Kirtley found the driving factors to be defeat and entrapment [17]. De Beurs et al. later stated that internal entrapment and perceived burdensomeness are the strongest factors. Still, defeat, external entrapment, and thwarted belongingness do not relate as much to suicidal ideation among young adults [14]. However, Gunn et al. and You et al. both shared that social connectedness (or belongingness) is the key factor driving adolescent suicidal thoughts and behaviors [21,22].

The inconsistencies in empirical research suggest a need for a new theory or model that can explain the underlying complexity and dynamics of the suicidal ideation process. Thus, our study aims to demonstrate how suicidal ideation may form and persist using the Mindsponge model—a mechanism of absorbing, analyzing, updating, and ejecting information [23,24]. The mechanism can be used to explain how a sense of connectedness influences suicidal ideation and what puzzle pieces were missing in prior studies that caused the inconsistencies. Moreover, to justify the mechanism, we employed the Bayesian analysis on a dataset of multinational university students in Japan.

More in-depth explanation, validation, and discussion about the mechanism will be presented later in the following sections: Theoretical Foundation, Methods and Materials, Results, Discussion, and Conclusion.

2. Theoretical Formulation

2.1. Suicide-Related Theories

Currently, two well-known theories have been proposed and advocated to explain the existence of suicidal ideation and engagement in suicidal behaviors. The first theory is the Interpersonal Theory of Suicide (ITS), proposed by Van Orden et al. [18,19,20]. The theory assumes that a suicidal desire is determined by the co-existence of a high level of thwarted connectedness and perceived burdensomeness. The lethal (or near-lethal) suicidal attempts are driven by the capability for suicide. The authors define thwarted connectedness as a feeling of not belonging in the current environment and the perceived burdensomeness as feeling like a burden for others.

The second one is the Integrated Motivational–Volitional Model (IMV) [17]. Its core idea suggests that suicidal behaviors result from a complex interplay of motivational and volitional phase factors. To explain the formation of suicidal thoughts and respective enaction, O’Connor separated the model into three phrases: pre-motivational, motivational, and volitional phrase. The first phase consists of biosocial contexts for suicide (e.g., diathesis, environment, and life events). The second phrase describes how suicidal ideation is formulated through motivational factors (e.g., social problem-solving, coping, memory biases, etc.). Suicidal behaviors only emerge during the third phase after meeting some volitional moderators (e.g., access to means, impulsivity, capability, etc.).

Both theories have generated useful frameworks for researchers to study the formation of suicidal thoughts and behaviors systematically. However, further understanding about the root of suicidal ideation should take into account the underlying mechanism, in addition to the interactions of risk factors from within. As the human mind is a multiplex system, its psychological process should be explained and interpreted using a dynamic model rather than conventional static theories. Moreover, such dynamics and complexity are amplified when putting physical and social influences from the individual’s surrounding environment into consideration. While the ITS and IMV focus on answering the ontological question of what factors influence suicidal ideation and behaviors using the positivism viewpoint, the present study expands to the “how” aspect—particularly, how the influences on suicidal ideation work. The explanation for suicidal ideation’s predictors utilizes the mindsponge mechanism that concerns a person’s cognitive and environmental interactions with better dynamics, generalizability, and explainability.

2.2. Mindsponge Mechanism of Suicidal Ideation

2.2.1. Mindsponge Mechanism

In this sub-section, we would like to introduce the Mindsponge mechanism and how it could help explain the formation of suicidal thoughts and behaviors. Every person develops a mindset (or a set of core values) that defines the person’s identity, perceptions, and behaviors. The Mindsponge is a mechanism illustrating how a person can absorb new values and eject waning values conditionally based on contexts. The absorbing and ejecting mechanisms are driven by a multi-filtering information process detecting and connecting insights (or information) among different disciplines as well as using inductive attitudes for plausible reasoning [23,24]. For clarity’s sake, Mindsponge is not only a coping mechanism aiming to solve internal conflicts but rather a broader, more inclusive model of cognition shifting process, which also includes such kind of adaptation.

Information coming from the surrounding environment is judged to whether be kept or dismissed based on its perceived value. The filtering process uses cost–benefit judgment-including both rational and emotional-through many layers. The closer the information moves toward the mindset, the stronger the filtering effect becomes. Information accepted into the mindset is integrated into one’s belief system and will affect subsequent decisions and, thus, may create a loop that accepts and reinforces similar information. Filters are based on core beliefs and contexts simultaneously, which means an individual’s cost–benefit judgments are made based on the inductive reasoning of environmental factors and the mindset’s preferences. Persistently, the mindset absorbs and ejects information so that it can maximize total perceived-benefit and reduce total perceived-cost for an individual in a constantly updating manner.

2.2.2. Process of Suicidal Ideation

Within the scope of this study, we focus on two major questions:

  1. How are suicidal thoughts formulated in a student’s mind?

  2. How can a student get rid of suicidal thoughts?

First of all, we assume that any students who have suicidal thoughts in mind consider suicide an option when dealing with certain circumstances (e.g., depression, anxiety, perceived burdensomeness, loneliness, etc.). The option of killing themselves is one among many other alternatives, such as seeking help, solving the problems, doing more meaningful activities, etc. Based on the Mindsponge mechanism, an option is judged by the mind. Two conditions need to be fulfilled before an individual considers an “act” to be a viable and preferable option (here, the act is suicide).

The first condition is the existence of suicide-related information within the environment surrounding the individual (or within the approachable range of an individual). The second condition is the filter’s decision to let the information move in closer toward the mindset. For information to get close to the mindset, it needs to pass through the filter’s gate of cost–benefit judgment. If suicide-related information successfully enters the mindset and becomes one of the mind’s core preferences, suicidal ideation happens. Speaking in this sense, an individual acquires suicidal ideation when he/she perceives suicide (or becoming non-existent) as beneficial.

However, what makes an individual feel better off dead? There are multiple reasons, including depression, psychological distress, physical or psychological pain, etc. Thus, we assume that suffering is the perceived cost of living that drives an individual to consider suicide beneficial. An example of clearer demonstration for this cost–benefit judgment is the case of euthanasia-intentionally ending one’s own life to relieve unbearable pain (usually due to untreatable diseases) with help from medical doctors—a practice considered legal in a few countries. However, the perceived cost of living due to suffering will be lessened if an individual can find effective help sources. When such help exists and is accessible, the person’s mind will favor ejecting suicide-related information based on the filter’s updated cost–benefit judgment.

We present here an example to demonstrate the filtering process. The idea of talking to one’s father may meet the following internal inquiries: is he available to talk; do I like or dislike him for the fact that I talk to him; will he be able to help me emotionally or practically; do I even need to talk to someone; etc. Similarly, the idea of jumping from the rooftop will face evaluation: why do I even think about this; will it hurt; is there no other better option; should I seek help instead; is existence worth it, etc. As formerly accepted information moves closer to the core beliefs, its influence on behavior is stronger, but the inquiries will become more fundamental. For example, the decision to rely on family members for support may be judged based on one’s perceived self-worth or even childhood trauma. In contrast, the decision to attempt suicide may be judged based on the instinctive will to live or prevalent religious belief.

So, what is the role of a sense of connectedness in this process? We hypothesize that an individual’s sense of connectedness between themselves and other people acts as a component of the filter—which is driven by the core values within one’s mindset (preferences). Specifically, if an individual’s level of connectedness is high, his/her filter will be less rigorous toward information received from other people and vice versa. Nevertheless, being less rigorous toward the received information does not mean that an individual can absorb help-related information from a priorly perceived source as inaccessible (to certain degrees), which causes a rise in help-seeking behavior’s perceived cost.

Figure 1 is a visualization of the Mindsponge process of suicidal ideation and help-seeking behaviors in two groups of students: international students in Japan and domestic Japanese students. The red nucleus circle represents a student’s core mindset, which stores the core beliefs and values. In the middle, the light blue circle represents the mind’s filter gate, a buffer zone for information to enter and go through the cost–benefit judgment. The outer green circle represents a student’s surrounding social environment. Each inner circle has a white layer. These altogether comprise a three-dimensional filter for inductive attitude.

Figure 1.

Figure 1

The Mindsponge process of suicidal ideation and help-seeking information.

2.2.3. Research Objectives

Based on the aforementioned theoretical explanation and the higher education context, we speculate that the sense of connectedness is helpful for students to find and absorb useful help-related information, which could eventually lead to a lower suicidal ideation rate. However, if the help-related information is inaccessible, the effect of a sense of connectedness will become weaker in lessening the suicidal ideation rate. To justify this proposition, we devised three steps:

Step 1: We examine the effect of a sense of connectedness and its interaction with perceived information inaccessibility on suicidal ideation. Here, we assume that being an international student represents information inaccessibility due to their low language proficiency, limited social network, acculturative purposes, etc. Thus, Model 1 is proposed. Suppose the interaction between the sense of connectedness and being an international student is positively associated with suicidal ideation. In that case, perceived information inaccessibility might associate with a higher probability of suicidal ideation. The inaccessibility to information might increase the suicide’s perceived benefit (e.g., to stop suffering) because it increases the cost of seeking help. To confirm this assumption, we continue to Step 2.

Suicide ~ α+TCC+TCCinter_dom (1)

Step 2: We examine the effect of a sense of connectedness and its interaction with perceived information inaccessibility on the willingness to seek help from both informal and formal sources. The associations are explored by Models 2 and 3, respectively. If the interaction between the sense of connectedness and being an international student lessens the supposed positive effect of the sense of connectedness toward help-seeking willingness, then information perceived inaccessibility might reduce the willingness to seek help (or raise the perceived cost of seeking help). To test whether help-related information negates suicide-related information, we continue to conduct Step 3.

InformalHelp ~ α+TCC+TCCInter_Dom (2)
FormalHelp ~ α+TCC+TCCinter_dom (3)

Step 3: We examine the effect of willingness to seek help from informal and formal sources on suicidal ideation. Model 4 demonstrates the association. Suppose the willingness to seek help is negatively associated with suicidal ideation. In that case, we could support the notion that help-related information negates suicide-related information and would suggest that the perceived accessibility to help-related information is the missing puzzle of the “sense of connectedness-suicidal ideation” relationship.

Suicide ~ α+ FormalHelp+InformalHelp  (4)

The Mindsponge mechanism that drives the authors to develop the three steps above is illustrated in Figure 1. The authors also want to be transparent about what led to these hypotheses. This study’s two co-authors have spent more than six years in the university selected as the study site and had both gone through periods of depression with suicidal ideation. Through personal experience and observation, they provided some insights and personal experiences for generating the above assumptions. The materials, methods, and results to support these hypotheses are presented subsequently.

3. Materials and Methods

3.1. Study Site and Participants

This study employed a dataset of students’ mental health and help-seeking behaviors in Japan’s multicultural environment. The data has been employed and validated in several studies [8,25,26]. The data were collected from Ritsumeikan Asia Pacific University (APU)—an international university in Oita Prefecture, Japan, from October to December 2018. At the time of survey collection, there were students from 86 countries and regions and faculty members from 22 countries and regions. The proportion of international students on campus was approximately 50.1%.

Among the total sample of 268 students, 75% were international, and 25% were domestic. Male and female percentages were 37% and 63%, respectively. International students were from various origins, such as East Asia, South Asia, South East Asia, etc., but the majority were from South East Asia regions (45.5%). More details of respondents’ socio-demographic characteristics are presented in Nguyen et al. data descriptor [25].

The survey design and procedure received permission from APU’s Ethical Committee Board Approval Number 2018-03 and strictly conformed to the World Medical Association (WMA) Declaration of Helsinki. The approval letter is included in the Supplementary. The survey was conducted using the Google Forms platform due to its advantage of accessibility, data management, and confidentiality. The questionnaire was available in both English and Japanese language. Before participants fill in the questionnaire, a consent form with clear explanations of the survey’s purpose, content, information security, and the right to refuse or withdraw was given on the first page and accompanied by in-person presentations.

3.2. Statistical Analysis and Variables

While the dataset covers multiple variables, we purposely selected variables that help explain the formulation mechanism of suicidal thoughts among international and domestic students. In total, we employed five variables. The description of each variable is presented in Table 1.

Table 1.

Variable description.

Name Variable Data Type Description
Suicidal ideation Suicide Binary Suicidal ideation in the past two weeks based on the PHQ-9 [27,28]. ‘Yes’ is coded as 1, ‘No’ is coded as 0.
Informal help-seeking source InformalHelp Continuous The average score of willingness to seek help from parents and family members. The data range from 1 to 7.
Formal help-seeking source FormalHelp Continuous The average score of willingness to seek help from professionals and doctors when encountering emotional difficulties. The data range from 1 to 7.
Type of student Inter_Dom Binary Whether the respondent is an international or domestic student. ‘International student’ is coded as 1, ‘Domestic student’ is coded as 0.
Total connectedness and companionship TCC Continuous The total score of connectedness (4 items) and companionship (1 item) measured by the Social Connectedness Scale developed by Lee and Robins [29]. The data range from 6 to 48.

In this study, we employed item 9 in the PHQ-9 to examine suicidal ideation in students. The item was found to be a robust predictor of suicide attempts and deaths regardless of age [30]. The item is “Over the last two weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?” with four response options: "not at all", "several days", "more than half the days", and "nearly every day". Respondents answering "not at all" are coded as 0, while the rest are coded as 1. For InformalHelp, we purposely selected the willingness to seek help from parents and relatives because they are the two most apparent help-seeking sources that international students perceive as relatively more inaccessible than domestic students. For TCC, we purposely exclude items of affiliation to keep consistency with the variable InformalHelp and to focus on the sense of connectedness.

All the data were analyzed using the Bayesian analysis with the Hamiltonian MCMC technique (Markov Chain Monte Carlo). We employed Bayesian modeling for three major reasons. Firstly, evidence in the current study is novel, which requires future validation in various contexts and benefits from the Bayesian inference’s updating capability [31,32]. Secondly, for justifying the Theoretical Foundation section’s assumptions, high flexibility in model fitting is required. Such flexibility can be achieved by using the Bayesian inference [33]. Finally, given the dataset’s small sample size, the estimation’s precision will be greatly enhanced by applying the MCMC simulation technique [34].

For conducting the analysis, we initially downloaded the data from its online repository and then generated necessary variables (InformalHelp and FormalHelp) in addition to the existing ones. It should be noted that the variable TCC is not available in the published dataset, so we have attached a sufficient dataset and codes in the Supplementary for future replication. The data were later uploaded to the R software (version 4.0.2) and analyzed using the bayesvl package [35,36,37]. The package has been utilized for multiple studies in various fields [38,39,40,41]. The simulation setup was organized with 5000 iterations (2000 are warm-up iterations), four Markov chains, and four cores. We used the Pareto smoothed importance-sampling leave-one-out cross-validation (PSIS-LOO) approach to check for goodness-of-fit [42]. The Gelman and autocorrelation plots were also visualized to check whether the Markov property is achieved. Since no study of the same type has been conducted, all estimations’ priors were set as uninformative [31], which is equivalent to a normal distribution with mean = 0 and standard deviation = 10.

4. Results

To test the assumptions made above, we examined four models as presented in the Research Objectives sub-section. All the models’ simulated results and their technical validity are presented accordingly.

4.1. Model 1

In the first model, we examine the association of a sense of connectedness and its interaction with perceived information inaccessibility (represented by being international students) against suicidal ideation. The logical network of the Model is presented in Figure 2.

Figure 2.

Figure 2

Model 1′s logical network.

Good Pareto k estimates (k < 0.5) in the PSIS diagnostic plot show that the model fits the data (see Figure 3). As shown in Table 2, all simulated posteriors’ effective sample size (n_eff) is larger than 1000. Each trace plot with four Markov chains fluctuating around a central equilibrium shows good convergence (see Figure 4). There is almost no difference between the between-chain variance and within-chain variance as the shrink factors reduce to one during the warm-up phase (see Figure A1). The Markov property is held because the autocorrelations of MCMC-simulated samples eliminated quickly to 0 (see Figure A2).

Figure 3.

Figure 3

Model 1′s Pareto smoothed importance-sampling (PSIS) diagnostic plot.

Table 2.

Model 1′s simulated posteriors.

Parameters Mean SD n_eff Rhat
Constant 2.56 0.65 4236 1
TCC −0.93 0.16 3821 1
TCC*Inter_Dom 0.07 0.09 4932 1

Figure 4.

Figure 4

Trace plots for Model 1′s posterior coefficients.

Sense of connectedness shows a negative association with suicidal ideation (μTCC_Suicide = −0.93 and σTCC_Suicide = 0.07), but when the interaction with being international students is added, the sense of connectedness’s effect on suicidal ideation becomes less impactful (μTCCInter_Dom_Suicide = 0.07 and σTCCInter_Dom_Suicide = 0.09). Visually, the interaction effect on suicidal ideation is moderately reliable because the majority of the posterior distribution lies on the positive side (see Figure 5).

Figure 5.

Figure 5

Distributions of Model 1′s posterior coefficients with HPDI at 95%.

4.2. Model 2

The second model examines the effect of a sense of connectedness and its interaction with perceived information inaccessibility (represented by being an international student) on informal help-seeking behavior. Its logical connection is shown in Figure 6.

Figure 6.

Figure 6

Model 2′s logical network.

Similar to model 1, the second model exhibits a high goodness-of-fit with the data (k < 0.5, see Figure 7). The effective sample size (n_eff > 1000) and Gelman shrink factor (Rhat = 1) of all simulated posteriors portray a good convergence of Markov chains (see Table 3). Posterior coefficients’ trace plots, Gelman plots, and autocorrelation plots all demonstrate a good convergence signal (see Figure 8, Figure A3, Figure A4).

Figure 7.

Figure 7

Model 2′s PSIS diagnostic plot.

Table 3.

Model 2′s simulated posteriors.

Parameters Mean SD n_eff Rhat
Constant 2.58 0.43 5593 1
TCC 0.31 0.10 5522 1
TCC*Inter_Dom −0.09 0.04 7420 1

Figure 8.

Figure 8

Trace plots for Model 2′s posterior coefficients.

The total sense of connectedness is found to positively influence informal help-seeking behaviors (μTCC_InformalHelp = 0.31 and σTCC_InformalHelp = 0.10), which is relatively intuitive. In contrast, the interaction produces a negative value, suggesting the lower effect of sense of connectedness on help-seeking behavior among international students (μTCCInter_Dom_InformalHelp = −0.09 and σTCCInter_Dom_InformalHelp = 0.04). The distribution of TCC*Inter_Dom falls almost entirely in the 95% the Highest Posterior Distribution Intervals (HPDI) range, indicating high reliability of the effect (see Figure 9). We can also see that the majority of simulated samples are located on the positive side of TCC (x-axis) and the negative side of TCC*Inter_Dom (y-axis) in the pairwise distribution graph (see Figure 10). These distributions, again, hint at the high reliability of TCC’s and TCC*Inter_Dom’s impacts on InformalHelp.

Figure 9.

Figure 9

Distributions of Model 2′s posterior coefficients with HPDI at 95%.

Figure 10.

Figure 10

Pairwise distribution plot for model 2′s TCC and TCC*Inter_Dom.

4.3. Model 3

The third model has a similar design as model 2, but the outcome variable InformalHelp was replaced by FormalHelp. The network in Figure 11 demonstrates the logical connection of the third model.

Figure 11.

Figure 11

Model 3′s logical network.

As all the Pareto k estimates are below 0.2 (see Figure 12), it is plausible to say Model 3 fits the data well. Other diagnostic graphs also show good statistical validity for the simulation (see Figure 13, Figure A5, Figure A6).

Figure 12.

Figure 12

Model 3′s PSIS diagnostic plot.

Figure 13.

Figure 13

Trace plots for Model 3′s posterior coefficients.

Interestingly, the level of sense of connectedness has a negative impact on the willingness to seek help from doctors and professionals. Moreover, when the factor of being an international student is considered, the sense of connectedness’s effect on formal help-seeking willingness is strengthened (see Table 4). Both effects are moderately reliable, as posterior distributions lie primarily on the negative side (see Figure 14).

Table 4.

Model 3′s simulated posteriors.

Parameters Mean SD n_eff Rhat
Constant 3.32 0.42 5707 1
TCC −0.06 0.09 5404 1
TCC*Inter_dom −0.06 0.05 7202 1

Figure 14.

Figure 14

Distributions of Model 3′s posterior coefficients. (A)—Interval plot; (B)—Density plot.

4.4. Model 4

The logical network of Model 4 is illustrated in Figure 15. Using this model, we examine the effect of willingness to seek help from informal and formal sources on suicidal ideation. The PSIS diagnostic plot suggests that the model fits the data well (see Figure 16).

Figure 15.

Figure 15

Model 4′s logical network.

Figure 16.

Figure 16

Model 4′s PSIS diagnostic plot.

As shown in Table 5, all the simulated posteriors’ effective sample size (n_eff) is larger than 1000, and the Rhat value equals 1. The presented statistics indicate good convergence of the Markov chains. The Markov chains’ good convergence is also confirmed visually by the trace plots, Gelman plots, and autocorrelation plots (see Figure 17, Figure A7, Figure A8).

Table 5.

Model 4′s simulated posteriors.

Parameters Mean SD n_eff Rhat
Constant 0.23 0.36 5916 1
FormalHelp 0.09 0.10 5809 1
InformalHelp −0.51 0.10 5470 1

Figure 17.

Figure 17

Trace plots for Model 4′s posterior coefficients.

Figure 18 shows the posterior distributions of FormalHelp and InformalHelp coefficients against the outcome Suicide. The distribution of InformalHelp lies entirely on the negative side, hinting at the robustly negative association of InformalHelp with Suicide (μInformalHelp_Suicide = −0.51 and σInformalHelp_Suicide = 0.10). In contrast to InformalHelp, the FormalHelp’s mean is positive (μFormalHelp_Suicide = 0.09 and σFormalHelp_Suicide = 0.10). Even though the standard deviation of FormalHelp is larger than the mean, the majority of simulated samples are located on the positive side, suggesting a moderate-confident positive association between FormalHelp and Suicide (see Figure 19).

Figure 18.

Figure 18

Distributions of Model 4′s posterior coefficients. (A)–Interval plot; (B)–Density plot.

Figure 19.

Figure 19

Distributions of Model 4′s posterior coefficients with HPDI at 95%.

5. Discussion

The current study is one of the first to demonstrate the suicidal ideation process of an individual using a dynamic and complex mechanism—the Mindsponge mechanism. We employed the Bayesian statistics with the Hamiltonian MCMC technique on a multinational dataset for justifying the underlying mechanism of suicidal ideation among students.

5.1. Sense of Connectedness: A Gatekeeper

Our results show that sense of connectedness is positively associated with the willingness to seek help from informal sources (parents and family members) and negatively associated with suicidal ideation. Moreover, the negative association between the willingness to seek informal help (parents and relatives) and suicidal ideation is also observed. Thus, it is plausible to say that a high degree of connectedness to other people helps lessen the probability of suicidal ideation by increasing the willingness to seek help from parents and family members. Parents and relatives are normally a good source of helpful and supportive information, especially against one’s death or suicidal thoughts. The results are consistent with past findings that suicidal thoughts and behaviors are negatively influenced by objective isolation, subjective loneliness, and thwarted belongingness among adolescents [20,21,22,43].

Given the fact that a student’s cost–benefit judgment of help- and suicide-related information is deemed uncertain at first and needs deeper evaluation to decide on acceptance or rejection, a high sense of connectedness provides a “priority-pass” (increased benefit perception) for information from an individual’s social network—in this case, parents and family members. In other words, a stronger sense of being connected to parents and family members improves the student’s trust in the information provided by them, including the help-related one. Subsequently, the availability of help-related information increases the cost of suicidal ideation and makes suicide-related information easier to be rejected from the mindset. Nevertheless, things are not always like what we expect. Sense of connectedness might be a good-information gatekeeper providing a “priority pass” to help-related information, but what if the help is not available or perceived to be inaccessible?

5.2. Perceived Information Inaccessibility: The Elusive Helping Hands

The positive impact of a sense of connectedness on suicidal ideation does not necessarily mean it is a sufficient factor for preventing suicidal ideation. Our findings support the assumption that a high sense of connectedness is a condition that needs to be satisfied for suicidal ideation prevention. We find that the sense of connectedness’s interaction with being an international student lessens the effect of sense of connectedness on both suicidal ideation and informal help-seeking willingness. In other words, even though international students acquire the merits of a high sense of connectedness level, the merits are seemingly lower than domestic students since the help from parents and relatives is perceived as more difficult to access or unavailable. Thus, the perceived accessibility of help-related information is also a condition that needs to be satisfied for negating suicidal ideation in a student’s mindset.

In detail, the informal help-related information available for an international student is much less effective than that for a domestic student because family members of international students are not physically available nearby. This factor can significantly increase the perceived help-seeking cost in the cost–benefit judgment when a student faces emotional difficulty. When the perceived value of the information decreases due to external barriers (e.g., geographical distance), the mind may hastily evaluate it as inaccessible and reject the information regardless of internal preferences and traits, such as a sense of connectedness. Furthermore, distance barriers limit the amount and intensity of help-related information coming to the mind, reducing its overall presence concerning suicide-related information.

These results suggest that the construct of connectedness is not a fundamental predictor of suicidal ideation but rather a psychological trait affecting the process of filtering suicide-related and informal help-related information. A willingness to connect to and feel belonged to the wrong social groups can lead to negative outcomes [44]. Students in distress who lack valuable sources of help-related information can be attracted to depressive peers or suicidal-oriented online media for temporary emotional sympathy or for whatever personal reasons. However, the harmful influence can be literally deadly, defined as suicide contagion [45,46]. In fact, group suicides are present among adolescents and performed in many different forms within Japanese society [47].

5.3. Collective Perception Issues: The Painted Garden

We also suggest another condition that may need to be satisfied for effectively preventing suicidal ideation besides the sense of connectedness and perceived help-related information accessibility. This third factor is the perceived cultural responses towards mental health problems. Our result shows a positive association between formal help-seeking willingness and suicidal ideation, which is likely the result of complex interactions rather than simple factors. We present our explanation below but also acknowledge the possibility of other fitting interpretations. This requires further examination in future studies.

Students with a higher likelihood of having suicidal ideation tend to have a higher willingness to seek doctors and professionals for help, which is quite plausible given the Japanese context and the sample’s student origins (mostly from countries in South-Eastern Asia and Eastern Asia). Professional mental healthcare is relatively less common in Asian countries than in the West because of myriad underlying reasons [48]. However, the most significant cause might be the high social stigma against mental health issues and lack of investment and legislative support for mental healthcare [49,50]. The stigmatization results in the social disapproval, discrimination, and devaluation of families with mentally ill people, causing the student’s hesitation to seek professional help when facing mental health issues. In other words, negative perceptions towards mental illness as a social norm considerably raise the students’ perceived cost of seeking help from doctors and professionals. This speculation is supported by one of our findings that students with a relatively higher level of connectedness may be less willing to seek help from doctors and professionals, although this interpretation requires further examination to be justified.

Suppose the hesitation to seek formal help persists. In that case, students’ mental problems (e.g., depressive disorder, anxiety, stress, etc.) might gradually accumulate and develop to a certain higher level. Hence, they start to perceive suicide as a “promising” option [51,52]. Concurrently, the cost of losing their own life also push students to recall more acceptable options, that is, to seek professional help.

The perceived cost of seeking professional healthcare is amplified for international students. We find that the sense of connectedness’s interaction with being international students lessens help-seeking level. This result again highlights the importance of help-related information accessibility and cultural perception of mental health issues. Specifically, international students have less access to formal help-related information than domestic students due to their low language proficiency and unfamiliarity with the new environment [53,54]. In addition, a local negative collective perception about mental health issues might also hinder international students’ access to formal help-related information due to the fear of social stigmatization, disapproval, and discrimination within the new community.

Based on the above findings, we advocate a more systematic and dynamic approach in studying mental health problems and psychiatric issues, like the information absorbing and ejecting process of the Mindsponge mechanism. Further, tackling the issue of suicidal ideation among students or even among other populations is not only the work of any single intervention but a set of systematically coordinated programs. These programs have to improve the individual’s sense of belongingness (e.g., through social and recreative activities, etc.), increase the accessibility of help-seeking sources (e.g., through mental healthcare services, etc.), and reduce improper perceived cultural responses (e.g., through shifting cultural perception, etc.).

5.4. Limitations and Research Agendas

The study is not without limitations [55]. First, the study employs cross-sectional data for justifying assumptions on a dynamic mechanism. Even though it is still plausible, longitudinal studies testing the reliability of these results and assumptions are necessary. Second, we acknowledge that the effect sizes are small. However, given the study is a preliminary attempt toward a new approach, we believe the consistency in all four models can justify the significance of interpretation or the direction for future endeavors. In addition, in psychological research, effect sizes need to be interpreted carefully to avoid mistakes [56]. Third, for the same reason (initial study), we used uninformative prior to the analysis. However, after testing with prior tweaking, we found the same results, which justified the robustness of the models. Fourth, we acknowledge the small size of the sample. However, regarding the properties of psychological research, we did try to optimize accuracy through our chosen methodology, Bayesian analysis [57].

Last but not least, the Mindsponge mechanism is a very dynamic and complex model; its utility has not been fully employed in the current study. Thus, some multifaceted aspects and problems could not be addressed. Such aspects and problems might be categorized into three groups:

  • The mindset’s values: socio-cultural values, political viewpoints, traits, experience, etc.

  • The filter: the sense of belongingness, habits, inductive attitude, etc.

  • Information accessibility: school environment, healthcare service availability, interpersonal network, etc.

Considering all the aforementioned limitations, the current paper is intentionally presented in the greatest detail and backed up with open resources (data and code) for improving scientific transparency [55,58]. During the current reproducibility crisis, such transparency can help smoothen and lessen the cost of future replications of the study’s results and ways of conducting psychological research [59,60,61,62].

6. Conclusions

In this study, we use the Mindsponge mechanism—a mechanism of absorbing, analyzing, updating, and ejecting information as the theoretical basis to present that suicidal ideation is a process of receiving, evaluating, and integrating suicide-related information—which is driven by the individual’s inductive cost–benefit judgments. Within this process, the individual’s sense of connectedness is necessary for seeking help that negates suicide-related information. However, connectedness alone is not sufficient, but information accessibility and the perceptions about the help-related information are also crucial.

Alice in Suicideland

Alice followed a white rabbit into a strange world. There were many guests coming to visit the rabbit in his house. While the Shadows sent by the Queen of Abyss persuaded the rabbit into surrender, other animals tried to offer him help to fight back. A friendly Gryphon was standing at the house’s gate, welcoming nice guests while blocking the vile Shadows. Alice stood and observed all kinds of interesting characters and events in the noisy house. The rabbit kept trying to call his parents at home for supply, but every time he reminded himself that they were staying in the Farland and decided to hang up before even saying a word. There was a wise caterpillar wearing a doctor outfit trying to come in, but his coat was painted with exotic patterns that scared the rabbit. There was a mysterious cat with angelic fur and an evil grin lying on the balcony, with only his shiny fur visible when nice guests are in the house and only his dark teeth visible when the Shadows are inside. There was also a friendly turtle that looked so sad that he made the rabbit cry as well. However, as more and more merry animals got inside the house, the once confused rabbit became determined to reject all coming Shadows. Everyone held a grand tea party and invited Alice, but just then, she woke up. What a weird yet somehow useful dream!

--------Characters borrowed from Alice in Wonderland--------

Acknowledgments

We would like to thank Ritsumeikan Asia Pacific University for supporting this research during the data collection.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph18073681/s1. All the resources for replicating this study are deposited in the following repository: https://osf.io/nmjas/ (accessed on 24 March 2021).

Appendix A

Figure A1.

Figure A1

Gelman plots for Model 1′s posterior coefficients.

Figure A2.

Figure A2

Autocorrelation plots for Model 1′s posterior coefficients.

Figure A3.

Figure A3

Gelman plots for Model 2′s posterior coefficients.

Figure A4.

Figure A4

Autocorrelation plots for Model 2′s posterior coefficients.

Figure A5.

Figure A5

Gelman plots for Model 3′s posterior coefficients.

Figure A6.

Figure A6

Autocorrelation plots for Model 3′s posterior coefficients.

Figure A7.

Figure A7

Gelman plots for Model 4′s posterior coefficients.

Figure A8.

Figure A8

Autocorrelation plots for Model 4′s posterior coefficients.

Author Contributions

Conceptualization: M.-H.N., T.-T.L. and Q.-H.V.; Methodology: M.-H.N.; Formal analysis and investigation: T.-T.L.; Writing—original draft preparation: M.-H.N., T.-T.L. and H.-K.T.N.; Writing—review and editing: M.-H.N., M.-T.H., H.T.T.N. and Q.-H.V.; Validation: Q.-H.V., T.-T.L., M.-H.N., H.T.T.N., H.-K.T.N. and M.-T.H.; Resources: M.-H.N. and T.-T.L.; Supervision: Q.-H.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethical Committee Board of Ritsumeikan Asia Pacific University.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that supports the findings of this study is available at https://www.mdpi.com/2306-5729/4/3/124/s1 (accessed on 1 January 2021).

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Carroll L. Alice’s Adventures in Wonderland. Macmillan; London, UK: 1865. [Google Scholar]
  • 2.WHO Suicide data. [(accessed on 24 January 2021)]; Available online: https://www.who.int/teams/mental-health-and-substance-use/suicide-data.
  • 3.WHO Depression and Other Common Mental Disorders. [(accessed on 15 January 2021)]; Available online: https://www.who.int/mental_health/management/depression/prevalence_global_health_estimates/en/
  • 4.Wang S., Wright R., Wakatsuki Y. In Japan, more people died from suicide last month than from Covid in all of 2020. [(accessed on 15 January 2021)]; Available online: https://edition.cnn.com/2020/11/28/asia/japan-suicide-women-covid-dst-intl-hnk/index.html.
  • 5.Wright R. Japan’s worst day for teen suicides. [(accessed on 15 January 2021)]; Available online: https://edition.cnn.com/2015/09/01/asia/japan-teen-suicides/index.html.
  • 6.Beautrais A.L. Risk Factors for Suicide and Attempted Suicide among Young People. Aust. N. Z. J. Psychiatry. 2000;34:420–436. doi: 10.1080/j.1440-1614.2000.00691.x. [DOI] [PubMed] [Google Scholar]
  • 7.Eskanadrieh S., Liu Y., Yamashina H., Kono K., Arai A., Lee R.B., Tamashiro H. Depressive symptoms among international university students in northern Japan: Prevalence and associated factors. Kokusai Hoken Iryo. 2012;27:165–170. [Google Scholar]
  • 8.Nguyen M.H., Le T.T., Meirmanov S. Depression, Acculturative Stress, and Social Connectedness among International University Students in Japan: A Statistical Investigation. Sustainability. 2019;11:878. doi: 10.3390/su11030878. [DOI] [Google Scholar]
  • 9.Humphrey N. The lure of death: Suicide and human evolution. Philos. Trans. R. Soc. B Biol. Sci. 2018;373:20170269. doi: 10.1098/rstb.2017.0269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Cholbi M. Stanford Encyclopedia of Philosophy Archive. Stanford Encyclopedia of Philosophy; Stanford, CA, USA: 2017. [(accessed on 15 January 2021)]. Suicide. Available online: https://plato.stanford.edu/entries/suicide/ [Google Scholar]
  • 11.Narveson J. Moral Philosophy and Suicide. Can. J. Psychiatry. 1986;31:104–107. doi: 10.1177/070674378603100205. [DOI] [PubMed] [Google Scholar]
  • 12.Lo P.-C., Ethics S.O.C. Confucian Ethic of Death with Dignity and Its Contemporary Relevance. Annu. Soc. Christ. Ethic- 1999;19:313–333. doi: 10.5840/asce19991916. [DOI] [PubMed] [Google Scholar]
  • 13.Promta S., Thomyangkoon P. A Buddhist perspective on suicide. In: Wasserman D., editor. Oxford Textbook of Suicidology and Suicide Prevention. Oxford University Press; Oxford, UK: 2009. p. 31. [Google Scholar]
  • 14.De Beurs D., Fried E., Wetherall K., Cleare S., Connor D.O., Ferguson E., O’Carroll R., Connor R.O. Exploring the psychology of suicidal ideation: A theory driven network analysis. Behav. Res. Ther. 2019;120:103419. doi: 10.1016/j.brat.2019.103419. [DOI] [PubMed] [Google Scholar]
  • 15.Joiner T. Why People Die by Suicide. Harvard University Press; Cambridge, MA, USA: 2007. [Google Scholar]
  • 16.Joiner T.E., Jr., Van Orden K.A., Witte T.K., Selby E.A., Ribeiro J.D., Lewis R., Rudd M.D. Main predictions of the interpersonal–psychological theory of suicidal behavior: Empirical tests in two samples of young adults. J. Abnorm. Psychol. 2009;118:634. doi: 10.1037/a0016500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.O’Connor R.C., Kirtley O.J. The integrated motivational–volitional model of suicidal behaviour. Philos. Trans. R. Soc. B: Biol. Sci. 2018;373:20170268. doi: 10.1098/rstb.2017.0268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Van Orden K.A., Witte T.K., Gordon K.H., Bender T.W., Joiner Jr T.E. Suicidal desire and the capability for suicide: Tests of the interpersonal-psychological theory of suicidal behavior among adults. J. Consult. Clin. Psychol. 2008;76:72. doi: 10.1037/0022-006X.76.1.72. [DOI] [PubMed] [Google Scholar]
  • 19.Van Orden K.A., Witte T.K., Cukrowicz K.C., Braithwaite S.R., Selby E.A., Joiner T.E., Jr. The interpersonal theory of suicide. Psychol. Rev. 2010;117:575. doi: 10.1037/a0018697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Van Orden K.A., Cukrowicz K.C., Witte T.K., Joiner Jr T.E. Thwarted belongingness and perceived burdensomeness: Construct validity and psychometric properties of the Interpersonal Needs Questionnaire. Psychol. Assess. 2012;24:197. doi: 10.1037/a0025358. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Gunn J.F., Goldstein S.E., Gager C.T. A longitudinal examination of social connectedness and suicidal thoughts and behaviors among adolescents. Child Adolesc. Ment. Health. 2018;23:341–350. doi: 10.1111/camh.12281. [DOI] [PubMed] [Google Scholar]
  • 22.You S., Van Orden K.A., Conner K.R. Social connections and suicidal thoughts and behavior. Psychol. Addict. Behav. 2011;25:180–184. doi: 10.1037/a0020936. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Vuong Q.H., Napier N.K. Acculturation and global mindsponge: An emerging market perspective. Int. J. Intercult. Relat. 2015;49:354–367. doi: 10.1016/j.ijintrel.2015.06.003. [DOI] [Google Scholar]
  • 24.Vuong Q.H. Global mindset as the integration of emerging socio-cultural values through mindsponge processes: A transition economy perspective. In: Kuada J., editor. Global Mindsets. Routledge; Oxford, UK: 2016. pp. 123–140. [Google Scholar]
  • 25.Nguyen M.H., Ho M.-T., Nguyen Q.-Y.T., Vuong Q.-H. A Dataset of Students’ Mental Health and Help-Seeking Behaviors in a Multicultural Environment. Data. 2019;4:124. doi: 10.3390/data4030124. [DOI] [Google Scholar]
  • 26.Nguyen M.-H., Serik M., Vuong T.-T., Ho M.-T. Internationalization and Its Discontents: Help-Seeking Behaviors of Students in a Multicultural Environment Regarding Acculturative Stress and Depression. Sustainability. 2019;11:1865. doi: 10.3390/su11071865. [DOI] [Google Scholar]
  • 27.Kroenke K., Spitzer R.L. The PHQ-9: A New Depression Diagnostic and Severity Measure. Psychiatr. Ann. 2002;32:509–515. doi: 10.3928/0048-5713-20020901-06. [DOI] [Google Scholar]
  • 28.Kroenke K., Spitzer R.L., Williams J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Int. Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Lee R.M., Robbins S.B. Measuring belongingness: The social connectedness and the social assurance scales. J. Couns. Psychol. 1995;42:232. doi: 10.1037/0022-0167.42.2.232. [DOI] [Google Scholar]
  • 30.Rossom R.C., Coleman K.J., Ahmedani B.K., Beck A., Johnson E., Oliver M., Simon G.E. Suicidal ideation reported on the PHQ9 and risk of suicidal behavior across age groups. J. Affect. Disord. 2017;215:77–84. doi: 10.1016/j.jad.2017.03.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.McElreath R. Statistical Rethinking: A Bayesian Course with Examples in R and Stan. CRC Press; Boca Raton, FL, USA: 2020. [Google Scholar]
  • 32.Wagenmakers E.-J., Marsman M., Jamil T., Ly A., Verhagen J., Love J., Selker R., Gronau Q.F., Šmíra M., Epskamp S., et al. Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications. Psychon. Bull. Rev. 2018;25:35–57. doi: 10.3758/s13423-017-1343-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Dunson D.B. Commentary: Practical Advantages of Bayesian Analysis of Epidemiologic Data. Am. J. Epidemiol. 2001;153:1222–1226. doi: 10.1093/aje/153.12.1222. [DOI] [PubMed] [Google Scholar]
  • 34.Uusitalo L. Advantages and challenges of Bayesian networks in environmental modelling. Ecol. Model. 2007;203:312–318. doi: 10.1016/j.ecolmodel.2006.11.033. [DOI] [Google Scholar]
  • 35.La V.-P., Vuong Q.-H. The Comprehensive R Archive Network (CRAN) SSRN; Rochester, NY, USA: 2019. [(accessed on 15 January 2021)]. Bayesvl: Visually learning the graphical structure of Bayesian networks and performing MCMC with ‘Stan’. Available online: https://cran.r-project.org/web/packages/bayesvl/index.html. [Google Scholar]
  • 36.Vuong Q.-H., La V.-P., Nguyen M.-H., Ho M.-T., Tran T. Bayesian analysis for social data: A step-by-step protocol and interpretation. MethodsX. 2020;7:100924. doi: 10.1016/j.mex.2020.100924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Vuong Q.-H., La V.-P., Nguyen M.-H., Ho M.-T., Mantello P. Improving Bayesian statistics understanding in the age of Big Data with the bayesvl R package. Softw. Impacts. 2020;4:100016. doi: 10.1016/j.simpa.2020.100016. [DOI] [Google Scholar]
  • 38.Ho M.-T., La V.-P., Nguyen M.-H., Pham T.-H., Vuong T.-T., Vuong H.-M., Pham H.-H., Hoang A.-D., Vuong Q.-H. An analytical view on STEM education and outcomes: Examples of the social gap and gender disparity in Vietnam. Child. Youth Serv. Rev. 2020;119:105650. doi: 10.1016/j.childyouth.2020.105650. [DOI] [Google Scholar]
  • 39.Vuong Q.-H., Ho M.-T., Nguyen H.-K.T., Vuong T.-T., Tran T., Hoang K.-L., Vu T.-H., Hoang P.-H., Nguyen M.-H., La V.-P. On how religions could accidentally incite lies and violence: Folktales as a cultural transmitter. Palgrave Commun. 2020;6:1–13. doi: 10.1057/s41599-020-0442-3. [DOI] [Google Scholar]
  • 40.Vuong T.-T., Ho M.-T., Nguyen M.-H., Nguyen T.-H.T., Nguyen T.-L., Luong A.-P., Vuong Q.-H. Adopting open access in the social sciences and humanities: Evidence from a developing nation. Heliyon. 2020;6:e04522. doi: 10.1016/j.heliyon.2020.e04522. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Vuong Q.-H., Bui A.-T., La V.-P., Nguyen M.-H., Pham H.-H., Pham T.-H., Vu T.-H., Vuong T.-T., Ho M.-T. Mirror, mirror on the wall: Is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam. Res. Evaluation. 2021:rvaa036. doi: 10.1093/reseval/rvaa036. [DOI] [Google Scholar]
  • 42.Vehtari A., Gelman A., Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat. Comput. 2017;27:1413–1432. doi: 10.1007/s11222-016-9696-4. [DOI] [Google Scholar]
  • 43.Calati R., Ferrari C., Brittner M., Oasi O., Olié E., Carvalho A.F., Courtet P. Suicidal thoughts and behaviors and social isolation: A narrative review of the literature. J. Affect. Disord. 2019;245:653–667. doi: 10.1016/j.jad.2018.11.022. [DOI] [PubMed] [Google Scholar]
  • 44.Centers for Disease Control and Prevention . Promoting Individual, Family, and Community Connectedness to Prevent Suicidal Behavior Atlanta. Centers for Disease Control and Prevention; Atlanta, GA, USA: 2007. [Google Scholar]
  • 45.Yıldız M., Orak U., Walker M.H., Solakoglu O. Suicide contagion, gender, and suicide attempts among adolescents. Death Stud. 2019;43:365–371. doi: 10.1080/07481187.2018.1478914. [DOI] [PubMed] [Google Scholar]
  • 46.Cheng Q., Li H., Silenzio V., Caine E.D. Suicide Contagion: A Systematic Review of Definitions and Research Utility. PLoS ONE. 2014;9:e108724. doi: 10.1371/journal.pone.0108724. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Katsuragawa S. Family and group suicide in Japan: Cultural analysis. World Cult. Psychiatry Res. Rev. 2009;4:28–32. [Google Scholar]
  • 48.Meshvara D. Mental health and mental health care in Asia. World Psychiatry. 2002;1:118–120. [PMC free article] [PubMed] [Google Scholar]
  • 49.Ito H., Setoya Y., Suzuki Y. Lessons learned in developing community mental health care in East and South East Asia. World Psychiatry. 2012;11:186–190. doi: 10.1002/j.2051-5545.2012.tb00129.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Lauber C., Rössler W. Stigma towards people with mental illness in developing countries in Asia. Int. Rev. Psychiatry. 2007;19:157–178. doi: 10.1080/09540260701278903. [DOI] [PubMed] [Google Scholar]
  • 51.Ibrahim N., Amit N., Suen M.W.Y. Psychological Factors as Predictors of Suicidal Ideation among Adolescents in Malaysia. PLoS ONE. 2014;9:e110670. doi: 10.1371/journal.pone.0110670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Kirkcaldy B.D., Eysenck M.W., Siefen G.R. Psychological and Social Predictors of Suicidal Ideation among Young Adolescents. Sch. Psychol. Int. 2004;25:301–316. doi: 10.1177/0143034304046903. [DOI] [Google Scholar]
  • 53.Poyrazli S., Kavanaugh P.R., Baker A., Al-Timimi N. Social Support and Demographic Correlates of Acculturative Stress in International Students. J. Coll. Couns. 2004;7:73–82. doi: 10.1002/j.2161-1882.2004.tb00261.x. [DOI] [Google Scholar]
  • 54.Sandhu D.S., Asrabadi B.R. Development of an Acculturative Stress Scale for International Students: Preliminary Findings. Psychol. Rep. 1994;75:435–448. doi: 10.2466/pr0.1994.75.1.435. [DOI] [PubMed] [Google Scholar]
  • 55.Vuong Q.-H. Reform retractions to make them more transparent. Nat. Cell Biol. 2020;582:149. doi: 10.1038/d41586-020-01694-x. [DOI] [Google Scholar]
  • 56.Funder D.C., Ozer D.J. Evaluating Effect Size in Psychological Research: Sense and Nonsense. Adv. Methods Pr. Psychol. Sci. 2019;2:156–168. doi: 10.1177/2515245919847202. [DOI] [Google Scholar]
  • 57.Etz A., Vandekerckhove J. A Bayesian Perspective on the Reproducibility Project: Psychology. PLoS ONE. 2016;11:e0149794. doi: 10.1371/journal.pone.0149794. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Vuong Q.-H. Scientific Data Updates. Vol. 2020. ResearchGate; Berlin, Germany: 2017. [(accessed on 15 January 2021)]. Open data, open review and open dialogue in making social sciences plausible. Available online: http://blogs.nature.com/scientificdata/2017/12/12/authors-corner-open-data-open-review-and-open-dialogue-in-making-social-sciences-plausible/ [Google Scholar]
  • 59.Vuong Q.-H. The (ir)rational consideration of the cost of science in transition economies. Nat. Hum. Behav. 2018;2:5. doi: 10.1038/s41562-017-0281-4. [DOI] [PubMed] [Google Scholar]
  • 60.Munafò M.R., Nosek B.A., Bishop D.V.M., Button K.S., Chambers C.D., Du Sert N.P., Simonsohn U., Wagenmakers E.-J., Ware J.J., Ioannidis J.P.A. A manifesto for reproducible science. Nat. Hum. Behav. 2017;1:0021. doi: 10.1038/s41562-016-0021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Collaboration O.S. Estimating the reproducibility of psychological science. Science. 2015;349:6251. doi: 10.1126/science.aac4716. [DOI] [PubMed] [Google Scholar]
  • 62.Baker M. 1500 scientists lift the lid on reproducibility. Nat. Cell Biol. 2016;533:452–454. doi: 10.1038/533452a. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The data that supports the findings of this study is available at https://www.mdpi.com/2306-5729/4/3/124/s1 (accessed on 1 January 2021).


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES