Abstract
Objectives
This is the first validation study to evaluate the measurement properties (i.e., construct, concurrent, incremental, and relative validity) and determine the clinical utility of the Chinese version of the 12-item subjective incompetence scale (SIS-12) based on the science of clinimetrics.
Methods
Consecutive general hospital inpatients (n= 232) in the Departments of Neurology and Obstetrics & Gynecology were assessed for SIS-12, along with measures of anxiety, depression, stress levels, and demographic information. Mokken analysis was employed to evaluate construct validity, while relative validity was assessed through relative weight analysis.
Results
Mokken analysis indicated inadequate construct validity for items 1, 4, 8, and 10, leading to the development of an 8-item version of the scale (SIS-8), which was found to have optimal scalability. The SIS-8 also entailed the clinimetric properties of concurrent validity, incremental validity, and relative validity.
Conclusion
The findings of the present clinimetric validation indicate that the SIS-8 can potentially be used both as a screening measure for the early detection of individuals at increased risk for demoralization and as a dimensional measure to assess the severity of feelings of subjective incompetence. This dual utility suggests its relevance in both clinical research and practice, particularly in managing inpatients suffering from psychological distress.
Keywords: clinimetrics, demoralization, psychological distress, relative validity, subjective incompetence
Background
Sense of competence/efficacy has gained considerable recognition as a critical factor in healthcare practice, given its well-documented contribution to multiple health behaviors and outcomes across diverse cultures (1, 2). Evidence from different patient populations-spanning both outpatient and inpatient settings- consistently suggests that a stronger sense of competence/efficacy correlates with improved treatment adherence, encompassing not only medication compliance (3, 4) but also beneficial changes in lifestyle, such as increased exercise (5), better dietary habits (6), and decreased smoking and drinking (7). Moreover, a heightened sense of competence/efficacy is predictive of a range of positive physical health outcomes, such as enhanced glycemic control in patients with diabetes (3, 8), and reduced serum phosphorus levels in patients undergoing chronic hemodialysis (9), as well as improvements in mental health conditions, including decreased depressive symptoms (10), elevated quality of life (11, 12), and greater confidence in healthcare providers and social support (13, 14; 16).
Recently, Ponton (15) argued that a weak sense of efficacy should not be equated with a strong sense of inefficacy, as the former is rooted in insufficient efficacy-enhancing information, while the latter arises from an abundance of efficacy-diminishing information. Similarly, an empirical investigation on burnout among university students underscored the distinction between low efficacy and inefficacy (17). However, the current clinical assessment methods overlook this distinction, often employing a reversed competence/efficacy scale to measure the sense of incompetence or inefficacy (17, 18), highlighting the need to develop valid instruments for accurately assessing incompetence and inefficacy.
The concept of subjective incompetence (SI) has been defined for the first time by de Figueiredo and Frank (19) as a state experienced by individuals who perceive themselves as unable to perform the tasks and express the feelings they consider appropriate in a stressful situation. In clinical psychosomatics, SI has been recognized as the clinical hallmark of demoralization, a prolonged psychological state marked by distressing feelings often expressed in terms such as “it is too much for me”, “I cannot take it anymore”, ascribed by the individual to failures or deficiencies in one’s environment (helplessness) and/or to one’s own personal inadequacies for which nothing can be done (hopelessness) (20, 21). SI represents the initial stage of the demoralization cascade, which may progress to evoke feelings of helplessness and hopelessness successively, potentially culminating in suicidality (de 22, 23). In contrast to the constructs of perceived competence and self-efficacy, SI does not sharply distinguish between individuals and their behaviors (i.e., it is not conceptualized as a proximate cognition to a target behavior) (24), thereby not being confined to specific behaviors or domains (e.g., diabetes self-management, dieting, exercise, and etc.) (19).
Cockram et al. (25, 26 developed a 12-item self-assessment scale for subjective incompetence (SIS-12) and evaluated its psychometric properties among cancer patients in the United States. The scale demonstrated good internal consistency and a strong association between SI and maladaptive coping strategies, including self-blame and behavioral disengagement. Subsequent research using the SIS-12 indicated that it can significantly predict treatment outcomes in individuals with eating disorders in Italy (27). Moreover, among U.S. patients with Parkinson disease, SI was found to be a crucial factor contributing to demoralization, independent of depression and anxiety (23). Although SI is generally considered a unidimensional construct, the factorial structure of the SIS-12 was not explicitly examined in these studies. However, a recent study by Murri et al. (28) in the Italian general population supported a three-factor structure for the SIS-12 based on exploratory factor analysis: subjective incompetence, inability to plan, and inability to deal. Despite these findings and promising clinical implications, there remains a lack of validated Chinese tools for assessing SI.
The term “clinimetrics”, which results from the combination of the words “clini” (that stands for clinical) and “metrics” (that refers to a measurement process based on specific criteria), was originally coined by Alvan R. Feinstein (29, 30) to introduce the science of clinical measurements (31, 32). This innovative clinically-based approach emphasizes the clinical utility of indices and rating scales, particularly when used to evaluate a wide range of clinical issues, for example, symptom severity, sensitivity to changes in clinical (i.e., psychotherapy or drug) trials, differentiation between active therapy and placebo, as well as distinction between different patient groups, detecting clinically relevant changes in drug or psychotherapy trials, and many other clinical factors that demarcate major prognostic and therapeutic differences (31, 33, 34). Recently, a panel of international experts has proposed a set of clinimetric criteria that apply to the development of new and to the validation of existing patient-reported outcome measures (34). In particular, the authors of this consensus paper placed scalability at the core of construct validity, defining it as the evidence that each item included a clinimetric index or rating scale provides distinctive or unique clinical information and belongs to the same underlying clinical dimension (34). In the same vein, internal consistency, which measures the degree to which items in a rating scale are correlated, is not necessarily required within the clinimetric criteria (34). Scalability is conventionally tested using Mokken analysis to determine whether individual items and the total score of the assessment instrument provide a statistically sufficient and clinically valid measure of the severity of the latent clinical dimension under examination (34, 35).
Following this clinimetric principle, we intend to extend the current clinimetric criteria for validity by introducing “relative validity”. The term is defined as the ability of a particular instrument to hold importance for clinical decisions (i.e. the extent to which the measure contributes to the variables of interest) when taking the other relevant measures into consideration. Relative validity can be seen as an extension of incremental validity, as the latter establishes if a measure adds unique information, whereas the former determines how clinically important the information is, in relation to other existing assessments. Relative validity may have a significant bearing on clinical practice. In busy clinical settings and the upcoming era of process-based psychotherapy (36), relative validity may enable us to carefully select the most impactful measures while keeping them to a minimum. Relative validity can be quantified by relative importance statistics in multiple regression analyses, such as Johnson’s relative weights (37) and dominance analysis (38). Moreover, the magnitude of relative validity can be qualitatively determined by applying Cohen’s criteria for effect size (39).
Based on this conceptual framework, the present study endeavors to validate the Chinese version of SIS-12 through the utilization of an extended clinimetric paradigm among general hospital inpatients in Beijing, China. To this end, the current version of the SIS-12 was assessed for a set of clinimetric properties including construct, concurrent, incremental, and relative validity, among inpatients from Neurology and Obstetrics & Gynecology departments of a general hospital in China. These departments were specifically selected based on previous research indicating a high prevalence of demoralization in those patient populations within the Chinese healthcare context (40, 41). This approach allows for a comprehensive and rigorous assessment of the scale’s applicability not only in the Chinese clinical context but also in all those studies and clinical settings where the improved detection of subjective incompetence may determine major prognostic and therapeutic outcomes.
Methods
Study design and sample size determination
This is a cross-sectional study conducted from July 2022 to February 2023. Sample size was estimated based on methodological recommendations (42) for sample size determination in validation studies of patient-reported outcome measures, which suggested a sample size of at least 100 subjects.
Participants
Participants were consecutive inpatients recruited at the Neurology and Obstetrics & Gynecology Departments of a general hospital in Beijing, China. Inclusion criteria were a) patients admitted to the Neurology and Obstetrics & Gynecology Departments of the hospital during the study period, b) aged 14 or over, and c) willing to participate. Exclusion criteria include a) patients with a hospital stay of fewer than 24 hours, and b) patients who were unable to complete the relevant assessments due to language, writing, or reading barriers. All participants provided written informed consent, ensuring their full understanding of the study’s purpose and potential risks. No incentives were offered for participation in the study. The study was conducted according to the World Medical Association Declaration of Helsinki and approved by the Ethical Committee of the participating hospital.
Data sources and assessments
Trained research assistants administered the questionnaires electronically via smartphone immediately following clinic appointments. The program required responses to each question before allowing participants to proceed. Participants provided information on their age, sex, race/ethnicity, marital status, education level, cigarette smoking habits, and alcohol consumption patterns.
SIS-12 is a 12-item self-assessment tool designed to evaluate feelings of SI (25). For each item, the response is provided on a 4-point Likert scale ranging from 0 (none of the time) to 3 (most or all of the time), reflecting the frequency of the corresponding experience (e.g. “puzzled, indecisive, and uncertain as to what actions to take”). The sum score of the 12 items (with items 1, 4, and 10 being reverse-scored) is calculated, yielding a range from 0 to 36, with higher scores indicating greater levels of SI (25). For this study, a proficient bilingual native Chinese speaker undertook the translation of the original English version into Chinese. Subsequently, two senior psychiatrists scrutinized and revised the translation to guarantee the naturalness and cultural appropriateness of each item in the Chinese context. Following this, two bilinguals, unaware of the original English version, performed a back-translation from Chinese to English. Then, the senior author of the original version of the SIS-12 meticulously reviewed and provided feedback on the back-translation, ensuring that the meaning of each item aligns with that of the original scale.
The Patient Health Questionnaire-9 (PHQ-9) (43, 44), a widely employed self-report scale comprising 9 items, was used to assess depression, on a scale ranging from 0 (not at all) to 3 (nearly every day). The total score, calculated by summing all item scores, reflects depression severity (higher scores indicate greater severity).
Anxiety was evaluated using the subscale from the Union Physio-Psycho-Social Assessment Questionnaire (UPPSAQ70) (45; Wang et al., 2024). This self-report questionnaire was specifically designed to measure overall health in the psychological, physical, and social domain. It has undergone validation within the general hospital context of China (45; 46). The subscale comprises eight items aimed at quantifying the severity of anxiety (e.g., “I feel jittery, worried, or frightened”). Each item is evaluated on a 4-point Likert scale from 0 (not at all) to 3 (most or all of the time), resulting in a total score ranging from 0 to 24. A higher score indicates a greater severity of anxiety.
Stress levels were measured using the Life Events Scale (LES) (47), a 48-item self-assessment scale designed to gauge the cumulative impact of life events across three domains (i.e., family life, work/study, and social/other). For each event, stress scores were computed by multiplying three factors: (1) impact severity, (2) duration of impact, and (3) frequency of occurrence. The total stress score was derived by summing all item scores, with higher scores reflecting greater stress levels.
Suicidal ideation was assessed using item 9 of the PHQ-9 (43, 44), employing a 4-point response scale ranging from 0 (not at all) to 3 (nearly every day).
Statistical analyses
Descriptive statistics (mean, median, and frequency) were used to describe the sample characteristics, as appropriate. We used the Shapiro-Wilk test to check for normal distribution of the continuous variables. Clinimetric properties of the SIS-12 were assessed using the following statistical analyses:
Construct validity
Mokken analysis was employed to assess the construct validity of the SIS based on the double monotonicity model (DMM) (48). This involved a comprehensive examination of scalability coefficients, as well as local independence, monotonicity, and Invariant Item Ordering (IIO) assumptions. The analytical process consisted of the following steps: 1) Scalability coefficients were evaluated at both the item (Hj) and scale levels (H) using a predetermined cutoff of 0.30. As suggested by Mokken (49), an item or a scale is deemed unscalable if either the scalability coefficient at the item level (Hj) or the scale level (H) is less than 0.3. If the overall scalability of the scale fell below 0.3, the automated item selection procedure (AISP) method was utilized to generate a refined scale, with MINVI sizes (i.e., lower bound of scalability coefficient) of 0.3, 0.4, and 0.5; 2) Monotonicity and IIO assumptions were examined using statistical significance and the crit index for each item. A significant violation was defined as having either the number of statistically significant violations (#zsig or #tsig) ≥1 or the crit value ≥ 40, as proposed by Stochl et al. (50). Items that violated the monotonicity and IIO assumptions were removed from the scale one at a time, starting with the item having the highest crit value and continuing until no further violations were found; 3) local independence was tested through conditional association procedure with W1, W2, and W3 statistics. Pairs of items with local correlation were marked by the procedure and subsequently eliminated one by one until no violating pairs were detected; 4) the scalability coefficient for the final version of the scale was computed, when applicable. In addition, we conducted a confirmatory factor analysis (CFA) on the final version of the scale to determine whether the results aligned with those from the Mokken analysis. CFA applied MLM estimation with scaled fit indices to account for non-normality (Shapiro-Wilk p < 0.05).
Concurrent validity
Spearman correlation coefficients were employed to evaluate the relationship between the SIS-12 and measures of depression, anxiety, suicidal ideation, and stress. Moderate correlations (r= 0.4-0.6) were anticipated for the association of SI with depression and anxiety, while small to moderate correlations (r= 0.2-0.4) were expected for its relationship with suicidal ideation and stress (23).
Incremental validity
Hierarchical regression analysis assessed whether subjective incompetence contributed to depression and anxiety, above the variance explained by LES. Incremental validity was estimated by the increase of R2 (ΔR2) following the inclusion of SI to LES.
Relative validity
A method originated from Johnson’s relative weights (37) was used to assess the relative importance of SIS, together with stress, on depression and anxiety. The magnitude of the validity was determined in accordance with Cohen’s criteria (i.e. R2<0.02, very weak; 0.02≤R2<0.13, weak; 0.13≤R2<0.26, moderate; R2≥0.26, large) (39).
Mokken analysis, relative weight analysis, and CFA were conducted using the “mokken” (51), “rwa” (52), and “lavaan” (53) packages in R Studio, respectively; other statistical analyses were performed using SPSS version 23. The statistical significance level was set at p ≤ 0.05, and all statistical tests were two-tailed.
Results
Sample characteristics
The final sample consisted of a total of 232 participants (response rate = 96.7%) with no missing data. The majority were female (74.6%), hospitalized in the neurology ward (50.0%), married (79.7%), and with a high school degree or higher (78.9%). The age range of the sample was 14–82 years (mean=42.09 years, SD = 13.77 years). Only 11 subjects (4.7%) were cigarette smokers; 94 (40.5%) reported drinking alcoholic beverages; and 67 (28.9%) received psychological medication or psychotherapy within the last 6 months. The Shapiro-Wilk test indicated non-normal distributions for LES, SIS-12, PHQ-9, and UPPSAQ-70 anxiety scores (p< 0.05). The median SIS-12 score was 12 (IQR = 9–15; see Table 1).
Table 1.
Sample characteristics.
| N=232 | ||
|---|---|---|
| Categorical variables | ||
| N | % | |
| Gender (Male) | 59 | 25.4 |
| Department (neurology) | 116 | 50.0 |
| Health insurance (yes) | 218 | 94.0 |
| Marital state (married) | 185 | 79.7 |
| Education level (High school or higher) | 183 | 78.9 |
| Family income | ||
| <4000 yuan | 22 | 9.5 |
| 4000–8000 yuan | 74 | 31.9 |
| >8000 yuan | 136 | 58.6 |
| Currently employed | 125 | 53.9 |
| Living alone | 23 | 9.9 |
| Current cigarette smoking | 11 | 4.7 |
| Current alcohol drinking | 94 | 40.5 |
| PMP administration within the last 6 months | 67 | 28.9 |
| Suicidal ideation | ||
| Not at all | 178 | 76.7 |
| Several days | 51 | 22.0 |
| More than half the days | 3 | 1.3 |
| Nearly every day | 0 | 0 |
| Continuous Variables | ||
| MEAN | SD | |
| Age | 42.09 | 13.77 |
| MEDIAN | IQR | |
| LES | 13 | 0-48 |
| UPPSAQ-70 anxiety | 5 | 3-8 |
| PHQ-9 | 5 | 2-7 |
| SIS-12 | 12.00 | 9-15 |
PMP, Psychotropic medication and psychotherapy; LES, Life Events Scale; UPPSAQ-70, Union Physio-Psycho-Social Assessment Questionnaire-70; PHQ-9, Patient Health Questionnaire-9; SIS-12, Subjective Incompetence Scale-12.
Construct validity
Table 2 shows the scalability coefficients of the SIS-12. The overall scale coefficient indicates a poor level of scalability for the 12-item scale (H = 0.26). Individual item scalability (Hi) for items 1, 2, 4, 7, and 10, were below the cut-off of 0.30, indicating they were unscalable with the other items. Further automatic item selection procedures with different MINVI sizes (0.3-0.5) consistently yielded a 9-item scale, where items 1, 4, and 10 were omitted because of weak scalability with the other items. No significant violations of monotonicity and IIO were detected (see Table 3) for the 9-item scale, with a crit value of zero and no statistically significant violations for each item. Conditional association procedure marked significant local dependence between item pairs 2 and 8, 5 and 7, as well as between items 5 and 8 according to W3 statistics (see Supplementary Table S1). Item 8 was removed from the scale by the procedure and the re-analysis of the 8-item scale detected no local dependence for each pair of items (see Supplementary Table S2). Finally, Table 4 displays the scalability coefficients of the 8-item scale (SIS-8). The 8-item scale shows adequate scalability in overall (H = 0.56) and for each item (Hi range=0.47 to 0.62). Additionally, the one-factor model of SIS-8 demonstrated acceptable fit in confirmatory factor analysis (scaled CFI = 0.929, scaled TLI = 0.901, scaled RMSEA = 0.076; see Supplementary Table S3).
Table 2.
Initial scalability and identification of Mokken scales for SIS using the aisp function.
| Items | MINVI sizea | Hi(se) | ||
|---|---|---|---|---|
| 0.3 | 0.4 | 0.5 | ||
| 1 | 2 | 2 | 2 | 0.12(0.05) |
| 2 | 1 | 1 | 1 | 0.28 (0.04) |
| 3 | 1 | 1 | 1 | 0.37 (0.04) |
| 4 | 2 | 2 | 2 | 0.00(0.06) |
| 5 | 1 | 1 | 1 | 0.36 (0.04) |
| 6 | 1 | 1 | 1 | 0.38 (0.04) |
| 7 | 1 | 1 | 1 | 0.27 (0.05) |
| 8 | 1 | 1 | 1 | 0.31 (0.05) |
| 9 | 1 | 1 | 1 | 0.36 (0.04) |
| 10 | 2 | 2 | 2 | 0.06(0.05) |
| 11 | 1 | 1 | 1 | 0.41 (0.03) |
| 12 | 1 | 1 | 1 | 0.38 (0.04) |
| Scale H: 0.26(0.03) | ||||
Bold indicates Hi < 0.3; se, standard error; a the numbers in each column indicate the scale to which the item belongs according to different levels of MINVI size.
Table 3.
Output of assessment of monocity and IIO for 9-item SIS.
| Items | Monocity coefficients | IIO coefficients | ||||||
|---|---|---|---|---|---|---|---|---|
| #ac | #vi | crit | #zsig | #ac | #vi | crit | #tsig | |
| 2 | 2 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 3 | 3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 5 | 3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 6 | 2 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 7 | 3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 8 | 3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 9 | 2 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 11 | 1 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
| 12 | 3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 |
#ac, number of active pairs that were investigated; #vi, number of violations in which the item is involved; crit, Crit value; #zsig/#tsig, number of statistically significant violations.
Table 4.
Scalability coefficients for the revised 8-item version of the SIS.
| Items | Coefficients | |
|---|---|---|
| Hi | se | |
| 2 | 0.47 | 0.06 |
| 3 | 0.60 | 0.05 |
| 5 | 0.55 | 0.05 |
| 6 | 0.57 | 0.05 |
| 7 | 0.52 | 0.06 |
| 9 | 0.54 | 0.05 |
| 11 | 0.62 | 0.04 |
| 12 | 0.59 | 0.05 |
Scale H: 0.56(0.04).
se, standard error.
Concurrent validity
Figure 1 presents the concurrent validity analysis of the revised 8-item version of SIS. As hypothesized, scores of the SIS-8 (median=7, IQR = 3-8) show significant correlations with measures of depression and anxiety, exhibiting moderate correlations (r= 0.4-0.6). Additionally, the scores also demonstrate small to moderate correlations (r= 0.2-0.4) with suicidal ideation and life events, confirming our expectations.
Figure 1.

Concurrent validity of SIS-8 using Spearman’s rho correlation coefficients. PHQ-9, Patient Health Questionnaire-9; GAD-7, General Anxiety Disorder Scale-7; SIS-8, Subjective Incompetence Scale-8; UPPSAQ-70, Union Physio-Psycho-Social Assessment Questionnaire-70; LES, Life Events Scale; **p-value < 0.001.
Incremental and relative validity
As illustrated in Table 5, the SIS-8 shows significant incremental validity over stress to predict depression (Δr2 = 0.19) as well as anxiety symptoms (Δr2 = 0.16). Moreover, the SIS-8 demonstrated moderate relative validity to count for anxiety (r2 = 0.14) and depression (r2 = 0.21), together with stress measured by LES.
Table 5.
Incremental and relative validity of SIS-8.
| Coefficients | |||||
|---|---|---|---|---|---|
| Predictors | B | se | p | R2 | p |
| Outcome: Anxiety (UPPSAQ-70) | 0.22 | <.001 | |||
| LES | 0.01 | 0.00 | 0.001 | 0.05a | |
| SIS-8 | 0.33 | 0.05 | <0.001 | 0.17 a | |
| ΔR2 | 0.16 | ||||
| Outcome: Depression (PHQ-9) | 0.26 | <.001 | |||
| LES | 0.01 | 0.00 | 0.001 | 0.05 a | |
| SIS-8 | 0.39 | 0.05 | <0.001 | 0.21 a | |
| ΔR2 | 0.19 | ||||
Statistically significant values (p < 0.05) are in bold. aIndicates the Johnson’s relative weights.
Discussion
This is the first validation study in which the clinimetric properties of the Chinese version of the SIS-12 have been assessed using an extended paradigm. The measurement property of “relative validity” was introduced and its unique implications for the validation of clinical measures were discussed. The study’s strengths thus include the application of innovative clinimetric criteria and robust statistical methods, particularly comprehensive Mokken analysis (48) and relative weight analysis (37), to determine the clinical utility of the SIS-12.
The analyses revealed that the total score of a short version of the scale, the SIS-8, which only included 8 items, had optimal scalability, thus being a highly valid or unidimensional measure of subjective incompetence. In other words, findings of the present clinimetric validation support the use of the SIS-8 not only as a screening measure for early detection of individuals at increased risk for development of demoralization but also as a dimensional measure to assess the severity of feelings of subjective incompetence. The use of the SIS-8 has the potential to help clinical investigators and clinicians differentiate healthy or homeostatic reactions to adverse life events from experiences and manifestations of subjective incompetence that may require clinical attention.
In terms of construct validity, items 1 (i.e., “Were you able to plan and initiate concerted action as well as you thought you could?”), 4 (i.e., “Did you feel that you could continue to plan, strategize and initiate appropriate action?”), and 10 (i.e., “When you were experiencing this situation, did you feel that you could continue to carry out your usual activities [such as doing your housework, concentrating or visiting people]?”) of the original version of the SIS-12 had poor scalability, thus indicating that these items did not belong to the underlying dimension of subjective incompetence that they intended to measure. Examining the item content suggests that these items may reflect an underlying construct of “perceived inability to react” (i.e., being unable to plan, take action, and engage in daily activities) rather than pure feelings of subjective incompetence. This is consistent with the evidence that individuals experiencing demoralization usually maintain the capacity to react (20, 21). As Fava and his research group (20, 21) observed, depressed patients experience a lack of motivation and drive, while in a demoralized person they are usually intact, even though they may be fluctuating and inhibited by helplessness. Similarly, de Figueiredo et al. (23) argued that the magnitude of motivation (i.e., willingness, desire, or interest) is preserved in demoralization, though the direction of motivation (i.e., course of action) is thwarted by uncertainty about how to get out of the predicament. It is noteworthy that the latter does not imply a loss of ability to plan and act in a general manner, but rather a perception that there is a narrowing of pathway toward the desired outcomes. This interpretation is well exemplified by the case that people who are in a hopeless state (i.e., an advanced stage of demoralization) can typically plan and even commit suicide (54). Our findings are also consistent with previous research viewing subjective incompetence as a one-dimensional construct (19, 25). In the present study, after the exclusion of the three items reflecting the perceived inability to react, the SIS-8 was found to be a unidimensional index of subjective incompetence.
Another plausible reason for the three items displaying inadequate scalability coefficients could be their reverse content in contrast to the other items, potentially causing reverse item bias. While utilizing reverse-worded items in assessments can have a number of advantages (e.g., controlling acquiescence and providing wider coverage of a construct’s content), it can also lead to problematic responses given acquiescence, careless responding, and confirmation bias (55, 56). This implies that, in order to calibrate the bias, these three items may benefit from adjustment to non-reverse content for subsequent validation (57). In line with this methodological recommendation, Bech (58), in his editorial on clinimetric dilemmas in outcome scales for mental disorders, suggested avoiding the use of items worded in oppositive directions that have to be reversed in the scoring process. Regarding item 8 (i.e., “Did you change your mind about your ability to deal with similar situations?”), it exhibited significant local dependence with items 2 (i.e., “Were you puzzled, indecisive and uncertain as to what actions, if any, you should take?”) and 5 (i.e., “Did you feel that you were running out of ideas to handle the situation?”), leading to its exclusion through the stepwise automated procedure. This suggests that item 8 may benefit from a rewording not only to avoid clinical redundancy between items but also to allow each item of the scale to express its particular piece of clinical information (59).
As to the concurrent validity, the findings of the present study confirmed our hypotheses, indicating the differential role of subjective incompetence in depression, anxiety, suicidality, and stress. This aligns with the conceptualization of subjective incompetence as an early sign of demoralization (22, 23). Moreover, consistent with our research expectations, the findings from the incremental and relative validity highlighted the clinical utility of SIS-8, suggesting that this index may provide a unique and clinically significant contribution to psychological distress outcomes. Specifically, SIS-8 emerges as a valuable instrument for informing the care of hospitalized patients who present symptoms of depression, anxiety, and suicidality. This finding corresponds to a previous study by Tecuta et al. (27) on patients with eating disorders, where SI demonstrated an independent predictive effect on changes in eating disorder symptomatology.
The study has several limitations that warrant attention. First, it is crucial to acknowledge the high heterogeneity among the inpatient population within the comprehensive hospital setting. Consequently, the external validity of the study’s conclusions should be interpreted with caution. Second, the lack of self-efficacy assessment in this study prevents our ability to disentangle the unique contributions of subjective incompetence from a weak sense of efficacy. Third, the present study did not assess patients’ disease-related characteristics— including disease duration, severity, and psychotropic use—, which may influence subjective incompetence and thus confound the validity of the SIS. Fourth, the absence of qualitative assessment for demoralization rules out the possibility of establishing cut-off values for the scale, thereby restricting its clinical applicability and guidance (20). Future investigations are warranted to fill this gap and clarify the relationship between subjective incompetence and demoralization. Finally, the cross-sectional design of the study precludes the investigation of predictive validity and clinimetric sensitivity of the scale. This limitation underscores the necessity for future refinements, possibly through longitudinal approaches, to enhance our understanding of the scale’s performance over time.
Conclusions
The findings of this clinimetric validation indicate that the revised 8-item Chinese version of the Subjective Incompetence Scale (SIS), the SIS-8, is a valid measure that can be used in clinical research and practice to assess the degree of feelings of subjective incompetence. This easy-to-use and no-time consuming clinimetric index holds promise as a valuable tool in the management of inpatients experiencing psychological distress. It may serve both as a screening measure to identify individuals at heightened risk of demoralization and as a dimensional tool to distinguish between healthy adaptive responses to adversity- such as the burden imposed by the medical condition and associated life disruptions from clinically significant subjective incompetence requiring intervention.
Nonetheless, the findings of this study should be cautiously considered due to factors such as the heterogeneity of the hospitalized patient population, challenges in establishing cut-off values for the scale, and the cross-sectional study design. Further research is needed to refine the scale’s clinical utility and verify its robustness in diverse clinical contexts.
Acknowledgments
We acknowledge the invaluable contribution of Zixiang Zheng, Aoxue Wu, and Jinya Cao for helping with the translation of the SIS. We thank all the patients who participated in the study.
Funding Statement
The author(s) declared that financial support was received for this work and/or its publication. This study was supported by the STI2030-Major Projects (Grant no. 2021ZD0202001), the Capital Funds for Health Improvement and Research, CFH (Grant No.: 2022-2-4012), and the National High-Level Hospital Clinical Research Funding (Grant No.: 2022-PUMCH-B-093).
Footnotes
Edited by: Veena Kumari, Brunel University London, United Kingdom
Reviewed by: Andrés Ramírez, Salesian Polytechnic University, Ecuador
Luis Felipe Higuita Gutierrez, Cooperative University of Colombia, Colombia
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by the Ethics Committee of Peking Union Medical College Hospital. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
BZ: Methodology, Writing – review & editing, Writing – original draft, Conceptualization, Formal analysis, Resources. YD: Investigation, Writing – review & editing, Project administration. JF: Supervision, Writing – review & editing, Resources. DC: Writing – review & editing, Supervision. JH: Data curation, Investigation, Writing – review & editing. TL: Writing – review & editing, Supervision, Methodology, Conceptualization. JW: Supervision, Conceptualization, Funding acquisition, Resources, Writing – review & editing, Methodology.
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was used in the creation of this manuscript. During the preparation of this work, the authors acknowledge using ChatGPT (GPT-3.5, OpenAI), Deepseek (V3, Deepseek Chat), and Grammarly (Grammarly Inc.) for text editing to improve the fluency and readability of the English language. After using this tool/service, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2026.1825824/full#supplementary-material
References
- 1. Bachmann JM, Goggins KM, Nwosu SK, Schildcrout JS, Kripalani S, Wallston KA. Perceived health competence predicts health behavior and health-related quality of life in patients with cardiovascular disease. Patient Educ Couns. (2016) 99:2071–9. doi: 10.1016/j.pec.2016.07.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Chen J, Tian Y, Yin M, Lin W, Tuersun Y, Li L, et al. Relationship between self-efficacy and adherence to self-management and medication among patients with chronic diseases in China: a multicentre cross-sectional study. J Psychosomatic Res. (2023) 164:111105. doi: 10.1016/j.jpsychores.2022.111105 [DOI] [PubMed] [Google Scholar]
- 3. Williams GC, Patrick H, Niemiec CP, Williams LK, Divine G, Lafata JE, et al. Reducing the health risks of diabetes. Diabetes Educator. (2009) 35:484–92. doi: 10.1177/0145721709333856 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Blaakman SW, Fagnano M, Borrelli B, Riekert KA, Halterman JS. Self-determination theory and preventive medication adherence: motivational considerations to support historically marginalized adolescents with asthma. J Pediatr Health Care. (2022) 36:560–9. doi: 10.1016/j.pedhc.2022.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Bellizzi KM, Rowland JH, Arora NK, Hamilton AS, Miller MF, Aziz NM. Physical activity and quality of life in adult survivors of non-Hodgkin’s lymphoma. J Clin Oncol. (2009) 27:960–6. doi: 10.1200/jco.2008.17.5026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. De Man J, Wouters E, Delobelle P, Puoane T, Daivadanam M, Absetz P, et al. Testing a self-determination theory model of healthy eating in a South African township. Front Psychol. (2020) 11. doi: 10.3389/fpsyg.2020.02181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Tromp DM, Brouha XDR, Hordijk GJ, Winnubst JAM, Gebhardt WA, van der Doef MP, et al. Medical care-seeking and health-risk behavior in patients with head and neck cancer: the role of health value, control beliefs and psychological distress. Health Educ Res. (2005) 20:665–75. doi: 10.1093/her/cyh031 [DOI] [PubMed] [Google Scholar]
- 8. Iannotti RJ, Schneider S, Nansel TR, Haynie DL, Plotnick LP, Clark LM, et al. Self-efficacy, outcome expectations, and diabetes self-management in adolescents with type 1 diabetes. J Dev Behav Pediatr. (2006) 27:98–105. doi: 10.1097/00004703-200604000-00003 [DOI] [PubMed] [Google Scholar]
- 9. Wild MG, Wallston KA, Green JA, Beach LB, Umeukeje E, Wright Nunes JA, et al. The perceived medical condition self-management scale can be applied to patients with chronic kidney disease. Kidney Int. (2017) 92:972–8. doi: 10.1016/j.kint.2017.03.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Williams GC, McGregor HA, King D, Nelson CC, Glasgow RE. Variation in perceived competence, glycemic control, and patient satisfaction: Relationship to autonomy support from physicians. Patient Educ Couns. (2005) 57:39–45. doi: 10.1016/j.pec.2004.04.001 [DOI] [PubMed] [Google Scholar]
- 11. Peters M, Potter CM, Kelly L, Fitzpatrick R. Self-efficacy and health-related quality of life: a cross-sectional study of primary care patients with multi-morbidity. Health Qual Life Outcomes. (2019) 17. doi: 10.1186/s12955-019-1103-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Zou D, Liu Y, Gong Y, Zhang X, Liu J, Shen J. Self-efficacy’s mediating role in the relationship between self-perceived burden and health-related quality of life among older-adult inpatients in China: A cross-sectional study. J Multidiscip Healthcare. (2024) 17:2157–63. doi: 10.2147/jmdh.s460151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Rueda B, Pérez-García AM. Gender and social support in the context of cardiovascular disease. Women Health. (2006) 43:59–73. doi: 10.1300/j013v43n01_04 [DOI] [PubMed] [Google Scholar]
- 14. Christensen AJ, Wiebe JS, Benotsch EG, Lawton WJ. Perceived health competence, health locus of control, and patient adherence in renal dialysis. Cogn Ther Res. (1996) 20:411–21. doi: 10.1007/bf0222804230311153 [DOI] [Google Scholar]
- 15. Ponton MK. Weak self-efficacy versus strong self-inefficacy: a comment on the conceptual difference. Int J Soc Sci Res. (2021) 9:1. doi: 10.5296/ijssr.v9i2.18244 [DOI] [Google Scholar]
- 16. Wang H, Jia J, Fan Y, Chen H, Lou Y, Wang X, et al. Impact of inpatient self-efficacy and trust in physicians on inpatient satisfaction with medical services: the mediating role of patient participation in medical decision-making. Front Psychol. (2024) 15. doi: 10.3389/fpsyg.2024.1364319 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Schaufeli WB, Salanova M. Efficacy or inefficacy, that’s the question: burnout and work engagement, and their relationships with efficacy beliefs. Anxiety Stress Coping. (2007) 20:177–96. doi: 10.1080/10615800701217878 [DOI] [PubMed] [Google Scholar]
- 18. Ferrier AG, Martens MP. Perceived incompetence and disordered eating among college students. Eating Behav. (2008) 9:111–9. doi: 10.1016/j.eatbeh.2007.06.004 [DOI] [PubMed] [Google Scholar]
- 19. de Figueiredo JM, Frank JD. Subjective incompetence, the clinical hallmark of demoralization. Compr Psychiatry. (1982) 23:353–63. doi: 10.1016/0010-440x(82)90085-2 [DOI] [PubMed] [Google Scholar]
- 20. Fava GA, Cosci F, Sonino N. Current psychosomatic practice. Psychother Psychosomatics. (2016) 86:13–30. doi: 10.1159/000448856 [DOI] [PubMed] [Google Scholar]
- 21. Fava GA, Guidi J. Clinical characterization of demoralization. Psychother Psychosomatics. (2023) 92:139–47. doi: 10.1159/000530760 [DOI] [PubMed] [Google Scholar]
- 22. Figueiredo JM. Distress, demoralization and psychopathology: diagnostic boundaries. Eur J Psychiatry. (2013) 27:61–73. doi: 10.4321/s0213-6163201300010000834044895 [DOI] [Google Scholar]
- 23. de Figueiredo JM, Zhu B, Patel A, Kohn R, Koo BB, Louis ED. From perceived stress to demoralization in Parkinson disease: a path analysis. Front Psychiatry. (2022) 13. doi: 10.3389/fpsyt.2022.876445 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Warner LM, Schwarzer R. Self‐efficacy and health. In: The Wiley Encyclopedia of Health Psychology (2020). New York, NY: Wiley-Blackwell; p. 605–13. doi: 10.1002/9781119057840.ch111 [DOI] [Google Scholar]
- 25. Cockram CA, Doros G, de Figueiredo JM. Diagnosis and measurement of subjective incompetence: the clinical hallmark of demoralization. Psychother Psychosomatics. (2009) 78:342–5. doi: 10.1159/000235737 [DOI] [PubMed] [Google Scholar]
- 26. Cockram C, Doros G, de Figueiredo JM. Subjective incompetence as the clinical hallmark of demoralization in cancer patients without mental disorder. Prim psychiatry. 2010;17(7):54-58. Primary Psychiatry. (2010) 17:54–8. [Google Scholar]
- 27. Tecuta L, Tomba E. Subjective incompetence as a predictor of treatment outcomes in eating disorder outpatients. Psychiatry Res. (2018) 266:193–8. doi: 10.1016/j.psychres.2018.05.052 [DOI] [PubMed] [Google Scholar]
- 28. Belvederi Murri M, Folesani F, Azzolina D, Muscettola A, Bobevski I, Triolo F, et al. A tale of two constructs: combined assessment of demoralization and subjective incompetence. Psychology Health Med. (2024) 29:1635–51. doi: 10.1080/13548506.2024.2405749 [DOI] [PubMed] [Google Scholar]
- 29. Feinstein AR. T. Duckett Jones memorial lecture. The Jones criteria and the challenges of clinimetrics. Circulation. (1982) 66:1–5. doi: 10.1161/01.cir.66.1.1 [DOI] [PubMed] [Google Scholar]
- 30. Feinstein AR. Clinimetrics. London: Yale University Press; (1987). [Google Scholar]
- 31. Fava GA. Forty years of clinimetrics. Psychother Psychosomatics. (2021) 91:1–7. doi: 10.1159/000520251 [DOI] [PubMed] [Google Scholar]
- 32. Fava GA, Tomba E, Sonino N. Clinimetrics: the science of clinical measurements. Int J Clin Pract. (2011) 66:11–5. doi: 10.1111/j.1742-1241.2011.02825.x [DOI] [PubMed] [Google Scholar]
- 33. Cosci F. Clinimetric perspectives in clinical psychology and psychiatry. Psychother Psychosomatics. (2021) 90:217–21. doi: 10.1159/000517028 [DOI] [PubMed] [Google Scholar]
- 34. Carrozzino D, Patierno C, Guidi J, Berrocal Montiel C, Cao J, Charlson ME, et al. Clinimetric criteria for patient-reported outcome measures. Psychother Psychosomatics. (2021) 90:222–32. doi: 10.1159/000516599 [DOI] [PubMed] [Google Scholar]
- 35. Cosci F, Christensen KS, Ceccatelli S, Patierno C, Carrozzino D. Patient health questionnaire-9: a clinimetric analysis. Braz J Psychiatry. (2024) 46:e20233449. doi: 10.47626/1516-4446-2023-3449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Hayes SC, Hofmann SG, Ciarrochi J. A process-based approach to psychological diagnosis and treatment: the conceptual and treatment utility of an extended evolutionary meta model. Clin Psychol Rev. (2020) 82:101908. doi: 10.1016/j.cpr.2020.101908 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Johnson JW. A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivar Behav Res. (2000) 35:1–19. doi: 10.1207/s15327906mbr3501_1 [DOI] [PubMed] [Google Scholar]
- 38. Azen R, Budescu DV. The dominance analysis approach for comparing predictors in multiple regression. psychol Methods. (2003) 8:129–48. doi: 10.1037/1082-989x.8.2.129 [DOI] [PubMed] [Google Scholar]
- 39. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. New York, NY: Routledge; (1988). doi: 10.4324/9780203771587 [DOI] [Google Scholar]
- 40. Zhu X, Gan J, Wu N, Zhang Y, Liu Z. The simultaneous presence of demoralization, apathy, and depression has a detrimental impact on both cognitive function and motor symptoms in Parkinson’s disease patients. Front Psychiatry. (2024) 15. doi: 10.3389/fpsyt.2024.1345280 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Cui X, Ding L, Xu Y, Yuan X, Zhang Q, Rafanelli C, et al. Prevalence and rapid screen method of diagnostic criteria for psychosomatic research syndromes in human papillomavirus-infected patients. Psychother Psychosomatics. (2024) 93:271–7. doi: 10.1159/000539471 [DOI] [PubMed] [Google Scholar]
- 42. Anthoine E, Moret L, Regnault A, Sébille V, Hardouin J-B. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes. (2014) 12. doi: 10.1186/s12955-014-0176-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Internal Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Wang W, Bian Q, Zhao Y, Li X, Wang W, Du J, et al. Reliability and validity of the Chinese version of the Patient Health Questionnaire (PHQ-9) in the general population. Gen Hosp Psychiatry. (2014) 36:539–44. doi: 10.1016/j.genhosppsych.2014.05.021 [DOI] [PubMed] [Google Scholar]
- 45. Duan Y, Wei J, Hong X, Cao J, Shi L, Zhao X, et al. Psychometric evaluation of the union physio-psycho-social assessment questionnaire. Acta Academiae Medicinae Sinicae. (2019) 41:615–21. doi: 10.3881/j.issn.1000-503X.10960 [DOI] [PubMed] [Google Scholar]
- 46. Wang Y, Gong T, Gaowa S, Duan Y, Jiang Y, Jiang J, et al. Assessment of psychometric properties of the union physio-psycho-social assessment questionnaire (UPPSAQ-70) in a large sample of general hospital psychiatric outpatients. Gen Hosp Psychiatry. (2024) 90:165–70. doi: 10.1016/j.genhosppsych.2024.08.013 [DOI] [PubMed] [Google Scholar]
- 47. Zheng YP, Lin KM. A nationwide study of stressful life events in Mainland China. Psychosomatic Med. (1994) 56:296–305. doi: 10.1097/00006842-199407000-00004 [DOI] [PubMed] [Google Scholar]
- 48. Sijtsma K, van der Ark LA. A tutorial on how to do a Mokken scale analysis on your test and questionnaire data. Br J Math Stat Psychol. (2016) 70:137–58. doi: 10.1111/bmsp.12078 [DOI] [PubMed] [Google Scholar]
- 49. Mokken RJ. A Theory and Procedure of Scale Analysis: With Applications in Political Research. Walter de Gruyter; (2011). [Google Scholar]
- 50. Stochl J, Jones PB, Croudace TJ. Mokken scale analysis of mental health and well-being questionnaire item responses: a non-parametric IRT method in empirical research for applied health researchers. BMC Med Res Methodol. (2012) 12. doi: 10.1186/1471-2288-12-74 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. van der Ark LA. Mokken scale analysis in R. J Stat Software. (2007) 20:1–19. doi: 10.18637/jss.v020.i11 [DOI] [Google Scholar]
- 52. Tonidandel S, LeBreton JM. RWA web: a free, comprehensive, web-based, and user-friendly tool for relative weight analyses. J Business Psychol. (2014) 30:207–16. doi: 10.1007/s10869-014-9351-z30311153 [DOI] [Google Scholar]
- 53. Rosseel Y. lavaan: an R package for structural equation modeling. J Stat Software. (2012) 48:1–36. doi: 10.18637/jss.v048.i02 [DOI] [Google Scholar]
- 54. Beck AT, Brown G, Berchick RJ, Stewart BL, Steer RA. Relationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients. FOCUS. (2006) 4:291–6. doi: 10.1176/foc.4.2.291 [DOI] [PubMed] [Google Scholar]
- 55. Weijters B, Baumgartner H. Misresponse to reversed and negated items in surveys: A review. J Marketing Res. (2012) 49:737–47. doi: 10.1509/jmr.11.0368 [DOI] [Google Scholar]
- 56. Weijters B, Baumgartner H, Schillewaert N. Reversed item bias: An integrative model. psychol Methods. (2013) 18:320–34. doi: 10.1037/a0032121 [DOI] [PubMed] [Google Scholar]
- 57. Suárez-Álvarez J, Pedrosa I, Lozano LM, García-Cueto E, Cuesta M, Muñiz J. Using reversed items in Likert scales: a questionable practice. Psicothema. (2018) 30:149–58. doi: 10.7334/psicothema2018.33 [DOI] [PubMed] [Google Scholar]
- 58. Bech P. Clinimetric dilemmas in outcome scales for mental disorders. Psychother Psychosomatics. (2016) 85:323–6. doi: 10.1159/000448810 [DOI] [PubMed] [Google Scholar]
- 59. Carrozzino D, Patierno C, Pignolo C, Christensen KS. The concept of psychological distress and its assessment: a clinimetric analysis of the SCL-90-R. Int J Stress Manage. (2023) 30:235–48. doi: 10.1037/str000028027371692 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
