Skip to main content
PLOS One logoLink to PLOS One
. 2017 Jun 29;12(6):e0179461. doi: 10.1371/journal.pone.0179461

Psychometric assessment of a scale to measure bonding workplace social capital

Hisashi Eguchi 1,*, Akizumi Tsutsumi 1, Akiomi Inoue 2, Yuko Odagiri 3
Editor: Toshiyuki Ojima4
PMCID: PMC5491017  PMID: 28662058

Abstract

Objectives

Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to worker health. This study aimed to assess the psychometric properties of a newly developed WSC scale for use in work environments, where bonding social capital is important.

Methods

We assessed the psychometric properties of a newly developed 6-item scale to measure bonding WSC using two data sources. Participants were 1,650 randomly selected workers who completed an online survey. Exploratory factor analyses were conducted. We examined the item–item and item–total correlations, internal consistency, and associations between scale scores and a previous 8-item measure of WSC. We evaluated test–retest reliability by repeating the survey with 900 of the respondents 2 weeks later. The overall scale reliability was quantified by an intraclass coefficient and the standard error of measurement. We evaluated convergent validity by examining the association with several relevant workplace psychosocial factors using a dataset from workers employed by an electrical components company (n = 2,975).

Results

The scale was unidimensional. The item–item and item–total correlations ranged from 0.52 to 0.78 (p < 0.01) and from 0.79 to 0.89 (p < 0.01), respectively. Internal consistency was good (Cronbach’s α coefficient: 0.93). The correlation with the 8-item scale indicated high criterion validity (r = 0.81) and the scale showed high test–retest reliability (r = 0.74, p < 0.01). The intraclass coefficient and standard error of measurement were 0.74 (95% confidence intervals: 0.71–0.77) and 4.04 (95% confidence intervals: 1.86–6.20), respectively. Correlations with relevant workplace psychosocial factors showed convergent validity.

Conclusions

The results confirmed that the newly developed WSC scale has adequate psychometric properties.

Introduction

Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to workers' health. There are several aspects of WSC, such as the extent and intensity of associational links or activities, and perceptions of support, reciprocity, and trust in the workplace [1]. A growing body of research has identified WSC as a determinant of employee health [2]. Empirical studies have found associations between low WSC and depression [3, 4], hypertension [5, 6], poor self-rated health [4, 7], smoking [4, 8], and high mortality [9]. On the other hand, a meta-analysis showed no association between most social capital dimensions and all-cause mortality, cardiovascular disease or cancer [10]. Thus, further studies are necessary to explore the health effects of WSC.

Several WSC scales have been used in Western countries. Trust and mutual aid in the workplace have been measured in the United States [11]. A 6-item scale was developed in Germany to examine personal aspects of social capital, such as shared values, support, aggregation, and recognition of trust within an organization [12, 13]. In Finland, Kouvonen et al. developed an 8-item scale to measure a multifaceted concept that included reciprocity, mutual aid, and cooperative interpersonal relationships beyond differences in workplace position [14]. Currently, Kouvonen et al.’s scale is the most frequently cited instrument in the occupational stress research field [6, 9, 15].

The separate and combined effects of the three types of social capital (i.e., bonding, bridging, and linking social capital) have attracted broad interest [16]. Bonding refers to the value assigned to social relationships among individuals with similar socioeconomic attributes. Bridging describes relationships between dissimilar persons at the same hierarchical levels. Linking refers to relationships between persons across different hierarchical levels. These constructs are relevant in specifying how WSC inheres in relationships between individuals in similar social contexts and different levels of society [14, 16].

Bonding WSC is of particular importance in Japanese society because Japanese culture is group-oriented; altruism, teamwork, and group cohesiveness are all strongly emphasized in Japanese society, and individual identity is defined by the social group [1719]. Trust and reciprocity are a key factor in Japanese society. Previous studies from Japan showed the association of trust and reciprocity with worker’s health [4, 20]. The use of well-validated questionnaires is indispensable for measurement across diverse cultural settings. However, there are currently no original scales that measure bonding, trust and reciprocity of WSC in consideration of Japanese context.

This study aimed to analyze a newly developed scale for measuring bonding WSC and to assess the psychometric properties in a Japanese working population. The development of the scale was based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) [21].

Materials and methods

Scale development

The measurement theory underlying the scale development was based on the reflective model (COSMIN Box E-1). Fourteen items were generated for the scale during the process of developing the New Brief Job Stress Questionnaire [22]. These items were collected from previous questionnaires based on relevant occupational stress theories and through a series of meetings with experts and stakeholders. The stakeholder meeting comprised researchers from five institutes or departments of occupational safety and health, occupational health personnel (physicians, nurses, and hygienists), and representatives of two employer associations and one employee organization. As previously mentioned, bonding WSC is of particular relevance to Japanese society [23]; therefore, we selected items relevant to bonding WSC to measure the network, trust, and reciprocity aspects of WSC. The items assessing the network aspects of WSC were adapted from Kouvonen et al. [14] and included three items that measured bonding WSC. The trust and reciprocity items were taken from previous Japanese studies that used the social cohesion approach to conceptualizing social capital [4, 11, 19, 20, 2426]. These studies examined individuals’ perceptions of the trustworthiness of others, as well as the norms of solidarity and reciprocity that exist within the groups to which individuals belong. Norms and social trust represent features of social relationships that facilitate collective action for mutual benefit at workplaces [11]. Content validity, including face validity, was checked via item analyses and stakeholder discussions, and a consensus was reached that six items would be retained for the scale. All items were answered using a 4-point scale (1 = strongly disagree to 4 = strongly agree). Ratings for all items were summed to provide a single index. The scale is the following (COSMIN Box A-1, D-1, D-3, D-4).

  • Item 1. People keep each other informed about work-related issues in the work unit.

  • Item 2. We have a “we are together” attitude.

  • Item 3. People feel understood and accepted by each other.

  • Item 4. In our workplace, there is an atmosphere of helping each other.

  • Item 5. In our workplace, we trust each other.

  • Item 6. Our workplace is a place of laughter and smiles.

Study design and population

Online survey

We conducted a new survey to confirm the reliability and validity of the WSC scale. A series of online surveys was conducted in February 2016 with participants registered with a Japanese online survey company. In total, 581,660 working people (excluding those who were self-employed, unemployed, or students) aged 20–69 years, of both sexes and all ages, were randomly invited to participate in the survey. Participants were selected with a random number generator; the study population comprised individuals interested in participating in a survey that provided a financial incentive for responding. The online survey company contacted selected registrants to answer the survey and ceased recruitment when the total number of participants reached the target number. The sex ratio was 1:1 and there were an equal number of participants in each age group (20–29, 30–39, 40–49, 50–59, and 60–69 years). The financial incentive for participants was modest, valued at approximately a few US dollars. For economic reasons, recruitment ceased when the number of participants exceeded 1,650; this was a moderate sample size based on a previous study [27] (COSMIN Box A-4, A-6, B-3, C-3, E-4, H-3, J-3). At least 301 participants were considered necessary to detect an intraclass correlation efficient (ICC) (2,1) ≥ 0.50 (error α = 0.05 and β = 0.20) between the first and second survey[28]. We repeated the survey with 900 of the respondents using the same WSC questionnaire 2 weeks later (COSMIN Box B-4, B-5, B-6, B-9, C-4, C-5, C-6, C-9). The second survey respondents were recruited on a first-come, first-served basis until the number of participants achieved 900. A time interval of about 2 weeks is considered appropriate for the evaluation of instruments [29] (COSMIN Box B-8, C-8). There were no differences in WSC and participant demographic characteristics between the two survey periods (COSMIN Box Generalisability-4, -5, -7). Because our online survey required participants to answer all the questions, no participants had missing items (COSMIN Box A-2, A-3, B-1, B-2, C-1, C-2, H-1, H-2, Generalisability-8).

Company survey

We used the existing database to confirm the convergent validity of the WSC scale. We used part of a cross-sectional dataset collected from a baseline survey of an occupational cohort study on social class and health in Japan (Japanese Study of Health, Occupation, and Psychosocial Factors Related Equity: J-HOPE), which was conducted from April to June 2011. We selected workers employed by an electrical components company at two manufacturing sites. The total number of employees in the company was about 15,000. This dataset comprised information from 3,461 workers who completed a self-administered questionnaire. This contained scales that measured a broad range of relevant workplace psychosocial factors and psychological distress together with the WSC scale (response rate = 95.3%). After excluding 486 workers who had at least one missing response on the questionnaire, the final number of respondents was 2,975 (2,204 men and 771 women: valid response rate = 86.0%), which was a moderate sample size based on a previous study [27] (COSMIN Box A-4, A-6, B-3, C-3, E-4, F-3, H-3, J-3). We compared the final respondents of the study population (n = 2,975) with participants with at least one missing response on the questionnaire (n = 486). There were no significant differences between these groups in job demands, coworker support, effort–reward imbalance (ERI), penetration of management philosophy, work engagement, psychological distress, or education. However, job control, supervisor support, procedural justice, interactional justice, the proportion of men, number of younger individuals, number of regular workers, and number of less skilled workers were lower in the missing response group (COSMIN Box Generalisability-4, -5, -7, -8). Among participants with at least one missing response on the WSC scale, 69% had only one missing response. There were no large differences in the number of missing responses between individual items related to WSC: item 1 (n = 14), item 2 (n = 19), item 3 (n = 18), item 4 (n = 16), item 5 (n = 17), and item 6 (n = 13) (COSMIN Box F-2).

Measures

Online survey

Kouvonen et al.’s [14] WSC scale:To evaluate criterion validity, we used a Japanese version of Kouvonen et al.’s WSC scale [14] (COSMIN Box H-4). This measure is a reliable and valid indicator of WSC, and shows strong associations with self-rated health [14], depression [30], hypertension [6], and mortality [9]. Using a 5-point Likert scale, participants report their perceptions of the following issues: “We have a ‘we are together’ attitude,” “People feel understood and accepted by each other,” “People keep each other informed about work-related issues in the work unit,” “Members of the work unit build on each other’s ideas in order to achieve the best possible outcome,” “People in the work unit cooperate in order to help develop and apply new ideas,” “We can trust our supervisor,” “Our supervisor treats us with kindness and consideration,” and “Our supervisor shows concern for our rights as an employee.” Odagiri et al. [31] have found acceptable internal consistency, reliability, and validity for the Japanese version of the WSC. In our online survey, Cronbach's α coefficient was 0.94.

Company survey

Job demands, job control, supervisor support, and coworker support: We used the scales measuring job demands, job control, supervisor support, and coworker support from the Japanese version of the Job Content Questionnaire [32]. The Job Content Questionnaire, developed by Karasek, is based on the job demands–control (or demand–control–support) model and includes scales for job demands (five items), job control (nine items), supervisor support (four items), and coworker support (four items) rated on a 4-point scale (1 = strongly disagree to 4 = strongly agree). The reliability and validity of the Japanese version of the Job Content Questionnaire are acceptable, as shown by Kawakami et al. [33]. In the present study sample, Cronbach’s α coefficients were 0.68, 0.82, 0.90, and 0.79 for the job demands, job control, supervisor support, and coworker support scales, respectively (COSMIN Box F-7, F-8).

Effort–reward imbalance (ERI)

To assess ERI, we used data collected from a simplified Japanese version of the ERI Questionnaire [34]. This version includes scales for effort (three items) and reward (seven items) rated on a 4-point scale (1 = strongly disagree to 4 = strongly agree). Kurioka et al. [35] have reported acceptable reliability and validity for the simplified Japanese version of the ERI Questionnaire. In the present study sample, Cronbach’s α coefficients were 0.78 and 0.72 for the effort and reward scales, respectively. We calculated the effort/reward ratio to measure the extent of the ERI (COSMIN Box F-7, F-8).

Procedural and interactional justice

Two aspects of organizational justice (i.e., procedural and interactional) were assessed using the Japanese version of the Organizational Justice Questionnaire. This instrument was developed by Moorman [36] and was modified by Elovanio et al. [37]. It comprises a 7-item scale that measures procedural justice, and a 6-item scale that measures interactional justice, both of which are rated on a 5-point scale (1 = strongly disagree to 5 = strongly agree). Inoue et al. [38] have confirmed the reliability and validity of the Japanese version of the scale. In the present study sample, Cronbach’s α coefficients were 0.88 and 0.94 for procedural and interactional justice scales, respectively (COSMIN Box F-7, F-8).

Penetration of management philosophy

Penetration of management philosophy was assessed using three questions derived from previous studies [39]. Participants reported their perceptions of the following issues: “I understand my company management philosophy," “My company management philosophy has a strong effect on my attitudes towards my work," and “My company management philosophy fits my sense of value." Responses were measured on a 5-point scale (1 = completely disagree to 5 = completely agree). Item scores were summed and greater scores indicated greater penetration of management philosophy. In the present study sample, Cronbach’s α coefficient was 0.86 for the penetration of management philosophy scale (COSMIN Box F-7, F-8).

Work engagement

Work engagement was assessed using the short form of the Utrecht Work Engagement Scale (UWES) [40]. The UWES includes three subscales that reflect the underlying dimensions of engagement: vigor, dedication, and absorption (three items for each). All items were scored on a 7-point Likert scale ranging from 0 (never) to 6 (always). The validation study of the Japanese version of the UWES [41] recommends that work engagement should be treated as a unitary construct owing to high correlations among the three components. In the present study sample, Cronbach’s α coefficient was 0.93 for the UWES (COSMIN Box F-7, F-8).

Psychological distress

The K6 scale, developed by Kessler et al. [42], consists of six items that measure the extent of psychological distress using a 5-point response option (0 = none of the time to 4 = all of the time). The Japanese version of the K6 scale has acceptable reliability and validity [43]. The item scores are summed to calculate a total score; higher scores indicate greater psychological distress. In the present study sample, Cronbach’s α coefficient was 0.88 for the K6 scale (COSMIN Box F-7, F-8).

Demographic variables

In both the online and company surveys, we measured sex, age group (18–29, 30–39, 40–49, 50–59, and 60–69 years), educational attainment (more than 12 years or not greater than 12 years), employment contract (regular or part-time), and job types to describe the study population (COSMIN Box D-2).

Hypothesis testing

According to COSMIN, hypothesis testing must be used when a gold standard is not available. WSC is theoretically related to other psychosocial factors in the workplace [14]. We hypothesized that WSC might be negatively correlated with job demands (r ≤ −0.05), ERI (r ≤ −0.20), and psychological distress (r ≤ −0.05), and positively correlated with job control (r ≥ 0.20), procedural justice (r ≥ 0.50), interactional justice (r ≥ 0.50), work engagement (r ≥ 0.30), and penetration of management philosophy (r ≥ 0.30). These hypothesized effect sizes were estimated from previous studies [14, 44, 45] (COSMIN boxes F-4, F-5, F-6, F-7).

Statistical analysis (COSMIN Box F-10)

Online survey

We used classical test theory to measure bonding WSC. Mean values and standard deviations were calculated for each item of the WSC scale. We tested sex, age, education, employment contract, and occupational differences in the WSC scale with analysis of variance. Item–item and item–total Spearman’s correlations were examined. Exploratory factor analyses were conducted, and all six items were entered using the unweighted least squares method. Factors with eigenvalues of more than 1.0 were extracted, and the Promax rotation method was used to obtain clear factorial structures (COSMIN Box E-6). The survey was repeated using the same WSC scale for 900 of the respondents after 2 weeks to assess the replicability of the WSC scale using the test–retest method (COSMIN Box B-4, B-5, B-6, B-9). The overall scale reliability was quantified by both an intraclass correlation coefficient (ICC) (2,1) based on a single measurement two-way random effects model of absolute agreement [46] (COSMIN Box B-11) and the standard error of measurement (SEM) (COSMIN Box C-11). ICC (2,1) was interpreted in accordance with published recommendations: an ICC (2,1) of 0.90 or higher was considered excellent, 0.75 or higher good, 0.50 or higher moderate, and lower than 0.50 poor [46]. The larger the SEM, the lower the test reliability and the less precision in the measures and scores obtained [47]. To evaluate internal consistency, Cronbach’s α coefficient was calculated (COSMIN Box A-7, A-9). To confirm criterion validity, Pearson’s correlation was computed between our scale scores and scores from Kouvonen et al.'s scale (COSMIN Box H-6).

Company survey

To evaluate convergent validity, we calculated the Pearson’s correlation coefficients between the WSC and job demands, job control, supervisor support, coworker support, ERI, procedural justice, interactional justice, penetration of management philosophy, work engagement, and psychological distress based on the hypothesis testing.

The level of significance used was 0.05 (two-tailed). IBM SPSS Statistics for Windows, Version 23 (IBM Corp., Armonk, NY, USA) was used for the statistical analyses.

Ethics review and approval

The study aims and protocol were reviewed and approved by the Research Ethics Committee of the Graduate School of Medicine and Faculty of Medicine, The University of Tokyo (No. 2772), the Kitasato University Medical Ethics Organization (Nos. B12-103 and B15-132), and the Ethics Committee of the University of Occupational and Environmental Health, Japan (No. 10–004). Written consent was obtained from participants.

Results

Participants’ demographic characteristics and means and standard deviations of total WSC score by the characteristics for the two databases are shown in Table 1 (COSMIN Box J-4, J-7, Generalisability-2). Means of total WSC were significantly different between ages, educations, and occupations in the online survey and between ages and occupations in the company survey.

Table 1. Participant demographics and means and standard deviations of total workplace social capital score.

Online survey (n = 1,650) A company survey (n = 2,975)
N Mean SD pa N Mean SD pa
Sex
 Men 825 16.33 (4.01) 0.42 2204 16.91 (3.23) 0.58
 Women 825 16.44 (4.15) 771 16.80 (3.58)
Age
 18–29 330 16.42 (4.03) 0.01 763 16.95 (3.53) 0.01
 30–39 330 16.06 (4.25) 792 16.58 (3.40)
 40–49 330 16.08 (4.03) 856 16.95 (3.18)
 50–59 330 16.28 (3.91) 480 17.04 (3.12)
 60- 330 17.06 (4.11) 84 17.65 (3.14)
Education
 ≤12 years 421 16.06 (4.00) <0.01 1669 16.73 (3.40) 0.06
 >12 years 1229 16.49 (4.10) 1306 17.08 (3.22)
Employment contract
 Regular 985 16.25 (4.17) 0.81 2500 16.88 (3.28) 0.11
 Part-time 665 16.58 (3.93) 475 16.92 (3.58)
Occupation
 Managers 164 17.66 (3.94) <0.01 271 17.93 (2.84) <0.01
 Professionals 198 16.85 (3.72) 205 16.91 (3.35)
 Technicians and associate professionals 101 16.32 (3.70) 352 16.97 (3.03)
 Clerical support workers 520 15.98 (4.12) 278 16.88 (3.44)
 Service and sales workers 317 16.55 (4.26) 24 16.00 (3.97)
 Craft and related trade workers 58 16.33 (4.12) 192 17.05 (3.35)
 Plant and machine operators, and assemblers 58 15.93 (3.60) 712 16.52 (3.24)
 Armed forces occupations 151 15.74 (4.09) 477 16.63 (3.72)
 Others 83 16.22 (4.35) 464 17.00 (3.26)

SD, standard deviation.

a, Analysis of variance.

Online survey

Table 2 shows the means, standard deviations, item–item and item–total correlations, and Cronbach's α coefficients of the scale if each item was deleted. The mean for each item was between 2.0 and 3.0. Correlations between items varied between 0.52 and 0.78 (p < 0.01). The item–total correlations ranged from 0.79 to 0.89 (p < 0.01). The WSC scale was unidimensional (principal component analysis; eigenvalue = 4.43) (COSMIN Box A-5). The correlations between the WSC scores of the two survey rounds indicated high test–retest reliability (r = 0.74, p < 0.01). The ICC (2,1) and SEM for WSC were 0.74 (95% confidence intervals [CI]: 0.71–0.77) and 4.04 (95% CI: 1.86–6.20). The mean of the time variation for WSC was 0.06 ± 2.92. The internal consistency of the scale was good, with a Cronbach's α coefficient of 0.93. The presence or removal of any of the items did not materially alter the internal reliability of the scale. The scale score was highly correlated with that of Kouvonen et al.’s scale (r = 0.81, p < 0.01).

Table 2. Means, standard deviations, item–item correlations, item–total correlations, and Cronbach’s α if item deleted: Social capital items measured in randomly selected workers by an online survey (N = 1,650).

Means SD Item 1b Item 2b Item 3b Item 4b Item 5b Item–total correlationb Cronbach’s α if item deleted
Item 1. 2.81 (0.78) 0.86 0.91
Item 2. 2.68 (0.77) 0.72 0.89 0.91
Item 3. 2.73 (0.78) 0.65 0.67 0.83 0.92
Item 4. 2.75 (0.81) 0.71 0.71 0.67 0.89 0.91
Item 5. 2.61 (0.80) 0.67 0.78 0.66 0.73 0.88 0.91
Item 6. 2.81 (0.81) 0.59 0.60 0.52 0.64 0.63 0.79 0.93

SD, standard deviation.

b, Item–item correlations and item–total correlations: all Spearman correlations; p < 0.001 in all cases.

Company survey

An aspect of convergent validity was tested by exploring the associations between the WSC score and the theoretically related constructs of job demands, job control, supervisor support, coworker support, ERI, procedural justice, interactional justice, penetration of management philosophy, work engagement, and psychological distress. Table 3 shows that, as expected, high WSC scores were significantly negatively associated with job demands, ERI, and psychological distress; and positively associated with job control, supervisor support, coworker support, procedural justice, interactional justice, penetration of management philosophy, and work engagement (all p < 0.01).

Table 3. Association between workplace social capital score and other constructs in workers employed at two manufacturing sites of an electrical components company (N = 2,975).

Other constructs Correlation coefficientsa
 Job demands −0.10
 Job control 0.21
 Supervisor support 0.45
 Coworker support 0.63
 Effort–reward imbalance −0.24
 Procedural justice 0.52
 Interactional justice 0.51
 Penetration of management philosophy 0.31
 Work engagement 0.36
 Psychological distress −0.30

aPearson’s correlations; p < 0.001 in all cases.

Discussion

We assessed the psychometric properties of our new WSC scale, which was developed to reflect the importance of bonding social capital in work environments in Japan. Following the COSMIN model, we demonstrated acceptable levels of internal consistency (Box A), reliability (Box B), measurement error (Box C), content validity (Box D), structural validity (Box E), hypothesis testing (convergent validity) (Box F), criterion validity (Box H), and generalizability among diverse populations. However, we did not examine cross-cultural validity (Box G), responsiveness (Box I), or interpretability (Box J).

We examined bonding rather than bridging or linking social capital. As mentioned above, bonding is important in the cultural context of the Japanese workplace [23]. Bridging social capital is defined as respect and mutuality between people who know that they are not alike in some sociodemographic (or social identity) sense (differing by age, ethnic group, or socioeconomic class). Linking social capital refers to relationships among people who are interacting across explicit, formal, or institutionalized power or authority gradients, which might lead to top-down management in the workplace. In the previous study in the Japanese workplaces, the results of bonding WSC were consistent with previous studies, whereas linking and bridging WSC were not consistent with previous studies [48]. Because workers in Japan are from less diverse backgrounds (e.g., ethnic group or social class) and top-down management styles are less common than in Western countries [49], the bonding social capital might make more effect on the workers’ health than linking and bridging in Japanese workplaces.

Previous studies using our scale showed significant associations between WSC score and psychological distress, as expected [50, 51]. These results were consistent with previous studies using other WSC measures [3, 7] and provide evidence for the validity of our scale. However, the health benefits of social capital can be observed both at the individual and aggregated (workplace) level [14]. As our study only demonstrated psychometric properties at the individual level, further studies are needed to evaluate the association between workplace-level WSC and workers’ health.

The present study has some limitations. First, participants in the company survey were workers employed by an electrical components company at two manufacturing sites or internet users in Japan. It is unclear how much the reported psychometric properties can be generalized to other industries and non-internet users. Therefore, more research with participants of differing backgrounds is needed to validate the measure further. Second, our scale was constructed using a relatively small number of items. However, as the items were selected based on the conventional core concepts of social capital, such as "trust," "reciprocity,” and “collective efficacy” [4, 11, 19, 20, 2426], as well as through discussion between experts, occupational health professionals and practitioners, we consider our new WSC scale to have a certain level of content validity. Third, this scale was originally developed in Japanese. We assumed that this scale was used in the Japanese workplace. However, there are some countries with similar working cultural background such as collectivism, allocentrism and non-diverse in east Asia[23, 52]. Therefore, this concise scale could be useful in work environments other than Japan to see the health effect of bonding workplace social capital by confirming the cross-cultural validity (COSMIN Box G). Fourth, COSMIN requires a further test for responsiveness, which refers to the ability of an instrument to detect change over time in the construct to be measured (COSMIN Box I). Fifth, we could not calculate the minimal important change or the minimal important difference, which is used to define meaningful change (COSMIN Box J-8).

Conclusion

Although further validation tests are required, the findings show that the newly developed WSC scale has adequate psychometric properties. We expect this concise scale to be useful in measuring WSC at workplaces where bonding social capital is relevant.

Acknowledgments

The present study was supported by a Grant-in-Aid for Scientific Research on Innovative Areas (Research in a Proposed Research Area) 2009–2013 (No. 4102–21119001) from the Ministry of Education, Culture, Sports, Science and Technology, Japan, a KAKENHI Grant Number 26253042 from the Japan Society for the Promotion of Science, and a Health and Labour Sciences Research Grant 2015–2017 (H27-Rodo-Ippan-004) from the Ministry of Health, Labour and Welfare, Japan.

Data Availability

Data is not suitable for public deposition due to ethical concerns. The data set is under processing to be suitable for public deposition to meet the revised Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects. The data set is managed by the data management committee on J-SHINE and J-HOPE. Researchers who have an interest in the analysis using J-HOPE data, please contact Prof. Akizumi Tsutsumi, who is one of the data managing committee members and are responsible for the J-HOPE data, akizumi@kitasato-u.ac.jp.

Funding Statement

The present study was supported by a Grant-in-Aid for Scientific Research on Innovative Areas (Research in a Proposed Research Area) 2009–2013 (No. 4102-21119001) from the Ministry of Education, Culture, Sports, Science and Technology, Japan, a KAKENHI Grant Number 26253042 from the Japan Society for the Promotion of Science, and a Health and Labour Sciences Research Grant 2015–2017 (H27-Rodo-Ippan-004) from the Ministry of Health, Labour and Welfare, Japan. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Kawachi I, Berkman L. Social cohesion, social capital, and health Social Epidemiology. 2014; 290–319. [Google Scholar]
  • 2.Kawachi I, Takao S, Subramanian SV. Global perspectives on social capital and health. New York: Springer; 2013. [Google Scholar]
  • 3.Kouvonen A, Oksanen T, Vahtera J, Stafford M, Wilkinson R, Schneider J, et al. Low workplace social capital as a predictor of depression: The Finnish Public Sector Study. Am J Epidemiol. 2008;167(10): 1143–1151. doi: 10.1093/aje/kwn067 [DOI] [PubMed] [Google Scholar]
  • 4.Suzuki E, Takao S, Subramanian SV, Komatsu H, Doi H, Kawachi I. Does low workplace social capital have detrimental effect on workers' health? Soc Sci Med. 2010;70(9): 1367–1372. doi: 10.1016/j.socscimed.2010.01.014 [DOI] [PubMed] [Google Scholar]
  • 5.Oksanen T, Kawachi I, Jokela M, Kouvonen A, Suzuki E, Takao S, et al. Workplace social capital and risk of chronic and severe hypertension: A cohort study. J Hypertens. 2012;30(6): 1129–1136. doi: 10.1097/HJH.0b013e32835377ed [DOI] [PubMed] [Google Scholar]
  • 6.Oksanen T, Kawachi I, Kouvonen A, Suzuki E, Takao S, Sjosten N, et al. Workplace social capital and adherence to antihypertensive medication: A cohort study. PloS One. 2011;6(9): e24732 doi: 10.1371/journal.pone.0024732 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Oksanen T, Kouvonen A, Vahtera J, Virtanen M, Kivimäki M. Prospective study of workplace social capital and depression: Are vertical and horizontal components equally important? J Epidemiol Community Health. 2010;64(8): 684–689. doi: 10.1136/jech.2008.086074 [DOI] [PubMed] [Google Scholar]
  • 8.Kouvonen A, Oksanen T, Vahtera J, Väänänen A, De Vogli R, Elovainio M, et al. Work-place social capital and smoking cessation: The Finnish Public Sector Study. Addiction. 2008;103(11): 1857–1865. doi: 10.1111/j.1360-0443.2008.02315.x [DOI] [PubMed] [Google Scholar]
  • 9.Oksanen T, Kivimäki M, Kawachi I, Subramanian SV, Takao S, Suzuki E, et al. Workplace social capital and all-cause mortality: A prospective cohort study of 28,043 public-sector employees in Finland. Am J Public Health. 2011;101(9): 1742–1748. doi: 10.2105/AJPH.2011.300166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Choi M, Mesa-Frias M, Nuesch E, Hargreaves J, Prieto-Merino D, Bowling A, et al. Social capital, mortality, cardiovascular events and cancer: a systematic review of prospective studies. Int J Epidemiol. 2014;43(6):1895–920. doi: 10.1093/ije/dyu212 [DOI] [PubMed] [Google Scholar]
  • 11.Kawachi I, Subramanian S, Kim D. Social capital and health: A decade of progress and beyond In: Kawachi I, Subramanian S, Kim D, editors. Social capital and health, New York: Springer; 2008. pp. 1–26. [Google Scholar]
  • 12.Jung J, Nitzsche A, Ernstmann N, Driller E, Wasem J, Stieler-Lorenz B, et al. The relationship between perceived social capital and the health promotion willingness of companies: A systematic telephone survey with chief executive officers in the information and communication technology sector. J Occup Environ Med. 2011;53(3): 318–323. doi: 10.1097/JOM.0b013e31820d103f [DOI] [PubMed] [Google Scholar]
  • 13.Jung J, Ernstmann N, Nitzsche A, Driller E, Kowalski C, Lehner B, et al. Exploring the association between social capital and depressive symptoms: Results of a survey in German information and communication technology companies. J Occup Environ Med. 2012;54(1): 23–30. doi: 10.1097/JOM.0b013e318237a1b6 [DOI] [PubMed] [Google Scholar]
  • 14.Kouvonen A, Kivimäki M, Vahtera J, Oksanen T, Elovainio M, Cox T, et al. Psychometric evaluation of a short measure of social capital at work. BMC Public Health. 2006;6: 251 doi: 10.1186/1471-2458-6-251 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Oksanen T, Kawachi I, Kouvonen A, Takao S, Suzuki E, Virtanen M, et al. Workplace determinants of social capital: Cross-sectional and longitudinal evidence from a Finnish cohort study. PLoS One. 2013;8(6): e65846 doi: 10.1371/journal.pone.0065846 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Szreter S, Woolcock M. Health by association? Social capital, social theory, and the political economy of public health. Int J Epidemiol. 2004;33(4): 650–667. doi: 10.1093/ije/dyh013 [DOI] [PubMed] [Google Scholar]
  • 17.Oyserman D, Coon HM, Kemmelmeier M. Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychol Bull. 2002;128(1): 3–72. [PubMed] [Google Scholar]
  • 18.Brislin RW, MacNab B, Worthley R, Kabigting F, Zukis B. Evolving perceptions of Japanese workplace motivation: An employee-manager comparison. Int J Cross Cult Manag. 2005;5(1): 87–104. [Google Scholar]
  • 19.Suzuki E, Yamamoto E, Takao S, Kawachi I, Subramanian SV. Clarifying the use of aggregated exposures in multilevel models: Self-included vs. self-excluded measures. PloS One. 2012;7(12): e51717 doi: 10.1371/journal.pone.0051717 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Suzuki E, Fujiwara T, Takao S, Subramanian SV, Yamamoto E, Kawachi I. Multi-level, cross-sectional study of workplace social capital and smoking among Japanese employees. BMC Public Health. 2010;10:489 doi: 10.1186/1471-2458-10-489 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Qual Life Res. 2010;19(4): 539–49. doi: 10.1007/s11136-010-9606-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Inoue A, Kawakami N, Shimomitsu T, Tsutsumi A, Haratani T, Yoshikawa T, et al. Development of a short questionnaire to measure an extended set of job demands, job resources, and positive health outcomes: The New Brief Job Stress Questionnaire. Ind Health. 2014;52(3): 175–189. doi: 10.2486/indhealth.2013-0185 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Oyserman D, Coon HM, Kemmelmeier M. Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychol Bull. 2002;128(1): 3–72. [PubMed] [Google Scholar]
  • 24.Fujino Y, Kubo T, Kunimoto M, Tabata H, Tsuchiya T, Kadowaki K, et al. A cross-sectional study of workplace social capital and blood pressure: A multilevel analysis at Japanese manufacturing companies. BMJ Open. 2013;3(2): pii: e002215 doi: 10.1136/bmjopen-2012-002215 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Fujisawa Y, Hamano T, Takegawa S. Social capital and perceived health in Japan: An ecological and multilevel analysis. Soc Sci Med. 2009;69(4): 500–505. doi: 10.1016/j.socscimed.2009.05.046 [DOI] [PubMed] [Google Scholar]
  • 26.Ichida Y, Kondo K, Hirai H, Hanibuchi T, Yoshikawa G, Murata C. Social capital, income inequality and self-rated health in Chita peninsula, Japan: A multilevel analysis of older people in 25 communities. Soc Sci Med. 2009;69(4): 489–499. doi: 10.1016/j.socscimed.2009.05.006 [DOI] [PubMed] [Google Scholar]
  • 27.Terwee CB, Mokkink LB, Knol DL, Ostelo RWJG, Bouter LM, de Vet HCW. Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4): 651–657. doi: 10.1007/s11136-011-9960-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101–10. [DOI] [PubMed] [Google Scholar]
  • 29.Streiner DL, Norman GR, Cairney J. Health measurement scales: A practical guide to their development and use. USA: Oxford University Press; 2014. [Google Scholar]
  • 30.Gao J, Weaver SR, Dai J, Jia Y, Liu X, Jin K, et al. Workplace social capital and mental health among Chinese employees: A multi-level, cross-sectional study. PloS One. 2014;9(1): e85005 doi: 10.1371/journal.pone.0085005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Odagiri Y, Ohya Y, Inoue S, Hayashi T, Uchiyama A, Takamiya T, et al. [Reliablity and validation of the Japanese version of the measure of workplace social capital scale]. San Ei Shi. 2010;52(Suppl.): 631. Japanese. [Google Scholar]
  • 32.Karasek RA. Job content questionnaire and user’s guide. Lowell: University of Massachusetts; 1985.
  • 33.Kawakami N, Kobayashi F, Araki S, Haratani T, Furui H. Assessment of job stress dimensions based on the job demands-control model of employees of telecommunication and electric power companies in Japan: Reliability and validity of the Japanese version of the Job Content Questionnaire. Int J Behav Med. 1995;2(4): 358–375. doi: 10.1207/s15327558ijbm0204_5 [DOI] [PubMed] [Google Scholar]
  • 34.Siegrist J, Wege N, Pühlhofer F, Wahrendorf M. A short generic measure of work stress in the era of globalization: Effort-reward imbalance. Int Arch Occup Environ Health. 2009;82(8): 1005–1013. doi: 10.1007/s00420-008-0384-3 [DOI] [PubMed] [Google Scholar]
  • 35.Kurioka S, Inoue A, Tsutsumi A. Optimum cut-off point of the Japanese short version of the Effort-Reward Imbalance Questionnaire. J Occup Health. 2013;55(5): 340–348. [DOI] [PubMed] [Google Scholar]
  • 36.Moorman RH. Relationship between organizational justice and organizational citizenship behaviors: Do fairness perceptions influence employee citizenship? J Appl Psychol. 1991;76(6): 845. [Google Scholar]
  • 37.Elovainio M, Kivimäki M, Vahtera J. Organizational justice: Evidence of a new psychosocial predictor of health. Am J Public Health. 2002;92(1): 105–108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Inoue A, Kawakami N, Tsutsumi A, Shimazu A, Tsuchiya M, Ishizaki M, et al. Reliability and validity of the Japanese version of the Organizational Justice Questionnaire. J Occup Health. 2009;51: 74–83. [DOI] [PubMed] [Google Scholar]
  • 39.Wang Y. Mission-driven organizations in Japan: Management philosophy and individual outcomes. J Bus Ethics. 2011;101(1): 111–126. doi: 10.1007/s10551-010-0712-x [Google Scholar]
  • 40.Schaufeli WB, Bakker AB, Salanova M. The measurement of work engagement with a short questionnaire: A cross-national study. Educ Psychol Meas. 2006;66: 701–716. [Google Scholar]
  • 41.Shimazu A, Schaufeli W, Kosugi S, Suzuki A, Nashiwa H, Kato A, et al. Work engagement in Japan: Validation of the Japanese version of the Utrecht Work Engagement Scale. Appl Psychol. 2008;57: 510–523. doi: 10.1111/j.1464-0597.2008.00333.x [Google Scholar]
  • 42.Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32: 959–976. [DOI] [PubMed] [Google Scholar]
  • 43.Furukawa TA, Kawakami N, Saitoh M, Ono Y, Nakane Y, Nakamura Y, et al. The performance of the Japanese version of the K6 and K10 in the World Mental Health Survey Japan. Int J Methods Psychiatr Res. 2008;17: 152–158. doi: 10.1002/mpr.257 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Van Bogaert P, van Heusden D, Timmermans O, Franck E. Nurse work engagement impacts job outcome and nurse-assessed quality of care: Model testing with nurse practice environment and nurse work characteristics as predictors. Front Psychol. 2014;5(1261). doi: 10.3389/fpsyg.2014.01261 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Oshio T. The association between individual-level social capital and health: Cross-sectional, prospective cohort and fixed-effects models. J Epidemiol Community Health. 2016;70(1): 25–30. doi: 10.1136/jech-2015-205962 [DOI] [PubMed] [Google Scholar]
  • 46.Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 1979;86(2): 420–428. [DOI] [PubMed] [Google Scholar]
  • 47.de Vet HC, Beckerman H, Terwee CB, Terluin B, Bouter LM. Definition of clinical differences. J Rheumatol. 2006;33(2): 434 [PubMed] [Google Scholar]
  • 48.Kobayashi T, Suzuki E, Oksanen T, Kawachi I, Takao S. The bright side and dark side of workplace social capital: opposing effects of gender on overweight among Japanese employees. PLoS One. 2014;9(1):e88084 doi: 10.1371/journal.pone.0088084 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Bae K, Chung C. Cultural values and work attitudes of Korean industrial workers in comparison with those of the United States and Japan. Work Occup. 1997;24(1): 80–96. [Google Scholar]
  • 50.Tsuboya T, Tsutsumi A, Kawachi I. Change in psychological distress following change in workplace social capital: Results from the panel surveys of the J-HOPE study. Occup Environ Med. 2015;72(3): 188–194. doi: 10.1136/oemed-2014-102427 [DOI] [PubMed] [Google Scholar]
  • 51.Oshio T, Inoue A, Tsutsumi A. The mediating and moderating effects of workplace social capital on the associations between adverse work characteristics and psychological distress among Japanese workers. Ind Health. 2014;52(4): 313–323. doi: 10.2486/indhealth.2014-0032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Schaubroeck J, Lam SSK, Xie JL. Collective efficacy versus self-efficacy in coping responses to stressors and control: A cross-cultural study. J Appl Psychol. 2000;85(4):512–25. doi: 10.1037/0021-9010.85.4.512 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Data is not suitable for public deposition due to ethical concerns. The data set is under processing to be suitable for public deposition to meet the revised Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects. The data set is managed by the data management committee on J-SHINE and J-HOPE. Researchers who have an interest in the analysis using J-HOPE data, please contact Prof. Akizumi Tsutsumi, who is one of the data managing committee members and are responsible for the J-HOPE data, akizumi@kitasato-u.ac.jp.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES