Skip to main content
PLOS One logoLink to PLOS One
. 2024 Mar 19;19(3):e0300182. doi: 10.1371/journal.pone.0300182

Examination of the structural components of the Abilitator–A self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position

Miia Wikström 1,2,*, Anne Kouvonen 2,3, Jouko Remes 4, Kaisa Törnroos 1, Matti Joensuu 1
Editor: Leona Cilar Budler5
PMCID: PMC10950251  PMID: 38502655

Abstract

Objectives

According to the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel, structural validity describes how well Patient-Reported Outcome Measures’ (PROM) scores reflect the dimensions of the measured construct. The main purpose of this study was to examine the structural components of the Abilitator, a co-developed self-report questionnaire on work ability and functioning for the population in a weak labour market position.

Methods

We examined to what extent the Abilitator has reflective and formative elements in its five summary scales: “C. Inclusion”, “D. Mind”, “E. Everyday life”, “F. Skills”, and “G. Body”. The Abilitator data sample (n = 4555, men 51%, mean age 37 years) was collected in 2017–2022 by the Finnish Institute of Occupational Health in cooperation with the European Social Fund Priority 5 projects in which the participants have multiple challenges to gain employment. For the structural components and validity analysis we implemented both Confirmatory Factor Analysis (CFA) and Exploratory Factor Analysis (EFA).

Results

Based on the COSMIN criteria for structural validity, the Abilitator reached approximate model fit with CFA when we analysed the different concepts of the questionnaire separately rather than in one unified model. An exception was “E. Everyday life” which was a formative summary scale, and it did not reach approximate fit. EFA showed that the items in the Abilitator’s summary scales loaded on ten factors.

Conclusions

The Abilitator had both reflective and formative elements in its structure. It reached structural validity in those separate concepts that were based on a reflective model. This study revealed interesting connections between different aspects of the Abilitator and produced valuable information for further modification of the questionnaire.

Introduction

The population’s health and quality of life would both improve if there were less unemployment [1]. Minimizing long-term unemployment could also increase social inclusion and equality in working life and reduce marginalization [2–4]. Therefore, measures to promote employment should be a societal priority [1].

However, many working-age people face persistent difficulties finding sustainable employment. This may be due to a migrant background, low-level education or skills, short work history, chronic health problems, disabilities, prolonged unemployment, living in a rural area, or being young or old [5–7]. These people are in a weak labour market position and could benefit from individually designed measures to support their participation in employment [6, 8].

In most Western European welfare states, the working-age population has access to a wide range of services to support their employment, education, health, and well-being. To assess which services might be the most suitable for each individual, we need validated, multi-professionally usable, quickly managed, and easily interpreted instruments. Alongside non-patient-reported assessments carried out by clinicians or service professionals, the use of Patient-Reported Outcome Measures (PROMs) has become popular [9–12]. PROMs are self-report questionnaires for individuals to assess their own situation in terms of health, health-related quality of life, and life situation [13–18]. The work ability and functioning of the unemployed are important aspects to consider as they are known to have poorer health and work ability than those who are in employment [19–21]. For example, in Finland, health and work ability problems are estimated to be an obstacle to employment for 45% of the unemployed population [5].

Work ability is a multidimensional concept that combines health, functioning, basic skills, and the occupationally relevant attributes required for executing work tasks in an acceptable work environment [22, 23]. It also contains elements related to the individuals’ social networks and opportunities in their living environment [23]. Functioning is integrally linked to health and includes psychological, social, physical, and cognitive dimensions [24, 25].

At present only a few validated PROMs for the multidimensional assessment of work ability and functioning are aimed at the population in a weak labour market position [26–28]. The Abilitator® self-report instrument was developed in part to fill this gap. The Abilitator is a digital questionnaire that produces an individual report with written feedback and suggests further actions for maintaining or improving work ability and functioning. It is an indicative rather than a diagnostic instrument. It can be described as a “resource-oriented work ability mapping tool” for the general, non-observable work ability-related aspects that should be considered when building one’s path towards employment [29]. On the one hand, the Abilitator helps unemployed individuals identify their strengths and challenges in terms of their work ability and functioning. On the other hand, by producing valuable information it helps service professionals suggest the most effective means to support their clients’ transition towards employment [29, 30].

A PROM can be considered of high-quality when it is valid, reliable, responsive, and interpretable [31]. Previous studies on the Abilitator’s content validity [29], concurrent validity [32], and intrarater test-retest reliability [33] have supported the view that the Abilitator is a high-quality self-report questionnaire. However, further evidence of its psychometric properties is required. By examining the internal structure of the Abilitator we can obtain further information on how the different concepts and items in the instrument are related to each other.

The Abilitator’s conceptual model on work ability, i.e., the theoretical model of how different constructs within its concepts are related [31] is based on the multi-dimensional theory of the Work Ability House [23]. This theory constructs work ability as the dynamic balance between individual-related resources such as health, functioning, motivation and skills, and the operational environment such as social networks and service structure [23, 34]. The model also covers elements related to work, working conditions, colleagues, and leadership. However, the Abilitator does not include these work-related aspects, because the majority of individuals in a weak labour market position are not in employment. Within work ability, the conceptual model of functioning is viewed as biopsychosocial [24].

In addition to being a self-report tool for work ability and functioning, the Abilitator was developed for a variety of other purposes, including setting individual goals in different areas of life, and tracking their achievement. To meet these needs, the Abilitator combines both existing questionnaires and some new questions into one self-report questionnaire [29]. The Abilitator’s conceptual framework i.e., the model representing the relationships between the items and the construct to be measured [31] has both reflective and formative elements. This means that the underlying model for some of the constructs in the Abilitator are reflected by all its items, and other constructs are formed because of the items they include. The items in the formative constructs do not always correlate with each other [31, 35]. For example, many different situations and circumstances might affect concepts such as coping in everyday life, but they do not all need to exist at the same time.

A measurement theory describes how the scores produced by the items represent the construct to be measured [31]. This theory is especially important with multi-item instruments, which contain several indirectly measured unobservable items [31]. The Abilitator’s underlying measurement theory is the Classical Test Theory (CTT) [36]. This means that in the constructs that are based on a reflective model, the information is obtained by measuring the items that display the construct. However, no well-developed theories are available for the constructs that are based on a formative model. These constructs are based on common sense [31].

According to the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel’s taxonomy, construct validity is one of the main elements when assessing a PROM’s measurement properties [37]. Construct validity is defined as the degree to which the scores of a measurement tool are consistent with the presumed construct in terms of the internal relationships, with the scores of other tools, or with the differences between the groups [31, 37]. It is assessed when no gold standard is available [31] and when abstract variables such as social inclusion or coping with everyday life are observed [38].

Structural validity is a subtype of construct validity [31]. It describes how well the PROM’s scores reflect the dimensions of the measured construct [37]. It has been proposed that structural validity is not pertinent for all types of PROMs [35]. When a self-report tool is based on a reflective model and has effect indicators, i.e., items that are highly correlated, interchangeable and all indicate the same underlying construct, the assessment of structural validity is important. In contrast, structural validity is not relevant when a PROM is based on a formative model in which the items form the construct and are not necessarily correlated [35].

As the Abilitator has both formative and reflective elements in its conceptual framework, a structural validity assessment is not essential. However, we wanted to determine how reflective the Abilitator’s summary scale elements are. It has also been recommended that when an instrument already exists and has a mixed conceptual framework, it should be considered a reflective model [35].

The overall aim of this study was to examine the internal structure and structural validity of the Abilitator. This aim was achieved.

Materials and methods

The Abilitator self-report questionnaire

The Abilitator was co-developed in 2014–2017 at the Finnish Institute of Occupational Health (FIOH) in “The Social Inclusion and the Change of One’s Work Ability and Capacity” (Solmu), a national coordination project funded by the European Social Fund (ESF) Priority 5 programme (2014–2023) [29, 32, 33, 39]. One of the main aims of the ESF Priority 5 programme was to improve the social inclusion, work ability, and functioning of those in a weak labour market position [40]. Solmu’s target was to jointly develop a PROM ‘The Abilitator’, which would evaluate both the work ability and functioning of those participating in the national Priority 5 projects and detect any changes after the projects [29]. In addition to the ESF projects in Finland, the Abilitator has been used in research [8, 41, 42] and in employment, health, and social services to support primary-level decision-making when large numbers of clients meet professionals with various occupational backgrounds [43, 44].

The Abilitator contains 84 items under nine domains (sections): “A. Personal details”, “B. Well-being”, “C. Inclusion”, “D. Mind”, “E. Everyday life”, “F. Skills”, “G. Body”, “H. Background information”, and “I. Work and the Future” [29, 32, 33]. Each section contains 4–14 items (S1 Appendix). The measure of each of the five reported sections C, D, E, F, and G is a summary scale, transformed into a score of 0% to 100% of the selected items (Fig 1, Table 1). The smallest detectable changes in the Abilitator’s summary scale scores are presented in Wikström et al. [33]. The qualitative data is gathered from all the questions in sections A, H, I, and in separate questions of C9-C13, F4, G2, G3, G8, G9-G12. These questions are valuable for the respondents to reflect on, but they also provide useful additional information on the respondent’s situation for the service professionals.

Fig 1. The Abilitator’s domains, total number of items in each domain, items included in the summary scales, and summary scales included in the “Overall situation” score [33].

Fig 1

Table 1. Interpretation of the Abilitator’s results based on the summary scales included in the “Overall situation” score [30].

Poor (%) Fairly poor (%) Fairly good (%) Good (%)
C. Inclusion 0–23 25–48 50–73 75–100
D. Mind 0–22 25–56 58–70 71–100
E. Everyday life 0–23 25–48 50–73 75–100
F. Skills 0–48 50–60 61–73 75–100
G. Body 0–30 40–60 61–80 90–100

These sections are numerically valued on a scale of 0–100%

In this study, we examined the structural components of the summary scales formed from sections C, D, E, F, and G, which contain the dimensions of social functioning and participation, psychological functioning, managing in everyday life, cognitive functioning and basic skills, and physical functioning, respectively. The “Overall situation” score, which is the mean of the sums obtained from these five summary scales, was not included in the analysis. There are no limit values for this score and the obtained data is used by service professionals to monitor the overall change in the respondent’s work ability and functioning, for example, when the Abilitator is applied for the second time after an intervention. Also, sections A, H, and I were excluded from the analysis since they were developed to provide background information and do not form a summary scale. Even though the Abilitator is available in 10 different languages, in this study we only examined the original Finnish version.

Study sample

The entire Abilitator data (n = 54464) has been collected by FIOH in various services and projects aimed mainly for the unemployed. To ensure that the participants in this study were in a weak labour market position, the sample utilized in this study (n = 4555) was collected in cooperation with the European Social Fund Priority 5 projects in 01.10.2017–31.12.2022. Each project (n = 150) gave written consent to FIOH to use their Abilitator data in an anonymous format in its research. All the Abilitator respondents in the data were participants in the ESF Priority 5 projects, which aim to improve the work ability and functioning of people not in employment to help them proceed on employment paths and to strengthen social inclusion [40]. In each project the participants took part in activities such as cooking, gardening, social interaction, light physical activity, and rehabilitative work tasks. The participants could choose whether to answer the questionnaire online via the Abilitator online service or in a paper format. In the latter case, the staff of each ESF project transferred the answers to the Abilitator online service with the permission of the respondent.

Research design

The structural examination of the Abilitator followed the guidelines of the COSMIN panel [31, 35]. These guidelines recommend the implementation of factor analysis (FA) to determine the dimensionality of the data based on item correlations [31]. In FA, the items that are highly correlated with each other can be grouped in one factor. The purpose of FA is to find the number of meaningful factors in data or in a construct. Of the FA types, the use of exploratory factor analysis (EFA) is suggested if the number of the dimensions in the instrument is not known beforehand. The use of confirmatory factor analysis (CFA) is recommended if the dimensions of the instrument are predetermined [31]. Because the latter was the case with the Abilitator, we carried out CFA to determine whether the collected data fits the assumed factor structure. In addition to this strictly confirmatory approach, an alternative model approach was taken to examine other models that would fit the Abilitator’s factor structure well [45]. After CFA it was also relevant to conduct EFA to discover how the Abilitator’s items loaded freely. We used Mplus software version 8 to conduct the CFA and EFA [46]. The same data sample was used for all the analyses, because EFA was not used to develop a reflective, unidimensional, data driven model, which should be confirmed in a separate sample.

Data analysis

In the CFA, we followed three phases: 1) preparation, 2) model testing and 3) reporting the results [47]. In the first phase, we prepared the data for the actual CFA analysis. The Abilitator data we used (n = 4555) consisted solely of the data collected from the ESF Priority 5 projects that had two or more participants. This included the individuals who had responded to the Abilitator in Finnish and were between 18 and 74 years old i.e., belonged to the labour force in Finland. The respondents who regularly used an aid when moving around were excluded. We described the study population by age, gender, self-rated health, perceived general functioning, perceived work ability and duration of unemployment.

After these preparations, we screened the data by clarifying the sample size and its variation. The recommended sample size for CFA is 3 to 15 times the number of variables [48]. To ensure sufficient variation, the data set should be over 400 cases, especially when the maximum likelihood with robust standard errors (MLR) method is used, with continuous non-normal data containing missing values [49]. We also searched the data for and reported missing response percentages and checked for multivariate outliers. In addition, we analysed the data set for possible floor and ceiling effects. These effects may occur if more than 15% of all responses score at the lower or upper end of the scales [31]. Both CFA and later EFA were conducted with multilevel modeling which considers the clustering of participants in specific ESF projects (TYPE = COMPLEX). Missing values were handled with the Missing data at random (MAR) option in Mplus. [46]. For EFA the type of rotation used was GEOMIN i.e., oblique rotation where the dimensions of the Abilitator were allowed to correlate [45, 46].

In the second phase of CFA, we conducted the model testing, which was further divided into five sub-phases: 1) specification, 2) identification, 3) estimation, 4) evaluation, and 5) modification [47]. In the specification phase, we selected the first model to be tested on the basis of the hypothesis that the summary scales of the Abilitator comprise 5 concepts and 44 selected items. We further selected the second set of models on the basis of the assumption that the Abilitator consists of five separate concepts with 3–12 items within each concept.

In the identification phase, we identified the tested models by fixing one loading in each concept (factor) to one as a reference variable and the rest to zero. Only those models that were identified could be estimated. If the model’s degrees of freedom (df) were over 0 the model was identified and if 0 it was just identified. If the model’s df was under 0 it was not identified.

In the estimation phase, we estimated the factor loadings and residual error terms for all the models using the MLR method (ESTIMATOR = MLR). In the evaluation phase, we analysed how well the selected models matched the data using five indicators: the Comparative Fit Index (CFI), the Tucker-Lewis Index (TLI), the Root Mean Square Error of approximation (RMSEA), the Standardized Root Mean Square Residual (SRMR) and the Chi-square (χ2) test. Of these, CFI and TLI are incremental fit indices and utilize the worst possible model (null model) as a basis for assessing how well the model fits [45]. The other extreme is the best possible model (saturated model). RMSEA, SRMR and χ2 are absolute fit indices for the whole model and are not compared with the null model [45]. The COSMIN cut-off limits for good model fit and measurement properties in CFA are CFI ≥0.95, TLI ≥0.95, RMSEA ≤0.06, SRMR ≤0.08, and χ2 should be p ≥0.05 [35]. However, if the measurement instrument is based on CTT, only one of these listed limits must be met to reach good measurement properties. In addition, the result of the χ2 test is not required [35].

In the modification phase, we further improved the tested models by utilizing the result of the EFA analysis, in which the data was allowed to load freely, and with the modification index (MI). MI is related to assessing the fixed parameters and is a tool for determining potential sources of model misfit [45]. With the knowledge of the highest MIs between the variables, we allowed some of the error terms to correlate to improve the model fit. For the EFA, factor loadings of ≥0.30 were considered substantial [31].

In the third phase of the CFA analysis, we reported the results for all the tested models with standardized values for factor loadings and error terms, correlations between concepts, and MIs in both graphic form and tables. The strength of the standardized factor loadings was considered sufficiently high if ≥0.5, but ideal if ≥0.7 [50]. For CFA we used STYDYX standardization which is recommended for continuous variables [46].

Ethics statement

The study was approved by the ethics board of the Finnish Institute of Occupational Health in June 2017. All the respondents had been given written information about the Abilitator’s data security and the possible later research use of the data in anonymous format. They had also all consented to this by voluntarily responding to the Abilitator self-report questionnaire.

Results and discussion

Study population characteristics

The study population (N = 4555, 51% men, 47% women and 2% other, mean age 37 years) was made up of participants of 150 different ESF Priority 5 projects (Table 2). Most had problems with their health, general functioning, and work ability. Eighteen per cent of the participants had been unemployed for less than a year, 21% for one to two years, 34% for three to ten years and 9% for over 10 years. Nine per cent of the participants had never worked and another 9% were in employment at the time of the questionnaire. In terms of the Abilitator’s score categories (Table 1), 23% of the participants had a poor or fairly poor situation in section “C. Inclusion”, 42% in “D. Mind”, 7% in “E. Everyday life”, 37% in "F. Skills”, and 37% in "G. Body”, respectively.

Table 2. Study population characteristics.

ESF Priority 5 (n = 4555)
n (%)
Gender Men 2319 (51)
Women 2159 (47)
Other 77 (2)
Age in years mean (min–max) 37.2 (18–72)
B2. Self-rated health 3.17
Mean (95% CI of mean, SD) (3.14–3.20, 1.04)
Poor or fairly poor (1–2 points) 1187 (26.1)
Average (3 points) 1691 (37.1)
Fairly good (4 points) 1157 (25.5)
Good (5 points) 516 (11.3)
B3. Perceived general functioning 6.54
Mean (95% CI of mean, SD) (6.47–6.60, 2.15)
Poor (0–5 points) 1412 (31)
Fairly poor (6–7 points) 1398 (30.7)
Good (8–9 points) 1454 (31.9)
Excellent (10 points) 291 (6.4)
B4. Perceived work ability 5.75
Mean (95% CI of mean, SD) (5.68–5.82, 2.53)
Poor (0–5 points) 1975 (43.4)
Fairly poor (6–7 points) 1295 (28.4)
Good (8–9 points) 1072 (23.5)
Excellent (10 points) 213 (4.7)

ESF, European Social Fund; CI, Confidence Interval; SD, Standard Deviation.

Confirmatory and exploratory factor analysis

In terms of variation, the sample size was large enough for CFA to be conducted. The requirement was either over 400 or 3–15 times the number of the analysed 44 variables i.e., 132 to 660. The percentages of missing values were 0.92% for the whole sample, 0.76% for “C. Inclusion, 1.81% for “D. Mind”, 0.73% for “E. Everyday life”, 0.52% for “F. Skills”, and 0.45% for “G. Body”. No floor or ceiling effects were found, as less than 15% of the responses per analysed item or summary scale scored at the lowest or highest score of the scale. Therefore, the data was considered continuous and normally distributed. In addition, there were no outliers in the sample since all items could be scored from 1 to 5.

The results of the first tested model and the separate models with partial modifications are presented separately in graphic form (Figs 2–7). The ovals represent independent latent variables (concepts), and the circles are independent latent error terms. The rectangles are the dependent measured items. The two-way arrows represent the correlation or covariance between variables and one-way arrows the standardized, unidirectional factor loadings. The goodness of fit indices are presented beside each graph and in Table 3. The Table 3 also presents the goodness of fit indices for an alternative model of the “F. Skills” without the Abilitator’s item E4 and the EFA with ten factors, which was the first well-fitting model.

Fig 2. Model with all the Abilitator’s five concepts together.

Fig 2

Fig 7. Separate model with the Abilitator’s concept “G. Body”.

Fig 7

Table 3. Goodness of fit indices in models tested with Confirmatory Factor Analysis (CFA) and Exploratory Factor Analysis (EFA).

Model χ2, p* df CFI TLI RMSEA SRMR
Five concepts in one model 18314.19, <0.001 895 0.81 0.80 0.07 0.06
C. Inclusion 1006.06, <0.001 50 0.96 0.95 0.07 0.03
D. Mind 558.29, <0.001 26 0.97 0.95 0.07 0.03
E. Everyday life 910.44, <0.001 41 0.93 0.91 0.07 0.04
F. Skills 721.27, <0.001 32 0.96 0.94 0.07 0.04
F. Skills without question E4 447.47, <0.001 24 0.97 0.96 0.06 0.03
G. Body 0, <0.001, saturated 0 N/A N/A N/A N/A
EFA with ten factors 3867.93, <0.001 551 0.96 0.94 0.04 0.01

χ2, Chi-squared test

p*, the pursued p-value for χ2 test >0.05; df, degrees of freedom; CFI, Comparative Fit Index; TLI = Tucker-Lewis Index; RMSEA, Root Mean Square Error of Approximation; SRMR, Standardized root mean Square Residual.

Fig 3. Separate model with the Abilitator’s concept “C. Inclusion” with partial modifications.

Fig 3

Fig 4. Separate model with the Abilitator’s concept “D. Mind”.

Fig 4

Fig 5. Separate model with the Abilitator’s concept “E. Everyday life”.

Fig 5

Fig 6. Separate model with the Abilitator’s concept “F. Skills” with partial modifications.

Fig 6

The Abilitator’s factor loadings with EFA are presented in Table 4. Most of the items in the original summary scales loaded substantially on one to four different factors, but items in “D. Mind” on six factors. Items D3, D9 and E4 did not load substantially on any of the 10 factors. Items C6, C15, D5, E3, F6, F7 and F9 loaded substantially on two factors.

Table 4. Exploratory factor analysis with ten factors.

F1 F2 F3 F4 F5 F6 F7 F8 F9 F10
C1 0.47 -0.11 0.01 0.22 0.01 0.04 0.01 0.11 -0.02 0.14
C2 0.74 0.04 0.02 0.03 -0.10 0.01 -0.03 -0.05 0.10 -0.09
C3 0.61 0.01 -0.02 0.16 0.12 -0.10 -0.00 0.06 0.04 0.13
C4 0.83 -0.02 -0.03 0.11 -0.03 -0.08 0.01 0.01 0.04 0.01
C5 0.57 0.00 0.04 -0.04 0.10 0.17 0.01 0.00 0.03 -0.01
C6 0.33 -0.00 0.13 0.05 0.32 0.12 -0.03 0.06 -0.12 0.06
C7 0.49 0.11 0.19 0.05 0.05 0.11 0.00 -0.01 -0.11 -0.00
C8 0.27 0.09 -0.00 0.49 0.05 0.04 0.01 -0.01 -0.09 -0.02
C14 0.10 0.02 0.04 0.58 0.00 -0.01 0.07 -0.02 0.03 0.04
C15 0.04 0.38 0.11 0.47 0.02 -0.00 0.04 -0.00 -0.02 -0.07
C16 0.05 0.87 0.01 0.09 0.02 -0.00 -0.02 0.01 -0.01 -0.02
C17 -0.03 0.84 0.03 0.02 -0.03 0.00 0.01 -0.00 0.04 0.07
D1 0.03 0.04 -0.03 -0.06 0.05 0.60 0.07 0.02 -0.03 0.01
D2 0.52 0.09 0.06 -0.05 0.07 0.20 0.08 -0.04 -0.00 -0.12
D3 0.20 0.01 0.01 0.03 0.19 0.15 0.29 0.06 -0.22 -0.02
D4 0.08 0.06 0.04 0.03 0.39 0.12 0.11 -0.01 0.07 -0.06
D5 0.07 0.04 0.03 0.01 0.44 -0.01 0.32 -0.02 -0.01 0.01
D6 0.23 0.12 -0.08 0.30 0.11 0.14 0.02 -0.02 0.07 -0.04
D7 0.02 0.04 0.02 0.05 0.71 0.02 0.03 0.01 0.01 0.10
D8 -0.00 0.06 0.28 -0.02 0.55 0.05 -0.04 0.00 0.05 -0.05
D9 0.20 -0.02 0.01 0.12 0.28 0.24 0.12 0.00 -0.00 -0.02
E1 -0.06 -0.02 0.63 0.06 0.05 0.06 0.04 0.15 -0.07 -0.02
E2 -0.03 0.03 0.71 -0.01 -0.04 0.06 0.05 0.07 -0.09 0.24
E3 0.04 0.08 0.67 -0.08 0.06 -0.03 0.06 -0.06 0.03 0.33
E4 0.03 -0.16 0.20 0.01 0.02 -0.03 0.23 0.03 0.24 0.29
E5 0.03 -0.10 0.44 -0.01 0.25 -0.12 0.11 -0.05 0.01 -0.03
E6 0.05 -0.00 0.53 0.05 0.14 0.00 0.04 0.15 -0.02 -0.26
E7 0.09 -0.01 0.47 -0.02 -0.03 0.04 0.14 0.05 -0.01 -0.22
E8 -0.04 -0.05 0.61 0.11 0.08 -0.04 -0.05 0.01 0.09 -0.08
E9 0.09 0.03 0.63 -0.01 0.07 -0.02 -0.08 -0.07 0.09 0.01
E10 0.05 0.12 0.61 0.01 -0.09 0.07 -0.00 0.08 0.00 0.20
E11 0.01 0.02 0.47 0.24 -0.03 0.04 -0.02 -0.02 0.19 0.05
F1 -0.05 0.01 0.18 0.07 0.09 0.01 0.60 -0.07 -0.00 0.01
F2 -0.01 0.02 -0.03 0.03 -0.04 0.07 0.66 0.03 0.23 0.08
F3 0.02 -0.00 0.15 0.00 0.01 -0.04 0.60 0.03 0.01 -0.08
F5 0.27 -0.01 0.09 0.01 0.00 0.61 0.03 0.00 0.02 0.00
F6 0.02 -0.05 0.01 0.11 -0.03 0.67 -0.04 0.01 0.37 0.05
F7 -0.04 0.01 0.06 0.08 0.08 0.53 -0.01 0.01 0.43 -0.06
F8 0.13 0.15 -0.02 -0.04 -0.01 0.23 0.17 0.04 0.38 -0.04
F9 0.03 0.46 0.01 0.00 0.15 -0.01 0.08 0.02 0.32 0.02
F10 0.04 0.13 0.01 -0.05 0.12 0.04 0.22 0.06 0.39 0.06
G1 0.09 0.05 0.13 -0.00 0.00 0.05 0.13 0.53 -0.00 -0.26
G4 -0.04 -0.02 0.07 0.00 -0.03 -0.01 -0.03 0.73 0.02 0.06
G6 0.00 0.00 -0.07 -0.02 0.03 -0.00 -0.00 0.86 0.04 -0.02

Factor loadings ≥ 0.30 are bolded

Discussion of the results

This study examined the structural components of the Abilitator, which is a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position. Our aim was to investigate to what extent the Abilitator has reflective elements in its five reported summary scales, and could structural validity be reached. The data used in the study was collected from the ESF Priority 5 projects, the aim of which is to support work ability, functioning and the overall well-being of those in a weak labour market position. The data corresponded to our prior expectations that the participants would belong to the target group; 64% were long-term unemployed, 63% had at least some health problems and 62% had problems functioning in everyday life. In addition, 72% perceived their work ability as fairly poor or poor. Therefore, the analyses in this study were conducted using the data sample from the intended population.

The models for CFA were specified based on two hypotheses: 1) All the concepts of the Abilitator can be analysed in the same model, and 2) All the concepts can be analysed as separate models. Both of these hypotheses were tested, and the results were compared to the COSMIN cut-off limits for the good model fit and measurement properties of CTT based instruments. The aim was to reach at least an approximate model fit i.e., that the analysed fit indices would fulfil at least acceptable or good criteria, but that in the χ2-test the p-value would not need to be over 0.05. It must also be noted that the χ2-test easily rejects models with samples larger than 500–600 [45]. The first model that tested all concepts in one model had reasonably high factor loadings of over 0.5 or 0.7, apart from the variable E4 in the “E. Everyday life” and “F. Skills” concepts. There were also high positive correlations among all the other concepts, except for “G. Body”. The SRMR was the only fit index to reach an acceptable value. This first model was too complex and did not have a sufficiently good fit with CFA.

The results for CFA were better with the second approach, in which we tested the Abilitator’s concepts as separate models with partial modifications. All the tested models had high factor loadings of over 0.5 or 0.7, except for item E4 in the “E. Everyday life” and “F. Skills” concepts. The tested second-order factor model for the “C. Inclusion” concept had high factor loadings and reached an approximate fit. With concept “D. Mind” the first-order factor model with letting one pair of error terms to correlate based on the MIs also reached an approximate fit. Similarly, for the”F. Skills” concept, the second-order factor model also resulted in an approximate fit. For this concept we also tested an alternative model without item E4, which is usually counted in its summary scale. This new model reached a very good fit, which means that the concept “F. Skills” could also be used separately without item E4.

The concept “E. Everyday life” with the first-order factor model did not reach an approximate fit even after allowing three error terms to correlate on the basis of the MIs. On the one hand, the result indicates that this concept might need remodelling. On the other hand, this concept might also be formative in nature and therefore the CFA results can be ignored. The concept “C. Everyday life” is a combination of different aspects that are all related to coping with everyday activities, but they do not all need to be present at the same time for a person to find daily coping challenging. Therefore, we can assume that this concept might be based on a formative model. The model that tested the concept “G. Body” was saturated. This means that the model estimated as many parameters as there were pieces of information in the data and therefore the fit was perfect. In this case CFA did not produce a clear result. However, we were able to observe the factor loadings for this model and found that they were either acceptable or high.

The EFA showed that a well-fitting model of the Abilitator had ten different latent dimensions. We made some interesting observations when examining the factor loadings of the Abilitator’s original summary scale items, i.e., which items were highly correlated and clustered in one factor. First, it was evident that some of the items in the two summary scales had similar contents. This was the case with item D1 “I’ve been feeling positive about the future” which clustered in the same factor with F5, F6 and F7 which also contained statements about the future, but from a slightly different perspective. The same was true for item C6 “I am in charge of the course of my life” which clustered with some parts of the original summary scale “C. Inclusion” but also with D4, D5, D7, and D8 which contained aspects of dealing with problems and life control. Second, it was interesting to notice that item F8 “I am able to verbally express myself in different situations” loaded on both the original summary scale “F. Skills” and on C15, C16, and C17, which contained aspects of socializing and friendships. The ability to express oneself verbally was connected to social relationships. Third, psychological well-being seems to be a comprehensive element of work ability and functioning in our study population, as the items in summary scale “D. Mind” clustered with many parts of “C. Inclusion” i.e., social inclusion, social relationships but also with some parts of skills “F. Skills” i.e., cognitive functioning and hopes for the future. This is supported by the literature as we know that unemployment impairs mental health and well-being [1, 51]. Mental disorders, neurological disabilities and substance abuse challenges have also been associated with low work ability in the unemployed [7, 52]. In contrast, good social relationships and experiencing life as meaningful support maintaining work ability in unemployment [53].

The result of EFA can also be viewed from the perspective of both the multidimensional model of work ability [22, 23] and the biopsychosocial model of functioning [24, 25], on which the Abilitator’s underlying theory is based on [29]. In our previous study [29] the items of the Abilitator were linked to the World Health Organization’s International Classification of Functioning, Disability and Health (ICF), which provides a framework to describe and organize information on health-related states [24]. ICF is based on the biopsychosocial model, which provides a holistic understanding of functioning as interactions between different perspectives of health conditions i.e., diseases, disorders, and injuries, and contextual factors i.e., external environmental factors such as climate or social attitudes, and internal personal factors such as age or education [54]. ICF further classifies three levels of functioning: 1) at the level of body or body part, 2) the whole person, and 3) the whole person in a social context. All these levels are interconnected and therefore each disability can be associated with impairments, activity limitations, and restrictions in participation in day-to-day life [54]. In this study, from the Abilitator’s ICF codes’ point of view [29], the connection between the ability to express oneself verbally (d350 conversation) and socializing and friendships (e.g., d750 informal social relationships) can be seen as a logical result as verbal communication is usually an essential a part of social relationships. In addition, the clustering of psychological well-being (e.g., b152 emotional functions) with not just social inclusion (e.g., d7101 appreciation in relationships) and social relationships (e.g., d7500 informal relationships) but also with cognitive functioning (e.g., d160 focusing attention) and future hopes (b1265 optimism) supports the theory of ICF that a human being is a holistic entity [54].

Significance of the results

This study revealed that the Abilitator is more a combination of separate sets of questions on different aspects of work ability and functioning than one unified questionnaire. The “C. Inclusion”, “D. Mind”, and “F. Skills” concepts had acceptable structural validity [35]. The concept “G. Body” could also be considered reflective, even though the tested model was saturated. The concept “E. Everyday life” was formative in nature and reaching structural validity was thus not relevant. From a practical point of view, this study supports the possibility to utilize the different sections of the Abilitator also separately. In addition, as the section “E. Everyday life” was formative, the responses to each item in this section should be viewed separately as the result of this summary scale does not necessarily reflect different aspects that might be challenging for the respondents in their daily life.

The results of this study support the basic idea of the development of the Abilitator in that the items in its concepts were based more on a theory and their usefulness in practice than on a data-driven approach, in which the items are selected to reflect a single well-defined latent trait [29]. Therefore, each concept of the Abilitator can be interpreted as a sensible, meaningful combination of items of wide-ranging conceptual categories, derived from input from both the professionals and those in weak labour market position. This approach is also supported by Coulter [13], who recommends considering what really matters to the respondents when developing PROMs.

This study also revealed opportunities to further modify the internal structure of the Abilitator. For example, the questionnaire could be made shorter and therefore easier for the respondents to fill in and for the service professionals to interpret. Item reduction could be conducted to form a shorter PROM that includes only those items that reflected the Abilitator’s dimensions the strongest. However, this further development would need to be carried out carefully, without jeopardizing the relevance of the questionnaire to the respondents and its reflection of their situation from different perspectives. An example of such is item “E4. Using the internet, searching for information”, which did not reflect substantially either the section “E. Everyday life” or “F. Skills” even though the item counts as a part of both scales. However, difficulties with digital skills can hinder functioning in contemporary society, including in the labour market and employment.

Strengths and limitations

The main strength of this study was the carefully conducted examination of the structure of the Abilitator and the structural validation process, which was based on the widely accepted COSMIN methodology [31, 35]. Our study design followed each step of the recommended process for CTT based PROMs of which the underlying theory and the dimensions of the instrument were predetermined. We applied both CFA and EFA to examine the Abilitator’s structure and analysed the results based on COSMIN’s criteria for good measurement properties. At the end of the analysis, we viewed the COSMIN bias checklist for structural validity studies [35]. We confirmed that the sample size was adequate i.e., seven times the number of items and n≥100. We have described the study design and statistical methods used in sufficient detail. The COSMIN guidelines also encourage to conduct internal consistency analysis alongside the structural validity examination phase [35]. We had already successfully implemented the internal consistency analysis with the same items and sections in our previous study on the Abilitator’s test-retest reliability [33]. However, the sample in that study was partly different containing also groups of unemployed individuals slightly closer to the labour market threshold. In the future, we could conduct the internal consistency analysis again with the data sample used in the present study.

However, there are also limitations. The main limitation of this study related to the context of the target population. The study was conducted only with specific data sample collected in Finland and with individuals responding to the Finnish version of the Abilitator. Therefore, the results of this study apply only to the Finnish context. Moreover, the population in the weak labour market position is very heterogenous. In the future, we could repeat the procedures of this study with other subgroups of the unemployed and those responding to the Abilitator in other languages. In addition, those who regularly use an aid when moving around could be studied as a separate subgroup. However, the sample size has not yet been large enough to conduct these subgroup analyses to reach the COSMIN criteria.

Conclusions

For a co-developed multidimensional self-report questionnaire such as the Abilitator, it might be difficult to reach approximate model fit in one unified model, but this is possible when the questionnaire’s different concepts are analysed separately. As hypothesized, the Abilitator had both reflective and formative elements. Structural validity was reached in the separate concepts that were based on a reflective model. If the Abilitator is revised, shortening the questionnaire could be beneficial for its quicker implementation and interpretation. This study provided valuable information for the possible item reduction to be conducted in the future.

Supporting information

S1 Appendix. The Abilitator questionnaire.

(PDF)

pone.0300182.s001.pdf (983.3KB, pdf)

Acknowledgments

We honour the memory of our colleagues Kaisa Törnroos and Jouko Remes, who both very sadly and tragically died before the final version of this manuscript was submitted. Both were actively involved in the preparation of this paper and are listed as co-authors. Miia Wikström accepts responsibility for the integrity and validity of the data collected and analyzed.

Data Availability

The data does not include the variable for the identification of specific ESF projects, which is used for clustering the participants in the analyses of the present article. In addition, the data does not include any demographic information such as the participants’ age, gender, or duration of unemployment. These particular pieces of information were considered to compromise the anonymity of the participants in the review process of the data sharing protocol conducted by the Finnish Institute of Occupational Health (FIOH). Therefore, the analyses of this paper cannot be fully replicated with the open data. To fully replicate the analyses of this study, one piece of the additional information is needed i.e., the variable for the identification of specific ESF projects, which is used for clustering the participants. This data can be requested from the FIOH's data protection officer via email: dpo@ttl.fi The demographic information i.e., the participants’ age, gender, or duration of unemployment are merely background information to describe the study population and play no role in the actual data analysis. In questions concerning data availability from FIOH, more information is available: https://www.ttl.fi/en/privacy-notice/data-permits-for-datasets-of-the-finnish-institute-of-occupational-health Data can be requested and other information concerning the data enquired from the FIOH's data protection officer via email: dpo@ttl.fi.

Funding Statement

This study was conducted by the Finnish Institute of Occupational Health’s project ‘Social Inclusion and the Change of One’s Work Ability and Capacity’ (2014-2023). The study was was funded by the European Social Fund (ESF) grant number S20237. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Paul K, Moser K. Unemployment impairs mental health: Meta-analyses. Journal of Vocational behavior. 2009;74: 264–82. 10.1016/j.jvb.2009.01.001 [DOI] [Google Scholar]
  • 2.Tøge A, Blekesaune M. Unemployment transitions and self-rated health in Europe: A longitudinal analysis of EU-SILC from 2008 to 2011. Social Science & Medicine. 2015;143: 171–8. doi: 10.1016/j.socscimed.2015.08.040 [DOI] [PubMed] [Google Scholar]
  • 3.Robroek S, Schuring M, Crozen S, Stattin M, Burdorf A. Poor health, unhealthy behaviors, and unfavorable work characteristics influence pathways of exit from paid employment among older workers in Europe: a four-year follow-up study. Scandinavian Journal of Work, Environment &Health. 2013; 39(2): 125–33. doi: 10.5271/sjweh.3319 [DOI] [PubMed] [Google Scholar]
  • 4.Schuring M, Robroek S, Otten F, Arts C, Burdorf A. The effect of ill health and socioeconomic status on labor force exit and re-employment: a prospective study with ten years follow-up in the Netherlands. Scandinavian Journal of Work, Environment & Health. 2013; 39(2):134–43. doi: 10.5271/sjweh.3321 [DOI] [PubMed] [Google Scholar]
  • 5.OECD. Faces of Joblessness in Finland. A People-centered Perspective on Employment Barriers and Policies. 2020. Available from: Faces of joblessness in Finland: A people-centred perspective on employment barriers and policies | en | OECD [Google Scholar]
  • 6.Oivo T, Kerätär R. Osatyökykyisten reitit työllisyyteen -etuudet, palvelut, tukitoimet. [The paths of the partly disabled to employment–benefits, services, and support]. Report 43. Ministry of Social Affairs and Health: Helsinki; 2018. Finnish. Available from: http://urn.fi/URN:ISBN:978-952-00-3997-4 [Google Scholar]
  • 7.Kerätär R. You’ll see more when you look from a distance. Multidimensional assessment of work ability and needs for rehabilitation among long-term unemployed. PhD thesis. Acta Universitatis Ouluensis D Medica 1340. 2016. Available from: http://urn.fi/urn:isbn:9789526210865 [Google Scholar]
  • 8.Saikku P, Joensuu M, Männistö-Inkinen V, Poutanen J (eds.) “Here nobody says that it’s not our business” Final report of the Work Ability Programme Evaluation Study. Finnish Institute for Health and Welfare (THL). Report 2/2023. 141 pages. Helsinki: 2023. Available from: https://urn.fi/URN:ISBN:978-952-408-023-1 [Google Scholar]
  • 9.PROMIS®. PROMIS Health Organization. [cited 2023 Aug 9] [Google Scholar]
  • 10.National Health Service (NHS). https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/patient-reported-outcome-measures-proms [cited 2023 Aug 9]
  • 11.Canadian Institute for Health Information. Patient-reported outcome measures (PROMs) | CIHI [cited 2023 Aug 9] [Google Scholar]
  • 12.Finnish Institute for Health and Welfare (THL). The Finnish TOIMIA network: https://thl.fi/en/web/functioning. [cited 2023 Aug 9] [Google Scholar]
  • 13.Coulter A. Measuring what matters to patients. OECD Health ministers commit to patient reported measures of performance. BMJ. 2017; 356:1–2. doi: 10.1136/bmj.j816 [DOI] [PubMed] [Google Scholar]
  • 14.Weldring T, Smith S. Article Commentary: Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Services Insights. 2013; 6:61–68. 10.4137/HSI.S11093 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Brodersen J, Doward L, Thorsen H, Mckenna S. Writing Health-Related Items for Rasch Models–Patient-Reported Outcome Scales for Health Sciences: From Medical Paternalism to Patient Autonomy. In Rasch Models in Health (eds Christensen K.B, Kreiner S and Mesbah M). 2012. 10.1002/9781118574454.ch15 [DOI] [Google Scholar]
  • 16.Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr A. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010;340:c186 doi: 10.1136/bmj.c186 [DOI] [PubMed] [Google Scholar]
  • 17.Lohr K, Zebrack B. Using patient-reported outcomes in clinical practice: challenges and opportunities. Quality of Life Research. 2009;18: 99–107 doi: 10.1007/s11136-008-9413-7 [DOI] [PubMed] [Google Scholar]
  • 18.Valderas J, Kotzeva A, Espallargues M, Gyatt G, Ferrans C, Halyard M, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Quality of Life Research. 2008;17;179–193 doi: 10.1007/s11136-007-9295-0 [DOI] [PubMed] [Google Scholar]
  • 19.Hult M, Pietilä A-M, Koponen P, Saaranen T. Good work ability among unemployed individuals: Association of sociodemographic, work-related and well-being factors. Scandinavian Journal of Public Health.2018;46(3):375–381. doi: 10.1177/1403494817720103 [DOI] [PubMed] [Google Scholar]
  • 20.Szlachta E, Gawlik-Chmiel B, Kallus K. Do the long-term unemployed regard themselves as able to work? Journal of Public Health. 2012; 20:505–11. 10.1007/s10389-012-0505-z [DOI] [Google Scholar]
  • 21.Pensola T, Järvikoski A, Järvisalo J. Unemployment and work ability. In: Dimensions of Work Ability. Results of the Health 2000 Survey. Gould R, Ilmarinen J, Järvisalo J, Koskinen S, editors. Helsinki: Finnish Centre for Pensions, The Social Insurance Institution, National Public Health Institute, Finnish Institute of Occupational Health; 2008. pp. 123–130. [Google Scholar]
  • 22.Tengland P-A. The concept of work ability. Journal of Occupational Health. 2011; 21:275–85. doi: 10.1007/s10926-010-9269-x [DOI] [PubMed] [Google Scholar]
  • 23.llmarinen J, Gould R, Järvikoski A, Järvisalo J. Diversity of Work Ability. In: Dimensions of Work Ability. Results of the Health 2000 Survey. Gould R, Ilmarinen J, Järvisalo J, Koskinen S, editors. Helsinki: Finnish Centre for Pensions, The Social Insurance Institution, National Public Health Institute, Finnish Institute of Occupational Health; 2008. pp. 13–23. [Google Scholar]
  • 24.World Health Organization (WHO). How to use the ICF. A Practical Manual for using the International Classification of Functioning, Disability and Health (ICF). Geneva. WHO; 2013. Available from: How to use the ICF—A Practical Manual for using the International Classification of Functioning, Disability and Health (who.int) [Google Scholar]
  • 25.Painter P, Steward A, Carey S. Physical Functioning: Definitions, Measurement, and Expectations. Advances in Renal Replacement Therapy. 1999;6(2):110–23. doi: 10.1016/s1073-4449(99)70028-2 [DOI] [PubMed] [Google Scholar]
  • 26.Finger M, Escorpizo R, Bostan C, De Bie R. Work Rehabilitation Questionnaire (WORQ): development and preliminary psychometric evidence of an ICF-based questionnaire for vocational rehabilitation. Journal of Occupational Rehabilitation. 2014;24(3):498–510. doi: 10.1007/s10926-013-9485-2 [DOI] [PubMed] [Google Scholar]
  • 27.Üstün T, Kostanjsek N, Chatterji S, Rehm J (eds.). Measuring Health and Disability: Manual for WHO Disability Assessment Schedule: WHODAS 2.0. Geneva: World Health Organization; 2010. Available from: Measuring health and disability: manual for WHO Disability Assessment Schedule (‎WHODAS 2.0)‎ / edited by T.B. Üstün, N. Kostanjsek, S. Chatterji, J.Rehm [Google Scholar]
  • 28.Tuomi K, Ilmarinen J, Jahkola M, Katajarinne L, Tulkki A. Työkykyindeksi [Work Ability Index]. Työterveyshuolto 19. Helsinki: Finnish Institute of Occupational Health; 1997. Finnish. [Google Scholar]
  • 29.Wikström M, Anttila H, Savinainen M, Kouvonen A, Joensuu M. Development and content validity of the Abilitator: a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position. BMC Public Health. 2020; 20 (327) 10.1186/s12889-020-8391-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Wikström M, Unkila K, Räsänen H. The Abilitator handbook: Utilisation of the Abilitator self-report method in client work and service impact assessment. Finnish Institute of Occupational Health; 2023. https://urn.fi/URN:ISBN:978-952-391-122-2 [Google Scholar]
  • 31.de Vet H, Terwee C, Mokkink L, Knol D. Measurement in Medicine. A Practical guide. Cambridge: University Press; 2011. [Google Scholar]
  • 32.Savinainen M, Jauhiainen O, Heikkilä H, Joensuu M. The concurrent validity of the Abilitator: a self-assessment questionnaire on functioning and work ability. Journal of Public Health (Berl.). 2020. 10.1007/s10389-020-01438-1 [DOI] [Google Scholar]
  • 33.Wikström M, Kouvonen A, Joensuu M. Intrarater reliability of the Abilitator—a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position: a test–retest study BMJ Open 2021;11:e057295. 10.1136/bmjopen-2021-057295 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ilmarinen J, Tuomi K, Seitsamo J. New dimensions of work ability. International Congress Series. 2005; 1280: 3–7. 10.1016/j.ics.2005.02.060 [DOI] [Google Scholar]
  • 35.Mokkink L, Prinsen C, Patrick D, Alonso J, Bouter L, de Vet H, Terwee C. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs). User manual version 1.0. COSMIN; 2018. Available from: https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Lord F, Novick M. Statistical theories of mental test scores. Reading, MA. Addison-Wesley; 1968. [Google Scholar]
  • 37.Mokkink L, Terwee C, Patrick D, Alonso J, Stratford P, Knol D, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology 2010. Jul;63(7):737–45. doi: 10.1016/j.jclinepi.2010.02.006 [DOI] [PubMed] [Google Scholar]
  • 38.Steiner D, Norman G. Health Measurement Scales. A Practical Guide to Their Development and Use. Second Edition. Oxford University Press; 1995. [Google Scholar]
  • 39.The Abilitator ® Kykyviisari | Työterveyslaitos (ttl.fi) [cited 2023 August 18]
  • 40.European Social Fund (ESF) Programme for Sustainable Growth and Jobs. Social inclusion and combating poverty (ESF)—Rakennerahasto (ware.fi) [cited 2023 Aug 9] [Google Scholar]
  • 41.Savinainen M, Seitsamo J, Joensuu M. The association between changes in functional capacity and work ability among unemployed individuals. International Archives of Occupational and Environmental Health. 2020; 93: 503–511. doi: 10.1007/s00420-019-01498-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Hult M, Lappalainen K. Factors associated with health and work ability among long-term unemployed individuals. International Journal of Occupational Health and Public Health Nursing. 2018; 5(1): 5–22. ISSN: 2053-2369. Available from: Style ISP (scienpress.com) [Google Scholar]
  • 43.Ministry of Economic Affairs and Employment Local government pilots on employment—Ministry of Economic Affairs and Employment (tem.fi) [cited 2023 Aug 9] [Google Scholar]
  • 44.Ministry of Social Affairs and Health Work ability programme—Ministry of Social Affairs and Health (stm.fi) [cited 2023 Aug 9] [Google Scholar]
  • 45.Metsämuuronen J. Essentials of Research Methods in Human Sciences. Vol 2. Multivariate Analysis. SAGE Publications; 2017. pp. 145–226 [Google Scholar]
  • 46.Muthén L, Muthén B. In Mplus user’s guide (8 ed.). Los Angeles, CA, USA: Author. Available from: http://www.statmodel.com/
  • 47.Kääriäinen M, Kanste O, Elo S, Pölkki S, Miettunen J, Kyngäs H. Testing and verifying nursing theory by confirmatory factor analysis. Journal of Advanced Nursing. 2011;67(5): 1163–1172. doi: 10.1111/j.1365-2648.2010.05561.x [DOI] [PubMed] [Google Scholar]
  • 48.Stevens J. Applied multivariate statistics for the social sciences. 4th ed. Lawrence Erlbaum Associates. Erlbaum Mahwah; 2002. [Google Scholar]
  • 49.Kyriazos T. Applied Psychometrics: Sample Size and Sample Power Considerations in Factor Analysis (EFA, CFA) and SEM in General. Psychology. 2018; 9: 2207–2230. 10.4236/psych.2018.98126 [DOI] [Google Scholar]
  • 50.Hair J, Black W, Babin B, Anderson R, Tatham R. Multivariate data analysis. 6th ed. Upper Saddle River, NJ. Pearson University Press; 2006. [Google Scholar]
  • 51.Gebel M, Voßemer J. The impact of employment transitions on health in Germany. A difference-in-differences propensity score matching approach. Social Science and Medicine. 2014; 108: 128–36. doi: 10.1016/j.socscimed.2014.02.039 [DOI] [PubMed] [Google Scholar]
  • 52.Kerätär R, Taanila A, Jokelainen J, Soukainen J, Ala-Mursula L. Work disabilities and unmet needs for health care and rehabilitation among jobseekers: a community-level investigation using multidimensional work ability assessments. Scandinavian Journal of Primary Health Care. 2016;34(4):343–51. doi: 10.1080/02813432.2016.1248632 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Hult M. The work ability and health of unemployed persons. Focusing on promoting factors. PhD thesis. University of Eastern Finland. Dissertations in Health Sciences 525. 2019. Available from: eRepo—Work ability and health of unemployed persons: Focusing on promoting factors (uef.fi) [Google Scholar]
  • 54.World Health Organization. Towards a Common Language for Functioning, Disability and Health ICF. Geneva: WHO; 2002. Available from: Towards (who.int) [Google Scholar]

Decision Letter 0

Leona Cilar Budler

15 Dec 2023

PONE-D-23-26849Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market positionPLOS ONE

Dear Dr. Wikström,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 29 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Leona Cilar Budler

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Note from Emily Chenette, Editor in Chief of PLOS ONE, and Iain Hrynaszkiewicz, Director of Open Research Solutions at PLOS: 

Did you know that depositing data in a repository is associated with up to a 25% citation advantage (https://doi.org/10.1371/journal.pone.0230416)? If you’ve not already done so, consider depositing your raw data in a repository to ensure your work is read, appreciated and cited by the largest possible audience. You’ll also earn an Accessible Data icon on your published paper if you deposit your data in any participating repository (https://plos.org/open-science/open-data/#accessible-data).

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

4. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. 

5. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

Additional Editor Comments:

There are major issues pointed out by reviewers. Please read them all carefully and revise paper in order to consider your paper for publication. Also, check all journal guidelines.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: ID: PONE-D-23-26849

Title: Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position

Thank you for providing a chance to review this manuscript.

Detailed information:

Abstract

You'd better dividing the paragraph into “Objective”, “Method”, “Results”, and “Conclusion” four parts. And bold these words. This will make it clearer to the reader. Provide a concise summary of the work done and the results obtained as much as possible.

Materials and Methods

The Abilitator self-report questionnaire

Line 171-173, Page 7: Please briefly describe in language the differences in meaning represented by changes in scores.

Study sample

Line 179-188, Page 8: Please add participants' selection methods, inclusion criteria and exclusion criteria.

Methods

Line191-203, Page 8: 1) What are measurement data? What are qualitative data? Which obey normality and which do not obey? Please provide a detailed explanation. 2) Is there any missing data? If not, please explain how to carry out quality control, etc. If so, please explain how to handle it, such as simple imputation or multiple imputation? 3) Regarding the unclear order of the use of exploratory factor analysis and confirmatory factor analysis, please add details and explain the reasons. 4) Also, are the samples for confirmatory factor analysis and exploratory factor analysis the same population? If so, why not separate? Please explain.

Page 8-10: Please add a data analysis section and explain the data analysis software used, as well as detailed data analysis methods or steps. It is best to separate research design from data analysis.

Results and discussion

Study population characteristics

Table 1, Page 12: If there are no special requirements for the magazine, please use a three-line form.

Line 266, Page 12: Is this a note for the table? Please pay attention to the formatting details, don't you even have a corner marker?

Confirmatory factor analysis

Table 2, Page 13: If there are no special requirements for the magazine, please use a three-line form.

Table 3, Page 14: This icon is not aesthetically pleasing, please beautify your results.

Figures: The clarity of the images is relatively low. Please pay attention to improving your resolution according to the magazine's requirements.

Discussion of the results

Page 17: Is it supported by the literature?

Significance of the results

Page 17: Please increase the discussion on the limitations of this study, including potential biases and sources of uncertainty, and provide a reflection on this study.

Overall: The results and discussion sections should be separated. The results are only objectively presented based on the analysis data of this time. The logic of this section needs to be strengthened.

Conclusions

Page 18: Please explain the practical significance of the research results.

Overall, I feel that your writing is not rigorous enough and your logic needs to be strengthened. The biggest issue is the research design and data analysis methods section. I think it's not enough to support publication.

Thank you and my best,

Your reviewer

Reviewer #2: Ingenious way to calculate structural validity: through CFA with all concepts in the same model and considered separately.

Line 269 - it seems that instead of 136 it is 132.

Table 3 - I think it would be important that factor loadings to be reproduced numerically.

It does not appear out of nowhere how the questionnaire was completed by the weak labor market position population? Online?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 19;19(3):e0300182. doi: 10.1371/journal.pone.0300182.r002

Author response to Decision Letter 0


31 Jan 2024

Academic Editor’s Comments to Author:

After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Response 1: Thank you for these encouraging comments. We have tried our best to revise the paper according to the Reviewers’ points.

Reviewers’ Comments to Author:

The page and line numbers refer to clean copy of the manuscript.

Reviewer: 1

Thank you for providing a chance to review this manuscript.

Response 1: Thank you for your review and very helpful comments.

Abstract

You’d better dividing the paragraph into “Objective”, “Method”, “Results”, and “Conclusion” four parts. And bold these words. This will make it clearer to the reader. Provide a concise summary of the work done and the results obtained as much as possible.

Response 2: Thank you for these useful suggestions. We have now made these changes to Abstract (page 2 lines 24-45, page 3 lines 46-50)

Materials and Methods

The Abilitator self-report questionnaire

Line 171-173, Page 7: Please briefly describe in language the differences in meaning represented by changes in scores.

Response 3: We have added a description according to your suggestion (page7, lines 167-171 and page 8, lines 172-186) and also added Table 1 (page 8) to clarify how the Abilitator’s scores (0-100%) are interpreted. We have also described the study population in terms of these Abilitator’s score categories (page 13, lines 301-303). The smallest detectable changes in the Abilitator’s summary scale scores are presented in: Wikström et al. (2021) “Intrarater reliability of the Abilitator—a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position: a test–retest study” BMJ Open. http://dx.doi.org/10.1136/bmjopen-2021-057295

Study sample

Line 179-188, Page 8: Please add participants' selection methods, inclusion criteria and exclusion criteria.

Response 4: We have clarified this part according to your suggestion (page 9, lines 195-210).

In addition, further description of inclusion and exclusion criteria is provided in the Data analysis section (page 10, lines 232-236).

Methods

Line 191-203, Page 8: What are qualitative data? Which obey normality and which do not obey? Please provide a detailed explanation. Is there any missing data? If not, please explain how to carry out quality control, etc. If so, please explain how to handle it, such as simple imputation or multiple imputation?

Response 5: Thank you for your questions. We have divided our response into three parts:

1) What are qualitative data?

The qualitative data is gathered from all the questions in sections A. Personal details, H. Background information, and I. Work and the Future. In addition, separate questions C9-C13, F4, G2, G3, G8, G9-G12 are qualitative. These questions are valuable for the respondents to reflect on, but they also provide useful additional information on the respondent’s situation for the service professional. We have added this description to text (page 8, lines 172-175). The development of the Abilitator is described in detail in: Wikström et al. (2020) “Development and content validity of the Abilitator: a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position” BMC Public Health. https://doi.org/10.1186/s12889-020-8391-8

2) Which obey normality and which do not obey? Please provide a detailed explanation.

As we use MLR estimation, which is robust to non-normality, the skewness for continuous data is handled when there is no floor or ceiling effects present. We have mentioned this in the Results and Discussion section (page 14, lines 311-314)

3) Is there any missing data? If not, please explain how to carry out quality control, etc. If so, please explain how to handle it, such as simple imputation or multiple imputation?

Yes, there was missing data (page 14, lines 309-311). The percentages of missing values were 0.92% for the whole sample, 0.76% for “C. Inclusion, 1.81% for “D. Mind”, 0.73% for “E. Everyday life”, 0.52% for “F. Skills”, and 0.45% for “G. Body”. Missing data was handled with the Missing data at random (MAR) which is a default option in Mplus (page 11, lines 248-249). MAR is the same as Full information maximum likelihood (FIML) in which includes all the missing data in the analysis. Therefore, we used simple imputation.

Regarding the unclear order of the use of exploratory factor analysis and confirmatory factor analysis, please add details and explain the reasons.

Response 6: Thank you for requesting a clarification on this issue. CFA was conducted first and then EFA. We have added a sentence to make this order apparent (page 10, lines 224-225).The main focus of this study was to conduct a CFA in in accordance with the COSMIN criteria for PROMS of which the dimensions are predetermined. When developing the Abilitator our aim was not to create a data driven PROM based on a unidimensional reflective model, where items are selected based on EFA and then tested in a separate sample with CFA. The Abilitator was developed on the basis of an expert panel-based, content driven model. Our primary hypothesis assumes that this co-developed content is relevant to the target group. EFA has been utilized to examine whether there are same underlying themes between the different domains, of which it is helpful to be aware of. In this kind of self-report questionnaire, a good enough structure is a satisfactory result. More information is provided in our earlier paper Wikström et al. (2020) “Development and content validity of the Abilitator: a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position” BMC Public Health. https://doi.org/10.1186/s12889-020-8391-8

Also, are the samples for confirmatory factor analysis and exploratory factor analysis the same population? If so, why not separate? Please explain.

Response 7: CFA and EFA are conducted in the same data. We have added a sentence to clarify this (page 10, line 226-228). In this study the same data sample could be utilized, because EFA was not used to develop a reflective, unidimensional, data driven model and then utilized to confirm it. Different data samples for EFA and CFA would be relevant if this described unidimensional model was being formed in one sample and confirmed in another.

Methods

Page 8-10: Please add a data analysis section and explain the data analysis software used, as well as detailed data analysis methods or steps. It is best to separate research design from data analysis.

Response 8: Thank you for this suggestion. We have now divided the Methods section into Research design, Data analysis and an additional Ethics statement section, which was a request from PLOS ONE (pages 9-12, lines 212-290). We have also added descriptions on the data analysis (page 11, lines 247-251 and 262-263 and also page 12, lines 283-284)The software used i.e., Mplus is described in detail in reference 46. Muthén L, Muthén B. In Mplus user's guide (8 ed.). Los Angeles, CA, USA: Author. Available from: http://www.statmodel.com/

Results and discussion

Study population characteristics

Table 1, Page 12: If there are no special requirements for the magazine, please use a three-line form.

Response 9: The former Table 1, now Table 2 has been modified in line with PLOS ONE’s style requirements (page 13).

Line 266, Page 12: Is this a note for the table? Please pay attention to the formatting details, don't you even have a corner marker.

Response 10: Yes, those were footnotes for Table 2. Unfortunately, the lines moved to next page when the pdf of the manuscript was formed. We hope this issue doesn’t occur again. We have also decreased the font size of the foot notes to make them clearer.

Confirmatory factor analysis

Table 2, Page 13: If there are no special requirements for the magazine, please use a three-line form.

Response 11: The former Table 2, now Table 3 has been modified in line with PLOS ONE’s style requirements (page 15). In addition, the heading of this whole section has been renamed to Confirmatory and Exploratory Factor Analysis (page 14, line 308)

Table 3, Page 14: This icon is not aesthetically pleasing, please beautify your results.

Response 12: We were considering very hard how to make Table 4 (formerly Table 3), page 15 more aesthetically pleasing without losing any of its content but were able to make only very small modifications. We are happy to take further suggestions about how to make the table look better.

Figures: The clarity of the images is relatively low. Please pay attention to improving your resolution according to the magazine's requirements.

Response 13: This is true. These images turned out blurry when the original pdf files were transformed to the format required by PLOS ONE. If this problem persists, we will do our best to sort it in cooperation between the experts of PLOS ONE and our organization by the time of publication.

Discussion of the results

Page 17: Is it supported by the literature?

Response 14: Thank you for requesting this information. We have added a few sentences and a separate paragraph to expand on this issue (page 19-20, lines 408-432)

Significance of the results

Page 17: Please increase the discussion on the limitations of this study, including potential biases and sources of uncertainty, and provide a reflection on this study.

Response 15: We have expanded on this with a subsection titled “Strengths and limitations” (pages 21-22, lines 467-492) We also added discussion on the significance of the results (pages 20-21, lines 434-465).

Overall

The results and discussion sections should be separated. The results are only objectively presented based on the analysis data of this time. The logic of this section needs to be strengthened.

Response 16: We have tried to strengthen the content of the Results and Discussion section as per your above suggestions as well as divided this section to subsections. However, we did not separate these two sections. We have followed the PLOS ONE’s submission guidelines in which combining is one of the given options for authors to choose:

“Results, Discussion, Conclusions. These sections may all be separate or may be combined to create a mixed Results/Discussion section (commonly labeled “Results and Discussion”) or a mixed Discussion/Conclusions section (commonly labeled “Discussion”). These sections may be further divided into subsections, each with a concise subheading, as appropriate. These sections have no word limit, but the language should be clear and concise.” Submission Guidelines | PLOS ONE

Conclusions

Page 18: Please explain the practical significance of the research results.

Response 17: We have added an extra sentence to the Conclusions section (Page 22, lines 494-501) and several sentences to the Significance of the Results section (see Response 15) to explain the practical significance of the results.

Overall, I feel that your writing is not rigorous enough and your logic needs to be strengthened. The biggest issue is the research design and data analysis methods section. I think it's not enough to support publication.

Response 18: We have revised the content of these sections according to your excellent suggestions (page 9-12, lines 213-284). Our goal was to explain all the methods, phases and results of this study as clearly as possible so that even a person who is not familiar with the subject and these specific statistical analysis methods could understand this relatively complex study. We hope that our revisions have made our manuscript clearer and strong enough to support its publication.

Reviewer: 2

Ingenious way to calculate structural validity: through CFA with all concepts in the same model and considered separately.

Response 1: We highly appreciate this encouraging feedback.

Line 269 - it seems that instead of 136 it is 132.

Response 2: Thank you very much for noticing our mistake. We have now corrected the value from 136 to 132 (3x44),(page 14, line 310).

Table 3 - I think it would be important that factor loadings to be reproduced numerically.

Response 2: A good suggestion, thank you. We have now added the numerical factor loadings to Table 4 which was previously Table 3 (page 16).

It does not appear out of nowhere how the questionnaire was completed by the weak labor market position population? Online?

Response 3: Thank you for bringing this up. We have added the description under the subsection “Study sample” (page 9, lines 194-210 ).

Attachment

Submitted filename: Response to Reviewers.docx

pone.0300182.s002.docx (59.7KB, docx)

Decision Letter 1

Leona Cilar Budler

8 Feb 2024

PONE-D-23-26849R1Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market positionPLOS ONE

Dear Dr. Wikström,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 24 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Leona Cilar Budler

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

There are minor comments that need to be resolved

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: ID: PONE-D-23-26849R1

Title: Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position

Thank you for providing a chance to review this manuscript.

Recommendation: Minor revision.

Detailed information:

Abstract

Objective:There are too many words, please briefly summarize the research background and purpose.

Materials and Methods

The title is quite confusing, please pay attention to the subordinate relationship between the title and subtitle.

The previous review comments were well revised, but there are still a few parts that need to be improved. Please review the expression of the article as much as possible from the reader's perspective.

Thank you and my best,

Your reviewer

Reviewer #2: I think the manuscript improved after the changes made by the authors. I consider it a robust piece of research that contributes to the assessment literature by introducing this auxiliary tool necessary in the evaluation of the population in a weak labor market position.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 19;19(3):e0300182. doi: 10.1371/journal.pone.0300182.r004

Author response to Decision Letter 1


13 Feb 2024

Academic Editor’s Comments to Author:

After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Response 1: Thank you for these encouraging comments. We have tried our best to revise the paper according to the points raised.

Reviewers’ Comments to Author:

Reviewer: 1

Thank you for providing a chance to review this manuscript.

Response 1: Thank you for your review and helpful comments.

Abstract

Objective: There are too many words, please briefly summarize the research background and purpose.

Response 2: Thank you for this good suggestion. We have now made changes to Objectives (page 2 lines 24-29)

Objectives

According to the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) panel, structural validity describes how well Patient-Reported Outcome Measures’ (PROM) scores reflect the dimensions of the measured construct. The main purpose of this study was to examine the structural components of the Abilitator, a co-developed self-report questionnaire on work ability and functioning for the population in a weak labour market position.

Materials and Methods

The title is quite confusing, please pay attention to the subordinate relationship between the title and subtitle.

Response 3: Thank you for this very useful comment. We have tried to follow the PLOS ONE’s submission guidelines regarding the “Materials and Methods” section that the journal requires, see Submission Guidelines | PLOS ONE. However, we have made some changes to headings based on your suggestion. First, we unified the formatting of titles so that this article contains only either level 1 headings (Bold type, 18 pt font) for major sections or level 2 headings (Bold type, 16 pt font) for sub-sections of major sections. Second, we deleted the heading “Methods” (marked copy page 9, line 212), which partly duplicated the major heading “Materials and Methods”. We hope these changes address the points you raised.

The previous review comments were well revised, but there are still a few parts that need to be improved. Please review the expression of the article as much as possible from the reader's perspective.

Response 4: We highly appreciate your feedback. We have tried our best to review the expression of the article from the reader’s perspective and made some amendments particularly to the Significance of the results section (pages 20-21, lines 433-461, marked copy pages 20-21, lines 437-469) and the Strengths and limitations section (page 21-22, lines 463-488, marked copy pages 21-22, lines 471-496). We also deleted two sentences in the Study sample section (marked copy page 9, lines 204-208) as they repeated the Ethics Statement (page 12, lines 285-289, marked copy pages 12-13, lines 291-295).

Reviewer: 2

I think the manuscript improved after the changes made by the authors. I consider it a robust piece of research that contributes to the assessment literature by introducing this auxiliary tool necessary in the evaluation of the population in a weak labor market position.

Response 1: Thank you very much for your review and encouraging feedback.

Attachment

Submitted filename: Response to Reviewers.docx

pone.0300182.s003.docx (28.6KB, docx)

Decision Letter 2

Leona Cilar Budler

23 Feb 2024

Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position

PONE-D-23-26849R2

Dear Dr. Wikström,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Leona Cilar Budler

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Authos did take into account all comments and suggestions and improved paper quality. Paper is now ready to be accepted.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: ID: PONE-D-23-26849R2

Title: Examination of the structural components of the Abilitator – a self-report questionnaire on work ability and functioning aimed at the population in a weak labour market position

Thank you for providing a chance to review this manuscript.

Recommendation: Accept.

There are no other suggestions. Hopefully, you'll do a careful detail check again to ensure the quality of the text.

Thank you and my best,

Your reviewer

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Acceptance letter

Leona Cilar Budler

7 Mar 2024

PONE-D-23-26849R2

PLOS ONE

Dear Dr. Wikström,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Leona Cilar Budler

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. The Abilitator questionnaire.

    (PDF)

    pone.0300182.s001.pdf (983.3KB, pdf)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0300182.s002.docx (59.7KB, docx)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0300182.s003.docx (28.6KB, docx)

    Data Availability Statement

    The data does not include the variable for the identification of specific ESF projects, which is used for clustering the participants in the analyses of the present article. In addition, the data does not include any demographic information such as the participants’ age, gender, or duration of unemployment. These particular pieces of information were considered to compromise the anonymity of the participants in the review process of the data sharing protocol conducted by the Finnish Institute of Occupational Health (FIOH). Therefore, the analyses of this paper cannot be fully replicated with the open data. To fully replicate the analyses of this study, one piece of the additional information is needed i.e., the variable for the identification of specific ESF projects, which is used for clustering the participants. This data can be requested from the FIOH's data protection officer via email: dpo@ttl.fi The demographic information i.e., the participants’ age, gender, or duration of unemployment are merely background information to describe the study population and play no role in the actual data analysis. In questions concerning data availability from FIOH, more information is available: https://www.ttl.fi/en/privacy-notice/data-permits-for-datasets-of-the-finnish-institute-of-occupational-health Data can be requested and other information concerning the data enquired from the FIOH's data protection officer via email: dpo@ttl.fi.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES