Skip to main content
BMJ Open logoLink to BMJ Open
. 2019 Sep 24;9(9):e029577. doi: 10.1136/bmjopen-2019-029577

Measuring precarious employment in Sweden: translation, adaptation and psychometric properties of the Employment Precariousness Scale (EPRES)

Johanna Jonsson 1,, Alejandra Vives 2,3, Joan Benach 3,4, Katarina Kjellberg 1,5, Jenny Selander 1, Gun Johansson 1,5, Theo Bodin 1,5
PMCID: PMC6773301  PMID: 31551377

Abstract

Objectives

Precarious employment (PE) is a determinant of poor health and health inequality. However, the evidence of health consequences and mechanisms underlying the associations, are still limited due to a lack of a comprehensive multidimensional definition and measurement instrument. The Employment Precariousness Scale (EPRES) is a Spanish, multidimensional scale, developed to measure degree of PE. The aim of this study was to translate the EPRES-2010 into Swedish, adapt it to the Swedish context and to assess the psychometric properties of the Swedish EPRES.

Method

EPRES was translated, adapted and implemented for data collection within the research project PRecarious EMployment in Stockholm (PREMIS). During 2016–2017, questionnaire data were collected from 483 non-standard employees in Stockholm, Sweden, sampled with web-based respondent-driven sampling. Analyses included item descriptive statistics, scale descriptive statistics and exploratory factor analysis.

Results

The final EPRES-Se (Swedish version of the EPRES), consisted of six dimensions and 23 items. There was a high response rate to all items and response options. Global Cronbach’s alpha was 0.83. Subscales ‘vulnerability’, ‘rights’ and ‘exercise rights’ had reliability coefficients between α=0.78–0.89 and item-subscale correlations between r=0.48–0.78. ‘Temporariness’ had poor reliability (α=−0.08) and inter-item correlation (r=−0.04), while ‘disempowerment’ showed acceptable psychometric properties (α=0.5; r=0.34). Exploratory factor analysis confirmed the original EPRES factor structure.

Conclusions

‘Vulnerability’, ‘wages’, ‘rights’, ‘exercise rights’ and ‘disempowerment’ worked in the Swedish context; however, ‘temporariness’ would need revising before implementing the EPRES-Se in further research. Continued work and validation of EPRES-Se is encouraged. In order to enable international comparisons and multinational studies, similar studies in other European countries are also called for.

Keywords: epidemiology, occupational & industrial medicine, public health, statistics & research methods


Strengths and limitations of this study.

  • First translation and adaptation of the Employment Precariousness Scale (EPRES)-2010 to Swedish and the Swedish context.

  • First assessment of the psychometric properties of the EPRES-Se.

  • Relatively small sample restricted to non-standard employees.

  • Limited generalisability of results.

Introduction

Precarious employment (PE) is considered a social determinant of poor health and health inequality.1–3 PE is present in both low-income and middle-income as well as developed countries.4 5 However, evidence of the health consequences of PE, and by which mechanisms PE harm workers’ health, is still limited due to the lack of a comprehensive multidimensional definition and measurement instrument.6 This lack also brings about challenges in terms of capturing the size of the population in PE, conducting occupational health and safety surveillance,6 7 as well as cross-country comparisons. The Employment Precariousness Scale (EPRES) is a Spanish questionnaire developed to measure six dimensions of PE. EPRES has previously been validated in Spanish and Chilean populations,8–11 and also applied to the population of Catalonia,12 but as of yet there is no Swedish translation or adaptation.

Precarious employment

During the past decades, neoliberal economics and policies together with increased globalisation, trade competition, technological innovation and financial crises, has had a considerable impact on the dynamics of the labour market.5 13 14 These impacts have had several implications, including an increase in privatisation, downsizing, outsourcing, a weakening of union input and collective regulation, and a more competitive and uncertain context for workers with increases in flexible work, unemployment and non-standard employment arrangements.5 13 14 Furthermore, there has been a decline in attachment to employers, risk shifting from employer to employees, growth in perceived and actual job insecurity and work-based stress, as well as diminished bargaining power and rights.13 14

Non-standard arrangements, in comparison with standard employment contracts (ie, open-ended full-time contracts), includes part-time work (underemployment), temporary work, temporary agency work, zero hour contracts, ‘gig’ work arrangements and self-employment.1 4 7 14 15 Non-standard work can also include holding multiple jobs.16 A comprehensive term used to describe forms of non-standard employment is ‘PE’.17 PE does not, however, solely refer to the type of employment, but also to unfavourable employment conditions, such as vulnerability, low pay, low levels of social security and rights.3 4 14 17–21 As these elements are not exclusively found in non-standard employments per se, employees in a standard employment are also at risk of experiencing precariousness.14 22 23 Thereby, it is important to move beyond a simplistic categorical grouping of employment, such as temporary versus permanent, and instead work towards a comprehensive multidimensional approach that enables a better understanding of PE.16 23

Several definitions and attempts to create multidimensional constructs capturing PE already exist. In terms of the previous, Rodgers and Rodgers include employment instability, employment insecurity, lack of protection and economic/social vulnerability as components in their definition of PE17; and the International Labour Organization include low wage, poor protection from termination of employment, lack of access to social protection/benefits (usually associated with full-time standard employment) and lack of/limited access to exercise rights at work.21 To our knowledge, two validated questionnaires have been developed for the purpose of measuring PE: The Employment Precarity Index, identifying employment precarity by 10 questions and dividing scores in four groups: secure, stable, vulnerable and precarious23; and the EPRES with its six dimensions: ‘temporariness’, ‘wages’, ‘disempowerment’, ‘vulnerability’, ‘rights’ and ‘exercise rights’, where precarity ranges from low to high.10 Several studies have also used a combination of indicators as proxy measures in order to identify PE.24–26 Despite these efforts, there is of yet no universally accepted definition or operationalisation.

By the means of a cross-national multidimensional definition and measurement instrument of PE, comparative and more precise estimations of health effects would be made possible. Previously, PE has been linked to an array of health issues including mental and physical health2 27 and occupational injuries.28 Previous research on related concepts such as job insecurity and temporary employment also show consistent associations with various health outcomes.29–32 Mechanisms linking PE and health are not yet fully understood but pathways that have been suggested include: more harmful working conditions, limited control over one’s professional and personal lives, feelings of insecurity and income below the subsistence level, which consequently can affect other social determinants of health such as housing quality, lifestyles and so on.19

Employment Precariousness Scale

EPRES is a Spanish, multidimensional theory-based scale, developed to measure degree of PE among waged and salaried workers.8 EPRES is comprised of 22 items and six subscales corresponding to six dimensions: ‘temporariness’ (contract duration; two items), ‘wages’ (low or insufficient; possible economic deprivation; three items), ‘disempowerment’ (level of negotiation of employment conditions; two items), ‘vulnerability’ (defenselessness to authoritarian treatment; five items), ‘rights’ (entitlement to workplace rights and social security benefits; four items) and ‘exercise rights’ (powerlessness, in practice, to exercise workplace rights; six items).8 9 EPRES items are scored on a 5-point or 3-point scale, depending on item, and all items taken together gives a global score ranging between 0 (least precarious) and 4 (most precarious).33 EPRES has demonstrated good acceptability, good internal consistency and evidence of construct validity in Spanish and Chilean populations.8 9 The original EPRES scale was revised in 2015 (hereafter known as EPRES-2010), which showed good metric properties and improved sensitivity to worker vulnerability and employment stability.10 Further details about EPRES and its development has been described elsewhere.33

PE in Sweden

In Sweden, much of previous research has focused on health outcomes of PE and related exposures. Some studies have focused on exposures such as temporary employment,34 peripheral employment35 and temporary employment and job insecurity.36 Fewer studies have created proxies of multidimensional exposures of PE, for instance by combining previous unemployment, temporary/permanent employment and perceived job insecurity37; or by identifying multiple indicators of PE (eg, type of contract, income, working times etc).26 It is challenging to put Sweden in a larger comparative context of PE as there is no consensus on its operationalisation. Sweden has, according to some definitions (as defined by a typological approach of 11 indicators), one of the smallest proportions of precarious employees among the Scandinavian countries.19 However, in other measures (defined by involuntary part-time work, temporary employment and fear of job-loss) Sweden has the largest proportion of precariously employed individuals24 and the largest proportion of fixed-term employment contracts38 in the same context. Reports show that the Swedish labour market is growing increasingly more insecure, especially for temporary employees.39 40 The proportion of temporary employees has been stable around 15%–17% since the late 1990’s.40 41 There has, however, been reports on a shift within this group where longer-term positions have been replaced by a larger proportion of on-demand employees and day labourers, which are more precarious by nature.39 40 42 Especially women (19%, compared with 15% among men), 16–24 years old (56%, compared with 21% among 25–34 years old and 9% among 35–44 years old) and foreign born (24%, compared with 15% among individuals born in Sweden) are likely of holding a temporary employment.40 These are groups that reportedly are exposed to high employment precariousness.19 Further, around 10% of employees in Sweden are not covered by collective bargaining agreements and around 9% have multiple jobs. The latter has seen an increase with 1.5 percentage points since 2005.42 According to a definition by the Swedish Labour Policy Council, the group of atypical employees is constituted by those that fulfil one of the following: not being covered by a collective bargaining agreement, have a temporary employment, are employed by a temp agency or are self-employed, have their own company, hold multiple jobs or are working in the informal sector. This group of atypical workers is estimated to be around 35%–39% of the Swedish workforce,42 and likely of experiencing precariousness.

Thereby, despite the stabile levels of temporary employment in Sweden, it could be assumed that the level of precariousness has increased on the Swedish labour market. A study from Finland, however, indicate that the precariat (as defined by atypical employment, previous unemployment, fear of job-loss, poor prospects of employment and low earnings) has not seen an increase the past couple of decades.43 Without longitudinal studies with precise measures of PE assessing changes over time, evidence in Sweden remains inconclusive.

To our knowledge, this is the first study in Sweden aiming at translating and adapting a validated multidimensional measurement of PE, EPRES, to Swedish and the Swedish context. It is an important step in the direction to more precisely and fully comprehend the distribution and trends of PE in the Swedish population, as well as it will allow for future studies on health outcomes of PE. Further, such an instrument will also enable well-needed cross-country comparisons.

Aim

The aim of this study was to translate the EPRES-2010 into Swedish, adapt it to the Swedish context, and to assess the psychometric properties of the Swedish EPRES.

Method

In order to fulfil the study aims, the EPRES-2010 was first translated into Swedish and subsequently adapted to suit the Swedish context (hereafter known as the Swedish version of the Employment Precariousness Scale, EPRES-Se). Thereafter, EPRES-Se was piloted and implemented as a part of the survey used in the research project PRecarious EMployment in Stockholm (PREMIS).

Translation and adaptation of EPRES

The translation and adaptation process of the EPRES-2010 consisted of five steps: (1) translation from Spanish to Swedish; (2) cultural adaptation to fit the Swedish context; (3) back translation to Spanish and adjustments; (4) pilot testing; (5) final adaptations based on user feedback in pilot.

  1. The Spanish version of the revised EPRES-2010 scale, which has been published elsewhere,10 was translated into Swedish. The translation was done by a bilingual member of the research team (TB) in close discussion with AV, a native Spanish speaker with previous experience of validation studies of EPRES.

  2. Several adaptations of the questionnaire were implemented in order to fit Swedish labour market conditions. The questionnaire and its translation was discussed during workshops in the project team, which consisted of Swedish, Spanish and Chilean researchers within public-—and occupational health; as well as within the reference group involved in PREMIS, which consisted of labour union members and workers with experience of PE.

  3. Several drafts of the Swedish questionnaire were translated back to Spanish during the adaptation process and discussed until the final translation was decided on.

  4. A two-stage pilot testing was performed: first face-to-face with five volunteers from the reference group, and thereafter online with six volunteers who were currently working but without a permanent full-time employment. The latter were also asked to participate in an evaluation of the survey either via the phone or online.

  5. With the input from the pilot, a few minor adaptations were made to the EPRES.

Further, in order to offer non-Swedish speaking participants an opportunity to participate in the PREMIS-study, the PREMIS-survey, including the Swedish version of EPRES, was translated into English by an external, professional, translator. After the translation, minor changes in terms of style and terminology was made by the research group. The English translation of the EPRES-Se was not validated in this study, nor has it been validated in any previous studies.

Implementation of the EPRES-Se

PREMIS is an ongoing, longitudinal, web-based study conducted in Stockholm county, Sweden. PREMIS aims at methodological development in terms of sampling strategies and assessment of PE, as well as at studying health outcomes of PE. In 2016–2017, 483 non-standard employees were sampled with web-based respondent-driven sampling (webRDS). WebRDS uses peer-to-peer recruitment to build a sample from populations that are hard-to-reach and therefore lacks a sampling frame.44 Questionnaire data were collected through an online survey tool specifically developed for respondent-driven sampling (RDS).45 The PREMIS-survey included all the items of the EPRES-Se, as well as questions on employment type, occupational environment, health outcomes and background. The survey could be completed in Swedish or English.

As one of the aims of PREMIS was to sample precarious employees with webRDS, a process which has been described elsewhere,46 participation in the study was restricted to individuals considered particularly vulnerable to PE conditions, such as individuals with temporary employment, on-demand employment, involuntary part-time employment and involuntary self-employment. The inclusion criteria for participants were: living and/or working in Stockholm County, being aged 18–65 years, having and indicating a Swedish personal identification number, and having a current employment. Exclusion criteria were: having a fixed, full-time, employment, being voluntarily self-employed or being a student. Out of the 483 participants included in the sample, 68 participants were excluded due to not matching criteria of county (n=6), re-using or giving an incorrect personal number (n=8 and n=17, respectively), being underage (n=1) or suspected cheating (ie, systematic repeated participation; n=36), giving a final sample of 415 participants.

Statistical analysis

Item descriptive statistics (mean, SD, response frequencies, missing responses and Pearson item-subscale correlations) and scale descriptive statistics (mean, SD, missing items, range, floor and ceiling effects, and reliability (Cronbach’s alpha coefficient)) were assessed for the entire sample. Participants answering ‘No answer’ on the question on income (question three in EPRES-Se) were excluded from the analyses of this question due to the ambiguity of the response alternative. Exploratory factor analysis was conducted in order to determine the underlying factor structure of the data. Principal axis factoring, with varimax rotation, extracting eigenvalues >1 was used, which is the method used in previous EPRES-studies.8–10 Subanalyses were conducted without informal workers, ie, participants answering ‘I have no contract’ to the question on contract duration (question one in EPRES-Se). Further, as the sample was recruited with RDS, weighted analyses were conducted in addition to the unweighted analyses. RDSII weights47 were calculated in RDS Analyst 0.42 for Windows (Los Angeles, California, USA). In short, weights are based on the self-reported network size in the target population (degree) of the participant and applied in order to account for over-sampling of individuals included in large social networks. Participants with large social networks are given a smaller weight, and vice versa.47 48 The results from the weighted analyses will be shown in full in the online supplementary material. All analyses were performed using SPSS V.23.

Supplementary data

bmjopen-2019-029577supp001.pdf (159.9KB, pdf)

Patient and public involvement

In PREMIS, a reference group consisting of individuals with experience from PE and labour union representatives, was involved in the design of the PREMIS-survey (design of survey and formulation of questions not otherwise standardised) and data collection process (deciding on the appropriate compensation for participation, recruitment of participants and testing the survey software) through active discussions and workshops. Results will be disseminated to study participants through the website of the PREMIS-study.

Results

Adaptations of EPRES-Se

The following adaptations were made to the EPRES-Se in comparison with EPRES-2010.

  1. The response alternatives in ‘temporariness’ were stated as categories, as opposed to free text values of number of days, months or years in EPRES-2010, in order to increase usability in the web-survey context. For the same reason, the question on contract duration which contained three dependent items in EPRES-2010, was collapsed into one question in EPRES-Se. In addition, the response options ‘I do not have a contract’ was added in order to capture informal work and ‘Do not know’ was added in order to capture poor contractual relationship.

  2. In ‘wages’, the question on income was presented in local currency (Swedish krona, SEK) and intervals were set to ~€300 as the €150–200 intervals used in the EPRES-2010 version were perceived as too narrow in the Swedish context. In EPRES-2010, intervals were €150–€200 below a monthly income of €1200, and €300 above an income of €1201.

  3. In EPRES-2010, the two response alternatives capturing working conditions that were decided unilaterally by the employer, were merged into one response option in the Swedish adaptation in order to enhance usability. Further, as some workers, especially freelancers, are given a fixed budget with no hours specified, the response alternative ‘Not applicable. I work project-based’ was added for the question on how salary was decided on.

  4. One of the items in ‘vulnerability’, ‘afraid to demand better working conditions …’, was taken from the original EPRES8 according to the recommendations made by Vives et al.10

  5. In ‘rights’, the question on pension in EPRES-2010, which contained both pension due to old age and disability, was split in two as these are distinct systems unrelated to one another in the Swedish context. Retirement pension (ie, pension due to old age) was kept in EPRES-Se and disability pension was removed. However, a new item assessing the right to sickness benefit was added in the subscale instead, capturing both long term sick leave and shorter spells of sickness absence.

  6. In ‘exercise of rights’ the item on taking a day off for family reasons was clarified by adding ‘care of a sick child, care of a sick relative and so on’ within brackets.

EPRES-Se

The final version of EPRES-Se consisted of a total of 23 items and six dimensions: ‘temporariness’ (two items), ‘wages’ (three items), ‘disempowerment’ (two items), ‘vulnerability’ (five items), ‘rights’ (five items) and ‘exercise rights’ (six items). As in the EPRES-2010, the response scales were 5-point ordinal scales for ‘temporariness’, 5-point ordinal and 5-point frequency scales for ‘wages’, 5-point frequency scales for ‘vulnerability’ and ‘exercise rights’, and 5-point and 3-point categorical scales for ‘disempowerment’ and ‘exercise rights’, respectively. See EPRES-Se in online supplementary material A.

Coding of EPRES-Se

Similarly as EPRES-2010, subscale scores were computed as averages and transformed into a 0–4 scale. The global EPRES score is the average of the six subscales, ranging from 0 to 4, where 0 represent the lowest level of precariousness and 4 represent the highest level of precariousness.

For questions in ‘temporariness’, response options were coded slightly different compared with EPRES-2010 in order to accommodate the changes made in the Swedish version. For instance, in the question on duration of contract, response options ‘Do not have a contract’ and ‘Do not know’ were coded as 4 (most precarious), in comparison with the Spanish version where a contract length of less than 6 months was coded as 4. In the question on income, intervals were larger and consistent in size, as compared with the Spanish version. The cut-offs for income were based on the Swedish median net income for 2016, which was just above SEK 18 000 for individuals 20–64 years of age.49 Merging of items in ‘disempowerment’ did not affect the coding. The coding of the individual items along with the English translation of EPRES-Se can be found in the online supplementary material B.

Issues leading to recoding of the ‘temporariness’ dimension

During the data analysis phase, it was revealed that 79% (n=139) of the respondents answering ‘indefinitely’ to the EPRES question on contract length (‘How long is your current employment contract valid?’) also answered that they were employed on demand/by the hour on a question assessing employment type included in the PREMIS-survey. We suspected that this combination could be a type of ‘zero hour’ contract, in which the employer is not required to offer the employee any fixed number of hours of work at all per day, week or month.38 Thereby, this type of employment situation could be regarded as contingent with a high degree of precariousness. This was confirmed as the group indicating an indefinite contract length and on-demand/by the hour employment, were most similar (in terms of the other EPRES subscales) to employees with a contract lasting < 1 month and least alike employees with a fixed-term contract >2 years. Consequently, we recoded the group with an indefinite contract and on demand/by the hour-employment from 0 to 3 (ie, the same coding as the response alternative <1-month contract). Those with any other employment type and an indefinite contract (n=36) remained coded as 0. See results of subscale-average comparisons in online supplementary material C.

Psychometric properties of EPRES-Se

The demographic characteristics of the sample is shown in table 1. The sample consisted of a larger proportion 25–29 years old (45%) compared with the other age-groups, and a larger proportion women (54%) as compared with men. Further, the sample was dominated by workers employed on demand/by the hour (59%).

Table 1.

Demographic characteristics of the study population (frequencies and percentages), n=415

N %
Age
 18–24 122 29
 25–29 185 45
 30–64 108 26
Sex
 Men 190 46
 Women 225 54
Employment
 Temporary employment 121 29
 On demand/by the hour employment 243 59
 Self-employment (involuntary) 13 3
 Intern 2 1
 Part-time employment (involuntary) 36 9

Table 2 shows the item-descriptive statistics. There was a small proportion of missing values (<3%). Item means were similar within subscales, with the greatest mean difference found within ‘wages’ (item mean difference=1.6). All response options within the items were used by participants, although to a varying extent. Item-subscale correlations were around 0.6–0.8 in ‘vulnerability’ and ’exercise of rights’; and around 0.4–0.6 in ‘wages’ and ‘rights’. There was a weak correlation between item and subscale in ‘disempowerment’ and no correlation between items in ‘temporariness’. With exception of the latter, all items correlated higher with their corresponding subscale compared with other subscales.

Table 2.

Item descriptive statistics and Pearson item-subscale correlations of EPRES-Se

Item Missing %* Mean SD Response value frequency (%)† Pearson item subscale correlations‡
0 1 2 3 4 T W D V R ER
Temporariness§
 Length of contract 0.0 2.6 1.1 36 (8.7) 24 (5.8) 75 (18.1) 228 (54.9) 52 (12.5) −0.04** 0.04 0.05 0.06 0.08 0.04
 Time working employer 0.0 2.1 0.9 17 (4.1) 92 (22.2) 171 (41.2) 119 (28.7) 16 (3.9) −0.04** 0.06 0.11 −0.04 0.31 0.13
Wages
 Income monthly 2.2 2.4 1.2 43 (10.6) 45 (11.1) 87 (21.4) 171 (42.1) 60 (14.8) 0.09 0.39¶ 0.14 −0.07 0.29 0.17
 Cover basic need 1.0 0.8 0.9 175 (42.6) 171 (41.6) 44 (10.7) 14 (3.4) 7 (1.7) −0.02 0.60¶ 0.07 0.21 0.13 0.26
 Cover unforeseen expenses 1.0 1.8 1.1 60 (14.6) 113 (27.5) 136 (33.1) 70 (17.0) 32 (7.8) 0.08 0.55¶ 0.08 0.39 0.14 0.26
Disempowerment
 Working hours settled 0.0 2.1 1.2 84 (20.2) 8 (1.9) 110 (26.5) 190 (45.8) 23 (5.5) 0.12 0.17 0.34¶ 0.10 0.26 0.23
 Salary settled 0.0 2.2 1.2 77 (18.6) 8 (1.9) 101 (24.3) 210 (50.6) 19 (4.6) 0.07 0.03 0.34¶ 0.02 0.13 0.09
Vulnerability
 Demand work conditions 1.0 1.6 1.2 79 (19.2) 129 (31.4) 113 (27.5) 63 (15.3) 27 (6.6) 0.01 0.13 0.09 0.75¶ 0.04 0.28
 Unfair treatment 1.0 1.3 1.1 114 (27.7) 159 (38.7) 67 (16.3) 50 (12.2) 21 (5.1) −0.03 0.12 0.08 0.78¶ −0.01 0.26
 Afraid fired 1.0 1.5 1.2 106 (25.8) 130 (31.6) 81 (19.7) 60 (14.6) 34 (8.3) 0.06 0.20 0.10 0.78¶ 0.04 0.35
 Treated authoritarian 1.0 1.3 1.1 107 (26.0) 160 (38.9) 87 (21.2) 36 (8.8) 21 (5.1) −0.04 0.20 −0.01 0.63¶ 0.02 0.23
 Easily replaced 1.0 1.6 1.3 91 (22.1) 124 (30.2) 92 (22.4) 55 (13.4) 49 (11.9) 0.06 0.22 0.02 0.74¶ 0.04 0.27
Rights
 Right parental leave 1.2 1.2 0.8 100 (24.4) 130 (31.7) 180 (43.9) 0.18 0.16 0.26 0.05 0.58 0.16
 Right retirement 1.2 1.2 0.8 107 (26.1) 113 (27.6) 190 (46.3) 0.26 0.22 0.23 0.07 0.60¶ 0.16
 Right unemployment 1.2 1.0 0.9 156 (38.0) 100 (24.4) 154 (37.6) 0.15 0.24 0.15 −0.01 0.60 0.08
 Right severance pay 1.2 1.4 0.6 20 (4.9) 223 (54.4) 167 (40.7) 0.11 0.06 0.03 −0.02 0.48 0.03
 Right sickness benefits 1.2 0.9 0.8 160 (39.0) 110 (26.8) 140 (34.1) 0.26 0.18 0.17 0.03 0.53¶ 0.12
Exercise of rights
 Take weekend off 1.0 1.6 1.1 86 (20.9) 93 (22.6) 154 (37.5) 48 (11.7) 30 (7.3) −0.01 0.23 0.18 0.18 0.10 0.62
 Take vacation 1.2 1.9 1.1 50 (12.2) 88 (21.5) 163 (39.8) 77 (18.8) 32 (7.8) 0.14 0.22 0.20 0.30 0.15 0.68
 Take day off 1.2 1.6 1.1 88 (21.5) 85 (20.7) 166 (40.5) 50 (12.2) 21 (5.1) 0.15 0.19 0.21 0.24 0.16 0.75
 Take day off, pers. 1.0 1.9 1.2 63 (15.3) 78 (19.0) 159 (38.7) 69 (16.8) 42 (10.2) 0.11 0.21 0.08 0.36 0.07 0.74
 Sick leave 1.2 1.6 1.1 98 (23.9) 74 (18.0) 163 (39.8) 50 (12.2) 25 (6.1) 0.06 0.22 0.20 0.26 0.12 0.69
 Go to doctor 1.0 1.1 1.1 140 (34.1) 126 (30.7) 106 (25.8) 25 (6.1) 14 (3.4) 0.11 0.26 0.09 0.25 0.14 0.64

0 indicates the lowest precariousness score, 4 indicates the highest precariousness score.

*Proportion of participants with any missing item.

†Frequency (%) of participants indicating the specific response. 0 indicates the lowest precariousness score, 4 indicates the highest precariousness score.

‡Corrected for overlap, ie, item is removed from the corresponding subscale.

§Inter-item correlations.

¶ p <0.001

**p >0.05

D, disempowerment; ER, exercise rights; R, rights; T, temporariness; V, vulnerability; W, wages.

Table 3 shows the scale descriptive statistics. The subscale mean scores ranged between 1.4 and 2.3, with a global average of 1.9. The proportion of participants with any missing values in the subscales were around 1%, except in the case of ‘wages’ where it was 3.1%. The latter also included participants answering ‘No answer’ (n=9). Subscale scores ranged between 0 and 4, and global scale score ranged between 0.09 and 3.07. Both floor and ceiling effects were generally low (<5%), with floor effects being highest for ‘disempowerment’ (9.2%) and ‘vulnerability’ (11.7%), and ceiling effects being highest for ‘rights’ (18.0%). Cronbach’s alpha coefficients were around 0.7 or higher for ‘wages’, ‘vulnerability’, ‘rights’ and ‘exercise of rights’. Only ‘temporariness’ exhibited a Cronbach’s alpha coefficient close to 0. The global alpha coefficient was 0.83.

Table 3.

Scale descriptive statistics: range, mean, SD, floor and ceiling effects and Cronbach’s alpha coefficient

Subscale Items Mean SD Missing (%)* Obs. range Floor %† Ceiling %† Cronbach’s alpha
Temporariness 2 2.3 0.7 0.0 0–4 0.5 1.0 −0.08
Wages 3 1.6 0.8 3.1 0–4 4.2 0.7 0.69
Disempowerment 2 2.1 1.0 0.0 0–4 9.2 1.4 0.50
Vulnerability 5 1.4 1.0 1.0 0–4 11.7 1.9 0.89
Rights 5 2.3 1.2 1.2 0–4 2.9 18.0 0.78
Exercise of rights 6 1.6 0.9 1.2 0–4 6.8 1.0 0.88
EPRES-Se 23 1.9 0.5 3.4 0.09–3.07 0.2 0.2 0.83

*Proportion of participants with any missing item.

†Proportion of participants with lowest (floor) and highest (ceiling) EPRES-Se scores.

The exploratory factor analysis extracted six factors with eigenvalues >1 (eigenvalues=5.3; 3.2; 2.3; 1.6; 1.3; 1.1). The emerging factors were the same as in EPRES-2010, thereby confirming the original factor structure. Together, the six factors explained 64.1% of the variance. The six factors and their rotated factor loadings are shown in table 4. All loadings were above 0.35, except in the case of ‘length of contract’.

Table 4.

Factor loadings from exploratory factor analysis of the EPRES-Se

Factor
Exercise rights Vulnerability Rights Wages Disempowerment Temporariness
Temporariness
 Length of contract 0.12
 Time working employer 0.12 0.36 −0.36
Wages
 Income monthly 0.14 −0.16 0.23 0.49 0.35
 Cover basic need 0.17 0.13 0.71
 Cover unforeseen expenses 0.12 0.32 0.79 −0.10
Disempowerment
 Working hours settled 0.17 0.21 0.52 0.15
 Salary settled 0.60
Vulnerability
 Demand work conditions 0.14 0.80
 Unfair treatment 0.11 0.84
 Afraid fired 0.20 0.80
 Treated authoritarian 0.11 0.66 0.12 0.13
 Easily replaced 0.12 0.77 0.15
Rights
 Right parental leave 0.67 0.21
 Right retirement 0.69 0.16
 Right unemployment 0.69 0.11 0.29
 Right severance pay 0.55 −0.10
 Right sickness benefits 0.60 0.11
Exercise rights
 Take weekend off 0.65 0.10 0.14
 Take vacation 0.70 0.18 0.12 −0.13
 Take day off 0.80 0.10 0.10 0.13 −0.13
 Take day off, pers. 0.78 0.24 −0.10
 Sick leave 0.72 0.11 0.12 0.15
 Go to doctor 0.66 0.11 0.13

Table showing factor loadings >0.1.

Subanalyses were conducted in order to investigate the potential effect of including informal workers in the sample (n=35), which had minor influence on the correlation between temporariness-items (r=0.002) and reliability of the subscale (−0.003). However, in the factor analysis seven factors with eigenvalues >1 emerged (5.3; 3.2; 2.3; 1.6; 1.3; 1.1; 1.0), explaining 68.5% of the variance. The seventh factor was caused by a split of the temporariness dimension, grouping items on length of contract (duration) and time working for employer (tenure) in separate factors, with factor loadings of 0.33 and 0.42, respectively.

Analyses for the weighted population sample resulted in virtually the same results in regard to item-subscale correlations, Cronbach’s alpha coefficients, floor and ceiling effects, as well as factor loadings from the exploratory factor analysis of EPRES-Se, and did thereby not affect the interpretation of the results. See the weighted results in online supplementary material 1.

Discussion

Key findings and summary

EPRES-Se generally performed well, with a small proportion of missing values across all subscales, usage of all response options and good global reliability. The factor structure established in the Spanish EPRES-201010 was confirmed. The subscales ‘vulnerability’, ‘wages’, ‘rights’ and ‘exercise of rights’ generally worked well in the Swedish context, with high item-subscale correlations, subscale reliability and factor loadings. However, ‘temporariness’ did not perform as expected and would need revision. In addition, although ‘disempowerment’ showed acceptable psychometric properties, the subscale might benefit from additional adaptation.

‘Temporariness’

As opposed to previous studies,8–10 temporariness yielded very poor psychometric properties. The items in the subscale did not correlate, there was a negative Cronbach’s alpha coefficient and a low factor loading for the item on contract duration. Only minor changes in terms of correlation and Cronbach’s alpha was initiated by the removal of informal workers. This subanalysis did, however, split the temporariness dimension in two separate factors, both of which had higher factor loadings. On the basis of these results, we believe that the temporariness dimension needs further development and evaluation in a population of both standard and non-standard employees. Based on the results from the present study, we offer the following thoughts on this matter.

First, it is important to acknowledge the sample selection. As the sample was restricted to non-standard employees (ie, permanent, full-time, employees were excluded), the lower end of the precariousness scale had a smaller proportion than what would be expected if standard employees with longer duration and tenure would have been included in the sample. This limitation is likely to have contributed to the lack of correlation between the items. However, considering that the sample was intentionally recruited in order to capture a population of precariously employed individuals, the poor psychometric properties of temporariness also shows that these items are not necessarily related in a meaningful way when measuring precariousness among non-standard employees.

Second, in the current context, Swedish legislation (the Employment Protection Act SFS 1982:80) prevents an employer to hire an employee for more than 2 years during a 5-year period (consecutive or in shorter repeated contracts) without having to employ (or dismiss) the employee on a permanent contract.50 Thereby, an employee with an 18-month tenure might be more precarious than an employee with a 6-month tenure as the latter has longer time left before being forced in or out. Further, approximately 50% of temporary employees in Sweden has had repeated contracts with the same employer,40 which is an additional reason that could contribute to the lack of correlation between tenure and duration of contract.

Thirdly, we found that several participants were employed by the hour or on demand while still indicating an indefinite contract length. This highlights the difficulties in assessing temporariness only by contract duration (and tenure). Temporariness is the dimension most likely to be dependent on context. Given the proposed mechanism of temporariness leading to ill-health mediated via feelings of insecurity, temporariness is most relevant in labour markets which do not offer regulatory protection for certain groups of workers, such as permanent employees in most European countries, which does not apply to the same extent in the USA.51

However tempting it would be suggest the inclusion of questions regarding ‘contract type’ in a future development of EPRES, the continuous flexibilisation of the labour market and fast changes in employment practices in combination with contextual differences, makes it increasingly difficult—at least if international comparison using similar scales is sought after.

From a mechanistic standpoint and with an aspiration to develop a scale which could be used in international comparison independent of context, we believe that an item that measures the future employment opportunities with the current employer as objectively as possible should be developed. EPRES-Se and other translations could further be adapted, for example, by combining the contract duration and tenure-items with an item assessing the number of repeated contracts with the same employer or an item assessing how often during a specific time interval the employment contract is up for renewal. Contract duration could also be complemented or replaced by a question more explicitly assessing the remaining duration of the contract at the time of answering the survey.

‘Wages’

The income-item correlated moderately with the other items in the subscale (items assessing how well the income covers basic needs and unforeseen expenses). Previous studies report similar findings for this item.8–10 One explanation for these results is the quantitative nature of the income-item compared with the other items. Slightly more than half, 57%, of the participants scored a precariousness level of 3 or 4 on income, which is not surprising as the sample is constituted by young non-standard employees. However, only 5% and 25% of the sample scored a precariousness level of 3 or 4 on the other two items, respectively. How well one can cover basic needs and unforeseen expenses could depend on more than income, such as family support. Approximately 24% of adults aged 20–27 years in Sweden still live at home. In the majority of municipalities in large city regions, this figure is more than 50%. About half of those living at home pay nothing in rent.52 As 74% of the sample is between 18 and 29 years old, it is likely that at least a part of the participants still live at home and receive help from their family. Including standard employees in the sample could potentially have increased the item-subscale correlation as we would expect a larger proportion of participants with a high income.

Aside from the income-item, item-subscale correlations for the remaining two items and subscale reliability were acceptable and only a fraction of the sample did not provide an answer to the item on income (2.2%). Therefore, as in the other EPRES scales, we believe the subscale can be used in its current form in future studies.

‘Disempowerment’

The items in ‘disempowerment’ had acceptable item-subscale correlations and reliability. However, some response options (‘my working hours/salary was decided within my working team’ and ‘do not know’) were hardly used at all in, indicating that these options might not be appropriate for the current population in the Swedish context. Further, the remaining response options were also inadequate from an adaptational point of view. For example, the working hours/salary being in line with collective bargaining agreements does not imply that the working hours/salary was not set by the employer; these options are not mutually exclusive. In a revised EPRES-Se, the disempowerment-items would benefit from revision and clarification. Combining response options not mutually exclusive could be considered as one way of improving the subscale, such as ‘my working hours are in accordance with Swedish law and the collective agreement, decided by my employer’ and ‘my working hours are not in accordance with Swedish law and the collective agreement, decided by my employer’.

‘Rights’

The new item assessing sickness benefit had an acceptable item-subscale correlation and factor loading, similar to the other item-subscale correlations and factor loadings in the subscale, Further, the subscale reliability was good. Taken together, these results point towards that the new item worked well in the subscale.

Strengths and limitations

This study finds strength in the fact that it is the first study translating and adapting EPRES-2010 to the Swedish context, as well as the first study to assess the psychometric properties of the resulting EPRES-Se. In addition, this work provides context-specific recommendations for future research using EPRES-Se. This study is, however, not without limitations.

The main limitation is the sample. As this study lies within the frame of the PREMIS-project,46 the sample was restricted to employees with a non-standard employment. EPRES, however, is developed to measure precariousness independent of the type of employment.8 By only assessing the psychometric properties of the scale in a population of non-standard employees, the scale properties cannot be directly compared with similar studies as the heterogeneity of the sample is limited. A sample representative of the entire work force would have provided better insights as to how the scale behaves among Swedish employees. A next step which this study has provided strong grounds for.

Finally, the relatively small sample size could influence the reliability of the results, which should be kept in mind when interpreting and generalising the results. Further, being a convenience sample limits the generalisability of the results. However, as the weighted results confirmed the psychometric properties of the scale, we could expect similar results in a representative sample applying the same sample restrictions.

Conclusion

This study found that EPRES-Se worked well in the current context, with high global reliability, endorsement of all response options (for all items) and few missing values. The psychometric properties for five out of six subscales were satisfactory, considering this being the first translation and adaptation. However, one subscale, ‘temporariness’, worked poorly and would need revision before implementing the scale in further research. As employment precariousness is an emergent determinant of health it is important that PE can be properly measured. The EPRES-Se is an important step in this direction. We therefore encourage others to continue working with EPRES-Se and to validate it further in populations of both standard and non-standard employees. Our hope is for a revised EPRES-Se with satisfactory psychometric properties to be implemented in research both as an independent tool and within nation-wide surveys. In order to enable international comparisons and multinational studies, similar studies in other European countries are also called for.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

The authors are grateful to the PREMIS-project members and reference group members who provided valuable input during the formative work of the study.

Footnotes

Contributors: The study was conceived by TB and GJ. All authors, TB, GJ, JJ, AV, JB, KK and JS, contributed to the design of the study. TB translated and back-translated the EPRES, and AV supported the translation process and examined the back translation. JJ collected the data with support from TB and GJ. JJ and TB conducted the analyses. JJ wrote the draft(s) of the manuscript. All authors reviewed the draft(s) and provided feedback on its content. All authors approved the contents of the final manuscript.

Funding: This work was supported by grant 2015-00933 from The Swedish Research Council for Health, Working Life and Welfare (FORTE). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: None declared.

Patient consent for publication: Informed consent was attained from all participants by the respondent clicking ‘Yes’ to the question ‘I understand the information given above and want to participate’.

Ethics approval: Permission from the Regional Ethics Committee of Stockholm was given for the study, with dnr: 2016/1291-31/5.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement: Deidentified participant data are from the PREMIS study whose authors may be contacted at johanna.jonsson@ki.se. Data cannot be made publicly available for ethical and legal reasons, but could be made available to researchers who meet the criteria for access to confidential data after approval from the Regional Ethics Committee of Stockholm.

References

  • 1. CSDH Closing the gap in a generation: health equity through action on the social determinants of health. Final report of the Commission on social determinants of health. Geneva: World Health Organization, 2008. [DOI] [PubMed] [Google Scholar]
  • 2. Benach J, Vives A, Amable M, et al. . Precarious employment: understanding an emerging social determinant of health. Annu Rev Public Health 2014;35:229–53. 10.1146/annurev-publhealth-032013-182500 [DOI] [PubMed] [Google Scholar]
  • 3. Benach J, Muntaner C, Solar O, et al. . Employment, work, and health inequalities: a global perspective. Geneva: WHO, 2007. [Google Scholar]
  • 4. Benach J, Muntaner C. Precarious employment and health: developing a research agenda. J Epidemiol Community Health 2007;61:276–7. 10.1136/jech.2005.045237 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Quinlan M, Mayhew C, Bohle P. The global expansion of precarious employment, work disorganization, and consequences for occupational health: placing the debate in a comparative historical context. Int J Health Serv 2001;31:507–36. 10.2190/22BK-9XC0-AK7L-M6QH [DOI] [PubMed] [Google Scholar]
  • 6. Benach J, Vives A, Tarafa G, et al. . What should we know about precarious employment and health in 2025? framing the agenda for the next decade of research. Int J Epidemiol 2016;45:232–8. 10.1093/ije/dyv342 [DOI] [PubMed] [Google Scholar]
  • 7. Howard J. Nonstandard work arrangements and worker health and safety. Am J Ind Med 2017;60:1–10. 10.1002/ajim.22669 [DOI] [PubMed] [Google Scholar]
  • 8. Vives A, Amable M, Ferrer M, et al. . The employment precariousness scale (EPRES): psychometric properties of a new tool for epidemiological studies among waged and salaried workers. Occup Environ Med 2010;67:548–55. 10.1136/oem.2009.048967 [DOI] [PubMed] [Google Scholar]
  • 9. Vives-Vergara A, González-López F, Solar O, et al. . Precarious employment in Chile: psychometric properties of the Chilean version of employment precariousness scale in private sector workers. Cad Saude Publica 2017;33:e00156215 10.1590/0102-311x00156215 [DOI] [PubMed] [Google Scholar]
  • 10. Vives A, González F, Moncada S, et al. . Measuring precarious employment in times of crisis: the revised employment precariousness scale (EPRES) in Spain. Gac Sanit 2015;29:379–82. 10.1016/j.gaceta.2015.06.008 [DOI] [PubMed] [Google Scholar]
  • 11. Vives A, Amable M, Ferrer M, et al. . Employment precariousness and poor mental health: evidence from Spain on a new social determinant of health. J Environ Public Health 2013;2013:978656 10.1155/2013/978656 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Benach J, Julià M, Tarafa G, et al. . La precariedad laboral medida de forma multidimensional: distribución social Y asociación Con La salud en Cataluña. Gac Sanit 2015;29:375–8. 10.1016/j.gaceta.2015.04.002 [DOI] [PubMed] [Google Scholar]
  • 13. Arnold D, Bongiovi JR. Precarious, informalizing, and flexible work: transforming concepts and understandings. Am Behav Sci 2012;57:289–308. [Google Scholar]
  • 14. Broughton A, Green M, Rickard C, et al. . Precarious employment in Europe. Strasbourg: European Parliament, 2016. [Google Scholar]
  • 15. Muntaner C, Platforms D, Economy G. Digital platforms, Gig economy, precarious employment, and the invisible hand of social class. Int J Health Serv 2018;48:597–600. 10.1177/0020731418801413 [DOI] [PubMed] [Google Scholar]
  • 16. Vosko LF, Zukewich N, Cranford C. Precarious jobs: a new typology of employment. Perspect labour income 2003;15. [Google Scholar]
  • 17. Rodgers G, Rodgers J. Precarious jobs in labour market regulation: the growth of atypical employment in Western Europe. International Labour Organisation, 1989. [Google Scholar]
  • 18. Standing G. Global labour flexibility: seeking distributive justice. London: Macmillan, 1999. [Google Scholar]
  • 19. Julià M, Vanroelen C, Bosmans K, et al. . Precarious employment and quality of employment in relation to health and well-being in Europe. Int J Health Serv 2017;47:389–409. 10.1177/0020731417707491 [DOI] [PubMed] [Google Scholar]
  • 20. Scott-Marshall H, Tompa E. The health consequences of precarious employment experiences. Work 2011;38:369–82. 10.3233/WOR-2011-1140 [DOI] [PubMed] [Google Scholar]
  • 21. International Labour Organization From precarious work to decent work: outcome document to the workers’ symposium on policies and regulations to combat precarious employment. Geneva: ILO, 2012. [Google Scholar]
  • 22. Julià M, Vives A, Tarafa G, et al. . Changing the way we understand precarious employment and health: precarisation affects the entire salaried population. Saf Sci 2017;100:66–73. 10.1016/j.ssci.2017.01.015 [DOI] [Google Scholar]
  • 23. Lewchuk W. Precarious jobs: where are they, and how do they affect well-being? Econ Labour Relat Rev 2017;28:402–19. 10.1177/1035304617722943 [DOI] [Google Scholar]
  • 24. Kretsos L, Livanos I. The extent and determinants of precarious employment in Europe. Int J Manpow 2016;37:25–43. 10.1108/IJM-12-2014-0243 [DOI] [Google Scholar]
  • 25. Van Aerden K, Moors G, Levecque K, et al. . Measuring employment arrangements in the European labour force: a typological approach. Soc Indic Res 2014;116:771–91. 10.1007/s11205-013-0312-0 [DOI] [Google Scholar]
  • 26. Oke A, Braithwaite P, Antai D. Sickness absence and precarious employment: a comparative cross-national study of Denmark, Finland, Sweden, and Norway. Int J Occup Environ Med 2016;7:125–47. 10.15171/ijoem.2016.713 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Rönnblad T, Grönholm E, Jonsson J, et al. . Precarious employment and mental health: a systematic review and meta-analysis of longitudinal studies. Scand J Work Environ Health 2019. 10.5271/sjweh.3797 [DOI] [PubMed] [Google Scholar]
  • 28. Koranyi I, Jonsson J, Rönnblad T, et al. . Precarious employment and occupational accidents and injuries – a systematic review. Scand J Work Environ Health 2018;44:341–50. 10.5271/sjweh.3720 [DOI] [PubMed] [Google Scholar]
  • 29. Kim TJ, von dem Knesebeck O, insecurity Pjob. Perceived job insecurity, unemployment and depressive symptoms: a systematic review and meta-analysis of prospective observational studies. Int Arch Occup Environ Health 2016;89:561–73. 10.1007/s00420-015-1107-1 [DOI] [PubMed] [Google Scholar]
  • 30. Virtanen M, Nyberg ST, Batty GD, et al. . Perceived job insecurity as a risk factor for incident coronary heart disease: systematic review and meta-analysis. BMJ 2013;347 10.1136/bmj.f4746 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Kivimäki M, et al. Temporary employment and risk of overall and cause-specific mortality. Am J Epidemiol 2003;158:663–8. 10.1093/aje/kwg185 [DOI] [PubMed] [Google Scholar]
  • 32. De Witte H, Pienaar J, De Cuyper N. Review of 30 years of longitudinal studies on the association between job insecurity and health and well-being: is there causal evidence? Aust Psychol 2016;51:18–31. 10.1111/ap.12176 [DOI] [Google Scholar]
  • 33. Vives A. A multidimensional approach to precarious employment: measurement association with poor mental health and prevalence in the Spanish workforce. Universitat Pompeu Fabra, 2010. [Google Scholar]
  • 34. Waenerlund A-K, Virtanen P, Hammarström A. Is temporary employment related to health status? analysis of the Northern Swedish cohort. Scand J Public Health 2011;39:533–9. 10.1177/1403494810395821 [DOI] [PubMed] [Google Scholar]
  • 35. Waenerlund A-K, Gustafsson PE, Virtanen P, et al. . Is the core-periphery labour market structure related to perceived health? findings of the Northern Swedish cohort. BMC Public Health 2011;11:956 10.1186/1471-2458-11-956 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Virtanen P, Janlert U, Hammarström A. Exposure to temporary employment and job insecurity: a longitudinal study of the health effects. Occup Environ Med 2011;68:570-4 10.1136/oem.2010.054890 [DOI] [PubMed] [Google Scholar]
  • 37. Canivet C, Bodin T, Emmelin M, et al. . Precarious employment is a risk factor for poor mental health in young individuals in Sweden: a cohort study with multiple follow-ups. BMC Public Health 2016;16:687 10.1186/s12889-016-3358-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. International Labour Organization Non-Standard employment around the world: understanding challenges, shaping prospects. Geneva, 2016. [Google Scholar]
  • 39. Alfonsson J. Nomaderna på den svenska arbetsmarknaden. Det otrygga livets framväxt och effekter på klasstrukturen [In Swedish], 2018. [Google Scholar]
  • 40. Sweden S. Trends for persons in temporary employment [In Swedish], 2015. [Google Scholar]
  • 41. Eurofund Non-Standard forms of employment: recent trends and future prospects. International Publications, 2017. [Google Scholar]
  • 42. The Swedish Labour Policy Council (AER) Olika vägar till jobb [In Swedish] 2018.
  • 43. Pyöriä P, Ojala S. Precarious work and intrinsic job quality: evidence from Finland, 1984–2013. The Economic and Labour Relations Review 2016;27:349–67. 10.1177/1035304616659190 [DOI] [Google Scholar]
  • 44. Salganik MJ, Heckathorn DD. 5. Sampling and estimation in hidden populations using Respondent-Driven sampling. Sociol Methodol 2004;34:193–240. 10.1111/j.0081-1750.2004.00152.x [DOI] [Google Scholar]
  • 45. Bengtsson L, Lu X, Nguyen QC, et al. . Implementation of web-based respondent-driven sampling among men who have sex with men in Vietnam. PLoS One 2012;7:e49417 10.1371/journal.pone.0049417 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Jonsson J, Stein M, Johansson G, et al. . A performance assessment of web-based respondent driven sampling among workers with precarious employment in Sweden. PLoS One 2019;14:e0210183 10.1371/journal.pone.0210183 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Volz E, Heckathorn DD. Probability based estimation theory for Respondent driven sampling. J Off Stat 2008;24:79–97. [Google Scholar]
  • 48. Johnston LG, Sabin K. Sampling hard-to-reach populations with Respondent driven sampling. Methodological Innovations Online 2010;5:38.1–48. 10.4256/mio.2010.0017 [DOI] [Google Scholar]
  • 49. Statistics Sweden Inkomstrapport 2016 Hushåll och Individer [In Swedish], 2016. [Google Scholar]
  • 50. Svensk författningssamling Lagen(1982:80) om anställningsskydd (SFS 2017:363), 2017. [Google Scholar]
  • 51. OECD Detailed description of employment protection legislation, 2012-2013. OECD countries, 2013. [Google Scholar]
  • 52. Hyresgästföreningen Unga vuxnas boende [In Swedish], 2018. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2019-029577supp001.pdf (159.9KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES