Skip to main content
PLOS One logoLink to PLOS One
. 2022 Nov 23;17(11):e0277317. doi: 10.1371/journal.pone.0277317

Long Covid stigma: Estimating burden and validating scale in a UK-based sample

Marija Pantelic 1,2,*, Nida Ziauddeen 3,4, Mark Boyes 5,6, Margaret E O’Hara 7, Claire Hastie 7, Nisreen A Alwan 3,4,8,*
Editor: Dong Keon Yon9
PMCID: PMC9683629  PMID: 36417364

Abstract

Background

Stigma can be experienced as perceived or actual disqualification from social and institutional acceptance on the basis of one or more physical, behavioural or other attributes deemed to be undesirable. Long Covid is a predominantly multisystem condition that occurs in people with a history of SARSCoV2 infection, often resulting in functional disability. This study aimed to develop and validate a Long Covid Stigma Scale (LCSS); and to quantify the burden of Long Covid stigma.

Methods

Data from the follow-up of a co-produced community-based Long Covid online survey using convenience non-probability sampling was used. Thirteen questions on stigma were designed to develop the LCSS capturing three domains–enacted (overt experiences of discrimination), internalised (internalising negative associations with Long Covid and accepting them as self-applicable) and anticipated (expectation of bias/poor treatment by others) stigma. Confirmatory factor analysis tested whether LCSS consisted of the three hypothesised domains. Model fit was assessed and prevalence was calculated.

Results

966 UK-based participants responded (888 for stigma questions), with mean age 48 years (SD: 10.7) and 85% female. Factor loadings for enacted stigma were 0.70–0.86, internalised 0.75–0.84, anticipated 0.58–0.87, and model fit was good. The prevalence of experiencing stigma at least ‘sometimes’ and ‘often/always’ was 95% and 76% respectively. Anticipated and internalised stigma were more frequently experienced than enacted stigma. Those who reported having a clinical diagnosis of Long Covid had higher stigma prevalence than those without.

Conclusion

This study establishes a scale to measure Long Covid stigma and highlights common experiences of stigma in people living with Long Covid.

Introduction

Stigma is a process through which individuals are ‘disqualified from full social acceptance’ due to a physical, health and/or behavioural attribute deemed to be ‘deeply discrediting’ [1]. The detriment of stigma on both patient and health service delivery outcomes has been well-documented globally. Stigma–and the resultant fears of being ostracised or discredited–drives people underground and away from health services and contributes to psychological distress, thus compromising long-term physical health outcomes [25].

Long Covid is a predominantly multisystem condition that occurs in people following SARSCoV2 infection, often resulting in prolonged ill health and functional disability limiting their day-to-day activities including work, learning, care, and leisure activities [6]. In the UK alone, it is estimated that 1.8 million people currently have Long Covid for a duration of at least 4 weeks, out of those 791,000 have had it for at least one year and 235,000 for at least 2 years [7]. Emerging testimonies illustrate profound stigmas experienced by people living with Long Covid [811].

People living with poorly understood and managed health conditions such as Long Covid may experience stigma through three main mechanisms [2]. Enacted stigma refers to direct overt experiences of discrimination, whereby individuals are treated unfairly due to their health condition [12]. Internalised stigma occurs when people adopt negative associations with a health condition and accept them to be true and applicable to themselves; this is characterised by feelings of shame and worthlessness [13]. Anticipated stigma is the expectation of bias or poor treatment by others [14]. These mechanisms can occur independently from each other–for example, a person may anticipate stigma, decide against disclosing their health condition or seeking treatment and therefore avoid enacted stigma. Nonetheless, all three stigma mechanisms may undermine people’s emotional wellbeing, health seeking behaviours, and physical and mental health outcomes [3].

Research on Long Covid stigma is still in nascent stages. To the best of our knowledge, the extent of stigma experienced by people living with Long Covid has not been quantified using a specific scale, and evidence-based stigma reduction strategies are lacking. One of the reasons for this is a lack of a validated quantitative scale for measuring Long Covid stigma.

This study has two aims: 1) To validate a new Long Covid Stigma Scale (LCSS) and establish its basic psychometric properties; and 2) To quantify the burden of stigma, with its three domains of enacted, anticipated and internalised, as experienced in a UK community-based sample of people with lived experience of Long Covid.

Methods

Data from the follow-up of a Long Covid online survey was used [15]. The baseline survey, administered in November 2020 (n = 2550), utilised convenience non-probability sampling via social media to ensure recruitment of a community sample of people who identify as living with Long Covid [15].

The survey was restricted to adults aged 18 years or over who had COVID-19 (confirmed or suspected) and were not hospitalised for the treatment of COVID-19 in the first two weeks of experiencing symptoms. The original scope was decided as very little research was being conducted at the time to describe prolonged illness following non-hospitalised SARSCoV2 infection and most research was focusing on those who were admitted to the hospital during their acute COVID19 illness. People who experienced COVID-19 symptoms and did not require hospital admission during Spring 2020 in the UK largely did not have access to testing, leaving many people with undiagnosed COVID-19 and Long Covid. To enable inclusion of this population, the survey was open to people who did not have lab confirmation of their infection, but had suspected or clinically diagnosed COVID-19.

Participants provided written informed consent (recorded digitally on the survey platforms). Participants had to consent separately to participating in the baseline and follow-up survey before they could access the questionnaire. Responses were anonymous in the baseline survey, but participants who were willing to be contacted for a follow-up survey were asked to consent to future contact and provide contact details. 2210 (86.7%) individuals consented to future contact. One year from the baseline survey, in November 2021, the same participants were invited to complete the follow-up survey. The survey was not open to new participants who did not take part in the baseline survey. Ethical approval was granted by the University of Southampton Faculty of Medicine Ethics Committee (ID 61434).

Measures

The survey was co-produced working with public contributors (MEO, CH), who have lived experience of and provide peer support to others with Long Covid [16]. NAA also had lived experience of Long Covid. Public contributor members of the COVID-19 Research Involvement Group provided feedback on early versions of the questionnaire which was amended accordingly. Qualtrics was used as the platform for the follow-up following feedback from the baseline survey about user-friendliness.

Questions included demographic information, ability to work, current employment status, pattern of illness and impact on health, symptoms that have remained over the longer-term course, clinical diagnosis of Long Covid and other conditions, vaccination, and experiences of stigma. In this paper, we focus on reporting the stigma-related results of the follow-up survey.

Long Covid Stigma Scale (LCSS)

For the follow up survey, thirteen questions on stigma were designed following the Health Stigma and Discrimination Framework [2] to capture three dimensions/domains: enacted (5 items), internalised (4 items), and anticipated (4 items). Questions were based on existing scales related to other stigmatised chronic conditions including Myalgic Encephalomyelitis/Chronic fatigue syndrome (ME/CFS) and HIV [1720], emerging qualitative evidence on Long Covid stigma [9], and co-production with and feedback from people living with Long Covid. Response options were offered on a 5-point Likert scale: never, rarely, sometimes, often, and always, coded 0–4.

Hypothesised correlates for assessing concurrent criterion validity

For the purposes of assessing concurrent criterion validity, the follow-up survey also incorporated measures of depressive symptoms and disclosure concerns as these constructs have been consistently positively associated with health-related stigma [2123]. Depressive symptoms were measured via the eight-item Patient Health Questionnaire (PHQ-8), scored on a four-point Likert-type scale ranging from not at all (0) to nearly every day (3), usually used to assess current depressive symptoms in population-based studies [2426]. The total score was calculated as the sum of the individual item responses, with higher scores indicating greater depressive symptom severity. Disclosure concerns were measured via two items about being careful about disclosing information, or regretting having told people about their Long Covid [18]. Responses range from never (0) to always (4). The two items were combined into a total score, with higher scores indicating higher disclosure concerns.

Analysis strategy

Analyses presented in this paper focus on the UK follow-up survey sample. Evidence on other health conditions consistently suggests that stigma is sensitive to cultural and geographic contexts [27, 28]. Analyses based on the global follow-up survey sample are provided in S1S5 Tables.

Data were analysed using Stata v17 [29]. A descriptive preparatory phase examined frequencies, means, and standard deviations to capture the basic sociodemographic characteristics. This was followed by two phases.

Phase 1: Establishing the psychometric properties of the LCSS

Confirmatory factor analysis (CFA) tested whether LCSS consisted of the three hypothesised factors (stigma domains): anticipated, enacted and internalised stigma. Model fit was assessed via multiple goodness-of-fit measures. Comparative Fit Index (CFI) and Tucker Lewis Index (TLI) above 0.95 [30, 31], and Root Mean Square Error of Approximation (RMSEA) and standardised root mean-square residual (SRMR) values below 0.05 indicated good model fit [32]. χ2 was not used to assess goodness-of-fit as it is sensitive to sample size [33]. However, we report χ2/df as an additional measure of model fit, with values between 1 and 5 indicating good model fit [34, 35]. Internal consistency (Cronbach’s α) assessed reliability. Concurrent criterion validity was evaluated by examining associations between stigma scores and hypothesised correlates (PHQ-8 scores and disclosure concerns) in the full UK sample as well as the clinically diagnosed and undiagnosed/unsure sub-groups.

Phase 2: Estimating the burden of stigma experienced by people living with Long Covid

Two prevalence estimates were calculated. The first estimated prevalence of respondents who answered at least sometimes to one or more individual question within the overall stigma scale, and each sub-scale. The second estimated prevalence of respondents who answered often or always to one or more question within the overall scale and each sub-scale. These were also presented stratified by whether participants reported having a clinical diagnosis or not.

Results

Sample characteristics

A total of 1166 people completed the follow-up survey, of which 966 were from the UK. 888 responded to the LCSS questions. UK sample characteristics are described in Table 1 and full sample characteristics in S1 Table. The mean age of respondents was 48.3 (SD: 10.7), and 84.6% identified as female. The majority were living in England (81.4%), followed by Scotland (11.5%), Wales (6.1%) and Northern Ireland (0.9%). 75.5% of respondents were educated to university level or higher. Roughly half of respondents (n = 460, 50.4%) reported having a clinical diagnosis of Long Covid. 557 respondents (60.9%) said that they are very careful who they tell they have Long Covid at least ‘sometimes’, and 308 (33.7%) said that they regretted having told some people that they have Long Covid at least ‘sometimes’. Missing data were below 10% for all items, so cases were excluded list wise [36].

Table 1. UK sample characteristics (n = 966).

n %
Age (mean 48.3, SD 10.7)
 18–30 52 5.4
 31–45 321 33.5
 46–59 448 46.7
 ≥60 138 14.4
 Missing 7 0.7
Gender
 Male 139 14.5
 Female 811 84.6
 Non-binary or other 9 0.9
 Missing 7 0.7
Ethnicity
 White 914 95.5
 Minority ethnic 43 4.5
 Missing 9 0.9
Country of residence
 England 778 81.4
 Scotland 111 11.6
 Wales 58 6.1
 Northern Ireland 9 0.9
 Missing 10 1
Educational qualification
 No formal qualifications 10 1.0
 O levels or equivalent 95 9.8
 A levels or equivalent 131 13.6
 University degree or above 729 75.5
 Other 1 0.1
Duration of Long Covid illness
 <12 months 30 3.1
 12-<15 months 53 5.6
 15-<18 months 31 3.3
 >18 months 840 88.1
 Missing 12 1.2
Employment status
 Employed 653 65.6
 Unable to work 281 29.1
 Student/Volunteer 18 1.9
 Unemployed and looking for work 14 1.5
Clinical diagnosis of Long Covid received or on health record
 No 39 4.3
 Not sure 121 13.3
 Have test confirmation of initial Covid infection but no/not sure clinical diagnosis of Long Covid 53 5.8
 No official diagnosis but doctors suspect I have Long Covid 240 26.3
 Yes, Long Covid as a diagnosis on health record 460 50.4
 Missing 53 5.5
Long Covid Stigma Scale (LCSS) score, mean (SD) 20.4 ± 10.8
 Missing 78 8.1
Disclosure concerns score, mean (SD) 2.9 ± 2.3
 Missing 53 5.5
I am very careful who I tell that I have Long Covid
 At least ‘sometimes’ 557 60.9
 Often or always 296 32.3
I regret having told some people that I have Long Covid
 At least ‘sometimes’ 308 33.7
 Often or always 117 12.8
PHQ-8 score, mean (SD) 9.2 ± 5.8
 Missing 85 8.8

CFA results

Table 2 summarises item phrasing, response options and frequencies for stigma domains indicators that were included in the CFA. CFA was run on a 3-factor robust maximum likelihood (MLR) model. Enacted stigma items were constrained to load onto the enacted stigma factor; anticipated stigma items were constrained to load onto the anticipated stigma factor; and internalised stigma items were constrained to load onto the internalised stigma factor. Error terms were only allowed to be correlated between items on the same subscales.

Table 2. Response option frequencies for each stigma item.

Response options* Full UK sample (n = 888) Clinical diagnosis (n = 440) No clinical diagnosis/unsure
(n = 443)
0 1 2 3 4 0 1 2 3 4 0 1 2 3 4
Enacted stigma items
Because of my illness, some people seemed uncomfortable with me 27.5 20.7 37.4 13.3 1.1 18.6 21.4 43.9 14.8 1.4 36.1 20.1 31.4 11.5 0.9
Because of my illness, some people were unkind to me 50.0 21.0 22.8 6.2 0.1 43.0 23.2 27.5 6.4 - 56.9 18.7 18.3 5.9 0.2
People I care about stopped contacting me after learning I have Long Covid 55.0 15.7 19.7 8.9 0.8 43.0 18.4 26.1 12.1 0.5 66.8 13.1 13.3 5.6 1.1
People have acted as if I am dishonest since I have had Long Covid 47.3 19.7 22.2 9.4 1.5 43.4 20.9 23.9 10.9 0.9 51.2 18.5 20.5 7.7 2.0
I have been treated with less respect than other people are because of Long Covid 48.7 20.4 20.8 9.2 0.9 40.0 22.7 24.1 11.8 1.4 56.9 18.3 17.6 6.8 0.5
Internalised stigma items
I have felt embarrassed about my illness 25.9 11.6 31.3 22.9 8.3 19.8 11.4 32.1 26.8 10.0 31.6 12.0 30.9 19.0 6.6
I have felt embarrassed because of my physical limitations 15.1 9.1 29.4 32.2 14.2 9.8 7.5 28.0 37.5 17.3 20.1 10.8 30.9 27.3 10.8
I feel that I have been tainted by Long Covid and am of less value than others because of it 26.8 15.7 26.6 19.6 11.4 16.8 15.7 28.2 24.6 14.8 36.3 15.8 25.3 14.9 7.7
I have felt like I am very different from other people on account of Long Covid 17.8 14.6 32.7 22.0 13.0 11.1 13.2 31.1 28.6 15.9 24.4 15.8 34.3 15.6 9.9
Anticipated stigma items
Many people tend to think Long Covid isn’t a real illness 7.4 12.5 37.2 33.0 9.9 7.1 14.1 37.5 29.8 11.6 7.9 11.1 36.8 35.9 8.4
I feel that some people assume that having Long Covid is a sign of personal weakness 18.0 15.9 34.2 24.6 7.3 11.6 14.8 37.7 27.1 8.9 24.4 16.7 30.7 22.4 5.9
I worry that people with Long Covid lose their jobs when their employers find out 19.9 14.1 36.0 22.4 7.6 12.7 12.5 38.2 27.3 9.3 26.9 15.6 34.3 17.6 5.6
I worry that people may judge me negatively when they learn I have Long Covid 21.3 16.9 33.5 19.5 8.9 13.4 15.7 35.5 23.2 12.3 29.1 18.1 31.6 15.6 5.6

*Response options indicate 0:Never; 1:Rarely; 2:Sometimes; 3:Often; 4:Always.

Results of the CFA are presented in Table 3. Fit indices indicated that the model fitted the data well for the full UK sample, as well as both subsamples. Standardised factor loadings of indicators onto the latent constructs were high for all three domains, ranging between 0.70–0.86 for enacted, 0.75–0.84 for internalised, and 0.58–0.87 for anticipated stigma in the full UK sample.

Table 3. Factor loadings of individual stigma items on subscales of internalised, enacted and anticipated stigma using confirmatory factor analysis.

Full UK sample (n = 888) Clinical diagnosis (n = 440) No clinical diagnosis/unsure
(n = 443)
Enacted Internalised Anticipated Enacted Internalised Anticipated Enacted Internalised Anticipated
Because of my illness, some people seemed uncomfortable with me 0.78 0.74 0.78
Because of my illness, some people were unkind to me 0.79 0.81 0.77
People I care about stopped contacting me after learning I have Long Covid 0.70 0.66 0.71
People have acted as if I am dishonest since I have had Long Covid 0.76 0.77 0.79
I have been treated with less respect than other people are because of Long Covid 0.86 0.86 0.85
I have felt embarrassed about my illness 0.78 0.74 0.81
I have felt embarrassed because of my physical limitations 0.77 0.73 0.79
I feel that I have been tainted by Long Covid and am of less value than others because of it 0.84 0.82 0.83
I have felt like I am very different from other people on account of Long Covid 0.75 0.69 0.78
Many people tend to think Long Covid isn’t a real illness 0.65 0.70 0.66
I feel that some people assume that having Long Covid is a sign of personal weakness 0.78 0.78 0.77
I worry that people with Long Covid lose their jobs when their employers find out 0.58 0.52 0.59
I worry that people may judge me negatively when they learn I have Long Covid 0.87 0.84 0.87
CFI 0.971 0.972 0.971
TLI 0.958 0.959 0.958
RMSEA 0.064 0.062 0.064
SRMR 0.037 0.040 0.039
χ2/df 4.7 2.7 2.8
Cronbach’s alpha 0.88 0.86 0.82 0.88 0.85 0.81 0.89 0.87 0.83

Latent correlations between internalised and anticipated (r = 0.65, p<0.001) and enacted stigma (r = 0.57, p<0.001) were statistically significant. Anticipated and enacted stigma were also correlated (r = 0.67, p<0.001). Modifications to the measurement model were not necessary due to the good fit and factor loadings. Cronbach’s α were 0.82, 0.88 and 0.86 for anticipated, enacted and internalised stigma respectively.

Correlations testing concurrent criterion validity confirmed hypothesised relationships: the overall LCSS and the enacted, internalised and anticipated stigma subscales were consistently positively associated with PHQ-8 score and disclosure concerns (Table 4).

Table 4. Correlations between stigma scores, eight-item Patient Health Questionnaire (PHQ-8 score) and disclosure concerns.

Full UK sample Clinical diagnosis No clinical diagnosis/unsure
PHQ-8 score p-value Disclosure concerns p-value* PHQ-8 score p-value Disclosure concerns p-value* PHQ-8 score p-value Disclosure concerns p-value*
Overall LCSS 0.47 <0.001 0.61 <0.001 0.46 <0.001 0.64 <0.001 0.46 <0.001 0.61 <0.001
Enacted stigma subscale 0.35 <0.001 0.50 <0.001 0.32 <0.001 0.54 <0.001 0.32 <0.001 0.47 <0.001
Internalised stigma subscale 0.48 <0.001 0.52 <0.001 0.47 <0.001 0.53 <0.001 0.47 <0.001 0.51 <0.001
Anticipated stigma subscale 0.39 <0.001 0.59 <0.001 0.40 <0.001 0.59 <0.001 0.40 <0.001 0.59 <0.001

*Comparisons used Pearson’s correlation.

Prevalence of stigma

Two prevalence estimates are presented (Table 5). Based on the first estimate, prevalence of people experiencing overall stigma at least ‘sometimes’ was 95.4%; prevalence of enacted stigma was 62.7%; internalised stigma was 86.4%; and anticipated stigma was 90.8%. According to the more conservative estimate ‘often or always’, prevalence of overall, enacted, internalised and anticipated stigma experienced ‘often’ or ‘always’ was 75.9%, 25.3%, 59.7%, and 59.0% respectively. For all types of stigma and using both estimates, those with a clinical diagnosis of Long Covid had a higher prevalence than those without (Fig 1).

Table 5. Prevalence of stigma in the UK-based sample.

Experienced stigma at least ‘sometimes’ Experienced stigma often/always
Full UK sample Clinical diagnosis No clinical diagnosis/unsure p-value* Full UK sample Clinical diagnosis No clinical diagnosis/unsure p-value*
Overall LCSS 95.4 97.5 93.2 0.02 75.9 82.5 69.3 <0.001
Enacted stigma 62.7 70.7 55.1 <0.001 25.3 29.3 21.2 0.007
Internalised stigma 86.4 91.8 81.3 <0.001 59.7 70.0 49.4 <0.001
Anticipated stigma 90.8 93.2 88.3 0.007 59.0 63.6 54.6 0.004

*Comparisons between those with a clinical diagnosis and those with no clinical diagnosis/unsure used chi square test.

Fig 1. Prevalence estimates of stigma among people with diagnosed and undiagnosed Long Covid.

Fig 1

Discussion

Summary

This paper describes the development and validation of the first psychometric scale to measure stigma associated with Long Covid and offers the first quantitative estimate of the burden within a UK sample. The new scale captures three key domains—enacted, internalised and anticipated stigma. It demonstrated good psychometric properties within the overall sample, and sub-samples of those with and without Long Covid diagnoses.

Prevalence estimates using this new validated scale suggest that the majority of people with Long Covid are experiencing some form of stigma, with 95.4% experiencing at least one type at least ‘sometimes’, and 75.9% experiencing it ‘often’. Anticipated and internalised stigma were more frequently experienced than enacted stigma, in line with evidence of stigma associated with other concealable conditions [37, 38].

Prevalence of stigma was higher in those who reported having a clinical diagnosis of Long Covid. The reason is not clear. It may be that this group were exposed to more stereotyping or dismissal of their experience during their journey to obtaining a clinical diagnosis compared to those with no clinical diagnosis who perhaps had less interaction with services and others about their Long Covid. It may be that their Long Covid is more severe in nature making it more visible to others and/or more impactful in limiting everyday activities.

Strengths and limitations

LCSS was informed by theory and other stigma scales, co-designed with people with Long Covid and validated in a large UK sample, and takes less than 10 minutes to complete. This study has two notable limitations. First, the convenience non-probability sampling limits generalisability: university-educated white women from England are over-represented, and this may have resulted in an under- or over-estimation of Long Covid stigma. The prevalence of Long Covid in the UK is higher in females and in those aged 35–69 years [39]. The latest estimates from the UK’s Office of National Statistics also point to a higher prevalence in people living in more deprived areas, those working in social care, those aged 16 or over who are not in employment, and those with another activity-limiting health conditions [40]. Women and ethnic minorities may be more stigmatised by other similar conditions such as ME/CFS or fibromyalgia [41], though there is little quantitative evidence to support this. The survey did not include patients hospitalised with COVID-19 in the first two weeks of illness, indicating severe acute disease. Stigma levels could be higher in this group as they may have a higher prevalence of prolonged ongoing symptoms [42], or could be lower due to legitimisation of their illness given by the severity of its acute stage.

However, the community sample renders this study unique within a largely clinical evidence-base where diagnostic coding for Long Covid remains patchy and inconsistent due to varying knowledge and the absence of specific guidelines [43]. The social media recruitment strategy aimed to include an underrepresented group of people living with Long Covid–those not actively engaged with the healthcare system.

Second, stigma is a non-pathological construct and measurements do not have standardised diagnostic criteria. The aim is to capture frequency of specific experiences, and there is no agreed cut-off for measuring prevalence. This study sought to overcome potential bias by offering two different estimates, following cut-offs used in other studies on health-related stigma [44, 45]. This has resulted in divergent estimates capturing the percentage of people who experience different stigma mechanisms at least ‘sometimes’, and those who experience it often/always.

Comparison with existing literature

The new LCSS is an important addition to the growing number of existing scales for measuring stigma among people with acute COVID-19 infection [4648] or at risk of such infection [49]. The stigma associated with Long Covid is unique, requiring its own measurement tool; unlike acute COVID-19, Long Covid is a chronic, less well understood condition, often psychologised, and has serious implications for people’s long-term health and productivity.

Existing evidence on Long Covid stigma has been largely qualitative and anecdotal [811], which has been essential for describing and raising awareness around the issue. This study adds to ongoing narratives by quantifying the burden of stigma experienced by people living with Long Covid.

Implications for research and/or practice

Findings highlight widespread and multi-layered stigmas experienced by people living with Long Covid in the UK, which should be taken into consideration within clinical practice and healthcare policy. Whilst education about Long Covid may be an important first step, it is not a magic bullet for addressing stigma [50]. Evidence from other stigmatised health conditions suggests that interventions that facilitate social contact with the stigmatised group, advocacy and community mobilisation, as well as peer services may reduce both stigmatising attitudes and internalised stigma [51, 52]. Peer service providers would be uniquely positioned to foster non-judgmental environments and accountability to patients within Long Covid clinics and general practice.

Evidence from across health conditions and geographic contexts suggests Long Covid stigma could be hindering public health by compromising patients’ mental health and engagement with the health system. Developing evidence-based strategies to tackle Long Covid stigma requires a description of the problem, including prevalence estimates, and a validated scale that can capture changes in stigma over time. It is hoped that this study will enable further research on predictors of and interventions to address Long Covid stigma, including further exploring how the prevalence of such stigma differs by social and demographic factors. This would require efforts to recruit a more representative study sample with regards to age, ethnicity, profession and socioeconomic status. Adding measurement of stigma to the core outcomes recommended for Long Covid research would allow a more comprehensive assessment of the problem and provide insights on how to improve patient outcomes and reduce inequalities. More research on how stigma plays a role in changing the social identity of people with Long Covid is also needed.

Supporting information

S1 Table. Sample characteristics (n = 1166).

(DOCX)

S2 Table. Response option frequencies for each stigma item.

(DOCX)

S3 Table. Factor loadings of individual stigma items on subscales of internalised, enacted and anticipated stigma using confirmatory factor analysis.

(DOCX)

S4 Table. Correlations between stigma scores, eight-item Patient Health Questionnaire (PHQ-8 score) and disclosure concerns.

(DOCX)

S5 Table. Prevalence of reported stigma.

(DOCX)

Acknowledgments

We thank all participants for their time and commitment completing this survey. We also sincerely thank members of Long Covid Support’s COVID-19 Research Involvement Group for providing feedback on earlier versions of the questionnaire.

Data Availability

The survey data is available on request provided ethics committee approval for sharing the anonymized data is granted. To request access conditional on approval, please email "rgoinfo@soton.ac.uk," the University of Southampton’s Research Integrity and Governance team.

Funding Statement

The study received no specific funding.

References

  • 1.Goffman E. Stigma: Notes on the Management of Spoiled Identity. New Jersey, US: Prentice-Hall Inc.; 1963. [Google Scholar]
  • 2.Stangl AL, Earnshaw VA, Logie CH, Van Brakel W, Simbayi LC, Barré I, et al. The Health Stigma and Discrimination Framework: A global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC Med 2019;17:31. 10.1186/s12916-019-1271-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Earnshaw VA, Smith LR, Chaudoir SR, Amico KR, Copenhaver MM. HIV stigma mechanisms and well-being among PLWH: a test of the HIV stigma framework. AIDS Behav 2013;17:1785–95. 10.1007/s10461-013-0437-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Schnyder N, Panczak R, Groth N, Schultze-Lutter F. Association between mental health-related stigma and active help-seeking: Systematic review and meta-analysis. Br J Psychiatry 2017;210:261–8. 10.1192/bjp.bp.116.189464 [DOI] [PubMed] [Google Scholar]
  • 5.van Boekel LC, Brouwers EPM, van Weeghel J, Garretsen HFL. Stigma among health professionals towards patients with substance use disorders and its consequences for healthcare delivery: systematic review. Drug Alcohol Depend 2013;131:23–35. 10.1016/j.drugalcdep.2013.02.018 [DOI] [PubMed] [Google Scholar]
  • 6.Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV. A clinical case definition of post-COVID-19 condition by a Delphi consensus. Lancet Infect Dis 2022;22:e102–7. doi: 10.1016/S1473-3099(21)00703-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 6 May 2022. 2022.
  • 8.Burns S, Warren S. Learning from doctors with long covid. BMJ Opin 2021. https://blogs.bmj.com/bmj/2021/02/26/learning-from-doctors-with-long-covid/ (accessed March 11, 2021). [Google Scholar]
  • 9.Ladds E, Rushforth A, Wieringa S, Taylor S, Rayner C, Husain L, et al. Persistent symptoms after Covid-19: qualitative study of 114 “long Covid” patients and draft quality principles for services. BMC Health Serv Res 2020;20:1144. 10.1186/s12913-020-06001-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kingstone T, Taylor AK, O’Donnell CA, Atherton H, Blane DN, Chew-Graham CA. Finding the “right” GP: a qualitative study of the experiences of people with long-COVID. BJGP Open 2020;4:bjgpopen20X101143. 10.3399/bjgpopen20X101143 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Trueland J. The jobs that COVID crushed. BMA 2020. https://www.bma.org.uk/news-and-opinion/the-jobs-that-covid-crushed (accessed March 11, 2021).
  • 12.Earnshaw VA, Chaudoir SR. From conceptualizing to measuring HIV stigma: a review of HIV stigma mechanism measures. AIDS Behav 2009;13:1160–77. 10.1007/s10461-009-9593-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pantelic M, Sprague L, Stangl AL. It’s not “all in your head”: critical knowledge gaps on internalized HIV stigma and a call for integrating social and structural conceptualizations. BMC Infect Dis 2019;19:210. 10.1186/s12879-019-3704-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Quinn DM, Chaudoir SR. Living With a Concealable Stigmatized Identity: The Impact of Anticipated Stigma, Centrality, Salience, and Cultural Stigma on Psychological Distress and Health. J Pers Soc Psychol 2009;97:634. 10.1037/A0015815 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Ziauddeen N, Gurdasani D, O’Hara ME, Hastie C, Roderick PJ, Yao GL, et al. Characteristics and impact of Long Covid: findings from an online survey. PLOS ONE 2022;17:e0264331. doi: 10.1371/journal.pone.0264331 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Alwan NA. Lessons from Long COVID: working with patients to design better research. Nat Rev Immunol 2022;22:201–2. 10.1038/s41577-022-00692-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Terman JM, Awsumb JM, Cotler J, Jason LA. Confirmatory factor analysis of a myalgic encephalomyelitis and chronic fatigue syndrome stigma scale. J Health Psychol 2018;25:2352–61. 10.1177/1359105318796906 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Berger BE, Ferrans CE, Lashley FR. Measuring stigma in people with HIV: psychometric assessment of the HIV stigma scale. Res Nurs Health 2001;24:518–29. doi: 10.1002/nur.10011 [DOI] [PubMed] [Google Scholar]
  • 19.Williams DR, Gonzalez HM, Williams S, Mohammed SA, Moomal H, Steinor DJ. Perceived Discrimination, Race and Health in South Africa. Soc Sci Med 2008;67:441–52. doi: 10.1016/j.socscimed.2008.03.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Molina Y, Choi SW, Cella D, Rao D. The Stigma Scale for Chronic Illnesses 8-item version (SSCI-8): Development, validation, and use across neurological conditions. Int J Behav Med 2013;20:450–60. 10.1007/s12529-012-9243-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Evangeli M, Wroe AL. HIV Disclosure Anxiety: A Systematic Review and Theoretical Synthesis. AIDS Behav 2017;21:1–11. 10.1007/S10461-016-1453-3/TABLES/1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Benson A, O’Toole S, Lambert V, Gallagher P, Shahwan A, Austin JK. To tell or not to tell: A systematic review of the disclosure practices of children living with epilepsy and their parents. Epilepsy Behav 2015;51:73–95. 10.1016/J.YEBEH.2015.07.013 [DOI] [PubMed] [Google Scholar]
  • 23.Alimoradi Z, Golboni F, Griffiths MD, Broström A, Lin CY, Pakpour AH. Weight-related stigma and psychological distress: A systematic review and meta-analysis. Clin Nutr 2020;39:2001–13. 10.1016/J.CLNU.2019.10.016 [DOI] [PubMed] [Google Scholar]
  • 24.Shin C, Lee S-H, Han K-M, Yoon H-K, Han C. Comparison of the Usefulness of the PHQ-8 and PHQ-9 for Screening for Major Depressive Disorder: Analysis of Psychiatric Outpatient Data. Psychiatry Investig 2019;16:300–5. 10.30773/pi.2019.02.01 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Arias-de la Torre J, Vilagut G, Ronaldson A, Serrano-Blanco A, Martín V, Peters M, et al. Prevalence and variability of current depressive disorder in 27 European countries: a population-based study. Lancet Public Health 2021;6:e729–38. doi: 10.1016/S2468-2667(21)00047-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Arias-de la Torre J, Vilagut G, Ronaldson A, Serrano-Blanco A, Alonso J. PHQ-8 scores and estimation of depression prevalence–Author’s reply. Lancet Public Health 2021;6:e794. doi: 10.1016/S2468-2667(21)00226-7 [DOI] [PubMed] [Google Scholar]
  • 27.Scambler G. Health-related stigma. Sociol Health Illn 2009;31:441–55. 10.1111/j.1467-9566.2009.01161.x [DOI] [PubMed] [Google Scholar]
  • 28.Pantelic M, Boyes M, Cluver L, Thabeng M. ‘They Say HIV is a Punishment from God or from Ancestors’: Cross-Cultural Adaptation and Psychometric Assessment of an HIV Stigma Scale for South African Adolescents Living with HIV (ALHIV-SS). Child Indic Res 2018;11:207–23. 10.1007/s12187-016-9428-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Stata Statistical Software: Release 17 2021.
  • 30.Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990;107:238–46. doi: 10.1037/0033-2909.107.2.238 [DOI] [PubMed] [Google Scholar]
  • 31.Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model Multidiscip J 1999;6:1–55. 10.1080/10705519909540118. [DOI] [Google Scholar]
  • 32.Bowen N, Guo S. Structural Equation Modeling. Oxford: Oxford University Press, Inc.; 2012. [Google Scholar]
  • 33.Schermelleh-Engel K. Moosbrugger H, Müller H. Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodnessof-Fit Measures. Methods Psychol Res Online 2003;8:23–74. [Google Scholar]
  • 34.Hooper D, Coughlan J, Mullen M. Structural Equation Modelling: Guidelines for Determining Model Fit. Electron J Bus Res Methods 2008;6:53–60. doi: 10.21427/D7CF7R [DOI] [Google Scholar]
  • 35.Wheaton B, Muthen B, Alwin DF, Summers GF. Assessing Reliability and Stability in Panel Models. Sociol Methodol 1977;8:84. doi: 10.2307/270754 [DOI] [Google Scholar]
  • 36.Bennett DA. How can I deal with missing data in my study? Aust N Z J Public Health 2001;25:464–9. [PubMed] [Google Scholar]
  • 37.Sorsdahl KR, Mall S, Stein DJ, Joska JA. The prevalence and predictors of stigma amongst people living with HIV/AIDS in the Western Province. AIDS Care 2011;23:680–5. 10.1080/09540121.2010.525621 [DOI] [PubMed] [Google Scholar]
  • 38.NAPWA. The People Living with HIV Stigma Index. Germiston, South Africa: NAPWA-SA, The National Association of People living with HIV and AIDS in South Africa; 2012.
  • 39.Office for National Statistics. Technical article: Updated estimates of the prevalence of post-acute symptoms among people with coronavirus (COVID-19) in the UK: 26 April 2020 to 1 August 2021. 2021.
  • 40.Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 1 September 2022. 2022.
  • 41.Asbring P, Närvänen A-L. Women’s experiences of stigma in relation to chronic fatigue syndrome and fibromyalgia. Qual Health Res 2002;12:148–60. doi: 10.1177/104973230201200202 [DOI] [PubMed] [Google Scholar]
  • 42.PHOSP-COVID Collaborative Group. Clinical characteristics with inflammation profiling of long COVID and association with 1-year recovery following hospitalisation in the UK: a prospective observational study. Lancet Respir Med 2022:S2213-2600(22)00127-8. doi: 10.1016/S2213-2600(22)00127-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Walker AJ, MacKenna B, Inglesby P, Tomlinson L, Rentsch CT, Curtis HJ, et al. Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY. Br J Gen Pract 2021;71:e806–14. 10.3399/BJGP.2021.0301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Gerlinger G, Hauser M, De Hert M, Lacluyse K, Wampers M, Correll CU. Personal stigma in schizophrenia spectrum disorders: a systematic review of prevalence rates, correlates, impact and interventions. World Psychiatry Off J World Psychiatr Assoc WPA 2013;12:155–64. 10.1002/wps.20040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Pantelic M, Shenderovich Y, Cluver L, Boyes M. Predictors of internalised HIV-related stigma: a systematic review of studies in sub-Saharan Africa. Health Psychol Rev 2015;9:469–90. 10.1080/17437199.2014.996243 [DOI] [PubMed] [Google Scholar]
  • 46.Earnshaw VA, Brousseau NM, Hill EC, Kalichman SC, Eaton LA, Fox AB. Anticipated stigma, stereotypes, and COVID-19 testing. Stigma Health 2020;5:390–3. 10.1037/sah0000255. [DOI] [Google Scholar]
  • 47.Mostafa A, Mostafa NS, Ismail N. Validity and Reliability of a COVID-19 Stigma Scale Using Exploratory and Confirmatory Factor Analysis in a Sample of Egyptian Physicians: E16-COVID19-S. Int J Environ Res Public Health 2021;18:5451. 10.3390/ijerph18105451 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Nochaiwong S, Ruengorn C, Awiphan R, Kanjanarat P, Ruanta Y, Phosuya C, et al. COVID-19 Public Stigma Scale (COVID-PSS): development, validation, psychometric analysis and interpretation. BMJ Open 2021;11:e048241. 10.1136/bmjopen-2020-048241 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Li T, Bu H, Duan W. A brief measure of perceived courtesy and affiliate stigma on COVID-19: A study with a sample from China. Personal Individ Differ 2021;180:110993. 10.1016/j.paid.2021.110993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Pantelic M, Steinert JI, Park J, Mellors S, Murau F. ‘Management of a spoiled identity’: systematic review of interventions to address self-stigma among people living with and affected by HIV. BMJ Glob Health 2019;4:e001285. 10.1136/bmjgh-2018-001285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.National Academies of Sciences, Engineering, and Medicine (U.S.), editor. Ending discrimination against people with mental and substance use disorders: the evidence for stigma change. Washington, DC: The National Academies Press; 2016. [PubMed] [Google Scholar]
  • 52.Van de Vyver J, Leite AC, Alwan NA. Navigating the social identity of long covid. BMJ 2021:n2933. 10.1136/bmj.n2933 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Dong Keon Yon

15 Aug 2022

PONE-D-22-19124Long Covid stigma: estimating burden and validating scale in a UK-based samplePLOS ONE

Dear Dr. Ziauddeen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 29 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Dong Keon Yon, MD, FACAAI

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

Additional Editor Comments:

I read it with great interest. Please address excellent comments from the reviewers.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The study is very relevant . My only concern in with the use of sometimes/often etc as a scale. As a scale I think you move from 'sometimes' to 'often' to 'more often', then 'always'. I therefore think the authors should use 'sometime/often' and 'more often/always' as opposed to 'sometimes/more often' and 'often/always.

For the rest methods and results, I do not have adequate statistical expertise to evaluate.

Reviewer #2: Manuscript has been written in an intelligible fashion and in depth statistical analysis has been performed.It presented with a good flow and very understandable manner. It is very useful study in the present context. I congratulate all authors for their heard work.

Reviewer #3: Overall, an interesting read and very well written. Would like to see a bit more discussion on this limitation: university educated white women from England are over-represented. Do you have any information on the prevalence of Long Covid in the UK and who is most impacted? Men or women? Socioeconomic status? Age? Etc. I don't have a point of comparison for understanding the results. Also would the next steps be to get a more generalizable sample across SES? It may be that your results will be different with a more diverse sample. An interesting future article would be to look at how stigma differs by gender, SES, age, etc.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Nov 23;17(11):e0277317. doi: 10.1371/journal.pone.0277317.r002

Author response to Decision Letter 0


27 Sep 2022

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

Thank you, we have formatted the manuscript in line with PLOS ONE’s style requirements.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Written consent was recorded digitally on the survey platforms (details in lines 93-95). The survey was restricted to adults aged 18 years and over (line 84).

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

This study received no specific funding as stated in the funding information and financial disclosure sections. The funding information in the manuscript has been updated so the sections match.

Additional Editor Comments:

I read it with great interest. Please address excellent comments from the reviewers.

Thank you.

Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The study is very relevant . My only concern in with the use of sometimes/often etc as a scale. As a scale I think you move from 'sometimes' to 'often' to 'more often', then 'always'. I therefore think the authors should use 'sometime/often' and 'more often/always' as opposed to 'sometimes/more often' and 'often/always.

The possible responses to the scale were never, rarely, sometimes, often, and always. We created two condensed categories: 1) those who responded sometimes/often/always to reflect the proportion of those experiencing stigma at least sometimes (referred to as ‘sometimes or more often’ in the tables) and 2) a more conservative estimate of those who responded often/always to reflect the proportion of those experiencing some stigma more frequently (‘referred to often and always’ in the tables). For the avoidance of confusion, we have now updated any reference to the former to ‘at least sometimes’ throughout the manuscript and have kept the description of the latter to ‘often or always’

For the rest methods and results, I do not have adequate statistical expertise to evaluate.

Reviewer #2: Manuscript has been written in an intelligible fashion and in depth statistical analysis has been performed. It presented with a good flow and very understandable manner. It is very useful study in the present context. I congratulate all authors for their heard work.

Thank you.

Reviewer #3: Overall, an interesting read and very well written. Would like to see a bit more discussion on this limitation: university educated white women from England are over-represented. Do you have any information on the prevalence of Long Covid in the UK and who is most impacted? Men or women? Socioeconomic status? Age? Etc. I don't have a point of comparison for understanding the results. Also would the next steps be to get a more generalizable sample across SES? It may be that your results will be different with a more diverse sample. An interesting future article would be to look at how stigma differs by gender, SES, age, etc.

Thank you, we have added more information in the discussion section on prevalence rates in lines (218-222). In the UK, prevalence of Long Covid in higher in women and in adults aged 35-69 years and in more deprived communities.

We agree with the reviewer’s suggestions about future research directions on this topic and have added this to the discussion (lines 262-264). We thank the reviewer for suggesting these thoughtful discussion points.

Attachment

Submitted filename: Response-DataAvailability.docx

Decision Letter 1

Dong Keon Yon

25 Oct 2022

Long Covid stigma: estimating burden and validating scale in a UK-based sample

PONE-D-22-19124R1

Dear Dr. Ziauddeen,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Dong Keon Yon, MD, FACAAI

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

This is an excellent paper.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I thank all author for their wounder full work. Authors have address all the review comments and re arrange the manuscript. It is a very interesting study.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Sample characteristics (n = 1166).

    (DOCX)

    S2 Table. Response option frequencies for each stigma item.

    (DOCX)

    S3 Table. Factor loadings of individual stigma items on subscales of internalised, enacted and anticipated stigma using confirmatory factor analysis.

    (DOCX)

    S4 Table. Correlations between stigma scores, eight-item Patient Health Questionnaire (PHQ-8 score) and disclosure concerns.

    (DOCX)

    S5 Table. Prevalence of reported stigma.

    (DOCX)

    Attachment

    Submitted filename: Response-DataAvailability.docx

    Data Availability Statement

    The survey data is available on request provided ethics committee approval for sharing the anonymized data is granted. To request access conditional on approval, please email "rgoinfo@soton.ac.uk," the University of Southampton’s Research Integrity and Governance team.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES