Abstract
Background
Stigma can be experienced as perceived or actual disqualification from social and institutional acceptance on the basis of one or more physical, behavioural or other attributes deemed to be undesirable. Long Covid is a predominantly multisystem condition that occurs in people with a history of SARSCoV2 infection, often resulting in functional disability. This study aimed to develop and validate a Long Covid Stigma Scale (LCSS); and to quantify the burden of Long Covid stigma.
Methods
Data from the follow-up of a co-produced community-based Long Covid online survey using convenience non-probability sampling was used. Thirteen questions on stigma were designed to develop the LCSS capturing three domains–enacted (overt experiences of discrimination), internalised (internalising negative associations with Long Covid and accepting them as self-applicable) and anticipated (expectation of bias/poor treatment by others) stigma. Confirmatory factor analysis tested whether LCSS consisted of the three hypothesised domains. Model fit was assessed and prevalence was calculated.
Results
966 UK-based participants responded (888 for stigma questions), with mean age 48 years (SD: 10.7) and 85% female. Factor loadings for enacted stigma were 0.70–0.86, internalised 0.75–0.84, anticipated 0.58–0.87, and model fit was good. The prevalence of experiencing stigma at least ‘sometimes’ and ‘often/always’ was 95% and 76% respectively. Anticipated and internalised stigma were more frequently experienced than enacted stigma. Those who reported having a clinical diagnosis of Long Covid had higher stigma prevalence than those without.
Conclusion
This study establishes a scale to measure Long Covid stigma and highlights common experiences of stigma in people living with Long Covid.
Introduction
Stigma is a process through which individuals are ‘disqualified from full social acceptance’ due to a physical, health and/or behavioural attribute deemed to be ‘deeply discrediting’ [1]. The detriment of stigma on both patient and health service delivery outcomes has been well-documented globally. Stigma–and the resultant fears of being ostracised or discredited–drives people underground and away from health services and contributes to psychological distress, thus compromising long-term physical health outcomes [2–5].
Long Covid is a predominantly multisystem condition that occurs in people following SARSCoV2 infection, often resulting in prolonged ill health and functional disability limiting their day-to-day activities including work, learning, care, and leisure activities [6]. In the UK alone, it is estimated that 1.8 million people currently have Long Covid for a duration of at least 4 weeks, out of those 791,000 have had it for at least one year and 235,000 for at least 2 years [7]. Emerging testimonies illustrate profound stigmas experienced by people living with Long Covid [8–11].
People living with poorly understood and managed health conditions such as Long Covid may experience stigma through three main mechanisms [2]. Enacted stigma refers to direct overt experiences of discrimination, whereby individuals are treated unfairly due to their health condition [12]. Internalised stigma occurs when people adopt negative associations with a health condition and accept them to be true and applicable to themselves; this is characterised by feelings of shame and worthlessness [13]. Anticipated stigma is the expectation of bias or poor treatment by others [14]. These mechanisms can occur independently from each other–for example, a person may anticipate stigma, decide against disclosing their health condition or seeking treatment and therefore avoid enacted stigma. Nonetheless, all three stigma mechanisms may undermine people’s emotional wellbeing, health seeking behaviours, and physical and mental health outcomes [3].
Research on Long Covid stigma is still in nascent stages. To the best of our knowledge, the extent of stigma experienced by people living with Long Covid has not been quantified using a specific scale, and evidence-based stigma reduction strategies are lacking. One of the reasons for this is a lack of a validated quantitative scale for measuring Long Covid stigma.
This study has two aims: 1) To validate a new Long Covid Stigma Scale (LCSS) and establish its basic psychometric properties; and 2) To quantify the burden of stigma, with its three domains of enacted, anticipated and internalised, as experienced in a UK community-based sample of people with lived experience of Long Covid.
Methods
Data from the follow-up of a Long Covid online survey was used [15]. The baseline survey, administered in November 2020 (n = 2550), utilised convenience non-probability sampling via social media to ensure recruitment of a community sample of people who identify as living with Long Covid [15].
The survey was restricted to adults aged 18 years or over who had COVID-19 (confirmed or suspected) and were not hospitalised for the treatment of COVID-19 in the first two weeks of experiencing symptoms. The original scope was decided as very little research was being conducted at the time to describe prolonged illness following non-hospitalised SARSCoV2 infection and most research was focusing on those who were admitted to the hospital during their acute COVID19 illness. People who experienced COVID-19 symptoms and did not require hospital admission during Spring 2020 in the UK largely did not have access to testing, leaving many people with undiagnosed COVID-19 and Long Covid. To enable inclusion of this population, the survey was open to people who did not have lab confirmation of their infection, but had suspected or clinically diagnosed COVID-19.
Participants provided written informed consent (recorded digitally on the survey platforms). Participants had to consent separately to participating in the baseline and follow-up survey before they could access the questionnaire. Responses were anonymous in the baseline survey, but participants who were willing to be contacted for a follow-up survey were asked to consent to future contact and provide contact details. 2210 (86.7%) individuals consented to future contact. One year from the baseline survey, in November 2021, the same participants were invited to complete the follow-up survey. The survey was not open to new participants who did not take part in the baseline survey. Ethical approval was granted by the University of Southampton Faculty of Medicine Ethics Committee (ID 61434).
Measures
The survey was co-produced working with public contributors (MEO, CH), who have lived experience of and provide peer support to others with Long Covid [16]. NAA also had lived experience of Long Covid. Public contributor members of the COVID-19 Research Involvement Group provided feedback on early versions of the questionnaire which was amended accordingly. Qualtrics was used as the platform for the follow-up following feedback from the baseline survey about user-friendliness.
Questions included demographic information, ability to work, current employment status, pattern of illness and impact on health, symptoms that have remained over the longer-term course, clinical diagnosis of Long Covid and other conditions, vaccination, and experiences of stigma. In this paper, we focus on reporting the stigma-related results of the follow-up survey.
Long Covid Stigma Scale (LCSS)
For the follow up survey, thirteen questions on stigma were designed following the Health Stigma and Discrimination Framework [2] to capture three dimensions/domains: enacted (5 items), internalised (4 items), and anticipated (4 items). Questions were based on existing scales related to other stigmatised chronic conditions including Myalgic Encephalomyelitis/Chronic fatigue syndrome (ME/CFS) and HIV [17–20], emerging qualitative evidence on Long Covid stigma [9], and co-production with and feedback from people living with Long Covid. Response options were offered on a 5-point Likert scale: never, rarely, sometimes, often, and always, coded 0–4.
Hypothesised correlates for assessing concurrent criterion validity
For the purposes of assessing concurrent criterion validity, the follow-up survey also incorporated measures of depressive symptoms and disclosure concerns as these constructs have been consistently positively associated with health-related stigma [21–23]. Depressive symptoms were measured via the eight-item Patient Health Questionnaire (PHQ-8), scored on a four-point Likert-type scale ranging from not at all (0) to nearly every day (3), usually used to assess current depressive symptoms in population-based studies [24–26]. The total score was calculated as the sum of the individual item responses, with higher scores indicating greater depressive symptom severity. Disclosure concerns were measured via two items about being careful about disclosing information, or regretting having told people about their Long Covid [18]. Responses range from never (0) to always (4). The two items were combined into a total score, with higher scores indicating higher disclosure concerns.
Analysis strategy
Analyses presented in this paper focus on the UK follow-up survey sample. Evidence on other health conditions consistently suggests that stigma is sensitive to cultural and geographic contexts [27, 28]. Analyses based on the global follow-up survey sample are provided in S1–S5 Tables.
Data were analysed using Stata v17 [29]. A descriptive preparatory phase examined frequencies, means, and standard deviations to capture the basic sociodemographic characteristics. This was followed by two phases.
Phase 1: Establishing the psychometric properties of the LCSS
Confirmatory factor analysis (CFA) tested whether LCSS consisted of the three hypothesised factors (stigma domains): anticipated, enacted and internalised stigma. Model fit was assessed via multiple goodness-of-fit measures. Comparative Fit Index (CFI) and Tucker Lewis Index (TLI) above 0.95 [30, 31], and Root Mean Square Error of Approximation (RMSEA) and standardised root mean-square residual (SRMR) values below 0.05 indicated good model fit [32]. χ2 was not used to assess goodness-of-fit as it is sensitive to sample size [33]. However, we report χ2/df as an additional measure of model fit, with values between 1 and 5 indicating good model fit [34, 35]. Internal consistency (Cronbach’s α) assessed reliability. Concurrent criterion validity was evaluated by examining associations between stigma scores and hypothesised correlates (PHQ-8 scores and disclosure concerns) in the full UK sample as well as the clinically diagnosed and undiagnosed/unsure sub-groups.
Phase 2: Estimating the burden of stigma experienced by people living with Long Covid
Two prevalence estimates were calculated. The first estimated prevalence of respondents who answered at least sometimes to one or more individual question within the overall stigma scale, and each sub-scale. The second estimated prevalence of respondents who answered often or always to one or more question within the overall scale and each sub-scale. These were also presented stratified by whether participants reported having a clinical diagnosis or not.
Results
Sample characteristics
A total of 1166 people completed the follow-up survey, of which 966 were from the UK. 888 responded to the LCSS questions. UK sample characteristics are described in Table 1 and full sample characteristics in S1 Table. The mean age of respondents was 48.3 (SD: 10.7), and 84.6% identified as female. The majority were living in England (81.4%), followed by Scotland (11.5%), Wales (6.1%) and Northern Ireland (0.9%). 75.5% of respondents were educated to university level or higher. Roughly half of respondents (n = 460, 50.4%) reported having a clinical diagnosis of Long Covid. 557 respondents (60.9%) said that they are very careful who they tell they have Long Covid at least ‘sometimes’, and 308 (33.7%) said that they regretted having told some people that they have Long Covid at least ‘sometimes’. Missing data were below 10% for all items, so cases were excluded list wise [36].
Table 1. UK sample characteristics (n = 966).
| n | % | |
|---|---|---|
| Age (mean 48.3, SD 10.7) | ||
| 18–30 | 52 | 5.4 |
| 31–45 | 321 | 33.5 |
| 46–59 | 448 | 46.7 |
| ≥60 | 138 | 14.4 |
| Missing | 7 | 0.7 |
| Gender | ||
| Male | 139 | 14.5 |
| Female | 811 | 84.6 |
| Non-binary or other | 9 | 0.9 |
| Missing | 7 | 0.7 |
| Ethnicity | ||
| White | 914 | 95.5 |
| Minority ethnic | 43 | 4.5 |
| Missing | 9 | 0.9 |
| Country of residence | ||
| England | 778 | 81.4 |
| Scotland | 111 | 11.6 |
| Wales | 58 | 6.1 |
| Northern Ireland | 9 | 0.9 |
| Missing | 10 | 1 |
| Educational qualification | ||
| No formal qualifications | 10 | 1.0 |
| O levels or equivalent | 95 | 9.8 |
| A levels or equivalent | 131 | 13.6 |
| University degree or above | 729 | 75.5 |
| Other | 1 | 0.1 |
| Duration of Long Covid illness | ||
| <12 months | 30 | 3.1 |
| 12-<15 months | 53 | 5.6 |
| 15-<18 months | 31 | 3.3 |
| >18 months | 840 | 88.1 |
| Missing | 12 | 1.2 |
| Employment status | ||
| Employed | 653 | 65.6 |
| Unable to work | 281 | 29.1 |
| Student/Volunteer | 18 | 1.9 |
| Unemployed and looking for work | 14 | 1.5 |
| Clinical diagnosis of Long Covid received or on health record | ||
| No | 39 | 4.3 |
| Not sure | 121 | 13.3 |
| Have test confirmation of initial Covid infection but no/not sure clinical diagnosis of Long Covid | 53 | 5.8 |
| No official diagnosis but doctors suspect I have Long Covid | 240 | 26.3 |
| Yes, Long Covid as a diagnosis on health record | 460 | 50.4 |
| Missing | 53 | 5.5 |
| Long Covid Stigma Scale (LCSS) score, mean (SD) | 20.4 ± 10.8 | |
| Missing | 78 | 8.1 |
| Disclosure concerns score, mean (SD) | 2.9 ± 2.3 | |
| Missing | 53 | 5.5 |
| I am very careful who I tell that I have Long Covid | ||
| At least ‘sometimes’ | 557 | 60.9 |
| Often or always | 296 | 32.3 |
| I regret having told some people that I have Long Covid | ||
| At least ‘sometimes’ | 308 | 33.7 |
| Often or always | 117 | 12.8 |
| PHQ-8 score, mean (SD) | 9.2 ± 5.8 | |
| Missing | 85 | 8.8 |
CFA results
Table 2 summarises item phrasing, response options and frequencies for stigma domains indicators that were included in the CFA. CFA was run on a 3-factor robust maximum likelihood (MLR) model. Enacted stigma items were constrained to load onto the enacted stigma factor; anticipated stigma items were constrained to load onto the anticipated stigma factor; and internalised stigma items were constrained to load onto the internalised stigma factor. Error terms were only allowed to be correlated between items on the same subscales.
Table 2. Response option frequencies for each stigma item.
| Response options* | Full UK sample (n = 888) | Clinical diagnosis (n = 440) | No clinical diagnosis/unsure (n = 443) |
||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 1 | 2 | 3 | 4 | 0 | 1 | 2 | 3 | 4 | 0 | 1 | 2 | 3 | 4 | |
| Enacted stigma items | |||||||||||||||
| Because of my illness, some people seemed uncomfortable with me | 27.5 | 20.7 | 37.4 | 13.3 | 1.1 | 18.6 | 21.4 | 43.9 | 14.8 | 1.4 | 36.1 | 20.1 | 31.4 | 11.5 | 0.9 |
| Because of my illness, some people were unkind to me | 50.0 | 21.0 | 22.8 | 6.2 | 0.1 | 43.0 | 23.2 | 27.5 | 6.4 | - | 56.9 | 18.7 | 18.3 | 5.9 | 0.2 |
| People I care about stopped contacting me after learning I have Long Covid | 55.0 | 15.7 | 19.7 | 8.9 | 0.8 | 43.0 | 18.4 | 26.1 | 12.1 | 0.5 | 66.8 | 13.1 | 13.3 | 5.6 | 1.1 |
| People have acted as if I am dishonest since I have had Long Covid | 47.3 | 19.7 | 22.2 | 9.4 | 1.5 | 43.4 | 20.9 | 23.9 | 10.9 | 0.9 | 51.2 | 18.5 | 20.5 | 7.7 | 2.0 |
| I have been treated with less respect than other people are because of Long Covid | 48.7 | 20.4 | 20.8 | 9.2 | 0.9 | 40.0 | 22.7 | 24.1 | 11.8 | 1.4 | 56.9 | 18.3 | 17.6 | 6.8 | 0.5 |
| Internalised stigma items | |||||||||||||||
| I have felt embarrassed about my illness | 25.9 | 11.6 | 31.3 | 22.9 | 8.3 | 19.8 | 11.4 | 32.1 | 26.8 | 10.0 | 31.6 | 12.0 | 30.9 | 19.0 | 6.6 |
| I have felt embarrassed because of my physical limitations | 15.1 | 9.1 | 29.4 | 32.2 | 14.2 | 9.8 | 7.5 | 28.0 | 37.5 | 17.3 | 20.1 | 10.8 | 30.9 | 27.3 | 10.8 |
| I feel that I have been tainted by Long Covid and am of less value than others because of it | 26.8 | 15.7 | 26.6 | 19.6 | 11.4 | 16.8 | 15.7 | 28.2 | 24.6 | 14.8 | 36.3 | 15.8 | 25.3 | 14.9 | 7.7 |
| I have felt like I am very different from other people on account of Long Covid | 17.8 | 14.6 | 32.7 | 22.0 | 13.0 | 11.1 | 13.2 | 31.1 | 28.6 | 15.9 | 24.4 | 15.8 | 34.3 | 15.6 | 9.9 |
| Anticipated stigma items | |||||||||||||||
| Many people tend to think Long Covid isn’t a real illness | 7.4 | 12.5 | 37.2 | 33.0 | 9.9 | 7.1 | 14.1 | 37.5 | 29.8 | 11.6 | 7.9 | 11.1 | 36.8 | 35.9 | 8.4 |
| I feel that some people assume that having Long Covid is a sign of personal weakness | 18.0 | 15.9 | 34.2 | 24.6 | 7.3 | 11.6 | 14.8 | 37.7 | 27.1 | 8.9 | 24.4 | 16.7 | 30.7 | 22.4 | 5.9 |
| I worry that people with Long Covid lose their jobs when their employers find out | 19.9 | 14.1 | 36.0 | 22.4 | 7.6 | 12.7 | 12.5 | 38.2 | 27.3 | 9.3 | 26.9 | 15.6 | 34.3 | 17.6 | 5.6 |
| I worry that people may judge me negatively when they learn I have Long Covid | 21.3 | 16.9 | 33.5 | 19.5 | 8.9 | 13.4 | 15.7 | 35.5 | 23.2 | 12.3 | 29.1 | 18.1 | 31.6 | 15.6 | 5.6 |
*Response options indicate 0:Never; 1:Rarely; 2:Sometimes; 3:Often; 4:Always.
Results of the CFA are presented in Table 3. Fit indices indicated that the model fitted the data well for the full UK sample, as well as both subsamples. Standardised factor loadings of indicators onto the latent constructs were high for all three domains, ranging between 0.70–0.86 for enacted, 0.75–0.84 for internalised, and 0.58–0.87 for anticipated stigma in the full UK sample.
Table 3. Factor loadings of individual stigma items on subscales of internalised, enacted and anticipated stigma using confirmatory factor analysis.
| Full UK sample (n = 888) | Clinical diagnosis (n = 440) | No clinical diagnosis/unsure (n = 443) |
|||||||
|---|---|---|---|---|---|---|---|---|---|
| Enacted | Internalised | Anticipated | Enacted | Internalised | Anticipated | Enacted | Internalised | Anticipated | |
| Because of my illness, some people seemed uncomfortable with me | 0.78 | 0.74 | 0.78 | ||||||
| Because of my illness, some people were unkind to me | 0.79 | 0.81 | 0.77 | ||||||
| People I care about stopped contacting me after learning I have Long Covid | 0.70 | 0.66 | 0.71 | ||||||
| People have acted as if I am dishonest since I have had Long Covid | 0.76 | 0.77 | 0.79 | ||||||
| I have been treated with less respect than other people are because of Long Covid | 0.86 | 0.86 | 0.85 | ||||||
| I have felt embarrassed about my illness | 0.78 | 0.74 | 0.81 | ||||||
| I have felt embarrassed because of my physical limitations | 0.77 | 0.73 | 0.79 | ||||||
| I feel that I have been tainted by Long Covid and am of less value than others because of it | 0.84 | 0.82 | 0.83 | ||||||
| I have felt like I am very different from other people on account of Long Covid | 0.75 | 0.69 | 0.78 | ||||||
| Many people tend to think Long Covid isn’t a real illness | 0.65 | 0.70 | 0.66 | ||||||
| I feel that some people assume that having Long Covid is a sign of personal weakness | 0.78 | 0.78 | 0.77 | ||||||
| I worry that people with Long Covid lose their jobs when their employers find out | 0.58 | 0.52 | 0.59 | ||||||
| I worry that people may judge me negatively when they learn I have Long Covid | 0.87 | 0.84 | 0.87 | ||||||
| CFI | 0.971 | 0.972 | 0.971 | ||||||
| TLI | 0.958 | 0.959 | 0.958 | ||||||
| RMSEA | 0.064 | 0.062 | 0.064 | ||||||
| SRMR | 0.037 | 0.040 | 0.039 | ||||||
| χ2/df | 4.7 | 2.7 | 2.8 | ||||||
| Cronbach’s alpha | 0.88 | 0.86 | 0.82 | 0.88 | 0.85 | 0.81 | 0.89 | 0.87 | 0.83 |
Latent correlations between internalised and anticipated (r = 0.65, p<0.001) and enacted stigma (r = 0.57, p<0.001) were statistically significant. Anticipated and enacted stigma were also correlated (r = 0.67, p<0.001). Modifications to the measurement model were not necessary due to the good fit and factor loadings. Cronbach’s α were 0.82, 0.88 and 0.86 for anticipated, enacted and internalised stigma respectively.
Correlations testing concurrent criterion validity confirmed hypothesised relationships: the overall LCSS and the enacted, internalised and anticipated stigma subscales were consistently positively associated with PHQ-8 score and disclosure concerns (Table 4).
Table 4. Correlations between stigma scores, eight-item Patient Health Questionnaire (PHQ-8 score) and disclosure concerns.
| Full UK sample | Clinical diagnosis | No clinical diagnosis/unsure | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PHQ-8 score | p-value | Disclosure concerns | p-value* | PHQ-8 score | p-value | Disclosure concerns | p-value* | PHQ-8 score | p-value | Disclosure concerns | p-value* | |
| Overall LCSS | 0.47 | <0.001 | 0.61 | <0.001 | 0.46 | <0.001 | 0.64 | <0.001 | 0.46 | <0.001 | 0.61 | <0.001 |
| Enacted stigma subscale | 0.35 | <0.001 | 0.50 | <0.001 | 0.32 | <0.001 | 0.54 | <0.001 | 0.32 | <0.001 | 0.47 | <0.001 |
| Internalised stigma subscale | 0.48 | <0.001 | 0.52 | <0.001 | 0.47 | <0.001 | 0.53 | <0.001 | 0.47 | <0.001 | 0.51 | <0.001 |
| Anticipated stigma subscale | 0.39 | <0.001 | 0.59 | <0.001 | 0.40 | <0.001 | 0.59 | <0.001 | 0.40 | <0.001 | 0.59 | <0.001 |
*Comparisons used Pearson’s correlation.
Prevalence of stigma
Two prevalence estimates are presented (Table 5). Based on the first estimate, prevalence of people experiencing overall stigma at least ‘sometimes’ was 95.4%; prevalence of enacted stigma was 62.7%; internalised stigma was 86.4%; and anticipated stigma was 90.8%. According to the more conservative estimate ‘often or always’, prevalence of overall, enacted, internalised and anticipated stigma experienced ‘often’ or ‘always’ was 75.9%, 25.3%, 59.7%, and 59.0% respectively. For all types of stigma and using both estimates, those with a clinical diagnosis of Long Covid had a higher prevalence than those without (Fig 1).
Table 5. Prevalence of stigma in the UK-based sample.
| Experienced stigma at least ‘sometimes’ | Experienced stigma often/always | |||||||
|---|---|---|---|---|---|---|---|---|
| Full UK sample | Clinical diagnosis | No clinical diagnosis/unsure | p-value* | Full UK sample | Clinical diagnosis | No clinical diagnosis/unsure | p-value* | |
| Overall LCSS | 95.4 | 97.5 | 93.2 | 0.02 | 75.9 | 82.5 | 69.3 | <0.001 |
| Enacted stigma | 62.7 | 70.7 | 55.1 | <0.001 | 25.3 | 29.3 | 21.2 | 0.007 |
| Internalised stigma | 86.4 | 91.8 | 81.3 | <0.001 | 59.7 | 70.0 | 49.4 | <0.001 |
| Anticipated stigma | 90.8 | 93.2 | 88.3 | 0.007 | 59.0 | 63.6 | 54.6 | 0.004 |
*Comparisons between those with a clinical diagnosis and those with no clinical diagnosis/unsure used chi square test.
Fig 1. Prevalence estimates of stigma among people with diagnosed and undiagnosed Long Covid.
Discussion
Summary
This paper describes the development and validation of the first psychometric scale to measure stigma associated with Long Covid and offers the first quantitative estimate of the burden within a UK sample. The new scale captures three key domains—enacted, internalised and anticipated stigma. It demonstrated good psychometric properties within the overall sample, and sub-samples of those with and without Long Covid diagnoses.
Prevalence estimates using this new validated scale suggest that the majority of people with Long Covid are experiencing some form of stigma, with 95.4% experiencing at least one type at least ‘sometimes’, and 75.9% experiencing it ‘often’. Anticipated and internalised stigma were more frequently experienced than enacted stigma, in line with evidence of stigma associated with other concealable conditions [37, 38].
Prevalence of stigma was higher in those who reported having a clinical diagnosis of Long Covid. The reason is not clear. It may be that this group were exposed to more stereotyping or dismissal of their experience during their journey to obtaining a clinical diagnosis compared to those with no clinical diagnosis who perhaps had less interaction with services and others about their Long Covid. It may be that their Long Covid is more severe in nature making it more visible to others and/or more impactful in limiting everyday activities.
Strengths and limitations
LCSS was informed by theory and other stigma scales, co-designed with people with Long Covid and validated in a large UK sample, and takes less than 10 minutes to complete. This study has two notable limitations. First, the convenience non-probability sampling limits generalisability: university-educated white women from England are over-represented, and this may have resulted in an under- or over-estimation of Long Covid stigma. The prevalence of Long Covid in the UK is higher in females and in those aged 35–69 years [39]. The latest estimates from the UK’s Office of National Statistics also point to a higher prevalence in people living in more deprived areas, those working in social care, those aged 16 or over who are not in employment, and those with another activity-limiting health conditions [40]. Women and ethnic minorities may be more stigmatised by other similar conditions such as ME/CFS or fibromyalgia [41], though there is little quantitative evidence to support this. The survey did not include patients hospitalised with COVID-19 in the first two weeks of illness, indicating severe acute disease. Stigma levels could be higher in this group as they may have a higher prevalence of prolonged ongoing symptoms [42], or could be lower due to legitimisation of their illness given by the severity of its acute stage.
However, the community sample renders this study unique within a largely clinical evidence-base where diagnostic coding for Long Covid remains patchy and inconsistent due to varying knowledge and the absence of specific guidelines [43]. The social media recruitment strategy aimed to include an underrepresented group of people living with Long Covid–those not actively engaged with the healthcare system.
Second, stigma is a non-pathological construct and measurements do not have standardised diagnostic criteria. The aim is to capture frequency of specific experiences, and there is no agreed cut-off for measuring prevalence. This study sought to overcome potential bias by offering two different estimates, following cut-offs used in other studies on health-related stigma [44, 45]. This has resulted in divergent estimates capturing the percentage of people who experience different stigma mechanisms at least ‘sometimes’, and those who experience it often/always.
Comparison with existing literature
The new LCSS is an important addition to the growing number of existing scales for measuring stigma among people with acute COVID-19 infection [46–48] or at risk of such infection [49]. The stigma associated with Long Covid is unique, requiring its own measurement tool; unlike acute COVID-19, Long Covid is a chronic, less well understood condition, often psychologised, and has serious implications for people’s long-term health and productivity.
Existing evidence on Long Covid stigma has been largely qualitative and anecdotal [8–11], which has been essential for describing and raising awareness around the issue. This study adds to ongoing narratives by quantifying the burden of stigma experienced by people living with Long Covid.
Implications for research and/or practice
Findings highlight widespread and multi-layered stigmas experienced by people living with Long Covid in the UK, which should be taken into consideration within clinical practice and healthcare policy. Whilst education about Long Covid may be an important first step, it is not a magic bullet for addressing stigma [50]. Evidence from other stigmatised health conditions suggests that interventions that facilitate social contact with the stigmatised group, advocacy and community mobilisation, as well as peer services may reduce both stigmatising attitudes and internalised stigma [51, 52]. Peer service providers would be uniquely positioned to foster non-judgmental environments and accountability to patients within Long Covid clinics and general practice.
Evidence from across health conditions and geographic contexts suggests Long Covid stigma could be hindering public health by compromising patients’ mental health and engagement with the health system. Developing evidence-based strategies to tackle Long Covid stigma requires a description of the problem, including prevalence estimates, and a validated scale that can capture changes in stigma over time. It is hoped that this study will enable further research on predictors of and interventions to address Long Covid stigma, including further exploring how the prevalence of such stigma differs by social and demographic factors. This would require efforts to recruit a more representative study sample with regards to age, ethnicity, profession and socioeconomic status. Adding measurement of stigma to the core outcomes recommended for Long Covid research would allow a more comprehensive assessment of the problem and provide insights on how to improve patient outcomes and reduce inequalities. More research on how stigma plays a role in changing the social identity of people with Long Covid is also needed.
Supporting information
(DOCX)
(DOCX)
(DOCX)
(DOCX)
(DOCX)
Acknowledgments
We thank all participants for their time and commitment completing this survey. We also sincerely thank members of Long Covid Support’s COVID-19 Research Involvement Group for providing feedback on earlier versions of the questionnaire.
Data Availability
The survey data is available on request provided ethics committee approval for sharing the anonymized data is granted. To request access conditional on approval, please email "rgoinfo@soton.ac.uk," the University of Southampton’s Research Integrity and Governance team.
Funding Statement
The study received no specific funding.
References
- 1.Goffman E. Stigma: Notes on the Management of Spoiled Identity. New Jersey, US: Prentice-Hall Inc.; 1963. [Google Scholar]
- 2.Stangl AL, Earnshaw VA, Logie CH, Van Brakel W, Simbayi LC, Barré I, et al. The Health Stigma and Discrimination Framework: A global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC Med 2019;17:31. 10.1186/s12916-019-1271-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Earnshaw VA, Smith LR, Chaudoir SR, Amico KR, Copenhaver MM. HIV stigma mechanisms and well-being among PLWH: a test of the HIV stigma framework. AIDS Behav 2013;17:1785–95. 10.1007/s10461-013-0437-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Schnyder N, Panczak R, Groth N, Schultze-Lutter F. Association between mental health-related stigma and active help-seeking: Systematic review and meta-analysis. Br J Psychiatry 2017;210:261–8. 10.1192/bjp.bp.116.189464 [DOI] [PubMed] [Google Scholar]
- 5.van Boekel LC, Brouwers EPM, van Weeghel J, Garretsen HFL. Stigma among health professionals towards patients with substance use disorders and its consequences for healthcare delivery: systematic review. Drug Alcohol Depend 2013;131:23–35. 10.1016/j.drugalcdep.2013.02.018 [DOI] [PubMed] [Google Scholar]
- 6.Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV. A clinical case definition of post-COVID-19 condition by a Delphi consensus. Lancet Infect Dis 2022;22:e102–7. doi: 10.1016/S1473-3099(21)00703-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 6 May 2022. 2022.
- 8.Burns S, Warren S. Learning from doctors with long covid. BMJ Opin 2021. https://blogs.bmj.com/bmj/2021/02/26/learning-from-doctors-with-long-covid/ (accessed March 11, 2021). [Google Scholar]
- 9.Ladds E, Rushforth A, Wieringa S, Taylor S, Rayner C, Husain L, et al. Persistent symptoms after Covid-19: qualitative study of 114 “long Covid” patients and draft quality principles for services. BMC Health Serv Res 2020;20:1144. 10.1186/s12913-020-06001-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kingstone T, Taylor AK, O’Donnell CA, Atherton H, Blane DN, Chew-Graham CA. Finding the “right” GP: a qualitative study of the experiences of people with long-COVID. BJGP Open 2020;4:bjgpopen20X101143. 10.3399/bjgpopen20X101143 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Trueland J. The jobs that COVID crushed. BMA 2020. https://www.bma.org.uk/news-and-opinion/the-jobs-that-covid-crushed (accessed March 11, 2021).
- 12.Earnshaw VA, Chaudoir SR. From conceptualizing to measuring HIV stigma: a review of HIV stigma mechanism measures. AIDS Behav 2009;13:1160–77. 10.1007/s10461-009-9593-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pantelic M, Sprague L, Stangl AL. It’s not “all in your head”: critical knowledge gaps on internalized HIV stigma and a call for integrating social and structural conceptualizations. BMC Infect Dis 2019;19:210. 10.1186/s12879-019-3704-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Quinn DM, Chaudoir SR. Living With a Concealable Stigmatized Identity: The Impact of Anticipated Stigma, Centrality, Salience, and Cultural Stigma on Psychological Distress and Health. J Pers Soc Psychol 2009;97:634. 10.1037/A0015815 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ziauddeen N, Gurdasani D, O’Hara ME, Hastie C, Roderick PJ, Yao GL, et al. Characteristics and impact of Long Covid: findings from an online survey. PLOS ONE 2022;17:e0264331. doi: 10.1371/journal.pone.0264331 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Alwan NA. Lessons from Long COVID: working with patients to design better research. Nat Rev Immunol 2022;22:201–2. 10.1038/s41577-022-00692-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Terman JM, Awsumb JM, Cotler J, Jason LA. Confirmatory factor analysis of a myalgic encephalomyelitis and chronic fatigue syndrome stigma scale. J Health Psychol 2018;25:2352–61. 10.1177/1359105318796906 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Berger BE, Ferrans CE, Lashley FR. Measuring stigma in people with HIV: psychometric assessment of the HIV stigma scale. Res Nurs Health 2001;24:518–29. doi: 10.1002/nur.10011 [DOI] [PubMed] [Google Scholar]
- 19.Williams DR, Gonzalez HM, Williams S, Mohammed SA, Moomal H, Steinor DJ. Perceived Discrimination, Race and Health in South Africa. Soc Sci Med 2008;67:441–52. doi: 10.1016/j.socscimed.2008.03.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Molina Y, Choi SW, Cella D, Rao D. The Stigma Scale for Chronic Illnesses 8-item version (SSCI-8): Development, validation, and use across neurological conditions. Int J Behav Med 2013;20:450–60. 10.1007/s12529-012-9243-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Evangeli M, Wroe AL. HIV Disclosure Anxiety: A Systematic Review and Theoretical Synthesis. AIDS Behav 2017;21:1–11. 10.1007/S10461-016-1453-3/TABLES/1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Benson A, O’Toole S, Lambert V, Gallagher P, Shahwan A, Austin JK. To tell or not to tell: A systematic review of the disclosure practices of children living with epilepsy and their parents. Epilepsy Behav 2015;51:73–95. 10.1016/J.YEBEH.2015.07.013 [DOI] [PubMed] [Google Scholar]
- 23.Alimoradi Z, Golboni F, Griffiths MD, Broström A, Lin CY, Pakpour AH. Weight-related stigma and psychological distress: A systematic review and meta-analysis. Clin Nutr 2020;39:2001–13. 10.1016/J.CLNU.2019.10.016 [DOI] [PubMed] [Google Scholar]
- 24.Shin C, Lee S-H, Han K-M, Yoon H-K, Han C. Comparison of the Usefulness of the PHQ-8 and PHQ-9 for Screening for Major Depressive Disorder: Analysis of Psychiatric Outpatient Data. Psychiatry Investig 2019;16:300–5. 10.30773/pi.2019.02.01 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Arias-de la Torre J, Vilagut G, Ronaldson A, Serrano-Blanco A, Martín V, Peters M, et al. Prevalence and variability of current depressive disorder in 27 European countries: a population-based study. Lancet Public Health 2021;6:e729–38. doi: 10.1016/S2468-2667(21)00047-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Arias-de la Torre J, Vilagut G, Ronaldson A, Serrano-Blanco A, Alonso J. PHQ-8 scores and estimation of depression prevalence–Author’s reply. Lancet Public Health 2021;6:e794. doi: 10.1016/S2468-2667(21)00226-7 [DOI] [PubMed] [Google Scholar]
- 27.Scambler G. Health-related stigma. Sociol Health Illn 2009;31:441–55. 10.1111/j.1467-9566.2009.01161.x [DOI] [PubMed] [Google Scholar]
- 28.Pantelic M, Boyes M, Cluver L, Thabeng M. ‘They Say HIV is a Punishment from God or from Ancestors’: Cross-Cultural Adaptation and Psychometric Assessment of an HIV Stigma Scale for South African Adolescents Living with HIV (ALHIV-SS). Child Indic Res 2018;11:207–23. 10.1007/s12187-016-9428-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Stata Statistical Software: Release 17 2021.
- 30.Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990;107:238–46. doi: 10.1037/0033-2909.107.2.238 [DOI] [PubMed] [Google Scholar]
- 31.Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model Multidiscip J 1999;6:1–55. 10.1080/10705519909540118. [DOI] [Google Scholar]
- 32.Bowen N, Guo S. Structural Equation Modeling. Oxford: Oxford University Press, Inc.; 2012. [Google Scholar]
- 33.Schermelleh-Engel K. Moosbrugger H, Müller H. Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodnessof-Fit Measures. Methods Psychol Res Online 2003;8:23–74. [Google Scholar]
- 34.Hooper D, Coughlan J, Mullen M. Structural Equation Modelling: Guidelines for Determining Model Fit. Electron J Bus Res Methods 2008;6:53–60. doi: 10.21427/D7CF7R [DOI] [Google Scholar]
- 35.Wheaton B, Muthen B, Alwin DF, Summers GF. Assessing Reliability and Stability in Panel Models. Sociol Methodol 1977;8:84. doi: 10.2307/270754 [DOI] [Google Scholar]
- 36.Bennett DA. How can I deal with missing data in my study? Aust N Z J Public Health 2001;25:464–9. [PubMed] [Google Scholar]
- 37.Sorsdahl KR, Mall S, Stein DJ, Joska JA. The prevalence and predictors of stigma amongst people living with HIV/AIDS in the Western Province. AIDS Care 2011;23:680–5. 10.1080/09540121.2010.525621 [DOI] [PubMed] [Google Scholar]
- 38.NAPWA. The People Living with HIV Stigma Index. Germiston, South Africa: NAPWA-SA, The National Association of People living with HIV and AIDS in South Africa; 2012.
- 39.Office for National Statistics. Technical article: Updated estimates of the prevalence of post-acute symptoms among people with coronavirus (COVID-19) in the UK: 26 April 2020 to 1 August 2021. 2021.
- 40.Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 1 September 2022. 2022.
- 41.Asbring P, Närvänen A-L. Women’s experiences of stigma in relation to chronic fatigue syndrome and fibromyalgia. Qual Health Res 2002;12:148–60. doi: 10.1177/104973230201200202 [DOI] [PubMed] [Google Scholar]
- 42.PHOSP-COVID Collaborative Group. Clinical characteristics with inflammation profiling of long COVID and association with 1-year recovery following hospitalisation in the UK: a prospective observational study. Lancet Respir Med 2022:S2213-2600(22)00127-8. doi: 10.1016/S2213-2600(22)00127-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Walker AJ, MacKenna B, Inglesby P, Tomlinson L, Rentsch CT, Curtis HJ, et al. Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY. Br J Gen Pract 2021;71:e806–14. 10.3399/BJGP.2021.0301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Gerlinger G, Hauser M, De Hert M, Lacluyse K, Wampers M, Correll CU. Personal stigma in schizophrenia spectrum disorders: a systematic review of prevalence rates, correlates, impact and interventions. World Psychiatry Off J World Psychiatr Assoc WPA 2013;12:155–64. 10.1002/wps.20040 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Pantelic M, Shenderovich Y, Cluver L, Boyes M. Predictors of internalised HIV-related stigma: a systematic review of studies in sub-Saharan Africa. Health Psychol Rev 2015;9:469–90. 10.1080/17437199.2014.996243 [DOI] [PubMed] [Google Scholar]
- 46.Earnshaw VA, Brousseau NM, Hill EC, Kalichman SC, Eaton LA, Fox AB. Anticipated stigma, stereotypes, and COVID-19 testing. Stigma Health 2020;5:390–3. 10.1037/sah0000255. [DOI] [Google Scholar]
- 47.Mostafa A, Mostafa NS, Ismail N. Validity and Reliability of a COVID-19 Stigma Scale Using Exploratory and Confirmatory Factor Analysis in a Sample of Egyptian Physicians: E16-COVID19-S. Int J Environ Res Public Health 2021;18:5451. 10.3390/ijerph18105451 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Nochaiwong S, Ruengorn C, Awiphan R, Kanjanarat P, Ruanta Y, Phosuya C, et al. COVID-19 Public Stigma Scale (COVID-PSS): development, validation, psychometric analysis and interpretation. BMJ Open 2021;11:e048241. 10.1136/bmjopen-2020-048241 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Li T, Bu H, Duan W. A brief measure of perceived courtesy and affiliate stigma on COVID-19: A study with a sample from China. Personal Individ Differ 2021;180:110993. 10.1016/j.paid.2021.110993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Pantelic M, Steinert JI, Park J, Mellors S, Murau F. ‘Management of a spoiled identity’: systematic review of interventions to address self-stigma among people living with and affected by HIV. BMJ Glob Health 2019;4:e001285. 10.1136/bmjgh-2018-001285 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.National Academies of Sciences, Engineering, and Medicine (U.S.), editor. Ending discrimination against people with mental and substance use disorders: the evidence for stigma change. Washington, DC: The National Academies Press; 2016. [PubMed] [Google Scholar]
- 52.Van de Vyver J, Leite AC, Alwan NA. Navigating the social identity of long covid. BMJ 2021:n2933. 10.1136/bmj.n2933 [DOI] [PubMed] [Google Scholar]

