Abstract
Objectives
Targeted social distancing measures were widely implemented for nursing home residents when the extremely high coronavirus disease 2019 mortality in this setting became apparent. However, there is still scarce rigorous research examining how the pandemic and accompanying social distancing measures affected loneliness in this group. This prospective nationwide Swedish study of nursing home residents aimed to examine the impact on loneliness of the early phase of the pandemic and of a national visiting ban at nursing homes.
Methods
A panel was selected from a total population survey of all nursing home residents in Sweden March–May 2019 and 2020 (N = 11,782; age range 70–110 years; mean age 88.2 years; 71% women). Prospective pretest–posttest and controlled interrupted time series (ITS) designs were employed, with time trends estimated by date of returned questionnaire. Generalized linear models were used for estimation of effects, adjusting for demographic-, survey-, and health-related covariates.
Results
Loneliness prevalence increased from 17% to 19% from 2019 to 2020 (risk ratio, RR (95% confidence interval, CI) = 1.104 (1.060; 1.150)), but which was explained by self-reported health (RR (95% CI) = 1.023 (0.982; 1.066)). No additional impact of the visiting ban on loneliness trends was found in the ITS analyses (RR (95% CI) = 0.984 (0.961; 1.008)).
Discussion
The moderate but health-dependent increased risk of loneliness, and the lack of impact of the nationwide visiting ban at nursing homes, suggests that this ostensibly vulnerable group of nursing home residents also shows signs of resilience, at least during the early phase of the pandemic.
Keywords: Interrupted time series analysis, Long-term care facilities, Social relationships
The emergence of the pandemic has brought urgency to the broader public health issue of loneliness among older adults (MacLeod et al., 2021), who in most countries were targeted by more restrictive social distancing measures than the population at large (Dahlberg, 2021; Dyer, 2020). This precarious situation was particularly pronounced for older adults in nursing homes, a setting that has received considerable media attention during the pandemic (Miller et al., 2021).
Nursing home residents, comprising the oldest and frailest older adults, have more limited possibilities for social interaction than other older adults due to complex health needs, functional impairments, and institutional restrictions to daily life (Bethell et al., 2021; Mo & Shi, 2020; Simard & Volicer, 2020), as well as the double burden of social and digital exclusion (Seifert et al., 2021). Loneliness, a discrepancy between one’s desired and achieved levels of social relations (Perlman & Peplau, 1981), is more frequent among nursing home residents than community-dwelling older adults (Gardiner et al., 2020), with prevalence estimates of severe loneliness ranging between 9% and 22% in the Nordic countries (Gardiner et al., 2020), with little variation over time (Jansson et al., 2020).
After markedly high coronavirus disease 2019 (COVID-19) mortality rate and poor survival became apparent among nursing home residents in 2020 (Ioannidis et al., 2021; Zhang et al., 2021), this group of older adults was left to weather the pandemic under particularly strict social distancing conditions, while nursing home staff battled to maintain care under the chaotic and exhausting working conditions during the first wave of the pandemic (Giri et al., 2021; Palacios-Cena et al., 2021). Despite these harsh conditions for the oldest and frailest older adults, there is a paucity of rigorous research detailing the actual impact of the pandemic and related policies on loneliness in the nursing home setting (Dahlberg, 2021; Parlapani et al., 2021). One cross-sectional study reports a marked reduction in in-person contacts during the pandemic among nursing home residents, compared to community-dwelling older adults (Freedman et al., 2021), but to our knowledge, there are no longitudinal studies on the impact on loneliness. The majority of studies on older adults include younger and community-dwelling older adults (Lebrasseur et al., 2021; Parlapani et al., 2021), with few studies on the oldest old (Simard & Volicer, 2020). Longitudinal studies on community-dwelling older adults in Europe and the United States have, however, mostly found weak and inconsistent impact of the pandemic on loneliness (Lebrasseur et al., 2021; Parlapani et al., 2021) and during lockdown (Fuller & Huseth-Zosel, 2021; Kotwal et al., 2021; Lin et al., 2022; Stolz et al., 2021), including in Sweden (Gustafsson et al., 2022; Kivi et al., 2021).
In Sweden, the context of the present study, the first COVID-19 pandemic wave emerged in mid-March 2020 and ended in the summer of the same year. In contrast to many other countries, Sweden lacked legal possibilities to enforce compulsory and indiscriminate lockdown measures, and instead opted for a controversial strategy (Habib, 2020; Vogel, 2020) that heavily relied on voluntary recommendations of social distancing (Ludvigsson, 2020). Policies specifically targeting older adults were more restrictive, however, with strict but ultimately voluntary recommendations of quarantine for adults 70 years or older introduced promptly in mid-March 2020. After a series of devastating COVID-19 outbreaks emerged among older adults in nursing homes in Sweden, similar to the experience in other countries (Ioannidis et al., 2021), the Swedish government issued an ordinance prohibiting all external visits at nursing homes for older people.
This visiting ban, in effect from April 1, 2020, aimed at protecting the most vulnerable group from severe and fatal consequences of COVID-19. This strategy ultimately proved unsuccessful, as the unexpectedly high COVID-19 mortality rates in Sweden compared to neighboring Nordic countries (Nanda & Sharma, 2021) have been attributed largely to the failure to protect the oldest old in nursing home facilities (Diderichsen, 2021; Habib, 2020; The Swedish Corona Commission, 2020). Nevertheless, the visiting ban did mean that all Swedish older adults living in nursing homes overnight became deprived of physically meeting their close ones, and were left to the social contacts with staff and the other residents under the new, highly restrictive, pandemic eldercare routines (Public Health Agency of Sweden, 2020).
While the necessity of the visiting ban has not been widely questioned in Sweden, it was a nationally unprecedented measure that received criticism, for example, for the selective restriction of autonomy and the lack of accompanying plans to counteract social isolation among nursing home residents (Dahlberg, 2021; Skoog, 2020). This critique ties into the international discussion of ageism during the COVID-19 pandemic (Ayalon et al., 2021), and the Swedish visiting ban can be seen as an example of the problematic yet necessary decisions based on a conflicting continuum of risk and harm, which have marked the societal responses to the COVID-19 pandemic (Smith et al., 2020).
The present study seeks to examine the impact of the emergence of the pandemic itself and of the visiting ban on loneliness among older adults residing in nursing homes in Sweden, using both pretest–posttest and controlled interrupted time series (ITS) designs. The controlled ITS is considered the strongest study design to evaluate the causal effect of temporally well-defined policies in cases where randomization is prohibitive (Kontopantelis et al., 2015), and has been recommended specifically for impact evaluations of COVID-19 policies (Haber et al., 2021). The study aimed to test the following two hypotheses:
(1) The emergence of the COVID-19 pandemic was associated with an increased risk of loneliness among older adults in nursing homes; and
(2) The introduction of the national visiting ban at nursing homes caused an additional increased risk of loneliness, beyond the impact of the pandemic itself.
Method
The Swedish Nursing Home Setting
Nursing homes in Sweden are the responsibility of the 290 municipalities, but they can be operated by either public or private providers. A subsidized nursing home place can be granted based on assessment of individual needs, as regulated by the Social Services Act (1980:620). Places are reserved for individuals for whom the care needs are greater than those that can be provided by home care services, the first level of municipally managed and subsidized eldercare. The care professions at nursing homes vary but usually have a registered nurse with overall responsibility for care provision, with care delivered by auxiliary nurses and nurse’s assistants, and with other professions such as occupational therapists, physiotherapists, and medical doctors available for consulting or visits. The total population of Swedish nursing home residents is identifiable in the Social Services Registers of The National Board of Health and Welfare.
Study Population and Data Collection
The data of the present study came from two waves of the Elderly Survey in Nursing Homes 2019 and 2020, which were implemented by the National Board of Health and Welfare to monitor the quality of eldercare in Sweden. The target population comprised the total population of nursing home residents aged 65 years or older in Sweden each year, in 2019 and 2020, respectively. The survey questionnaire comprises 20–25 items covering perceptions of the eldercare as well as self-rated loneliness and health. Additional demographic information, for example, sex, provider, and municipality of residence, were linked to the survey data from total population registers.
Information about the survey, invitation to participate, and the questionnaire were distributed by mail to the entire target population on March 5, 2020, with first responses returned on March 9, 2020; the same week the first signs of COVID-19 community transmission in Sweden were detected, and 23 days before the visiting ban was in effect from April 1. Two reminders were sent out during the study period, and the last response accepted was on May 31. The respondents had the options of completing the questionnaire in paper form and returning it by a self-addressed stamped envelope, or by the web following a web link provided in the information. Respondents could complete the questionnaire on their own, or with assistance, for example, from nursing home staff, relative, or a friend. The 2019 survey took place over the equivalent period and using the same procedures.
For the present study, all respondents who completed both the 2019 and 2020 surveys and who were 70 years or older in 2020 were included, to avoid potential bias due to the recommendations of social distancing for older adults ≥70 years. Records were kept of the date each questionnaire was sent out and returned. Questionnaires were distributed to N = 72,431 nursing home residents in 2019, with N = 36,248 (50%) completing the questionnaire, of whom N = 35,853 were 70 years or older. Of this eligible and available population at baseline, N = 15,159 (42%) also completed the questionnaire in 2020. Due to missing data on individual variables, N = 11,782 individuals and N = 23,564 observations were available for analysis in the longitudinal analysis (33% of the eligible and available population, and 16% of the target population at baseline). Descriptive characteristics of the analytical sample are shown in Table 1.
Table 1.
Descriptive Statistics of the Longitudinal Sample of Swedish Nursing Home Residents
Variable | Prepandemic survey (2019) | Pandemic survey (2020) |
---|---|---|
Total sample, individuals (observations) | 11,782 (23,564) | |
Preintervention period | 9,009 (76) | 7,933 (67) |
Postintervention period | 2,773 (24) | 3,849 (33) |
Gender | ||
Women | 8,319 (71) | |
Men | 3,464 (29) | |
Age (years) in 2020 | ||
M (SD) | 88.2 (7.3) | |
Range | 70–110 | |
Area of residence | ||
Large city | 3,244 (28) | 3,251 (28) |
Medium-sized town | 4,820 (41) | 4,821 (41) |
Small town or rural | 3,718 (32) | 3,710 (31) |
Provider | ||
Private | 2,457 (21) | 2,417 (21) |
Public | 9,325 (79) | 9,365 (79) |
Questionnaire form | ||
Postal | 10,928 (93) | 10,200 (87) |
Web | 854 (7.3) | 1,582 (13) |
Questionnaire assistance | ||
No | 5,239 (44) | 4,771 (40) |
Yes | 6,543 (56) | 7,011 (60) |
Self-rated health | ||
Good | 8,768 (74) | 8,283 (70) |
Poor | 3,014 (26) | 3,499 (30) |
Mental health symptoms | ||
No | 4,653 (39) | 4,248 (36) |
Yes | 7,129 (61) | 7,534 (64) |
Mobility limitations | ||
No | 7,165 (61) | 6,332 (54) |
Yes | 4,617 (39) | 5,450 (46) |
Loneliness | ||
Never or sometimes | 9,755 (83) | 9,544 (81) |
Yes, often | 2,027 (17) | 2,238 (19) |
Note: Numbers are N (%) individuals if not otherwise noted.
Ethical approval was granted by the Swedish Ethical Review Authority (Ref. No. 2020-06879).
Study Design
For the first hypothesis, a pretest–posttest design was used by the longitudinal comparison of loneliness by year (1 = pandemic intervention year of 2020, 0 = prepandemic control year of 2019), that is, a within-subject comparison of dependent observations.
For the second hypothesis, three design variables were operationalized in a controlled ITS design. The controlled ITS design is a quasi-experimental design that, in contrast to more common quasi-experimental designs, relies on comparison of time trends before and after an intervention instead of single-point measures, and is therefore able to control by design biases rooted in underlying trends (Kontopantelis et al., 2015).
First, the condition of year was operationalized as above. Second, the return dates of the questionnaires were used to classify responses, from the 2020 intervention year as well as the 2019 control year, into two periods; before (0 = preintervention period; 3 weeks up to March 31) and after (1 = postintervention period, 9 weeks from April 1) the introduction of the visiting ban in 2020. Third, time corresponded to the return date of questionnaire, by 2-day intervals on a continuous scale. Three days adjustment was applied for physical questionnaires to take the time delay of postal service into account. As the study population comprised independent observations within each year, period and time comprised between-subject comparisons.
The ITS design relies on estimation of time trend (time) in risk of loneliness in the only group exposed to the visiting ban (intervention period, during the 2020 intervention year). To estimate the intervention impact, this trend is first compared to the corresponding trend in the group responding before the introduction of the visiting ban (preintervention period, during the same 2020 intervention year). To take unmeasured confounding into account, the resulting pre–post trend difference is subsequently compared to the corresponding pre–post trend difference the preceding year (preintervention and intervention period, during the 2019 control year), which due to the longitudinal design represents a within-subject comparison. The resulting estimate of the intervention impact thus amounts to a difference-in-difference of trends in the risk of loneliness. The design is schematically illustrated in Figure 1.
Figure 1.
Overview of the controlled interrupted time series design illustrating the four design conditions by year and period. Time trends in risk of loneliness are estimated within and compared between the four conditions.
Measures
Perceived loneliness
Loneliness, the outcome of interest, was measured by a single questionnaire item “Does it happen that you are troubled by loneliness?”, which was constructed for this survey. It has Likert-scale response options that were dichotomized (1 = “Yes, often”; 0 = “Yes, now and then” or “No”). The “Don’t know/No opinion” responses were coded as “0” if the questionnaire was completed by the respondent and as missing if completed with the assistance of another person. The rationale was that individuals themselves selecting this option are unlikely to suffer from frequent loneliness, but if completed with the help of another person it may also reflect unwillingness to disclose loneliness or communication difficulties.
Covariates
Demographic and survey-related characteristics that potentially could be related to the design conditions and simultaneous affect perceived loneliness were measured both in 2019 and 2020 and included as covariates: nursing home provider (0 = public/1 = private); questionnaire form (0 = web, 1 = physical) and questionnaire assistance, that is, whether the respondent completed the questionnaire independently or with assistance (0 = no/1 = with assistance); area of residence (0 = large city, 1 = medium-sized town, 2 = smaller town or rural area; Swedish Association of Local Authorities and Regions, 2016); age (continuous, in years); and sex (0 = woman, 1 = man).
Poor health is both a potential consequence (Luo et al., 2012) and cause (Dahlberg et al., 2022) of loneliness, and its status as confounder is therefore ambiguous. For this reason, the following health measures were included as covariates only in separate models: self-rated health, based on five Likert-scale response options dichotomized into 0 = “Fair,” “Quite good,” and “Very good” versus 1 = “Quite bad” and “Very bad”; worries and anxiety problems, based on three Likert-scale response options dichotomized into 0 = “No” versus 1 = “Mild” or “Severe troubles”; and indoor physical mobility limitations, based on four Likert-scale response options dichotomized into 0 = “No limitations” or “Certain limitations” versus 1 = “Considerable difficulties” or “No mobility.”
Statistical Analysis
All analyses were run on the longitudinal sample of N = 23,564 observations (11,782 individuals), using a generalized linear model, with binomial family and log link for estimation of risk ratios (RRs), in Stata. Dependency of observations between 2019 and 2020 owing to the longitudinal sample was handled by estimation of cluster-robust standard errors.
The first hypothesis was tested by regressing loneliness on year (1 = 2020 intervention; 0 = 2019 control) and covariates in both years, in the longitudinal sample. Analyses were run in three models: separate crude/unadjusted models for each independent variable (Model 0), one model adjusting for demographic and survey-related covariates (Model 1; excluding sex and age), and lastly one model adding health measures (Model 2). Due to the longitudinal sample, sex was the same both years age differed by a 1-year constant for all individuals. Sex and age could therefore not confound the main effect of year and were therefore not included in the adjusted analyses.
For the second hypothesis, interaction terms were first constructed from the main effect variables year (1 = 2020 intervention; 0 = 2019 control), period (0 = pretest; 1 = posttest), time (continuous, 2-day intervals of date of returned questionnaire), representing all two-way (year × period; year × time; period × time) and the three-way (year × period × time) interactions, as described by Linden (2015). The binary outcome loneliness was then regressed on all main and interaction terms. The year × period × time interaction term is the parameter of main interest for the hypothesis, as it corresponds to the difference-in-difference in loneliness trends between the postintervention period in 2020 and the preintervention period and corresponding periods in 2019. Three models were run: crude/unadjusted model (Model 0), adjusting for demographic and survey-related covariates (Model 1; including sex and age), and lastly adding health measures (Model 2). Sensitivity analyses were conducted specifying the impact of the visiting ban on loneliness 2 weeks after its introduction, on April 15 instead of April 1.
Dropout analysis (see Supplementary Table S1) on the eligible study population in 2019 (N = 35,853) indicated that the risk of missingness in 2020 was strongly predicted by baseline high age (RR (95% CI) = 1.208 (1.155; 1.265) for 100 years or older), poor general health (RR (95% CI) = 1.123 (1.103; 1.144)), mobility limitations (RR (95% CI) = 1.144 (1.124; 1.165)), and questionnaire assistance (RR (95% CI) = 1.088 (1.068; 1.109)). All other baseline characteristics were RR < 1.04.
Results
Descriptive statistics of the study population for 2019 and 2020 are displayed in Table 1. The sample comprised 71% women and had a mean age of 88.2 years in 2020. There were minimal changes in residential circumstances between the years, but a higher proportion completing the questionnaire with aid and by the web in 2020 compared to 2019. Mental health symptoms were markedly frequent already in 2019 (61%), and, together with general health and mobility limitations, deteriorated from 2019 to 2020.
Corresponding to the first hypothesis, that the emergence of the pandemic was associated with an increased risk of loneliness, Table 2 shows a summary of analyses with loneliness regressed on year (2020 vs 2019) and covariates. The crude model (Model 0) showed a significant RR = 1.104 (95% CI: 1.060; 1.150) for the year effect, which corresponds to the small descriptive increase in loneliness prevalence from 2019 (17%) to 2020 (19%), as reported in Table 1. This estimate was attenuated to RR = 1.080 (95% CI: 1.036; 1.125) after adjustment for covariates (Model 1), and further to a nonsignificant RR = 1.023 (95% CI: 0.982; 1.066) after taking variations in health into account (Model 2). Adjusting only for one health measure at a time in separate models (see Supplementary Table S2) yielded similar inferences but with attenuation of the main year effect below significance only when adjusted for self-rated health (RR (95% CI) = 1.036 (0.994; 1.080)), with smaller attenuations when adjusting for either mental health (RR (95% CI) = 1.054 (1.011; 1.098)) or mobility limitations (RR (95% CI) = 1.052 (1.009; 1.097)).
Table 2.
Relative Risk of Loneliness From 2019 to 2020 Among Swedish Nursing Home Residents
Variable | Model 0a | Model 1b | Model 2c |
---|---|---|---|
Year | |||
2020 (ref: 2019) | 1.104 (1.060; 1.150) | 1.080 (1.036; 1.125) | 1.023 (0.982; 1.066) |
Area (ref: large city) | |||
Medium-sized town | 0.953 (0.881; 1.031) | 0.966 (0.891; 1.046) | 1.000 (0.929; 1.076) |
Small town or rural | 0.928 (0.853; 1.010) | 0.938 (0.86; 1.022) | 0.973 (0.898; 1.054) |
Provider | |||
Public (ref: private) | 0.943 (0.872; 1.019) | 0.962 (0.888; 1.042) | 0.953 (0.885; 1.026) |
Questionnaire form | |||
Web (ref: postal) | 1.210 (1.108; 1.320) | 1.153 (1.055; 1.26) | 1.095 (1.009; 1.189) |
Questionnaire assistance | |||
Yes (ref: no) | 1.385 (1.300; 1.476) | 1.374 (1.289; 1.465) | 1.063 (1.009; 1.130) |
Self-rated health | |||
Poor (ref: good) | 2.483 (2.343; 2.631) | — | 1.788 (1.68; 1.903) |
Mental health symptoms | |||
Yes (ref: no) | 4.489 (4.075; 4.946) | — | 3.713 (3.363; 4.099) |
Mobility limitations | |||
Yes (ref: no) | 1.571 (1.477; 1.670) | — | 1.132 (1.063; 1.207) |
Sex | |||
Man (ref: woman) | 0.885 (0.822; 0.952) | — | — |
Age (per year of age) | 0.988 (0.994; 1.002) | — | — |
Notes: N = 23,564 observations. Numbers are risk ratios with 95% confidence interval.
aModel 0: nine unadjusted models separate for each independent variable.
bModel 1: adjusted for living alone, area of residence, provider, questionnaire form, and questionnaire assistance.
cModel 2: additionally adjusted for self-rated general health, mental health, and mobility limitations.
Of the covariates, mental health was the strongest independent predictor (RR (95% CI) = 3.717 (3.395; 4.070) in Model 2), with general health and mobility limitations displaying weaker but significant relationships. Those responding to questionnaire with assistance and by the web reported slightly higher risk of loneliness, but no independent association was found with area of residence and provider in adjusted analyses (Model 2). While age and sex were not included as covariates in the adjusted analyses, crude analyses (Model 0) indicated that men on average reported lower risk of loneliness than women, with no effect of age.
A summary of the analyses corresponding to the second hypothesis, that the visiting ban at nursing homes led to an increased risk of loneliness, is shown in Table 3. The main parameter of interest, the year × period × time effect, was in the crude model (Model 0) estimated at RR (95% CI) = 0.974 (0.949; 0.998), which indicated a relative decrease in loneliness trends (RR = 0.974 (95% CI: 0.949; 0.998)) after the introduction of the visiting ban, compared to the period before the visiting ban and to the trends of the corresponding periods in 2019. The estimate was attenuated below significance after adjustment for covariates (Model 1), and further attenuated to a nonsignificant RR = 0.984 (95% CI: 0.961; 1.008) after considering health in 2019 and 2020 (Model 2). The other estimates in the models indicated higher baseline prevalence of loneliness in 2020 (year) but which was attenuated below significance after adjustments.
Table 3.
Results of Controlled Interrupted Time Series Analyses of the Impact of a Visiting Ban on Loneliness Among Swedish Nursing Home Residents
Effect | Model 0a | Model 1b | Model 2c |
---|---|---|---|
Year (2020 vs 2019) | 1.266 (1.078; 1.486) | 1.234 (1.053; 1.446) | 1.070 (0.919; 1.245) |
Period (post vs pretest) | 1.096 (0.908; 1.323) | 1.048 (0.869; 1.265) | 0.968 (0.809; 1.158) |
Time (date, 2-day intervals) | 0.994 (0.978; 1.012) | 0.995 (0.978; 1.012) | 0.998 (0.982; 1.014) |
Year × Period | 1.236 (0.886; 1.725) | 1.223 (0.878; 1.702) | 1.251 (0.913; 1.715) |
Year × Time | 1.029 (1.007; 1.052) | 1.027 (1.006; 1.049) | 1.016 (0.996; 1.037) |
Period × Time | 1.009 (0.989; 1.029) | 1.010 (0.99; 1.030) | 1.010 (0.991; 1.029) |
Year × Period × Time | 0.974 (0.949; 0.998) | 0.975 (0.951; 0.999) | 0.984 (0.961; 1.008) |
Notes: N = 23,564 observations. Numbers are risk ratios with 95% confidence intervals.
aModel 0: one unadjusted model only including the design effects.
bModel 1: adjusted for living alone, area of residence, provider, questionnaire form, questionnaire assistance, age, and sex.
cModel 2: additionally adjusted for self-rated general health, mental health, and mobility limitations.
Sensitivity analyses setting the policy impact 2 weeks after the introduction of the visiting ban, on April 15, led to similar inferences (see Supplementary Table S3). In these analyses, the year × period × time effect was nonsignificant throughout the models.
Discussion
In the present national longitudinal study of Swedish older adults residing in nursing homes in both 2019 and 2020, we found support for our first hypothesis of increased risk of loneliness during the COVID-19 pandemic, which was, however, explained by a simultaneous deterioration in health from 2019 to 2020. We found no support for our second hypothesis of increased risk of loneliness specifically attributable to the implementation of the nationwide visiting ban at nursing homes. Taken together, the results point to a moderate and health-dependent immediate impact on loneliness of the pandemic and no impact of a restrictive policy, in this group of older adults ostensibly vulnerable to the psychosocial consequences of the pandemic.
We found markedly high frequency of worries and anxiety already before the pandemic, which corresponds to prior findings of high prevalence of depressive symptoms among nursing home residents (Baxter et al., 2022). Mental health, along with self-rated health and mobility limitations, deteriorated from 2019 to 2020, and the increased risk of loneliness in 2020 was largely dependent on this concurrent deterioration in health. This pattern may reflect the bidirectional relationship of loneliness and self-perceived health among older adults in the nursing home setting (Bethell et al., 2021; Lapane et al., 2022), and among older adults in general (Dahlberg et al., 2022). This finding can therefore illustrate both that preserving good health and functioning can be crucial for preventing experiences of loneliness, and that social interactions are important for well-being, for nursing home residents during the pandemic.
The prevalence of loneliness in both 2019 (17%) and 2020 (19%) is comparable to estimates in the home care setting in the Nordic countries before the pandemic (Gardiner et al., 2020). However, as the prevalence of loneliness in the nursing home setting tends to be stable across years (Jansson et al., 2020), the increased risk we found, from one year to another, remains concerning. At the same time, considering the tumultuous conditions at nursing homes during the early phase of the pandemic (Ioannidis et al., 2021; Xu et al., 2020), the magnitude of increased risk found can be seen as surprisingly moderate, particularly as we found no evidence of any additional increased risk of loneliness following the introduction of the national visiting ban.
While previous research has found a notable reduction in in-person contacts for nursing home residents during the pandemic (Freedman et al., 2021), research on loneliness is dominated by studies of community-dwelling older adults. Interestingly, this body of literature has also, overall, found a comparably modest or lack of impact of the pandemic on loneliness (Lebrasseur et al., 2021; Parlapani et al., 2021), including from Sweden (Gustafsson et al., 2022; Kivi et al., 2021), with one Swedish study also failing to find any impact of social distancing recommendations on loneliness among older adults with home care (Gustafsson et al., 2022). The present study gives credence to the voices challenging the view of older adults, and particularly nursing home residents, being singularly vulnerable to the psychosocial impact of the pandemic and related policy measures (Losada-Baltar et al., 2021; Parlapani et al., 2021). However, there are several potential explanations to the finding of a moderate impact of the pandemic conditions, with methodological causes discussed further below.
First, nursing home residents may engage in more social interaction than their community-dwelling counterparts due to the daily interactions with nursing home staff (Adlbrecht et al., 2021), which have been shown to be vital for the residents’ well-being (Kang et al., 2020; Liu et al., 2020). This feature may have protected many residents against experiences of loneliness during the early phase of the pandemic, despite the physical absence of family and the relative social isolation that the visiting ban enforced.
Second, despite the risk of digital exclusion among nursing home residents (Seifert et al., 2021), it is plausible that families made additional efforts to maintain social interactions with their family members at nursing homes during the pandemic, for example, increasing frequency of phone or video calls (Giri et al., 2021). The Swedish visiting ban did gain considerable public attention as it was, in the Swedish context, an unprecedented measure that was quite distinct from the more lenient general pandemic strategy, and which indirectly affected the entire population.
Third, it is possible that many nursing home residents and their families had limited their social interactions already ahead of the introduction of the visiting ban. Public awareness of the COVID-19 pandemic was high even before community spread of the virus was first observed in Sweden in mid-March 2020, and the promptly disseminated recommendations to older adults were generally adhered to (Gustavsson & Beckman, 2020). This possibility is supported by the higher baseline loneliness in 2020 than in 2019 found in this study.
Fourth, the present study only covered the first 3 months of the COVID-19 pandemic, and the experience of loneliness could take a longer time to develop. While sensitivity analyses of the visiting ban led to similar inferences, other studies of community-dwelling older adults have found loneliness increasing not until later during pandemic (Hansen et al., 2021).
Methodological Considerations
The strengths of the study include the large sample from a total population survey; the inclusion of the understudied target population of the oldest old in nursing homes; the prospective design and within-subject comparisons enabling control of a range of potential confounders by design, for example, traits, persistent social conditions, and seasonal variations; and the rigorous controlled ITS design which gives strong support for causal inference. Nevertheless, research on populations of the oldest old (Dahlberg, 2021), and particularly evaluative research during the pandemic (Haber et al., 2021), faces multiple challenges which also apply to the present study.
First, the target population was older adults in nursing homes, and results should not be generalized to the wider population of older adults. As for all comparable studies conducted, the heterogeneous arrangements of eldercare and societal responses to the COVID-19 pandemic across countries also limit generalizability to other societal contexts.
Second, while the survey was disseminated to the entire target population of nursing home residents in Sweden, only 50% responded to the survey at baseline, of whom only one third was retained for longitudinal analysis. Selection due to frailty, cognitive and communication problems is a common challenge in studies of the oldest old (Dahlberg, 2021), and the high mortality in nursing homes during the first wave of the pandemic risks introducing survival bias. Even though information on these characteristics was not available in this study, dropout analysis confirmed a systematic attrition by baseline age, health and functioning. This bias would be expected to lead to an underestimation of the impact of the pandemic and the visiting ban, and limits generalizability to nursing home residents in general.
Third, the ITS design is susceptible to misspecified timing of the policy impact (Haber et al., 2021). While the studied intervention was introduced as a national law on a specific date in all nursing homes, there is uncertainty as to what degree and when any objective social isolation was perceived as loneliness among the nursing home residents. While sensitivity analyses specifying the policy impact to 2 weeks after its introduction corroborated the inferences, a possible lag in the population impact remains an additional uncontrolled potential source of bias that is most likely expressed as an underestimation of the impact of the visiting ban.
Fourth, the ITS design relies on the counterfactual assumptions of projected and parallel trends (Haber et al., 2021), which are difficult to assume especially in the light of the extraordinarily chaotic conditions of the first wave of the COVID-19 pandemic, where also other competing interventions, or changes co-occurring with the studied intervention, could introduce bias (Haber et al., 2021). Although the competing impact of the recommendations to all older adults disseminated 2 weeks before the visiting ban in theory is methodologically managed by consideration of the preintervention trends, the possibility of lags in impact, as discussed above, makes it impossible to rule it out as a competing intervention and a source of bias.
Fifth, the study used a single-item measure of loneliness, which has not been subjected to psychometric evaluations and its validity and reliability can therefore not be ascertained. We adjusted for assistance with questionnaire completion to take into account potential response bias. The time frame of loneliness is not specified in the questionnaire, which would be expected to introduce random and possibly systematic error to the measurement. Moreover, unmeasured confounders, such as length of time in the nursing home, could potentially bias the findings.
Conclusions and Policy Implications
Taken together, the present prospective national study suggests that Swedish older adults residing in nursing homes in 2019 and through the initial months of the COVID-19 pandemic in 2020 did not experience increased prevalence of loneliness following the national visiting ban at nursing homes, despite the sharp restrictions to external social contacts it entailed. A noticeable increase in the risk of loneliness compared to the year prior was largely explained by a simultaneous deterioration in health, which can reflect that the first pandemic wave still affected nursing home residents with poor health. There is still a marked scarcity of rigorous studies on how the oldest and frailest older adults, including nursing home residents, have fared psychosocially during the COVID-19 pandemic, particularly when it comes to the impact of policies. To provide clearer guidance for public health and eldercare policy and practice, more research is needed to evaluate particularly the long-term impact of the sustained pandemic and social distancing measures in this group.
Supplementary Material
Contributor Information
Per E Gustafsson, Department of Epidemiology and Global Health, Umeå University, Umeå, Sweden.
Julia Schröders, Department of Epidemiology and Global Health, Umeå University, Umeå, Sweden; Department of Sociology, Umeå University, Umeå, Sweden.
Ingeborg Nilsson, Department of Community Medicine and Rehabilitation, Unit of Occupational Therapy, Umeå University, Umeå, Sweden.
Miguel San Sebastián, Department of Epidemiology and Global Health, Umeå University, Umeå, Sweden.
Funding
This work was supported by Forte - The Swedish Research Council for Health, Working Life and Welfare to P. E. Gustafsson (grant number 2020-01565).
Conflict of Interest
None declared.
Author Contributions
P. E. Gustafsson conceived the original idea together with I. Nilsson; P. E. Gustafsson planned the study, secured funding, retrieved the data with support from I. Nilsson and M. San Sebastián; J. Schröders prepared the data and performed preliminary analyses with support from M. San Sebastián and P. E. Gustafsson; P. E. Gustafsson performed the final analyses with support from M. San Sebastián and J. Schröders; P. E. Gustafsson performed the literature review with the help of I. Nilsson and wrote the first draft of the manuscript; all authors contributed with interpretations on the results, revised the manuscript, and approved of the final submission.
References
- Adlbrecht, L., Bartholomeyczik, S., Hildebrandt, C., & Mayer, H. (2021). Social interactions of persons with dementia living in special care units in long-term care: A mixed-methods systematic review. Dementia (London), 20(3), 967–984. doi: 10.1177/1471301220919937 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ayalon, L., Chasteen, A., Diehl, M., Levy, B. R., Neupert, S. D., Rothermund, K., Tesch-Romer, C., & Wahl, H. W. (2021). Aging in times of the COVID-19 pandemic: Avoiding ageism and fostering intergenerational solidarity. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 76(2), e49–e52. doi: 10.1093/geronb/gbaa051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baxter, R., Lovheim, H., Bjork, S., Skoldunger, A., & Edvardsson, D. (2022). Exploring changes to resident thriving and associated factors in Swedish nursing homes: A repeated cross-sectional study. International Journal of Geriatric Psychiatry, 37(6). doi: 10.1002/gps.5731 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bethell, J., Aelick, K., Babineau, J., Bretzlaff, M., Edwards, C., Gibson, J. L., Hewitt Colborne, D., Iaboni, A., Lender, D., Schon, D., & McGilton, K. S. (2021). Social connection in long-term care homes: A scoping review of published research on the mental health impacts and potential strategies during COVID-19. Journal of the American Medical Directors Association, 22(2), 228–237.e225. doi: 10.1016/j.jamda.2020.11.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dahlberg, L. (2021). Loneliness during the COVID-19 pandemic. Aging and Mental Health, 25(7), 1161–1164. doi: 10.1080/13607863.2021.1875195 [DOI] [PubMed] [Google Scholar]
- Dahlberg, L., McKee, K. J., Frank, A., & Naseer, M. (2022). A systematic review of longitudinal risk factors for loneliness in older adults. Aging and Mental Health, 26(2), 225–249. doi: 10.1080/13607863.2021.1876638 [DOI] [PubMed] [Google Scholar]
- Diderichsen, F. (2021). How did Sweden fail the pandemic? International Journal of Health Services. Advance online publication. doi: 10.1177/0020731421994848 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dyer, C. (2020). Covid-19: Care home residents in England should have “safe spaces” for visits from family and friends, says guidance. BMJ, 371, m4302. doi: 10.1136/bmj.m4302 [DOI] [PubMed] [Google Scholar]
- Freedman, V. A., Hu, M., & Kasper, J. D. (2021). Changes in older adults’ social contact during the COVID-19 pandemic. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 77(7), e160–e166. doi: 10.1093/geronb/gbab166 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fuller, H. R., & Huseth-Zosel, A. (2021). Older adults’ loneliness in early COVID-19 social distancing: Implications of rurality. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 77(7), e100–e105. doi: 10.1093/geronb/gbab053 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gardiner, C., Laud, P., Heaton, T., & Gott, M. (2020). What is the prevalence of loneliness amongst older people living in residential and nursing care homes? A systematic review and meta-analysis. Age and Ageing, 49(5), 748–757. doi: 10.1093/ageing/afaa049 [DOI] [PubMed] [Google Scholar]
- Giri, S., Chenn, L. M., & Romero-Ortuno, R. (2021). Nursing homes during the COVID-19 pandemic: A scoping review of challenges and responses. European Geriatric Medicine, 12(6), 1127–1136. doi: 10.1007/s41999-021-00531-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gustafsson, P. E., Nilsson, I., & San Sebastian, M. (2022). Venerable vulnerability or remarkable resilience? A prospective study of the impact of the first wave of the COVID-19 pandemic and quarantine measures on loneliness in Swedish older adults with home care. BMJ Open, 12(5), e060209. doi: 10.1136/bmjopen-2021-060209 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gustavsson, J., & Beckman, L. (2020). Compliance to recommendations and mental health consequences among elderly in Sweden during the initial phase of the COVID-19 pandemic—A cross-sectional online survey. International Journal of Environmental Research and Public Health, 17(15), 5380. doi: 10.3390/ijerph17155380 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haber, N. A., Clarke-Deelder, E., Salomon, J. A., Feller, A., & Stuart, E. A. (2021). Impact evaluation of coronavirus disease 2019 policy: A guide to common design issues. American Journal of Epidemiology, 190(11), 2474–2486. doi: 10.1093/aje/kwab185 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Habib, H. (2020). Has Sweden’s controversial COVID-19 strategy been successful? BMJ, 369, m2376. doi: 10.1136/bmj.m2376 [DOI] [PubMed] [Google Scholar]
- Hansen, T., Sevenius Nilsen, T., Knapstad, M., Skirbekk, V., Skogen, J., Vedaa, O., & Nes, R. B. (2021). Covid-fatigued? A longitudinal study of Norwegian older adults’ psychosocial well-being before and during early and later stages of the COVID-19 pandemic. European Journal of Ageing, 19(3), 463–473. doi: 10.1007/s10433-021-00648-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ioannidis, J. P. A., Axfors, C., & Contopoulos-Ioannidis, D. G. (2021). Second versus first wave of COVID-19 deaths: Shifts in age distribution and in nursing home fatalities. Environmental Research, 195, 110856. doi: 10.1016/j.envres.2021.110856 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jansson, A. H., Savikko, N., Kautiainen, H., Roitto, H. M., & Pitkala, K. H. (2020). Changes in prevalence of loneliness over time in institutional settings, and associated factors. Archives of Gerontology and Geriatrics, 89, 104043. doi: 10.1016/j.archger.2020.104043 [DOI] [PubMed] [Google Scholar]
- Kang, B., Scales, K., McConnell, E. S., Song, Y., Lepore, M., & Corazzini, K. (2020). Nursing home residents’ perspectives on their social relationships. Journal of Clinical Nursing, 29(7–8), 1162–1174. doi: 10.1111/jocn.15174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kivi, M., Hansson, I., & Bjalkebring, P. (2021). Up and about: Older adults’ well-being during the COVID-19 pandemic in a Swedish Longitudinal Study. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 76(2), e4–e9. doi: 10.1093/geronb/gbaa084 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kontopantelis, E., Doran, T., Springate, D. A., Buchan, I., & Reeves, D. (2015). Regression based quasi-experimental approach when randomisation is not an option: Interrupted time series analysis. BMJ, 350, h2750. doi: 10.1136/bmj.h2750 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kotwal, A. A., Holt-Lunstad, J., Newmark, R. L., Cenzer, I., Smith, A. K., Covinsky, K. E., Escueta, D. P., Lee, J. M., & Perissinotto, C. M. (2021). Social isolation and loneliness among San Francisco Bay Area older adults during the COVID-19 shelter-in-place orders. Journal of the American Geriatrics Society, 69(1), 20–29. doi: 10.1111/jgs.16865 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lapane, K. L., Lim, E., McPhillips, E., Barooah, A., Yuan, Y., & Dube, C. E. (2022). Health effects of loneliness and social isolation in older adults living in congregate long term care settings: A systematic review of quantitative and qualitative evidence. Archives of Gerontology and Geriatrics, 102, 104728. doi: 10.1016/j.archger.2022.104728 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebrasseur, A., Fortin-Bedard, N., Lettre, J., Raymond, E., Bussieres, E. L., Lapierre, N., Faieta, J., Vincent, C., Duchesne, L., Ouellet, M. C., Gagnon, E., Tourigny, A., Lamontagne, M. E., & Routhier, F. (2021). Impact of the COVID-19 pandemic on older adults: Rapid review. JMIR Aging, 4(2), e26474. doi: 10.2196/26474 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lin, T., Horta, M., Heald, K., Heemskerk, A., Darboh, B., Levi, A., Spreng, R. N., Turner, G. R., & Ebner, N. C. (2022). Loneliness progression among older adults during the early phase of the COVID-19 pandemic in the United States and Canada. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 77(4), e23–e29. doi: 10.1093/geronb/gbab229 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Linden, A. (2015). Conducting interrupted time-series analysis for single- and multiple-group comparisons. Stata Journal, 15(2), 480–500. doi: 10.1177/1536867x1501500208 [DOI] [Google Scholar]
- Liu, W., Perkhounkova, E., Williams, K., Batchelor, M., & Hein, M. (2020). Food intake is associated with verbal interactions between nursing home staff and residents with dementia: A secondary analysis of videotaped observations. International Journal of Nursing Studies, 109, 103654. doi: 10.1016/j.ijnurstu.2020.103654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Losada-Baltar, A., Martinez-Huertas, J. A., Jimenez-Gonzalo, L., Pedroso-Chaparro, M. D. S., Gallego-Alberto, L., Fernandes-Pires, J., & Marquez-Gonzalez, M. (2021). Longitudinal correlates of loneliness and psychological distress during the lockdown situation due to COVID-19. Effects of age and self-perceptions of aging. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 77(4), 652–660. doi: 10.1093/geronb/gbab012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ludvigsson, J. F. (2020). The first eight months of Sweden’s COVID-19 strategy and the key actions and actors that were involved. Acta Paediatrica, 109(12), 2459–2471. doi: 10.1111/apa.15582 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luo, Y., Hawkley, L. C., Waite, L. J., & Cacioppo, J. T. (2012). Loneliness, health, and mortality in old age: A national longitudinal study. Social Science & Medicine, 74(6), 907–914. doi: 10.1016/j.socscimed.2011.11.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacLeod, S., Tkatch, R., Kraemer, S., Fellows, A., McGinn, M., Schaeffer, J., & Yeh, C. S. (2021). COVID-19 era social isolation among older adults. Geriatrics (Basel), 6(2), 52. doi: 10.3390/geriatrics6020052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller, E. A., Simpson, E., Nadash, P., & Gusmano, M. (2021). Thrust into the spotlight: COVID-19 focuses media attention on nursing homes. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 76(4), e213–e218. doi: 10.1093/geronb/gbaa103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mo, S., & Shi, J. (2020). The psychological consequences of the COVID-19 on residents and staff in nursing homes. Work, Aging and Retirement, 6(4), 254–259. doi: 10.1093/workar/waaa021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nanda, M., & Sharma, R. (2021). COVID-19: A comprehensive review of epidemiology and public health system response in Nordic region. International Journal of Health Services, 51(3), 287–299. doi: 10.1177/0020731421994840 [DOI] [PubMed] [Google Scholar]
- Palacios-Cena, D., Fernandez-Pena, R., Ortega-Lopez, A., Fernandez-Feito, A., Bautista-Villaecija, O., Rodrigo-Pedrosa, O., Arnau-Sanchez, J., & Lizcano-Alvarez, A. (2021). Long-term care facilities and nursing homes during the first wave of the COVID-19 pandemic: A scoping review of the perspectives of professionals, families and residents. International Journal of Environmental Research and Public Health, 18(19), 10099. doi: 10.3390/ijerph181910099 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parlapani, E., Holeva, V., Nikopoulou, V. A., Kaprinis, S., Nouskas, I., & Diakogiannis, I. (2021). A review on the COVID-19-related psychological impact on older adults: Vulnerable or not? Aging Clinical and Experimental Research, 33(6), 1729–1743. doi: 10.1007/s40520-021-01873-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perlman, D. C., & Peplau, L. A. (1981). Toward a social psychology of loneliness. In Duck S. & Gilmour R. (Eds.), Personal relationships in disorder (pp. 31–56). Academic Press. [Google Scholar]
- Public Health Agency of Sweden. (2020). Exempel på åtgärder för att minska spridning av covid-19 på särskilda boenden för äldre—En sammanställning av exempel från verksamheter, kommuner och regioner [Examples of measures to reduce transmission of covid-19 at special residential homes for elderly—A review of examples from organizations, municipalities and regions]. https://www.folkhalsomyndigheten.se/contentassets/451e2b507dbc49d6b3bd9f74432e9416/exempel-atgarder-minska-spridning-covid-19-sarskilda-boenden-aldre.pdf
- Seifert, A., Cotten, S. R., & Xie, B. (2021). A double burden of exclusion? Digital and social exclusion of older adults in times of COVID-19. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 76(3), e99–e103. doi: 10.1093/geronb/gbaa098 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simard, J., & Volicer, L. (2020). Loneliness and isolation in long-term care and the COVID-19 pandemic. Journal of the American Medical Directors Association, 21(7), 966–967. doi: 10.1016/j.jamda.2020.05.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Skoog, I. (2020). COVID-19 and mental health among older people in Sweden. International Psychogeriatrics, 32(10), 1173–1175. doi: 10.1017/S104161022000143X [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith, M. L., Steinman, L. E., & Casey, E. A. (2020). Combatting social isolation among older adults in a time of physical distancing: The COVID-19 social connectivity paradox. Frontiers in Public Health, 8, 403. doi: 10.3389/fpubh.2020.00403 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stolz, E., Mayerl, H., & Freidl, W. (2021). The impact of COVID-19 restriction measures on loneliness among older adults in Austria. European Journal of Public Health, 31(1), 44–49. doi: 10.1093/eurpub/ckaa238 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Swedish Association of Local Authorities and Regions. (2016). Classification of Swedish municipalities 2017. https://skr.se/download/18.4d3d64e3177db55b16631b96/1615474478946/Classification%20of%20Swedish%20Municipalities%202017.pdf
- The Swedish Corona Commission. (2020). Äldreomsorgen under pandemin SOU 2020:80 [Elderly care during the pandemic]. Statens Offentliga Utredningar. [Google Scholar]
- Vogel, G. (2020). Sweden’s gamble. Science, 370(6513), 159–163. doi: 10.1126/science.370.6513.159 [DOI] [PubMed] [Google Scholar]
- Xu, H., Intrator, O., & Bowblis, J. R. (2020). Shortages of staff in nursing homes during the COVID-19 pandemic: What are the driving factors? Journal of the American Medical Directors Association, 21(10), 1371–1377. doi: 10.1016/j.jamda.2020.08.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang, X. M., Jiao, J., Cao, J., Huo, X. P., Zhu, C., Wu, X. J., & Xie, X. H. (2021). Frailty as a predictor of mortality among patients with COVID-19: A systematic review and meta-analysis. BMC Geriatrics, 21(1), 186. doi: 10.1186/s12877-021-02138-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.