Skip to main content
PLOS One logoLink to PLOS One
. 2024 Feb 8;19(2):e0296851. doi: 10.1371/journal.pone.0296851

Assessing community-level impacts of and responses to stay at home orders: The King County COVID-19 community study

Kathleen Moloney 1,*, Julio A Lamprea Montealegre 2, Tania M Busch Isaksen 1, Mallory Kennedy 1, Megan Archer 1,3,#, Carlos Contreras 1,#, Daaniya Iyaz 1,#, Juliette Randazza 1,4,#, Javier Silva 1,#, Nicole A Errett 1,5,*
Editor: Ayi Vandi Kwaghe6
PMCID: PMC10852336  PMID: 38330074

Abstract

Background

At the beginning of the COVID-19 pandemic, non-pharmaceutical interventions (NPIs) of unprecedented scope and duration were implemented to limit community spread of COVID-19. There remains limited evidence about how these measures impacted the lived experience of affected communities. This study captured the early impacts and coping strategies implemented in King County, Washington, one of the first U.S. communities impacted by COVID-19.

Methods

We conducted a cross-sectional web-based survey of 793 English- and Spanish-speaking adult King County residents from March 18, 2020 –May 30, 2020, using voluntary response sampling. The survey included close- and open-ended questions on participant demographics, wellbeing, protective actions, and COVID-19-related concerns, including a freeform narrative response to describe the pandemic’s individual-, family- and community-level impacts and associated coping strategies. Descriptive statistics were used to analyze close-ended questions, and qualitative content analysis methods were used to analyze free-form narrative responses.

Results

The median age of participants was 45 years old, and 74% were female, 82% were White, and 6% were Hispanic/Latinx; 474 (60%) provided a qualitative narrative. Quantitative findings demonstrated that higher percentages of participants engaged in most types of COVID-19 protective behaviors after the stay-at-home order was implemented and schools and community spaces were closed, relative to before, and that participants tended to report greater concern about the pandemic’s physical health or healthcare access impacts than the financial or social impacts. Qualitative data analysis described employment or financial impacts (56%) and vitality coping strategies (65%), intended to support health or positive functioning.

Conclusions

This study documented early impacts of the COVID-19 pandemic and the NPIs implemented in response, as well as strategies employed to cope with those impacts, which can inform early-stage policy formation and intervention strategies to mitigate the negative impacts. Future research should explore the endurance and evolution of the early impacts and coping strategies throughout the multiyear pandemic.

Introduction

The impacts of COVID-19 and associated societal responses are multidimensional and an area of current research. Moreover, these impacts have been shown to be dynamic and community specific [1, 2]. Non-pharmaceutical interventions (NPIs), including masking, social distancing, and community-wide shutdowns, were one form of societal response that was widely implemented throughout the pandemic. Even following development and widespread availability of effective medical countermeasures, NPIs remain an important contributor to controlling community transmission, particularly in the face of variants of concern [3]. However, the impacts of NPIs on mental health, access to health care, financial stability, and other important aspects of wellbeing require further study for a more holistic understanding of their consequences.

One type of NPI, stay-at-home orders, shutdowns, or lockdowns, have been implemented by governments across the world to curb the spread of SARS-CoV-2 and associated COVID-19 [4, 5]. Though stay-at-home orders have demonstrated effectiveness in lowering rates of SARS-CoV-2 transmission and preventing the excess morbidity and mortality associated with COVID-19, this type of NPI also has unintended negative impacts [6]. For instance, these orders, which forced closure of “non-essential” businesses, had various impacts on work. It is estimated that approximately 9.6 million U.S. workers lost their employment during 2020 as a result of COVID-19-related employment disruptions, a disproportionate share of which were low-wage workers [7]. In low- and middle-income countries, economic recessions, such as the initial recession caused by the COVID-19 pandemic, are associated with excess mortality. For example, a survey of over 30,000 participants from Burkina Faso, Ghana, Kenya, Rwanda, Sierra Leone, Bangladesh, Nepal, Philippines, and Colombia found massive increases in food insecurity as a result of the economic insecurity created by the pandemic and associated NPIs [8].

Many schools were also closed for months as part of the stay-at-home orders, impacting the academic outcomes of students worldwide. A systematic review of the impacts of COVID-19-related school closures on student achievement estimated that primary school children’s reading and mathematics test scores decreased by a median of 0.37 standard deviations during remote learning, and that the academic achievement gap between students of high and low socioeconomic status would increase by nearly 30% [9]. Many students unenrolled as a result of the school closures, with potentially disproportionate impacts in the global South; a study conducted in Ethiopia, Malawi, Nigeria, and Uganda found that enrollment of children in primary school dropped from 96% to around 46% during the pandemic [10].

The COVID-19 pandemic and responsive stay-at-home orders are also associated with negative physical health impacts beyond the health consequences of infection with SARS-CoV-2. For example, reduced physical activity has been shown to be aligned with implementation of stay-at-home orders [11, 12]. Additionally, access to healthcare was limited by the burden the pandemic placed on many healthcare systems, leading to delays in care for patients with chronic and emergent health conditions and a temporary suspension of preventive healthcare, such as cancer screenings. Research continues to emerge about the excess morbidity and mortality likely attributable to these delays in care. A study in the United Kingdom, for example, estimated between a 4.8 to 16.6 increase in deaths due to various types of cancers as a result of delayed screenings during the pandemic [13].

The mental health impacts of the pandemic are equally alarming. COVID-19 stay-at-home orders have been associated with greater health anxiety, financial worry, and loneliness [14]. For instance, health-related quality of life has declined from pre-pandemic levels, particularly among young adults [15]. Healthcare workers in particular have suffered many adverse mental health impacts, with 41% of healthcare workers enrolled in the HERO study from April to July 2020 expressing feelings of burnout [16]. Racial and ethnic minorities, individuals with disabilities, women, and those who are precariously housed or employed have borne a disproportionate burden across all categories of the pandemic’s impacts, including risk of COVID-19 exposure, additional health-related consequences, and disruptions to the social and economic underpinnings of health and wellbeing [17, 18].

While national and international surveys have attempted to understand the immediate impacts of NPIs on individuals and households [1921], less research has explored such impacts in a geographically bounded community. Given the variability of NPIs implemented in response to COVID-19 between various U.S. states and counties, research examining the impacts on a smaller geographical area where all community members experienced the same COVID-19 preventive measures is warranted. Moreover, research has shown that implementation of the same NPIs have resulted in different impacts in different contexts. For instance, our own research on bike and pedestrian trail use changes following COVID-19 stay-at-home orders in Seattle, Houston, and New York found that while there were significant impacts in all cities, the direction of change varied by location [12]. Accordingly, the King County COVID-19 Community Study (KC3S) aims to learn from the experiences of the residents of a single county, King County, WA.

Washington was the first U.S. state known to be affected by COVID-19. In response, the state and King County, home to the city of Seattle, were among the first to implement community-level NPIs to stem SARS-CoV-2 transmission. At various stages of the pandemic, these strategies consisted of NPIs such as closures for certain businesses; a statewide Stay Home, Stay Healthy order; and mask mandates [22]. Additionally, public schools, colleges, and universities in King County largely offered online-only instruction, and many local health care providers suspended elective procedures and discouraged patients from seeking in-person, non-emergency care during the first year of the pandemic.

The King County COVID-19 Community Study compliments the several national and international surveys that have been distributed in response to COVID-19 by providing accounts of impacts and resilience in the context of community-specific COVID-19 impacts and implementation of NPIs. This exploratory, descriptive study is guided by two central research questions: 1) How are individuals, families, and communities impacted by COVID-19 and responsive NPIs implemented in their community?, and 2) How are individuals, families, and communities adapting to and coping with the impacts of COVID-19 and responsive NPIs implemented in their community [23]? The King County COVID-19 Community Study aimed to characterize, in real time, how the NPIs implemented in King County impacted the lives and wellbeing of individuals, families, and communities, as well as the ways in which individuals, families, and communities have adapted and coped in the initial phases of the pandemic.

Methods

We conducted an online survey of King County community members to understand the impacts of COVID-19 and responsive NPIs on individuals, their families, and broader community, as well as associated coping mechanisms, in the initial phase of the COVID-19 pandemic response using a voluntary response sample approach [23]. Study data were collected and managed using REDCap (Research Electronic Data Capture) tools [24] hosted at the Institute of Translational Health Sciences. Research Electronic Data Capture is a secure, web-based application designed to support data capture for research studies, providing: 1) an intuitive interface for validated data entry; 2) audit trails for tracking data manipulation and export procedures; 3) automated export procedures for seamless data downloads to common statistical packages; and 4) procedures for importing data from external sources.

The survey included a mix of multiple choice and open-ended questions about experiences with COVID-19, engagement in behaviors to minimize COVID-19 risk, level of concern with potential impacts of COVID-19, emotional state, presence of COVID-19 symptoms, impacts of COVID-19 on work, and use of tools to cope with COVID-19-related stress and other impacts [23]. The World Health Organization-Five Well-Being Index (WHO-5), a brief measure with 5 items rated on a 0 to 5-point Likert scale, was included in the survey as a validated measure of current mental wellbeing [25]. The total sum of all 5 items is converted into a percentage score, with 0 representing the worst possible wellbeing and 100 representing the best possible wellbeing; a score of 50 or less is generally used as a cutoff when screening for clinical depression [25]. English and Spanish versions of the WHO-5 questionnaire are publicly available at https://www.psykiatri-regionh.dk/who-5/who-5-questionnaires/Pages/default.aspx [26]. The survey also collected information about respondents’ demographic characteristics, including age, gender identity, education, income, race/ethnicity, health insurance status, and area residence (e.g., ZIP code, county, neighborhood), and households (e.g., number of people overall, under 18, and high-risk for COVID-19 in the respondent’s household). Survey items without a pre-existing validated Spanish translation were translated by a study team member who was a native Spanish-speaker, also fluent in English. Prior to the release of the survey, multiple members of the research team with a variety of education and experience levels reviewed the survey and piloted taking the survey via the REDCap form to ensure accessibility and readability.

The University of Washington Human Subjects Division (HSD) reviewed the study protocol and determined the study was human subjects research that qualified for exempt status (STUDY00009765). Participants were provided an overview of the potential risks and benefits of study participation on the study webpage, and informed that accessing the survey via the provided link and answering survey questions indicated consent to participate in the research study.

Study setting

King County, which includes the city of Seattle, has a total population of just under 2.3 million people [27]. Approximately 64% of the population identifies as White, 7% as Black or African American, 1% as American Indian or Alaska Native, 22% as Asian, 1% as Native Hawaiian or Pacific Islander, and 6% as mixed race [27]. Eleven percent of the population identifies as Hispanic or Latinx, and approximately 7% of the population speaks Spanish [28]. The median household income is $106,326 [27]. Of those aged 25 or older, approximately 94% have at least a high school degree and 54% have at least a Bachelor’s degree [27].

Sample and data collection

To participate in the survey, respondents were required to indicate in the survey that they were at least 18 years old, living in King County, and able to respond to the survey in the languages offered (Spanish and English). Only those who indicated an age less than 18 years or that they did not reside in King County were excluded from study participation. The research team employed a multipronged approach to recruit community members to complete the survey. We posted information about the survey through community-based organizations, University of Washington websites, social media, online forums (e.g., Next-door), flyers placed in communities and businesses, local media organizations, and word of mouth. Recruitment materials described the study and directed interested participants to a website to learn more about the study and participate. Respondents completed the survey between March 18, 2020, and May 30, 2020 [23].

Participant characteristics

In total, 793 participants completed or partially completed the online survey, with 787 (99%) participants completing the survey in English and 6 (1%) participants completing the survey in Spanish. The participants ranged in age from 18 to 87 years old, with a median age of 45 (IQR 33–56, Table 1). Seventy-four percent of the sample identified as female, 20% as male, and 3% as non-binary. Most participants had attended at least some college, with 39% of participants having attained a bachelor’s degree and 43% of participants having attained a graduate degree. Over two-thirds of participants were currently employed at the time of survey completion (55% full-time and 14% part-time); 12% of participants were retired and 3% were currently unemployed.

Table 1. General characteristics of participants (N = 793).

Characteristic
Age, years; median (IQR)a 45 (33–56)
Gender; n (%)
    Female 583 (74)
    Male 156 (20)
    Non-binary 22 (3)
    Other 3 (>1)
    Missing 29 (4)
Race; n (%)
    White 650 (82)
    Black 13 (2)
    Asian 63 (8)
    American Indian or Alaska Native 11 (1)
    Native Hawaiian or Pacific Islander 4 (1)
    Other 42 (5)
    Missing 10 (1)
Ethnicity; n (%)
    Non-Hispanic/Non-Latinx 737 (93)
    Hispanic/Latinx 45 (6)
    Missing 11 (1)
Employment; n (%)
    Full time 434 (55)
    Part time 109 (14)
    Retired 99 (12)
    Unemployed 20 (3)
    Other 126 (16)
    Missing 5 (1)
Education; n (%)
    High school 16 (2)
    Some college 80 (10)
    Associates degree 43 (5)
    Bachelor’s degree 306 (39)
    Graduate degree 342 (43)
    Missing 6 (1)
Gross annual household income, USD; median (IQR) 110,000 (68,000–180,000)
Number of household members; median (IQR) 2 (2–3)
Number of household members <18 years old; median (IQR) 0 (0–1)
Health insurance; n (%) 770 (97)
Spanish survey; n (%) 6 (1)
COVID-19 symptoms & testing; n (%)
    Experienced flu-like symptoms 225 (28)
    Tested for COVID-19 15 (2)
    Positive COVID-19 test 11 (1)

a IQR: interquartile range

Data analysis

The survey data were exported to Microsoft Excel for review and cleaning. Once the data were cleaned, the research team calculated descriptive statistics for multiple choice questions. Differences in participants’ reported frequencies of engaging in COVID-19 protective behaviors, such as increased handwashing, decreased use of public transport, or avoidance of gatherings, before and after March 15, 2020, the date when K-12 schools as well as bars, restaurants and places of recreation were ordered to close in King County, were analyzed using McNemar’s test for equality of paired proportions. A WHO-5 Well-being Index percentage score was calculated for the subset of participants who wrote a narrative description of their experiences during the COVID-19 pandemic, to allow for comparison of these scores to participants’ open-ended descriptions of impacts and coping strategies. Differences in WHO-5 Well-being Index percentage scores across gender and age groups of participants were analyzed using the Kruskal-Wallis rank sum test.

To analyze the open-ended data detailing respondents’ stories about COVID-19, we used a directed content analysis approach [29]. A codebook was developed based on the study goals, and the framework for describing disaster losses and coping strategies presented in a recently published disaster research article by Peek et al [30]. One member of the study team applied the codebook to a sample of open-ended responses to assess the robustness of the codebook relative to the data prior to broader application by the study team. The codebook included code names, definitions, examples of correct code application from the survey responses, and notes about inclusion and exclusion criteria. One member of the research team trained the other coders on the codebook. The group engaged in a consensus-building activity that consisted of applying the draft codebook to 20 stories independently, meeting to discuss and adjudicate differences in applied codes, and revising the codebook in accordance with group discussion. Codes and definitions from the final codebook are provided in Table 2 below.

Table 2. Qualitative codes and illustrative quotes from KC3S survey participants.

Code Definition
Impacts at the Individual, Family & Community Level
    Employment or Financial Impact Impact to employment or finances
    Covid-19 Physical Health Impact Covid-19-related symptoms or death
    Other Physical Health Impact Impact to physical health, including disruptions to health care
    Mental or Behavioral Health Impact Impact to mental health, including disruptions to mental health care
    Social Impact Impact to social life
    Education or Childcare Impact Impact to childcare or education (elementary school, high school, higher education, etc.)
    Inequitable Impact Impact that disproportionately affects a group or groups
    Displacement Impact Impact to location or housing
    Lasting Impact Impacts that respondent thinks or hopes will be lasting
    Other Impact Impacts that do not fall into one of the above categories
    No Impact Absence of impact
Coping Strategies at the Individual, Family & Community Level
    Vitality Coping Strategy Strategy intended to support health or positive functioning
    Opportunity Strategy Strategy intended to support the achievement of life goals or financial stability
    Connectedness Strategy Strategy intended to maintain or strengthen social/community support and interdependence
    Contribution Strategy Strategy intended to support meaning, purpose, engagement, or belonging
    Inspiration Strategy Strategy intended to support motivation or hopefulness
    No Individual Coping Strategy Needed Lack of need for coping strategy
Perspective on Community & Government Response
    Inadequate Community Response Failure of community to respond
    Inadequate Government Response Failure of systems; mistrust of federal or other government leaders or systems; questioning government decisions/strategies; lack of political will or ethical leadership; inadequate policy support

To reduce bias, after the initial round of coding, three teams of two coders each worked together to co-code the remainder of the open-ended responses using NVivo qualitative analysis software. The coders worked in groups of two to discuss and adjudicate differences in their coding. Coders posed questions about the coding to the larger group via email as needed.

Upon completing coding, the team merged the coding teams’ NVivo files into a single file. The qualitative data was then merged with the quantitative data file, with each code included as a binary variable coded as a ‘1’ if it was present in each participant’s story, and ‘0’ if it was not present. The percentage of participants’ stories that included each code was calculated, and differences between gender and age groups were compared using Fisher’s exact test. Participants who did not provide a response to the open-ended prompt were not included in this analysis. Associations between codes describing COVID-19-related impacts and codes describing coping strategies were also examined. All qualitative data analysis was completed in NVivo Version 12 and NVivo for Mac [31]; quantitative analyses were performed using RStudio Version 4.1.2 [32].

To allow for accurate assessment of areas of convergence and divergence between the quantitative and qualitative data, we also conducted a sensitivity analysis of the quantitative survey data capturing participants’ level of concern about potential impacts of the pandemic; only participants who responded to both the survey questions and provided an open-ended narrative were included in this analysis.

Results

Engagement in COVID-19 protective behaviors

Participants were asked to indicate if they had increased engagement in specific behaviors to minimize COVID-19 risk both prior to March 15th, 2020 and after March 15th, 2020. Across nearly every category of COVID-19 protective behavior, a statistically significantly higher percentage of participants (p<0.05) reported engaging in the behavior after March 15th, 2020, relative to prior to that date (Table 3). The three exceptions were: “avoided large gatherings”, specified as greater than 50 people (82% vs 80%, p = 0.2); “increased handwashing for at least 20 seconds with soap and water”(88% vs 81%, p<0.001); and “increased hand sanitizer use”(65% vs 58%, p<0.001), perhaps due to earlier public health recommendations regarding these protective actions [33].

Table 3. Reported frequencies of COVID-19 protective behaviors before and after March 15th, 2020a.

n (%)
Behavior Before 3/15/20 After 3/15/20 P-value b
Increased handwashing for at least 20 seconds with soap and water 700 (88) 644 (81) <0.001
Increased hand sanitizer use 512 (65) 457 (58) <0.001
Stayed home more often 564 (71) 685(86) <0.001
Increased time working from home 394 (50) 504 (64) <0.001
Decreased or discontinue going to bars and restaurants 497 (63) 652 (82) <0.001
Decreased or discontinue going to gym 387 (48) 498 (63) <0.001
Increased outdoor physical activity 281 (35) 427 (54) <0.001
Decrease or discontinued use of public transportation 402 (51) 453 (57) <0.001
Avoided small gatherings (<10 people) 343 (43) 700 (88) <0.001
Avoided midsize gatherings (11–50 people) 567 (72) 675 (85) <0.001
Avoided large gatherings (>50 people) 634 (80) 653 (82) 0.2
Canceled or delayed routine healthcare appointment or elective procedure 270 (34) 436 (55) <0.001
Canceled or delayed routine dental appointment 241 (30) 393 (50) <0.001
Purchased extra food or commodities 451 (57) 510 (64) <0.001

a The date when King County K-12 schools, bars, restaurants and places of recreation were ordered to close

b P-value based on McNemar’s test for equality in paired proportions

Degree of concern about potential COVID-19 impacts

Participants were also asked to rate the degree of their concern about various potential COVID-19 impacts, which included impacts to physical health, financial stability, and social isolation (Table 4). In general, participants reported a greater degree of concern over the potential physical health or healthcare access impacts of the pandemic than the potential financial or social impacts. The highest percentage of participants reported being “very concerned” about “an at-risk family member getting sick” (69%), followed by “not being able to receive healthcare” (39%). Around half of participants reported being “somewhat concerned” about “getting sick myself” (56%), “my family members being socially isolated” (47%), and “not being able to access healthcare for emergent conditions other than COVID-19” (46%). A majority of respondents reported being “not concerned” about “inability to retire on time” (67%), “not being able to pay bills” (53%), and “not being able to work” (50%). The ranking of concerns remained consistent when only data from participants who provided a qualitative narrative was included, with the distribution of participants responding “not concerned”, “somewhat concerned”, or “very concerned” to each item differing by at most 1–3% from the overall sample.

Table 4. Reported concern about potential COVID-19 impacts.

n (%)
Not concerned Somewhat concerned Very concerned
Getting sick myself (n = 789) 113 (14) 444 (56) 232 (29)
An at-risk family member getting sick (n = 772) 45 (6) 198 (26) 529 (69)
Not being able to receive healthcare (n = 781) 151 (19) 327 (42) 303 (39)
Not being able to access healthcare for conditions other than Covid-19 (n = 778) 357 (46) 262 (34) 159 (20)
Not being able to access healthcare for emergent conditions other than Covid-19 (n = 783) 192 (25) 358 (46) 233 (30)
Not being able to work (n = 760) 382 (50) 200 (26) 178 (23)
Not being able to pay bills (n = 770) 409 (53) 185 (24) 176 (23)
Inability to retire on time (n = 742) 495 (67) 140 (19) 107 (14)
Being socially isolated myself (n = 778) 325 (42) 312 (40) 141 (18)
My family members being socially isolated (n = 776) 172 (22) 368 (47) 236 (30)

WHO-5 well-being index scores

We calculated WHO-5 Well-being Index percentage scores for the subset of participants who wrote a narrative description of their experiences during the COVID-19 pandemic (n = 474). The median WHO-5 Well-being Index percentage score amongst the overall sample was 72 (interquartile range (IQR) 56–88). There was no statistically significant difference in median WHO-5 Well-being Index percentage scores by gender. However, statistically significantly lower WHO-5 Well-being Index percentage scores were associated with higher age (p<0.001); those in the eldest age group (65 years and older) had a median score of 60 (IQR 48–80), versus a median score of 76 (IQR 64–88) in the youngest age group (18 to 34 years old).

Open-Ended narratives about COVID-19 experiences

A total of 474 survey participants (60%) wrote a narrative description of their experiences during the COVID-19 pandemic, including impacts to themselves, their family, and/or their broader community and associated coping strategies. These 474 narratives were included in qualitative data analysis. Qualitative codes included in the final version of the codebook described three general categories of participants’ experiences: impacts of the COVID-19 pandemic or the associated NPIs, coping strategies employed to mitigate the impacts, and perspectives about the community or government response to the pandemic (Table 2).

Impacts at the individual, family, and community level

Among all participants who provided a written narrative, the most frequently reported impact of the pandemic was “Employment or Financial Impact,” with 56% of participants’ narratives describing this type of impact (Table 5). Examples of the employment or financial impacts described by participants included “being the sole source of income in my family due to being the only one who can work remotely”, “COVID-19 has almost halted my business completely”, and “friends who were sent home without pay for at least two to three weeks.” One participant described losing their job due to contracting what they believed was COVID-19, stating they had been “[laid] off because [they] didn’t get better.”

Table 5. Impacts of covid-19 lockdowns and coping strategies of qualitative study participants by gender and age group.

Overall Gender a Age Group (years) a
Variable N = 474 Female, Male, Non-binary, p- 18–34, 35–54, 55–64, 65+, p-
n = 342 n = 97 n = 17 value b n = 124 n = 221 n = 77 n = 52 value b
WHO-5 Well-being Index Percentage Score; median (IQR) c 72 (56–88) 72 (56–88) 68 (56–84) 84 (60–100) 0.5 76 (64–88) 72 (60–88) 66 (52–88) 60 (48–80) <0.001
    Impacts at the Individual, Family & Community Level; n (%)
        Employment or Financial Impact 264 (56) 194 (57) 57 (59) 8 (47) 0.6 75 (60) 130 (59) 44 (57) 15 (29) <0.001
        Social Impact 183 (39) 140 (41) 33 (34) 4 (24) 0.2 52 (42) 72 (33) 33 (43) 25 (48) 0.10
        Other Physical Health Impact 181 (38) 142 (42) 24 (25) 9 (53) 0.006 42 (34) 79 (36) 34 (44) 26 (50) 0.13
        Mental or Behavioral Impact 167 (35) 129 (38) 23 (24) 6 (35) 0.012 45 (36) 81 (37) 22 (29) 18 (35) 0.6
        Education or Childcare Impact 113 (24) 89 (26) 18 (19) 2 (12) 0.2 24 (19) 71 (32) 15 (19) 3 (6) <0.001
        Other Impact 89 (19) 66 (19) 18 (19) 4 (24) 0.6 20 (16) 40 (18) 16 (21) 13 (25) 0.5
        No Impact 68 (14) 46 (13) 14 (14) 2 (12) >0.9 18 (15) 40 (18) 6 (8) 4 (8) 0.066
        Covid-19 Physical Health Impact 27 (6) 19 (6) 7 (7) 1 (6) ** 9 (7) 13 (6) 4 (5) 1 (2) **
        Inequitable Impact 25 (5) 21 (6) 4 (4) 0 (0) ** 3 (2) 13 (6) 4 (5) 5 (10) **
        Lasting Impact 20 (4) 16 (5) 2 (2) 1 (6) ** 5 (4) 8 (4) 2 (3) 5 (10) **
        Displacement Impact 12 (3) 11 (3) 1 (1) 0 (0) ** 6 (5) 5 (2) 1 (1) 0 (0) **
    Coping Strategies at the Individual, Family & Community Level; n (%)
        Vitality Coping Strategy 306 (65) 228 (67) 56 (58) 13 (76) 0.2 73 (59) 134 (61) 55 (71) 43 (83) 0.007
        Connectedness Strategy 150 (32) 121 (35) 21 (22) 4 (24) 0.008 37 (30) 59 (27) 29 (38) 24 (46) 0.030
        Contribution Strategy 76 (16) 62 (18) 11 (11) 2 (12) 0.4 15 (12) 31 (14) 18 (23) 12 (23) 0.071
        Inspiration Strategy 64 (14) 52 (15) 9 (9) 1 (6) 0.13 14 (11) 23 (10) 15 (19) 12 (23) 0.034
        Opportunity Strategy 26 (5) 22 (6) 3 (3) 1 (6) ** 8 (6) 11 (5) 5 (6) 2 (4) **
        No Individual Coping Strategy Needed 3 (1) 1 (0) 2 (2) 0 (0) ** 1 (1) 2 (1) 0 (0) 0 (0) **
    Perspective on Community & Government Response; n (%)
        Inadequate Government Response 73 (15) 55 (16) 13 (13) 1 (6) 0.3 18 (15) 30 (14) 14 (18) 11 (21) 0.5
        Inadequate Community Response 66 (14) 52 (15) 8 (8) 3 (18) 0.009 21 (17) 34 (15) 8 (10) 3 (6) 0.2

a 16 participants missing gender data and 1 participant missing age data were excluded

b Kruskal-Wallis rank sum test; Fisher’s exact test; results significant at the p <0.05 level are bolded; p-values for impacts and coping strategies endorsed by less than 30 participants from the overall sample were removed

c IQR: interquartile range

“Social Impact” (39% of participants) was the second most frequently reported impact. As one participant wrote, describing how their pre-existing mental health conditions made coping with the social isolation created by stay-at-home orders particularly difficult,

“My history of PTSD [post-traumatic stress disorder] and Depression make isolation especially hard…I feel terrified at the idea that no one can hold me. I live alone and have no physical touch.”

“Other Physical Health Impact” (38%), such as being unable to “receive [medical] treatment for the foreseeable future” for chronic health conditions, and “Mental or Behavioral Impact” (35%), such as an inability to be “productive at all”, were the next most frequently cited impacts. Around 14% of participants described the pandemic as currently having no impact on their lives (Table 5). One such participant, describing how their partner’s ability to work remotely had insulated them from some of the pandemic’s impacts, stated,

“My husband’s company was one of the first to send people home [on March 2nd]. His ability to earn a paycheck and have satisfying work and be safe during this time is an immense relief.”

Comparing the prevalence of impacts by gender, statistically significant differences were found for two impact categories, “Other Physical Health Impact” (p = 0.006) and “Mental or Behavioral Impact” (p = 0.012). Those who identified as female or non-binary were more likely than those who identified as male to describe experiencing each of these types of impacts (Table 5). Comparing the prevalence of impacts by age group, those in the youngest age group (18 to 34 years old) were the most likely to express an employment or financial impact (60%), versus only 29% of those in the eldest age group, 65 years and older (p<0.001). Those in the 35 to 54 years old group were the most likely to express an education or childcare impact (32%), as compared with 6% of the 65 years and older group and 19% of both the 18 to 34 years old and 55 to 64 years old groups (p<0.001, Table 5).

Coping strategies at the individual, family, and community level

Among all participants included in qualitative data analysis, the most frequently employed coping strategy in response to the pandemic’s impacts was “Vitality Coping Strategy”; 65% of participants’ narratives described using this type of coping strategy (Table 5). Examples of the vitality coping strategies described by participants include “trying to educate our children on self care”, “cleaning, sanitizing, stopping visitors, stocking up on supplies”, and “still going to trails for hike or bike if not too crowded.” “Connectedness Strategy” (32% of participants) was the next most frequently applied coping strategy code. Examples of the connectedness coping strategies described by participants include “using Zoom with my friends to create social gatherings”, “increased talking to friends and family via phone”, and “taking photos and videos to post to a group for the neighborhood on Facebook.” Only 1% of participants stated that they did not need any individual coping strategy. As one such participant stated, the stay-at-home order had not created a major shift in their usual, pre-pandemic routine:

Thankfully, I’ve been working from home for 11.5 years and am an introvert, so staying at home hasn’t been a huge adjustment for me.

Comparing the prevalence of coping strategies by gender, statistically significant differences were found for only “Connectedness Strategy” (p = 0.008). Those who identified as female were more likely than those who identified as male or non-binary to describe employing this type of coping strategy (Table 5). Comparing the prevalence of coping strategies by age group, three types of coping strategies were found to be statistically significantly different between groups, “Connectedness Strategy” (p = 0.03), “Vitality Coping Strategy” (p = 0.007), and “Inspiration Strategy” (p = 0.034). For each of these coping strategies, being a member of an older age group was associated with increased prevalence of employing the coping strategy.

Associations between impacts and coping strategies

Distributions of types of coping strategies associated with each category of impact are shown in Fig 1. Regardless of the type of impact a participant described, they were most likely to describe a vitality coping strategy associated with that impact. Between 62–83% of participants describing any category of impact also described engaging in a vitality coping strategy. Connectedness strategies were the second most frequently described coping strategy; again, this held true regardless of the type of impact a participant described. Between 26–65% of participants describing any category of impact also described engaging in a connectedness coping strategy. Distributions of the coping strategies engaged in less frequently also remained relatively consistent across impact categories, with some minor variations (Fig 1).

Fig 1. Impacts of covid-19 lockdowns and associated coping strategies (N = 474).

Fig 1

Discussion

The King County, Washington residents who participated in this study indicated that the first several months of the COVID-19 pandemic and community-level NPIs implemented in response had impacted them, their family, and their community in a variety of ways, and described numerous coping strategies that they had employed in response to these impacts. Analysis of quantitative survey data demonstrated statistically significantly higher percentages of participants were engaged in most types of COVID-19 protective behaviors after K-12 schools, and bars, restaurants, movie theaters, and other social gathering places were ordered to close in King County on March 15th, 2020, relative to before that date. The exceptions were avoiding large gatherings, which nearly equal numbers of participants reported avoiding before and after March 15th, as well as increased handwashing and increased hand sanitizer use, both of which fewer participants reported engaging in after March 15th. Participants responding to close-ended survey questions tended to report a greater degree of concern about the physical health or healthcare access impacts of the pandemic than the financial or social impacts; half or more of the participants indicated that they were “not concerned” about inability to work, pay bills, or retire on time.

Participants likely reported avoiding large gatherings in nearly equal numbers before and after March 15th due to guidance and/or restrictions limiting large gatherings in King County prior to that date; social distancing was recommended in King County as early as March 10th, and by March 11th, all gatherings of greater than 250 people were canceled [34]. Frequent handwashing and use of hand sanitizer were also among the first protective actions recommended by public health officials in response to the pandemic [32]. Even during the relatively early stage of the pandemic when this study was conducted, King County residents had likely heard the advice to engage in frequent handwashing and/or hand sanitizing numerous times. Thus, a lower number of participants may have reported engaging in these actions after March 15th due to message fatigue. An association between message fatigue and decreased retention of and compliance with public health guidance has been demonstrated by numerous other studies, both in the context of COVID-19 [35] and other public health emergencies [36].

Given the increasing frequency with which new infectious diseases have emerged over the past century [37], as well as the current and projected impacts of climate change on the frequency of novel zoonotic disease emergence, the likelihood of another pandemic may triple over the next 30 years [38]. Non-pharmaceutical interventions such as stay-at-home orders, shutdowns, or lockdowns reduced the morbidity and mortality due to COVID-19 [39], but appear to have resulted in unintended negative consequences for the health and wellbeing of the individuals subjected to them [4043]. Further research is needed to fully understand the overall impact of NPIs on all domains of health and wellbeing, particularly when implemented for long periods of time. However, the documented mental health impacts of the pandemic and associated NPIs, in combination with the evidence that suggests increased psychological distress is correlated with decreased compliance with NPIs [44], indicate that identifying strategies to mitigate these unintended consequences is critical to ensure that NPIs protect the health and wellbeing of populations as intended.

In contrast to the quantitative survey findings about pandemic-related concerns, qualitative data analysis found that in open-ended narratives, participants’ most frequently reported category of pandemic-related impact was an employment or financial impact, followed by social impacts. To cope with these impacts, participants most frequently described employing vitality coping strategies, which were strategies intended to support health or positive functioning, followed by connectedness strategies, which were intended to maintain or strengthen community support and interdependence.

As these results and other research on COVID-19 coping strategies demonstrate [45, 46], social connection appears to have been an important coping strategy even during the early stages of the pandemic and pandemic-related NPIs. Identifying strategies to intentionally promote social connectedness is likely a key element to mitigate the unintended negative impacts of the NPIs necessitated by future pandemics; these strategies could be proactively integrated into plans for stay-at-home orders prior to the next pandemic. However, more research is needed to understand how the concerns and coping strategies of populations subjected to NPIs evolved throughout the multiyear pandemic, and to identify how to deliver effective interventions that support and augment adaptive coping strategies. Conducting such research within a geographically bounded community can assist in identifying the physical and social assets that supported community members’ adaptive coping strategies during the COVID-19 pandemic. This, in turn, will allow intervention strategies to mitigate the unintended negative impacts of future pandemic-related NPIs to build upon pre-existing community resources and social infrastructure.

Gender and age were found to be correlated with an increased likelihood of describing certain impacts and coping strategies in open-ended narratives. For instance, those who identified as female or non-binary were more likely than those who identified as male to report an impact to both physical health or mental or behavioral health, and those who identified as female were more likely than male or non-binary participants to describe employing a connectedness coping strategy. Participants below the age of 65 were much more likely to report an employment or financial impact than those 65 and older; those in the 35 to 54 years old age group were the most likely to report an education or childcare impact. However, those 65 and older were the most likely to describe employing any coping strategy where statistically significant differences were found between age groups, which included vitality, connectedness, and inspiration coping strategies. Those in an older age group also tended to report lower levels of well-being, as measured by the WHO-5 Well-being Index; those in the 65 and older age group had the lowest median WHO-5 Well-being Index Percentage Score.

Differential impacts of the pandemic and associated NPIs by gender have been documented by prior research [4042, 47, 48]; specifically, women appear to have experienced greater impacts to mental health and well-being during the early stages of COVID-19 pandemic than men [41, 42, 47]. A survey study of over 12,000 U.S. adults conducted from March to May of 2020, which also utilized the WHO-5 Well-being Index as a measure of overall mental health, found that stay-at-home orders were associated with a decrease of 0.123 standard deviations (p = 0.011) in overall mental health amongst female participants, as compared to male participants who experienced a negligible, not statistically significant decline in overall mental health [47]. Large survey studies conducted in Cyprus [41] and Austria [42] in April 2020 similarly documented higher levels of anxiety and depression amongst female participants. There is also evidence that disparities in mental health impacts between men and women continued for at least several months past the initial stay-at-home orders or lockdowns. A longitudinal study of over 70,000 participants in the U.K. conducted by Fancourt et al. from the initial lockdown in March through August 2020 found that women had higher mean anxiety and depression scores than men throughout the entire study period, though the largest gender gap was found in the first few weeks of the lockdown [40]; another U.K. study with a longer follow-up timeframe (until March of 2021) also concluded that women experienced greater reductions in overall well-being than men [48]. Though our study did not find a statistically significant difference by gender in our quantitative measure of mental health (median WHO-5 Well-being Index Percentage Scores), we did find statistically significant difference by gender in the proportion of participants describing a mental or behavioral health impact of the pandemic in their open-ended narratives, with female participants far more likely than male participants to report these impacts. Our findings, combined with the prior evidence, point to a need for effective interventions to reduce the disparate mental health impacts of pandemic-related NPIs on women, particularly during the initial stages of stay-at-home orders. These interventions could perhaps build upon the coping strategies that women were most likely to describe engaging in, vitality and connectedness coping strategies.

While less research has included non-binary individuals when comparing the mental health impacts of the pandemic by gender, a study of Spanish adults conducted from April to May 2020 included 72 participants who either identified as non-binary or neither male or female; these participants had a statistically significant higher prevalence of anxiety when compared to males and similar levels of anxiety when compared to female participants [49]. Non-binary participants in our study, similar to female participants, were more likely than male participants to describe a mental or behavioral health impact, aligning with the findings of the Spanish study. However, as our study only included 22 non-binary participants (3% of the overall sample), further research on the pandemic’s impacts on non-binary and other gender non-conforming individuals is clearly warranted, particularly given the higher baseline prevalence of anxiety, depression, and other mental health conditions in this group [50].

Prior research has also documented differential mental health and well-being impacts of the pandemic by age group [4043]; however, the findings of other research studies, in contrast to our own, largely indicate that younger adults were more likely to exhibit worse mental health symptoms during the early pandemic [4043]. The longitudinal study in the U.K. conducted by Fancourt et al. found higher anxiety and depression symptoms at the beginning of pandemic in younger adults as compared to older adults, though younger adults experienced more rapid improvements [40]; similarly, the early pandemic studies conducted in Cyprus [41] and Austria [42] found that younger age was associated with higher levels of anxiety and depression. Longitudinal data on how the pandemic impacted the mental health of adults in the U.S. specifically is still limited, but a U.S. Centers for Disease Control and Prevention report that tracked anxiety and depression symptoms among U.S. adults from August 2020 until February 2021 found that all age groups experienced an increase in anxiety or depression symptoms during that period, though the increase was largest among 18 to 29 year olds [43].

Given the pandemic’s mental health impacts across the age spectrum, perhaps more important than understanding which age group experienced the most quantifiable impacts to mental health is uncovering the mechanisms by which these mental health impacts occurred in different age groups, and how to tailor interventions to mitigate these impacts in future pandemics. Our study documented differences in both impacts and coping strategies by age group, suggesting that certain interventions may be more effective if targeted to age-group. Younger adults experiencing the impact of disruptions to school and work routines, for instance, would likely benefit from a different intervention than older adults who have left the workforce. In the U.S., older adults are more likely to reside alone than in most other countries [51], may experience distress over higher risk of a severe case of COVID-19 if infected [52], and have pre-existing high rates of social isolation and loneliness [53]. As a result, interventions to mitigate the mental health impacts of the pandemic on this group warrant special attention. The high proportion of older adults in our study who engaged in vitality and connectedness coping strategies to deal with the pandemic’s early impacts point to strategies to increase social connectedness as an important potential intervention for future pandemics.

The quantitative and qualitative data appear to diverge when examining how participants rated their level of concern about the COVID-19 pandemic’s impacts to physical health, financial stability, and social isolation versus how they described the pandemic’s impacts in their open-ended narratives. Whereas participants on average reported greater levels of concern over the physical health and healthcare access aspects of the pandemic than the potential financial or social impacts on the quantitative survey, they were most likely to describe employment or financial impacts and social impacts of the pandemic in their open-ended narratives. The apparent divergence in these results likely reflects both the timing of this study (the early stage of the pandemic) and the relatively high income sample that participated in our survey. Whereas close-ended survey questions only asked participants to indicate their level of concern about impacts to their own employment or financial stability, the open-ended prompt allowed participants to reflect on impacts to friends, family, and the broader community. While participants in our sample may not have had high levels of concern about their own financial security, many expressed concern over the financial security or employment impacts that other members of their community were experiencing. Additionally, when given a chance to reflect on the impacts to family members in close-ended survey questions, participants tended to report greater concern over impacts to a family member rather than themselves. Thus, during this early stage of the pandemic, many participants’ concerns focused on the health and well-being of others, rather than their own personal health and well-being. More research is needed to understand how the concerns of populations subjected to NPIs evolved over the course of the pandemic, but emerging evidence suggests that as the pandemic and associated lockdowns wore on for several years, empathy and concern for the wellbeing of others appears to have decreased as levels of psychological distress increased [44]. This decrease in empathy is in turn correlated with decreased compliance with NPIs [44, 54].

This cross-sectional study does not capture longitudinal data on how the early impacts reported by participants may have evolved, intensified, or waned throughout the pandemic. Additionally, the non-probability sampling approach is inherently prone to bias and precludes generalization of the results to all residents of King County. As an invitation to participate in the study was broadly disseminated via various University of Washington and external partner websites, social media and communications channels, we were unable to assess the total number of potential participants reached by these invitations or calculate a survey response rate. Additionally, the study survey was only offered via the online REDCap platform, potentially excluding those with low digital literacy or technology access from study participation. We noted high participation of the broader University of Washington community of faculty, staff, and students in the study, despite study team efforts to recruit participants from outside the university by partnering with local community organizations to advertise information about study participation. Participants in this study had higher median levels of income and educational attainment, and were more likely to identify as White, female, and non-Hispanic/Latinx relative to King County residents as a whole. The relatively low participation of community members who identified as non-White and/or Hispanic precluded meaningful comparisons of impacts and coping strategies by race and ethnicity. Additionally, a qualitative narrative was only provided by one Spanish-speaking individual; thus, the qualitative data primarily included the perspectives of English-speaking survey respondents. As such, the results of this study may not be representative of the early impacts of the pandemic on King County residents as a whole. Due to the time-sensitive nature of this research, we were unable to conduct external pilot testing of the study survey instrument prior to its release, indicating that some items on the survey were not validated. Our use of a directed content analysis approach to analyze study participants’ qualitative narratives may have introduced bias, as this approach aligned the qualitative data with the pre-existing framework developed by Peek et al. However, our use of an open-ended question to elicit participants’ narratives reduces the potential that this bias was introduced into the qualitative analysis.

Conclusion

Through a cross-sectional survey of 793 King County, Washington residents, this study documented the protective actions, concerns, perceived impacts and associated coping strategies of participants during the first several months of the COVID-19 pandemic and community-level NPIs. Analysis of quantitative survey data demonstrated higher percentages of participants were engaged in most types of COVID-19 protective behaviors after March 15th, 2020, relative to before that date, and that participants tended to report a greater degree of concern about the physical health or healthcare access impacts of the pandemic than the financial or social impacts. Qualitative data analysis of participants’ open-ended narratives, however, found the most frequently reported impact of the pandemic was an employment or financial impact, followed by social impacts. Participants most frequently described employing vitality coping strategies, which were strategies intended to support health or positive functioning, to cope with the impacts of the pandemic, followed by connectedness strategies, which were intended to maintain or strengthen community support and interdependence.

By capturing the early impacts of the pandemic, as well as strategies employed to cope with these impacts, this study provides evidence that can inform early stage policy formation and intervention strategies to mitigate the detrimental impacts of future pandemics and the NPIs implemented in response. Future research studies could expand on this study’s findings by exploring the endurance and evolution of these early impacts and coping strategies throughout the multiyear pandemic, as well as by exploring how to develop effective interventions that support and augment adaptive coping strategies.

Acknowledgments

We would like to thank community and media partners who shared the word about our study, and those that participated in the survey.

Data Availability

We have created and published a project for this study on the National Science Foundation-funded DesignSafe-CI’s Data Depot Repository, and have uploaded the de-identified study dataset to the repository. In alignment with the repository's Protected Data Best Practices, this published dataset includes participants’ responses to quantitative survey questions and the results of the qualitative data analysis of participants’ written narratives (e.g., the binary ‘1’ or ‘0’ variable for each code to indicate if it was present in a participant’s narrative). Participants’ written narratives are not included in this publicly available dataset, as many contain sensitive and/or potentially identifiable information. As survey responses were collected from a small geographical area, sampling heavily from the University of Washington community, complete de-identification of participants’ narratives is not possible. The de-identified data set is available for public access via DesignSafe project PRJ-2997 (DOI: https://doi.org/10.17603/ds2-atw6-7z47).

Funding Statement

NAE was supported by the University of Washington Interdisciplinary Center for Exposures, Diseases, Genomics and Environment (National Institute of Environmental Health Sciences, https://www.niehs.nih.gov/; Grant #: P30ES007033). REDCap at ITHS is supported by the National Center For Advancing Translational Sciences (https://ncats.nih.gov/) of the National Institutes of Health under Award Number UL1 TR002319. JLM is supported by National Heart, Lung, and Blood Institute (https://www.nhlbi.nih.gov/; Grant #: 1K99HL157721-01A1). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.The Lancet Infectious Diseases (2020) The intersection of COVID-19 and mental health. Lancet Infect Dis 20:1217. doi: 10.1016/S1473-3099(20)30797-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Gloster AT, Lamnisos D, Lubenko J, et al. (2020) Impact of COVID-19 pandemic on mental health: An international study. PLoS One 15:e0244809. doi: 10.1371/journal.pone.0244809 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Zhang Y, Quigley A, Wang Q, Raina MacIntyre C (2021) Non-pharmaceutical interventions during the roll out of covid-19 vaccines. BMJ. 10.1136/bmj.n2314 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Hale T, Angrist N, Goldszmidt R, et al. (2021) A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker). Nat Hum Behav 5:529–538. doi: 10.1038/s41562-021-01079-8 [DOI] [PubMed] [Google Scholar]
  • 5.MultiState Associates (2022) Stay at Home Orders: What is an “Essential Business”? In: MultiState. https://docs.google.com/document/d/e/2PACX-1vSXZCFCbIRiRDRC-SWyc36T0S0hjXxT9wZAGM4V01_xtbywLBEn0o_kgmfs0dMJ4VbpPh30j2ZFZ3TH/pub. Accessed 23 Mar 2022. [Google Scholar]
  • 6.Müller O, Razum O, Jahn A (2021) Effects of non-pharmaceutical interventions against COVID-19 on the incidence of other diseases. The Lancet Regional Health–Europe. doi: 10.1016/j.lanepe.2021.100139 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bennett J (2021) Fewer jobs have been lost in the EU than in the US during the COVID-19 downturn. Pew Research Center. [Google Scholar]
  • 8.Egger D, Miguel E, Warren SS, et al. (2021) Falling living standards during the COVID-19 crisis: Quantitative evidence from nine developing countries. Sci Adv. doi: 10.1126/sciadv.abe0997 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hammerstein S, König C, Dreisörner T, Frey A (2021) Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review. Frontiers in Psychology. doi: 10.3389/fpsyg.2021.746289 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Josephson A, Kilic T, Michler JD (2021) Socioeconomic impacts of COVID-19 in low-income countries. Nat Hum Behav 5:557–565. doi: 10.1038/s41562-021-01096-7 [DOI] [PubMed] [Google Scholar]
  • 11.Schmidt T, Pawlowski CS (2020) Physical Activity in Crisis: The Impact of COVID-19 on Danes’ Physical Activity Behavior. Front Sports Act Living 2:610255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Doubleday A, Choe Y, Busch Isaksen T, Miles S, Errett NA (2021) How did outdoor biking and walking change during COVID-19?: A case study of three U.S. cities. PLoS One 16:e0245514. doi: 10.1371/journal.pone.0245514 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Maringe C, Spicer J, Morris M, Purushotham A, Nolte E, Sullivan R, et al. (2020) The impact of the COVID-19 pandemic on cancer deaths due to delays in diagnosis in England, UK: a national, population-based, modelling study. Lancet Oncol 21:1023–1034. doi: 10.1016/S1470-2045(20)30388-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tull MT, Edmonds KA, Scamaldo KM, Richmond JR, Rose JP, Gratz KL (2020) Psychological Outcomes Associated with Stay-at-Home Orders and the Perceived Impact of COVID-19 on Daily Life. Psychiatry Res 289:113098. doi: 10.1016/j.psychres.2020.113098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Hay JW, Gong CL, Jiao X, Zawadzki NK, Zawadzki RS, Pickard AS, et al. (2021) A US Population Health Survey on the Impact of COVID-19 Using the EQ-5D-5L. J Gen Intern Med 36:1292–1301. doi: 10.1007/s11606-021-06674-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Forrest CB, Xu H, Thomas LE, et al. (2021) Impact of the Early Phase of the COVID-19 Pandemic on US Healthcare Workers: Results from the HERO Registry. J Gen Intern Med 36:1319–1326. doi: 10.1007/s11606-020-06529-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Boserup B, McKenney M, Elkbuli A (2020) Disproportionate Impact of COVID-19 Pandemic on Racial and Ethnic Minorities. Am Surg 86:1615–1622. doi: 10.1177/0003134820973356 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Clay LA, Rogus S (2021) Primary and Secondary Health Impacts of COVID-19 among Minority Individuals in New York State. Int J Environ Res Public Health. doi: 10.3390/ijerph18020683 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Osterrieder A, Cuman G, Pan-Ngum W, et al. (2021) Economic and social impacts of COVID-19 and public health measures: results from an anonymous online survey in Thailand, Malaysia, the UK, Italy and Slovenia. BMJ Open 11:e046863. doi: 10.1136/bmjopen-2020-046863 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Enria L, Waterlow N, Rogers NT, Brindle H, Lal S, Eggo RM, et al. (2021) Trust and transparency in times of crisis: Results from an online survey during the first wave (April 2020) of the COVID-19 epidemic in the UK. PLoS One 16:e0239247. doi: 10.1371/journal.pone.0239247 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Pothisiri W, Vicerra PMM (2021) Psychological distress during COVID-19 pandemic in low-income and middle-income countries: a cross-sectional study of older persons in Thailand. BMJ Open 11:e047650. doi: 10.1136/bmjopen-2020-047650 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.(2022) Economic, social, and overall health impacts dashboard. In: King County. https://kingcounty.gov/depts/health/covid-19/data/impacts.aspx. Accessed 23 Mar 2022. [Google Scholar]
  • 23.Errett N, Lamprea Montealegre J, Busch Isaksen T (2020) King County COVID-19 Community Study. 10.17603/ds2-atw6-7z47 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG (2009) Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 42:377–381. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Topp CW, Østergaard SD, Søndergaard S, Bech P (2015) The WHO-5 Well-Being Index: a systematic review of the literature. Psychother Psychosom 84:167–176. doi: 10.1159/000376585 [DOI] [PubMed] [Google Scholar]
  • 26.WHO-5 Questionnaires. https://www.psykiatri-regionh.dk/who-5/who-5-questionnaires/Pages/default.aspx. Accessed 15 Sep 2023.
  • 27.United States Census Bureau: Communications Directorate—Center for New Media QuickFacts: King County, Washington. https://www.census.gov/quickfacts/fact/table/kingcountywashington/POP010220. Accessed 14 Sep 2023.
  • 28.U.S. Census Bureau 2022. American Community Survey 1-year Estimates Subject Tables: Language Spoken at Home. [Google Scholar]
  • 29.Hsieh H-F, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15:1277–1288. doi: 10.1177/1049732305276687 [DOI] [PubMed] [Google Scholar]
  • 30.Peek L, Tobin J, Adams RM, Wu H, Mathews MC (2020) A Framework for Convergence Research in the Hazards and Disaster Field: The Natural Hazards Engineering Research Infrastructure CONVERGE Facility. Frontiers in Built Environment. 10.3389/fbuil.2020.00110 [DOI] [Google Scholar]
  • 31.QSR International Pty Ltd (2018) NVivo. [Google Scholar]
  • 32.R Core Team (2021) RStudio. [Google Scholar]
  • 33.Eng EM (2020) Facts about novel coronavirus and how to prevent COVID-19. The Seattle Times. [Google Scholar]
  • 34.Varty A (2020) Coronavirus timeline: How the outbreak has unfolded. In: The Seattle Times. https://www.seattletimes.com/seattle-news/health/coronavirus-timeline-how-the-outbreak-unfolded/. Accessed 15 Sep 2023. [Google Scholar]
  • 35.Guan M, Li Y, Scoles JD, Zhu Y (2023) COVID-19 Message Fatigue: How Does It Predict Preventive Behavioral Intentions and What Types of Information are People Tired of Hearing About? Health Commun 38:1631–1640. doi: 10.1080/10410236.2021.2023385 [DOI] [PubMed] [Google Scholar]
  • 36.Baseman JG, Revere D, Painter I, Toyoji M, Thiede H, Duchin J (2013) Public health communications and alert fatigue. BMC Health Serv Res 13:295. doi: 10.1186/1472-6963-13-295 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Jones KE, Patel NG, Levy MA, Storeygard A, Balk D, Gittleman JL, et al. (2008) Global trends in emerging infectious diseases. Nature 451:990–993. doi: 10.1038/nature06536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Marani M, Katul GG, Pan WK, Parolari AJ (2021) Intensity and frequency of extreme novel epidemics. Proc Natl Acad Sci U S A. doi: 10.1073/pnas.2105482118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Haug N, Geyrhofer L, Londei A, Dervic E, Desvars-Larrive A, Loreto V, et al. (2020) Ranking the effectiveness of worldwide COVID-19 government interventions. Nat Hum Behav 4:1303–1312. doi: 10.1038/s41562-020-01009-0 [DOI] [PubMed] [Google Scholar]
  • 40.Fancourt D, Steptoe A, Bu F (2021) Trajectories of anxiety and depressive symptoms during enforced isolation due to COVID-19 in England: a longitudinal observational study. Lancet Psychiatry 8:141–149. doi: 10.1016/S2215-0366(20)30482-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Solomou I, Constantinidou F (2020) Prevalence and Predictors of Anxiety and Depression Symptoms during the COVID-19 Pandemic and Compliance with Precautionary Measures: Age and Sex Matter. Int J Environ Res Public Health. doi: 10.3390/ijerph17144924 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Pieh C, Budimir S, Probst T (2020) The effect of age, gender, income, work, and physical activity on mental health during coronavirus disease (COVID-19) lockdown in Austria. J Psychosom Res 136:110186. doi: 10.1016/j.jpsychores.2020.110186 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Vahratian A, Blumberg SJ, Terlizzi EP, Schiller JS (2021) Symptoms of Anxiety or Depressive Disorder and Use of Mental Health Care Among Adults During the COVID-19 Pandemic—United States, August 2020-February 2021. MMWR Morb Mortal Wkly Rep 70:490–494. doi: 10.15585/mmwr.mm7013e2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Baiano C, Raimo G, Zappullo I, Marra M, Cecere R, Trojano L, et al. (2022) Empathy through the Pandemic: Changes of Different Emphatic Dimensions during the COVID-19 Outbreak. Int J Environ Res Public Health. doi: 10.3390/ijerph19042435 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Ogueji IA, Okoloba MM, Demoko Ceccaldi BM (2022) Coping strategies of individuals in the United Kingdom during the COVID-19 pandemic. Curr Psychol 41:7493–7499. doi: 10.1007/s12144-020-01318-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Schneiders ML, Naemiratch B, Cheah PK, et al. (2022) The impact of COVID-19 non-pharmaceutical interventions on the lived experiences of people living in Thailand, Malaysia, Italy and the United Kingdom: A cross-country qualitative study. PLoS One 17:e0262421. doi: 10.1371/journal.pone.0262421 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Adams-Prassl A, Boneva T, Golin M, Rauh C (2022) The impact of the coronavirus lockdown on mental health: evidence from the United States. Econ Policy 37:139–155. [Google Scholar]
  • 48.Zhou M, Kan M-Y (2021) The varying impacts of COVID-19 and its related measures in the UK: A year in review. PLoS One 16:e0257286. doi: 10.1371/journal.pone.0257286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Jacques-Aviñó C, López-Jiménez T, Medina-Perucha L, de Bont J, Berenguera A (2021) Social conditions and mental health during COVID-19 lockdown among people who do not identify with the man/woman binomial in Spain. PLoS One 16:e0256261. doi: 10.1371/journal.pone.0256261 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Valentine SE, Shipherd JC (2018) A systematic review of social stress and mental health among transgender and gender non-conforming people in the United States. Clin Psychol Rev 66:24–38. doi: 10.1016/j.cpr.2018.03.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Ausubel J (2020) Older people are more likely to live alone in the U.S. than elsewhere in the world. In: Pew Research Center. https://www.pewresearch.org/fact-tank/2020/03/10/older-people-are-more-likely-to-live-alone-in-the-u-s-than-elsewhere-in-the-world/. Accessed 9 Jan 2023 [Google Scholar]
  • 52.Tyler CM, McKee GB, Alzueta E, Perrin PB, Kingsley K, Baker FC, et al. (2021) A Study of Older Adults’ Mental Health across 33 Countries during the COVID-19 Pandemic. Int J Environ Res Public Health. doi: 10.3390/ijerph18105090 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.National Academies of Sciences, Engineering, and Medicine, Division of Behavioral and Social Sciences and Education, Health and Medicine Division, Board on Behavioral, Cognitive, and Sensory Sciences, Board on Health Sciences Policy, Committee on the Health and Medical Dimensions of Social Isolation and Loneliness in Older Adults (2020) Social Isolation and Loneliness in Older Adults: Opportunities for the Health Care System. National Academies Press. [PubMed] [Google Scholar]
  • 54.Galang CM, Johnson D, Obhi SS (2021) Exploring the Relationship Between Empathy, Self-Construal Style, and Self-Reported Social Distancing Tendencies During the COVID-19 Pandemic. Front Psychol 12:588934. doi: 10.3389/fpsyg.2021.588934 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ayi Vandi Kwaghe

9 Aug 2023

PONE-D-23-05940Assessing community-level impacts of and responses to stay at home orders: the King County COVID-19 Community Study

Dear Dr. Errett,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

ACADEMIC EDITOR:

What coding method was used in your analysis? Inductive or deductive? Please, clearly state that in your methods.

What were the measures you applied to eliminate bias in your study? Please, clearly state it.

when analyzing your qualitative data, was there a time you felt that you have reached "data saturation point" where no new information was obtained based on the open ended responses provided? Please state whether or not you reached data saturation point in your analysis.

What was the rationale of putting table 1 in the methods? Codes were generated and the generated codes from the data analysis should be part of the results. I think table one should be placed appropriately under results.

Line 206. “ A majority of the participants”-please remove A, start the sentence with majority

Study population and sample size should be included in your methods

You made mention of the WHO-5 wellbeing index score in your methods. It will be good to explain what it means for readers and possibly state the site from which it was extracted from. For example: The Persian version of WHO-5 available at ( https://www.psykiatri-regionh.dk/who-5/Pages/default.aspx ).

Please submit your revised manuscript by Sep 23 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ayi Vandi Kwaghe, D.V.M., M.V.Sc., P.G.D.E. Ph.D., MPH

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript was well written and technically sound. The authors gave attention to details with statistical analysis performed appropriately and rigorously. However, there are a few seemingly ambiguous statements and a few details that were not stated/clarifications needed.

Abstract

1. In the Abstract, line 22 "after schools and community spaces were closed" may appear ambiguous to a first-time reader. Relating them to the lock-down could help keep the reader in the right context.

Introduction

2. Lines 82 to 86 appears unclear. For example, in line 84, there seems to be a break in thought after "disruptions to the social and economic underpinnings of health and wellbeing", in which "racial and ethnic minorities, individuals with disabilities, women, and those who are precariously housed or employed" categories were stated.

Methods

3. How was the study tool validated?

4. How was the tool translated into Spanish? where there any measures taken to ensure the same meaning was communicated to respondents despite the use of different languages?

5. Were there any exclusion criteria for the study participants?

6. Not much was said about the sociodemographic context of the study area to help provide insight to the readers about the county. For example the percentage of Hispanics/Latinx, proportion of Spanish speakers etcetera

7. L158. What were the COVID-19 protective behaviors? Although these were later described in table 3 in the results section, a few categories be stated earlier would make it easier for the reader to follow

8. L192 what version of Nvivo for Mac was used?

Discussion

9. Line 376 "Differential impacts of the pandemic and associated NPIs by gender have been documented by prior

research;" should be referenced

10. Line 377 "women appear to have experienced greater impacts to mental health and well-being during the early

stages of COVID-19 pandemic than men" should be referenced.

11. Lines 375 to 401 appear to be verbose. Studies stated in lines 378 to 392 can be represented as references in

line 397 as the evidence provided by other studies. However, this is subject to the discretion of the

authors

General suggestion/observation

An upload of the manuscript's questionnaire could help readers better understand the write up (this is optional and at the discretion of the authors)

Reviewer #2: • The study is highly relevant to the current global situation.

• The title is clear and concise, indicating that the study focuses on assessing the impacts of stay-at-home orders and community responses during the COVID-19 pandemic in King County.

• The title is already informative, but it could be made even more compelling by adding a concise mention of the key findings or some intriguing aspects of the study.

• Overall, the abstract is well-structured, informative, and provides a clear understanding of the study's objectives, methods, results, and implications. It efficiently conveys the relevance and significance of the research conducted.

• Providing surveys in both languages (Spanish and English) allows for a more representative sample and reduces potential language-related biases in the responses. Additionally, providing information on the process used for translation validation would add transparency and credibility to the study.

• In the Methods section, it would be beneficial to include details on how the translation and validation of the survey tools were performed, ensuring that the Spanish version is culturally and linguistically appropriate for the target population. including both English and Spanish versions of the survey tools is commendable and demonstrate the research team's commitment to conducting a comprehensive and inclusive study in the King County community. By addressing the translation process in the manuscript, the study would reinforce the rigor and reliability of the findings across both language groups.

• In the Methods section provided, the manuscript does not explicitly mention the specific type of qualitative data analysis conducted. It only states that "qualitative content analysis methods were used to analyze free-form narrative responses." However, it does not provide further details on the specific approach or method employed for the qualitative analysis.

To ensure transparency and rigor in the study, it is crucial for the manuscript to include more information about the qualitative content analysis method. Qualitative content analysis can take various forms, such as thematic analysis, narrative analysis, or grounded theory, among others.

To enhance the method section, the manuscript should provide more details about the qualitative content analysis method used, as this is a critical aspect of the research process, especially when analyzing free-form narrative responses. Specifying the qualitative content analysis method used would be valuable for readers to better understand the study's qualitative data analysis process and the credibility of the findings.

• The manuscript does not provide information about the total number of individuals who were invited to participate in the survey through various recruitment channels. Knowing the outreach efforts and response rate would be helpful in assessing the representativeness of the sample.

To enhance the description of the sample and data collection, the manuscript could include more details about the total number of individuals who were exposed to the recruitment materials and the response rate. Also, the population and demographics of the county.

• The codes and results are almost entirely descriptive, and it should it lifted up higher conceptually into more analytic codes.

A larger part of the results is replicated in the discussion section, which was not compared to comparable findings.

• The results and concepts in the discussion section should have been supported by quotes or notes from the qualitative aspects of this study.

• There is no explicit mention of the informed consent process for the study participants. It is essential for any research involving human participants to obtain informed consent, which ensures that participants are fully aware of the study's purpose, procedures, potential risks, and benefits before agreeing to participate. Informed consent, it should be added before submission for peer review and publication. Ethical considerations, including informed consent, are critical components of any research involving human subjects and should be transparently addressed in the manuscript.

Reviewer #3: It is a very relevant topics, understanding the impacts of COVID-10. The manuscript does a great job presenting the problem and the research questions. I really enjoyed reading it. However, I have a few comments:

- In page 9, line 152, it mentions that the participants were directed to a website to participate. Would that exclude potential participants with low digital literacy, thus more vulnerable to social isolation and other impacts of during the pandemic?

- In table 3, it seems that handwashing for at least 20 seconds with soap and water, and hand sanitizer use decreased after “March 15, 2020,” is that correct? If so, how can explain these results?

- In the same table, “avoided small or mid-size gatherings” increased, while “Avoided large gatherings” remained the same. It sounds a little bit unexpected, even contradictory. Can you elaborate more in that result?

- The analyses by gender and age groups are interesting. We know the pandemic, mainly at its beginning, had a huge toll on black and racialized communities. Did the study produce any analysis by race?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Mohammed Isa Bammami

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Feb 8;19(2):e0296851. doi: 10.1371/journal.pone.0296851.r002

Author response to Decision Letter 0


22 Sep 2023

Response to Reviewers

Ref: PONE-D-23-05940

We very much appreciate the thoughtful critique of our manuscript, “Assessing community-level impacts of and responses to stay at home orders: the King County COVID-19 Community Study,” and the suggestions provided by the Academic Editor and each of the Reviewers. Below we respond to each of the Editor’s and Reviewers’ comments raised in the August 9th, 2023 email correspondence. Editor and Reviewer comments are provided and are followed by itemized responses. Please note every response is linked to a page and line demarcation in the revised manuscript submission.

Academic Editor:

1. What coding method was used in your analysis? Inductive or deductive? Please, clearly state that in your methods.

Thank you for the opportunity to clarify which method of coding we employed. We used a deductive coding approach, leveraging a framework for describing disaster losses and coping strategies presented in a disaster research article by Peek et al., published in 2020. We have added language to the Methods section (page 12, lines 236-241) to clarify our approach. It now reads: “To analyze the open-ended data detailing respondents’ stories about COVID-19, we used a directed content analysis approach. A codebook was developed based on the study goals, and the framework for describing disaster losses and coping strategies presented in a recently published disaster research article by Peek et al. One member of the study team applied the codebook to a sample of open-ended responses to assess the robustness of the codebook relative to the data prior to broader application by the study team.”

2. What were the measures you applied to eliminate bias in your study? Please, clearly state it.

Thank you for the suggestion to add text about measures taken to reduce bias. We have added text to the Methods section to more clearly indicate that we employed co-coding as an approach to reduce bias. However, despite these efforts, our use of a convenience sample is inherently prone to bias. We discuss this in the context of our Limitations section (see page 34, lines 908-911) to promote transparency and temper interpretation of results. In addition, we have added discussion in the Limitations section (page 35, lines 932-936) about biases that may be introduced through a directed content analysis approach. As the approach seeks to align available data with an existent theory or framework selected a priori, researchers may be more likely to find evidence supporting the existing theory or framework, rather than refuting it. This can be exacerbated when such frameworks are also used to prompt responses from participants (e.g., in the context of a key informant interview, where questions are designed to elicit responses around elements of an existing theory or framework). However, our study’s use of an open-ended question without prompts aligned with the coding framework mitigates this potential bias.

3. When analyzing your qualitative data, was there a time you felt that you have reached "data saturation point" where no new information was obtained based on the open ended responses provided? Please state whether or not you reached data saturation point in your analysis.

Thank you for the opportunity to clarify our study methods. Thematic saturation, or the concept of diminishing returns associated with collection of new data and responses, is an approach to determining sample sizes in qualitative studies using thematic analysis approaches, particularly in small studies. As our study employed a directed content, versus thematic, analysis approach, and included a large sample size, we did not use the concept of saturation to determine when to discontinue data collection. In directed content analysis, the content of the data is assessed against a deductive framework. In our study, we reviewed the content of open-ended responses against a framework selected a priori to determine alignment of the response with different elements of the framework. We then summarized the number of responses that aligned with each element of the framework. We did not attempt to synthesize or elicit meaning in the textual data itself to identify key themes, as would be done in a conventional thematic analysis. We have clarified that our study employed a directed content analysis, versus thematic analysis, approach in the Methods section (page 12, lines 236-241), and included a reference to content analyses. As described in our response to Academic Editor comment #2, we have also added additional discussion of the limitations of this approach to our Limitations section (page 35, lines 932-936).

4. What was the rationale of putting table 1 in the methods? Codes were generated and the generated codes from the data analysis should be part of the results. I think table one should be placed appropriately under results.

Thank you for pointing out that the prior version of Table 1, which included illustrative quotes, would be more appropriately placed in the Results section. We placed Table 1 in the Methods section because we used a deductive coding approach, leveraging a pre-existing framework for describing disaster losses and coping strategies as described in our response to Academic Editor Comment #1. However, we concur that the illustrative quotes should not be included in the Methods section. We have retained an updated version of the table, now labeled Table 2, in the Methods section, which now includes only codes and code definitions. Illustrative quotes have now been included throughout the text of the Results section (see page 22, lines 668 - 684; page 26, lines 711-714).

5. Line 206. “ A majority of the participants”-please remove A, start the sentence with majority

Thank you for the suggested revision to this sentence. We have removed the “A” from the beginning of the sentence as suggested (page 10, line 216).

6. Study population and sample size should be included in your methods

Thank you for the suggestion to move information about the study sample size and participant characteristics to the Methods section. We have moved the Participant Characteristics section and the table providing an overview of participant characteristics (formerly Table 2, now Table 1 in the revised manuscript) to the Methods section (pages 10-11, lines 211-221).

7. You made mention of the WHO-5 wellbeing index score in your methods. It will be good to explain what it means for readers and possibly state the site from which it was extracted from. For example: The Persian version of WHO-5 available at ( https://www.psykiatri-regionh.dk/who-5/Pages/default.aspx ).

Thank you for bringing to our attention that the meaning of WHO-5 Well-being Index percentage scores was not well explained in our Methods section. We have added additional text to this section to explain what the percentage scores indicate, as well as inserted a link to a website from which both the Spanish and English versions on the WHO-5 questionnaire can be obtained (page 8, lines 170-176).

Journal Requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Thank you for providing these references. We have confirmed that our revised manuscript complies with PLOS ONE’s style requirements, as outlined in the documents provided.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Thank you for the opportunity to clarify our study procedures. The University of Washington Human Subjects Division reviewed our study protocol and determined that the study qualified for exempt status. Though an exempt status waives the requirement to document informed consent, potential participants were provided an overview of the potential risks and benefits of study participation on the study webpage. The link to the study survey on this website informed participants that they were consenting to participate in the research study by answering survey questions. We have updated the Methods section of the manuscript (page 9, lines 187-191) and online submission form with this information.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

Thank you for the opportunity to clarify how other researchers may access our study’s de-identified dataset. We have created and published a project for this study on the National Science Foundation-funded DesignSafe-CI’s Data Depot Repository, and have uploaded the de-identified study dataset to the repository. In alignment with the repository's Protected Data Best Practices, this published dataset includes participants’ responses to quantitative survey questions and the results of the qualitative data analysis of participants’ written narratives (e.g., the binary ‘1’ or ‘0’ variable for each code to indicate if it was present in a participant’s narrative). Participants’ written narratives are not included in this publicly available dataset, as many contain sensitive and/or potentially identifiable information. As survey responses were collected from a small geographical area, sampling heavily from the University of Washington community, complete de-identification of participants’ narratives is not possible. The de-identified data set is available for public access via DesignSafe project PRJ-2997 (DOI: https://doi.org/10.17603/ds2-atw6-7z47).

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

We have reviewed our reference list for completeness and accuracy. As part of the revisions requested by the Academic Editor and the Reviewers, we have added the following additional references:

1. WHO-5 Questionnaires. https://www.psykiatri-regionh.dk/who-5/who-5-questionnaires/Pages/default.aspx. Accessed 15 Sep 2023

2. United States Census Bureau: Communications Directorate - Center for New Media QuickFacts: King County, Washington. https://www.census.gov/quickfacts/fact/table/kingcountywashington/POP010220. Accessed 14 Sep 2023

3. U.S. Census Bureau 2022 American Community Survey 1-year Estimates Subject Tables: Language Spoken at Home.

4. Hsieh H-F, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15:1277–1288

5. Varty A (2020) Coronavirus timeline: How the outbreak has unfolded. In: The Seattle Times. https://www.seattletimes.com/seattle-news/health/coronavirus-timeline-how-the-outbreak-unfolded/. Accessed 15 Sep 2023

6. Guan M, Li Y, Scoles JD, Zhu Y (2023) COVID-19 Message Fatigue: How Does It Predict Preventive Behavioral Intentions and What Types of Information are People Tired of Hearing About? Health Commun 38:1631–1640

7. Baseman JG, Revere D, Painter I, Toyoji M, Thiede H, Duchin J (2013) Public health communications and alert fatigue. BMC Health Serv Res 13:295

Reviewers' comments:

Reviewer #1:

The manuscript was well written and technically sound. The authors gave attention to details with statistical analysis performed appropriately and rigorously. However, there are a few seemingly ambiguous statements and a few details that were not stated/clarifications needed.

We thank Reviewer #1 for their review and for positive overall feedback on our manuscript.

Abstract

1. In the Abstract, line 22 "after schools and community spaces were closed" may appear ambiguous to a first-time reader. Relating them to the lock-down could help keep the reader in the right context.

We appreciate Reviewer #1’s point that those reading the Abstract may not immediately connect the closure of schools and community spaces to the implementation of a stay-at-home order. We have added additional text to that sentence to clarify the connection (page 3, line 51).

Introduction

2. Lines 82 to 86 appears unclear. For example, in line 84, there seems to be a break in thought after "disruptions to the social and economic underpinnings of health and wellbeing", in which "racial and ethnic minorities, individuals with disabilities, women, and those who are precariously housed or employed" categories were stated.

We thank Reviewer #1 for pointing out that this sentence was unclear. We have rephrased this sentence to improve clarity. The sentence now reads, “Racial and ethnic minorities, individuals with disabilities, women, and those who are precariously housed or employed have borne a disproportionate burden across all categories of the pandemic’s impacts, including risk of COVID-19 exposure, additional health-related consequences, and disruptions to the social and economic underpinnings of health and wellbeing” (page 6, lines 111-115).

Methods

3. How was the study tool validated?

We appreciate Reviewer #1’s question about the validation of our study survey instrument. Given the time-sensitive nature of the study, which was focused on capturing the real-time impacts and coping strategies implemented during the early stages of the pandemic and the associated NPIs, we did not have time to fully pilot test our study survey. However, the survey was reviewed by members of the research team with a variety of education and experience levels, including undergraduate and graduate students, to ensure accessibility and readability. Additionally, the survey included previously validated measures such as the WHO-5 Well-being Index. After the survey was built in REDCap and prior to its release, multiple members of the research team piloted taking the survey via the REDcap form. We have added a brief description to the Methods section to describe our internal survey testing process (pages 8-9, lines 181-184). Additionally, we have added text to the Limitations section to clarify that we did not have time to more thoroughly test and validate the study survey instrument (page 35, lines 930-932).

4. How was the tool translated into Spanish? where there any measures taken to ensure the same meaning was communicated to respondents despite the use of different languages?

We appreciate Reviewer #1 bringing to our attention that our translation process was not detailed in the manuscript. Julio A. Lamprea Montealegre, a co-author of this manuscript, translated all survey items without a pre-existing validated Spanish translation. Dr. Lamprea Montealegre is a native Spanish-speaker who has lived in the United States for over 15 years and is fluent and practices medicine in English. We have added text to the Methods section detailing this translation process (page 8, lines 179-181).

5. Were there any exclusion criteria for the study participants?

We also appreciate Reviewer #1 bringing to our attention that exclusion criteria was not explicitly stated in the manuscript. Only those under 18 years of age or who were not residents of King County were excluded from study participation. We have added text to the Methods section stating this exclusion criteria (page 9, lines 202-203).

6. Not much was said about the sociodemographic context of the study area to help provide insight to the readers about the county. For example the percentage of Hispanics/Latinx, proportion of Spanish speakers etcetera

We wholeheartedly agree with Reviewer #1’s comment that an overview of the social and demographic characteristics of King County, the study area, would help readers better understand the study context. We have added an additional Study Setting section under Methods that provides a basic overview of the county, including location, race, ethnicity and language data, education, and median household income (see page 9, lines 191-198).

7. L158. What were the COVID-19 protective behaviors? Although these were later described in table 3 in the results section, a few categories be stated earlier would make it easier for the reader to follow

We thank Reviewer #1 for pointing out that providing examples of COVID-19 protective behaviors earlier in the manuscript improves clarity. We have included a few examples of such behaviors in the sentence Reviewer #1 indicated above (page 12, lines 227-228).

8. L192 what version of Nvivo for Mac was used?

We thank Reviewer #1 for this question. Unlike Nvivo for Windows, Nvivo for Mac does not have a version number.

Discussion

9. Line 376 "Differential impacts of the pandemic and associated NPIs by gender have been documented by prior research;" should be referenced

We agree with Reviewer #1’s comment that the above sentence should be referenced, and have added several appropriate citations at the end of the sentence mentioned (page 30, line 815).

10. Line 377 "women appear to have experienced greater impacts to mental health and well-being during the early stages of COVID-19 pandemic than men" should be referenced.

Just as above, we agree with Reviewer #1’s comment that this sentence should be referenced, and have added several appropriate citations at the end of the sentence mentioned (page 30, line 817).

11. Lines 375 to 401 appear to be verbose. Studies stated in lines 378 to 392 can be represented as references in line 397 as the evidence provided by other studies. However, this is subject to the discretion of the authors

We thank Reviewer #1 for this comment. While we have retained some of the discussion about the studies referenced, as we feel this overview of the prior research will be helpful for readers unfamiliar with these studies, we have made several edits to the text to reduce the length of this section (pages 30-31, lines 824-841)

General suggestion/observation

An upload of the manuscript's questionnaire could help readers better understand the write up (this is optional and at the discretion of the authors)

We wholeheartedly agree with Reviewer #1’s suggestion to publish our study survey instrument. We have created and published a project for this study on the National Science Foundation-funded DesignSafe-CI’s Data Depot Repository, and have included the survey instrument as part of the publicly available materials that can be accessed via this project (DesignSafe project PRJ-2997; DOI: https://doi.org/10.17603/ds2-atw6-7z47).

Reviewer #2:

1. The study is highly relevant to the current global situation.

We thank Reviewer #2 for their review, and for this comment highlighting the relevance of our study’s findings.

2. The title is clear and concise, indicating that the study focuses on assessing the impacts of stay-at-home orders and community responses during the COVID-19 pandemic in King County.

We appreciate Reviewer #2’s comment regarding our title, and its accurate representation of the focus of our study.

3. The title is already informative, but it could be made even more compelling by adding a concise mention of the key findings or some intriguing aspects of the study.

We appreciate Reviewer #2’s suggestion. While we agree that adding additional content about results to the title could make it more compelling, our study had numerous key findings that are difficult to summarize succinctly, due to the descriptive nature of the study. We want to be mindful of balancing the length of the title with the inclusion of multiple key findings. As such, we have decided to retain the original title.

4. Overall, the abstract is well-structured, informative, and provides a clear understanding of the study's objectives, methods, results, and implications. It efficiently conveys the relevance and significance of the research conducted.

We greatly Reviewer #2’s comment regarding our Abstract, and their overall positive review of the manuscript.

5. Providing surveys in both languages (Spanish and English) allows for a more representative sample and reduces potential language-related biases in the responses. Additionally, providing information on the process used for translation validation would add transparency and credibility to the study.

We appreciate Reviewer #2’s comment, and agree that our translation process should be detailed in the manuscript. As we indicated above in our response to Reviewer #1, co-author Julio A. Lamprea Montealegre, a native Spanish-speaker with a high level of English language fluency, translated all survey items without a pre-existing validated Spanish translation. We have added text to the Methods section detailing this translation process (page 8, lines 179-181).

6. In the Methods section, it would be beneficial to include details on how the translation and validation of the survey tools were performed, ensuring that the Spanish version is culturally and linguistically appropriate for the target population. including both English and Spanish versions of the survey tools is commendable and demonstrate the research team's commitment to conducting a comprehensive and inclusive study in the King County community. By addressing the translation process in the manuscript, the study would reinforce the rigor and reliability of the findings across both language groups.

We appreciate Reviewer #2’s comment, and agree that our validation process for the Spanish translation should also be detailed in the manuscript. As mentioned above, a study team member who is a native Spanish-speaker with a high level of English language fluency translated the survey. The study team also included another native Spanish speaker who had long resided in the U.S., and also had a very high level of English fluency. We have added text to the Methods section detailing this validation process for the translation (pages 8-9, lines 179-184).

7. In the Methods section provided, the manuscript does not explicitly mention the specific type of qualitative data analysis conducted. It only states that "qualitative content analysis methods were used to analyze free-form narrative responses." However, it does not provide further details on the specific approach or method employed for the qualitative analysis.

To ensure transparency and rigor in the study, it is crucial for the manuscript to include more information about the qualitative content analysis method. Qualitative content analysis can take various forms, such as thematic analysis, narrative analysis, or grounded theory, among others.

To enhance the method section, the manuscript should provide more details about the qualitative content analysis method used, as this is a critical aspect of the research process, especially when analyzing free-form narrative responses. Specifying the qualitative content analysis method used would be valuable for readers to better understand the study's qualitative data analysis process and the credibility of the findings.

We agree with Reviewer #2’s suggestion to include additional description of the qualitative analysis methods we used in our Methods section. As mentioned in response to the Academic Editor above, we used a deductive coding approach, leveraging a previously published framework for describing disaster losses and coping strategies to develop the study codebook. A directed content analysis approach was used to assess the content of the qualitative narratives against this deductive framework. We have added additional text to the Methods section (page 12, lines 236-241) as Reviewer #2 suggested to clarify our approach.

8. The manuscript does not provide information about the total number of individuals who were invited to participate in the survey through various recruitment channels. Knowing the outreach efforts and response rate would be helpful in assessing the representativeness of the sample.

To enhance the description of the sample and data collection, the manuscript could include more details about the total number of individuals who were exposed to the recruitment materials and the response rate. Also, the population and demographics of the county.

We appreciate Reviewer #2’s comment about including a response rate. As our study survey was broadly disseminated via various University of Washington and external partner websites and social media channels, we are unable to assess the total number of potential study participants that were reached by the study participation invitations distributed via those channels (see the Sample and Data Collection section for a description of these dissemination channels). We have added text describing this inability to assess the response rate to the Limitations section (page 34, lines 911-914). In addition, we have added an additional Study Setting section to our Methods, which includes information on the total population of King County, the geographic area from which our study sample was drawn (page 9, lines 192-193).

9. The codes and results are almost entirely descriptive, and it should it lifted up higher conceptually into more analytic codes.

We thank Reviewer #2 for their comment, and for the opportunity to further clarify our study methods. As stated in our response to the Academic Editor above, our study employed a directed content, versus thematic, analysis approach. Following this approach, we reviewed the content of participants’ qualitative narratives against a framework selected a priori to determine alignment of the response with different elements of the framework. We then summarized the number of responses that aligned with each element of the framework, rather than synthesizing or eliciting meaning in the textual data itself to identify key themes, as would be done in a conventional thematic analysis. We have clarified that our study employed a directed content analysis approach in the Methods section (page 12, lines 236-241), and included a reference to content analyses. We have also added additional discussion of the limitations of this approach to our Limitations section (page 35, lines 932-936).

A larger part of the results is replicated in the discussion section, which was not compared to comparable findings.

We thank Reviewer #2 for their comment. In the Discussion section, we compared our study’s findings to previous research findings about the differential impacts of the COVID-19 pandemic and associated NPIs by age (pages 32-33, lines 855-882) and gender (pages 30-31, lines 814-852). We also compare our results with the previous literature on mental health, such as the importance of social connection as a key coping strategy (page 29, lines 787-800). We welcome any additional suggestions from Reviewer #2 about how to relate our findings to the previous scientific literature.

10. The results and concepts in the discussion section should have been supported by quotes or notes from the qualitative aspects of this study.

We agree with Reviewer #2’s suggestion that discussions of qualitative data analysis results should have been accompanied by additional illustrative quotes. We have added additional quotes, which were previously included in Table 2, throughout the Results section (see page 22, lines 668 - 684; page 26, lines 711-714).

11. There is no explicit mention of the informed consent process for the study participants. It is essential for any research involving human participants to obtain informed consent, which ensures that participants are fully aware of the study's purpose, procedures, potential risks, and benefits before agreeing to participate. Informed consent, it should be added before submission for peer review and publication. Ethical considerations, including informed consent, are critical components of any research involving human subjects and should be transparently addressed in the manuscript.

We thank Reviewer #2 for this important comment and the opportunity to clarify our study procedures. As stated in response to the Academic Editor above, the University of Washington Human Subjects Division reviewed our study protocol and determined that the study qualified for exempt status. Potential participants were provided an overview of the potential risks and benefits of study participation on the study webpage and informed that they were consenting to participate in the research study by answering survey questions. We have updated the Methods section of the manuscript (page 9, lines 187-190) with this information.

Reviewer #3:

1. It is a very relevant topics, understanding the impacts of COVID-10. The manuscript does a great job presenting the problem and the research questions. I really enjoyed reading it.

We appreciate Reviewer #3’s review and overall positive feedback on our manuscript.

2. However, I have a few comments:

In page 9, line 152, it mentions that the participants were directed to a website to participate. Would that exclude potential participants with low digital literacy, thus more vulnerable to social isolation and other impacts of during the pandemic?

We appreciate and agree with Reviewer #3’s comment, and have added additional text to the Limitations section reflecting this potential exclusion (page 34, lines 914-916). Unfortunately, due to the time-sensitive nature of this rapid response research and the lack of specific funding to support this study, we did not have the resources to distribute the survey via other methods.

3. In table 3, it seems that handwashing for at least 20 seconds with soap and water, and hand sanitizer use decreased after “March 15, 2020,” is that correct? If so, how can explain these results?

We appreciate Reviewer #3’s thoughtful question. The observation that both handwashing and the use of hand sanitizer were reported by fewer participants after March 15th is correct. We believe this is possibly explained by message fatigue. As handwashing and the use of hand sanitizer were among the first protective actions recommended by public health officials in response to the pandemic, participants had likely heard these numerous times, even at the relatively early stages of the pandemic when the study was conducted. We have added a paragraph discussing this theory, as well as the prior literature correlating message fatigue with decreased compliance with public health guidance, to the Discussion section (pages 27-28, lines 755-767).

4. In the same table, “avoided small or mid-size gatherings” increased, while “Avoided large gatherings” remained the same. It sounds a little bit unexpected, even contradictory. Can you elaborate more in that result?

We thank Reviewer #3 for the opportunity to reflect a bit further on this result. This result is likely explained by the timeline of public health guidance for King County, which limited gatherings incrementally. Participants likely reported avoiding large gatherings in nearly equal numbers before and after March 15th due to guidance and restrictions limiting large gatherings in King County prior to that date. For instance, social distancing was recommended in King County as early as March 10th, and by March 11th, all gatherings of greater than 250 people were canceled. We have added text discussing this in the Discussion section (page 27, lines 755-758).

5. The analyses by gender and age groups are interesting. We know the pandemic, mainly at its beginning, had a huge toll on black and racialized communities. Did the study produce any analysis by race?

We greatly appreciate Reviewer #3’s important comment, and concur that there is a great deal of evidence documenting the disproportionate impact of the COVID-19 pandemic on BIPOC communities. In our specific study, we had relatively low participation from community members who identified as a race other than White. As noted in our Limitations section, study participants were also more likely to have higher median levels of income and educational attainment, and to identify as White or non-Hispanic/Latinx, relative to King County residents as a whole. Given the relatively low representation of BIPOC communities in our study sample and the convenience sampling approach we employed to recruit study participants, we are hesitant to make comparisons between racial or ethnic groups because we fear those results would not accurately represent the pandemic’s disproportionate impact on those populations. We have added additional text to our Limitations section noting that we were unable to make these comparisons (pages 34-35, lines 922-927).

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Ayi Vandi Kwaghe

20 Dec 2023

Assessing community-level impacts of and responses to stay at home orders: the King County COVID-19 Community Study

PONE-D-23-05940R1

Dear Dr. Moloney,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ayi Vandi Kwaghe, D.V.M., M.V.Sc., P.G.D.E. Ph.D., MPH

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewer 3 response

Please correct COVID-10 to COVID-19

Manuscript

Introduction

Line 138, Line 141- Please write KC35 in full. You cannot start a paragraph or sentence with abbreviation or acronyms.

Line 318-141 which is supposed to be the aim/objective of the study should be the last sentence in the last paragraph of the introduction.

Line 156- REDCap; Please write the meaning in full since you are beginning a sentence or you start your sentence with “ The REDCap is a “…….

Line 170-171- English and Spanish versions of the WHO-5 questionnaire are publicly available; Please clearly state the Website after the statement for easy access to readers/researchers

Line 341-PTSD; please write the meaning in full

Line 434- NPIs such as stay-at-home orders……………. Please, start the sentence with the full meaning of NPI. Do not abbreviate in the beginning of a sentence.

Line 496-we did find statistically significantly difference........Please rephrase; did you mean “Statistically significant difference”?

Line 507-these participants had a statistically significantly? Please, correct the statement.

Line 515-516-Prior research has also documented differential mental health and well-being impacts of the pandemic by age group? Please, provide the reference.

Line516-518-“however, the findings of other research studies, in contrast to our own, largely indicate that younger adults were more likely to exhibit worse mental health symptoms during the early pandemic.” Please, provide the references of the studies in contrast to your studies after this statement.

Line 567-please delete the heading “Limitations”. Limitations of the study should be the last paragraph of your discussion.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: All comments have been addressed

Reviewer #4: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: N/A

Reviewer #4: I Don't Know

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: No

Reviewer #4: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: (No Response)

Reviewer #4: Thank you for giving me the opportunity to review “Assessing community-level impacts of and response to stay at home orders: the King County COVID-19 Community Study” (PONE-D-23-05940R1). This is my first time reviewing this manuscript.

The authors have done a nice job addressing most of the previous reviewers’ comments. My comments are primarily focused on the qualitative methods, analysis, and results. I am not well-versed in quantitative methods so I did not review the quantitative research and analysis. Please note that the page and line numbers that I reference in the manuscript align with the “KC3S Manuscript Revision_Clean Copy” Microsoft Word file.

Much of the information about the qualitative methods is found in two sections, “Data Analysis” (pgs. 12-13, lines 228-239) and “Results” (pg. 20, lines 302-209), which makes it difficult for a reader to understand what was done. Consider briefly describing the qualitative research in the “Methods” section, including the use of directed content analysis, questions, posed, and number of responses. I appreciate that the Survey is included in materials posted to the DesignSafe Data Depot. The authors should consider providing the qualitative questions posed as an attachment to the methods section so that readers may better under the qualitative results.

In the “Participant Characteristics” section (pg. 10, lines 204-213), I would suggest adding the number of participants or percentage of survey completers who answered the open-ended questions of the survey. This number is not found in the body of the paper until the “Results” section.

In the “Data Analysis” section on pg. 12, lines 229-231, the authors describe developing the codebook “based on the study goals, and the framework for describing disaster losses and coping strategies presented in a recently published disaster research article by Peek et al”. While the study goals are described (see, for example pg. 7, lines 141-146) the framework is not described in this manuscript. I appreciate that the authors cited Peek et al, but it would help orient readers if the authors provided a few sentences describing this framework, highlighting the parts they used for the codebook.

The first submission of the manuscript included “Table 1. Qualitative codes and illustrative quotes from KC3S survey participants.” Based on the previous review, this table was renumbered as “Table 2” and moved to the end of the Data Analysis section (see pgs. 14-15, lines 240-241). Quotations that originally appeared on the table were removed but a few are included in the “Results” section. Unfortunately, many quotations that illustrated the codebook in the original submission have been lost. These quotations would help the reader better understand the codebook. I would recommend putting them in the manuscript, perhaps as supplemental material. In addition, Table 2 includes the title “Qualitative codes and illustrative quotes from KC3S survey participants.” If the authors decide not to include the quotations, they need to remove “and illustrative quotes” from this table’s title.

The quotations in the “Results” section are inconsistently presented. For example, two quotations are in italics and quotation marks (pg. 21, lines 323-324 and pg.25, lines 361-362), while all others are presented as non-italicized text within quotation marks.

This manuscript provides a good understanding of how non-pharmaceutical interventions (masking, stay-at-home orders, etc.) led to unintended impacts such as loss of income and social isolation and it illustrates how individuals responded by employing different coping strategies (for example, using virtual technologies to connect safely with family and friends) to support health and maintain positive functioning. As pointed out in the “Results” and “Discussion” sections, this information should inform early-stage policy and intervention strategy development to address future pandemics. This manuscript also highlights research gaps, such as understanding coping strategies across a multi-year pandemic.

Overall, I recommend that this manuscript be published with the minor revisions as noted in this review.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

Reviewer #4: No

**********

Acceptance letter

Ayi Vandi Kwaghe

31 Jan 2024

PONE-D-23-05940R1

PLOS ONE

Dear Dr. Moloney,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Ayi Vandi Kwaghe

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    We have created and published a project for this study on the National Science Foundation-funded DesignSafe-CI’s Data Depot Repository, and have uploaded the de-identified study dataset to the repository. In alignment with the repository's Protected Data Best Practices, this published dataset includes participants’ responses to quantitative survey questions and the results of the qualitative data analysis of participants’ written narratives (e.g., the binary ‘1’ or ‘0’ variable for each code to indicate if it was present in a participant’s narrative). Participants’ written narratives are not included in this publicly available dataset, as many contain sensitive and/or potentially identifiable information. As survey responses were collected from a small geographical area, sampling heavily from the University of Washington community, complete de-identification of participants’ narratives is not possible. The de-identified data set is available for public access via DesignSafe project PRJ-2997 (DOI: https://doi.org/10.17603/ds2-atw6-7z47).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES