Abstract
During the COVID-19 pandemic, the number of hospital visits and attendance at scheduled appointments have dropped significantly. We used the health belief model (in three dimensions) to examine the determinants of non-attendance of scheduled appointments in outpatient clinics due to the COVID-19 pandemic. Participants in Taiwan (n = 1954) completed an online survey from 10 April 10 to 23 April 2020, which assessed how people perceived and responded to the outbreak of a fast-spreading infectious disease. We performed both univariate and multivariate logistic regression to examine the roles of cognitive, affective, and behavioral health belief constructs in nonattendance at scheduled appointments. The results indicated that individuals who perceived high confidence in coping with COVID-19 were less likely to miss or cancel their doctor’s appointments, whereas individuals who reported high anxiety and practiced more preventive health behaviors, including avoiding crowded places, washing hands more often, and wearing a mask more often, were more likely to miss or cancel their appointments due to the COVID-19 pandemic. Non-heterosexual participants had a lower rate of nonattendance at scheduled appointments compared with heterosexual ones. The study results increase our understanding of the patients’ cognitive health beliefs, psychological distress, and health behaviors when assessing adherence to medical appointments during a pandemic.
Keywords: COVID-19 pandemic, health belief, self-efficacy, medical appointment
1. Introduction
1.1. Coronavirus Disease 2019 Pandemic
Coronavirus disease 2019 (COVID-19) is a novel viral disease that has become a global public health concern. The country Centers for Disease Control and Prevention (CDC) [1] has identified how the virus spreads and has recommended strategies for prevention. COVID-19 is thought to mainly spread from person-to-person, most commonly through close contact (within 6 feet). The virus travels through respiratory droplets released in the air when an infected person coughs, sneezes, or talks. No vaccine was available to prevent COVID-19, and it has spread rapidly worldwide, with a 2–5% mortality rate [1,2]. Asymptomatic individuals may spread COVID-19; older adults and people with underlying conditions seem to be at a higher risk of developing serious complications [1,3,4]. Since 31 December 2019, and as of 17 October 2020, 39,400,032 confirmed cases, including 1,105,353 deaths, have been reported worldwide [5]. Various strategies for COVID-19 management have been implemented globally, which focus on minimizing the transmission and spread of infection and providing supportive care for infected individuals. To prevent COVID-19 importation and outbreaks, the Taiwanese government took rapid action, including border control, case identification using new data and technology, quarantining suspicious cases, allocating resources, and reassuring and educating the public [6]. After experiencing the severe acute respiratory syndrome (SARS) outbreak in 2002, the government and general public of Taiwan could quickly respond to the COVID-19 pandemic and took precautionary measures seriously. In Taiwan, the CDC and Central Epidemic Command Center announced policies and regulations and educated the public about COVID-19 through various media sources. The Taiwanese public has adhered well to the control measures, including mask-wearing, maintaining hand and respiratory hygiene, temperature monitoring, avoiding public gatherings, and maintaining social distancing and the quarantine of individuals who are infected or at high-risk [7].
1.2. Trends in Outpatient Visits
To avoid gatherings, many people reduced or stopped normal activities, including travelling, going to restaurants and stores and visiting outpatient clinics or hospitals. Due to the concerns of the COVID-19 pandemic, the overall number of hospital visits in Taiwan decreased by 14% in the first quarter of 2020 [8]. In the United States, the number of outpatient visits decreased by approximately 60% from early in the pandemic to early April 2020 [9]. In the United Kingdom, similar moderating trends in emergency department visits were observed nationwide, with a decline of 25% within 7 days of the national lockdown [10], and general practitioner appointments decreased by 30% in March 2020 from the previous year [11]. The potential reason for the decrease in outpatient visits is to avoid hospital visits due to the fear of contracting COVID-19 and the increased use of pharmacological reperfusion due to COVID-19 [12]. The fear of COVID-19 compelled people with life-threatening emergencies to stay at home [12], and patients were willing to self-treat and monitor their health at home because they believe that emergency departments (EDs) were repurposed for COVID-19, and that they were more likely to be exposed to COVID-19. After containment measures against COVID-19 were implemented, a substantial decrease in the number of admissions to intensive coronary care units was observed in France [13]. These patients indicated two main reasons for missing appointments: the fear of being infected (38%) and the fear of disturbing their doctor during the pandemic (28%). The fear of potential in-hospital infection and the long wait before consultation in an overcrowded emergency room were suggested as reasons for the decreased admission rate [13]. Other factors including financial risk, which increased due to the sudden rise in unemployment and the loss of health insurance, may cause patients to opt out of ED visits [14].
COVID-19 affects not only nonattendance at scheduled appointments in outpatient clinics, but also other aspects. For example, the total number of outpatients, hospital admissions, and surgeries conducted during the pandemic (March and April 2020) were also significantly smaller than those in the corresponding months of the previous year on orthopedic surgery practice [15]. The impacts included a 20–29% reduction in outpatients, 22–37% reduction in admissions, and 18–35% reduction in surgeries. Similarly, COVID-19 has also changed the daily practice of dermatologists dramatically with a significant decrease in the number of visits in 2020, compared to 2018 and 2019 [16]. Those with non-emergent dermatosis were unlikely to visit the dermatology clinic in Taiwan during the pandemic, in contrast to patients with skin cancer. Moreover, COVID-19 has had great impacts on all forms of mental health care—inpatient, community, residential and outpatient across seven countries including Taiwan [17], especially for services which depended on face-to-face and hospital-based care. There was a general decrease in demand for mental health care during the initial and acceleration phase of the pandemic. Rehabilitation and social services for mental illness have also been affected or ceased. Routine care for chronic disease, such as diabetes, chronic obstructive pulmonary disease, and hypertension, were the most impacted conditions in the COVID-19 pandemic due to reduction in access to care across countries [18]. In Taiwan, there was a statistically significant decrease in the old elderly patients (aged above 75) with chronic diseases returning to hospital for medicines at early stage of outbreak [19].
1.3. Health Belief Model and Preventive Health Behavior
Understanding the public’s behaviors, beliefs, and perceptions is critically important in assessing adherence to health advice [20] and medical appointments. The health belief model (HBM) is one of the most widely used frameworks in health behavior research [21]. Health-related behaviors in the face of a disease or the risk of contracting a disease are determined by the health beliefs and cues to action of an individual [22]. These primary constructs include perceived susceptibility, perceived severity, self-efficacy, and expectations of the behavior (perceived benefits and barriers) [21,22]. Based on the HBM, we identified three dimensions of these health belief constructs—cognitive construct, affective construct, and behavioral construct of health belief. First, the cognitive constructs of health belief include perceived susceptibility, perceived severity, and self-efficacy (confidence). Perceived susceptibility refers to personal beliefs about the likelihood of contracting a disease [21]. Individuals must believe that there is a high possibility of contracting COVID-19 before they consider taking precautions. Perceived severity refers to personal beliefs about the seriousness of clinical and social consequences of being infected [21]. For example, an individual must believe that there is a high possibility of severe short-term (death) or long-term (organ damage) consequences after contracting COVID-19 before taking the disease seriously. Moreover, media reports may produce fear, worry, and anxiety in the public. Self-efficacy refers to the confidence in one’s ability to act according to social cognitive theory [23], and it is a part of the HBM [21,24]. Individuals educated about COVID-19 may have high self-efficacy and confidence in coping with COVID-19. Second, the affective constructs of health belief include worry and anxiety about the diseases. Third, the behavioral constructs of health belief involve both perceived benefits and barriers. Perceived benefits refer to personal beliefs about the efficacy of actions to reduce the disease threat [21]. For example, individuals may not practice the recommended precautions, including washing hands more often, maintaining social distancing, and wearing facemasks or coverings, unless the perceived benefits of these actions reduced the threat or risk to health. Perceived barriers refer to personal beliefs about the negative externalities or costs of the preventive health actions while weighing the expected benefits [21]. For example, although wearing facemasks can reduce the risk of contracting COVID-19, it can be unpleasant, inconvenient, and expensive or has side effects, including difficulty in breathing and impairment of nonverbal communication, which encourages noncompliance to regulations.
1.4. Nonattendance in Outpatient Clinics among Sexual Minority Individuals
COVID-19 may have a disproportionate impact on physical and mental health of sexual minorities [25]. Sexual minority individuals already have a higher burden of chronic health problems such as human immunodeficiency virus (HIV) infection [26], cancer [27], diabetes [28] and hypertension [29] than heterosexuals before the COVID-19 pandemic. As demonstrated by the minority stress model [30], negative attitude toward sexual minority in the society may worsen the health of sexual minority individuals. Sexual minority individuals are less likely to seek health care due to stigma and discrimination [31]. Furthermore, compared with heterosexual individuals, the COVID-19 pandemic disproportionately impacted mental health [32] and economic capability [33] of sexual minority individuals and thus may compromise their ability to access health care services. A recent study reported that the COVID-19 pandemic resulted in interruptions of HIV treatment in sexual minority individuals [34]. Whether there is difference in nonattendance at scheduled appointments in outpatient clinics during the COVID-19 pandemic between sexual minority and heterosexual individuals’ warrants study.
1.5. Aims of This Study
This study used HBM to examine the determinants of nonattendance at scheduled appointments in outpatient clinics due to the COVID-19 pandemic, which describe healthcare decision-making behavior in this uncertain time. The primary concepts of health beliefs were considered in terms of three dimensions: cognitive, affective, and behavioral constructs. The cognitive constructs of health belief include perceived susceptibility to COVID-19, perceived severity of COVID-19, having enough knowledge and information on COVID-19, and confidence in coping with COVID-19. The affective constructs of health belief include worry about COVID-19 and general anxiety. The behavioral constructs of health belief include avoiding crowded places, washing hands more often, and wearing a mask more often. Regarding the cognitive constructs of health belief, we hypothesized that people who perceived higher levels of susceptibility and severity to COVID-19 were more likely to miss scheduled appointments in clinics due to the COVID-19 pandemic, whereas people with enough knowledge and information on COVID-19 and confidence in coping with it were less likely to miss appointed appointments due to the pandemic. Regarding the affective constructs of health belief, we hypothesized that people who were worried about COVID-19 and had higher levels of anxiety were more likely to miss scheduled appointments in clinics. Regarding the behavioral constructs of health belief, we hypothesized that people who avoided crowed places, washed hands more often, and wore masks more often during the pandemic were more likely to miss scheduled appointments at the clinic. We also compared the rates of nonattendance at scheduled appointments between heterosexual and non-heterosexual individuals and the moderating effect of sexual orientation in the association between HBM constructs and nonattendance.
2. Methods
2.1. Participants and Procedures
We recruited 1954 participants through a Facebook advertisement from 10 April to 23 April 2020. Facebook users who were ≥20 years old and lived in Taiwan were eligible for this study. Each participant completed an online survey, which assessed how the general public perceived and responded to the outbreak of a fast-spreading infectious disease [35].
Our Facebook advertisement was posted on Facebook as “news feeds,” which is a constantly updating list of stories and information highlights. Compared with other Facebook advertising locations, such as the right column, we targeted users’ news feed advertisements because it is the most effective way to recruit research participants [36]. We targeted Facebook users by location (Taiwan) and language spoken (Chinese). Facebook’s advertising algorithm determined our audience based on our criteria. The Facebook advertisement included a headline, main text, pop-up banner, and link to the research questionnaire website. To ensure diversity of sexual orientation among participants during the recruitment, we posted the advertisements on three Facebook pages of Taiwanese health promotion and counseling centers for lesbian, gay, and bisexual individuals. Facebook has a younger and more progressive audience than the general population [37]. For example, in our sample only 1.4% of adults were elderly (65 years old or above), which is much less than the percentage in the general population in Taiwan (16%) [38]. While 89% of the participants in our sample have a high education level (college or above), the corresponding percentage in the general population in Taiwan was 47% [38]. While 67% of the participants in our sample were female, the percentage in the general population is 50% [38].
This study was approved by the Institutional Review Board (IRB) of Kaohsiung Medical University Hospital (KMUHIRB-EXEMPT(I) 20200011). IRB indicated that this study did not require written informed consent because participation was voluntary and survey responses were anonymous. No incentive was given to the participants. For participants to learn more about COVID-19, we provided useful links from the Taiwan CDC, Kaohsiung Medical University Hospital, and Medical College of National Cheng Kung University.
2.2. Measures
The questionnaire survey was conducted in Mandarin. The measures were listed below.
2.2.1. Nonattendance at Scheduled Appointments in Outpatient Clinics
We used the following question to assess participant nonattendance at scheduled appointments in outpatient clinics: “In the past 7 days, have you ever missed a doctor appointment?” The responses were categorized as 0, “no” or “yes, but not due to COVID-19” and 1, “yes, due to COVID-19.”
2.2.2. HBM Constructs
We used the questionnaire developed by Liao et al. [39] to measure the cognitive, affective and behavioral HBM constructs in the context of the COVID-19 pandemic. The original questionnaire was in Mandarin and developed for measuring cognitive, affective and behavioral constructs of the HBM among people in Hong Kong during the 2009 influenza A/H1N1 pandemic [39]. Given that there are similar characteristics of respiratory infectious diseases between COVID-19 and influenza A/H1N1 and that the questionnaire of Liao et al. [39] contained the HBM constructs we aimed to measure during the COVID-19 pandemic, the questionnaire was suitable for this study. We also used the same cutoffs recommended by the original study to dichotomize the variables.
We measured four cognitive constructs of the HBM. First, we assessed the perceived susceptibility to COVID-19 using the question “What do you think are your chances of contracting COVID-19 over the next 1 month compared with others outside your family?” [39]. This question was rated from 1 (no chance of contracting COVID-19) to 7 (guaranteed to contract COVID-19). Scores of 5 or more indicated high perceived susceptibilities and less than 5 indicated low perceived susceptibilities [39]. Second, we assessed the perceived severity of COVID-19 relative to SARS using the question “How serious is COVID-19 relative to SARS?” [39]. This question was rated from 1 (COVID-19 is much less serious) to 5 (COVID-19 is much more serious). Scores of 4 or more indicated high perceived severity and less than 4 indicated low perceived severity [39].
Third, a barrier in the HBM includes a lack of necessary knowledge [40]. We assessed the level of necessary knowledge using the yes/no question “Do you think you have sufficient knowledge and information on COVID-19?” Fourth, we assessed the perceived self-confidence in coping with COVID-19 using the question “How confident are you that you can cope well with COVID-19?” [41]. This question was rated from 1 (not confident at all) to 5 (very confident). Scores of 3 or more indicated high self-confidence levels and less than 3 indicated low self-confidence levels.
We measured two affective constructs in the context of the COVID-19 pandemic. First, we assessed the level of worry about COVID-19 through the question “Please rate how worried you are currently toward COVID-19” [39]. The response was rated from 1 (very mild) to 10 (very severe). Scores of 6 or more indicated high levels of worry, and scores less than 6 indicated low levels of worry. Second, we measured general anxiety in the past 1 week using a validated state anxiety scale from the State-Trait Anxiety Inventory [42]. Participants were asked to rate their feelings in response to 10 statements, including feelings of being rested, contented, comfortable, relaxed, pleasant, anxious, nervous, jittery, highly strung, and over-excited and “rattled” on a 4-point Likert scale (1 = not at all, 2 = sometimes, 3 = moderately so, 4 = very much so) [39,42,43]. Several items were reverse coded. Higher scores indicated greater anxiety. Cronbach’s α for these items was 0.92. Scores of 23 (the median) or more indicated high levels of anxiety, and scores less than 23 indicated low levels of anxiety.
The behavioral constructs assessed focused on whether the participants practiced preventive measures daily. Participants were asked if they (1) avoided crowded places, (2) washed their hands more often, and (3) wore a mask more often in the past 7 days [39]. The responses were categorized as 0, “no” or “yes, but not due to COVID-19” or 1, “yes, due to COVID-19.” Participants who responded “yes, due to COVID-19” were classified as practicing preventive measures daily [39].
2.2.3. Demographic Characteristics
We collected demographic data, including gender, age, sexual orientation (heterosexual vs. non-heterosexual), and education level (university qualifications or above vs. high school qualifications or below).
2.3. Statistical Analysis
Data analysis was performed using SPSS 22.0 statistical software (SPSS Inc., Chicago, IL, USA). Demographic characteristics; cognitive, affective, and behavioral constructs of health beliefs related to COVID-19; and general anxiety were compared between respondents who did or did not experience nonattendance at scheduled appointments in outpatient clinics due to COVID-19 by using univariate logistic regression with the crude odds ratio (cOR). All potential predictive variables identified from the first step were included in the multivariate logistic regression models with the adjusted odds ratio (aOR) calculated to determine independent predictors of nonattendance at scheduled appointments. According to Senaviratna and Cooray [44], we used Tolerance, Variance Inflation Factor (VIF) and Condition Index to examine the multicollinearity of logistic regression analysis. The values of Tolerance 0.1 or less, VIF above 2.5 and Condition Index above 30 indicate a concern for multicollinearity among variables. The moderating effect of sexual orientation on the association between HBM constructs and nonattendance was also examined. The odds ratio (OR), p value, and 95% confidence interval (CI) were used to indicate significance. A two-tailed p value of < 0.05 indicated statistical significance.
3. Results
3.1. Summaries of Descriptive Analysis
Data from 1954 patient respondents (women: 66.8%, men: 33.2%; mean age = 37.87 years) were analyzed; 77 of the original 2031 participants were excluded due to missing data. In total, 201 (10.3%) respondents reported nonattendance at scheduled appointments in outpatient clinics in the past week. Table 1 shows the results of univariate logistic regression analysis of the association between demographic characteristics with nonattendance at scheduled appointments in outpatient clinics. Older age was significantly associated with nonattendance at scheduled appointments. Heterosexual respondents were more likely to have nonattendance at scheduled appointments than nonheterosexual respondents. No difference was found in nonattendance between genders or between respondents with high and low education levels.
Table 1.
Variables | Nonattendance | Univariate Logistic Model | ||||
---|---|---|---|---|---|---|
No | Yes | B | cOR | 95% CI | p Value | |
Gender, n (%) | ||||||
Female (n = 1305) | 1161 (89.0) | 144 (11.0) | −0.253 | 0.776 | 0.562–1.071 | 0.124 |
Male (n = 649) | 592 (91.2) | 57 (8.8) | ||||
Age (years), mean (SD) | 37.5 (10.8) | 40.8 (10.4) | 0.027 | 1.027 | 1.014–1.041 | <0.001 |
Sexual orientation | ||||||
Nonheterosexual (n = 533) | 504 (94.6) | 29 (5.4) | 0.873 | 2.393 | 1.593–3.595 | <0.001 |
Heterosexual (n = 1421) | 1249 (87.9) | 172 (12.1) | ||||
Education level, n (%) | ||||||
University or above (n = 1736) | 1561 (89.9) | 175 (10.1) | 0.189 | 1.208 | 0.779–1.872 | 0.398 |
High school or below (n = 218) | 192 (88.1) | 26 (11.9) |
CI: Confidence interval; cOR: Crude odds ratio; SD: Standard deviation.
3.2. Comparisons Constructs of Health Beliefs between Attendance and Nonattendance at Scheduled Appointments
Table 2 presents the results of univariate logistic regression analysis of the associations of cognitive, affective, and behavioral constructs of health beliefs related to the COVID-19 pandemic with nonattendance at scheduled appointments in outpatient clinics. The results indicated that respondents who perceived high susceptibility to COVID-19 and had low confidence in coping with COVID-19 were more likely to have nonattendance at scheduled appointments than those who perceived low susceptibility to COVID-19 and who had high confidence in coping with COVID-19. Respondents who were highly worried about COVID-19 and had high general anxiety were more likely to have nonattendance than those who had low levels of worry and low general anxiety. Respondents who avoided crowded places, washed hands more often, or wore a mask more often were more likely to have nonattendance at scheduled appointments than those who did not practice these protective behaviors. However, perceived COVID-19 severity relative to SARS and knowledge on COVID-19 were not significantly associated with nonattendance at scheduled appointments.
Table 2.
Factors | Nonattendance | Univariate Logistic Model | ||||
---|---|---|---|---|---|---|
No | Yes | B | cOR | 95% CI | p | |
Cognitive constructs of health belief | ||||||
Perceived susceptibility to COVID-19, n (%) | ||||||
Low (n = 1608) | 1459 (90.7) | 149 (9.3) | 0.549 | 1.732 | 1.233–2.432 | 0.002 |
High (n = 346) | 294 (85.0) | 52 (15.0) | ||||
Perceived COVID-19 severity relative to SARS, n (%) | ||||||
Low (n = 575) | 522 (90.8) | 53 (9.2) | 0.169 | 1.184 | 0.851–1.647 | 0.316 |
High (n = 1379) | 1231 (89.3) | 148 (10.7) | ||||
Having enough knowledge and information about COVID-19, n (%) | ||||||
No (n = 191) | 174 (91.1) | 17 (8.9) | 0.176 | 1.193 | 0.708–2.008 | 0.507 |
Yes (n = 1763) | 1579 (89.6) | 184 (10.4) | ||||
Confidence in coping with COVID-19, n (%) | ||||||
Low (n = 268) | 221 (82.5) | 47 (17.5) | −0.749 | 0.473 | 0.331–0.675 | <0.001 |
High (n = 1686) | 1532 (90.9) | 154 (9.1) | ||||
Affective construct of health belief | ||||||
Worry about COVID-19, n (%) | ||||||
Low (n = 726) | 671 (92.4) | 55 (7.6) | 0.498 | 1.646 | 1.190–2.278 | 0.003 |
High (n = 1228) | 1082 (88.1) | 146 (11.9) | ||||
General anxiety, n (%) | ||||||
Low (n = 1011) | 940 (93.0) | 71 (7.0) | 0.750 | 2.117 | 1.562–2.869 | <0.001 |
High (n = 943) | 813 (86.2) | 130 (13.8) | ||||
Behavioral constructs of health belief | ||||||
Avoiding crowded places, n (%) | ||||||
No (n = 367) | 355 (96.7) | 12 (3.3) | 1.386 | 3.999 | 2.206–7.251 | <0.001 |
Yes (n = 1587) | 1398 (88.1) | 189 (11.9) | ||||
Washing hands more often, n (%) | ||||||
No (n = 443) | 432 (97.5) | 11 (2.5) | 1.731 | 5.649 | 3.046–10.474 | <0.001 |
Yes (n = 1511) | 1321 (87.4) | 190 (12.6) | ||||
Wearing a mask more often, n (%) | ||||||
No (n = 443) | 429 (96.8) | 14 (3.2) | 1.465 | 4.328 | 2.487–7.531 | <0.001 |
Yes (n = 1511) | 1324 (87.6) | 187 (12.4) | ||||
Yes (n = 1587) | 1398 (88.1) | 189 (11.9) |
CI: Confidence interval; COVID-19: Coronavirus disease 2019; cOR: Crude odds ratio; SARS: Severe acute respiratory syndrome.
3.3. Factors Associated with Nonattendance at Scheduled Appointments
Variables that were significantly associated with nonattendance at scheduled appointments in the univariate logistic regression model were included in the multivariate logistic regression model (Table 3). The multicollinearity among variables have not be identified because all Tolerances were larger than 0.1, VIFs were less than 2.5 and Condition Indexes were less than 30 (Supplementary Table S1). The results indicated that older age, heterosexuality, low confidence in coping with COVID-19, high general anxiety, avoiding crowded places, washing hands more often, and wearing a mask more often were significantly associated with nonattendance at scheduled appointments. However, perceived susceptibility to and worry about COVID-19 became not significantly associated with nonattendance at scheduled appointments.
Table 3.
Factors | B | aOR | 95% CI | p |
---|---|---|---|---|
Age | 0.021 | 1.021 | 1.007–1.036 | 0.004 |
Heterosexuals a | 0.572 | 1.772 | 1.153–2.724 | 0.009 |
Cognitive constructs of health belief | ||||
Perceived high susceptibility to COVID-19 b | 0.273 | 1.315 | 0.914–1.890 | 0.140 |
High confidence in coping with COVID-19 c | −0.393 | 0.675 | 0.459–0.993 | 0.046 |
Affective construct of health belief | ||||
High worry about COVID-19 d | 0.057 | 1.059 | 0.741–1.514 | 0.753 |
High general anxiety e | 0.517 | 1.677 | 1.207–2.330 | 0.002 |
Behavioral constructs of health belief | ||||
Avoiding crowded places | 0.632 | 1.882 | 1.005–3.524 | 0.048 |
Washing hands more often | 1.085 | 2.960 | 1.531–5.725 | 0.001 |
Wearing a mask more often | 0.777 | 2.174 | 1.199–3.940 | 0.011 |
a: Nonheterosexual as the reference; b: Low susceptibility to COVID-19 as the reference; c: Low confidence in coping with COVID-19 as the reference; d: Low worry about COVID-19 as the reference; e: Low general anxiety as the reference. aOR: Adjusted odds ratio; CI: Confidence interval; COVID-19: Coronavirus disease 2019.
3.4. Moderating Effect of Sexual Orientation on the Assocaition between HBM Construcs and Nonattendance
The interactions between sexual orientation and HBM constructs that were significantly associated with nonattendance were put into logistic regression model to examine the moderating effect of sexual orientation (Table 4). The results demonstrated that the interaction variables were not significantly associated with nonattendance, indicating no moderating effect of sexual orientation.
Table 4.
Variables | B | aOR | 95% CI | p |
---|---|---|---|---|
Heterosexuals × Confidence in coping with COVID-19 | 0.187 | 1.206 | 0.393–3.705 | 0.744 |
Heterosexuals × Gneral anxiety | −0.192 | 0.825 | 0.344–1.981 | 0.668 |
Heterosexuals × Avoiding crowded places | 0.041 | 1.042 | 0.245–4.440 | 0.955 |
Heterosexuals × Washing hands | −0.231 | 0.794 | 0.146–4.319 | 0.789 |
Heterosexuals × Wearing a mask | 0.429 | 1.536 | 0.356–6.628 | 0.565 |
a: Controlling for age, sexual orientaiton, susceptibility to COVID-19, confidence in coping with COVID-19, worry about COVID-19, gneral anxiety, worry about COVID-19, avoiding crowded places, washing hands, and wearing a mask. aOR: Adjusted odds ratio; CI: Confidence interval; COVID-19: Coronavirus disease 2019.
4. Discussion
4.1. Principle Results
This study contributes to the understanding of how people make healthcare decisions (keeping appointments) based on what they believed in, how they felt and reacted to the pandemic, and the preventive health behaviors they practiced. Uniquely, because Taiwan responded to the pandemic very early in January 2020 with border control, case identification using technology, quarantine of suspicious cases, resource allocation, etc., there was no community spread and no lockdown or stay-home order. Therefore, the nonattendances of scheduled appointments were not due to lockdown but because of individuals’ health beliefs. A total of 10.3% of the participants (heterosexual: 12.1%, non-heterosexual: 5.4%) in our study reported that they missed scheduled appointments in the past week because of the COVID-19 pandemic, suggesting that patients preferred to self-treat and monitor their health at home due to the anxiety or fear of exposure to COVID-19 at the clinic or hospital. However, the failure to keep a scheduled appointment may jeopardize patient health and well-being [45,46]. Understanding patients’ beliefs, psychological distress, and health behaviors is therefore important in assessing adherence to medical appointments.
This study is the first to investigate the determinants of nonattendance at scheduled appointments in outpatient clinics due to the COVID-19 pandemic using HBM in Taiwan. Only one study has investigated appointment-keeping behavior for a potentially fatal chronic disease using HBM [47]. Our findings indicate that all three constructs of health belief (cognitive, affective, and behavioral) were associated with nonattendance at scheduled appointments due to the COVID-19 pandemic. After considering age, sexual orientation, and other health belief constructs, individuals who perceived high confidence in coping with COVID-19 were less likely to miss or cancel their doctor’s appointments, which supported our hypothesis. If individuals perceive high efficacy of prevention measures, they are more likely to adhere to these prevention measures [48]. If the government and community can emphasize and increase people’s perceived efficacy of coping with COVID-19, it will reduce the threat and fear of the disease [23] and ensure appointment-keeping and adhere to health advice.
4.2. Three HBM Constructs and Nonattendance at Schedule Appointments
Regarding the cognitive constructs of health belief, individuals who had high confidence in coping with COVID-19 were less likely to miss or cancel doctor’s appointments. The confidence of the coping may be considered not only in the individual level but also the contextual levels. In very early stage of the pandemic in 20 January 2020, the Central Epidemic Command Center (CECC) in Taiwan was activated and rapidly responded to the pandemics. With the efforts of the CECC and all residents in Taiwan (total population is 23.8 million in 2020), there was no community spread and the number of confirmed cases until 23 April 2020 (the end of our survey time) was quite low (confirmed cases = 427, deaths = 6), and most of the cases were imported cases [49]. Moreover, CECC held the press conference every day to provide the most accurate, transparent and updated information and education to the public and answer any questions from the reports. Therefore, the majority of general public viewed CECC as trustworthy and believed the health system in Taiwan has the capacity in handling the pandemic situations and treatments without great concerns of collapses. It might contribute to the confidence in coping with COVID-19.
Regarding the affective constructs of health belief, our results indicated that individuals who reported high anxiety were more likely to miss or cancel their appointments due to the COVID-19 pandemic. Given the continuously increasing number of infected cases, rapid spread of the outbreak globally, and uncertainty, people are likely to experience psychological stress and mental health challenges. The spread of rumors on social media about disease severity may induce greater fear, worry, stigma, and discrimination against victims of infectious disease and increase anxiety levels [50,51]. In this study, approximately 63% of the respondents reported high levels of worry about COVID-19, and 48% respondents reported high levels of general anxiety. Furthermore, high levels of worry were associated with nonattendance at appointments; however, the relationship became insignificant after considering other constructs of health belief. By contrast, general anxiety was the strongest affective construct that explained patients’ missing appointments after considering other confounding factors. When individuals felt highly anxious, they tended to stay in the comfort zone without taking the risks of attending doctor’s appointments, especially during the pandemic which was full of uncertainty and increased anxiety.
Regarding the behavioral constructs of health belief, individuals who practiced more preventive health behaviors, such as avoiding crowded places, washing hands more often, and wearing a mask more often, were more likely to miss or cancel their appointments due to the COVID-19 pandemic, after considering other constructs of health belief. Because there was no vaccine for COVID-19 in 2020, the use of preventive measures, including social distancing, maintaining hand hygiene, and wearing a facemask, has become an alternate strategy for managing the spread of the pandemic [52]. Patients who are not highly concerned about the pandemic may become highly concerned because of the numerous recommended preventive strategies, including washing hands for 20 s (the length of singing a birthday song twice) many times a day or using sanitizers often, requirement of wearing a facemask, wiping surfaces very often, maintaining social distancing, avoiding shaking hands or sharing objects with others, entering and exiting a building or room using different doors, and working from home. These preventive strategies might be associated with reinforced beliefs about the susceptibility to and severity of the disease, including swine flu [53] and COVID-19. Our results support the hypothesis that the more the preventive strategies were followed by the patients, the more concerns they had of the COVID-19 pandemic, and the more they were likely to miss or cancel the scheduled appointments.
4.3. Role of Sexual Orientaiton in Nonattendance
The present study demonstrated that non-sexual individuals had a lower rate of nonattendance than heterosexual ones, whereas no moderating effect of sexual orientaiton was found on the association between HBM constructs and nonattendance. As mentioned before, research has revealed that non-heterosexual individuals may have higher rates of chronic health problems [26,27,28,29] that may make regular attendance at the clinics become necessary. The quality national health insurance provides every citizen in Taiwan health care at a reasonable cost. Given that the present study did not examine what departments the scheduled appointments the participants missed were in nor what kinds of physical and psychiatric illnesses the participants had, we could not determine whether the difference in non-attendance between non-heterosexual and heterosexual participants came from the varieties of illnesses and severities.
4.4. Limitations
Although this study provides insights into the roles of three health belief constructs to explain non-attendance at scheduled appointments due to the COVID-19 pandemic, there are several limitations. First, because of the cross-sectional design, causal conclusions and inferences between and among variables cannot be drawn. Second, the number of confirmed cases, the emergence and spread of the disease, death rates, and national or local responses may vary globally, and the results of this study from a Taiwanese sample may not be generalizable to other populations, especially because Taiwan has a relatively lower number of confirmed cases and does not show signs of community spread. Third, factors including stigma or discrimination toward people who are infected by COVID-19 may cause individuals to hide their infection and miss the scheduled appointments. Future studies may examine the role of social stigma in the context of the pandemic. Fourth, we did not separate the participants into those who miss or cancelled scheduled appointments, those who attended scheduled appointments, and those who did not have scheduled appointments. The HBM constructs identified to be associated with nonattendance in the present study could only discriminate between the nonattendance group and other two groups. Lastly, because Facebook has a younger and more progressive audience than the general population [37], the results in our study may not be generalizable to the general population, especially the elderly.
5. Conclusions
The study results increase our understanding of the patients’ cognitive health beliefs, psychological distress, and health behaviors when assessing adherence to medical appointments during a pandemic. Moreover, when the government or community can provide and deliver accurate and trustworthy information and education to the public and allocate resources, it may increase patients’ self-efficacy and confidence in coping with COVID-19 and decrease their anxiety levels, which in turn will reduce the unreasonable fear of the disease and ensure appointment-keeping and adhere to health advice. In addition, when patients took the pandemic very seriously by strictly following the preventive measures/strategies, they also tended to eliminate any risks of exposure to the COVID-19 by not attending doctor’s appointments unless it is an emergency. Alternative options should be developed and provided to patients to ensure their health and well-being are not jeopardized during the pandemic.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/ijerph18094445/s1, Table S1: The result for multicollinearity among variables in Multivariate Logistic Regression Model
Author Contributions
Y.-P.H. analyzed the data and drafted the manuscript. C.-F.Y. formulated goals of study. C.-F.W. did the data curation. P.-W.W. conducted the study. All authors have read and agreed to the published version of the manuscript.
Funding
This study was supported by grants KMUH107-7R68, KMUH108-8R63 and KMUH109-9R74 from Kaohsiung Medical University Hospital. The funding agency did not have a role in this study.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Kaohsiung Medical University Hospital (KMUHIRB-EXEMPT(I) 20200011).
Informed Consent Statement
The Institutional Review Board of Kaohsiung Medical University Hospital waived the need for informed consent because participation was voluntary and survey responses were anonymous.
Data Availability Statement
The data will be available upon reasonable request to the corresponding authors.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.How to Protect Yourself & Others. Centers for Disease Control and Prevention. [(accessed on 18 October 2020)]; Available online: https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html.
- 2.Wu F., Zhao S., Yu B., Chen Y.-M., Wang W., Song Z.-G., Hu Y., Tao Z.-W., Tian J.-H., Pei Y.-Y., et al. A new coronavirus associated with human respiratory disease in China. Nature. 2020;579:265–269. doi: 10.1038/s41586-020-2008-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.COVID-19 Hospitalization and Death by Age. Centers for Disease Control and Prevention. [(accessed on 18 October 2020)]; Available online: https://www.cdc.gov/coronavirus/2019-ncov/covid-data/investigations-discovery/hospitalization-death-by-age.html.
- 4.Certain Medical Conditions and Risk for Severe COVID-19 Illness. Centers for Disease Control and Prevention. [(accessed on 30 March 2021)]; Available online: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/people-with-medical-conditions.html.
- 5.COVID-19 situation update worldwide, as of 15 October 2020. European Centre for Disease Prevention and Control. [(accessed on 18 October 2020)]; Available online: https://www.ecdc.europa.eu/en/geographical-distribution-2019-ncov-cases.
- 6.Wang C.J., Ng C.Y., Brook R.H. Response to COVID-19 in Taiwan. J. Am. Med Assoc. 2020;323:1341. doi: 10.1001/jama.2020.3151. [DOI] [PubMed] [Google Scholar]
- 7.Kuo S.-C., Shih S.-M., Chien L.-H., Hsiung C.A. Collateral Benefit of COVID-19 Control Measures on Influenza Activity, Taiwan. Emerg. Infect. Dis. 2020;26:1928–1930. doi: 10.3201/eid2608.201192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lee H.-H., Lin S.-H. Effects of COVID-19 Prevention Measures on Other Common Infections, Taiwan. Emerg. Infect. Dis. 2020;26:2509–2511. doi: 10.3201/eid2610.203193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mehrotra A. What Impact Has COVID-19 Had on Outpatient Visits? Commonwealth Fund. [(accessed on 18 October 2020)]; Available online: https://www.commonwealthfund.org/publications/2020/apr/impact-covid-19-outpatient-visits.
- 10.Thornton J. Covid-19: A&E visits in England fall by 25% in week after lockdown. BMJ. 2020;369:1401. doi: 10.1136/bmj.m1401. [DOI] [PubMed] [Google Scholar]
- 11.Murray R., Edwards N. Delivering core NHS and care services during the Covid-19 pandemic and beyond. The King’s Fund. [(accessed on 18 October 2020)]; Available online: https://www.kingsfund.org.uk/publications/letter-to-health-and-social-care-select-committee-covid-19.
- 12.Garcia S., Albaghdadi M.S., Meraj P.M., Schmidt C., Garberich R., Jaffer F.A., Dixon S., Rade J.J., Tannenbaum M., Chambers J., et al. Reduction in ST-Segment Elevation Cardiac Catheterization Laboratory Activations in the United States During COVID-19 Pandemic. J. Am. Coll. Cardiol. 2020;75:2871–2872. doi: 10.1016/j.jacc.2020.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Huet F., Prieur C., Schurtz G., Gerbaud E., Manzo-Silberman S., Vanzetto G., Elbaz M., Tea V., Mercier G., Lattuca B., et al. One train may hide another: Acute cardiovascular diseases could be neglected because of the COVID-19 pandemic. Arch. Cardiovasc. Dis. 2020;113:303–307. doi: 10.1016/j.acvd.2020.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Kocher K.E., Macy M.L. Emergency Department Patients in the Early Months of the Coronavirus Disease 2019 (COVID-19) Pandemic—What Have We Learned? J. Am. Med Assoc. Health Forum. 2020 doi: 10.1001/jamahealthforum.2020.0705. [DOI] [PubMed] [Google Scholar]
- 15.Shih C.L., Huang P.J., Huang H.T., Chen C.H., Lee T.C., Hsu C.H. Impact of the COVID-19 pandemic and its related psychological effect on orthopedic surgeries conducted in different types of hospitals in Taiwan. J. Orthop. Surg. 2021 doi: 10.1177/2309499021996072. [DOI] [PubMed] [Google Scholar]
- 16.Ma S.H., Tai Y.H., Dai Y.X., Chen C.C., Chen T.J., Chang Y.T. Impact of the COVID-19 pandemic on dermatology clinic visits: Experience from a tertiary medical center in Taiwan. Dermatol. Sin. 2020;38:180–181. [Google Scholar]
- 17.Rosenberg S., Mendoza J., Tabatabaei-Jafari H. Pandemic-Mental Health International Network (Pan-MHIN), Salvador-Carulla, L. International experiences of the active period of COVID-19—Mental health care. Health Policy Technol. 2020;9:503–509. doi: 10.1016/j.hlpt.2020.08.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Chudasama Y.V., Gillies C.L., Zaccardi F., Coles B., Davies M.J., Seidu S., Khunti K. Impact of COVID-19 on routine care for chronic diseases: A global survey of views from healthcare professionals. Diabetes Metab. Syndr. Clin. Res. Rev. 2020;14:965–967. doi: 10.1016/j.dsx.2020.06.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hsiao S., Chang H.M., Kang Y.-T., Chen Y.-H. Mitigate risks of medication interruption due to COVID-19 for elderly with chronic diseases. Kaohsiung J. Med. Sci. 2020;36:661–662. doi: 10.1002/kjm2.12263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rubin G.J., Amlot R., Page L., Wessely S. Public perceptions, anxiety, and behaviour change in relation to the swine flu outbreak: Cross sectional telephone survey. BMJ. 2009;339:b2651. doi: 10.1136/bmj.b2651. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Champion V.L., Skinner C.S. The health belief model. Health Behav. Health Educ. Theory, Res. Pract. 2008;4:45–65. [Google Scholar]
- 22.Rosenstock I.M. Historical Origins of the Health Belief Model. Health Educ. Monogr. 1974;2:328–335. doi: 10.1177/109019817400200403. [DOI] [Google Scholar]
- 23.Bandura A. In: Self-Efficacy the Exercise of Control. Freeman W.H., editor. Springer; New York, NY, USA: 2000. [Google Scholar]
- 24.Rosenstock I.M., Strecher V.J., Becker M.H. Social Learning Theory and the Health Belief Model. Health Educ. Q. 1988;15:175–183. doi: 10.1177/109019818801500203. [DOI] [PubMed] [Google Scholar]
- 25.Phillips G., Felt D., Ruprecht M.M., Wang X., Xu J., Pérez-Bill E., Bagnarol R.M., Roth J., Curry C.W., Beach L.B. Addressing the disproportionate impacts of the COVID-19 pandemic on sexual and gender minority populations in the United States: Actions toward equity. LGBT Health. 2020;7:279–282. doi: 10.1089/lgbt.2020.0187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Operario D., Gamarel K.E., Grin B.M., Lee J.H., Kahler C.W., Marshall B.D., van den Berg J.J., Zaller N.D. Sexual minority health disparities in adult men and women in the United States: National Health and Nutrition Examination Survey, 2001–2010. Am. J. Public Health. 2015;105:e27–e34. doi: 10.2105/AJPH.2015.302762. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Cathcart-Rake E.J. Cancer in sexual and gender minority patients: Are we addressing their needs? Curr. Oncol. Rep. 2018;20:85. doi: 10.1007/s11912-018-0737-3. [DOI] [PubMed] [Google Scholar]
- 28.Beach L.B., Elasy T.A., Gonzales G. Prevalence of selfreported diabetes by sexual orientation: Results from the 2014 Behavioral Risk Factor Surveillance System. LGBT Health. 2018;5:121–130. doi: 10.1089/lgbt.2017.0091. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Everett B., Mollborn S. Differences in hypertension by sexual orientation among U.S. young adults. J. Community Health. 2013;38:588–596. doi: 10.1007/s10900-013-9655-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Meyer I.H. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychol. Bull. 2003;129:674–697. doi: 10.1037/0033-2909.129.5.674. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.National LGBT Health Education Center, The Fenway Institute Providing Inclusive Services and Care for LGBT People: A Guide for Health Care Staff. [(accessed on 25 March 2020)];2016 Available online: https://www.lgbthealtheducation.org/publication/learning-guide/
- 32.Kamal K., Li J.J., Hahm H.C., Liu C.H. Psychiatric impacts of the COVID-19 global pandemic on U.S. sexual and gender minority young adults. Psychiatry Res. 2021;299:113855. doi: 10.1016/j.psychres.2021.113855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Heslin K.C., Hall J.E. Sexual orientation disparities in risk factors for adverse COVID-19-related outcomes, by race/ethnicity Behavioral Risk Factor Surveillance System, United States, 2017–2019. Morb. Mortal. Wkly. Rep. 2021;70:149–154. doi: 10.15585/mmwr.mm7005a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Sanchez T.H., Zlotorzynska M., Rai M., Baral S.D. Characterizing the impact of COVID-19 on men who have sex with men across the United States in April, 2020. AIDS Behav. 2020;24:2024–2032. doi: 10.1007/s10461-020-02894-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Geldsetzer P. Use of Rapid Online Surveys to Assess People’s Perceptions During Infectious Disease Outbreaks: A Cross-sectional Survey on COVID-19. J. Med. Internet Res. 2020 doi: 10.2196/18790. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Ramo D.E., Rodriguez T.M., Chavez K., Sommer M.J., Prochaska J.J. Facebook recruitment of young adult smokers for a cessation trial: Methods, metrics, and lessons learned. Internet Interv. 2014;1:58–64. doi: 10.1016/j.invent.2014.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Bobkowski P., Smith J. Social media divide: Characteristics of emerging adults who do not use social network websites. Media Cult. Soc. 2013;35:771–781. doi: 10.1177/0163443713491517. [DOI] [Google Scholar]
- 38.Ministry of the Interior (2020) Statistics on education levels in Taiwan. [(accessed on 30 March 2021)]; Available online: https://statis.moi.gov.tw/micst/stmain.jsp?sys=100 and https://ws.moi.gov.tw/001/Upload/400/relfile/0/4405/64f11c2d-a315-4452-a852-5fb3f3f83b64/year/year.html.
- 39.Liao Q., Cowling B.J., Lam W.W., Ng D.M. Fielding, R. Anxiety, worry and cognitive risk estimate in relation to protective behaviors during the 2009 influenza A/H1N1 pandemic in Hong Kong: Ten cross-sectional surveys. BMC Infect. Dis. 2014;14:169. doi: 10.1186/1471-2334-14-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Glanz K., Rimer B.K., Viswanath K. Health Behavior: Theory, Research, and Practice. John Wiley & Sons; San Francisco, CA, USA: 2015. [Google Scholar]
- 41.Standard questionnaire on risk perception of an infectious. [(accessed on 18 October 2020)]; Available online: http://ecomeu.info/wp-content/uploads/2015/11/Standard-questionnaire-risk-perception-ECOM-november-2015.pdf.
- 42.Spielberger C.D., Gorsuch R.L., Lushene R.E. State-Trait. Anxiety Inventory: STAI. Consulting Psychologists Press; Palo Alto, CA, USA: 1970. [Google Scholar]
- 43.Leung G.M., Ho L.-M., Chan S.K.K., Ho S.-Y., Bacon-Shone J., Choy R.Y.L., Hedley A.J., Lam T.-H., Fielding R. Longitudinal Assessment of Community Psychobehavioral Responses During and After the 2003 Outbreak of Severe Acute Respiratory Syndrome in Hong Kong. Clin. Infect. Dis. 2005;40:1713–1720. doi: 10.1086/429923. [DOI] [PubMed] [Google Scholar]
- 44.Senaviratna N.A.M.R., Cooray T.M.J. Diagnosing Multicollinearity of Logistic Regression Model. Asian J. Probab. Stat. 2019;5:1–9. doi: 10.9734/ajpas/2019/v5i230132. [DOI] [Google Scholar]
- 45.Andrews R., Morgan J.D., Addy D.P., McNeish A.S. Understanding non-attendance in outpatient paediatric clinics. Arch. Dis. Child. 1990;65:192–195. doi: 10.1136/adc.65.2.192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Macharia W.M. An overview of interventions to improve compliance with appointment keeping for medical services. J. Am. Med. Assoc. 1992;267:1813–1817. doi: 10.1001/jama.1992.03480130129038. [DOI] [PubMed] [Google Scholar]
- 47.Mirotznik J., Ginzler E., Zagon G., Baptiste A. Using the health belief model to explain clinic appointment-keeping for the management of a chronic disease condition. J. Community Health. 1998;23:195–210. doi: 10.1023/A:1018768431574. [DOI] [PubMed] [Google Scholar]
- 48.Lau J.T.F. Monitoring community responses to the SARS epidemic in Hong Kong: From day 10 to day 62. J. Epidemiol. Community Health. 2003;57:864–870. doi: 10.1136/jech.57.11.864. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Statista. Number of novel coronavirus COVID-19 cumulative confirmed, recovered and death cases in Taiwan from January 22, 2020 to March 29, 2021. [(accessed on 30 March 2021)]; Available online: https://www.statista.com/statistics/1108537/taiwan-novel-coronavirus-covid19-confirmed-death-recovered-trend/
- 50.Sim M. Psychological trauma of Middle East Respiratory Syndrome victims and bereaved families. Epidemiol. Health. 2016;38 doi: 10.4178/epih.e2016054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Bulck J.V.D., Custers K. Television exposure is related to fear of avian flu, an Ecological Study across 23 member states of the European Union. Eur. J. Public Health. 2009;19:370–374. doi: 10.1093/eurpub/ckp061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kwok K.O., Li K.K., Chan H.H.H., Yi Y.Y., Tang A., Wei W.I., Wong S.Y.S. Community Responses during Early Phase of COVID-19 Epidemic, Hong Kong. Emerg. Infect. Dis. 2020;26:1575–1579. doi: 10.3201/eid2607.200500. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Wheaton M.G., Abramowitz J.S., Berman N.C. Fabricant LE, Olatunji BO. Psychological Predictors of Anxiety in Response to the H1N1 (Swine Flu) Pandemic. Cogn. Ther. Res. 2011;36:210–218. doi: 10.1007/s10608-011-9353-3. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data will be available upon reasonable request to the corresponding authors.