Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Oct 8;16(10):e0258452. doi: 10.1371/journal.pone.0258452

Disparities in telemedicine utilization among surgical patients during COVID-19

Courtney M Lattimore 1, William J Kane 1, Mark A Fleming II 1, Allison N Martin 2, J Hunter Mehaffey 1, Mark E Smolkin 3, Sarah J Ratcliffe 3, Victor M Zaydfudim 1, Shayna L Showalter 1, Traci L Hedrick 1,*
Editor: Jingjing Qian4
PMCID: PMC8500431  PMID: 34624059

Abstract

Background

Telemedicine has been rapidly adopted in the wake of the COVID-19 pandemic. There is limited work surrounding demographic and socioeconomic disparities that may exist in telemedicine utilization. This study aimed to examine demographic and socioeconomic differences in surgical patient telemedicine usage during the COVID-19 pandemic.

Methods

Department of Surgery outpatients seen from July 1, 2019 to May 31, 2020 were stratified into three visit groups: pre-COVID-19 in-person, COVID-19 in-person, or COVID-19 telemedicine. Generalized linear models were used to examine associations of sex, race/ethnicity, Distressed Communities Index (DCI) scores, MyChart activation, and insurance status with telemedicine usage during the COVID-19 pandemic.

Results

14,792 patients (median age 60, female [57.0%], non-Hispanic White [76.4%]) contributed to 21,980 visits. Compared to visits before the pandemic, telemedicine visits during COVID-19 were more likely to be with patients from the least socioeconomically distressed communities (OR, 1.31; 95% CI, 1.08,1.58; P = 0.005), with an activated MyChart (OR, 1.38; 95% CI, 1.17–1.64; P < .001), and with non-government or commercial insurance (OR, 2.33; 95% CI, 1.84–2.94; P < .001). Adjusted comparison of telemedicine visits to in person visits during COVID-19 revealed telemedicine users were more likely to be female (OR, 1.38, 95% CI, 1.10–1.73; P = 0.005) and pay with non-government or commercial insurance (OR, 2.77; 95% CI, 1.85–4.16; P < .001).

Conclusions

During the first three months of the COVID-19 pandemic, telemedicine was more likely utilized by female patients and those without government or commercial insurance compared to patients who used in-person visits. Interventions using telemedicine to improve health care access might consider such differences in utilization.

Introduction

The COVID-19 pandemic swiftly upended life as we know it with the decline in social, economic, mental, and physical wellbeing which was felt around the world. As hospitals braced for overwhelming COVID-19 patient admissions while ensuring an adequate supply of personal protective equipment (PPE), health systems were tasked with finding a way to safely triage, evaluate, and treat patients in accordance with national COVID-19 safety guidelines. Telemedicine, a previously underutilized virtual platform in which patients and providers are able to communicate via telephone or videoconference, became essential; offering a safe and convenient alternative care delivery platform amidst the pandemic [1, 2]. As much as a 50–300 fold increase in the number of patients evaluated by telemedicine during the pandemic has been observed [3, 4]. At least 50% of physicians have transitioned to incorporating telemedicine into their practice, most of which have never used this platform previously [1, 2, 4].

This rapid change in healthcare delivery has raised concerns regarding which patients can access healthcare under conditions of a major public health crisis. Unsurprisingly, the COVID-19 pandemic has further exposed healthcare disparities that exist in the United States [57]. Studies of COVID-19 have shown that Black and Hispanic communities are disproportionately impacted by the virus [5, 6, 8, 9], and are more likely to contract COVID-19, become hospitalized, and die [8, 9]. Patients who are elderly, of low socioeconomic status, and suffer from pre-existing health conditions are also at particularly increased risk [5, 7, 8]. These vulnerable populations could greatly benefit from access to quality care in the form of telemedicine.

Telemedicine is a convenient form of communication and improves access to care for those with the required technology, but can exacerbate disparities in those who do not. Video visits are the exclusive form of telecommunication in some practices because they not only offer a visual evaluation of the patient that is otherwise lost over the phone, but also reimburse at a higher rate [10]. However, video platforms require a stable internet connection, updated electronics with video capabilities, and proficient digital literacy [4, 10]—resources that may be inadequate for rural, minority, elderly, non-English-speaking, and low socioeconomic patients [7, 10]. Clinician factors such as poor cultural competency and discomfort with technology can also make telemedicine particularly difficult for these populations [4, 7, 11]. Moreover, minority and low socioeconomic status populations are historically more distrustful of the healthcare system due to under investigated mechanisms of systemic racism, which can be exacerbated in a major public health crisis [12, 13]. These populations, which are already less likely to seek medical care in traditional ways, may be even less likely to choose and trust telemedicine, a more novel avenue of receiving care [14].

Investigation and understanding of access, barriers, and disparities in telemedicine utilization during the COVID-19 pandemic is essential to providing equitable heath care and the future implementation of telemedicine into medical practice. We sought to answer whether the rapid adoption of telemedicine has created additional disparities in access to health care for surgical patients in vulnerable, at-risk populations. We hypothesized that during the COVID-19 pandemic, telemedicine in a surgical population was disproportionately used based on race, sex, and socioeconomic status.

Methods

Study population

All billable Department of Surgery outpatient office and telemedicine encounters at a single academic tertiary care center from July 1, 2019 to May 31, 2020 were included in the study, which included new patient visits and follow up visits. Non-billable postoperative visits during the global period were not included within this particular database. On March 17, 2020, institutional leadership mandated rescheduling of all non-urgent outpatient visits, signaling the beginning of the COVID-19 pandemic in our community. All encounters in this study were divided into one of three groups: visits from July 1, 2019 to March 17, 2020 (Pre-COVID-19), in-person visits on or after March 17, 2020 (COVID-19 in-person), or telemedicine visits on or after March 17, 2020 (COVID-19 telemedicine).

Study variables

Encounter data were extracted from prospectively maintained institutional databases. Specific variables captured for each visit included patient age, sex, race/ethnicity as defined by the National Institute of Health (non-Hispanic White, non-Hispanic Black, Hispanic, and Other/Unknown) [15], language preference, visit payer (e.g., Medicare, Medicaid, private insurer, and Other: self-pay, financial assistance, other means). MyChart activation status, home ZIP code, and subspecialty, which was based on the clinician/clinic the patient was evaluated. MyChart is an internet or smartphone application-based portal for patients to access their medical record and communicate with clinicians. MyChart was the method of choice for contacting patients regarding their telemedicine visit and granting access to a third-party video platform. For telemedicine visits, the mode of communication—i.e., video or telephone—was also extracted from an institutional database or, when unknown, obtained from review of the electronic medical record.

Patient home ZIP code was used to calculate two additional variables: driving distance to the main hospital clinic and the patient’s Distressed Communities Index (DCI) score. DCI is a composite measure of community-level socioeconomic distress ranging from 0 (least distress) to 100 (most distress) and has been well-documented in the surgical literature [9, 16]. Patient DCI scores were grouped based on nationally determined quintiles (i.e. distressed, at risk, mid-tier, comfortable, or prosperous) consistent with prior literature [9, 16] and then further categorized as lower-tier (distressed and at risk), mid-tier (mid-tier), and top-tier (comfortable and prosperous).

Time period of patient visits were divided into five groups based on two-week intervals: March 17th-31st, April 1st-15th, April 16th-30th, May 1st-15th, and May 16th-31st.

Statistical analysis

Summary statistics for the entire patient cohort as well as for each encounter group (i.e., Pre-COVID-19, COVID-19 in-person, or COVID-19 telemedicine) were calculated and are reported as frequencies with percentages or medians with interquartile ranges as appropriate. Demographics at the patient level are reported to highlight static characteristics (e.g. age, sex, race/ethnicity, driving distance, DCI score, language preference), while other characteristics that are subject to change are provided at the visit-level (e.g. provider subspecialty and MyChart activation status). Missing data was present for DCI score/group and driving distance, however represented < 5% of all patient-visits. Thus, a complete-case analysis was conducted.

The primary objective of this study was to identify patient and surgery clinic characteristics associated with completion of a telemedicine visit during COVID-19 compared to visits before COVID-19. Generalized estimating equations (GEEs) with a logit link and a robust, unstructured correlation structure were used to test for differences between groups. GEEs were chosen to produce population-level estimates, allowing for marginal odds ratios and predicted probabilities to be calculated, while adjusting for patients with more than one visit. Additionally, secondary objectives used similar methods to identify factors associated with completion of an in-person visit during COVID-19 compared to visits before COVID-19, as well as factors associated with completion of a telemedicine visit during COVID-19 compared to in-person visits during COVID-19. This latter comparison also adjusted for calendar time.

Due to concerns about modeling the age variable and the pediatric surgery category together, a sensitivity analysis that excluded pediatric patients was performed, yielding no appreciable differences in the model estimates.

A two-sided P < 0.05 was considered significant, with the results of secondary analyses considered exploratory. SAS version 9.4 (SAS Institute Inc.) was used to conduct all analyses. The University of Virginia Institutional Review Board (IRB) for Health Sciences Research reviewed and approved this study (IRB# 22462) and deemed it as meeting exempt determination. The IRB determined this to be secondary research in which informed consent is not required. Identifiable private information was collected, secured on an approved server, and deidentified for study analysis.

Results

The study cohort included 14,792 patients contributing to 21,980 visits. A majority of the patients were female (57.0%) and non-Hispanic White (76.4%) with a median age of 60 years. The other race/ethnicities represented were non-Hispanic Black (14.6%), Hispanic (3.7%), and Other/Unknown (5.3%). Seventy-two percent of patients had just one visit during the study period while 18% had two visits and 10% had three or more visits.

Of the 21,980 visits, 19,407 (88.3%) were in-person and took place before COVID-19, 1,809 (8.2%) were in-person during COVID-19, and 764 (3.5%) were conducted via telemedicine during COVID-19 (Table 1). Telemedicine visits were primarily conducted via videoconference (67.5%). Substantial changes in the proportions of visits provided by each subspecialty were seen between visits before COVID, in-person visits during COVID, and telemedicine visits during COVID.

Table 1. Patient characteristics by visit typea.

Characteristic All Visits
N = 21,980
Pre-COVID-19 In-Person
N = 19,407
COVID-19 In-Person
N = 1,809
COVID-19 Telemedicine
N = 764
Age, y, median (IQR) 60.0 (46.0–70.0) 60.0 (46.0–70.0) 59.0 (45.0–68.0) 60.0 (48.0–69.0)
Sex
 Female 12,644 (57.5%) 11,202 (57.7%) 980 (54.2%) 462 (60.5%)
 Male 9,336 (42.5%) 8,205 (42.3%) 829 (45.8%) 302 (39.5%)
Race/Ethnicity
 Non-Hispanic White 16,557 (75.3%) 14,663 (75.6%) 1,331 (73.6%) 563 (73.7%)
 Non-Hispanic Black 3,520 (16.0%) 3,091 (15.9%) 291 (16.1%) 138 (18.1%)
 Hispanic 823 (3.7%) 731 (3.8%) 75 (4.1%) 17 (2.2%)
 Other/Unknown 1,080 (4.9%) 922 (4.8%) 112 (6.2%) 46 (6.0%)
English language preferred 21,268 (96.8%) 18,774 (96.7%) 1,747 (96.6%) 747 (97.8%)
Payer
 Medicaid 29,49 (13.4%) 2,615 (13.5%) 254 (14.0%) 80 (10.5%)
 Medicare 9,395 (42.7%) 8,359 (43.1%) 745 (41.2%) 291 (38.1%)
 Private 7,827 (35.6%) 6,911 (35.6%) 664 (36.7%) 252 (33.0%)
 Other 1,809 (8.2%) 1,522 (7.8%) 146 (8.1%) 141 (18.5%)
DCI Score, median (IQR)b 52.2 (29.5–69.9) 52.2 (29.6–69.9) 52.2 (27.2–69.9) 48.7 (27.2–69.0)
DCI Groupb
 Top-tier 8,123 (37.8%) 7,134 (37.6%) 673 (38.1%) 316 (42.2%)
 Mid-tier 5,449 (25.3%) 4,813 (25.3%) 445 (25.2%) 191 (25.5%)
 Lower-tier 79,31 (36.9%) 7,041 (37.1%) 648 (36.7%) 242 (32.3%)
Distance to clinic, mi, median (IQR)c 52.3 (28.6–87.4) 52.3 (28.5–87.1) 52.3 (29.0–88.1) 56.3 (31.5–103.5)
MyChart Activated 12,093 (55.0%) 10,551 (54.4%) 1,073 (59.3%) 469 (61.4%)
Communication Type
 Video 516 (67.5%)
 Phone 245 (32.1%)
 Unknown 3 (0.4%)
Specialty
 Breast 3562 (16.2%) 3163 (16.3%) 251 (13.9%) 148 (19.4%)
 Colorectal 1930 (8.8%) 1757 (9.1%) 129 (7.1%) 44 (5.8%)
 Cardiothoracic 2815 (12.8%) 2493 (12.8%) 206 (11.4%) 116 (15.2%)
 General 1220 (5.6%) 1086 (5.6%) 90 (5.0%) 44 (5.8%)
 MIS/Bariatric 2936 (13.4%) 2646 (13.6%) 232 (12.8%) 58 (7.6%)
 Oncology 2289 (10.4%) 1961 (10.1%) 229 (12.7%) 99 (13.0%)
 Pediatric 1162 (5.3%) 1048 (5.4%) 100 (5.5%) 14 (1.8%)
 Transplant 2830 (12.9%) 2321 (12.0%) 313 (17.3%) 196 (25.7%)
 Vascular 3236 (14.7%) 2932 (15.1%) 259 (14.3%) 45 (5.9%)

a Patients with multiple visits will appear more than once in this table, thus inflating their characteristics.

b DCI score/group only available on n = 21,503 visits.

c Distance only available on n = 21,062 visits.

DCI = distressed communities index, MIS = minimally invasive surgery.

Adjusted analysis, accounting for all of the variables in the model, compared telemedicine visits during COVID-19 to visits before COVID-19 and found that telemedicine visits were more likely used by patients with an activated MyChart status (OR, 1.38; 95% CI, 1.17–1.64; P < .001) and who were expected to self-pay, utilize financial assistance, or pay with other means for their visit, compared to those covered by Medicare (OR, 2.33; 95% CI, 1.84–2.94; P < .001) (Table 2). Further, patients residing in a top-tier community, as compared to a low-tier community, were more likely to utilize a telemedicine visit (OR, 1.31; 95% CI, 1.08,1.58; P = 0.005). Finally, surgical subspecialty was strongly associated with use of telemedicine during COVID, with significant variability across subspecialties (Fig 1). For example, patients evaluated in the Transplant Surgery clinic had a 6.9% chance of undergoing a telemedicine visit in the COVID period, while patients seen in Pediatric Surgery had only a 1.4% chance of having a telemedicine visit. A sensitivity analysis excluding pediatric patients showed no appreciable differences in the estimates obtained for this primary comparison (S1S3 Tables).

Table 2. Patient characteristics associated with a telemedicine visit during COVID-19, compared to pre-COVID in-person visits.

Variable Odds Ratio 95% Confidence Limits
Age, y 1.00 0.99 1.01
Female 1.17 0.99 1.40
Race/Ethnicity
 Non-hispanic White 1 [Ref]
 Non-hispanic Black 1.11 0.89 1.38
 Hispanic 0.65 0.36 1.18
 Other/Unknown 1.37 0.97 1.94
English language preferred 1.76 0.96 3.23
Payer
 Medicare 1 [Ref]
 Medicaid 1.16 0.84 1.60
 Private 1.01 0.81 1.25
 Other 2.33 1.84 2.94
DCI Group
 Top-tier 1 [Ref]
 Mid-tier 0.95 0.77 1.16
 Lower-tier 0.77 0.63 0.92
log(Distance, mi) 1.01 0.92 1.12
MyChart Activated 1.38 1.17 1.64
Specialty
 Breast 1.10 0.75 1.60
 Colorectal 0.66 0.42 1.02
 Cardiothoracic 1.23 0.85 1.80
 General 1 [Ref]
 MIS/Bariatric 0.56 0.37 0.86
 Oncology 1.38 0.93 2.04
 Pediatric 0.36 0.18 0.72
 Transplant 1.85 1.27 2.68
 Vascular 0.39 0.24 0.61

DCI = distressed communities index, MIS = minimally invasive surgery

Fig 1. Probability of telemedicine visit during COVID-19 by surgical subspecialty.

Fig 1

Marginal probability of a telemedicine visit during COVID-19, compared to visits before COVID-19, by surgical subspecialty.

Exploratory analysis of in-person visits during COVID-19, compared to in-person visits before COVID-19, showed that patients who underwent a visit during COVID-19 were more likely to be of younger age (OR, 1.00; 95% CI, 0.99–1.00; P = 0.043), have activated MyChart (OR, 1.29; 95% CI, 1.14–1.45; P < .001), and less likely to self-pay, utilize financial assistance, or pay with other means for their visit, compared to those covered by Medicare (OR, 0.75; 95% CI, 0.57–0.98; P = 0.038) (Table 3). Similarly, exploratory analysis of only visits during COVID-19 showed that patients who underwent a telemedicine visit, compared to those who underwent an in-person visit, were more likely to be female (OR, 1.38, 95% CI, 1.10–1.73; P = 0.005) and pay for their visit with other, non-government or commercial insurance means (OR, 2.77; 95% CI, 1.85–4.16; P < .001) (Table 4).

Table 3. Patient characteristics associated with an in-person visit during COVID-19, compared to in-person visits before COVID-19.

Variable Odds Ratio 95% Confidence Limits
Age, y 1.00 0.99 1.00
Female 0.92 0.81 1.04
Race/Ethnicity
 Non-hispanic White 1 [Ref]
 Non-hispanic Black 0.99 0.84 1.17
 Hispanic 1.27 0.88 1.84
 Other/Unknown 1.41 1.11 1.80
English language preferred 0.96 0.65 1.42
Payer
 Medicare 1 [Ref]
 Medicaid 0.98 0.80 1.22
 Private 0.92 0.79 1.08
 Other 0.75 0.57 0.98
DCI Group
 Top-tier 1 [Ref]
 Mid-tier 1.02 0.88 1.18
 Lower-tier 1.01 0.88 1.16
log(Distance, mi) 0.97 0.90 1.04
MyChart Activated 1.29 1.14 1.45
Specialty
 Breast 0.93 0.70 1.23
 Colorectal 0.80 0.59 1.09
 Cardiothoracic 1.02 0.77 1.35
 General 1 [Ref]
 MIS/Bariatric 1.14 0.87 1.50
 Oncology 1.44 1.09 1.89
 Pediatric 0.93 0.64 1.35
 Transplant 1.72 1.28 2.32
 Vascular 0.96 0.73 1.27

DCI = distressed communities index, MIS = minimally invasive surgery

Table 4. Patient characteristics associated with a telemedicine visit during COVID-19, compared to an in-person visit during COVID-19.

Variable Odds Ratio 95% Confidence Limits
Age, y 1.01 1.00 1.02
Female 1.38 1.10 1.73
Race/Ethnicity
 Non-hispanic White 1 [Ref]
 Non-hispanic Black 1.16 0.88 1.54
 Hispanic 0.40 0.15 1.04
 Other/Unknown 0.99 0.64 1.53
English language preferred 1.22 0.48 3.10
Payer
 Medicare 1 [Ref]
 Medicaid 1.07 0.73 1.56
 Private 1.08 0.82 1.42
 Other 2.77 1.85 4.16
DCI Group
 Top-tier 1 [Ref]
 Mid-tier 0.93 0.72 1.20
 Lower-tier 0.80 0.63 1.02
log(Distance, mi) 1.06 0.93 1.21
MyChart Activated 1.15 0.93 1.42
Specialty
 Breast 1.26 0.79 2.01
 Colorectal 0.90 0.52 1.55
 Cardiothoracic 1.62 0.99 2.65
 General 1 [Ref]
 MIS/Bariatric 0.64 0.39 1.04
 Oncology 0.96 0.60 1.54
 Pediatric 0.52 0.23 1.18
 Transplant 1.22 0.76 1.97
 Vascular 0.40 0.23 0.71
Time period
 March 17–31, 2020 0.08 0.04 0.17
 April 1–15, 2020 3.13 2.33 4.22
 April 16–30, 2020 4.28 3.27 5.61
 May 1–15, 2020 2.18 1.69 2.81
 May 16–31, 2020 1 [Ref]

DCI = distressed communities index, MIS = minimally invasive surgery.

Discussion

The COVID-19 pandemic has highlighted the stark disparities that exist in marginalized communities [5, 7, 17]. There are numerous studies examining these inequities and some more recent studies investigating these in the context of telemedicine amidst the pandemic [18, 19]. However, the present study examined the adoption of telemedicine across a large general surgery population at a tertiary center during the COVID-19 pandemic, and more importantly, the characteristics of the patient population most likely to use telemedicine. Overall, telemedicine was more likely utilized by those without government or commercial insurance and women.

The finding that female patients were more likely to use telemedicine versus in-person visits is consistent with other published literature on telemedicine use both prior to and during the pandemic [2, 2022]. A recent cross-sectional study of 1.1 million patients found that men were significantly less likely to choose both a video and phone visit [22]. Similarly, a survey study determining preference and perceptions of telemedicine in an outpatient clinic setting also found predictors of liking telemedicine to be skewed towards female patients [20]. The pandemic has exacerbated responsibilities for women tasked with balancing career, childcare, and other caregiving/household family needs [20, 23], which could also be driving the higher rates of telemedicine use among women during this time.

In this study, there was a significant disparity in telemedicine use between patients who reside in communities of low compared to high socioeconomic distress. Those from the most distressed communities were significantly less likely to use telemedicine visits during COVID-19 compared to pre-COVID in-person visits. Several studies have identified factors that support this finding. In a recent survey study, patients with a household income of ≥ $50,000 were 34% more likely to choose a telemedicine visit than those making < $50,000 [24]. Additionally, although mobile devices are used by patients of all socioeconomic statuses, devices without video capability and lack of access to a stable internet connection can be a major barrier in low-income populations and may explain the preference for in-person and telephone visits over video [7, 22]. Patients of low socioeconomic backgrounds are less likely to have general digital literacy, access to broadband internet, and own a smartphone [4]. Furthermore, patients who live in areas with higher residential internet access have been found to be more likely to choose telemedicine [22]. The present study further emphasizes the importance of community environment and socioeconomic status in access to telemedicine.

Recognizing the disparities that exist across the country in broadband internet access, the Federal Communications Commission (FCC) has made a push over the past few years to invest in infrastructure to provide access to vulnerable communities [25]. Although access has improved, it remains inadequate and highly variable in quality depending on location [25]. In Virginia, highly dense areas such as Northern Virginia benefit from investment of private companies in broadband coverage while less dense, rural areas are left uncovered [26]. There are at least 660,000 households and businesses without any broadband access and even more with inadequate or inaccessible coverage [26]. During the pandemic, several states, including Virginia, used the Coronavirus Relief Fund (CRF), as part of the Coronavirus Aid, Relief, and Economic Security (CARES) Act, to emergently provide broadband access to their communities as distanced work, education, and healthcare became a necessity [27, 28]. Unfortunately, this is not a permanent fixture [27] and if we want to strive towards equitable telemedicine access in the future, advocating for policy change will be essential.

Access to the internet has also been shown to be associated with MyChart activation [29], corroborating the result of this study that MyChart activation was associated with a 40% greater likelihood to have a telemedicine visit during COVID-19 compared to an in-person visit before COVID-19. Video visits at our institution were through a third-party web-based platform. Patients were often, if not exclusively, contacted through MyChart and given a link to an individual surgeon’s online portal. Studies examining demographics of MyChart usage have found that lower income patients are significantly less likely to have activated MyChart accounts [29], suggesting that MyChart use is not only reflective of comfort with technology but also socioeconomic status. In addition, patients who paid for their visit with other means—through self-pay, financial assistance, or another mechanism besides government-sponsored or commercial insurance—were over two times as likely to have a telemedicine visit compared to patients with Medicare. This finding is supported by previous work that found patients with higher copayments and out of pocket costs were more likely to choose a telemedicine visit [22, 24]. Together, the association between greater self-payment and greater telemedicine use may be reflective of greater urgency among patients in seeing a physician, through any means available. Additional research is needed to clarify the reasons behind this paradoxical association.

While associations between socioeconomic status and technological proficiency have been examined in healthcare access, the associations of race/ethnicity with technology remain less clear [22, 24]. Previous work has found that Black patients are significantly less likely to undertake videoconference visits than patients of other races [24]. In contrast, another study found that Black patients were more willing than patients of other races to choose both video and phone visits [22]. The present study, though potentially underpowered, found no difference in telemedicine visits during COVID-19 when stratified by race; this held true when compared to both in-person visits before and during COVID-19. It is likely that social determinants of health, including those not fully captured in this study, drive racial disparities in telemedicine utilization. Visit payor, DCI group, and MyChart status were used as surrogates for patient socioeconomic status and comfort with technology, but these imperfect measures may not adequately reflect differences in access. Although this study did not elucidate differences by race in ability to access telemedicine, it is well known that inequities in access to care are ever-present within the US healthcare system; telemedicine is unlikely to be an exception. Most of the previously mentioned initiatives and funds to improve broadband access by the FCC have been in rural communities, disproportionately benefiting non-Hispanic White Americans [30]. There has been a substantial lack of funding in inner cities, where the majority of communities of color live, despite urban households being three times more likely to not have broadband access than rural households [30]. Qualifications for federal funding exclude nearly all urban centers because they have the infrastructure, but do not take into account accessibility of the people who live there [30]. Given that the population in this study was disproportionately non-Hispanic White and rural, it is quite likely there is a racial divide in telemedicine access nationally that was not captured in this study.

Within this academic surgical department, there was substantial variability in telemedicine utilization by surgical subspecialty. While differing levels of visit urgency may exist between subspecialties, exemplified by the greatest telemedicine uptake among transplant and oncology patients compared to pre-COVID-19 in-person visits, it is likely that surgeon and clinic-dependent factors played a role in the ability to offer telemedicine to patients. Indeed, physician comfort with technology, the ability to make patients aware of telemedicine as an option, and patients being able to see a physician with whom they have established a relationship have been associated with increased telemedicine usage [24, 31, 32]. Though beyond the scope of this study, hospital and physician characteristics appear to have a prominent effect on differences in patient telemedicine adoption.

Telemedicine can be an alternative to the traditional in-patient visit, but this study found that it may not be utilized by the most vulnerable populations. Men and patients of low socioeconomic status, potentially with less access to technology, appear to be disproportionately affected. Given the delays in patient care during the pandemic, these findings are concerning and suggest that some patients may further delay care due to issues or apprehension with telemedicine [8]. Considering many in these populations are already at greater risk of chronic disease, disproportionately affected by the COVID-19 pandemic, and generally have less access to healthcare, it is problematic that telemedicine is possibly another factor contributing to this entanglement of inequality [5, 6, 17]. Strategies for increasing telemedicine use among these at-risk populations are needed. When telemedicine is consistently used and tailored to patient needs to ensure a successful visit, patients, especially minorities and underserved populations, can benefit [14, 33].

This study has several limitations. Although a wide array of surgical patients were included, the single-center scope restricts generalizability. It is possible that other departments or hospital systems with different patient demographics may exhibit different associations between patient factors and telemedicine utilization. Additionally, we are unable to separate visit types into initial visits versus follow up visits within the current database (non-billable postoperative visits during the global period were not included). Although we would expect similar trends in patient factors across all visit types, it is quite possible that patients attending visits for new appointments and subsequent follow ups are distinctly different, thus confounding the study results. Furthermore, conducting this study during an unprecedented global pandemic may limit the applicability of the findings outside of this context. Further, our data is limited to the initial three months of the pandemic when telemedicine was first implemented and non-urgent in-person visits were rescheduled. These findings may not translate to other timepoints as the pandemic continued. Patient-reported reasoning behind choosing or not choosing telemedicine is an important factor in determining why certain groups of patients have less telemedicine utilization [17, 20, 24, 32]. This study was unable to capture attitudes and perceptions of patients, which if understood, could help further understand disparities in telemedicine access. Finally, patient-reported comfort with technology and digital literacy, instead of proxy measures such as MyChart activation status, may provide a more accurate assessment of this factor [24, 29].

Conclusion

The COVID-19 pandemic has shown that telemedicine will likely become increasingly necessary to provide safe healthcare. Although it has potential to close the gap in patient access to care, this study found that patient factors influence telemedicine utilization. We cannot rely on telemedicine in its current state to be a solution to equitable access, as it can exacerbate existing disparities for patients from lower resourced communities. Further investigation into underlying barriers to telemedicine access and conscious efforts to mitigate them are required to achieve equity in telemedicine access.

Supporting information

S1 Table. Sensitivity analysis excluding pediatric surgery patients of patient characteristics associated with a telemedicine visit during COVID-19, compared to pre-COVID in-person visits.

(DOCX)

S2 Table. Sensitivity analysis excluding pediatric surgery patients of patient characteristics associated with an in-person visit during COVID-19, compared to in-person visits before COVID-19.

(DOCX)

S3 Table. Sensitivity analysis excluding pediatric surgery patient characteristics associated with a telemedicine visit during COVID-19, compared to an in-person visit COVID-19.

(DOCX)

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

Research reported in this article was supported by award T32CA163177 (CML and WJK) from the National Institutes of Health, the University of Virginia Department of Surgery. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Survey: Physician Practice Patterns Changing As A Result Of COVID-19 [Internet]. Meritt Hawkins; April 2020. https://www.merritthawkins.com/news-and-insights/media-room/press/-Physician-Practice-Patterns-Changing-as-a-Result-of-COVID-19/
  • 2.Siow MY, Walker JT, Britt E, Kozy JP, Zanzucchi A, Girard PJ, et al. What Was the Change in Telehealth Usage and Proportion of No-show Visits for an Orthopaedic Trauma Clinic During the COVID-19 Pandemic? Clin Orthop Relat Res. 2020. Epub 2020/07/03. doi: 10.1097/CORR.0000000000001396 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Fox B, Sizemore JO. Telehealth: Fad or the Future: Epic Health Research Network; 2020 [updated August 18, 2020]. https://ehrn.org/articles/telehealth-fad-or-the-future.
  • 4.Nouri S, Khoong EC, Lyles CR, Karliner L. Addressing Equity in Telemedicine for Chronic Disease Management During the Covid-19 Pandemic. N Engl J Med Catalyst 2020. Epub May 4, 2020. [Google Scholar]
  • 5.Millett GA, Jones AT, Benkeser D, Baral S, Mercer L, Beyrer C, et al. Assessing Differential Impacts of COVID-19 on Black Communities. Ann Epidemiol. 2020;47:37–44. Epub 2020/05/14. doi: 10.1016/j.annepidem.2020.05.003 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Moore JT, Ricaldi JN, Rose CE, Fuld J, Parise M, Kang GJ, et al. Disparities in Incidence of COVID-19 Among Underrepresented Racial/Ethnic Groups in Counties Identified as Hotspots During June 5–18, 2020–22 States, February-June 2020. MMWR Morb Mortal Wkly Rep. 2020;69(33):1122–6. Epub 2020/08/21. doi: 10.15585/mmwr.mm6933e1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.COVID-19 FAQs: Health equity in a pandemic2020 August 29, 2020. https://www.ama-assn.org/delivering-care/health-equity/covid-19-faqs-health-equity-pandemic?gclid=Cj0KCQjwp4j6BRCRARIsAGq4yMGABkbTYEUjwH0CvznN2uFwZJY8ncE1otXU380B6T9OqmZZPengR6kaAld1EALw_wcB.
  • 8.Azar KMJ, Shen Z, Romanelli RJ, Lockhart SH, Smits K, Robinson S, et al. Disparities In Outcomes Among COVID-19 Patients In A Large Health Care System In California. Health Aff (Millwood). 2020;39(7):1253–62. Epub 2020/05/21. doi: 10.1377/hlthaff.2020.00598 . [DOI] [PubMed] [Google Scholar]
  • 9.Hawkins RB, Charles EJ, Mehaffey JH. Socio-economic status and COVID-19-related cases and fatalities. Public Health. 2020;189:129–34. Epub 2020/10/17. doi: 10.1016/j.puhe.2020.09.016 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Mehrotra A, Ray K, Brockmeyer DM, Barnett ML, Bender JA. Rapidly Converting to “Virtual Practices”: Outpatient Care in the Era of Covid-19. N Engl J Med Catalyst. 2020. Epub April 1, 2020. [Google Scholar]
  • 11.Jackson CS, Gracia JN. Addressing health and health-care disparities: the role of a diverse workforce and the social determinants of health. Public Health Rep. 2014;129 Suppl 2:57–61. doi: 10.1177/00333549141291S211 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Armstrong K, Putt M, Halbert CH, Grande D, Schwartz JS, Liao K, et al. Prior experiences of racial discrimination and racial differences in health care system distrust. Med Care. 2013;51(2):144–50. doi: 10.1097/MLR.0b013e31827310a1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Jeffery MM, D’Onofrio G, Paek H, Platts-Mills TF, Soares WE, Hoppe JA, et al. Trends in Emergency Department Visits and Hospital Admissions in Health Care Systems in 5 States in the First Months of the COVID-19 Pandemic in the US. JAMA Intern Med. 2020;180(10):1328–33. Epub 2020/08/03. doi: 10.1001/jamainternmed.2020.3288 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tong T, Myers AK, Bissoonauth AA, Pekmezaris R, Kozikowski A. Identifying the barriers and perceptions of non-Hispanic black and Hispanic/Latino persons with uncontrolled type 2 diabetes for participation in a home Telemonitoring feasibility study: a quantitative analysis of those who declined participation, withdrew or were non-adherent. Ethn Health. 2020;25(4):485–94. Epub 2019/01/15. doi: 10.1080/13557858.2019.1566520 . [DOI] [PubMed] [Google Scholar]
  • 15.Racial and Ethnic Categories and Definitions for NIH Diversity Programs and for Other Reporting Purposes [Internet]. National Institute of Health; April 8, 2015 https://grants.nih.gov/grants/guide/notice-files/NOT-OD-15-089.html
  • 16.Mehaffey JH, Hawkins RB, Charles EJ, Turrentine FE, Hallowell PT, Friel C, et al. Socioeconomic "Distressed Communities Index" Improves Surgical Risk-adjustment. Ann Surg. 2020;271(3):470–4. doi: 10.1097/SLA.0000000000002997 . [DOI] [PubMed] [Google Scholar]
  • 17.Graboyes E, Cramer J, Balakrishnan K, Cognetti DM, López-Cevallos D, de Almeida JR, et al. COVID-19 pandemic and health care disparities in head and neck cancer: Scanning the horizon. Head Neck. 2020;42(7):1555–9. Epub 2020/06/20. doi: 10.1002/hed.26345 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Darrat I, Tam S, Boulis M, Williams AM. Socioeconomic Disparities in Patient Use of Telehealth During the Coronavirus Disease 2019 Surge. JAMA Otolaryngol Head Neck Surg. 2021;147(3):287–95. Epub 2021/01/15. doi: 10.1001/jamaoto.2020.5161 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Jaffe DH, Lee L, Huynh S, Haskell TP. Health Inequalities in the Use of Telehealth in the United States in the Lens of COVID-19. Popul Health Manag. 2020;23(5):368–77. Epub 2020/08/21. doi: 10.1089/pop.2020.0186 . [DOI] [PubMed] [Google Scholar]
  • 20.Polinski JM, Barker T, Gagliano N, Sussman A, Brennan TA, Shrank WH. Patients’ Satisfaction with and Preference for Telehealth Visits. J Gen Intern Med. 2016;31(3):269–75. Epub 2015/08/13. doi: 10.1007/s11606-015-3489-x . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Ramirez AV, Ojeaga M, Espinoza V, Hensler B, Honrubia V. Telemedicine in Minority and Socioeconomically Disadvantaged Communities Amidst COVID-19 Pandemic. Otolaryngol Head Neck Surg. 2020:194599820947667. Epub 2020/07/28. doi: 10.1177/0194599820947667 . [DOI] [PubMed] [Google Scholar]
  • 22.Reed ME, Huang J, Graetz I, Lee C, Muelly E, Kennedy C, et al. Patient Characteristics Associated With Choosing a Telemedicine Visit vs Office Visit With the Same Primary Care Clinicians. JAMA Netw Open. 2020;3(6):e205873. Epub 2020/06/01. doi: 10.1001/jamanetworkopen.2020.5873 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Wenham C, Smith J, Davies SE, Feng H, Grepin KA, Harman S, et al. Women are most affected by pandemics—lessons from past outbreaks. Nature. 2020;583:194–202. doi: 10.1038/d41586-020-02006-z [DOI] [PubMed] [Google Scholar]
  • 24.Fischer SH, Ray KN, Mehrotra A, Bloom EL, Uscher-Pines L. Prevalence and Characteristics of Telehealth Utilization in the United States. JAMA Netw Open. 2020;3(10):e2022302. Epub 2020/10/01. doi: 10.1001/jamanetworkopen.2020.22302 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.New FCC Report Shows Digital Divide Continuing to Close [Internet]. Federal Communications Commission; April 24, 2020. https://docs.fcc.gov/public/attachments/DOC-363985A1.pdf
  • 26.Report on Commonwealth Connect: Governor Northam’s Plan to Connect Virginia. In: Trade OotSoCa, editor.: Commonwealth of Virginia; 2019.
  • 27.States Tap Federal CARES Act to Expand Broadband. The Pew Charitable Trusts.
  • 28.Broadband Funding Opportunities and UpdatesDecember 14, 2020. https://www.vaco.org/broadband-funding-opportunities-and-updates/.
  • 29.Wallace LS, Angier H, Huguet N, Gaudino JA, Krist A, Dearing M, et al. Patterns of Electronic Portal Use among Vulnerable Patients in a Nationwide Practice-based Research Network: From the OCHIN Practice-based Research Network (PBRN). J Am Board Fam Med. 2016;29(5):592–603. doi: 10.3122/jabfm.2016.05.160046 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Siefer A, Callahan B. Limiting Broadband Investment to "Rural Only” Discriminates Against Black Americans and other Communities of Color Columbus, OH: National Digital Inclusion Alliance; [updated June 2020December 9, 2020]. https://www.digitalinclusion.org/digital-divide-and-systemic-racism/.
  • 31.Barton PL, Brega AG, Devore PA, Mueller K, Paulich MJ, Floersch NR, et al. Specialist physicians’ knowledge and beliefs about telemedicine: a comparison of users and nonusers of the technology. Telemed J E Health. 2007;13(5):487–99. Epub 2007/11/15. doi: 10.1089/tmj.2006.0091 . [DOI] [PubMed] [Google Scholar]
  • 32.Welch BM, Harvey J, O’Connell NS, McElligott JT. Patient preferences for direct-to-consumer telemedicine services: a nationwide survey. BMC Health Serv Res. 2017;17(1):784. Epub 2017/11/28. doi: 10.1186/s12913-017-2744-8 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Shea S, Kothari D, Teresi JA, Kong J, Eimicke JP, Lantigua RA, et al. Social impact analysis of the effects of a telemedicine intervention to improve diabetes outcomes in an ethnically diverse, medically underserved population: findings from the IDEATel Study. Am J Public Health. 2013;103(10):1888–94. Epub 2013/03/14. doi: 10.2105/AJPH.2012.300909 . [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Jingjing Qian

5 Aug 2021

PONE-D-21-20375

Socioeconomic disparities in telemedicine utilization among surgical patients during COVID-19

PLOS ONE

Dear Dr. Lattimore,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 19 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jingjing Qian

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Additional Editor Comments:

Please carefully address reviewers' comments. In addition, please describe the sensitivity analysis and its rationale in the Methods section.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a timely manuscript on an important social issue emerging in telemedicine, an avenue of medicine which continues to be increasing utilized after the pandemic. The authors highlight important social disparities between those who utilized telemedicine during the pandemic versus those who continued with in-person visits. A large retrospective cohort of patients and patient encounters was utilized which is a large strength of the paper. The discussion is well-written and highlights several relevant, up-to-date articles.

There is a conclusion made which I do not believe is sound. Analysis showed that when comparing telemedicine visits during COVID to visits beforehand, those who used telemedicine were more likely to have activated MyChart (lines 163-165). However, when comparing in-person visits during COVID to visits beforehand, those who attended in-person visits were also more likely to have activated MyChart (lines 195-198). Thus regardless of visit type during pandemic (telemedicine vs in-person), the patient was more likely to have activated MyChart. Therefore the conclusion that those more comfortable with technology (using MyChart activation as a gauge) are disproportionately utilizing telemedicine, is false. The statistics need to be re-calculated, or the conclusion withdrawn, or my misunderstanding explained.

My largest critique of this manuscript is the failure to investigate or mention the reason for visit. A patient visit can be of several types - new patient visits, follow-up visits, and post-operative visits to name a few. While routine follow-up visits are easy to perform virtually, some aspects of new patient visits and post-operative visits such as conducting a physical examination, drawing blood, suture removal, dressing change, etc. all necessitate an in-person component. This is potentially massive confounding variable, especially as the manuscript is based entirely on a surgical patient population. For example, perhaps those from more privileged backgrounds were able to cancel their elective surgeries while those from more disadvantaged backgrounds continued with surgery and thus had more in person visits after the pandemic? Or are disadvantaged populations simply more affected from a health perspective by the pandemic (as you cite in your manuscript), requiring more urgent in-person visits? Reason for visit is a vital, possibly confounding variable that ideally be investigated but at minimum mentioned in the discussion.

Minor grammatical errors: line 132 "as well factors" to "as well as factors"; Abstract Methods: "My Chart" to "MyChart" to stay consistent with remainder of manuscript

Reviewer #2: This retrospective cohort study of 14,792 patients seen in an outpatient surgical setting between July 1 2019 to May 31, 2020 compared patient demographic, insurance, SES factors between in-person vs. telemedicine visits prior to and during the COVID-19 pandemic.

Major concerns:

There currently exist a large body of literature describing telehealth use in surgical practices during COVID-19. This paper would add much more insight into telehealth use as restrictions on clinical practice lifted to describe the its use in current contexts.

While institutional policy closed outpatient clinics on March 17th, there were likely changes in healthcare-seeking behavior even before this time as case numbers rose. Would consider another time frame (e.g. same time frame the year before) for a clearer comparison.

Increasingly, it seems that telemedicine in complementary to in-person visits in surgical practices. Type of visit, therefore, is extremely important. What types of visits were these? New patients? Post-op? Return/surveillance patients?

Minor concerns:

How were video visits offered? Using an institutional MyChart based platform? Or whatever communications platform available to the provider/patient (e.g. FaceTime, WhatsApp)? This would give insight into how meaningful MyChart enrollment might be.

Intro:

Line 69 – would change wording to reflect the fact the video visits are not only preferred due to reimbursement – physical examination is possible with video visits (albeit limited) and many non-verbal communication cues can be lost through telephone only assessment

Methods:

- Was “specialty” based on provider or diagnosis? While described in the discussion, would be helpful to be more explicit in the methods.

- Please specify exactly how calendar time was determined. It appears it was considered categorically based on Table 4, but what are the exact definitions?

Results:

- p-values are redundant and not required if presenting 95% CI

- Line 163 – what were these adjusted for? Do all tables represent adjusted odds ratios?

- Table 2 - Would consider using another specialty as a referent as general has one of the smaller n, resulting in increased potential error in OR

- Table 4 – would also give baseline characteristics of “time period” to understand this relationship better.

Discussion:

- Throughout, statements are made based on the results without discussing the comparand population, which can mislead the reader about the conclusions.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Oct 8;16(10):e0258452. doi: 10.1371/journal.pone.0258452.r002

Author response to Decision Letter 0


4 Sep 2021

The following responses with a brief letter are also included in the attached file "Response to Reviewers".

Editor Comments:

Please carefully address reviewers' comments. In addition, please describe the sensitivity analysis and its rationale in the Methods section.

• Response: The sensitivity analysis involved rerunning the models while excluding pediatric patients. Considering pediatric patients are younger in age, there were concerns about modeling the age variable and the pediatric surgery category together. This population was inherently dissimilar to the other specialties making it important to determine whether its inclusion was impacting parameter estimates in the model. We found that the model results were similar with or without the pediatric group. This has been added to the Methods section (lines 141-143, highlighted).

Reviewer #1: This is a timely manuscript on an important social issue emerging in telemedicine, an avenue of medicine which continues to be increasing utilized after the pandemic. The authors highlight important social disparities between those who utilized telemedicine during the pandemic versus those who continued with in-person visits. A large retrospective cohort of patients and patient encounters was utilized which is a large strength of the paper. The discussion is well-written and highlights several relevant, up-to-date articles.

There is a conclusion made which I do not believe is sound. Analysis showed that when comparing telemedicine visits during COVID to visits beforehand, those who used telemedicine were more likely to have activated MyChart (lines 163-165). However, when comparing in-person visits during COVID to visits beforehand, those who attended in-person visits were also more likely to have activated MyChart (lines 195-198). Thus regardless of visit type during pandemic (telemedicine vs in-person), the patient was more likely to have activated MyChart. Therefore the conclusion that those more comfortable with technology (using MyChart activation as a gauge) are disproportionately utilizing telemedicine, is false. The statistics need to be re-calculated, or the conclusion withdrawn, or my misunderstanding explained.

• Response: We thank the reviewer for their comment. 54.4% of the patients who attended in-person visits prior to COVID had activated MyChart compared to 61.4% of the telemedicine visits during COVID and 59.3% of in person visits during COVID. The adjusted analysis between in person versus telemedicine visits during COVID was not statistically significant as demonstrated in Table 4. Thus, we removed mention of comfort with technology as a barrier to telemedicine in the conclusion of the abstract and the discussion.

My largest critique of this manuscript is the failure to investigate or mention the reason for visit. A patient visit can be of several types - new patient visits, follow-up visits, and post-operative visits to name a few. While routine follow-up visits are easy to perform virtually, some aspects of new patient visits and post-operative visits such as conducting a physical examination, drawing blood, suture removal, dressing change, etc. all necessitate an in-person component. This is potentially massive confounding variable, especially as the manuscript is based entirely on a surgical patient population. For example, perhaps those from more privileged backgrounds were able to cancel their elective surgeries while those from more disadvantaged backgrounds continued with surgery and thus had more in person visits after the pandemic? Or are disadvantaged populations simply more affected from a health perspective by the pandemic (as you cite in your manuscript), requiring more urgent in-person visits? Reason for visit is a vital, possibly confounding variable that ideally be investigated but at minimum mentioned in the discussion.

• Response: Thank you for bringing up this important question and discussion point. The only visits included in the study were billable visits as the visits were identified from an administrative (financial) database. Postoperative visits within the global (non-billable) period were not included in the database. As far as determining the type of visit amongst the billable visits, we are unable to distinguish between a follow up versus an initial visit in the current database. We agree this is potentially a confounding variable. A statement has been added in the Methods clarifying the visit type (lines 90-93, highlighted) in addition to a further elaboration on this point in the limitations section of the Discussion (lines 330-335, highlighted).

Minor grammatical errors: line 132 "as well factors" to "as well as factors"; Abstract Methods: "My Chart" to "MyChart" to stay consistent with remainder of manuscript

• Response: Thank you for these corrections. The changes have been made and highlighted (line 138 and line 31, respectively).

Reviewer #2: This retrospective cohort study of 14,792 patients seen in an outpatient surgical setting between July 1 2019 to May 31, 2020 compared patient demographic, insurance, SES factors between in-person vs. telemedicine visits prior to and during the COVID-19 pandemic.

Major concerns:

There currently exist a large body of literature describing telehealth use in surgical practices during COVID-19. This paper would add much more insight into telehealth use as restrictions on clinical practice lifted to describe the its use in current contexts.

While institutional policy closed outpatient clinics on March 17th, there were likely changes in healthcare-seeking behavior even before this time as case numbers rose. Would consider another time frame (e.g. same time frame the year before) for a clearer comparison.

• Response: Thank you for this suggestion. Here in central Virginia, our case numbers did not start to rise until late May 2020 as we are in a relatively rural environment. The March 17th shutdown was in response to a decree by the governor largely in part to the national concern and rising cases in Northern Virginia. Although we cannot rule out the possibility that that healthcare-seeking behaviors of our patients may have started to change in the one to two weeks leading up to March 17th date, the number of visits during this short time frame would have been negligible compared to the overall study period.

Increasingly, it seems that telemedicine in complementary to in-person visits in surgical practices. Type of visit, therefore, is extremely important. What types of visits were these? New patients? Post-op? Return/surveillance patients?

• Response: Thank you for bringing up this important question and discussion point. The study was limited to billable visits. Thus, because postoperative visits occurring during the global period (typically 90 days for most procedures) are not billable, they were not included in the database. As far as determining the type of visit amongst the billable visits, we are unable to distinguish follow up versus initial visits. We agree this is potentially a confounding variable. A statement has been added in the Methods clarifying the visit type (lines 90-93, highlighted) in addition to a further elaboration on this point in the limitations section of the Discussion (lines 330-335, highlighted)

Minor concerns:

How were video visits offered? Using an institutional MyChart based platform? Or whatever communications platform available to the provider/patient (e.g. FaceTime, WhatsApp)? This would give insight into how meaningful MyChart enrollment might be.

• Response: Video visits were offered through an online platform called Doxy.me. Patients were sent a link to their surgeon’s specific online portal through MyChart. MyChart access would have been essential to communicating to patients about accessing the video platform. Although it is possible that patients were sent this link through other means: email, over the phone, etc., we believe MyChart was an integral component to facilitating video appointments. We have added a statement addressing this point in the Methods (lines 108-110, highlighted) and Discussion (lines 269-271, highlighted).

Intro:

Line 69 – would change wording to reflect the fact the video visits are not only preferred due to reimbursement – physical examination is possible with video visits (albeit limited) and many non-verbal communication cues can be lost through telephone only assessment

• Response: Thank you for this important addition. A change has been made in the Introduction (lines 67-70, highlighted).

Methods:

- Was “specialty” based on provider or diagnosis? While described in the discussion, would be helpful to be more explicit in the methods.

• Response: We have aimed to make this clearer in the Methods by adding further explanation. (line 106, highlighted).

- Please specify exactly how calendar time was determined. It appears it was considered categorically based on Table 4, but what are the exact definitions?

• Response: Thank you for bringing this to our attention. We have added the exact dates for the time periods into Table 4 (highlighted) and have also stated these dates within the study variables section of the Methods (lines 120-121, highlighted).

Results:

- p-values are redundant and not required if presenting 95% CI

• Response: We have removed p-values from Tables 2-4 and our supplemental tables S1-S3.

- Line 163 – what were these adjusted for? Do all tables represent adjusted odds ratios?

• Response: Each table represents one model and all of the model variables. The odds ratios within the table are adjusted for all of the variables in the model. We have clarified this in line 172 (highlighted).

- Table 2 - Would consider using another specialty as a referent as general has one of the smaller n, resulting in increased potential error in OR

Response: The ‘general’ category was chosen as the reference category because it was deemed the most meaningful to display comparisons with the other specialties. In our opinion, had we chosen a different reference category with a larger n, the comparisons displayed in the table would likely have been of lesser interest.

- Table 4 – would also give baseline characteristics of “time period” to understand this relationship better.

• Response: We have added the exact dates for the time periods into Table 4 and have also stated these dates within the study variables section of the Methods (lines 120-123, highlighted).

Discussion:

- Throughout, statements are made based on the results without discussing the comparand population, which can mislead the reader about the conclusions.

• Response: Thank you for this feedback. Several changes have been made and highlighted throughout the Discussion to address the comparand group of results on which the discussion is based.

Attachment

Submitted filename: ResponsetoReviewers.docx

Decision Letter 1

Jingjing Qian

16 Sep 2021

PONE-D-21-20375R1Socioeconomic disparities in telemedicine utilization among surgical patients during COVID-19PLOS ONE

Dear Dr. Lattimore,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Oct 31 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jingjing Qian

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

The authors properly addressed majority of the comments provided. However, a few additional edits need to be made to ensure accuracy of results reporting and conclusion drawing.

1. Abstract: page 2, Conclusions. Based on your findings, the current conclusions are not appropriately supported, because the significance of DCI (table 2) and female (table 4) came from two different models with different comparison groups. Please consider to use the revised Conclusions "During the first 3 months of the COVID-19 pandemic, Telemedicine was more likely used by females patients and those without government or commercial insurance compared to patients who used in-person visits. Interventions using telemedicine to improve health care access might consider such differences in utilization." Given this change, I suggest the authors to remove "socioeconomic" in their title.

2. Discussion, page 14, line 227-229: please consider revising this sentence to "Overall, telemedicine was more likely utilized by those without government or commercial insurance and women."

3. Limitations, page 19. The authors only had access to less than 3 months of data after the COVID-19 outbreak, from March 17, 2020 to May 31, 2020. Please add a limitation of the early observation of the association based on the short period availability of data, which might be different from later into the pandemic.

4. Conclusion, page 19, line 347. Please consider to change the sentence to "this study found that patient factors influence telemedicine utilization."

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Oct 8;16(10):e0258452. doi: 10.1371/journal.pone.0258452.r004

Author response to Decision Letter 1


23 Sep 2021

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

• The reference list was reviewed in its entirety and is both complete and correct with no retracted articles cited. A corrected citation was made in the Introduction (line 64, highlighted).

Additional Editor Comments (if provided):

The authors properly addressed majority of the comments provided. However, a few additional edits need to be made to ensure accuracy of results reporting and conclusion drawing.

1. Abstract: page 2, Conclusions. Based on your findings, the current conclusions are not appropriately supported, because the significance of DCI (table 2) and female (table 4) came from two different models with different comparison groups. Please consider to use the revised Conclusions "During the first 3 months of the COVID-19 pandemic, Telemedicine was more likely used by females patients and those without government or commercial insurance compared to patients who used in-person visits. Interventions using telemedicine to improve health care access might consider such differences in utilization." Given this change, I suggest the authors to remove "socioeconomic" in their title.

• Thank you for bringing this important point to our attention. The changes to the abstract have been made (lines 42-45, highlighted) and “Socioeconomic” has been removed from the title.

2. Discussion, page 14, line 227-229: please consider revising this sentence to "Overall, telemedicine was more likely utilized by those without government or commercial insurance and women."

• Thank you for this suggestion. The revision to this sentence has been made (lines 226-227, highlighted)

3. Limitations, page 19. The authors only had access to less than 3 months of data after the COVID-19 outbreak, from March 17, 2020 to May 31, 2020. Please add a limitation of the early observation of the association based on the short period availability of data, which might be different from later into the pandemic.

• We agree that the three months of data at the beginning of the pandemic are indeed a limitation. A statement to reflect this has been added (lines 334-337, highlighted).

4. Conclusion, page 19, line 347. Please consider to change the sentence to "this study found that patient factors influence telemedicine utilization."

• This change has been made. (line 347, highlighted)

Attachment

Submitted filename: ResponsetoReviewers_2.docx

Decision Letter 2

Jingjing Qian

28 Sep 2021

Disparities in telemedicine utilization among surgical patients during COVID-19

PONE-D-21-20375R2

Dear Dr. Lattimore,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Jingjing Qian

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thanks for making the suggested editorial edits.

Reviewers' comments:

Acceptance letter

Jingjing Qian

30 Sep 2021

PONE-D-21-20375R2

Disparities in telemedicine utilization among surgical patients during COVID-19

Dear Dr. Lattimore:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Jingjing Qian

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Sensitivity analysis excluding pediatric surgery patients of patient characteristics associated with a telemedicine visit during COVID-19, compared to pre-COVID in-person visits.

    (DOCX)

    S2 Table. Sensitivity analysis excluding pediatric surgery patients of patient characteristics associated with an in-person visit during COVID-19, compared to in-person visits before COVID-19.

    (DOCX)

    S3 Table. Sensitivity analysis excluding pediatric surgery patient characteristics associated with a telemedicine visit during COVID-19, compared to an in-person visit COVID-19.

    (DOCX)

    Attachment

    Submitted filename: ResponsetoReviewers.docx

    Attachment

    Submitted filename: ResponsetoReviewers_2.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES