Abstract
Background:
Surgeons rapidly adopted video visits during the COVID-19 pandemic. However, video visit use among surgeons has significantly declined, pointing to the need to better understand current attitudes and barriers to their use in surgical care.
Methods:
From August 2022 to March 2023, a nationwide survey was conducted among practicing surgeons in six specialties. The survey included multiple-choice and free response questions based on an implementation determinants framework, covering demographics, provider, patient, and organizational factors.
Results:
A total of 170 surgeons responded (24% response rate). Overall, 67% of surgeons believed their practice lacked motivation for video visit implementation. Additionally, 69% disagreed with using video visits as the sole means for pre-operative surgical consultation, even with relevant medical history, labs, and imaging. Nearly 43% cited the need for a physical exam while 58% of surgeons believed video visits carried a greater malpractice risk than in-person visits. Other barriers included technological, billing, and care quality concerns. Nevertheless, 41% agreed that video visits could improve outcomes for some patients and 60% expressed openness to using video visits exclusively for post-operative consultations in uncomplicated surgeries.
Conclusion:
Surgeons recognize the potential benefits of video visits for certain patients. However, perceived barriers include the need for a physical exam, technological limitations, care quality concerns, and malpractice risks.
Keywords: Surgical Care, Telehealth, Video Visits, Barriers, Malpractice, Implementation
INTRODUCTION
The COVID-19 pandemic drove a surge in telehealth adoption. Telehealth use increased 83-fold between 2019 and 2020, continuing to increase post lockdown.1–2 Surgeons also embraced video visits for patient care during the pandemic, accounting for 35% of new patient encounters.3 However, as in-person care resurged, video visits declined across all specialties, including in surgery. Between March 2021 and August 2021, just 3% of new patient surgical visits occurred via video.3
While video visits increased since the pandemic, they still face challenges in surgical care. Surgeons may find it hard to build rapport via video visits, and a perceived lack of privacy could decrease trust. Geriatric and low-income patients may lack technological access or literacy. Both surgeons and patients may favor in-person care for its depth and perceived ability to better sustain the patient-physician relationship. Considering the broad nature of these potential issues, identifying barriers is crucial for video visits’ success in surgery.
Previous studies found 95% of patients were satisfied with video visits and 75% expressed a perceived equivalence in quality to in-person visits.4 Meanwhile, over 76% of surgeons were satisfied with video visits and 85% were confident in retrieving patient health history (85%) through video visits.5 We expanded on these promising findings by better defining individual barriers across five surgical specialties: Cardiothoracic/Thoracic Surgery, General Surgery, Orthopedic Surgery, Otolaryngology, and Urology. This study highlights both the benefits and challenges of video visits, a first step towards improving surgical video visits for both surgeons and patients.
METHODS
Data Collection
From August 2022 to March 2023, we surveyed surgeons across five fields. To ensure geographic diversity, we used a random list from the AMA physician master file. These included cardiothoracic surgery, general surgery, orthopedic surgery, otolaryngology, and urology. Based on significant findings in prior literature 6–8, we also stratified responses by practice type: solo practice, single specialty practice, multi-specialty practice, and hospital-employed. Our outreach included a mailed letter and survey link/QR code,9 with cash advance incentives of $20, later reduced to $10.9,10 Using the Dillman approach, we contacted 158 surgeons in August 2022, 200 in October, 280 in December, and 80 in February 2023, minimizing time between outreach to reduce confounding variables.11 The Institutional Review Board deemed our study exempt.
Study Design
Surgeons completed a 19-item Qualtrics survey using multiple choice, case-based, and open-ended questions, grounded in the Tailored Implementation for Chronic Disease (TICD) framework covering demographics, provider/patient factors, organizational change capacity,12 and socio-political/legal elements. We chose TICD framework for its rigorous development, inclusion of provider and organization-level barriers, broad usage, and ability to guide implementation strategy selection.13–19 The fifteen multiple choice questions included true/false, multiple-choice, multiple response, case-based scenarios, and the five-point Likert scale to reliably gauge opinions.20 Four free response questions were included for further insight.
Surgeon Demographics
Our survey began with two questions assessing surgical specialty and practice type.
Surgeon Attitudes to Video Visits
Next, we evaluated surgeon attitudes on video visit implementation, querying their personal motivations and perceived impact on patient outcomes. We also collected data on their current video visit engagement rate to quantify surgical video visit usage.
Role in Surgical Care Process
We integrated case-based questions in our survey to gauge surgeons’ stance on video visits in surgical care. We asked about the appropriateness of pre-operative video visits given complete labs/imaging and medical history, and post-operative visits for the same surgery given no adverse events during the procedure. We tailored surgery types to each respondent’s specialty, highlighting the most common or widely known surgeries in each field: coronary bypass (cardiothoracic surgery),21 tonsillectomy (otolaryngology),22 hernia repair (general surgery),23 ACL reconstruction (orthopedic surgery),24 and prostatectomy (urology).25 We inquired about complications necessitating an in-person consultation over a video visit.
Surgeon’s Perceptions of Patient Attitudes
We surveyed surgeons on their perception of patient opinions towards video visit quality. Using two Likert scale questions, we evaluated if video visits aligned with patient-centered care and matched in-person care quality.
Finances and Malpractice
To address the financial benefits of video visits in surgery, we included questions about surgeons’ beliefs regarding video visit reimbursement compared to implementation costs. We asked case-based multiple-choice questions about compensation rates for video visits, including situations where technical challenges prompt telephone consultations. To explore if legal concerns hinder video visits expansion, we inquired about perceived malpractice risk associated with video visits compared to in-person visits.
Leadership and Organizational Change
We asked three questions about organizational attitudes towards video visits. Using a Likert scale, we gauged leadership’s motivation for their use. We identified which team members were most hesitant through a multiple-answer question and two free-response questions about changes and concerns regarding video visits over the next year.
Additional Comments
Our survey closed with an open-ended question letting surgeons voice additional concerns or insights not previously covered.
Statistical Analysis
Our methods varied based on the nature of our questions. Each of the Likert scale responses were assigned a number ie. 1 = Strongly Disagree, 2 = Disagree, 3 = Neutral, 4 = Agree, 5 = Strongly Agree. Descriptive analysis was reported by categorizing “Strongly Disagree/Disagree” as “Disagree” and “Strongly Agree/Agree” as “Agree.” Parametric analysis was reported by comparing mean values between specialties and practice types using Welch’s Two Sample T-tests with a 95% confidence interval to assess significance, a method validated for Likert data previously.26 As detailed in the Central Limit Theorem,27 we assumed a normal distribution for samples with n > 30. As a result, we did not include “cardiothoracic” and “other” surgical specialties in any specialty-specific analysis or “solo practice” in practice-specific analysis as these three groups all had n < 30. Findings were visualized using bar graphs and/or pie charts. All case-based questions were multiple choice and thus we used the same methods.
Our four free response questions were analyzed using a formal categorical analysis. This consisted of grouping responses into barrier categories and detailing the top three or four most frequently cited examples, a method justified previously as a formal means of qualitative data analysis.28–29 Our approach was motivated by prior telehealth research which often described potential barriers following categorical themes such as financial, technological, and accessibility.30 Some findings were also visualized using a bar graph.
RESULTS
Surgeon Demographics
Of the 718 surgeons mailed cover letters with cash incentives, 170 completed the survey, yielding a 23% response rate for those receiving a $20 incentive and 24% for those receiving $10. This suggests that incentive value didn’t significantly impact the response rate (p = 0.93).
The participants spanned six surgical specialties: Orthopedic Surgery (n = 46, 27%), General Surgery (n = 43, 25%), Urology (n = 36, 21%), Otolaryngology (n = 31, 18%), Cardiothoracic Surgery (n = 7, 4%), and Other (n = 7, 4%) (Figure 1).
Figure 1.
Survey respondents hail from a variety of specialties and practice types
They were affiliated with various practice types, with Hospital Employed (n = 69, 41%) being the most common, followed by Single Specialty Practice (n = 53, 31%), Multi-Specialty Practice (n = 31, 18%), Solo Practice (n = 14, 8%), and Other (n = 4, 2%).
Surgeon Attitudes Toward Video Visits
Most respondents had limited video visit experience. In total, 38% of surgeons reported no use of video visits with any patients, while only 17% employed them with at least 5% of patients. Adoption rates were lowest among otolaryngologists (10%), general surgeons (12%), cardiothoracic surgeons (14%), and orthopedic surgeons (19%). Urologists stood out with significantly higher utilization (p < 0.01), with 88% using video visits and over 38% employing them with at least 5% of patients (Figure 2).
Figure 2.
Surgeons stress patient, organization, and legal barriers to video visit adoption
In terms of motivation for video visits, 56% of surgeons disagreed that their practices were driven to use them. Among otolaryngologists, orthopedic and general surgeons, consensus existed about lacking practice motivation for video visits (mean 2.8). Urologists exhibited significantly higher motivation (mean 3.7) compared to orthopedic surgeons (mean 2.6, p < 0.01), general surgeons (mean 2.9, p < 0.01), and otolaryngologists (mean 2.9, p < 0.01). Practice type also influenced motivation: surgeons in multi-specialty practices reported higher motivation (mean 3.3) than those in hospital-based (mean 2.8, p < 0.01) or single-specialty practices (mean 2.9, p < 0.02) (Figure 2). Overall, motivation for video visit implementation remained low throughout except for urologists and those in multi-specialty practices.
Across all fields, 41% of surgeons agreed video visits could enhance outcomes for some patients. Response did not significantly differ between specialties and practice types (Figure 2).
Role in Surgical Care Process
Surgeons were cautious about using video visits for pre-operative consultation. Overall, 69% disagreed with performing surgery on a patient they’ve only seen through video, even with all necessary information. Specifically, 83% of general surgeons, 78% of orthopedic surgeons, 58% of otolaryngologists, and 56% of urologists disagreed. No differences were found based on practice type. Across specialties, surgeons were uncomfortable with operating based on pre-operative video visit consultation alone (Figure 3).
Figure 3.
Surgeons express skepticism about video visits as sole means for Pre-Op consultation
Surgeons were more receptive to using video visits for post-operative consultations without complications. Unlike pre-operative consultations, 49% agreed video visits were suitable for postoperative consultations following a successful surgery. Specifically, 77% of otolaryngologists, 55% of general surgeons, and 56% of urologists agreed. Orthopedic surgeons deviated from this trend, with only 20% agreeing. Orthopedic surgeons (mean 2.3) were significantly less comfortable than otolaryngologists (mean 3.8, p < 0.01), urologists (mean 3.35, p < 0.01), and general surgeons (mean 3.1, p < 0.01). Practice type did not impact this trend (Figure 4).
Figure 4.
Surgeons are more comfortable with video visits for Post-Op consultation
Comparing each specialty’s preferences for pre and post-operative consultations, general surgeons (p < 0.01) and otolaryngologists (p < 0.01) found post-operative video visits significantly more comfortable than pre-operative assessments.
In a free response question about conditions that would prompt surgeons to see patients in-person instead of via video, 59% mentioned wound, hemorrhage, or infection concerns (fever, chills, nausea/vomiting). In addition, 23% cited patient complication, 20% mentioned pain not responding to conservative treatment, and 6% referred to medical comorbidities. However, one surgeon stated “if a patient calls with a postoperative complication, I can generally see them much quicker over a quick video visit. It would actually delay care to see the patient in person.” Despite this, most surgeons still favored in-person visits for potential complications.
Surgeon’s Perceptions of Patient Attitudes
Collectively, 53% of surgeons disagreed patients saw video visits as equal to in-person visits (mean 2.5), including 71% of otolaryngologists, 57% of orthopedic surgeons, and 42% of general surgeons. Conversely, 42% of urologists (mean 3.2) agreed with this, significantly more than general surgeons (mean 2.6, p < 0.01), otolaryngologists (mean 2.6, p < 0.01), and orthopedic surgeons (mean 2.3, p < 0.01). Practice type had no significant impact.
Additionally, 47% of surgeons agreed video visits align with providing patient-centered care (mean 3.3). Unlike other surgeons, over 75% of urologists (mean 4.0) agreed, significantly more than orthopedic surgeons (mean 3.0, p < 0.01), of whom only 36% agreed video visits align with providing patient-centered care. Practice type once again did not yield significant differences in response.
In conclusion, surgeons believed patients viewed video visits as lesser quality compared to in-person visits but still agreed that they constituted patient-centered care.
Finances and Malpractice
Across all specialties, 58% of surgeons were neutral (mean 3.0) on whether reimbursement from video visits outweighed its costs, implying a perceived consensus on cost neutrality.
When asked about payment for video visits compared to in-person visits of equal time and complexity, 79% preferred “same compensation,” while 17% opted for “less compensation,” and 4% chose “more compensation.” Similarly, for telephone consultations, 78% preferred “same compensation,” with 20% opting for “less compensation.” Surgeons advocated for time-based compensation rather than communication methods (audio, video, in-person).
Concerning malpractice, 58% agreed video visits carried higher malpractice risk (mean 3.6). General surgeons (mean 3.9) were significantly more concerned (p < 0.01) than urologists (mean 3.1), while practice types didn’t yield significant differences. Malpractice concerns remained a substantial barrier across specialties and practice types.
Leadership and Organizational Change
Across all specialties, surgeons concurred on practice leadership/administration being supportive of video visit adoption (mean 3.7, mode 4); only 7% disagreed. Practice type influenced perceptions, but overall, practice leadership encouraged video visits.
When asked a “choose all that apply” question on the most hesitant practice members regarding video visit expansion, 48% of surgeons indicated peer surgeons. Nurses/PAs concerned 13%. Administrators and legal teams each garnered 13% and 11% respectively. The consensus remained clear: peer physicians were listed as nearly four times more hesitant than the next most cited team members, a significant finding (Figure 5).
Figure 5.
Surgeons believed their peer physicians were most likely to be hesitant to expand video visit use
Surgeons highlighted several organizational changes needed to expand video visits. The foremost was technology, with 37% expressing the need to improve video platforms, enhance access to rural communities, educate geriatric populations, and ensure patient privacy. One surgeon responded, “we need a subscription to a video service facilitating secure visits. It is difficult at times due to a lack of a standard platform (apple, android, etc).” Workflow concerns, like in-person scheduling preferences, were raised by 16%. For instance, one surgeon conveyed that if they were to implement video visits into their practice, the visits would “have to be properly scheduled within the clinic flow, such as the beginning of the day or at least 30 minutes after the last patient visit of the day.” Legal issues, including cross-state coverage and malpractice, were noted by 10%. One surgeon expressed, “if there is a problem that you can’t recognize because it is a video exam, how much legal trouble are you in?” While 28% saw no need for adjustments, most agreed on the importance of enhancements, especially technologically.
When asked about the top three practice concerns for using video visits in the next 12 months, 43% of surgeons cited the necessity of physical exams, 35% expressed care quality concerns, and 27% highlighted potential billing issues. Surgeons stressed the importance of physical exams, lab tests, and imaging studies. One stated “the concept of physical exam is extremely important in surgical patients and cannot be achieved via video visits. Video visits may have a role in post-operative visits” while another said “a surgical consultation without a physical exam is not a surgical consultation.” Worries about compromised care quality were underlined, with one surgeon highlighting the lack of empathy conveyed through video and the absence of touch in patient-physician relationships. Billing concerns centered on facility fee loss and lackluster reimbursement. Overall, surgeons’ primary organizational concerns included physical assessments, care quality, and billing.
Additional Comments
Some surgeons provided noteworthy feedback. One surgeon said “patient’s tech and medical literacy is typically the biggest barrier. If they can’t navigate the steps for video visits, I resort to phone calls.” Regarding illegal intra-state telehealth another surgeon stated “we are limited to seeing patients in states we’re licensed in. Patients far away would benefit from video visits, but can’t use them as a result.” Despite apprehension about technology, physical exams, and legal or billing difficulties, one surgeon emphasized ”‘if we are being patient-centered, video visits are the future.”
DISCUSSION
This study was the first to comprehensively survey surgeons on their perception of barriers to video visit use in the surgical care process. These barriers can be divided into four categories based on our TICD framework: provider factors, patient factors, malpractice and reimbursement, and administration and leadership. In Table 1, we define the primary barriers from our survey, label them into the four existing TICD categories, and provide potential solutions that were identified upon review of the existing literature.
Table 1.
TICD framework, proposed solutions to identified barriers for video visits in surgical care
Determinants | Identified barrier | Proposed solution |
---|---|---|
| ||
Provider factors | Surgeons require an in-person physical exam for surgical practice. | Video visits can play a supplementary role to in-person visits in order to assess patient symptoms and the need for a potential in-person follow-up rather than a primary role. |
Provider factors | Surgeons remain wary of using video visits as the sole means of preoperative consultation. | Establishing the need for an in-person preoperative consultation prior to surgery while defining the role of video visits for postoperative consultation for uncomplicated surgeries. |
Provider factors | Surgeons have low motivation for video visit implementation. | Motivation may increase by adequately defining an appropriate role for video visits in the surgical care process to obtain a physical exam and appropriately addressing all defined barriers. |
Patient factors | Patients are perceived to view video visits as a lower standard of care. | Previous studies,31,32 including one with 3,486 in-person and video visits for nephrology encounters at Mayo Clinic, show no significant difference in patient perceived access to care, provider satisfaction, or care quality. |
Patient factors | Some patients have low technological literacy or lack access to necessary technology.22 | Practices can continue to take advantage of improved technological literacy after the pandemic33 and also develop support mechanisms like a “help desk” for patients |
Malpractice and reimbursement | Surgeons believe video visits pose a greater malpractice risk. | Implementing patient consent forms before starting video visits will reduce the risk of surgeon malpractice. Professional societies should consider publishing guidelines for video visit use so that it is perceived to be within normal standards of care. |
Malpractice and reimbursement | Concern for patient privacy remains prevalent among surgeons. | Requiring video visit platform vendors to follow HIPAA compliance and take responsibility for potential breaches in confidential patient information34 will ease surgeon privacy concerns. |
Malpractice and reimbursement | Surgeons believe they should be reimbursed adequately for video or audio visits. | Surgeons should be made aware that there is strong bipartisan support for continued video visit coverage. Additionally, they can work with their professional societies to ensure payment parity for video visits. |
Administration and leadership | Surgeons believe peer physicians are hesitant to expand video visit use. | Further research explaining the high rates of video visit use among urology and multispecialty practices may better uncover solutions for practice-level adoption. |
Provider factors include the need for physical exams, pre-operative video visits concerns, and low motivation. Half of surgeons saw the absence of a physical exam as a major hindrance to video visits, echoing findings from Breton et al. identifying this as a significant barrier in primary care as well.31 Even with comprehensive labs, imaging, and medical history, most surgeons remained skeptical of pre-operative video consultation. However, a retrospective urology review found 95% of video visit surgical plans remaining unchanged following in-person examination.32 Further studies are required to identify specialties where virtual video visits are most feasible, with urology appearing promising.
In contrast, surgeons favor post-operative video visits for uncomplicated cases, consistent with studies indicating no link between video visits and increased readmissions within the first 90 days of surgery.33,34 Additionally, randomized control trials in lung cancer and arthroscopic surgeries showed similar patient outcomes for in-person and video consultations.35,36 Video visits appear appropriate for uncomplicated post-operative patients. However, orthopedics, general surgery, and otolaryngology practices expressed low motivation for video visits. Table 1 offers solutions to address these barriers, which may potentially boost enthusiasm.
Patient factors involve quality of care and low technological literacy concerns. A survey from 1,600 patients found 75% cited lack of a physical exam as their biggest concern for video visit use.37 While physical exams are valued by patients and physicians alike, a study at the Mayo Clinic showed no significant difference in care quality between in-person and video visits.38
Patients of low socioeconomic status (SES) or technology literacy face challenges with video visits. Kalicki et al. found 83% of homebound patients needed assistance with them.39 Age and economic burdens decrease video visit completion,40 seen in fields such as psychiatry.41 Thus, video visits can benefit some but should supplement in-person visits for the elderly or patients of low SES. Addressing this requires increased technological training and outreach to rural areas. Table 1 presents potential solutions and provides a basis for future research.
Malpractice worries revolve around misdiagnosis and breaches in patient privacy. Surgeons unanimously worry about misdiagnosis, which accounts for 68% of video visit malpractice claims compared to 46% for in person visits.42,43 Yet, a 2019 review found no video visit-related malpractice claims heard in court, indicating most are settled outside court.44 To prevent lawsuits, it is crucial to define the circumstances for combining video visits with in person visits. Additionally, using patient consent forms and ensuring HIPAA-compliant video platforms can further mitigate unease.
Reimbursement concerns arise from insufficient billing, a key physician concern.45 The average payment for video visits is 10% lower than for in-person visits.46 Although Congress extended Medicare telehealth coverage parity until December 2024, ongoing uncertainty around video visit reimbursement necessitates policy solutions. To address reimbursement worries, Congress should focus on patient interaction time, irrespective of communication mode (in-person, video, or audio), in upcoming legislation. Nevertheless, it is important to note that while billing concerns remain prevalent in both our survey and prior literature, 73% of surgeons did not list it as a top three issue, labeling other matters described above as more pressing.
Administrative and leadership dynamics reveal surgeons report peer physicians as nearly four times higher than the next most reluctant team member to adopt video visits. Two primary theories could explain this trend. First, surgeons may be likely to change their behaviors to conform with that of the group.47 This trend is seen frequently in medicine: a recent study found that presenting physicians with peer prescribing patterns can determine whether they themselves prescribe antibiotics for conditions which do not demand them, such as influenza.48 Second, surgeons and their peers may simply be unmotivated to implement video visits and have stronger opinions relating to this as the care provider. Prior literature documenting U.S. surgeon preferences is lacking, though our survey does cite an overall lack of motivation. Nonetheless, the cause for perceived surgeon hesitation remains unclear and presents an opportunity for future research.
These barriers notwithstanding, 41% of surgeons believed video visits could enhance outcomes for certain patients. In complex cases, concerns centered on wounds, hemorrhage, and infection drove preference for in-person consultations. Yet, initial video visits can offer timely care and prevent treatment delays for these cases enhanced post-operative monitoring. Notably, post-operative telehealth has already improved the acute care patient experience through improved communication, reduced wait times, and swift treatment for acute care or postoperative issues.49–51
Despite our findings, our study did have limitations. Our response rate stood at 24%, which means that non-response bias could affect our findings. While newer research does dispute this assumption,52 a lower response rate increases the likelihood of non-response bias. Our study did our best to combat this by including advanced incentives and providing anonymity to survey respondents, proven methods to increase response rates.53–55 That said, our second limitation stemmed from anonymity, as we were unable to gather information on the age and gender of our respondent population. As detailed by the CDC, video visit use is highest among women and, perhaps surprisingly, highest among the elderly.56 Therefore, the demographics of our surgeon population could affect our findings. Lastly, while our study remains broad, we were able to survey only five out of the 14 specialties recognized by the American College of Surgeons. Further research is needed to best determine the feasibility of video visits for other specialties such as plastic or vascular surgery. Nonetheless, our study included a broad surgeon population representing specialties that accounted for 79% of the total surgeon population, according to the AAMC.
CONCLUSION
Surgeons recognize the benefits of video visits, such as cost reduction, improved efficiency, and better access to care for specific patients. However, perceived barriers hinder widespread adoption in surgical practice. Concerns about physical exams, technological limitations, care quality, and malpractice risks make surgeons cautious about relying on video visits as the primary mode of patient care. Addressing these barriers and emphasizing post-operative video visits can lead to more effective implementation of video visits in surgery.
Acknowledgments
This work was supported by the Agency for Healthcare Research and Quality, Rockville MD [K08 HS027632].
Footnotes
DISCLOSURES
The authors themselves received no financial compensation for this work.
The authors have no relevant financial disclosures.
The authors have no conflicts of interest to report.
REFERENCES
- 1.Medicare Beneficiaries’ Use of Telehealth in 2020: Trends by Beneficiary Characteristics and Location. (n.d.). ASPE. https://aspe.hhs.gov/reports/medicare-beneficiaries-use-telehealth-2020 [Google Scholar]
- 2.Outpatient telehealth use soared early in the COVID-19 pandemic but has since receded - Peterson-KFF Health System Tracker. (2022, March 23). Peterson-KFF Health System Tracker. https://www.healthsystemtracker.org/brief/outpatient-telehealth-use-soared-early-in-the-covid-19-pandemic-but-has-since-receded/?_hsmi=2&_hsenc=p2ANqtz-_BpHSuyL82pHLFsPVCO_Oicw8j1LxzGpQpG9cIHn6v-M5OPrLxPCxqH1UrD3dbKLftzdWmyyOMIuU32D3RPvhENlMm2w&utm_campaign=KFF-2022-Coronavirus&utm_medium=email&utm_content=2&utm_source=hs_email [Google Scholar]
- 3.Chao GF, Li KY, Zhu Z, et al. Use of Telehealth by Surgical Specialties During the COVID-19 Pandemic. JAMA Surg. 2021;156(7):620–626. doi: 10.1001/jamasurg.2021.0979 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Wiadji E, Mackenzie L, Reeder P, Gani JS, Ahmadi S, Carroll R, Smith S, Frydenberg M, O’Neill CJ. Patient perceptions of surgical telehealth consultations during the COVID 19 pandemic in Australia: Lessons for future implementation. ANZ J Surg. 2021. Sep;91(9):1662–1667. doi: 10.1111/ans.17020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kemp MT, Liesman DR, Williams AM, Brown CS, Iancu AM, Wakam GK, Biesterveld BE, Alam HB. Surgery Provider Perceptions on Telehealth Visits During the COVID-19 Pandemic: Room for Improvement. J Surg Res. 2021. Apr;260:300–306. doi: 10.1016/j.jss.2020.11.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Castillo VH, Martínez-García AI, Pulido JR. A knowledge-based taxonomy of critical factors for adopting electronic health record systems by physicians: a systematic literature review. BMC Med Inform Decis Mak. 2010. Oct 15;10:60. doi: 10.1186/1472-6947-10-60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Boonstra A, Broekhuis M. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res. 2010. Aug 6;10:231. doi: 10.1186/1472-6963-10-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ngugi P, Were MC, Babic A. Facilitators and Barriers of Electronic Medical Records Systems Implementation in Low Resource Settings: A Holistic View. Stud Health Technol Inform. 2018;251:187–190. [PubMed] [Google Scholar]
- 9.VanGeest JB, Johnson TP, Welch VL. Methodologies for improving response rates in surveys of physicians: a systematic review. Eval Health Prof. 2007. Dec;30(4):303–21. doi: 10.1177/0163278707307899. [DOI] [PubMed] [Google Scholar]
- 10.Leung GM, Johnston JM, Saing H, Tin KY, Wong IO, Ho LM. Prepayment was superior to post payment cash incentives in a randomized postal survey among physicians. J Clin Epidemiol. 2004. Aug;57(8):777–84. doi: 10.1016/j.jclinepi.2003.12.021. [DOI] [PubMed] [Google Scholar]
- 11.Dillman DA, Smyth JD, Christian LM Internet, phone, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: John Wiley & Sons, Inc; 2014. [Google Scholar]
- 12.Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013. Mar 23;8:35. doi: 10.1186/1748-5908-8-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Desveaux L, Gagliardi AR. Comparing the application of two theoretical frameworks to describe determinants of adverse medical device event reporting: secondary analysis of qualitative interview data. BMC Health Serv Res. 2018. Jun 4;18(1):402. doi: 10.1186/s12913-018-3251-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Straßner C, Steinhäuser J, Freund T, Szecsenyi J, Wensing M. German healthcare professionals’ perspective on implementing recommendations about polypharmacy in general practice: a qualitative study. Fam Pract. 2018. Jul 23;35(4):503–510. doi: 10.1093/fampra/cmx127. [DOI] [PubMed] [Google Scholar]
- 15.Barnes GD, Misirliyan S, Kaatz S, Jackson EA, Haymart B, Kline-Rogers E, Kozlowski J, Krol G, Froehlich JB, Sales A. Barriers and facilitators to reducing frequent laboratory testing for patients who are stable on warfarin: a mixed methods study of de-implementation in five anticoagulation clinics. Implement Sci. 2017. Jul 14;12(1):87. doi: 10.1186/s13012-017-0620-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Aakhus E, Flottorp SA, Oxman AD. Implementing evidence-based guidelines for managing depression in elderly patients: a Norwegian perspective. Epidemiol Psychiatr Sci. 2012. Sep;21(3):237–40. doi: 10.1017/S204579601200025X. [DOI] [PubMed] [Google Scholar]
- 17.Saluja S, Silverstein A, Mukhopadhyay S, Lin Y, Raykar N, Keshavjee S, Samad L, Meara JG. Using the Consolidated Framework for Implementation Research to implement and evaluate national surgical planning. BMJ Glob Health. 2017. Jul 13;2(2):e000269. doi: 10.1136/bmjgh-2016-000269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Birken SA, Powell BJ, Presseau J, Kirk MA, Lorencatto F, Gould NJ, Shea CM, Weiner BJ, Francis JJ, Yu Y, Haines E, Damschroder LJ. Combined use of the Consolidated Framework for Implementation Research (CFIR) and the Theoretical Domains Framework (TDF): a systematic review. Implement Sci. 2017. Jan 5;12(1):2. doi: 10.1186/s13012-016-0534-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci. 2016. May 17;11:72. doi: 10.1186/s13012-016-0437-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jebb AT, Ng V, Tay L. A Review of Key Likert Scale Development Advances: 1995–2019. Front Psychol. 2021. May 4;12:637547. doi: 10.3389/fpsyg.2021.637547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Lee LS, Clark AJ, Namburi N, Naum CC, Timsina LR, Corvera JS, Beckman DJ, Everett JE, Hess PJ. The presence of a dedicated cardiac surgical intensive care service impacts clinical outcomes in adult cardiac surgery patients. J Card Surg. 2020. Apr;35(4):787–793. doi: 10.1111/jocs.14457. [DOI] [PubMed] [Google Scholar]
- 22.Haq AU, Bansal C, Pandey AK, Singh VP. Analysis of Different Techniques of Tonsillectomy: An Insight. Indian J Otolaryngol Head Neck Surg. 2022. Dec;74(Suppl 3):5717–5730. doi: 10.1007/s12070-021-02948-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Berger D Evidence-Based Hernia Treatment in Adults. Dtsch Arztebl Int. 2016. Mar 4;113(9):150–7; quiz 158. doi: 10.3238/arztebl.2016.0150. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Desai VS, Anderson GR, Wu IT, Levy BA, Dahm DL, Camp CL, Krych AJ, Stuart MJ. Anterior Cruciate Ligament Reconstruction With Hamstring Autograft: A Matched Cohort Comparison of the All-Inside and Complete Tibial Tunnel Techniques. Orthop J Sports Med. 2019. Jan 8;7(1):2325967118820297. doi: 10.1177/2325967118820297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Hugosson J, Stranne J, Carlsson SV. Radical retropubic prostatectomy: a review of outcomes and side-effects. Acta Oncol. 2011. Jun;50 Suppl 1:92–7. doi: 10.3109/0284186X.2010.535848. [DOI] [PubMed] [Google Scholar]
- 26.Sullivan GM, Artino AR Jr. Analyzing and interpreting data from likert-type scales. J Grad Med Educ. 2013. Dec;5(4):541–2. doi: 10.4300/JGME-5-4-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kwak SG, Kim JH. Central limit theorem: the cornerstone of modern statistics. Korean J Anesthesiol. 2017. Apr;70(2):144–156. doi: 10.4097/kjae.2017.70.2.144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Connelly LM, Peltzer JN. Underdeveloped Themes in Qualitative Research: Relationship With Interviews and Analysis. Clin Nurse Spec. 2016. Jan-Feb;30(1):52–7. doi: 10.1097/NUR.0000000000000173. [DOI] [PubMed] [Google Scholar]
- 29.Patel M, Berlin H, Rajkumar A, Krein SL, Miller R, DeVito J, Roy J, Punch M, Ellimootti C, Peahl AF. Barriers to Telemedicine Use: Qualitative Analysis of Provider Perspectives During the COVID-19 Pandemic. JMIR Hum Factors. 2023. Jun 26;10:e39249. doi: 10.2196/39249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Klee D, Pyne D, Kroll J, James W, Hirko KA. Rural patient and provider perceptions of telehealth implemented during the COVID-19 pandemic. BMC Health Serv Res. 2023. Sep 12;23(1):981. doi: 10.1186/s12913-023-09994-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Breton M, Sullivan EE, Deville-Stoetzel N et al. Telehealth challenges during COVID-19 as reported by primary healthcare physicians in Quebec and Massachusetts. BMC Fam Pract 22, 192 (2021). 10.1186/s12875-021-01543-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Eyrich NW, Andino JJ, Ukavwe RE, Farha MW, Patel AK, Triner D, Ellimoottil C. The Lack of a Physical Exam During New Patient Telehealth Visits Does Not Impact Plans for Office and Operating Room Procedures. Urology. 2022. Sep;167:109–114. doi: [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Yao LY, Fleshner PR, Zaghiyan KN. Impact of postoperative telemedicine visit versus in-person visit on patient satisfaction: A randomized clinical trial. Surgery. 2023. Feb;173(2):322–327. doi: 10.1016/j.surg.2022.09.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Uppal A, Kothari AN, Scally CP, Roland CL, Bednarski BK, Katz MHG, Vauthey JN, Chang GJ; D3CODE Team. Adoption of Telemedicine for Postoperative Follow-Up After Inpatient Cancer-Related Surgery. JCO Oncol Pract. 2022. Jul;18(7):e1091–e1099. doi: 10.1200/OP.21.00819. [DOI] [PubMed] [Google Scholar]
- 35.Cleeland CS, Wang XS, Shi Q, Mendoza TR, Wright SL, Berry MD, Malveaux D, Shah PK, Gning I, Hofstetter WL, Putnam JB Jr, Vaporciyan AA. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol. 2011. Mar 10;29(8):994–1000. doi: 10.1200/JCO.2010.29.8315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kane LT, Thakar O, Jamgochian G, Lazarus MD, Abboud JA, Namdari S, Horneff JG. The role of telehealth as a platform for postoperative visits following rotator cuff repair: a prospective, randomized controlled trial. J Shoulder Elbow Surg. 2020. Apr;29(4):775–783. doi: 10.1016/j.jse.2019.12.004. [DOI] [PubMed] [Google Scholar]
- 37.Malani P, Kullgren J, Solway E, Buis L, Singer D, Kirch M. National poll on health aging report. The Regents of the University of Michigan. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/156253/0212_NPHA-telehealth-report-FINAL-08142020-v6-handle.pdf?sequence=4&isAllowed=y [Google Scholar]
- 38.Patel M, Miller R, Haddad H, An L, Devito J, Neff A, Rajkumar A, Ellimoottil C. Assessing patient usability of video visits. Mhealth. 2021. Apr 20;7:22. doi: 10.21037/mhealth-20-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Kalicki AV, Moody KA, Franzosa E, Gliatto PM, Ornstein KA. Barriers to telehealth access among homebound older adults. J Am Geriatr Soc. 2021. Sep;69(9):2404–2411. doi: 10.1111/jgs.17163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Darrat I, Tam S, Boulis M, Williams AM. Socioeconomic Disparities in Patient Use of Telehealth During the Coronavirus Disease 2019 Surge. JAMA Otolaryngol Head Neck Surg. 2021;147(3):287–295. doi: 10.1001/jamaoto.2020.5161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Hilty D, Yellowlees PM, Parrish MB, & Chan S (2015). Telepsychiatry. Psychiatric Clinics of North America, 38(3), 559–592. doi: 10.1016/j.psc.2015.05.006 [DOI] [PubMed] [Google Scholar]
- 42.Rowland SP, Fitzgerald JE, Lungren M, Lee EH, Harned Z, McGregor AH. Digital health technology-specific risks for medical malpractice liability. NPJ Digit Med. 2022. Oct 20;5(1):157. doi: 10.1038/s41746-022-00698-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Finnegan J (2019, March 12). Diagnostic errors are top reason for liability claims against Primary Care Doctors, report says. Fierce Healthcare. https://www.fiercehealthcare.com/practices/diagnostic-errors-are-top-reason-for-liability-claims-against-primary-care-doctors-report [Google Scholar]
- 44.Fogel AL, Kvedar JC. Reported Cases of Medical Malpractice in Direct-to-Consumer Telemedicine. JAMA. 2019. Apr 2;321(13):1309–1310. doi: 10.1001/jama.2019.0395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Wilson FA, Rampa S, Trout KE, Stimpson JP. Reimbursements for telehealth services are likely to be lower than non-telehealth services in the United States. J Telemed Telecare. 2017. May;23(4):497–500. doi: 10.1177/1357633X16652288. [DOI] [PubMed] [Google Scholar]
- 46.Early in the pandemic, private insurer payments for telehealth and in-person claims were similar - Peterson-KFF Health System Tracker. (2023, January 18). Peterson-KFF Health System Tracker. https://www.healthsystemtracker.org/brief/telehealth-payments-similar-early-in-the-pandemic/ [Google Scholar]
- 47.Beran Tanya. (2015). Research Advances in Conformity to Peer Pressure: A Negative Side Effect of Medical Education. Health Professions Education. 1. 19–23. 10.1016/j.hpe.2015.11.004. [DOI] [Google Scholar]
- 48.Meeker D, Linder JA, Fox CR, et al. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA. 2016;315(6):562–570. doi: 10.1001/jama.2016.0275 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Belarmino A, Walsh R, Alshak M, Patel N, Wu R, Hu JC. Feasibility of a Mobile Health Application To Monitor Recovery and Patient-reported Outcomes after Robot-assisted Radical Prostatectomy. Eur Urol Oncol. 2019. Jul;2(4):425–428. doi: 10.1016/j.euo.2018.08.016. [DOI] [PubMed] [Google Scholar]
- 50.Chang JH, Sritharan S, Schmitt K, Patel S, Crew RJ, Tsapepas DS. Home Care Delivery and Remote Patient Monitoring of Kidney Transplant Recipients During COVID-19 Pandemic. Prog Transplant. 2021. Dec;31(4):381–384. doi: 10.1177/15269248211046005. [DOI] [PubMed] [Google Scholar]
- 51.Viers BR, Lightner DJ, Rivera ME, Tollefson MK, Boorjian SA, Karnes RJ, Thompson RH, O’Neil DA, Hamilton RL, Gardner MR, Bundrick M, Jenkins SM, Pruthi S, Frank I, Gettman MT. Efficiency, satisfaction, and costs for remote video visits following radical prostatectomy: a randomized controlled trial. Eur Urol. 2015. Oct;68(4):729–35. doi: 10.1016/j.eururo.2015.04.002. [DOI] [PubMed] [Google Scholar]
- 52.Hendra R, & Hill A (2019). Rethinking Response Rates: New Evidence of Little Relationship Between Survey Response Rates and Nonresponse Bias. Evaluation Review, 43(5), 307–330. 10.1177/0193841X18807719 [DOI] [PubMed] [Google Scholar]
- 53.VanGeest JB, Johnson TP, Welch VL. Methodologies for improving response rates in surveys of physicians: a systematic review. Eval Health Prof. 2007. Dec;30(4):303–21. doi: 10.1177/0163278707307899. [DOI] [PubMed] [Google Scholar]
- 54.Leung GM, Johnston JM, Saing H, Tin KY, Wong IO, Ho LM. Prepayment was superior to post payment cash incentives in a randomized postal survey among physicians. J Clin Epidemiol. 2004. Aug;57(8):777–84. doi: 10.1016/j.jclinepi.2003.12.021. [DOI] [PubMed] [Google Scholar]
- 55.Faria AJ and Dickinson JR (1996), “The effect of reassured anonymity and sponsor on mail survey response rate and speed with a business population”, Journal of Business & Industrial Marketing, Vol. 11 No. 1, pp. 66–76. 10.1108/08858629610112300 [DOI] [Google Scholar]
- 56.Lucas JW, Villarroel MA. Telemedicine use among adults: United States, 2021. NCHS Data Brief, no 445. Hyattsville, MD: National Center for Health Statistics. 2022. DOI: 10.15620/cdc:121435. [DOI] [PubMed] [Google Scholar]
- 57.Androga LA, Amundson RH, Hickson LJ, Thorsteinsdottir B, Garovic VD, Manohar S, Viehman JK, Zoghby Z, Norby SM, Kattah AG, Albright RC Jr. Telehealth versus face-to-face visits: A comprehensive outpatient perspective-based cohort study of patients with kidney disease. PLoS One. 2022. Mar 11;17(3):e0265073. doi: 10.1371/journal.pone.0265073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Patel M, Miller R, Haddad H, An L, Devito J, Neff A, Rajkumar A, Ellimoottil C. Assessing patient usability of video visits. Mhealth. 2021. Apr 20;7:22. doi: 10.21037/mhealth-20-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Blandford A, Wesson J, Amalberti R, AlHazme R, Allwihan R. Opportunities and challenges for telehealth within, and beyond, a pandemic. Lancet Glob Health. 2020. Nov;8(11):e1364–e1365. doi: 10.1016/S2214-109X(20)30362-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Jin MX, Kim S, Miller LJ, et al. (August 20, 2020) Telemedicine: Current Impact on the Future. Cureus 12(8): e9891. doi: 10.7759/cureus.9891 [DOI] [PMC free article] [PubMed] [Google Scholar]