Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Apr 16;16(4):e0250241. doi: 10.1371/journal.pone.0250241

Physicians’ attitude towards webinars and online education amid COVID-19 pandemic: When less is more

Ismail Ibrahim Ismail 1,*, Ahmed Abdelkarim 2, Jasem Y Al-Hashel 1,3
Editor: Itamar Ashkenazi4
PMCID: PMC8051773  PMID: 33861799

Abstract

Background

Since the declaration of COVID-19 as a pandemic, all scientific medical activities were shifted to an online format, in the form of webinars, to maintain continuing medical education (CME). We aimed to assess physicians’ attitude among different medical specialties towards this sudden and unexpected shift of traditional face-to-face meetings into webinars, and to suggest future recommendations.

Methods

We conducted a cross-sectional, internet-based survey study using a 25-item questionnaire, from November 1 and November 15, 2020. The survey was created and distributed to physicians from different medical and surgical specialties and from different countries via several social media platforms, using a snowball technique.

Results

A total of 326 physicians responded; 165 (50.6%) were females, mean age of responders was 38.7 ± 7.5 years. The majority of responses (93.2%) came from Arab countries. Of them, 195 (59.8%) reported attending more webinars compared to the same period last year, with average of 3 per month. As regard to the general impression; 244 (74.8%) were “strongly satisfied” or “satisfied”, with the most satisfaction for “training courses: by 268 (82.2%), and “International conferences” by 218 (66.9%). However, 246 respondents (75.5%) felt overwhelmed with the number and frequency of webinars during the pandemic, 171 (52.5%) reported attending less than 25% of webinars they are invited to, 205 (62.8%) disagreed that webinars can replace in-person meetings after the pandemic, and 239 (73.3%) agreed that online meetings need proper regulations.

Conclusions

Webinars comprised a major avenue for education during COVID-19 pandemic, with initial general satisfaction among physicians. However, this paradigm shift was sudden and lacked proper regulations. Despite initial satisfaction, the majority of physicians felt overwhelmed with the number and frequency of webinars. Physicians’ satisfaction is crucial in planning future educational activities, and considering that this current crisis will most likely have long lasting effects, webinars should be viewed as complementing traditional in-person methods, rather than replacement. In this study, we are suggesting recommendations to help future regulation of this change.

Introduction

The world has been overtaken by coronavirus 2019 (COVID-19) pandemic since March 11, 2020. Since then, health care systems around the world have been struggling to contain this unprecedented public health crisis [1]. Most countries implemented lockdown and social distancing recommendations for fear of COVID-19 spread, and the majority of medical conferences and in-person scientific meetings were canceled. Many societies and educational institutes started using online-meeting applications to reach their relevant goals and needs, and the medical educational organizations and pharmaceutical companies were no exception [2]. The scientific activities were shifted to an online format, in the form of webinars, virtual conferences and online teaching courses. Webinars (web-based seminars) are one form of online communication tools that facilitate delivery of scientific information and sharing experiences among physicians. Thus, it best suited a time of movement restrictions and fear from a potentially fatal virus amid COVID-19 pandemic [3].

During the 6-month period following the pandemic, physicians have been invited to attend a lot of scientific webinars, while working to minimize the spread of COVID-19 outbreak. Webinars at this point were probably the only solution for continuing medical education (CME), however, months into the pandemic, their number and frequency has markedly increased. Physicians had difficulties in controlling their virtual agenda and struggled to participate in the extensive offer of webinars, teaching courses, medical representatives visits, board and committee meetings, in addition to telemedicine. It is not surprising that several physicians have felt “digital burnout” as suggested by some authors [4]. The ability of physicians to attend these online educational activities were compromised by several factors, and the lack of proper regulations as regard to the best teaching format, timing to conduct webinars, or methods for feedback, created several challenges amid COVID-19 crisis [5, 6].

Several studies have discussed these emerging challenges and disadvantages of online education amid COVID-19 pandemic [7, 8], however, there are limited data in the literature regarding physicians’ perception and satisfaction towards this sudden and unexpected shift in medical education. We believe that physicians’ satisfaction is crucial, not only for evaluation of the current practices, but also for planning of future strategies between in-person and virtual learning. In this survey study, we aim to assess physicians’ attitude, mainly in The Middle East and North Africa (MENA) region, towards webinars in comparison to the traditional in-person meetings, and to suggest future recommendations to regulate this change in practice.

Methods

Participants

This cross-sectional, internet-based study, was conducted between November 1 and November 15, 2020. The study was approved by the Institutional Review Board Committee of Ministry of health of the state of Kuwait. The survey was developed and distributed to physicians of different specialties and from different countries via several social medical networks using a snowball technique. Answering the survey was considered an implied consent to participate in the study, and all answers were confidential. The study follows the American Association for Public Opinion Research (AAPOR) reporting guideline.

Survey

A 25-item questionnaire was designed in English language, combining multiple choice and Likert response scale questions, with the option for respondents to provide further free text responses for some questions. A pilot study was conducted on a random sample of 25 physicians to determine the feasibility of using the questionnaire. Each author sent the questionnaire to a random of 10 physicians of their contacts, and 25 responded, which was considered a convenient sample. The survey was then modified as regard to formulation of the questions, formulation of response preferences, and the addition of certain demographic variables before distribution. The survey aimed to assess physicians’ attitude towards shifting scientific activities to online formats amid COVID-19 pandemic, using a 5-point Likert scale of agreeableness (’strongly disagree’, ’disagree’, ’neutral’, ’agree’, and ’strongly agree’) against certain questions. The self-administered survey was developed using “GoogleTM Forms”, which require participants to sign-in into their Google accounts to prevent multiple entries from respondents.

The educational activities can be different among medical specialties, but they mainly include; general online webinars, teaching courses on specific subjects (e.g. Botox injection), International annual conferences, or pharmaceutically-sponsored meetings discussing specific therapies.

The survey collected the following data from three domains: (1) demographic variables (age, gender, country of practice, specialty, years of experience, working role during the pandemic). (2) webinars-related variables (attendance, number of attendances per month, comparison to last year attendance, role in webinars, percentage of webinars attended in relation to the number of invitations). (3) physicians’ attitude towards webinars (general impression on shifting scientific meetings to online format, specific impression on shifting international conferences/ teaching courses versus pharmaceutically-sponsored meetings to online format, impression on the scientific content of international conferences versus pharmaceutically-sponsored meetings in online format, types of online meetings respondents prefer to attend, types of online meetings respondents reject to attend, factors determining attendance or rejection to attend online meetings, agreement on online meetings replacing in-person visits, feeling overwhelmed with the number and frequency of online meetings, agreement on the need for further regulations). In reporting the results, the data from the two columns of “strongly agree” and “agree”/ “strongly satisfied” and “satisfied” were combined and the data for “strongly disagree” and “disagree”/ “strongly dissatisfied” and “dissatisfied” were combined as well. Participants were asked at the end of the survey to give their opinion and to suggest recommendations for educational organizations, pharmaceutical companies, and policy makers, to improve physicians’ satisfaction beyond the COVID-19 pandemic.

The full survey instrument can be viewed as an appendix to this article (S1 Appendix).

The survey link was created and initially posted on the personal social media accounts of the primary investigators and on several medical groups on Facebook. Physicians were encouraged to recruit other colleagues by resending the link to their contacts through a “snow-ball technique”. The link was posted only once on each medical group, and twice on the personal accounts of the investigators. The survey continued until there was no more responses for 1 day. The survey was closed at 23:59, November 15, 2020.

Statistical analysis

Data were analyzed using SPSS statistical software version 25.0 (Armonk, NY: IBM Corp). The Kolmogorov- Smirnov non-parametric test was used to verify the normality of distribution of variables. Comparisons between groups for categorical variables were assessed using Chi-square test (Fisher’s Exact or Monte Carlo correction). Student t-test was used to compare two groups for normally distributed quantitative variables while Mann Whitney test was used to compare between two groups for not normally distributed quantitative variables. Significance of the obtained results was judged at the 5% level.

Results

In this survey, a total of 326 physicians responded to the online survey; 165 (50.6%) females, and 161 (49.4%) were males, with a mean age of 38.7 ± 7.5 years for all responders. Mean years of experience for the cohort was 11.8 ± 7.01 years. The respondents were mostly from Arab countries (93.2%); Egypt; 142 (43.6%), Kuwait; 122 (37.4%), UAE; 22 (6.7%), KSA; 13 (4%) and 27 (8.3%) from other countries. The response rate cannot be calculated in this study. During the pandemic, 172 physicians (52.8%) continued to practice their usual work, 80 (24.5%) were frontline healthcare worker, 38 (11.7%) partially worked, 24 (7.4%) practiced through "telemedicine services”, while 12 (3.7%) didn’t work during the pandemic. Physicians’ characteristics and their responses to the survey questions are summarized in Table 1. Of the respondents, the commonest specialties were neurology by 75 physicians (23%), psychiatry by 40 (12.3%), family medicine by 38 (11.6%), general surgery by 20 (6.1%), critical care by 17 (5.2%), internal medicine by 16 (4.9%), radiology by 16 (4.9%), and 104 physicians (31.9%) from other specialties, as summarized in Table 2.

Table 1. Distribution of the survey respondents according to different parameters (n = 326).

N (%)
Age (years)
    Mean ± SD. 38.7 ± 7.5
    Median (Min.–Max.) 37 (25–61)
Gender
    Male 161 (49.4%)
    Female 165 (50.6%)
Country of practice
    Egypt 142 (43.6%)
    Kuwait 122 (37.4%)
    UAE 22 (6.7%)
    KSA 13 (4%)
    UK 8 (2.5%)
    USA 7 (2.1%)
    Germany 4 (1.2%)
    India 3 (0.9%)
    Oman 3 (0.9%)
    Syria 2 (0.6%)
Years of practice in your specialty
    Mean ± SD. 11.8 ± 7.01
    Median (Min.–Max.) 11 (1–36)
How do you describe your role amid COVID-19 pandemic?
    Frontline healthcare worker 80 (24.5%)
    I continued to practice my usual work during the pandemic 172 (52.8%)
    I didn’t work during the pandemic 12 (3.7%)
    I partially worked during the pandemic 38 (11.7%)
    I practiced through "telemedicine" services 24 (7.4%)
Have you attended webinars or online meetings during the past 6 months?
    No 8 (2.5%)
    Yes 318 (97.5)
If yes, how many webinars or online meetings, in average, have you attended per month during the past 6 months?
  Median (Min.–Max.) 3 (0–20)
How many webinars or online meetings, in average, have you attended per month last year?
  Median (Min.–Max.) 0 (0–1)
In comparison to the last year, have you attended more meetings and conferences during the past 6 months?
    No 110 (33.7%)
    Maybe 21 (6.4%)
    Yes 195 (59.8%)
What is your role in webinars and online meetings?
    Equally speaker and attendee 41 (12.6%)
    Mostly attendee 270 (82.8%)
    Mostly speaker 15 (4.6%)
In average, what is the percentage of webinars or online meetings you attend in comparison to the number you are invited to?
    Less than 25% 171 (52.5%)
    25–50% 72 (22.1%)
    50–75% 55 (16.9%)
    More than 75% 28 (8.6%)

Table 2. Distribution of the studied cases according to the different specialties (n = 326).

Specialty N (%)
    Anesthesia 9 (2.8%)
    Cardiology 7 (2.1%)
    Critical care 17 (5.2%)
    Dermatology 7 (2.1%)
    Endocrinology 3 (0.9%)
    Family medicine 38 (11.6%)
    General surgery 20 (6.1%)
    Haematology 2 (0.6%)
    Internal medicine 16 (4.9%)
    Neurology 75 (23%)
    Neurosurgery 12 (3.7%)
    Nutrition 5 (1.5%)
    OB/GYN 2 (0.6%)
    Oncology 4 (1.2%)
    Ophthalmology 13 (4%)
    Orthopedic surgery 4 (1.2%)
    Otolaryngology 5 (1.5%)
    Pain management 1 (0.3%)
    Palliative care 1 (0.3%)
    Pediatric surgery 1 (0.3%)
    Pediatrics 11 (3.4%)
    Physical medicine 4 (1.2%)
    Plastic surgery 4 (1.2%)
    Psychiatry 40 (12.3%)
    Public health 1 (0.3%)
    Pulmonology 3 (0.9%)
    Radiology 16 (4.9%)
    Rheumatology 5 (1.5%)

The majority of physicians; 318 (97.5%) attended webinars or online meetings during the first 6 months of the pandemic, with 195 (59.8%) reported attending more webinars compared to the same period last year. The average median was 3 (0–20) webinars per month, compared to 0 (0–1) in the past year. More than half of the respondents; 171 (52.5%) reported attending less than 25% of webinars they are invited to, 72 (22.1%) attended 25–50%, 55 (16.9%) attended 50–75%, while only 28 (8.6%) reported attending more than 75%. Most of the respondents; 270 (82.8%) were “mostly attendees”, 41 (12.6%) were “equally speakers and attendees”, and 15 (4.6%) were “mostly speakers”.

As regard to the general impression on shifting scientific meetings to online format, 244 (74.8%) were “strongly satisfied” or “satisfied”, 49 (15%) were neutral, while 33 (10.1%) were “strongly dissatisfied” or “dissatisfied”. Almost the same results were obtained when asked about their impression on shifting international conferences and teaching courses to online format; 243 (74.5%) were “strongly satisfied” or “satisfied”, 42 (12.9%) were neutral, and 41 (12.5%) were “strongly dissatisfied” or “dissatisfied”. However, these results differed when asked about shifting pharmaceutically-sponsored meetings; only 135 (41.4%) were “strongly satisfied” or “satisfied”, 90 (27.6%) were neutral, while 101 (30.9%) were “strongly dissatisfied” or “dissatisfied”.

As regard to impression on the scientific content of the international conferences in online format; 267 (81.9%) were “strongly satisfied” or “satisfied”, 44 (13.5%) were neutral, and 15 (4.6%) were “strongly dissatisfied” or “dissatisfied”. These results also changed when asked about the scientific content of the pharmaceutically-sponsored meetings; 120 (36.8%) were “strongly satisfied” or “satisfied”, 86 (26.4%) were neutral, and 120 (36.8%) were “strongly dissatisfied” or “dissatisfied”. The commonest types of meetings respondents preferred to attend were training courses by 268 (82.2%), international conferences by 218 (66.9%), local/regional conferences by 167 (51.2%), and the least was commercial/ pharmaceutically-sponsored meetings by 29 (8.9%) respondent. Findings are illustrated in Table 3, and Fig 1.

Table 3. Distribution of survey responses according to satisfaction with different webinars and online meetings (n = 326).

Strongly dissatisfied Dissatisfied Satisfied Strongly satisfied Χ2 p
Since the beginning of COVID-19 pandemic, what is your general impression on shifting scientific meetings to webinars and online meetings? 4 (1.2%) 29 (8.9%) 183 (56.1%) 61 (18.7%) 272.704* <0.001*
What is your impression on shifting international conferences and teaching courses to webinars and online meetings? 2 (0.6%) 39 (12%) 158 (48.5%) 85 (26.1%) 190.845* <0.001*
What is your impression on shifting pharmaceutically-sponsored meetings to webinars and online meetings? 4 (1.2%) 97 (29.8%) 69 (21.2%) 66 (20.2%) 78.271* <0.001*
In general, what is your impression on the scientific content of the International conferences as webinars and online meetings? 1 (0.3%) 14 (4.3%) 200 (61.3%) 67 (20.6%) 391.703* <0.001*
In general, what is your impression on the scientific content of the pharmaceutically-sponsored meetings as webinars and online meetings? 7 (2.1%) 113 (34.7%) 91 (27.9%) 29 (8.9%) 125.667* <0.001*

χ2: Chi square for Goodness of fit.

*: Statistically significant at p ≤ 0.05.

Fig 1. Stacked bar chart of Likert questions.

Fig 1

The figure shows 5 bar charts describing the impression of physicians towards shifting scientific activities into online format, the impression differences between international conferences and pharmaceutically-sponsored activities, and the perception of the scientific content of these activities during the pandemic.

The commonest reported factors for determining attendance were; scientific content by 297 (91.1%), CME certification by 164 (50.3%), speaker’s name and experience by 158 (48.5%), annual international conferences by 156 (47.9%), and personal relations with the inviting party by 61 (18.7%) respondent. The commonest reported factor for declining to attend was the timing of the meeting by 284 (87.1%), followed by the scientific content by 228 (69.9%), lack of CME certification by 115 (35.3%), personal factors by 85 (26.1%), speakers in the meeting by 75 (23%), and lack of personal relations with the inviting party by 50 (15.3%) respondent.

When asked if webinars can replace in-person meetings after the pandemic; 205 respondents (62.8%) reported “strongly disagree” or “disagree”, in comparison to 105 (32.2%) who reported “strongly agree” or “agree”. Moreover, 246 (75.5%) agreed or strongly agreed that they felt overwhelmed with the number and frequency of webinars during the pandemic, with 239 (73.3%) agreed or strongly agreed that webinars and online meetings need further regulations. Findings are illustrated in Table 4, and Fig 2.

Table 4. Distribution of the survey responses according to agreeableness to different items (n = 326).

Strongly disagree Disagree Agree Strongly agree Χ2 p
Do you agree that webinars and online meetings can replace in-person meetings after the pandemic? 110 (33.7%) 95 (29.1%) 78 (23.9%) 27 (8.3%) 50.490* <0.001*
Have you felt overwhelmed with the number and frequency of webinars and online meetings during the pandemic? 0 (0%) 31 (9.5%) 123 (37.7%) 123 (37.7%) 61.112* <0.001*
Do you agree that webinars and online meetings need further regulations? 0 (0%) 14 (4.3%) 127 (39%) 112 (34.4%) 89.320* <0.001*

χ2: Chi square for Goodness of fit.

*: Statistically significant at p ≤ 0.05.

Fig 2. Stacked bar chart of Likert questions.

Fig 2

The figure shows 3 bar charts describing the questions regarding being overwhelmed with webinars, the need for further regulations, and if webinars can replace traditional in-person methods after the pandemic.

A statistical comparison was performed between satisfied and non-satisfied groups, and there were no significant differences as regard to age (p = 0.601), gender (p = 0.593), years of clinical practice (p = 0.620), and role amid the pandemic (p = 0.563). However, there was a statistically significant difference regarding the role during online meetings, where “mostly speakers” reported more satisfaction compared to “mostly attendees” (p = <0.001). Findings are summarized in Table 5.

Table 5. Comparison between satisfied and non-satisfied groups on shifting scientific meetings into webinars with different parameters (n = 277).

General impression on shifting scientific meetings into webinars Test of Sig. p
Satisfied (n = 33) Dissatisfied (n = 244)
Gender
    Male 15 (45.5%) 123 (50.4%) χ2 = 0.593
    Female 18 (54.5%) 121 (49.6%) 0.286
Age (years)
    Mean ± SD. 39.5 ± 7.7 38.7 ± 7.5 t = 0.601
    Median (Min.–Max.) 38 (26–59) 37.5 (25–61) 0.523
Years of practice
    Mean ± SD. 12.3 ± 6.7 11.8 ± 7.1 U = 0.620
    Median (Min.–Max.) 12 (1–27) 11 (1–36) 3812.0
How do you describe your role amid COVID-19 pandemic?
    Frontline healthcare worker 8 (24.2%) 58 (23.8%) χ2 = MCp =
    I continued to practice my usual work during the pandemic 16 (48.5%) 139 (57%)
    I didn’t work during the pandemic 1 (3%) 4 (1.6%)
    I partially worked during the pandemic 6 (18.2%) 26 (10.7%) 2.821 0.563
    I practiced through "telemedicine" services 2 (6.1%) 17 (7%)
What is your role in webinars and online meetings?
    Equally speaker and attendee 9 (27.3%) 19 (7.8%) χ2 = MCp =
    Mostly attendee 19 (57.6%) 216 (88.5%)
18.142* <0.001*
    Mostly speaker 5 (15.2%) 9 (3.7%)

χ2: Chi square test, MC: Monte Carlo, t: Student t-test, U: Mann Whitney test.

p: p value for association between different categories.

*: Statistically significant at p ≤ 0.05.

Discussion

The COVID-19 pandemic has caused a major disruption to the conventional medical education across the world, and webinars were used in an attempt to maintain teaching and learning. This phenomenal shift of concepts has led to an increase in webinar usage in 2020 compared to the same period in 2019, by more than 300% in one study [9] and up to 3250% in another [10]. This is not the first time when traditional educational activities are suspended in a time of a major crisis. SARS coronavirus (SARS-CoV) and H1N1 Flu outbreaks also negatively impacted educational activities in a large number of countries around the globe, enforcing “emergency remote teaching” as a feasible option [11]. However, the current circumstances are unique and different in its global magnitude and the more likely long-lasting effects after the pandemic.

In this study, nearly two-thirds of physicians attended more meetings during the first 6 months of the pandemic compared to the same period last year, and the majority reported initial satisfaction. This satisfaction was higher with “International conferences” and “teaching courses” compared to pharmaceutically-sponsored meetings (74.5% vs 41.4%, p = <0.001). Moreover, the satisfaction with the scientific content was also higher between the aforementioned two types of meetings (81.9% vs 36.8%, p = <0.001). This interesting disparity in satisfaction might be attributed to the higher number, frequency, and overlapping activities of pharmaceutically-sponsored meetings, probable perceived biases, or due to dominance of early COVID-19-related topics at that time. Moreover, International conferences are annual events, that usually lack commercial biases, and are eligible for higher CME accreditation, than pharmaceutically-sponsored events.

However, the majority (75.5%) reported feeling overwhelmed with the frequency of online meetings during this period, more than half (52.5%) attended less than 25% of webinars they are invited to, and (73.3%) felt the need for proper regulations of this practice. Furthermore, 62.8% disagreed that online format can replace in-person meetings afterwards.

These findings were in line with other surveys by Figueroa et al. [12] and Al-Ahmari et al. [13], where around 60% to 70% of physicians believed that webinars should not replace face-to-face traditional teaching after the pandemic, respectively. Moreover, similar findings were found among medical students in a study that included 13 medical schools, where 54.8% disagreed that e-learning could be used for clinical teaching [14].

Interestingly, similar findings extended to physicians’ attitude towards online consultations with patients. In a survey study of 140 physicians from Lebanon, the vast majority of responders disagreed, or remained undecided, as to whether “telemedicine” can replace face-to-face consultations [15].

Respondents reported several reasons for dissatisfaction including: the overwhelming number and frequency, lack of scheduling, increase screen time exposure especially with shifting practice to telemedicine, technical difficulties, increased stress from either attending too many or too little webinars for fear of missing out on educational activities, in addition to disturbance of work/life balance, as most webinars occur during weekends or after working hours. In a study evaluating challenges to online medical education during the COVID-19 pandemic in Saudi Arabia [5], poor communication (59%), lack of assessment (57.5%), technology-related issues (56.5%), online inexperience (55%), pandemic-related anxiety or stress (48%), time management (35%), and technophobia (17%) were the commonly reported factors. In the same study, 62.5% of respondents preferred combining online with traditional face-to-face education, 25.5% preferred traditional face-to-face, and only 12.0% preferred online education alone.

The “Anywhere-Anytime” feature of webinars were found to be especially beneficial at the beginning of COVID-19 pandemic. However, this same feature was reported to be one the most relevant reasons for dissatisfaction. Physicians’ satisfaction largely affects the willingness to continuously use the platform. Online education advantages are numerous including time and location flexibility, being less costly, possibility of self-paced education, and accommodation of a wider audience. However, they also pose several disadvantages such as technical difficulties, less communication with attendees, slow response time with low Internet connection, increase distraction during webinars, limited feedback and assessment, and absence of socialization in comparison to the traditional ways [16, 17]. Moreover, it is well known that high screen time exposure can be linked to increase stress, sleep disturbance, fatigue, anxiety and depression [18, 19]. Furthermore, little evidence has been presented regarding the efficiency and efficacy of online education compared to traditional methods, especially with the huge differences between countries in digital advancement [20], in addition to difficulties to replicate in-person clinical bedside experiences virtually.

Higher satisfaction among speakers in comparison to attendees can be understood in the light of several studies, showing that acceptance of change is affected primarily by the degree to which individuals are involved in the change process. In other words, participation in implementing the various aspects of online education leads to significantly less resistance to this change [21].

Recommendations

William Osler once said, “Medicine is learned by the bedside and not in the classroom” [22].

With this in mind, and though attending webinars is optional, it became a major avenue to maintain the provision of medical education remotely for the time being. The debate about their benefits and limitations is still ongoing, and despite earlier attempts to regulate online education in general [23, 24], the majority of respondents agreed that regulations are needed, as part of preparation for future pandemics or other disruptions to medical education. The following recommendations are suggested based on our survey findings, and a review of the current literature [2534].

1-Webinars should be regulated through the local/ regional scientific organizations to arrange for the timing, frequency, and topics, in order to avoid repetition and overlapping activities and to help limiting screen-time exposure. In numerous everyday domains, it has been demonstrated that increasing the number of options can lead to a choice paralysis and decrease satisfaction; the so-called “paradox of choice” [25]. A predetermined monthly schedule can be helpful in avoiding overwhelm and burnout.

2- Inconvenient timing was found to be the most important concern in our survey. Most respondents preferred avoiding working hours and weekends, to avoid disruption of work/life balance, however, time zone differences still remain an important challenge for International events. Studies have shown that the best time to hold a webinar is mid-week, with a strong preference for Tuesday and Wednesday [26].

3- Research in the field of “brain-based learning” has resulted in some useful “learner-centered” techniques for planning the content of webinars to maintain high attention and concentration levels: e.g. sessions should be 20 minutes or less, followed by 5 minutes of discussion, stimulation of as many of the learner’s senses as possible using images, question-response modules, games, or role-playing, and to provide timely assessment and feedback [26].

4- Webinars should be concise, well-structured, and having clear objectives. Most general webinars should not be longer than one hour in total, whereas webinars presenting highly technical content, or webinars for training purposes, can be up to a maximum of 1.5 hours [27, 28].

5- Speakers should be highly qualified, well known, and respected in their field. If more than one speaker is required, those with opposing views can be chosen, to make the discussion livelier.

6-The scientific content should be novel, updated, and non-biased. The virtual experience should be enriched with multimodal learning elements including videos, images, and audio files, rather than merely presenting slides, in order to attract and engage more audience. Moreover, emphasis on social interaction among participants is crucial [29, 30].

7- The “two-way interaction” of teaching must be implemented. Knowledge assessment can be made prior to and after webinars, to ensure better understanding of the subjects. An interactive Q&A during live sessions is also beneficial [31, 32].

8—CME accreditation is important to ensure high quality of webinars, as physicians usually require a specified number of credits annually to maintain medical licenses.

9- Technical issues should be addressed, in order to ensure digital equity. Internet connection problems is a difficulty that needs to be anticipated, as not all attendees/speakers have access to the same amount of bandwidth [33, 34].

10-A recorded version of the lectures can be kept for a specific period of time, to allow for better self-paced learning.

Limitations

Our study has some limitations which should be stated. First, being a cross-sectional survey study carries a potential for certain biases. Moreover, respondents self-selected themselves into the study via social media, which may be prone to selection bias, with nearly third of respondents from neurology and psychiatry. However, the other two-thirds came from a representative sample of different medical and surgical specialties. Furthermore, the majority of respondents were from physicians working in MENA countries, which could limit the generalizability of our results to other geographical regions. The results of this survey should be interpreted as descriptive, aiming to assess attitude of a defined population, towards a specific target, during a specific period of time. Second, our study was not designed to allow for sub-analysis of physicians’ satisfaction according to different medical or surgical specialties, and further research is needed to understand satisfaction can differ between specialties. Finally, the survey was not validated, due to time constraints during the COVID-19 crisis, and the need to assess the outcome in a timely manner, which might limit the reliability in assessing physicians’ attitude. However, we conducted a pilot study on a random sample of 25 physicians before distributing the survey, to determine its feasibility.

Conclusion

The impact of COVID-19 pandemic on medical education has been significant all over the world. Webinars and online meetings provided the best avenue for teaching during this global crisis. Despite its several advantages, this paradigm shift came suddenly and without proper preparation from the educational organizations, and lacked proper regulations. Physicians in our study showed initial satisfaction with this shift, with higher satisfaction levels for “International conferences” and “teaching courses” compared to “pharmaceutically-sponsored meeting”. However, the majority felt overwhelmed with the number and frequency of webinars, more than half attend less than quarter of webinars they were invited to, and most respondents thought it needs proper regulations. Moreover, two-thirds of physicians disagreed that webinars can replace in-person meetings. Considering that this current crisis will most likely have long lasting effects, webinars should be viewed as complementing traditional in-person methods, rather than replacement, while aiming for normalcy.

The findings and recommendations from this study highlight the importance of physicians’ satisfaction in future planning of long-term strategies for online medical education. Further general and specialty-specific studies are needed to modify and refine proper online educational tools.

Supporting information

S1 Appendix. Survey questions.

(DOCX)

Acknowledgments

We would like to express our thanks and gratitude to our colleagues who participated by answering this survey study.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Phelan AL, Katz R, Gostin LO. The novel coronavirus originating in Wuhan, China: challenges for global health governance. Jama. 2020. February 25;323(8):709–10. 10.1001/jama.2020.1097 [DOI] [PubMed] [Google Scholar]
  • 2.Ahmed H., Allaf M. and Elghazaly H. (2020) ‘COVID-19 and medical education’, The Lancet. Online First. Published: March 23, 2020. 10.1016/S1473-3099(20)30226-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Li L, Xv Q, Yan J. COVID-19: the need for continuous medical education and training. The Lancet Respiratory Medicine. 2020. April 1;8(4):e23. 10.1016/S2213-2600(20)30125-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wroclawski M, Heldwein FL. Editorial Comment: Digital Physician Burnout in the “New Normal” Workplace. Journal of Endourology. 2020. November 5. 10.1089/end.2020.0631 [DOI] [PubMed] [Google Scholar]
  • 5.Rajab MH, Gazal AM, Alkattan K. Challenges to Online Medical Education During the COVID-19 Pandemic. Cureus. 2020. July 2;12(7):e8966. 10.7759/cureus.8966 ; PMCID: PMC7398724. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ferrel MN, Ryan JJ. The impact of COVID-19 on medical education. Cureus. 2020. March;12(3). 10.7759/cureus.7492 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Dedeilia A, Sotiropoulos MG, Hanrahan JG, Janga D, Dedeilias P, Sideris M. Medical and surgical education challenges and innovations in the COVID-19 era: a systematic review. in vivo. 2020. June 1;34(3 suppl):1603–11. 10.21873/invivo.11950 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Paudel P. Online education: Benefits, challenges and strategies during and after COVID-19 in higher education. International Journal on Studies in Education. 2021;3(2):70–85. [Google Scholar]
  • 9.Nepal PR. Role of Webinars in Medical Educations during Pandemic of COVID 19. Eastern Green Neurosurgery. 2020. June 3;2(2):1–2. [Google Scholar]
  • 10.Navia A, Berner JE, Pereira N, Reissis D, Rakhorst H, Cuadra A. Have We Passed the Peak? The COVID-19 Plastic Surgery Webinar Pandemic. Aesthet Surg J. 2020;40(9):NP569–NP573. 10.1093/asj/sjaa163 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Cauchemez S, Van Kerkhove MD, Archer BN, Cetron M, Cowling BJ, Grove P, et al. School closures during the 2009 influenza pandemic: national and local experiences. BMC infectious diseases. 2014. December 1;14(1):207. 10.1186/1471-2334-14-207 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Figueroa F, Figueroa D, Calvo-Mena R, Narvaez F, Medina N, Prieto J. Orthopedic surgery residents’ perception of online education in their programs during the COVID-19 pandemic: should it be maintained after the crisis?. Acta Orthopaedica. 2020. June 12:1–4. 10.1080/17453674.2020.1776461 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Al-Ahmari AN, Ajlan AM, Bajunaid K, Alotaibi NM, Al-Habib H, Sabbagh AJ, et al. Perception of Neurosurgery Residents and Attendings on Online Webinars During COVID-19 Pandemic and Implications on Future Education. World Neurosurgery. 2020. November 9. 10.1016/j.wneu.2020.11.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Alsoufi A, Alsuyihili A, Msherghi A, Elhadi A, Atiyah H, Ashini A, et al. Impact of the COVID-19 pandemic on medical education: Medical students’ knowledge, attitudes, and practices regarding electronic learning. PloS one. 2020. November 25;15(11):e0242905. 10.1371/journal.pone.0242905 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Helou S, El Helou E, Abou-Khalil V, Wakim J, El Helou J, Daher A, et al. The effect of the COVID-19 pandemic on physicians’ use and perception of telehealth: The case of Lebanon. International journal of environmental research and public health. 2020. Jan;17(13):4866. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Radović-Marković M. Advantages and disadvantages of e-learning in comparison to traditional forms of learning. Annals of the University of Petroşani, Economics. 2010;10(2):289–98. [Google Scholar]
  • 17.Goh PS, Sandars J. A vision of the use of technology in medical education after the COVID-19 pandemic. MedEdPublish. 2020. March 26;9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Kummer TF, Recker J, Bick M. Technology-induced anxiety: Manifestations, cultural influences, and its effect on the adoption of sensor-based technology in German and Australian hospitals. Information & Management. 2017. January 1;54(1):73–89. [Google Scholar]
  • 19.Rosen L, Carrier LM, Miller A, Rokkum J, Ruiz A. Sleeping with technology: cognitive, affective, and technology usage predictors of sleep problems among college students. Sleep health. 2016. March 1;2(1):49–56. 10.1016/j.sleh.2015.11.003 [DOI] [PubMed] [Google Scholar]
  • 20.Adedoyin OB, Soykan E. Covid-19 pandemic and online learning: the challenges and opportunities. Interactive Learning Environments. 2020. September 3:1–3. [Google Scholar]
  • 21.Mitchell LD, Parlamis JD, Claiborne SA. Overcoming faculty avoidance of online education: From resistance to support to active participation. Journal of Management Education. 2015. June;39(3):350–71. [Google Scholar]
  • 22.Bliss M. William Osler: A life in medicine. Oxford University Press; 1999. November 18. [Google Scholar]
  • 23.Guanci G. Best practices for webinars. Creative nursing. 2010. Aug 1;16(3):119–21. [DOI] [PubMed] [Google Scholar]
  • 24.Mbati L, Minnaar A. Guidelines towards the facilitation of interactive online learning programmes in higher education. International Review of Research in Open and Distributed Learning. 2015;16(2):272–87. [Google Scholar]
  • 25.Bassett RL. The Paradox of Choice: Why More is Less. How the Culture of Abundance Robs us of Satisfaction. Journal of Psychology and Christianity. 2007. April 1;26(1):87. [Google Scholar]
  • 26.Bedford N., 2016. Webinar Best Practices. [Google Scholar]
  • 27.Reyna J, Todd B, Hanham J. A Practical Framework to Design Educational Webinars in the Age of COVID-19. InEdMedia+ Innovate Learning 2020 Jun 23 (pp. 265–271). Association for the Advancement of Computing in Education (AACE). [Google Scholar]
  • 28.Molay K. Best Practices for Webinars: Increasing attendance, engaging your audience, and successfully advancing your business goals. Adobe Systems Incorporated. Retrieved September. 2009;29:2011. [Google Scholar]
  • 29.Zoumenou V, Sigman-Grant M, Coleman G, Malekian F, Zee JM, Fountain BJ, et al. Identifying best practices for an interactive webinar. Journal of Family & Consumer Sciences. 2015. June 1;107(2):62–9. [Google Scholar]
  • 30.Hilliard JD, Rahman M, Chambless LB, Asthagiri AR, Fogleson MA, Angelos C. Evaluation of CNS Webinars Format Based on Participant Engagement. Neurosurgery. 2020. November 15;67(Supplement_1). [Google Scholar]
  • 31.Foster MJ, Shurtz S, Pepper C. Evaluation of best practices in the design of online evidence-based practice instructional modules. Journal of the Medical Library Association: JMLA. 2014. January;102(1):31. 10.3163/1536-5050.102.1.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chen T, Peng L, Yin X, Rong J, Yang J, Cong G. Analysis of user satisfaction with online education platforms in China during the COVID-19 pandemic. InHealthcare 2020 Sep (Vol. 8, No. 3, p. 200). Multidisciplinary Digital Publishing Institute. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Reyna J, 2020, ’Twelve Tips for COVID-19 friendly learning design in medical education’, MedEdPublish, 9, [1], 103, 10.15694/mep.2020.000103.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Schifferdecker KE, Reed VA. Using mixed methods research in medical education: basic guidelines for researchers. Medical education. 2009. July;43(7):637–44. 10.1111/j.1365-2923.2009.03386.x [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Itamar Ashkenazi

1 Feb 2021

PONE-D-20-39984

Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When Less is More

PLOS ONE

Dear Dr. Ismail,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I wish to be sincere and say that of five reviewers, four presented significant issues, questioning whether the study as performed, deserves to be accepted for publication.  I would like to emphasize one criticism in a positive way.  The overwhelming majority of the responders were from Arab countries. Consider transforming your study into one that relates to this specific population. 

Please submit your revised manuscript by Mar 18 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Itamar Ashkenazi

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files-

4. Please upload a copy of Figure 3, to which you refer in your text on page 17. If the figure is no longer to be included as part of the submission please remove all reference to it within the text.

5. Please ensure that you refer to Figure 1 in your text as, if accepted, production will need this reference to link the reader to the figure.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Partly

Reviewer #4: Partly

Reviewer #5: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: I Don't Know

Reviewer #4: Yes

Reviewer #5: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: No

Reviewer #5: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: No

Reviewer #4: No

Reviewer #5: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Presentation

I appreciate the amount of work the authors have undertaken in this endeavor and have a few suggestions and clarifications that I hope may add to the value of this submitted manuscript.

1. Abstract

• The title of the article is clear and describes the focus of the study.

• The abstract is well structured and describes the study.

2. Introduction, the rationale and overall impact of the review are not clear. Some parts of the introduction need greater references to the evidence base.

3. Methods, the method section is in detail but there is no flow and many relevant pieces of information are missing:

• For international readers, and for readers who may wish to cite this study, it might be helpful for the authors to provide a brief overview of training activities at this particular institution to better facilitate an understanding of the results and discussion, especially as it applies to other institutions.

• Sampling technique and sampling size was not mentioned

• What were the baseline characteristics of the physicians such as qualification, specialties etc.

• How the consent from the physicians was taken?

• Who designed the survey?

• How the validity of the instrument was checked and what was the reliability score?

• It seems the snowball technique was not effectively used. Authors need to review the technique and explain in detail such as how they contact the first group, from where they got other contacts, who provided further contacts, and so on. In the snowball technique researcher asks for contacts and then asks contacts for participation. I am really curious about the process; how many reminders were sent and what was the logic for closing the link on November 15?

• The significance level should be checked.

4. Results & discussion, well written but the discussion needs more relevant referencing.

5. Conclusion, is relevant but due to major problems with the methods, it is really difficult to comment. In the conclusion, it would be useful to put the ideas in the context of what has been found. What is novel from this study? Strangely the validity of the tool was not done. Also, I am confused with the reason of “time constraint”. This needs further explanation.

6. Recommendations, are too long and most of them are not based on the results. Please review it.

7. References, Vancouver style was not followed.

8. It is unclear the additional value of this manuscript contributes to the literature beyond just a description of an attempt at investigating the physicians’ attitude toward webinars. The authors may need to highlight the values/implications of the current study (In the Introduction sections).

I also suggest careful editing of the manuscript to ensure clarity.

Reviewer #2: Dear authors

Thank you for submitting your manuscript to the PLOS ONE journal. Your study is a cross-sectional study using a questionnaire. I think this manuscript is suitable for a letter to the editor. There is no novelty in the idea or the design.

Reviewer #3: The overall outcomes of this study are interesting and highlights the feelings of physicians on using online methods for CME etc. However, I feel that in parts it is superficial and needs re-written.

To me there needs to be greater clarity in how the results are being presented and discussed, with more cited comparisons (where appropriate) of the specific points.

I also think that some interesting points that the survey has identified have been overlooked and would have made for further discussion.

In the main the recommendations are good but follow a common-sense approach that many institutions already expect.

Given the International nature of medical education these days it is hard to select a time that suits all possible attendees around the world. The authors recommendation number 1 is therefore particularly difficult to address, unless it is time zone specific.

There is a good argument for having an institutional body to coordinate local CME activities, but again it is extremely difficult to coordinate if it is a webinar being presented by a specific professional society in another country. In the end it should be up to the physician to decide which webinar they want to attend or not.

Specific points

Abstract - I think this needs to be re-written on the basis of comments on the full paper.

Introduction -

Page 10. Line 19. What ‘proper regulation’ are the authors alluding to at this point in the paper?

Page 10. Line 20. ‘several challenges and disadvantages have been reported by physicians.’ Is there a reference to this report?

Page 11. Line 10. Details of the ‘snowball technique’ should be provided.

Page 11. Line 17. How was a random sample of 25 physicians achieved? It is not clear how that was truly random

It is not clear why a distinction was drawn between international events and pharmaceutical sponsored events. this should be explained.

Statistical analysis. I don’t think there is a need to include the dates that analysis was done.

Kolmogorov- Smirnov – should include ‘non-parametric test’

Results.

Why mention only female respondents and their age range? I think male respondents and their age range should also be included. That would make an interesting comparison.

The way that the sentences 1 and 2 are written, suggests that the mean years of experience relates to the female respondents.

Page 14. Lines 9 and 10. ’Most of the respondents; 270 (82.8%) were mostly attendees’ or ‘15 (4.6%) were mostly speakers’ – using the term ‘mostly’ makes this unclear.

Page 15. The figures presented in the first 2 paragraphs, indicate that respondents answered twice or more. Perhaps these results should be presented as a ranked order of preferences.

Page 15. Line 19. ‘that webinars and online meetings need further regulations’. If they need further regulation, what were the initial regulations?

Discussion

Page 16. Lines 2 & 3. Again, results are being described as ‘mostly’.

Page 16. Line 20. ‘Moreover, the satisfaction with the scientific content was also higher between them (81.9% vs 36.8%)’. This statement needs to clarify between which groups.

Page 17. line 4. The authors again mention the need for further regulations, but there has been no mention of existing regulations.

Page 18 line 1. It is not clear what the authors mean by poor communication, slow response time and increased distraction. I think these should be clarified.

Page 18. Line 5. Suggestion – ‘Furthermore, little evidence has been presented…..’

Recommendations.

Page 19. Line 6. ‘Studies have shown……’ Needs a reference here.

Page 19. Line 8. ‘Research in the field…..’ Needs a reference here.

Page 20. Line 1. ‘The virtual experience should be enriched…’ It would be helpful if the authors gave examples of enrichment.

Conclusion.

The authors confuse the issue here. One the one hand they say ‘lacked proper regulation’ and on the other they say ‘the need for further regulation’, implying that there was some form of regulation in the first place.

Reviewer #4: Dear respected Authors,

Thanks for your efforts on doing research and trying to contribute to the field of continuing medical education.

I have found your research question interesting and read your manuscript with interest.

Nonetheless, I have a few concerns regarding the manuscript which once addressed I believe would make the manuscript better.

Abstract: Overall fine. It is better to rephrase “continuous medical education” to “continuing medical education (CME)”.

Introduction:

The claims in the second paragraph should supported with relevant literature.

In the purpose statement it has been stated that you aimed to assess “physicians’ attitude” which requires to use a valid reliable scale. Your aim could be defining the “physicians’ reactions” with the survey you developed.

Method:

Your sampling method sounds more like convenience sampling rather than snowball sampling. I believe one of the major problems with your manuscript is the distribution of the survey questionnaire relatively uncontrolled way. Although you have distributed your survey questionnaire via multiple social media platforms, you have received vast majority of the responses from Middle East and North Africa region? Could it because of the survey questionnaire language? Was it in English or Arabic? This information should be included in the text.

What happened after the pilot study of the survey? Were there any changes or additions to the questionnaire?

Google Forms statement repeated multiple times in the manuscript which seems unnecessary.

While it is a good measure to ask sign-in into Google accounts to avoid multiple responses from participants, this is also a limitation for “possible participants” who are not regularly using Google accounts or reluctant to log in. I think it would be better to express this as a limitation.

Data analysis time span is not a requisite information for reporting. Could be removed from the text.

Results:

It would be good to add the country of origin of the respondents in table_1 if you have the data.

I think one of the most interesting results of your research is that the high dissatisfaction level of shifting pharmaceutical company (industry) sponsored meetings to online. This should be discussed more in discussion.

In the recommendations section, it would be better to cite relevant literature at the end of each item so that your contributions would be much clearer.

In the tables the presentation as “No. (%) is not a usual reporting style, should be rewritten as N (%)

Your manuscript would benefit from a careful proofreading related to English language usage.

Overall, I found your research interesting. But your manuscript needs some revisions which I stated above. In addition, I think that your manuscript is not contributing to the literature new or original results or conclusions.

I hope this would help to improve your manuscript.

Respectfully,

Reviewer #5: This manuscript evaluates a dramatic, sudden, and unexpected change in physician education. This is an important topic, not only for evaluation for current practices, but to consider the benefits future synergy between in-person and virtual learning. This manuscript proves some important evaluation of physician impressions of this transition, yet I believe it is somewhat limited in data that contribute to the conclusions provided. This could be improved by a more in-depth description of similar publications and careful consideration of the conclusions presented.

Introduction:

Some statements in the introduction seemed to bias the reader to the author's perspective and were opinion-based instead of facts. For example: "physicians have been bombarded with scientific webinars like no other time" and "Although at first, webinars seemed like a novelty, and probably the only solution for continuous medical education, however, months into the pandemic, these online meetings have lost much of their initial charm."

More of a review on previous research would be more appropriate and put this study in context. The authors state "There are limited data in the literature regarding physicians’ attitude and satisfaction towards this sudden shift in medical education" yet don't summarize any specific other publications at all in the introduction.

Methods:

Were any of the questions based on similar studies?

A complete list of the questions and possible responses would be helpful. Table 1 appears to be a partial list.

Results:

The question regarding "Attending more webinars" stated that the average of webinars observed this year had an average of 3 webinars; however, because the number of webinars observed last year was not given, it is unclear how much "more" is; this comparison seems crucial.

The authors discuss several types of virtual webinars, yet some questions seem to generalize. For example, for the question asking if webinars can replace in-person meetings, it seems like the answers may depend on the type of webinar offered (training courses, conferences, sponsored meetings). This is an example where having the full list of questions and responses could help interpretation.

Discussion:

Statistically speaking, as an overwhelming majority of responses were from the middle east, the discussion should focus on that population of physicians. There is not a broad enough representation across countries to make broader generalizations.

In describing % response comparisons of groups, providing a p value would be helpful (i.e. "This satisfaction was higher with International conferences and teaching courses compared to pharmaceutically-sponsored meetings (74.5% vs 41.4%)."

In the paragraph describing reasons for dissatisfaction in webinars, it would be helpful to get a sense of the frequency of similar responses to convert anecdotal feedback into generalizable statements.

For the recommendations, it would be helpful to place each recommendation in the context of previous literature. For example, some recommendations (#3, 4, 5, 6, 7) do not directly follow from the data in this study.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Mitra Amini

Reviewer #3: No

Reviewer #4: No

Reviewer #5: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 16;16(4):e0250241. doi: 10.1371/journal.pone.0250241.r002

Author response to Decision Letter 0


17 Feb 2021

Response to editor and reviewers’ comments

Dear Editor

Thank you for evaluating our manuscript. We have read with great concern the comments raised by the editor and reviewers, and we are glad to address and respond to these comments accordingly.

Editor’s comment:

I wish to be sincere and say that of five reviewers, four presented significant issues, questioning whether the study as performed, deserves to be accepted for publication. I would like to emphasize one criticism in a positive way. The overwhelming majority of the responders were from Arab countries. Consider transforming your study into one that relates to this specific population

We would like to thank the Editor for positive criticism, and we agree with the Editor on this point. More than 90% of the responders were from Arab and Middle East countries. We agree that this can limit the generalizability of our results. We emphasized on this point in the abstract, manuscript and mentioned it in Limitations section as well. All the changes made to the original draft are highlighted in yellow.

Reviewer’s comment:

Reviewer #1:

Presentation

I appreciate the amount of work the authors have undertaken in this endeavor and have a few suggestions and clarifications that I hope may add to the value of this submitted manuscript.

1. Abstract

• The title of the article is clear and describes the focus of the study.

• The abstract is well structured and describes the study.

2. Introduction, the rationale and overall impact of the review are not clear. Some parts of the introduction need greater references to the evidence base.

3. Methods, the method section is in detail but there is no flow and many relevant pieces of information are missing:

• For international readers, and for readers who may wish to cite this study, it might be helpful for the authors to provide a brief overview of training activities at this particular institution to better facilitate an understanding of the results and discussion, especially as it applies to other institutions.

• Sampling technique and sampling size was not mentioned

• What were the baseline characteristics of the physicians such as qualification, specialties etc.

• How the consent from the physicians was taken?

• Who designed the survey?

• How the validity of the instrument was checked and what was the reliability score?

• It seems the snowball technique was not effectively used. Authors need to review the technique and explain in detail such as how they contact the first group, from where they got other contacts, who provided further contacts, and so on. In the snowball technique researcher asks for contacts and then asks contacts for participation. I am really curious about the process; how many reminders were sent and what was the logic for closing the link on November 15?

• The significance level should be checked.

4. Results & discussion, well written but the discussion needs more relevant referencing.

5. Conclusion, is relevant but due to major problems with the methods, it is really difficult to comment. In the conclusion, it would be useful to put the ideas in the context of what has been found. What is novel from this study? Strangely the validity of the tool was not done. Also, I am confused with the reason of “time constraint”. This needs further explanation.

6. Recommendations, are too long and most of them are not based on the results. Please review it.

7. References, Vancouver style was not followed.

8. It is unclear the additional value of this manuscript contributes to the literature beyond just a description of an attempt at investigating the physicians’ attitude toward webinars. The authors may need to highlight the values/implications of the current study (In the Introduction sections).

I also suggest careful editing of the manuscript to ensure clarity.

Response to Reviewer 1:

1-We would like to thank Reviewer 1 for his appreciation, and we are glad to respond to the comments accordingly.

2- We updated the Introduction section with the needed references.

3- (a) As regard to the training activities for our institution, it included general online webinars in neurology, teaching courses on specific subjects (e.g. Botox injection), International Neurology conferences, and pharmaceutically sponsored meetings discussing specific therapies. However, the survey was distributed to other specialties which might has some differences. We added this part to the Methods section as per your recommendations.

4- (b) As regard to the “snow-ball technique” used, the survey was initially distributed to the contacts of the primary investigators, and posted on personal social media accounts of the authors. Then it was posted on several and medical social media group. Responders were instructed to further distribute the survey to their contacts. The survey closed when there were no more responses for 1 day. This was mentioned in the Methods section (Line 166-167).

5- (c) Baseline characteristics of the physicians were mentioned in the Results section, table 1, and table 2. It included demographic variables, specialties, and years of experience in their fields (instead of specific degrees, as this can be different in between countries).

(d) Accepting to fill the survey was considered an implied consent to participate in the study, as approved by the Institutional Review Board Committee, based on the fact that completing the survey was voluntary, and all answers were confidential. This is mentioned in Methods section.

(e) The survey was designed by the authors of the study, and tested on a pilot of 25 physicians before distribution to physicians. The survey was not validated, and this was mentioned in the limitations section.

(f) Significance of the obtained results was judged at the 5% level.

Thank you for amending the Results & Discussion. We updated the Discussion section with more relevant references as requested.

5- We agree with the reviewer comment and Conclusion section was updated accordingly.

6- Recommendations were equally based on the findings from responses from our survey, and we augmented this with a review of the current literature, as mentioned in the manuscript. It was formulated into points for simplicity and clarity. It can be further shortened if needed.

7- We updated the references in Vancouver Style as needed.

8- We believe this study is important in several aspects. First, this sudden change in education is new to physicians, and the number and frequency of webinars was found to be overwhelming to the majority of physicians. Second, we believe this study highlights such problem, and suggests further recommendations to regulate this “new-normal” practice. We further highlighted this in the Introduction section.

Reviewer #2:

Dear authors

Thank you for submitting your manuscript to the PLOS ONE journal. Your study is a cross-sectional study using a questionnaire. I think this manuscript is suitable for a letter to the editor. There is no novelty in the idea or the design.

Response to Reviewer 2:

We would like to thank Reviewer 2 for the interest in our cross-sectional study. The format suitable for publication is different among journals, and is decided by the journal’s Editor. We believe that the study is descriptive to an important topic, in addition to the suggested recommendations, which needs to be highlighted in the current format.

Reviewer #3:

The overall outcomes of this study are interesting and highlights the feelings of physicians on using online methods for CME etc. However, I feel that in parts it is superficial and needs re-written.

To me there needs to be greater clarity in how the results are being presented and discussed, with more cited comparisons (where appropriate) of the specific points.

I also think that some interesting points that the survey has identified have been overlooked and would have made for further discussion.

In the main the recommendations are good but follow a common-sense approach that many institutions already expect.

Given the International nature of medical education these days it is hard to select a time that suits all possible attendees around the world. The authors recommendation number 1 is therefore particularly difficult to address, unless it is time zone specific.

There is a good argument for having an institutional body to coordinate local CME activities, but again it is extremely difficult to coordinate if it is a webinar being presented by a specific professional society in another country. In the end it should be up to the physician to decide which webinar they want to attend or not.

Response to Reviewer 3:

We would like to thank Reviewer 3 for his interest in the study, and we are glad to respond to the comments accordingly. We agree with the Reviewer that some interesting points in the study needs further elucidation with more relevant references, and we updated the manuscript. As regard to the best timing, it should be regulated according to the institutional decision, however, the recommended time was based on responses from our responders and from literature review. However, we updated this point and mentioned that attending is a personal choice.

Response to specific points:

Abstract: We updated the abstract after reading the full comments from reviewers on the manuscript.

Introduction -

Page 10. Line 19. What ‘proper regulation’ are the authors alluding to at this point in the paper?

As these changes in practice amid COVID-19 pandemic were sudden and unprecedented, we believe that “proper regulations” were needed as regard to the best teaching format, best timing to conduct webinars, proper method for feedback, ..etc. Most physicians needed to continue medical education while dealing with COVID-19 pandemic, and this was not possible with the number and frequency of webinars at the time. We updated the Introduction section with these important points.

Page 10. Line 20. ‘several challenges and disadvantages have been reported by physicians.’ Is there a reference to this report?

A reference was added to the manuscript.

Page 11. Line 10. Details of the ‘snowball technique’ should be provided.

Done. We explained more on this issue.

Page 11. Line 17. How was a random sample of 25 physicians achieved? It is not clear how that was truly random

Each author sent the questionnaire to a random of 10 of his contacts, and 25 responded which was considered a convenience sample to this pilot. We updated the manuscript. Line 129

It is not clear why a distinction was drawn between international events and pharmaceutical sponsored events. this should be explained.

We thank the reviewer for this remark, and we believe this important issue should be explained more. International conferences are less frequent (usually annual), contain many webinars in a short period of time, not commercially biased, and eligible for higher CME accreditation, than pharmaceutically-sponsored events. We updated the manuscript accordingly. (Line 268-273)

Statistical analysis. I don’t think there is a need to include the dates that analysis was done.

We removed this line from the manuscript.

Kolmogorov- Smirnov – should include ‘non-parametric test’

Done. The manuscript was updated accordingly

Results.

Why mention only female respondents and their age range? I think male respondents and their age range should also be included. That would make an interesting comparison. The way that the sentences 1 and 2 are written, suggests that the mean years of experience relates to the female respondents.

Done. We updated this part as requested. The mean age and mean years of experience were performed for the whole cohort.

Page 14. Lines 9 and 10. ’Most of the respondents; 270 (82.8%) were mostly attendees’ or ‘15 (4.6%) were mostly speakers’ – using the term ‘mostly’ makes this unclear.

Because some respondents are both speakers and attendees, and some are only attendees, we agreed to add “mostly” to illustrate their major roles in the webinars they participate in. We put the words between brackets and in italics to remove this unclarity.

Page 15. The figures presented in the first 2 paragraphs, indicate that respondents answered twice or more. Perhaps these results should be presented as a ranked order of preferences.

This is an important point. However, in the study we used a 5-point Likert scale of agreeableness ('strongly disagree', 'disagree', 'neutral', 'agree', and 'strongly agree’) against certain questions, which does not allow for ranking according to preference. Both figures (1) and (2) represent a stacked bar chart of these Likert questions. Two tables were also added to summarize the findings, and the survey questions were added as a supplementary file. (Appendix A).

Page 15. Line 19. ‘that webinars and online meetings need further regulations’. If they need further regulation, what were the initial regulations?

Some regulations for online education and webinars in general are available:

- Guanci G. Best practices for webinars. Creative nursing. 2010 Aug 1;16(3):119-21.

- Mbati L, Minnaar A. Guidelines towards the facilitation of interactive online learning programmes in higher education. International Review of Research in Open and Distributed Learning. 2015;16(2):272-87.

However, no such studies were performed for the current situation following COVID-19 pandemic, and this was one of the main goals of this study. We updated this part in the manuscript.

Discussion

Page 16. Lines 2 & 3. Again, results are being described as ‘mostly’.

We updated the manuscript for this point.

Page 16. Line 20. ‘Moreover, the satisfaction with the scientific content was also higher between them (81.9% vs 36.8%)’. This statement needs to clarify between which groups.

Done. Line 268

Page 17. line 4. The authors again mention the need for further regulations, but there has been no mention of existing regulations.

We updated this point as stated in the Recommendations section.

Page 18 line 1. It is not clear what the authors mean by poor communication, slow response time and increased distraction. I think these should be clarified.

We updated this point. Online education has less communication with attendees, slow response time with low Internet connection, increase distraction during webinars.

Page 18. Line 5. Suggestion – ‘Furthermore, little evidence has been presented…..’

Done

Recommendations.

Page 19. Line 6. ‘Studies have shown……’ Needs a reference here.

Page 19. Line 8. ‘Research in the field…..’ Needs a reference here.

In this section, the recommendations were pooled from the responses we had from the participating physicians, and from a review of the literature. It was then formulated into points for simplification and clarity. The literature review was derived from references number (25-32) for further reading.

Page 20. Line 1. ‘The virtual experience should be enriched…’ It would be helpful if the authors gave examples of enrichment.

Done. We updated this point.

Conclusion.

The authors confuse the issue here. One the one hand they say ‘lacked proper regulation’ and on the other they say ‘the need for further regulation’, implying that there was some form of regulation in the first place.

We understand the confusion in this point. There have been several mentions of regulations for webinars in general in the literature. However, no specific recommendations were suggested for medical education during times of crisis or movement restrictions as in the current pandemic. We updated this point to remove such confusion and used the word “proper” throughout the manuscript.

Reviewer #4:

Dear respected Authors,

Thanks for your efforts on doing research and trying to contribute to the field of continuing medical education.

I have found your research question interesting and read your manuscript with interest.

Nonetheless, I have a few concerns regarding the manuscript which once addressed I believe would make the manuscript better.

Response to Reviewer 4:

We would like to thank Reviewer 4 for his interest in the study, and we are glad to respond to the comments accordingly.

Abstract: Overall fine. It is better to rephrase “continuous medical education” to “continuing medical education (CME)”.

Done. We updated this part.

Introduction:

The claims in the second paragraph should supported with relevant literature.

We agree and updated this section.

In the purpose statement it has been stated that you aimed to assess “physicians’ attitude” which requires to use a valid reliable scale. Your aim could be defining the “physicians’ reactions” with the survey you developed.

We agree that a valid scale would have given more robust data. However, such scale assessing the desired outcome (attitude to medical education amid COVID-19 pandemic) is not available, to our knowledge. However, our scale was tested in a pilot study, and this was stated in the Methods and Limitations section.

Method:

Your sampling method sounds more like convenience sampling rather than snowball sampling. I believe one of the major problems with your manuscript is the distribution of the survey questionnaire relatively uncontrolled way. Although you have distributed your survey questionnaire via multiple social media platforms, you have received vast majority of the responses from Middle East and North Africa region? Could it because of the survey questionnaire language? Was it in English or Arabic? This information should be included in the text.

We used a “snowball technique” in distributing the survey. The initial responders were from the contacts of the primary investigators who were mostly from the MENA region. However, responders were advised to recruit further participants through the snowball technique. The survey was also posted on several medical Facebook group, which also had majority of members from MENA region. We agree about this point and added it to Limitations section.

What happened after the pilot study of the survey? Were there any changes or additions to the questionnaire?

Each author sent the questionnaire to a random of 10 of his contacts, and 25 responded, which was considered a convenient sample to this pilot.

Yes, there had been some changes after the pilot mainly regarding formulation of questions, formulation of response preferences, and adding some demographic variables.

Google Forms statement repeated multiple times in the manuscript which seems unnecessary.

Done, we updated the manuscript regarding this point.

While it is a good measure to ask sign-in into Google accounts to avoid multiple responses from participants, this is also a limitation for “possible participants” who are not regularly using Google accounts or reluctant to log in. I think it would be better to express this as a limitation.

We had a discussion regarding this point before distributing the survey, and we agreed to accept only signed-in responses to have more credible data, and to avoid multiple responses. We thought of this as a point of strength actually, but if it is necessary to add it to limitations we can do this.

Data analysis time span is not a requisite information for reporting. Could be removed from the text.

Done, we removed it.

Results:

It would be good to add the country of origin of the respondents in table_1 if you have the data.

Unfortunately, this data is not available. We only collected the country of practice.

I think one of the most interesting results of your research is that the high dissatisfaction level of shifting pharmaceutical company (industry) sponsored meetings to online. This should be discussed more in discussion.

We agree about this part. And we elucidated more on this in the discussion. Lines 268-273

In the recommendations section, it would be better to cite relevant literature at the end of each item so that your contributions would be much clearer.

In this section, the recommendations were pooled from the responses we had from the participating physicians, and from a review of the current literature. It was then formulated into points for simplification and clarity. The literature review was derived from references number (25-32) for future reading.

In the tables the presentation as “No. (%) is not a usual reporting style, should be rewritten as N (%)

Done, we updated it.

Your manuscript would benefit from a careful proofreading related to English language usage. Overall, I found your research interesting. But your manuscript needs some revisions which I stated above. In addition, I think that your manuscript is not contributing to the literature new or original results or conclusions.

I hope this would help to improve your manuscript.

Respectfully,

We thank the reviewer and we updated the manuscript as recommended. We believe physicians’ attitude towards online education is important in planning future educational activities, as for now, this sudden shift is unregulated and perceived by the majority as overwhelming.

Reviewer #5:

This manuscript evaluates a dramatic, sudden, and unexpected change in physician education. This is an important topic, not only for evaluation for current practices, but to consider the benefits future synergy between in-person and virtual learning. This manuscript proves some important evaluation of physician impressions of this transition, yet I believe it is somewhat limited in data that contribute to the conclusions provided. This could be improved by a more in-depth description of similar publications and careful consideration of the conclusions presented.

Response to Reviewer 5:

We would like to thank Reviewer 5 for the interest and constructive remarks. We are glad to address the requested comments.

Introduction:

Some statements in the introduction seemed to bias the reader to the author's perspective and were opinion-based instead of facts. For example: "physicians have been bombarded with scientific webinars like no other time" and "Although at first, webinars seemed like a novelty, and probably the only solution for continuous medical education, however, months into the pandemic, these online meetings have lost much of their initial charm."

More of a review on previous research would be more appropriate and put this study in context. The authors state "There are limited data in the literature regarding physicians’ attitude and satisfaction towards this sudden shift in medical education" yet don't summarize any specific other publications at all in the introduction.

We agree with the reviewer on this point, and updated the manuscript. The other publications were summarized in the Discussion section rather than Introduction, due to space limitations. However, we added the references to such publications in the Introduction section. (Ref 7 and 8)

Methods:

Were any of the questions based on similar studies?

A complete list of the questions and possible responses would be helpful. Table 1 appears to be a partial list.

The questions were based on similar literature assessing physician’s attitudes towards certain outcomes. It was tested and remodified in a pilot study. We added the full list of the questions as a supplementary file.

Results:

The question regarding "Attending more webinars" stated that the average of webinars observed this year had an average of 3 webinars; however, because the number of webinars observed last year was not given, it is unclear how much "more" is; this comparison seems crucial.

We agree that this information is crucial. Because the vast majority of respondents reported not attending webinars at all during the last year, but around 60% attended more meetings in general this year, the results were presented in such manner. We updated the manuscript as requested.

The authors discuss several types of virtual webinars, yet some questions seem to generalize. For example, for the question asking if webinars can replace in-person meetings, it seems like the answers may depend on the type of webinar offered (training courses, conferences, sponsored meetings). This is an example where having the full list of questions and responses could help interpretation.

In this question, we aimed to have a general perception of this sudden shift in educational format, and if it can replace in-person traditional teaching, regardless of the type of webinars. The rationale is that this online format is relatively new to the medical community, and most educational activities used to be in-person. The attitude towards different types was evaluated in other questions.

Discussion:

Statistically speaking, as an overwhelming majority of responses were from the middle east, the discussion should focus on that population of physicians. There is not a broad enough representation across countries to make broader generalizations.

We agree with the reviewer on this point. The majority of physicians were working in Arab and MENA countries. We focused more in the discussion about this point as requested, and also mentioned this in the Limitations part.

In describing % response comparisons of groups, providing a p value would be helpful (i.e. "This satisfaction was higher with International conferences and teaching courses compared to pharmaceutically-sponsored meetings (74.5% vs 41.4%)."

We updated this part in Results and Discussion. New tables were added including these findings (Tables 3,4).

In the paragraph describing reasons for dissatisfaction in webinars, it would be helpful to get a sense of the frequency of similar responses to convert anecdotal feedback into generalizable statements.

We agree with this point and updated the manuscript accordingly. From line 294-300.

For the recommendations, it would be helpful to place each recommendation in the context of previous literature. For example, some recommendations (#3, 4, 5, 6, 7) do not directly follow from the data in this study.

In this section, the recommendations were pooled from the responses we had from the participating physicians, and from a review of the literature. It was then formulated into points for simplification and clarity. The literature review was derived from references number (25-32) for further reading.

Attachment

Submitted filename: Response to editor and reviewers PLOS ONE.docx

Decision Letter 1

Itamar Ashkenazi

22 Mar 2021

PONE-D-20-39984R1

Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When Less is More

PLOS ONE

Dear Dr. Ismail,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by May 06 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Itamar Ashkenazi

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #4: (No Response)

Reviewer #5: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #4: Partly

Reviewer #5: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #4: Yes

Reviewer #5: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #4: No

Reviewer #5: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #4: Dear Respected Authors,

Thanks for your efforts trying to improve your research manuscript according to the reviewers' comments and suggestions.

Although you have mentioned you agree that a valid scale needed to be able to measure the "attitude" of physicians, you did not made any changes or improvements in neither title nor text of your manuscript.

Pilot study is still unclear in terms of method and findings in the manuscript.

Best regards

Reviewer #5: Thank you for your resubmission of your publication. I have several comments, mostly relating to my initial evaluation. One new comment is in regards to your statistical analysis in Table 3 and 4. I am not sure what your comparisons are for each question. You used a Goodness of Fit, but I'm not sure what your comparison values were. Any statistical analysis on these responses doesn't seem necessary.

Regarding your survey population, I believe the response group should be noted in the title or abstract.

For your recommendations at the end of the paper, it would be helpful if you referenced the other publications that recommendations not directly related to your study are from. You mention that some of the recommendations are from feedback in your survey; could you add the specific text they provided? (ie. Recommendation 2 does not cite the publication for preference for Tuesday; Recommendation 3 mentions previous work on seminar length but does not cite it; 5-7 seem to be more opinions)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #4: No

Reviewer #5: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 16;16(4):e0250241. doi: 10.1371/journal.pone.0250241.r004

Author response to Decision Letter 1


23 Mar 2021

Review Comments to the Author

Reviewer #1: (No Response)

Reviewer #4:

Dear Respected Authors,

Thanks for your efforts trying to improve your research manuscript according to the reviewers' comments and suggestions.

Although you have mentioned you agree that a valid scale needed to be able to measure the "attitude" of physicians, you did not made any changes or improvements in neither title nor text of your manuscript.

We would like to thank the respected reviewer for the constructive remarks. We agree with the reviewer that our survey was not validated, and this was mentioned in the Limitations section. We used 5-point Likert scale of agreeableness which has been used in several studies to measure attitude towards different variables. We updated the limitations section as regard to the reliability in measuring attitude.

Pilot study is still unclear in terms of method and findings in the manuscript.

Each author sent the questionnaire to a random of 10 physicians of his contacts, and 25 responded, which was considered a convenient sample to this pilot. The Methods section was updated (Line 129-134), highlighted in green.

Best regards

Reviewer #5:

Thank you for your resubmission of your publication. I have several comments, mostly relating to my initial evaluation. One new comment is in regards to your statistical analysis in Table 3 and 4. I am not sure what your comparisons are for each question. You used a Goodness of Fit, but I'm not sure what your comparison values were. Any statistical analysis on these responses doesn't seem necessary.

We would like to thank the reviewer for the constructive remarks. These tables were added upon your suggestions to add (p value) in describing the responses. However, we can remove them and keep the p values only, if this is recommended and acceptable by the journal editor.

Regarding your survey population, I believe the response group should be noted in the title or abstract.

We added this point to the abstract (highlighted in green) as suggested. We focused on this point in the Discussion as requested. Also, this was mentioned in the Limitations part.

For your recommendations at the end of the paper, it would be helpful if you referenced the other publications that recommendations not directly related to your study are from. You mention that some of the recommendations are from feedback in your survey; could you add the specific text they provided? (ie. Recommendation 2 does not cite the publication for preference for Tuesday; Recommendation 3 mentions previous work on seminar length but does not cite it; 5-7 seem to be more opinions)

We updated this part in the manuscript and assigned the references used for these recommendations.

Attachment

Submitted filename: RESPONSE to editor and reviewers PLOS R2.docx

Decision Letter 2

Itamar Ashkenazi

5 Apr 2021

Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When Less is More

PONE-D-20-39984R2

Dear Dr. Ismail,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Itamar Ashkenazi

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Itamar Ashkenazi

8 Apr 2021

PONE-D-20-39984R2

Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When Less is More

Dear Dr. Ismail:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Itamar Ashkenazi

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Survey questions.

    (DOCX)

    Attachment

    Submitted filename: Response to editor and reviewers PLOS ONE.docx

    Attachment

    Submitted filename: RESPONSE to editor and reviewers PLOS R2.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES