Skip to main content
PLOS One logoLink to PLOS One
. 2021 Aug 12;16(8):e0255992. doi: 10.1371/journal.pone.0255992

Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada

Ellen Stephenson 1,*, Debra A Butt 1,2, Jessica Gronsbell 1,3, Catherine Ji 1,4, Braden O’Neill 1,5,6, Noah Crampton 1,4, Karen Tu 1,4,7
Editor: Christine Leong8
PMCID: PMC8360367  PMID: 34383844

Abstract

Purpose

We aimed to determine the degree to which reasons for primary care visits changed during the COVID-19 pandemic.

Methods

We used data from the University of Toronto Practice Based Research Network (UTOPIAN) to compare the most common reasons for primary care visits before and after the onset of the COVID-19 pandemic, focusing on the number of visits and the number of patients seen for each of the 25 most common diagnostic codes. The proportion of visits involving virtual care was assessed as a secondary outcome.

Results

UTOPIAN family physicians (N = 379) conducted 702,093 visits, involving 264,942 patients between March 14 and December 31, 2019 (pre-pandemic period), and 667,612 visits, involving 218,335 patients between March 14 and December 31, 2020 (pandemic period). Anxiety was the most common reason for visit, accounting for 9.2% of the total visit volume during the pandemic compared to 6.5% the year before. Diabetes and hypertension remained among the top 5 reasons for visit during the pandemic, but there were 23.7% and 26.2% fewer visits and 19.5% and 28.8% fewer individual patients accessing care for diabetes and hypertension, respectively. Preventive care visits were substantially reduced, with 89.0% fewer periodic health exams and 16.2% fewer well-baby visits. During the pandemic, virtual care became the dominant care format (77.5% virtual visits). Visits for anxiety and depression were the most common reasons for a virtual visit (90.6% virtual visits).

Conclusion

The decrease in primary care visit volumes during the COVID-19 pandemic varied based on the reason for the visit, with increases in visits for anxiety and decreases for preventive care and visits for chronic diseases. Implications of increased demands for mental health services and gaps in preventive care and chronic disease management may require focused efforts in primary care.

Introduction

The COVID-19 pandemic has presented unprecedented challenges in primary health care worldwide since it was first declared in March 2020 [15]. Governments around the world have implemented policies to prioritize the use of health care resources to treat patients with COVID-19 and to prevent the spread of the disease [6], including decreasing non-COVID hospital admissions [7] and delaying elective surgeries [8]. In primary care settings, physicians were encouraged to triage medical appointments, prioritize services that would prevent acute care hospitalization, and increase their use of virtual care [1, 912]. Although changes in primary care practice occurred rapidly in response to the COVID-19 pandemic, the implications of these changes have yet to be determined.

The World Organization of Family Doctors (WONCA) Europe has identified a lack of evidence regarding the management of non-COVID-19 patients in primary care during the pandemic [13]. To fill this gap, we first need to know the reasons why patients seek primary care, and how this may have changed during the COVID-19 pandemic. A 2018 review found that acute respiratory infections, chronic diseases (i.e., hypertension, diabetes, arthritis), anxiety or depression, routine health maintenance, and back pain were among the most common clinician reported reasons for a primary care visit [14]. In Canada, over half of family physician visits involve patients with chronic diseases, and this increases with advancing age [15, 16]. There is some evidence that older Canadians accessed more primary care visits during the pandemic than younger Canadians [17, 18], however the reasons for those visits are unknown. Without knowing the degree to which different types of primary care services were impacted by the pandemic, it is difficult to estimate the value of the forgone care and the potential implications for health outcomes.

The goal of the current study was to determine the impact of COVID-19 on the most common reasons for primary care visits in Ontario, Canada’s largest provincial health system. We examined a region of Ontario with the greatest number of COVID-19 cases and the extent to which the effect of the COVID-19 pandemic and the uptake of virtual care varied based on the reason for the primary care visit.

Methods

Study design

We used a repeated cross-sectional design in which primary care visits for a fixed cohort of family physicians were sampled after the onset of the COVID-19 pandemic (March 14-December 31, 2020) and the same time the year before (March 14-December 31, 2019). The same time period was used in 2019 and 2020 to account for any potential seasonal variation in reasons for primary care visits [19]. The start of the pandemic period was defined as March 14, 2020 when the Ontario Ministry of Health introduced new physician billing codes for the provision of virtual care via telephone or video [20]. Prior to this, virtual visits in primary care were not widely utilized [21].

Data source and setting

We used data from the University of Toronto Practice-Based Research Network (UTOPIAN) Data Safe Haven, a primary care electronic medical record (EMR) database [22]. This database includes records from family medicine clinics in Ontario, Canada, with most physicians practicing in the Greater Toronto Area, a region of Ontario that has consistently had the highest number of COVID-19 cases [23]. The number of confirmed cases of COVID-19 per capita was more than 1.5 times higher for public health units in Peel (2.5 per million) and Toronto (1.9 per million) relative to the provincial average (1.2 per million) as of December 31, 2020 [24]. Public health measures implemented to control the spread of COVID-19 included closures of schools and non-essential businesses, travel restrictions, instructions to only leave home for essential purposes such as accessing medical services, mandatory mask wearing in indoor public spaces, and limiting the size of social gatherings.

Ontario has a government run single payer health insurance system that provides coverage for hospital and primary care services to most residents through the Ontario Health Insurance Plan (OHIP). Family physicians use their EMR system to bill OHIP for the services they provide, such that an OHIP billing code and corresponding diagnostic code are recorded for all encounters documented in the EMR database. OHIP service codes for diabetes, prenatal care and periodic health exams do not require an accompanying diagnostic code [25]. In these instances, we inferred the relevant diagnostic code if none was billed along with one of these OHIP service codes (S1 Appendix).

A cohort of physicians and patients who met minimum data quality requirements and were active within the EMR during the study period were selected for inclusion in the current study (Fig 1). To be eligible to contribute EMR data, family physicians had to meet minimum standards for data quality (S2 Appendix) and have started using their EMR prior to March 14, 2019. All patients who were registered to an eligible physician, had a valid age and sex recorded in the EMR, and had at least one visit during the observation period were eligible for inclusion. Billing records with an OHIP service code for an office or virtual visit were included (S3 Appendix).

Fig 1. Record selection process.

Fig 1

Outcome measures

We selected the 25 most frequently used diagnostic codes from March 14-December 31, 2019 (pre-pandemic period) and compared these to the 25 most frequently used diagnostic codes for the same time period in 2020 (pandemic period). To understand the impact of COVID-19 on the use of each of the top 25 diagnostic codes, we compared three outcomes during the pre-pandemic and pandemic periods: (i) the number of times each diagnostic code was billed (number of visits), (ii) the number of unique patients seen at least once for a visit associated with each diagnostic code (number of visitors), and (iii) the number of visits relative to the number of patients who visited at least once (visits per visitor). Separating the change in the number of visits into a change in the number of unique visitors and a change in the number of visits per visitor allowed us to examine pandemic-related changes in healthcare use (vs. non-use) separately from the effects of the pandemic on intensity of healthcare use. This is an important distinction to make because healthcare use and intensity have been found to be affected by different factors [26].

To better understand not only changes in visit volume, but also changes in visit format that occurred during the pandemic, we examined the uptake of virtual care by reason for visit. Because virtual care was not widely available before the pandemic, we calculated the proportion of visits that occurred via telephone or video during the pandemic period for each diagnosis code as a secondary outcome measure.

Statistical analysis

We examined each outcome in the pre-pandemic and pandemic periods along with the percentage change from the pre-pandemic to pandemic period. To further understand the impact of the pandemic on healthcare volume at the physician-level, we fit Poisson regression models to estimate the relative difference in (i) the number of visits and (ii) the number of visitors per physician in the pre-pandemic and pandemic periods. To account for within-physician correlation over time, we used generalized estimating equations (GEEs) to estimate the model parameters [27, 28] and adopted a working exchangeable correlation structure. We calculated standard errors, two-sided p-values, 95% confidence intervals (CIs) for the rate ratios using the robust sandwich estimator. Statistical significance was based on two-sided p-values at the 0.05 level.

Ethics approval

This study was approved through the University of Toronto (#40129) and North York General Hospital (#20–0044) research ethics boards. Physicians in this study provided written informed consent to have their EMR data extracted, de-identified, and used for research purposes; patients can opt out of uses for research.

Results

Sample description

Sociodemographic characteristics of patients and physicians included in the current study are summarized in Table 1. All physicians practiced as part of a blended capitation model [29]. Patients who were female, older age, and higher income were overrepresented in the sample relative to the Ontario population, but this is consistent with characteristics of health care users [30]. UTOPIAN family physicians were more likely to be younger, female, and Canadian medical graduates relative to family physicians across Ontario. Family physicians included in the current study (N = 379) conducted 702,093 primary care visits, involving 264,942 patients with at least one visit (mean number of visits per visitor = 2.65) during the pre-pandemic period. During the pandemic period, the total number of visits dropped to 667,612 (-4.9%) and the total number of patients with at least one visit dropped to 218,335 (-17.6%), such that the mean number of visits per visitor increased to 3.06.

Table 1. Physician and patient characteristics.

UTOPIAN Family Physicians (N = 379) Ontario Family Physicians
N % %
Sex
Female 232 61.2 49.5
Male 147 38.8 50.5
Age (years)
< 30 <5 <1
30–44 153 40.4 33.3
45–64 156 41.2 48.1
65–74 37 9.8 14.5
≥ 75 <5 <1 3.5
Missing 29 7.7
Medical School Graduation
Canada 341 90.0 55.3
Other (including United States) 38 10.0 25.5
Patients with at least one visit during pre-pandemic period (N = 264,942) Patients with at least one visit during pandemic period (N = 218,335) Ontario population
N % N % %
Sex
Female 154,706 58.4 130,984 60.0 50.6
Male 110,236 41.6 87,351 40.0 49.4
Age (years)
<19 39,000 14.7 28,229 12.9 21.5
19–34 43,603 16.5 37,769 17.3 21.2
34–49 52,182 19.7 43,834 20.1 19.4
50–64 62,758 23.7 52,020 23.8 20.6
>64 67,399 25.4 56,483 25.9 17.3
Neighborhood income quintile
1 (Lowest income) 51,882 19.6 42,518 19.3
2 45,325 17.1 37,070 16.9
3 44,997 17.0 36,901 16.9
4 47,894 18.0 39,292 18.1
5 (Highest income) 68,168 25.7 55,757 25.7
Missing 6,676 2.5 6,797 3.1

Ontario population estimates for age and sex are based on Statistics Canada data for July 1, 2019. Physician age, sex, and medical graduation for Ontario family physicians are based on results from a 2021 report using the ICES Physician Database [17]. † Not available in source used for the Ontario population.

Most frequent reasons for visit

The 25 most frequently billed diagnostic codes associated with visits in the pre-pandemic period are listed in Table 2. The most common reasons for visit during the pandemic were similar but included the new diagnostic OHIP code for coronavirus, which was the 19th most frequent reason for a visit during the 2020 pandemic period (N = 7,523 visits; 1.1% of total visit volume). Anxiety, diabetes, and hypertension remained the most common reasons for visit both pre-pandemic and during the pandemic, whereas periodic health exam and common cold were the 4th and 5th most common reason pre-pandemic but dropped to 39th and 13th place during the pandemic (Table 2).

Table 2. Frequency of the most common diagnostic codes billed for primary care visits.

Pre- COVID (March 14-December 31, 2019) COVID (March 14-December 31, 2020) Difference
Diagnostic code Most common associated description* Rank Number of visits (% of total visit volume) Rank Number of visits (% of total visit volume) Percentage change in number of visits
300 Anxiety 1 45,629 (6.5) 1 61,121 (9.2) 34.0
250 Diabetes 2 43,548 (6.2) 2 33,246 (5.0) -23.7
401 Hypertension 3 40,414 (5.8) 3 29,824 (4.5) -26.2
917 Periodic Health Exam 4 31,739 (4.5) 39 3,479 (0.5) -89.0
460 Common Cold 5 23,010 (3.3) 13 11,165 (1.7) -51.5
787 Abdominal Pain 6 21,240 (3.0) 4 24,384 (3.7) 14.8
781 Musculoskeletal Pain 7 21,046 (3.0) 5 21,703 (3.3) 3.1
916 Well Baby Care 8 19,626 (2.8) 8 16,451 (2.5) -16.2
799 Ill-defined Conditions 9 19,387 (2.8) 6 20,547 (3.1) 6.0
650 Pregnancy/Delivery 10 17,986 (2.6) 7 19,236 (2.9) 6.9
691 Eczema 11 13,295 (1.9) 9 13,824 (2.1) 4.0
724 Back Pain 12 11,647 (1.7) 11 11,735 (1.8) 0.8
715 Osteoarthritis 13 10,287 (1.5) 16 8,551 (1.3) -16.9
785 Chest Pain 14 10,031 (1.4) 10 11,950 (1.8) 19.1
780 Vertigo, Dizziness, Headache 15 9,845 (1.4) 12 11,544 (1.7) 17.3
895 Family Planning 16 9,824 (1.4) 15 9,216 (1.4) -6.2
786 Cough, Epistaxis 17 9,553 (1.4) 17 8,509 (1.3) -10.9
896 Immunization 18 8,668 (1.2) 26 5,846 (0.9) -32.6
599 Hematuria 19 8,010 (1.1) 14 10,481 (1.6) 30.8
311 Depression 20 7,979 (1.1) 18 8,491 (1.3) 6.4
847 Strain, Sprain, Back Pain 21 6,990 (1.0) 23 6,332 (0.9) -9.4
727 Tendonitis, Bunion 22 6,979 (1.0) 25 6,156 (0.9) -11.8
796 Fatigue 23 6,357 (0.9) 21 6,723 (1.0) 5.8
709 Mole, Other Disorders of Skin 24 6,063 (0.9) 22 6,433 (1.0) 6.1
272 Hypercholesterolemia 25 5,743 (0.8) 27 5,639 (0.8) -1.8
Top 25 < 26 41,4896 (59.1) 372,586 (55.8) -10.6
All All visits 702,093 (100.0) 667,612 (100.0) -4.9

These 25 diagnostic codes were selected based on how frequently they were billed in March 14-December 31, 2019. The top 25 diagnostic codes used in the 2020 period also included codes for coronavirus (N = 7,523; 1.1%), menstrual disorders (N = 6,825; 1.0%), and cystitis (N = 6,197; 0.9%).

*The most common description associated with each diagnostic code is provided above; a full list of all diagnoses associated with each code is provided in the supplementary appendix. One visit was counted per patient per date and less than 1% of visits involved the use of multiple diagnostic codes.

Changes in the number of visits by reason for visit

Relative to the pre-pandemic period, the total number of visits during the pandemic period was lower for chronic conditions (diabetes, hypertension, osteoarthritis), preventive care (periodic health exams, immunizations, well-baby care), common cold, and family planning, higher for anxiety, abdominal pain, chest pain, headache, and hematuria, and unchanged for pregnancy/delivery, eczema, musculoskeletal pain, back pain, fatigue, and other ill-defined conditions (Table 2). The largest change in visit volume was observed for periodic health exams (-89.0%), which accounted for 4.5% of all visits pre-pandemic, but ceased almost entirely after the onset of the pandemic (0.5% of visits).

Changes in the number of patients accessing care by reason for visit

Although the number of visits for some conditions increased, this did not always mean that more individual patients were accessing care. Anxiety and hematuria were the only diagnostic codes with more individual patients accessing care during the pandemic period than in the pre-pandemic period. In most cases there was a decline in the number of individual patients accessing care (i.e., visiting at least once), and this was accompanied by an increase in the number of contacts for those who did visit their family physician (i.e., more visits per visitor; Table 3). Decreases in the number of patients with at least one visit during the pandemic were especially pronounced for periodic health exams (-89.1%), common cold (-55.6%), immunizations (-33.3%), hypertension (-28.8%), osteoarthritis (-22.9%), and diabetes (-19.5%). Diabetes was the only diagnostic code where the intensity of visits relative to the number of visitors decreased during the pandemic. The number of visits per visitor increased the most for mental health concerns with a 21.6% and 10.2% increase in the number of visits per visitor for anxiety and depression, respectively.

Table 3. Number of visitors and visits per visitor by reason for visit.

Type of reason for visit Diagnostic code Most common associated description* Number of visitors Number of visits per visitor
Pre COVID COVID % Change Pre COVID COVID % Change
Mental health 300 Anxiety 25962 28610 10.2 1.76 2.14 21.6
311 Depression 4795 4645 -3.1 1.66 1.83 10.2
Chronic disease 401 Hypertension 24922 17734 -28.8 1.62 1.68 3.7
250 Diabetes 21585 17380 -19.5 2.02 1.91 -5.4
715 Osteoarthritis 7609 5867 -22.9 1.35 1.46 8.1
Preventive care 917 Periodic Health Exam 31568 3437 -89.1 1.01 1.01 0.0
916 Well Baby Care 8093 6553 -19.0 2.43 2.51 3.3
896 Immunization 7418 4947 -33.3 1.17 1.18 0.9
Other 460 Common Cold 19474 8650 -55.6 1.18 1.29 9.3
787 Abdominal Pain 16877 16509 -2.2 1.26 1.48 17.5
781 Musculoskeletal Pain 16240 14598 -10.1 1.30 1.49 14.6
799 Ill-defined Conditions 16007 15444 -3.5 1.21 1.33 9.9
650 Pregnancy/Delivery 4960 4952 -0.2 3.63 3.88 6.9
691 Eczema 11404 10754 -5.7 1.17 1.29 10.3
724 Back Pain 8672 7328 -15.5 1.34 1.60 19.4
785 Chest Pain 8413 8685 3.2 1.19 1.38 16.0
786 Cough, Epistaxis 8180 6314 -22.8 1.17 1.35 15.4
895 Family Planning 8166 6970 -14.6 1.20 1.32 10.0
780 Vertigo, Dizziness, Headache 8157 8321 2.0 1.21 1.39 14.9
599 Hematuria 6544 7313 11.8 1.22 1.43 17.2
727 Tendonitis, Bunion 5617 4540 -19.2 1.24 1.36 9.7
796 Fatigue 5552 5327 -4.1 1.14 1.26 10.5
709 Mole, Other Disorders of Skin 5471 5353 -2.2 1.11 1.20 8.1
847 Strain, Sprain, Back Pain 5165 4206 -18.6 1.35 1.51 11.9
272 Hypercholesterolemia 4941 4677 -5.3 1.16 1.21 4.3

*The most common description associated with each diagnostic code is provided above; a full list of all diagnoses associated with each code is provided in the supplementary appendix.

Fig 2 shows the extent to which the change in the number of visits associated with each diagnostic code is the result of a change in the frequency of distinct visitors and/or a change in the intensity of service use among visitors.

Fig 2. Change in visit and visitor volume by reason for visit during the COVID-19 pandemic.

Fig 2

When the rate ratio for visits in larger than the rate ratio for visitors (i.e., interval is further to the right), this indicates that the intensity of visits per visitor increased during the pandemic. When the rate ratio for visits in smaller than the rate ratio for visitors (i.e., interval is further to the left), this indicates that the intensity of visits per visitor decreased during the pandemic.

Virtual care uptake by reason for visit

During the pandemic, virtual care became the dominant care format with virtual visits accounting for 77.5% of all primary care visits. Visits for immunizations, periodic health exams, well-baby care and pre-natal care were most likely to continue occurring in person, with less than half of these visits occurring virtually (Table 4). Visits for anxiety and depression were among the most common reasons for a virtual visit, with 90.6% of visits for these concerns during the pandemic occurring virtually.

Table 4. Rate of virtual visits during the COVID-19 pandemic for the most common diagnoses.

Diagnostic code Most common associated description* Number of virtual visits Percentage of visits involving virtual care
272 Hypercholesterolemia 5142 91.2
300 Anxiety 55370 90.6
311 Depression 7678 90.4
460 Common Cold 9971 89.3
599 Hematuria 9064 86.5
786 Cough, Epistaxis 7296 85.7
796 Fatigue 5661 84.2
847 Strain, Sprain, Back Pain 5310 83.9
724 Back Pain 9810 83.6
781 Musculoskeletal Pain 17784 81.9
787 Abdominal Pain 19911 81.7
780 Vertigo, Dizziness, Headache 9400 81.4
799 Ill-defined Conditions 16589 80.7
785 Chest Pain 9454 79.1
691 Eczema 10691 77.3
715 Osteoarthritis 6540 76.5
401 Hypertension 22634 75.9
709 Mole, Other Disorders of Skin 4691 72.9
250 Diabetes 23531 70.8
727 Tendonitis, Bunion 4300 69.9
895 Family Planning 6208 67.4
896 Immunization 2708 46.3
650 Pregnancy/Delivery 7867 40.9
916 Well Baby Care 3716 22.6
917 Periodic Health Exam 770 22.1

*The most common description associated with each diagnostic code is provided above; a full list of all diagnoses associated with each code is provided in the supplementary appendix. One visit was counted per patient per date and less than 1% of visits involved the use of multiple diagnostic codes.

Discussion

There were marked changes during the COVID-19 pandemic in the top reasons for visiting a family physician, when compared with before the pandemic, with substantial changes in the frequency of some types of visits more than others. Overall, visits for chronic disease and preventive care decreased, while visits for mental health concerns increased. For many conditions (e.g., pregnancy, skin disorders, various types of pain), there was no change in the number of patients accessing care but the intensity of visits per visitor increased. Taken together our findings highlight some important patterns of change in primary care visits that have implications for the delivery of primary care moving forward.

Increased demand for mental health support

Anxiety and depression have been among the most common reasons for consulting a family physician in recent decades [14, 22], and the pandemic has increased the demand for these services even more. Before the pandemic, 7.6% of primary care visits in our sample were for anxiety or depression and this increased to 10.5% after the onset of the pandemic. This is consistent with concurrent reports from primary care physician surveys, with 61–76% reporting an increase in the number of patients with mental or emotional health needs [31, 32]. Our findings suggest that both the number of individuals presenting in primary care with anxiety and the number of visits per visitor increased during the pandemic. The ability to offer virtual visits over the telephone or video may have allowed physicians to conduct follow-up appointments more regularly with patients presenting with symptoms of anxiety, resulting in a greater number of visits per patient on average. Results from representative samples of the general population suggest that rates of anxiety and depression have increased since the onset of the COVID-19 pandemic [3335], but this has not necessarily resulted in an increase in anxiety/depression diagnoses made by primary care physicians [36, 37]. More research is needed to understand how family physicians are responding to the increase in mental health concerns and effective approaches for addressing the needs of distressed patients.

Reduced preventive care

In Ontario, periodic health visits that focus on preventive care represent 4–8% of services provided by family physicians [38]. We found that periodic health visits ceased almost entirely with the onset of the COVID-19 pandemic, which is consistent with other reports of physicians limiting and patients avoiding seeking preventive care [39, 40]. There are concerns that the pandemic has led to a reduction in preventive services that are often delivered as part of a periodic health visit, including cancer screening [4143], vaccinations [44, 45], and screening for chronic diseases [46], and that this will result in delayed diagnosis and worse disease outcomes. On the other hand, past research has found little evidence that general health checks, including periodic health visits, reduce morbidity and mortality for patients [47, 48]. The pandemic has created the conditions for a “natural experiment” that may help elucidate the value of visits focused on preventive care. Within the UTOPIAN database, there is now a cohort of patients who can be followed over time to identify potential health consequences that may result because of missed/delayed periodic health exam visits.

Adding to these concerns, we found that primary care visits where the main reason for the visit was immunizations dropped by 32.6%. Disruptions to the provision of routine childhood immunizations and decrease in adequate coverage for vaccine-preventable diseases due to the pandemic have been reported worldwide [4952]. The volume of well-baby visits (during which childhood immunizations are usually provided) was 16.2% lower during the pandemic in our studied cohort. More research is needed to determine if this decrease has translated into missed or delayed routine immunizations in our patient population.

Reduced care for chronic disease

We found that during the pandemic, diabetes, hypertension, and osteoarthritis continued to be among the most common reasons for consulting a family physician, but that the frequency of visits and the number of unique individuals accessing care for these chronic conditions decreased. Many primary care physicians in Canada and the United States reported limiting chronic care on surveys conducted at the start of the pandemic [39, 53], and continue to do so almost a year later [54]. The reduced care being provided for chronic conditions may result in poor disease control among those who already have the condition (e.g., higher Hemoglobin A1C, higher blood pressure) as well as less disease prevention for those at risk. The format of care delivery is also important to consider, given that 75.9% of visits for hypertension and 70.8% of visits for diabetes in the current study occurred virtually. A study of primary care visits in the United States found that blood pressure and cholesterol levels were less likely to be assessed and new treatments for hypertension were less likely to be initiated in virtual visits relative to office visits [55]. Efforts have been made to adapt current guidelines to support the management of chronic disease in primary care during COVID-19, including the use of virtual care for patients with type 2 diabetes [56] and hypertension [57]. However, more research is needed to provide evidence of the effectiveness of these new approaches to chronic disease management.

Limitations

Although the top 25 diagnostic billing codes assessed in the current study covered the majority of the primary care visits that occurred and these codes provide information about the primary reason for a visit, they do not necessarily capture all the issues addressed in a visit. Our findings should be interpreted with respect to changes in the clinician reported reason for visit, rather than the number of patients with a specific diagnosis. Data were drawn from a relatively large sample of physicians practicing in a high COVID region. Nevertheless, the findings are not necessarily representative of the experience across Ontario or in other health systems, especially those with lower COVID-19 case numbers. Our study compared primary care visits in only 2 time periods (pre-pandemic vs. during pandemic). We do not know to what extent the changes we observed included longer term trends in health services. However, the large effect sizes we observed are not consistent with past longitudinal research [58, 59], where a change in health service use of more than 30% occurred across 5 years rather than only 1 year. Although we were able to describe how the reasons for consulting a family physician changed after the onset of the COVID-19 pandemic, we do not know to what degree these changes are the result of changes in disease prevalence in the population (e.g., reduced rates of respiratory illness), reluctance among patients to seek healthcare services during the pandemic, and/or changes in provider availability or accessibility (e.g., providers unable to do in-person visits due to lack of personal protective equipment). It is likely that multiple factors are contributing to the changes we observed.

Conclusion

The COVID-19 pandemic has changed how and why patients are accessing primary care services. Not only have more primary care visits occurred via telephone and video but the reasons associated with those visits have also changed. Visits for mental health concerns have become more frequent, accounting for a larger proportion of the total visit volume in primary care. Prenatal and well-baby were most likely to occur in-person, rather than virtually. Some of the largest decreases seen for primary care visits were for preventive care and common chronic conditions, with fewer individuals accessing care. Continued attention should be paid to the implications of these changes in how family medicine is being practiced and potential impacts on health outcomes for patients.

Supporting information

S1 Appendix. Inferred diagnoses for missing diagnostic codes.

(DOCX)

S2 Appendix. Data quality criteria.

(DOCX)

S3 Appendix. Eligible service codes.

(DOCX)

S4 Appendix. Full diagnostic descriptions.

(DOCX)

Acknowledgments

Dr’s K Tu, D Butt, B O’Neill, N Crampton, C Ji receive Research Scholar Awards from the Department of Family and Community Medicine and/or the Rathlyn Foundation Primary Care EMR Research and Discovery Fund at the University of Toronto.

Data Availability

The research ethics approval for the use of UTOPIAN data does not permit making the data publicly available, as the data contain potentially identifiable patient information. Researchers interested in accessing EMR data from the UTOPIAN Data Safe Haven for research can apply to do so at: https://www.dfcm.utoronto.ca/getting-utopian-support.

Funding Statement

This study was made possible by a CIHR Operating Grant: COVID-19 Mental Health & Substance Use – Matching Access to Service with Needs: grant #450302 (PI: KT). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Huston P, Campbell J, Russell G, Goodyear-Smith F, Phillips RL, van Weel C, et al. COVID-19 and primary care in six countries. BJGP Open. 2020;4: bjgpopen20X101128. doi: 10.3399/bjgpopen20X101128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Griffin S. Covid-19: “Staggering number” of extra deaths in community is not explained by COVID-19. BMJ. 2020;1931: m1931. doi: 10.1136/bmj.m1931 [DOI] [PubMed] [Google Scholar]
  • 3.Kearon J, Risdon C. The role of primary care in a pandemic: reflections during the COVID-19 pandemic in Canada. J Prim Care Community Heal. 2020;11: 4–7. doi: 10.1177/2150132720962871 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Krist AH, Devoe JE, Cheng A, Ehrlich T, Jones SM. Redesigning primary care to address the COVID1-9 pandemic in the midst of the pandemic. Ann Fam Med. 2020;18: 349–354. doi: 10.1370/afm.2557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Marshall M, Howe A, Howsam G, Mulholland M, Leach J. COVID-19: A danger and an opportunity for the future of general practice. Br J Gen Pract. 2020;70: 270–271. doi: 10.3399/bjgp20X709937 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hale T, Angrist N, Cameron-Blake E, Hallas L, Kira B, Majumdar S, et al. Variation in government responses to COVID-19. BSG Work Pap Ser Blavatnik Sch Gov Univ Oxford. 2020; Version 8.0. Available: www.bsg.ox.ac.uk/covidtracker%0Awww.bsg.ox.ac.uk/covidtracker%0Ahttps://www.bsg.ox.ac.uk/research/publications/variation-government-responses-covid-19
  • 7.De Filippo O, D’Ascenzo F, Angelini F, Bocchino PP, Conrotto F, Saglietto A, et al. Reduced rate of hospital admissions for ACS during COVID-19 outbreak in Northern Italy. N Engl J Med. 2020;383: 88–89. doi: 10.1056/NEJMc2009166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Nepogodiev D, Omar OM, Glasbey JC, Li E, Simoes JFF, Abbott TEF, et al. Elective surgery cancellations due to the COVID-19 pandemic: global predictive modelling to inform surgical recovery plans. Br J Surg. 2020;107: 1440–1449. doi: 10.1002/bjs.11746 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Government of Canada. COVID-19 pandemic guidance health care sector. Available: https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/health-professionals/covid-19-pandemic-guidance-health-care-sector.html#a322
  • 10.Ontario Ministry of Health. Primary care changes in response to Corona Virus (COVID- 19) effective March 14, 2020. Negotiations Branch, Ministry of Health; 2020: Bulletin #11229. Available: http://health.gov.on.ca/en/pro/programs/ohip/bulletins/11000/bul11229.pdf
  • 11.Haldane V, Zhang Z, Abbas RF, Dodd W, Lau LL, Kidd MR, et al. National primary care responses to COVID-19: a rapid review of the literature. BMJ Open. 2020;10: 1–10. doi: 10.1136/bmjopen-2020-041622 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Saint-Lary O, Gautier S, Le Breton J, Gilberg S, Frappé P, Schuers M, et al. How GPs adapted their practices and organisations at the beginning of COVID-19 outbreak: a French national observational survey. BMJ Open. 2020;10. doi: 10.1136/bmjopen-2020-042119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Windak A, Frese T, Hummers E, Klemenc Ketis Z, Tsukagoshi S, Vilaseca J, et al. Academic general practice/family medicine in times of COVID-19–Perspective of WONCA Europe. Eur J Gen Pract. 2020;26: 182–188. doi: 10.1080/13814788.2020.1855136 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Finley CR, Chan DS, Garrison S, Korownyk C, Kolber MR, Campbell S, et al. What are the most common conditions in primary care? Systematic review. Can Fam Physician. 2018;64: 832–840. [PMC free article] [PubMed] [Google Scholar]
  • 15.Broemeling AM, Watson DE, Prebtani F. Population patterns of chronic health conditions, co-morbidity and healthcare use in Canada: implications for policy and practice. Healthcare Quarterly (Toronto, ON). 2008;11(3):70–76. doi: 10.12927/hcq.2008.19859 [DOI] [PubMed] [Google Scholar]
  • 16.Canadian Institute for Health Information. Chronic disease management in primary health care: A demonstration of EMR data for quality and health system monitoring. 2014; 1–16.
  • 17.Glazier RH, Green ME, Wu FC, Frymire E, Kopp A, Kiran T. Shifts in office and virtual primary care during the early COVID-19 pandemic in Ontario, Canada. Can Med Assoc J. 2021;193: 200–210. doi: 10.1503/cmaj.202303 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Stephenson E, O’Neill B, Gronsbell J, Butt DA, Crampton N, Ji C, et al. Changes in family medicine visits across sociodemographic groups after the onset of the COVID-19 pandemic in Ontario: a retrospective cohort study. CMAJ Open. 2021;9: E651 LP-E658. doi: 10.9778/cmajo.20210005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Moineddin R, Nie JX, Domb G, Leong AM, Upshur REG. Seasonality of primary care utilization for respiratory diseases in Ontario: a time-series analysis. BMC Health Serv Res. 2008;8: 1–6. doi: 10.1186/1472-6963-8-160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ontario Ministy of Health. Changes to the Schedule of Benefits for Physician Services (Schedule) in response to COVID-19 influenza pandemic effective March 14, 2020. Health Services Branch, Ministry of Health; 2020: Bulletin #4745. Available: http://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/4000/bul4745.aspx
  • 21.Agarwal P, Kithulegoda N, Umpierre R, Pawlovich J, Nunes J, Pereira D’avila O, et al. Telemedicine in the driver’s seat: new role for primary care access in Brazil and Canada. Can Fam Physician. 2020;66: 104–111. [PMC free article] [PubMed] [Google Scholar]
  • 22.Tu K, Sodhi S, Kidd M, et al. The University of Toronto Family Medicine Report: Caring for our Diverse Populations. Toronto, ON; 2020.
  • 23.Public Health Ontario. Weekly epidemiologic summary: COVID-19 in Ontario: focus on December 27, 2020 to January 2, 2021. 2020. Available: https://files.ontario.ca/moh-covid-19-weekly-epi-report-en-2021-01-02.pdf [Accessed June 22, 2021]
  • 24.Public Health Ontario. Daily epidemiologic summary: COVID-19 in Ontario: January 15, 2020 to December 31, 2020. 2020. Available: https://files.ontario.ca/moh-covid-19-report-en-2021-01-01.pdf [Accessed June 22, 2021]
  • 25.Ministry of Health and Longterm Care. Resource Manual for Physicians. 2015.
  • 26.Asada Y, Kephart G. Equity in health services use and intensity of use in Canada. BMC Health Serv Res. 2007;7: 1–12. doi: 10.1186/1472-6963-7-41 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Liang KY, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73: 13–22. doi: 10.1093/biomet/73.1.13 [DOI] [Google Scholar]
  • 28.Halekoh U, Højsgaard S, Yan J. The R package geepack for generalized estimating equations. J Stat Softw. 2006;15: 1–11. doi: 10.18637/jss.v015.i02 [DOI] [Google Scholar]
  • 29.Ontario Ministry of Health. Primary Care Payment Models in Ontario. Available: http://www.health.gov.on.ca/en/pro/programs/pcpm/
  • 30.Rosella LC, Fitzpatrick T, Wodchis WP, Calzavara A, Manson H, Goel V. High-cost health care users in Ontario, Canada: Demographic, socio-economic, and health status characteristics. BMC Health Serv Res. 2014;14. doi: 10.1186/s12913-014-0532-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Wong S. Quick COVID-19 Primary Care Survey of Clinicians: Summary of the second weekly pan-Canadian survey of frontline primary care clinicians’ experience with COVID-19. 2020. Available: http://hdl.handle.net/2027.42/155574
  • 32.Wong ST. Quick COVID-19 Primary Care Survey of Clinicians: Summary of the sixth (May 29-June 1, 2020) pan- Canadian survey of frontline primary care clinicians’ experience with COVID-19. 2020. Available: http://hdl.handle.net/2027.42/155574
  • 33.Jenkins EK, McAuliffe C, Hirani S, Richardson C, Thomson KC, McGuinness L, et al. A portrait of the early and differential mental health impacts of the COVID-19 pandemic in Canada: Findings from the first wave of a nationally representative cross-sectional survey. Prev Med. 2021; 106333. doi: 10.1016/j.ypmed.2020.106333 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Alison Holman E, Thompson RR, Garfin DR, Silver RC. The unfolding COVID-19 pandemic: a probability-based, nationally representative study of mental health in the United States. Sci Adv. 2020;6: 1–8. doi: 10.1126/sciadv.abd5390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Pierce M, Hope H, Ford T, Hatch S, Hotopf M, John A, et al. Mental health before and during the COVID-19 pandemic: a longitudinal probability sample survey of the UK population. The Lancet Psychiatry. 2020;7: 883–892. doi: 10.1016/S2215-0366(20)30308-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Williams R, Jenkins DA, Ashcroft DM, Brown B, Campbell S, Carr MJ, et al. Diagnosis of physical and mental health conditions in primary care during the COVID-19 pandemic: a retrospective cohort study. Lancet Public Heal. 2020;5: e543–e550. doi: 10.1016/S2468-2667(20)30201-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Carr MJ, Steeg S, Webb RT, Kapur N, Chew-Graham CA, Abel KM, et al. Effects of the COVID-19 pandemic on primary care-recorded mental illness and self-harm episodes in the UK: a population-based cohort study. Lancet Public Heal. 2021;6: e124–e135. doi: 10.1016/S2468-2667(20)30288-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Saunders NR, Guan J, Fu L, Guo H, Wang X, Guttmann A. Periodic health visits by primary care practice model, a population-based study using health administrative data. BMC Fam Pract. 2019;20: 1–8. doi: 10.1186/s12875-019-0927-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Wong ST. Special Report: Quick COVID-19 Primary Care Survey of Clinicians: Summary of the third (April 24–27, 2020) weekly pan-Canadian survey of frontline primary care clinicians’ experience with COVID-19. COVID-19 Ann Fam Med. 2020; 1–5. Available: http://hdl.handle.net/2027.42/155354 [Google Scholar]
  • 40.Czeisler MÉ, Marynak K, Clarke KEN, Salah Z, Shakya I, Thierry JM, et al. Delay or avoidance of medical care because of COVID-19–related concerns—United States, June 2020. MMWR Morb Mortal Wkly Rep. 2020;69: 1250–1257. doi: 10.15585/mmwr.mm6936a4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Jacob L, Loosen SH, Kalder M, Luedde T, Roderburg C, Kostev K. Impact of the COVID-19 pandemic on cancer diagnoses in general and specialized practices in Germany. Cancers (Basel). 2021;13: 1–11. doi: 10.3390/cancers13030408 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Patt D, Gordan L, Diaz M, Okon T, Grady L, Harmison M, et al. Impact of COVID-19 on cancer care: how the pandemic is delaying cancer diagnosis and treatment for American seniors. JCO Clin Cancer Informatics. 2020; 1059–1071. doi: 10.1200/cci.20.00134 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Freer PE. The Impact of the COVID-19 pandemic on breast imaging. Radiol Clin North Am. 2021;59: 1–11. doi: 10.1016/j.rcl.2020.09.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.MacDonald NE, Comeau JL, Dubé È, Bucci LM. COVID-19 and missed routine immunizations: designing for effective catch-up in Canada. Can J Public Heal. 2020;111: 469–472. doi: 10.17269/s41997-020-00385-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Vogt TM, Zhang F, Banks M, Black C, Arthur B, Kang Y, et al. Provision of pediatric immunization services during the COVID-19 pandemic: an assessment of capacity among pediatric immunization providers participating in the Vaccines for Children Program—United States, May 2020. MMWR Morb Mortal Wkly Rep. 2020;69: 859–863. doi: 10.15585/mmwr.mm6927a2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Dickinson JA, Thériault G, Singh H, Szafran O, Grad R. Rethinking screening during and after COVID-19: should things ever be the same again? Can Fam Physician. 2020;66: 571–575. [PMC free article] [PubMed] [Google Scholar]
  • 47.Krogsbøll LT, Jørgensen KJ, Gøtzsche PC. General health checks in adults for reducing morbidity and mortality from disease. JAMA—J Am Med Assoc. 2013;309: 2489–2490. doi: 10.1001/jama.2013.5039 [DOI] [PubMed] [Google Scholar]
  • 48.Birtwhistle R, Bell N, Thombs B, Grad R, Dickinson J. Periodic preventive health visits: a more appropriate approach to delivering preventive services. Can Fam Physician. 2017;63: 824–6. Available: http://www.cfp.ca/content/cfp/63/11/824.full.pdf [PMC free article] [PubMed] [Google Scholar]
  • 49.Piché-Renaud P-P, Ji C, Farrar D, Friedman J, Science M, Kitai I, et al. Impact of the COVID-19 pandemic on the provision of routine childhood immunizations in Ontario, Canada. under Rev. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Santoli JM, Lindley MC, DeSilva MB, Kharbanda EO, Daley MF, Galloway L, et al. Effects of the COVID-19 pandemic on routine pediatric vaccine ordering and administration—United States, 2020. MMWR Morb Mortal Wkly Rep. 2020;69: 591–593. doi: 10.15585/mmwr.mm6919e2 [DOI] [PubMed] [Google Scholar]
  • 51.Zhong Y, Clapham HE, Aishworiya R, Chua YX, Mathews J, Ong M, et al. Childhood vaccinations: hidden impact of COVID-19 on children in Singapore. Vaccine. 2021;39: 780–785. doi: 10.1016/j.vaccine.2020.12.054 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Chandir S, Siddiqi DA, Mehmood M, Setayesh H, Siddique M, Mirza A, et al. Impact of COVID-19 pandemic response on uptake of routine immunizations in Sindh, Pakistan: an analysis of provincial electronic immunization registry data. Vaccine. 2020;38: 7146–7155. doi: 10.1016/j.vaccine.2020.08.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Etz R. Quick COVID-19 Primary Care Weekly Survey, week 14. COVID-19 Ann Fam Med. 2020. Available: http://hdl.handle.net/2027.42/155622
  • 54.Etz R. Quick COVID-19 Primary Care Survey, Series 25. COVID-19 Ann Fam Med. 2021. Available: http://hdl.handle.net/2027.42/166302
  • 55.Alexander GC, Tajanlangit M, Heyward J, Mansour O, Qato DM, Stafford RS. Use and content of primary care office-based vs telemedicine care visits during the COVID-19 pandemic in the US. JAMA Netw open. 2020;3:e2021476. doi: 10.1001/jamanetworkopen.2020.21476 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Kiran T, Moonen G, Bhattacharyya OK, Agarwal P, Bajaj HS, Kim J, et al. Managing type 2 diabetes in primary care during COVID-19. Can Fam Physician. 2020;66: 745–747. [PMC free article] [PubMed] [Google Scholar]
  • 57.Pan American Health Organization. Managing people with Hypertension and cardiovascular disease during COVID-19. 2020. Available: https://iris.paho.org/bitstream/handle/10665.2/52271/PAHONMHNVCOVID-19200020_eng.pdf?sequence=1&isAllowed=y
  • 58.Gandhi S, Chiu M, Lam K, Cairney JC, Guttmann A, Kurdyak P. Mental health service use among children and youth in Ontario: population-based trends over time. Can J Psychiatry. 2016;61: 119–124. doi: 10.1177/0706743715621254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Chiu M, Gatov E, Vigod SN, Amartey A, Saunders NR, Yao Z, et al. Temporal trends in mental health service utilization across outpatient and acute care sectors: a population-based study from 2006 to 2014. Can J Psychiatry. 2018;63: 94–102. doi: 10.1177/0706743717748926 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Christine Leong

14 Jun 2021

PONE-D-21-12572

Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada

PLOS ONE

Dear Dr. Stephenson,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 29 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Christine Leong, Pharm. D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found athttps://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Thank you for your submission of a very interesting paper. It is interesting to observe the extent of change in reasons for primary care visits pre and during pandemic. Very well written. A few comments raised by the reviewer and below could be addressed:

Title page

- Please identify affiliation 7 for Karen Tu

Data Source

- Please provide additional details about the COVID-19 rates in the population. It was mentioned the area included were in areas of high rates, please consider defining what is high for readers to assess generalizability. Also consider commenting on public health measures that were implemented during the study period

Limitations

- Edit sentence in line 252 “ Data were from drawn from“

- Recommend addressing that only two time periods were measured. You mentioned that it was difficult to tease out degree of prevalence change. I would further elaborate that it is uncertain of the trend in seeing the physician for anxiety has increased over time (ie. How do we know the rate of change between 2019 and 2020 was not expected. Analysis of additional pre pandemic years May have been beneficial

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Statistics:

I selected "I don't know" in the statistics section because of Table 4 (Effect of COVID on the number of visits etc.). I am trying to rationalize why an IRR was calculated as this usually is done when there's a set exposure (exposed vs not exposed) and a certain health outcome over a time period. Practically speaking, if this paper is being geared towards family physicians, interpreting this table by sifting through confidence intervals to understand the text in the results/discussion is tedious and I'm not sure was actually necessary. Just a suggestion, but could the results be presented as "hard numbers" - for example, actual # of visits for Diabetes (% of total visits in brackets) and then percentage change pre/post COVID? That would be much easier to understand. Perhaps placing an * by the statistically significant results? I feel that the actual visit numbers and percentages should be presented so the reader is able to interpret outcomes themselves. This data is very appropriately presented in Table 2, and perhaps the change in % could be added in another column to the right?

I have attached a 2 recent papers looking at very similar outcomes. 1) In an Ontario population published in CMAJ Feb 2021 - Looking at their statistical analysis, they used 2-sample z tests, which I think makes more sense if this is a 2-group, independent sample with a large sample size (>50). 2) A second paper from the US that used simple descriptive statistics.

I'd strongly recommend rethinking Table 4 and revisiting the statistical analysis section for appropriateness of IRR after reviewing other similar papers.

Abstract:

If your group decides to present Table 4 differently (or take it out completely), I'd then suggest to edit the abstract as there are IRR values with 95% CI's. I was expecting in the abstract to potentially see the "top 5" visit reasons pre- and post- COVID summarized as that was your primary outcome. I liked how the anxiety outcome was presented in the abstract and I'd suggest presenting other outcomes the same way in the results section. I'd also suggest defining your secondary outcome as percentage of virtual care visits (clarifying this in the paragraph before the methods (lines 71-73) and including that as well in your abstract.

Table 1:

In Table 1 (Physician and Patient characteristics), would it be possible to include what the income quintiles are (in $ values)?

Discussion:

In the Discussion, in the first paragraph, suggest highlighting visit reasons that were NOT different pre- and post- COVID.

I think this paper definitely adds to the body of knowledge, especially since it defines which visit types changes substantially with COVID and advocates for more mental health supports which are desperately needed. It was well-written.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Grace Frankel

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Shifts in office and virtual primary care during the early COVID pandemic (CMAJ Feb 2021).pdf

Attachment

Submitted filename: Primary Care Telemedicine visits US (JAMA Oct 2020).pdf

PLoS One. 2021 Aug 12;16(8):e0255992. doi: 10.1371/journal.pone.0255992.r002

Author response to Decision Letter 0


19 Jul 2021

Response to Editor and Reviewer Comments

Editor Comments:

Data Source

- Please provide additional details about the COVID-19 rates in the population. It was mentioned the area included were in areas of high rates, please consider defining what is high for readers to assess generalizability. Also consider commenting on public health measures that were implemented during the study period

Authors’ response: We have added the following text to the Method to elaborate on the COVID-19 case numbers and public health interventions in the Greater Toronto Area and across Ontario throughout 2020.

“The number of confirmed cases of COVID-19 per capita was more than 1.5 times higher for public health units in Peel (2.5 per million) and Toronto (1.9 per million) relative to the provincial average (1.2 per million) as of December 31, 2020 [24]. Public health measures implemented to control the spread of COVID-19 included closures of schools and non-essential businesses, travel restrictions, instructions to only leave home for essential purposes such as accessing medical services, mandatory mask wearing in indoor public spaces, and limiting the size of social gatherings.”

Limitations

- Edit sentence in line 252 “ Data were from drawn from“

- Recommend addressing that only two time periods were measured. You mentioned that it was difficult to tease out degree of prevalence change. I would further elaborate that it is uncertain of the trend in seeing the physician for anxiety has increased over time (ie. How do we know the rate of change between 2019 and 2020 was not expected. Analysis of additional pre pandemic years may have been beneficial

Authors’ response: We have revised the limitations section as recommended. We acknowledge that longer term time trends (i.e., expected increases or decreases for specific types of visits) could not be accounted for using our current design. However, large changes across a 1-year period are not consistent with past longitudinal research describing trends in health service use. We chose not to include additional pre-pandemic years because this would introduce additional limitations with respect to EMR data quality, completeness, and availability across the patient population. The following text was added to the Limitations section:

Our study compared primary care visits in only 2 time periods (pre-pandemic vs. during pandemic). We do not know to what extent the changes we observed included longer term trends in health services. However, the large effect sizes we observed are not consistent with past longitudinal research [58,59], where a change in health service use of more than 30% occurred across 5 years rather than only 1 year.

Reviewer #1 Comments:

Statistics:

I selected "I don't know" in the statistics section because of Table 4 (Effect of COVID on the number of visits etc.). I am trying to rationalize why an IRR was calculated as this usually is done when there's a set exposure (exposed vs not exposed) and a certain health outcome over a time period. Practically speaking, if this paper is being geared towards family physicians, interpreting this table by sifting through confidence intervals to understand the text in the results/discussion is tedious and I'm not sure was actually necessary. Just a suggestion, but could the results be presented as "hard numbers" - for example, actual # of visits for Diabetes (% of total visits in brackets) and then percentage change pre/post COVID? That would be much easier to understand. Perhaps placing an * by the statistically significant results? I feel that the actual visit numbers and percentages should be presented so the reader is able to interpret outcomes themselves. This data is very appropriately presented in Table 2, and perhaps the change in % could be added in another column to the right?

I have attached a 2 recent papers looking at very similar outcomes. 1) In an Ontario population published in CMAJ Feb 2021 - Looking at their statistical analysis, they used 2-sample z tests, which I think makes more sense if this is a 2-group, independent sample with a large sample size (>50). 2) A second paper from the US that used simple descriptive statistics.

I'd strongly recommend rethinking Table 4 and revisiting the statistical analysis section for appropriateness of IRR after reviewing other similar papers.

Authors’ Response: The reviewer has raised a good point about how difficult it may be for many readers in our target audience (family physicians) to easily understand the statistics originally reported in Table 4. We have revised our presentation of the results in the text and in the tables to clarify the value added by each outcome measure, in particular the importance of looking at the number of unique individuals visiting at least once before and during COVID by reason for visit.

We have added columns with percentage change year over year to Table 2 as recommended, and report percentage change in the number of visitors and in the number of visits per visitor in Table 3. We now present the IRRs and 95% confidence intervals originally reported in a Table 4 as a forest plot (Figure 2). We hope that this will make it easier for readers to quickly see which types of visits increased/decreased the most during the pandemic.

A key difference between our statistical analysis and those used in the previous studies mentioned, is that we do not have 2 independent samples over time. Our data come from a fixed cohort of physicians for whom the number of visits and patients seen pre-COVID was compared to the number of visits and patients seen for the same dates after the onset of the pandemic. Thus, our analytic approach was chosen to account for the correlated nature of these paired observations. We have revised the Statistical Analysis section of the manuscript to make the justification for our approach clearer.

Abstract:

If your group decides to present Table 4 differently (or take it out completely), I'd then suggest to edit the abstract as there are IRR values with 95% CI's. I was expecting in the abstract to potentially see the "top 5" visit reasons pre- and post- COVID summarized as that was your primary outcome. I liked how the anxiety outcome was presented in the abstract and I'd suggest presenting other outcomes the same way in the results section. I'd also suggest defining your secondary outcome as percentage of virtual care visits (clarifying this in the paragraph before the methods (lines 71-73) and including that as well in your abstract.

Author’s response: We have removed the IRR values and 95% CIs from results section of the abstract. We report effect sizes as percentages instead. We have also revised the abstract to emphasize which types of visits were most common (i.e., “top 5”) and how the frequency of these visits changed during the pandemic. We now mention the proportion of visits involving virtual care as a secondary outcome in the Methods section of the Abstract.

Table 1:

In Table 1 (Physician and Patient characteristics), would it be possible to include what the income quintiles are (in $ values)?

Authors’ Response: This measure of neighbourhood income quintile does not map to specific income ranges in dollar values. Rather the income quintiles are indexed to the income range for each Census Metropolitan Area. This means that the same dollar amount, e.g., $80,000, could belong to a different income quintile in a major urban centre than it does for a person living in a smaller town. An advantage of this approach is that the quintiles have similar meanings across regions with the country even though there may be differences in the cost of living in each region.

Discussion:

In the Discussion, in the first paragraph, suggest highlighting visit reasons that were NOT different pre- and post- COVID.

Authors’ Response: We have revised the first paragraph of the discussion section to mention both what has changed during the pandemic and what has stayed the same.

Additional changes:

While conducting additional analyses to revise the results section, we discovered that EMR data from some physicians was not correctly and/or completely extract to the UTOPIAN database. As a result, data from 17 additional physicians were excluded from the sample used in the revised manuscript. This did not change any of our findings or conclusions.

Attachment

Submitted filename: Response to reviewers PLoSONE.docx

Decision Letter 1

Christine Leong

28 Jul 2021

Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada

PONE-D-21-12572R1

Dear Dr. Stephenson,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Christine Leong, Pharm. D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Christine Leong

2 Aug 2021

PONE-D-21-12572R1

Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada

Dear Dr. Stephenson:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Christine Leong

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Inferred diagnoses for missing diagnostic codes.

    (DOCX)

    S2 Appendix. Data quality criteria.

    (DOCX)

    S3 Appendix. Eligible service codes.

    (DOCX)

    S4 Appendix. Full diagnostic descriptions.

    (DOCX)

    Attachment

    Submitted filename: Shifts in office and virtual primary care during the early COVID pandemic (CMAJ Feb 2021).pdf

    Attachment

    Submitted filename: Primary Care Telemedicine visits US (JAMA Oct 2020).pdf

    Attachment

    Submitted filename: Response to reviewers PLoSONE.docx

    Data Availability Statement

    The research ethics approval for the use of UTOPIAN data does not permit making the data publicly available, as the data contain potentially identifiable patient information. Researchers interested in accessing EMR data from the UTOPIAN Data Safe Haven for research can apply to do so at: https://www.dfcm.utoronto.ca/getting-utopian-support.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES