Skip to main content
BMJ - PMC COVID-19 Collection logoLink to BMJ - PMC COVID-19 Collection
. 2022 May 9;12(5):e059130. doi: 10.1136/bmjopen-2021-059130

Changes in primary care visits arising from the COVID-19 pandemic: an international comparative study by the International Consortium of Primary Care Big Data Researchers (INTRePID)

Karen Tu 1,2,, Robert Sarkadi Kristiansson 3, Jessica Gronsbell 1,4, Simon de Lusignan 5, Signe Flottorp 6,7, Lay Hoon Goh 8, Christine Mary Hallinan 9, Uy Hoang 5, Seo Young Kang 10, Young Sik Kim 11, Zhou Li 12, Zheng Jye Ling 8, Jo-Anne Manski-Nankervis 9, Amy Pui Pui Ng 12,13, Wilson D Pace 14, Knut-Arne Wensaas 15, William CW Wong 12,13, Ellen Stephenson 1; INTRePID
PMCID: PMC9086267  PMID: 35534063

Abstract

Introduction

Through the INTernational ConsoRtium of Primary Care BIg Data Researchers (INTRePID), we compared the pandemic impact on the volume of primary care visits and uptake of virtual care in Australia, Canada, China, Norway, Singapore, South Korea, Sweden, the UK and the USA.

Methods

Visit definitions were agreed on centrally, implemented locally across the various settings in INTRePID countries, and weekly visit counts were shared centrally for analysis. We evaluated the weekly rate of primary care physician visits during 2019 and 2020. Rate ratios (RRs) of total weekly visit volume and the proportion of weekly visits that were virtual in the pandemic period in 2020 compared with the same prepandemic period in 2019 were calculated.

Results

In 2019 and 2020, there were 80 889 386 primary care physician visits across INTRePID. During the pandemic, average weekly visit volume dropped in China, Singapore, South Korea, and the USA but was stable overall in Australia (RR 0.98 (95% CI 0.92 to 1.05, p=0.59)), Canada (RR 0.96 (95% CI 0.89 to 1.03, p=0.24)), Norway (RR 1.01 (95% CI 0.88 to 1.17, p=0.85)), Sweden (RR 0.91 (95% CI 0.79 to 1.06, p=0.22)) and the UK (RR 0.86 (95% CI 0.72 to 1.03, p=0.11)). In countries that had negligible virtual care prepandemic, the proportion of visits that were virtual were highest in Canada (77.0%) and Australia (41.8%). In Norway (RR 8.23 (95% CI 5.30 to 12.78, p<0.001), the UK (RR 2.36 (95% CI 2.24 to 2.50, p<0.001)) and Sweden (RR 1.33 (95% CI 1.17 to 1.50, p<0.001)) where virtual visits existed prepandemic, it increased significantly during the pandemic.

Conclusions

The drop in primary care in-person visits during the pandemic was a global phenomenon across INTRePID countries. In several countries, primary care shifted to virtual visits mitigating the drop in in-person visits.

Keywords: COVID-19, PRIMARY CARE, HEALTH SERVICES ADMINISTRATION & MANAGEMENT


Strengths and limitations of this study.

  • The multiple countries involved to be able to compare experiences in the primary care setting and the large volume of patients visiting primary care around the world is a strength of this study.

  • Coming together to form the INTernational ConsoRtium of Primary Care BIg Data Researchers (INTRePID) with local primary care physicians and data experts having the ability to provide local context for the interpretation of findings is a strength of this study.

  • The heterogeneity of available data ranging from national level data to only one or a few clinic’s data in one country may have limited the representativeness of individual countries data.

  • The capture of virtual visits and contacts of primary care physicians and their patients may be more incomplete in settings that did not have remuneration for virtual visits.

Introduction

On 11 March 2020, the WHO declared the spread of COVID-19 a pandemic.1 Almost 2 years later, with over 425 million cases and nearly 6 million deaths worldwide as of 24 February 2022,2 new variants spreading and vaccination issues, the end to the pandemic is uncertain. The COVID-19 pandemic has presented unprecedented challenges in all aspects of daily life around the world, especially in healthcare delivery including primary care.3 4 Primary care is the foundation on which the highest functioning healthcare systems are built.5 Primary care practice and policy has the potential to affect the health impacts of the pandemic, with respect to screening, diagnosis, treatment and prevention of patients with COVID-196 and through non-COVID-19 disease management and prevention. Although recent studies have shown less respiratory illnesses as a result of COVID-19 prevention strategies7 8 and lower overall death rates in Norway,9 likely due to less spread of other infectious diseases,10 the unintended consequences of the pandemic are coming more and more to light. Estimates of excess deaths due to the COVID-19 pandemic suggest that the health consequences of the pandemic are not limited to those infected with COVID-19, with more people dying from non-COVID-19 causes11–13 and many negative indirect effects as well.14 15

Although all countries have their own unique primary care healthcare system, changes in healthcare delivery in response to the pandemic, variable degrees of COVID-19 spread2 and government and public health-imposed containment measures,16 comparisons between countries may help contextualise local measures. Almost a decade ago, responding to ‘emerging infectious diseases with potential widespread health and economic impact’ was identified as an international primary care research responsibility.17

In response to the need for primary care to prioritise acute care and prevent the spread of disease, healthcare funders in many countries expanded or introduced virtual care (telephone or video) as a mode of delivery for physician visits.18 19 Yet the design and duration of these virtual care programmes has varied across jurisdictions. There is a lack of evidence comparing the experiences with virtual care in different settings that could be used to support ongoing changes in primary care beyond the pandemic.20 21 We set out to compare the pandemic impact on volume of primary care visits, as well as uptake of virtual care, in primary care settings in nine different countries around the world.

Methods

Triggered by the onset of the COVID-19 pandemic and the understanding of common challenges worldwide, primary care researchers in nine different countries joined together to form the INTernational ConsoRtium of Primary Care BIg Data Researchers (INTRePID). INTRePID countries include Australia, Canada, China, Norway, Singapore, South Korea, Sweden, the UK and the USA.

We conducted an international comparative study of changes in primary care visit volumes and the switch to virtual care in INTRePID countries in 2019–2020 to capture the effects of the onset of the global COVID-19 pandemic. Electronic medical record data or physician billing claims data covering the primary care population in a given region, or a sample of the population, were used to estimate weekly visit volume and format of care delivery (see online supplemental material for description of country specific data sources). There were no restrictions based on age or sex in any of the data and all patients presenting to the primary care clinics with a visit to the primary care physician (PCP) in the various settings in INTRePID countries were included. Data were extracted and analysed in each individual country, and aggregated results were shared centrally for comparative analysis. We considered key features of each country’s primary care healthcare system, COVID-19 incidence patterns2 and containment and health indices16 (a composite measure of 11 policy response indicators such as school and workplace closures, travel bans, testing policy and contact tracing) in the interpretation of our findings.

Supplementary data

bmjopen-2021-059130supp001.pdf (90.7KB, pdf)

All INTRePID countries had some level of public funding for primary care delivery and varied based on the extent of funding via private insurance. In all INTRePID countries except for the USA and Singapore, primary care delivery is primarily publicly funded. Apart from Canada, Sweden and the UK, PCPs in INTRePID countries are paid primarily by fee for service. PCPs include family doctors, family physicians, general practitioners or GPs, list patient doctors, polyclinic doctors and in the USA also includes general internists and paediatricians. Healthcare systems varied based on the degree to which patients were expected to cover or have insurance to cover payments and copayments for visits and medications. In all countries except China, South Korea and most situations in the USA, PCPs act as gatekeepers for access to care from secondary care (table 1a). In all INTRePID countries, PCPs provide a broad scope of practice including preventive, acute and chronic disease diagnosis, and management.

Table 1.

(A) Summary of primary care healthcare systems in INTRePID countries. (B) Pandemic timing, virtual care policies and data available for INTRePID countries

Country Type and level of
funding
Payment model for primary care
physicians
Cost for patients Primary care as gatekeeper?
Australia Both public and private (10%–20%) Fee for service Visits: yes, copayments for some visits.
Medications: 6.60 AUD/medicine–41.30 AUD/month.
Yes, for access to specialists
Canada Public universal access funded at provincial level Primarily capitation in Ontario Visits: none.
Medications: Ontario provincial formulary only covers residents 65+ years, children without private insurance, those on social assistance and partial coverage for low-income residents.
Yes, for access to specialists
China Public and private Fee for service Visits and medications: social insurance with copayment depending on one’s status. No
Norway Public funded at a national level Capitation for 30% of PCPs income, the rest
fee for service
Visits: yes, copayments up to an annual upper limit. No patient visit costs for visits related to suspected or confirmed COVID-19, or for children <16 years old.
Medications: yes, copayments up to annual upper limit.
Yes, for access to specialists
Singapore Public and private funded differently Fee for service Visits: yes, public polyclinic visits are charged based on residency status and age of patient 14 SGD for adults (citizen) 6.90 SGD for children and elderly (citizen). In private primary care clinics determined by the clinic. However, patients who are citizens can receive subsidies under the Community Health Assist Scheme for visits in private clinics.
Medications: yes, amount based on residency status and age in public clinics, in private clinics determined by the clinic.
Yes, for access to specialists in public hospitals.
No for access to specialists in private hospitals.
South
Korea
Both public and private
(proportions vary according to the level and the type of medical care institution)
Fee for service Visits: yes.
Medications: yes.
No
Sweden Public funded at a
national level
Capitation 70% and fee for service 30%. Visits: yes, patient pays approximately 1/5 of the fee with an annual maximum copayment of 1200 SEK.
Medications: yes, copayment with a maximum of 2200 SEK.
Yes
UK Public
national health
insurance/taxation
Capitation Visits: no.
Medications: 40% of the population are eligible to pay prescription charges, but children, older people and medications to treat some chronic diseases are exempt from payment.
Yes
USA Private with public for low income and veterans Fee for service Visits: no if covered by insurance.
Medications: copayments typically required.
No
Country Date local pandemic or state of emergency was first declared Virtual care policy Data coverage region
Australia State of emergency in Victoria on 16 March 2020. State of disaster in Victoria on 2 August 2020 Commencing 13 March 2020, and now a permanent feature telephone or telehealth services were made available to physicians and allied health providers. This service is only to be provided where safe and clinically appropriate and limited to patients where there is an established clinical relationship. Bulk billing rates are the same for virtual as they are for in-person visits and the government is encouraging virtual visits. Select coverage
(1256 PCPs in 103 general practices in Victoria).
Canada State of emergency in Ontario on 17 March 2020. Gradual lifting of restrictions in the summer of 2020. Second wave declared on 28 September 2020, followed by gradual localised restrictions until province wide lockdown on 26 December 2020. In Ontario, as of March 14, 2020, new billing codes were introduced to cover any physician service provided via telephone or video. Recently extended indefinately. Virtual care was very limited before the pandemic. Payment for virtual visits equal to payment for in-person visits during the pandemic. Select coverage (392 PCPs in 95 clinics in Ontario).
China On 23 January 2020, the Guang Dong province government declared a public health state of emergency. Prior to the pandemic, the hospital did not offer virtual visits. Virtual consultations over a platform called ‘wedoctor’ for any queries on COVID-19 were offered for free on 1 February–30 April 2020, and the healthcare professionals were not paid additionally for these interactions. These virtual consultations are potentially under-represented here as hospital-based doctors (shown here) have been found to have lower utilisation of internet/telephone-based consultations compared with PCPs in the community. Select coverage (13 PCPs and 3 psychotherapists in the University of Hong Kong-Shenzhen Hospital family medicine clinic).
Norway There was an almost complete lockdown from 12 March 2020. The lockdown was gradually lifted from April onwards, but some restrictions were maintained during all of 2020. Prior to the pandemic, eHealth was already developed and used to a small extent. Patient copayment was the same for virtual and in-person consultations. From 16 March 2020 consultations by phone were reimbursed in the same way. As of 25 March 2020, it was recommended to use telehealth (phone/video) services as much as possible in place of in-person. Full coverage
(national).
Singapore Singapore implemented a ‘circuit breaker’ from 7 April 2020 to 1 June 2020, which is a set of safe distancing measures that significantly reduces people’s movements and interactions in public and private spaces. People were also encouraged to wear masks when going out. The public insurance system does not reimburse physicians for virtual care. Had a lot of virtual visits in the hospitals, less so in primary care. Most polyclinic patients had their appointments deferred during COVID-19 and were followed up by phone without cost (hence not captured in the data presented here). PCPs in the public health system were deployed to public health sites. Routine follow-up intervals for chronic disease management were extended. Select coverage
(886 PCPs in six public polyclinics).
South
Korea
On 23 February 2020, Infectious Disease Crisis Alert was upgraded to ‘Severe’. Social distancing system (level 1, level 1.5, level 2, level 2.5 and level 3) was applied depending on the severity of outbreak. Prior to the pandemic, virtual visits were not permitted in South Korea. From 24 February 2020, telephone consultation and prescription by fax were temporarily allowed by the Ministry of Health and Welfare. Virtual visits (20 400 KRW) remunerated at slightly lower rates than in-person (20 700 KRW). Select coverage (5 professors, 3 fellows, and 15 residents in primary care at Asan Medical Centre-Seoul).
Sweden 1 February 2020: COVID-19 classified as a disease dangerous to the public and society. 26 February 2020: high alert at the National Board of Health and Welfare. 16 March 2020: people over age 70 years were urged to avoid all contact with others. Gradual limitations of public gatherings. In general, Sweden was a relatively open society with no general lockdown, or mandatory mask wearing. Payments for virtual visits are half of the amount for in-person visits. The virtual (telehealth) services have been open to everyone, and in April 2020, the population was encouraged to use a telehealth solution if suitable for their visits. In Sweden, the 21 regions provide care for their own patients, but there are also a few national providers of telehealth that charge fee-for-service. Full coverage of Uppsala region, 150 PCPs.
UK Enacted the Coronavirus Act 2020 on 25 March 2020 that provided government with emergency powers. Virtual care is being used to reduce risk of infection for staff and patients. It is encouraged to promote virtual consultations and introduce it where it does not exist yet. Using video consultation is recommended in addition to telephone. Videoconferencing is encouraged as well as commercial apps such as Skype and Facetime for urgent use. However, physical visits were allowed only if benefits outweighed risks. Select coverage (there are 1800 practices in the network and 15 million patients across England (26% of the population)). This study was done on a subset of 5.6 million patients (~10% of the population), recruited to be evenly geographically spread across England.
USA National emergency declared on 13 March 2020. Very few US healthcare systems had used virtual care prior to the pandemic but by March 2020 most systems provided virtual care. Select coverage (236 PCPs in one health organisation in each of California, Texas and Colorado).

Select coverage: convenience sample within a region.

Full coverage: all clinics/practices within a region.

INTRePID, INTernational ConsoRtium of Primary Care BIg Data Researchers; PCP, primary care physician.

Most INTRePID countries responded to the WHO pandemic declaration with corresponding declarations of a ‘state of emergency’ and implemented healthcare policies and restrictions to prevent the spread of COVID-19 (table 1b). In Australia, Canada, Norway, Sweden and the UK, PCPs were encouraged to limit in-person contacts and use virtual care as much as possible, whereas in China, South Korea and Singapore support for virtual care was more limited, with variation in the extent of remuneration and the duration of time it was available. At the University of Hong Kong-Shenzhen Hospital in China, virtual care in primary care was only available shortly after the pandemic started in China from February 2020 to April 2020. Virtual care became permitted in South Korea from the end of February 2020. In Singapore, telephone and video visits were not offered as services billed by PCPs at any point before or during the pandemic. Administrative and support staff within these clinics were more likely to follow-up with patients by telephone during the pandemic, but these contacts were not captured as part of our estimates of visit volume. In all other countries virtual care was a reimbursable primary care visit delivery mode until the end of 2020 and policies for extensions have occurred such that it is still going on today in many countries (table 1b).

Measurements

Primary outcome measures were the total number of primary care visits per week in each country and the total visits per week that were virtual. Visits refer to a patient and PCP interaction that is remunerated by local publicly or privately funded health insurance plans. The term visit can be referred to as an attendance, encounter, consultation, contact or event in various INTRePID countries. We considered the format of care delivery. Using methods appropriate to data sources in each country, primary care visits were classified as in-person or virtual. Virtual visits included both telephone and video consultations between patients and GPs as it was not possible to distinguish between these types of visits in all countries. As email correspondence between patients and PCPs were unable to be identified in all INTRePID countries, we elected to only include telephone and video visits except in Norway where e-consultation (secure e-mail correspondence) was the main form of virtual care both prepandemic and in the pandemic period. Separate counts for each week in 2019 and 2020 were created for in-person visits and for virtual visits, which added together created the total visit volume for each week. To facilitate comparison between countries, weekly visit volume was calculated by the International Organization for Standardization (ISO) (https://www.iso.org/home.html) week.

Data analysis

We summarised weekly in-person, virtual and total visit volume across all weeks in 2019 and 2020 in the INTRePID countries. The total visit volume and proportion of virtual visits were obtained during the pandemic period in 2020 as well as the corresponding period in 2019 (the prepandemic period). The start of the pandemic period coincided with the global pandemic declaration by the WHO on 11 March 2020 until the end of 2020 (pandemic period: ISO weeks 12–52) for all countries except China where the local pandemic was declared on 23 January 2020 (pandemic period: ISO weeks 5–52).

To examine the impact of the pandemic on total visit volume in each country, we estimated rate ratios (RRs) comparing the mean weekly visit volume in the pandemic period and prepandemic periods. In countries where virtual care was offered before and after the pandemic (Norway, Sweden and the UK), we repeated the same analysis for weekly virtual visit volume to evaluate the relative change in mean weekly virtual visit rate in the pandemic period compared with the prepandemic period. For both analyses, RRs were obtained from a Poisson generalised linear model with an indicator of the pandemic period included as a covariate. We obtained robust SEs, two-sided p values and 95% confidence intervals (CIs) using the Newey-West method to account for autocorrelation. Bandwidth selection was performed using the procedure of Newey and West 1994 with prewhitening. All analyses were conducted with R V.4.0.3.

Role of the funding source

None of the study funding sources played a role in the study design, collection, analysis, interpretation of the data, writing of the report or in the decision to submit the paper for publication.

Patient and public involvement

Neither patients nor the public were directly involved in the conduct of the study.

Results

Overall, we captured 80 889 386 primary care visits in INTRePID countries in 2019 and 2020 (table 2). At the onset of the pandemic, visit volume decreased in all INTRePID settings, with variation across countries in the timing and duration of this change and the degree to which virtual visits increased to fill the gap in in-person visit volume (figure 1). Comparing the average weekly visit volume in the pandemic period to the prepandemic period, we observed significant decreases in China, Singapore, South Korea, the USA, but not in Australia, Canada, Norway, Sweden or the UK (table 3).

Table 2.

Total number of visits (in-person and virtual) in 2019–2020 and the total visit volume and proportion of virtual visits in the prepandemic and pandemic periods for the INTRePID countries

Country Total visit volume in 2019–2020 Total visit volume Proportion of virtual visits (%)
Prepandemic
period
Pandemic
period
Prepandemic
period
Pandemic
period
Australia 3 295 140 1 330 608 1 306 095 41.8
Canada 1 775 258 714 509 682 448 0.0 77.0
China 131 326 69 495 49 823 0.0
Norway 29 272 958 11 343 591 11 499 561 3.3 27.0
Singapore 2 371 659 1 053 615 773 418
South Korea 117 395 48 495 41 614 2.5
Sweden 3 185 700 1 278 258 1 166 475 29.0 42.2
UK* 40 343 066 917* 793* 20.7 56.6
USA 396 884 160 683 142 625 27.5

Prepandemic period=weeks 12–52 in 2019, except in China where it was weeks 5–52 in 2019.

Pandemic period=weeks 12–52 in 2020, except in China where it was weeks 5–52 in 2020.

*Unlike the other INTRePID countries, the number of clinics that contributed data for UK varied over time. To account for this, the visit volume is reported as total visits per 10 000 patients covered in each period. For all other countries, the population is assumed to be fixed over the duration of this study.

INTRePID, INTernational ConsoRtium of Primary Care BIg Data Researchers.

Figure 1.

Figure 1

Changes in primary care visits, COVID-19 spread and health containment indices in INTRePID countries in 2019–2020. INTRePID, INTernational ConsoRtium of Primary Care BIg Data Researchers.

Table 3.

Relative change in the average weekly visit volume comparing the pandemic period to the prepandemic period

Country Total visit volume Virtual visit volume
RR of total volume in the pandemic versus
prepandemic period (95% CI)
P value RR of virtual volume in the pandemic versus prepandemic period (95% CI) P value
Australia 0.98 (0.92 to 1.05) 0.591
Canada 0.96 (0.89 to 1.03) 0.237
China 0.72 (0.58 to 0.88) 0.002
Norway 1.01 (0.88 to 1.17) 0.852 8.23 (5.30 to 12.78) <0.001
Singapore 0.73 (0.65 to 0.83) <0.001
South Korea 0.86 (0.79 to 0.94) <0.001
Sweden 0.91 (0.79 to 1.06) 0.221 1.33 (1.17 to 1.50) <0.001
UK 0.86 (0.72 to 1.03) 0.107 2.36 (2.24 to 2.50) <0.001
USA 0.89 (0.82 to 0.96) 0.005

For countries with virtual care before and after the pandemic onset (Norway, Sweden and the UK), relative change in the weekly virtual visit volume is presented.

Prepandemic period=weeks 12–52 in 2019, except in China where it was weeks 5–52 in 2019.

Pandemic period=weeks 12–52 in 2020, except in China where it was weeks 5–52 in 2020.

*Unlike the other INTRePID countries, the number of clinics that contributed data for UK varied over time. An offset for the total number of patients covered for each week was added to the Poisson regression to account for this. For this reason, the RR is not directly comparable with the other countries.

INTRePID, INTernational ConsoRtium of Primary Care BIg Data Researchers; RR, rate ratio.

All INTRePID countries experienced a drop in in-person visits to PCPs immediately following the pandemic onset and showed various degrees of recovery either through a rebounding of in-person visits or a switch to virtual visits (figure 2). The countries with the largest decreases in visit volume during the pandemic (China (RR 0.72 (95% CI 0.58 to 0.88)), Singapore (RR 0.73 (95% CI 0.65 to 0.83)), South Korea (RR 0.86 (95% CI 0.79 to 0.94)) were those who did not shift to virtual care (table 2, figure 2). In countries that supported virtual care during the pandemic period, the decline in in-person visits appeared to be partially or completely mitigated by an increase in virtual visit rate. In Canada, Australia and the USA, virtual visits were not offered before the pandemic due to the regulatory environment or accounted for <1% of prepandemic visit volume. However, the overall visit volume in Canada was relatively stable across the pandemic and control periods, with a large increase in virtual care (77.0% of the weekly visit rate in the pandemic period). A similar pattern was observed for the uptake of virtual care in Australia (41.8%) and the USA (27.5%) (table 2, figure 2). Sweden and the UK were the only countries in which telephone or video visits were widely used prepandemic, while a small proportion of visits occurred virtually in the prepandemic period in Norway. During the pandemic, virtual visits increased substantially in all three of these countries (table 3).

Figure 2.

Figure 2

Year-over-year change in weekly visit volume, by country and visit type.

Discussion

Principal findings

The drop in in-person visits in primary care with the onset of the pandemic was a global phenomenon across INTRePID countries. Countries that embraced virtual care were able to mitigate the drop in in-person visits such that overall visit volume to primary care was largely maintained. The countries that had the lowest uptake of virtual care had the lowest rates of total visit volume during the pandemic compared with the prepandemic period. The impacts of replacing in-person visits with virtual ones to maintain stable primary care service levels remains to be seen and is an area for future research. The experiences across INTRePID countries illustrate that there is considerable variability in how much virtual care was used during the pandemic and to what degree prepandemic service patterns have returned.

The uptake of virtual care did not appear to be related to the degree of COVID-19 spread (figure 1) as the countries with the greatest COVID-19 incidence (Sweden, USA and UK) were similar in proportion of visits that were virtual during the pandemic as countries that had moderate or relatively lower COVID-19 incidence. Given that the health containment indices (figure 1) were similar among most INTRePID countries, it is difficult to correlate health containment indices with visit patterns. However, Norway did have slightly lower health containment index scores than other INTRePID countries and was the country that best maintained prepandemic visit volume in the pandemic period. It is interesting to note that the three countries that were the highest in rates of virtual care in the pandemic period (Canada, UK and Sweden) were the three countries among INTRePID that had primarily capitation payment model primary care systems. It is possible that a capitation payment model system whereby a physician has a set group of patients that they are remunerated to care for, regardless of the number of times a patient is seen, may be more amenable to virtual PCP visits.

Funding policies may explain some of the differences in virtual care uptake during the pandemic. The low number of virtual visits observed in China, South Korea and Singapore reflect policy decisions on how PCPs were or were not renumerated for virtual care. However, there was also variation among the other INTRePID countries where policies supported renumeration for virtual visits such that funding policies alone may not fully explain the differences in primary care visits we observed. Other factors such as the perceived effectiveness of virtual visits, perceived barriers in patient access and satisfaction with virtual care may have influenced both the availability and uptake of virtual visits in primary care across INTRePID countries.

The large immediate drop in in-person visits seen in Canada and China at the onset of the pandemic may reflect previous experience with severe acute respiratory syndrome (SARS-CoV-1),22 whereas other countries did not have as large a change in in-person visits. However, our results illustrate that China and Canada adopted different responses to adapt to this sudden change in in-person primary care services. In Canada, in-person visits were replaced with virtual visits such that total visit volume was largely maintained, and virtual visits continued to be the dominant format of care delivery throughout 2020. In China, the shift to replace missing in-person visits with virtual ones was minimal. As a result, total visit volume was lower during the pandemic than in the prepandemic period, but the number of in-person visits returned to prepandemic levels by the end of 2020. Although the health impacts of these differences remain to be seen, this example illustrates the value of comparing pandemic responses across jurisdictions. Studies done in a single country or health system might not recognise how the response taken locally during the pandemic compares with others internationally. The ability to compare experiences through INTRePID can provide further insight into the advantages and disadvantages of adopting virtual care models during the pandemic and beyond.

Comparison with other studies

Previous studies have looked at the switch to virtual care in one or a few jurisdictions.23–25 Reduced access to in-person health services at the start of the pandemic is a common finding and consistent with our results across INTRePID. Researchers have also observed that the content of primary care visits changed during the pandemic.26–28 This could be the result of changing population health needs or priorities during the pandemic or related to the increased use of virtual care. The current study illustrates that the increased use of virtual care was not universal and provides a foundation for future studies into the consequences of ongoing changes in primary care across INTRePID. This study allows for the individual countries to understand how they compare with other countries in the uptake of virtual visits in primary care. Experts in some jurisdictions predict that primary care may be changed forever or at least for the foreseeable future.29 30 This study is an illustration of the adaptability of primary care in the face of a pandemic around the world. There is a need for continued research to support ongoing changes in primary care beyond the pandemic and INTRePID is well positioned to meet this challenge.

Strengths and limitations

Over the course of the past 2 years, COVID-19 and the effects of the pandemic have dominated the medical literature. While international comparative studies on COVID-19 impact or response are not new in primary care, previous studies have been largely descriptive3 31 or based on survey responses.32 The formation of INTRePID, using local experts to discuss and agree on comparable measures, perform local analysis, provide local context for interpretation of findings, the large volume of patients visiting primary care around the world and the focus on primary care are strengths of this endeavour.

There are nevertheless several limitations we must acknowledge with this study. First, there was a large variation of data availability in INTRePID countries. The availability of data ranged from national level data to only one or a few clinic’s data in one country. In countries where there were fewer physicians contributing, the data may be less representative of the whole country and the national COVID-19 spread, and health containment indices may not accurately reflect the situation in settings that were locally sampled. Second, while we defined visits as those that we could reasonably measure through billing data sources in each country, we acknowledge that this approach does not capture all the activities of PCPs and in countries that did not allow for remuneration of virtual care, the activity of PCPs may be differentially under captured here. Third, it is possible that other care providers increased delivery of primary care services in some jurisdictions, and we were not able to measure this in this study. Last, we were limited to only having weekly visit data in 2019 and 2020 and focused our analyses on the average change in weekly visit volume comparing the pre and post pandemic periods rather than analysing trends in visit volume or format of care. We also only present unadjusted analyses as demographics and other environmental factors were not available for analysis.

Conclusions

The aftermath of the pandemic will only be known in the time to come. How the switch to virtual care may have impacted the quality of care provided is not yet known, will be subject for future study and will be of interest to both patients, providers and policy makers as the pandemic resolves.21 31

We have established the foundation for future international comparative studies on the impact of the pandemic on primary care in multiple countries.33 Primary care around the world has proven to be flexible and adaptable to provide patient care throughout the pandemic.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

Thank you to the patients and primary care providers in INTRePID countries who allow data sharing. Norway: Jonas Minet Kinge and Kjetil Elias Telle, Norwegian Institute of Public Health helped in providing and presenting the Norwegian data. UK: Julian Sherlock Data Analyst Oxford-Royal College of General Practitioners Clinical Informatics Digital Hub helped in providing and presenting the UK data. USA: Amanda Ratigan Director of Analytics, DARTNet Institute, helped in providing and presenting the US data. Canada: Angela Ortigoza Bonilla, helped in the revisions of the manuscript.

Footnotes

Twitter: @Lusignan_S, @SFlottorp, @Cmhallinan, @jo_manski

Collaborators: Simon de Lusignan; Signe Flottorp; Lay Hoon Goh; Jessica Gronsbell; Christine Hallinan; Uy Hoang; Seo Young Kang; Young Sik Kim; Robert Sarkadi Kristiansson; Zhou Li; Zheng Jye Ling; Jo-Anne Manski-Nankervis; Amy Pui Pui Ng; Wilson D Pace; Ellen Stephenson; Karen Tu; Knut-Arne Wensaas; William CW Wong.

Contributors: This study was born out of a recognition that the onset of the pandemic changed the delivery of primary care globally. In Canada health services researchers KT and ES and biostatistician JG accessed UTOPIAN and conducted the central analysis on all countries and wrote the first draft of the manuscript. In Australia, biostatistician CMH and primary care researcher JAMN accessed Patron. In China, primary care researchers APPN, ZL and WCWW accessed the Family Medicine General Practice Clinic at the University of Hong Kong Shenzhen Hospital. In Norway, health services researcher SF and research fellow KAW accessed the Norwegian Health Economics Administration data. In Singapore, primary care researcher LHG and health informatics researcher ZJL accessed the National University Polyclinics data. In South Korea, primary care researchers SYK and YSK accessed the data in Family Medicine in the Asan Medical Center. In Sweden, PhD candidate RSK accessed the Region Uppsala data. In the UK, primary care researchers SdeL and UH accessed the Oxford-Royal College of General Practitioners (RCGP) database. In the USA, health services researcher WDP accessed DARTNet. All countries had clinical primary care expertise and experience and provided interpretation of their local data. All authors provided critically important revision of the manuscript, approved the final version and accept responsibility to submit for publication. KT is the guarantor and responsible for the overall content, had access to the data centrally, accepts full responsibility for the work and conduct of the study.

Funding: This work was supported by the Canadian Institute of Health Research (CIHR) Operating Grant: COVID-19 Mental Health & Substance Use – Matching Access to Service with Needs: grant #450302, the North York General Hospital Exploration Fund and the Rathlyn Foundation.

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare the following: KT receives a Research Scholar award from the Department of Family and Community University of Toronto and research salary support from North York General Hospital, Toronto Western Family Health Team and the Rathlyn Foundation and has received grant funding from the Canadian Institutes of Health Research (CIHR), The College of Family Physicians of Canada/Foundation for Advancing Family Medicine/CMA Foundation, Heart and Stroke Foundation of Canada, Heart and Stroke Foundation of Ontario, Department of Defense United States of America, University of Toronto-Department of Family and Community Medicine), MaRS Innovation Fund, Canadian Dermatology Foundation, CRA (CIORA), PSI Foundation, Cancer Care Ontario, St. Michael’s Hospital Foundation, Toronto Rehab Institute Chair Fund, UTOPIAN, Arthritis Society, MS Society of Canada, The Canadian Vascular Network and Ontario SPOR Support Unit Targeted IMPACT Award. RSK teaches at the Swedish advanced training programme in quality improvement and owns stocks in the Swedish healthcare company Ambea. JG has received grant funding from NSERC and consulting fees from Verily Life Sciences. SdeL is the director of the Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC) as part of his academic post at Oxford. He has received payment to his research group for health services and primary care research from the University of Oxford and the University of Surrey and a wide range of grant funding through his university for vaccine related research from AstraZeneca, GSK, Sanofi, Segirus and Takeda. WDP has received grant funding from NIMCH, sits on the advisory board of AT Still Research Foundation, has stock in Moderna and Pfizer and received supplies from TEVA. ES receives a CIHR postdoctoral fellowship award. No other authors have any other conflicts of interest to declare. All funding sources were not involved in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and the decision to submit the article for publication. The researchers are all independent from funders, and all authors had full access to all the data in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Contributor Information

INTRePID:

Simon de Lusignan, Signe Flottorp, Lay Hoon Goh, Jessica Gronsbell, Christine Hallinan, Uy Hoang, Seo Young Kang, Young Sik Kim, Robert Sarkadi Kristiansson, Zhou Li, Zheng Jye Ling, Jo-Anne Manski-Nankervis, Amy Pui Pui Ng, Wilson D Pace, Ellen Stephenson, Karen Tu, Knut-Arne Wensaas, and William CW Wong

Data availability statement

Data are available upon reasonable request. All data are subject to local regulations for data sharing that vary from country to country. In all settings, individual-level data are not publicly available. We will provide aggregated visit data by country for review if requested. Analytic code for analysis of the data is also available on request.

Ethics statements

Patient consent for publication

Not applicable.

Ethics approval

This project received research ethics board (REB) approval from the University of Toronto (#40129) and North York General Hospital (#20–0044). Further REB approval was sought and attained by investigators in each country as necessary according to local regulations.

References

  • 1. World Health Organization . Coronavirus disease 2019 (COVID-19) situation report – 51, 2020. Available: https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200311-sitrep-51-covid-19.pdf?sfvrsn=1ba62e57_10 [Accessed 11 April 2021].
  • 2. Roser M, Ritchie H, Ortiz-Ospina E, et al. Coronavirus pandemic (COVID-19). Available: https://ourworldindata.org/coronavirus [Accessed 24 Feb 2022].
  • 3. Huston P, Campbell J, Russell G. COVID-19 and primary care in six countries. BJGP Open 2020;4. 10.3399/bjgpopen20X101128. [Epub ahead of print: 27 10 2020]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Marshall M, Howe A, Howsam G, et al. COVID-19: a danger and an opportunity for the future of general practice. Br J Gen Pract 2020;70:270–1. 10.3399/bjgp20X709937 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. World Health Organization . Primary health care. Available: https://www.who.int/news-room/fact-sheets/detail/primary-health-care [Accessed 27 Apr 2021].
  • 6. Tse DM-S, Li Z, Lu Y, et al. Fighting against COVID-19: preparedness and implications on clinical practice in primary care in Shenzhen, China. BMC Fam Pract 2020;21:271. 10.1186/s12875-020-01343-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Sinha P, Reifler K, Rossi M, et al. Coronavirus disease 2019 mitigation strategies were associated with decreases in other respiratory virus infections. Open Forum Infect Dis 2021;8:ofab105. 10.1093/ofid/ofab105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Britton PN, Hu N, Saravanos G, et al. COVID-19 public health measures and respiratory syncytial virus. Lancet Child Adolesc Health 2020;4:e42–3. 10.1016/S2352-4642(20)30307-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. European mortality monitoring project. Available: https://www.euromomo.eu/graphs-and-maps/#excess-mortality [Accessed 06 Jul 2021].
  • 10. Juul F, Jodal H, Barua I. Mortality in Norway and Sweden before and after the Covid-19 outbreak: a cohort study. medRxiv 2020. 10.1177/14034948211047137 [DOI] [Google Scholar]
  • 11. Bilinski A, Emanuel EJ. COVID-19 and excess all-cause mortality in the US and 18 comparison countries. JAMA 2020;324:2100–2. 10.1001/jama.2020.20717 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Wu J, Mafham M, Mamas MA, et al. Place and underlying cause of death during the COVID-19 pandemic: retrospective cohort study of 3.5 million deaths in England and Wales, 2014 to 2020. Mayo Clin Proc 2021;96:952–63. 10.1016/j.mayocp.2021.02.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Griffin S. Covid-19: "Staggering number" of extra deaths in community is not explained by covid-19. BMJ 2020;369:m1931. 10.1136/bmj.m1931 [DOI] [PubMed] [Google Scholar]
  • 14. Mansfield KE, Mathur R, Tazare J. Indirect acute effects of the COVID-19 pandemic on physical and mental health in the UK: a population-based study. Lancet Digit Health 2021;3:e217–30. 10.1016/S2589-7500(21)00017-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Douglas M, Katikireddi SV, Taulbut M. Mitigating the wider health effects of covid-19 pandemic response. BMJ 2020;369:m1557. 10.1136/bmj.m1557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Hale T, Angrist N, Goldszmidt R, et al. A global panel database of pandemic policies (Oxford COVID-19 government response Tracker). Nat Hum Behav 2021;5:529–38. 10.1038/s41562-021-01079-8 [DOI] [PubMed] [Google Scholar]
  • 17. Hay AD, Rortveit G, Purdy S, et al. Primary care research--an international responsibility. Fam Pract 2012;29:499–500. 10.1093/fampra/cms030 [DOI] [PubMed] [Google Scholar]
  • 18. Haldane V, Zhang Z, Abbas RF, et al. National primary care responses to COVID-19: a rapid review of the literature. BMJ Open. 2020;10:e041622 10.1136/bmjopen-2020-041622 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Greenhalgh T, Wherton J, Shaw S, et al. Video consultations for covid-19. BMJ 2020;368:m998. 10.1136/bmj.m998 [DOI] [PubMed] [Google Scholar]
  • 20. Windak A, Frese T, Hummers E, et al. Academic general practice/family medicine in times of COVID-19 - Perspective of WONCA Europe. Eur J Gen Pract 2020;26:182–8. 10.1080/13814788.2020.1855136 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Jonnagaddala J, Godinho MA, Liaw S-T. From telehealth to virtual primary care in Australia? a rapid scoping review. Int J Med Inform 2021;151:104470. 10.1016/j.ijmedinf.2021.104470 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Wong WCW, Wong SYS, Lee A, et al. How to provide an effective primary health care in fighting against severe acute respiratory syndrome: the experiences of two cities. Am J Infect Control 2007;35:50–5. 10.1016/j.ajic.2006.06.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Stephenson E, O'Neill B, Gronsbell J, et al. Changes in family medicine visits across sociodemographic groups after the onset of the COVID-19 pandemic in Ontario: a retrospective cohort study. CMAJ Open 2021;9:E651–8. 10.9778/cmajo.20210005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Mehrotra A, Chernew ME, Linetsky D. The impact of COVID-19 on outpatient visits in 2020: visits remained stable, despite a late surge in cases, 2021. The Commonwealth Fund. Available: https://www.commonwealthfund.org/publications/2021/feb/impact-covid-19-outpatient-visits-2020-visits-stable-despite-late-surge [Accessed 27 Apr 2021].
  • 25. Hall Dykgraaf S, Desborough J, de Toca L, et al. "A decade's worth of work in a matter of days": The journey to telehealth for the whole population in Australia. Int J Med Inform 2021;151:104483. 10.1016/j.ijmedinf.2021.104483 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Alexander GC, Tajanlangit M, Heyward J, et al. Use and content of primary care office-based vs telemedicine care visits during the COVID-19 pandemic in the US. JAMA Netw Open. 2020;3:e2021476. 10. 10.1001/jamanetworkopen.2020.21476 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Sigurdsson EL, Blondal AB, Jonsson JS, et al. How primary healthcare in Iceland swiftly changed its strategy in response to the COVID-19 pandemic. BMJ Open 2020;10:e043151. 10.1136/bmjopen-2020-043151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Stephenson E, Butt D, Gronsbell J. Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada. PLoS ONE 2021;16:e0255992. 10.1371/journal.pone.0255992 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Thornton J. Covid-19: how coronavirus will change the face of general practice forever. BMJ 2020;368:m1279. 10.1136/bmj.m1279 [DOI] [PubMed] [Google Scholar]
  • 30. Rawaf S, Allen LN, Stigler FL, et al. Lessons on the COVID-19 pandemic, for and by primary care professionals worldwide. Eur J Gen Pract 2020;26:129–33. 10.1080/13814788.2020.1820479 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Desborough J, Dykgraaf SH, Phillips C, et al. Lessons for the global primary care response to COVID-19: a rapid review of evidence from past epidemics. Fam Pract 2021;38:811–25. 10.1093/fampra/cmaa142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Goodyear-Smith F, Kinder K, Mannie C, et al. Relationship between the perceived strength of countries’ primary care system and COVID-19 mortality: an international survey study. BJGP Open 2020;4:bjgpopen20X101129. 10.3399/bjgpopen20X101129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Tu K, Stephenson E, Gronsbell J. An INTRePID international research journey. In: Tu K, Ji C, Varner C, et al., eds. The University of Toronto family medicine report: stronger together: caring through crisis. Toronto, Ontario: Department of Family and Community Medicine, 2021: 45. ISBN: 978-1-9990809-2-1. https://dfcm.utoronto.ca/news/2021-UofT-family-medicine-report-caring-through-crisis [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2021-059130supp001.pdf (90.7KB, pdf)

Reviewer comments
Author's manuscript

Data Availability Statement

Data are available upon reasonable request. All data are subject to local regulations for data sharing that vary from country to country. In all settings, individual-level data are not publicly available. We will provide aggregated visit data by country for review if requested. Analytic code for analysis of the data is also available on request.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES