Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Oct 30;18(10):e0288777. doi: 10.1371/journal.pone.0288777

Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol

Yasmine Khan 1,2,3,*, Nick Verhaeghe 1,4, Robby De Pauw 2,5, Brecht Devleesschauwer 2,6, Sylvie Gadeyne 3, Vanessa Gorasso 1,2, Yolande Lievens 7, Niko Speybroek 8, Nancy Vandamme 9, Miet Vandemaele 7, Laura Van den Borre 2,3, Sophie Vandepitte 1, Katrien Vanthomme 1,3, Freija Verdoodt 9, Delphine De Smedt 1
Editor: Matteo Ruggeri10
PMCID: PMC10615261  PMID: 37903130

Abstract

Introduction

Cancer causes a substantial burden to our society, both from a health and an economic perspective. To improve cancer patient outcomes and lower society expenses, early diagnosis and timely treatment are essential. The recent COVID-19 crisis has disrupted the care trajectory of cancer patients, which may affect their prognosis in a potentially negative way. The purpose of this paper is to present a flexible decision-analytic Markov model methodology allowing the evaluation of the impact of delayed cancer care caused by the COVID-19 pandemic in Belgium which can be used by researchers to respond to diverse research questions in a variety of disruptive events, contexts and settings.

Methods

A decision-analytic Markov model was developed for 4 selected cancer types (i.e. breast, colorectal, lung, and head and neck), comparing the estimated costs and quality-adjusted life year losses between the pre-COVID-19 situation and the COVID-19 pandemic in Belgium. Input parameters were derived from published studies (transition probabilities, utilities and indirect costs) and administrative databases (epidemiological data and direct medical costs). One-way and probabilistic sensitivity analyses are proposed to consider uncertainty in the input parameters and to assess the robustness of the model’s results. Scenario analyses are suggested to evaluate methodological and structural assumptions.

Discussion

The results that such decision-analytic Markov model can provide are of interest to decision makers because they help them to effectively allocate resources to improve the health outcomes of cancer patients and to reduce the costs of care for both patients and healthcare systems. Our study provides insights into methodological aspects of conducting a health economic evaluation of cancer care and COVID-19 including insights on cancer type selection, the elaboration of a Markov model, data inputs and analysis.

Introduction

Every year more than four million incident cancer cases occur across Europe, resulting in around two million cancer deaths [1]. According to the Global Cancer Observatory’s 2020 estimations, 13,5 million people were living with cancer over the past five years [2]. Moreover, a total of 47 million disability-adjusted life years (DALYs) were estimated by the Institute for Health Metrics and Evaluation in 2019 for cancer [3]. This has a considerable economic impact. In 2018, the estimated total cost of cancer in Europe reached approximately €199 billion [4]. About €103 billion was spent on direct costs, including €32 billion on cancer drugs, €26 billion on informal care (i.e. the opportunity cost of time forgone by relatives and friends to provide unpaid care) and the total productivity loss was €70 billion [4]. Early diagnosis and timely treatment are key to improving patient outcomes and reducing societal costs [5]. Indeed, delayed cancer diagnosis may lead to a worse prognosis, implying more aggressive and costly treatments affecting patients’ quality of life, productivity and survival [6].

Deferred cancer care may be caused by different factors such as a lack of public awareness of the signs and symptoms of cancer affecting care-seeking behaviours [7], outdated and faulty cancer care pathways leading to delayed cancer diagnosis and treatment [8], reduced or unequal accessibility of care [9], poor healthcare coordination [10], and a lack of resources [11]. Unprecedented sanitary situations may also disrupt cancer care as recently seen with the COVID-19 pandemic [6]. Strict COVID-19 measures in hospitals were taken by healthcare providers, supported by professional and scientific societies, which interfered with usual healthcare delivery (i.e. postponement of elective surgeries and deferral of “non-urgent” medical care, change in radiation schedules) [12, 13]. Furthermore, patients feared getting infected by the virus and wanted to avoid overwhelming the healthcare system, which disinclined them from seeking adequate care [14]. Although the health and health economic impact of delayed cancer care during the different COVID-19 pandemic waves is mainly unknown, some studies estimated its partial impact on usual cancer care [1517]. In Belgium, a 44% decrease in the diagnoses of invasive cancers (i.e. skin melanoma, prostate, colorectal, breast (women), head and neck, haematological malignancies, oesophagus, kidney, bladder, lung, pancreas, cervix) was observed in April 2020 compared with April 2019 [18]. Furthermore, in 2020 the Belgian Cancer Registry (BCR) observed approximately 6% fewer cancer diagnoses than expected compared to 2019 [19]. A recent study conducted by the Madrid tumor registry analysed cancer diagnoses between 2019–2021 in Spain. The study evaluated the differences in annual volume, observed-to-expected (O/E) volume ratios, and standardised incidence rate ratios for 2020–2021 compared to 2019, which was found to be 94.5% (95% CI 93.8–95.3). The study revealed that most cancer types were underdiagnosed in 2020, and this trend worsened in 2021 for colorectal and prostate cancers (87.8%). However, lung cancer showed improvement (102.1%), and breast cancer was overdiagnosed (114.4%) compared to pre-COVID-19 reference data [20]. Another study conducted in Japan found more aggressive and advanced disease after the suspension of breast cancer screening services during the COVID-19 pandemic with the percentage of stage IIB or higher patients being significantly higher in the pandemic group than in the non-pandemic group (22.0% vs 31.3%, p = 0.0133) [21].

Comprehensive quantitative evidence estimating the long-term health and health economic impact of delayed cancer care to guide decision-makers in their decision-making processes is however still scarce. According to a recent British study the COVID-19 pandemic will induce around 33,000 QALY (Quality-adjusted life year) losses and about £104 million in productivity losses in the five years to come [22]. Decision-analytic modelling, such as multistate Markov models (MM), which are typically used to assess the cost-effectiveness of various interventions and programmes in healthcare and public health, can be used as a tool to estimate the costs and outcomes of delayed cancer care [23]. MMs are flexible and therefore ideal to create a methodological framework adaptable to any context and setting. The evidence from such models can guide decision-makers in ways that improve the health outcomes of cancer patients and minimise costs for both patients and healthcare systems.

Hence, this paper aims to provide a MM methodology assessing the impact of delayed cancer care due to the COVID-19 pandemic in Belgium, with a flexible framework that can be used by researchers to answer various research questions in diverging contexts and settings. Our study does not present any result related but merely serves as a methodologic framework.

Methods

The methods outlined below are based on the Professional Society for Health Economics and Outcomes Research (ISPOR) guidelines [24].

Study population

For pragmatic and feasibility reasons, a limited number of cancer types are usually selected based on an agreed rationale. This can be carried out by looking at cancer incidence, burden, or prognosis, but in reality such decisions are often based on data availability. In our case, the selection is firstly made by considering the cancers in Belgium with the highest incidence, based on the BCR data [25]. Secondly, by taking into account cancers with the highest DALYs in Belgium [3]. Thirdly, by investigating cancers for which a delay in the initiation of treatment has an important negative impact on the patient’s disease progression, metastasis, and survival [6, 26]. To know whether the model is a good reflection of reality, validation is sought by two Belgian experts. Experts were selected using following criteria: at least 10 years of medical practice and active research experience in the field of cancer health economics in Belgium. Expert A has been working as an oncologist for over 20 years and has received health economic training. His research expertise includes the impact of the COVID-19 pandemic on delayed cancer diagnosis and treatment in Belgium. Expert B is an expert in radiation oncology and in health economics. Her work experience includes the organisational aspects of cancer treatment, including the financial and health economic aspects of cancer care. Based on those selection criteria, adult (> 18 years) men and women cancer patients with at least one diagnosis of breast cancer (only women), colorectal cancer, lung cancer, or head and neck cancer are chosen. The methodology outlined below can however be used to assess the impact on other cancer types as well.

Markov model

MMs are arguably the most popular form of analytical framework used in the health economic evaluation of healthcare interventions. They are generally used to describe random processes which change over time and to model the course of chronic diseases such as cancer. The disease can be split into different disease states, which are mutually exclusive and exhaustive, implying that each patient depicted can only be in one of these states. Transition probabilities (TP) are used for switching between these states over a discrete time period known as a "cycle" [23]. It is highly recommended that the cycle length is short enough for modifications in subsequent cycles to depict events that change over time [27]. Moreover, a short cycle length reduces errors and simulates events more realistically [23]. MMs do not only describe different health states in a population of interest but can also be used to identify the effects of different policies or therapy options [28]. Those models can predict the long-term costs and outcomes for a modelled cohort of patients (case cohort) by associating estimates of resource use and health outcomes to the model’s states and transitions, and then by running multiple cycles [23]. Those costs and health outcomes can then be compared with the experience of a similar (control) cohort, for instance by receiving a different intervention for the same disease (e.g. from the usual care period). In the present study, diagnosed and treated cancer patients from pre-COVID-19 times (control cohort) are compared to diagnosed and treated cancer patients during the COVID-19 period (case cohort). During the pandemic, preventive measures against the virus were put into place which affected the care trajectory of non-COVID patients in a potentially negative way. The purpose of the presented MM is to determine the incremental difference in terms of costs and QALYs, caused by the sanitary crisis. An important characteristic of MMs is that they are without memory, meaning that they are unable to integrate the health experience from previous cycles. However, it is possible to integrate a range of temporary states arranged in a way that each state transitions to the next one. Those states are known as tunnel states because they can only be visited in a predetermined order, much like travelling through a tunnel and an array of tunnel states is used to temporarily change transition probabilities by more than one cycle [27, 29]. If it is impossible to leave a disease state, it is considered to be absorbing (e.g. death) [28].

When developing a MM model, a common first step is consulting published decision-analytic models as a base and source of inspiration. After a thorough literature search of cost-effectiveness studies related to the five selected cancers, a decision-analytic model is developed using a multistate MM approach. Based on the findings from the literature, a draft of a generic multistate MM diagram is made for each considered cancer type (Fig 1). We refer to stages I-IV as defined by the Union for International Cancer Control (UICC), the TNM classification of Malignant Tumours (TNM) (8th edition). The model structure describes cancer progression after diagnosis and subsequent treatment. Therefore a patient diagnosed and then treated with stage I cancer cannot progress to stage II, III, or IV but will evolve in its attributed stage (e.g. if a stage I breast cancer patient is in remission after treatment and after a while the disease progresses, it will not be identified as a stage II breast cancer but as a stage I loco-regional relapse). Patients enter the model at diagnosis. Our MM consists of 18 health states (Fig 1): Missed cancer diagnoses; stage I; stage II; stage III; stage IV; stage I follow-up; stage II follow-up; stage III follow-up; stage IV follow-up; stage I loco-regional relapse; stage II loco-regional relapse; stage III loco-regional relapse; stage IV loco-regional relapse; stage I distant relapse; stage II distant relapse; stage III distant relapse; stage IV distant relapse; dead. It is assumed that once diagnosed, patients are treated using the available and recommended treatment practices. During each cycle, individuals move from stage I, stage II, stage III, or stage IV cancer (i.e. tunnel states), to the corresponding follow-up state (represented by the arrows). During each cycle, patients in the different “follow-up” states can develop a loco-regional relapse or a distant relapse and move to the corresponding states or they can remain in the “follow-up” states. Patients in the different “loco-regional relapse” states can either develop a distant relapse or stay in the same state. According to an expert’s opinion, patients being successfully treated with a loco-regional treatment for loco-regional relapse, will still be considered as in loco-regional relapse state. Patients in the different “distant relapse” states can stay in that state or they can move to the final “dead” state (i.e. absorbing state). Patients being successfully treated with a distant treatment for distant relapse, will still be considered as in distant relapse state. During each cycle, patients in any state can directly move to the dead state. The “missed cancer diagnoses” state represents the cancer patients that are not diagnosed yet due to the disrupted situation and they will either be diagnosed at some time or they will die. The “relapse” state is used as a label to indicate progression (loco-regional and/or distant), and does not mean that patients are not receiving treatment, with patients receiving standard of care treatment regardless of staying in the same state or moving up. Considering the five selected cancers for our study, the natural progression of cancer and the average treatment duration based on published literature, a three-month cycle length is chosen. Researchers may omit and/or adapt steps (i.e. cycle length) described in our paper according to country-specific available data.

Fig 1. MM diagram with 18 health states applicable to the five selected cancer types.

Fig 1

FU = Follow-up. LRR = Loco-regional relapse. DR = Distant relapse (metastasis). Curved arrow = Probability of remaining in the state. Straight arrow = Probability of moving to another state. Curly bracket = Probability for patients in any state to move to the dead state.

Data inputs

For a MM to be operational several types of data inputs are essential. Model inputs for the decision-analytic model are generally derived from two types of sources: (1) published studies and (2) administrative databases. Cost and epidemiological data should be collected from country-specific databases, such as, for example, administrative databases and cohort studies. It is also best to use country-specific TPs and utility loss data, however if certain data is not available, it can be derived from international published studies. As recommended by ISPOR-SMDM Medical Decision Making Modelling Task Force, TPs must be collected from studies with comparable settings and populations [30]. In our study, when Belgian data is not available we turn to European countries.

Transition probabilities

It is unusual for TPs to be extrapolated as such from the literature. Hence, TPs are generally derived from transition rates through two equations allowing the conversion between rates and probabilities [23]. Eqs (a) and (b) show the relation between a probability (p), a constant rate (r), and time (t).

r=ln(1p)t (a)
p=1exp(rt) (b)

In our study, rates are mostly used and are found in studies assessing the risk of cancer relapse and survival and then translated into TPs [3133].

Utilities

QALYs are calculated by combining utility values based on the EQ-5D index with the time spent in a given health state. The utility values are self-perceived health scores ranging from 0 to 1 with “1” meaning perfect health and “0” dead. One QALY represents one year lived in perfect health [34]. In our case study, utility losses for each cancer state are gathered from systematic reviews of the EQ-5D scores for chronic conditions [35, 36]. Studies using the EQ-5D-5L are preferred over studies using the EQ-5D-3L since they provide increased sensitivity and precision in health status measurement [37]. To account for a particular context and setting, disutility values reflecting disability due to the disease are subtracted from EQ-5D population norm data [35, 38].

Cost data

Costs are calculated based on a societal perspective, which considers both direct and indirect costs. Direct costs represent healthcare expenditures incurred by a cancer patient (i.e. hospitalisation, medical consultations, medication, radiotherapy, therapeutic intervention, surgery) and indirect costs represent costs associated to illness-attributable productivity losses.

In Belgium, cancer data related to the direct costs of each health state are collected through a linked data request destined to the BCR, which collects all new cancer diagnoses with full nationwide coverage, and the intermutualistic agency (IMA), a Belgian organisation which manages the databases containing information on healthcare insurances (compulsory in Belgium) at the population level. In a parallel study, cancer costs are estimated at the individual level for each considered cancer site and each cancer stage with the method of recycled predictions (also known as the method of standardisation or g-computation), which determines the marginal difference in costs for a sample of patients being affected with one type of cancer compared to a sample of the general population who do not present any cancer diagnosis [3941]. The aim is to estimate the average total healthcare expenditure during one year, being 2018 (the most recent year for which data is available) for cancer patients according to their cancer site and their cancer stage, which will be used as input in the model. The cancer population consists of a sample of the Belgian cancer population alive on the 1st January 2018, and who had at least one cancer diagnosis of the considered cancers during the 10 previous years (S1 Appendix). The control sample is selected from the healthcare insurer database (IMA) if they were alive on the 1st January 2018 and were not diagnosed with cancer in the 10 years preceding 2018. In order to limit the amount of individuals, a random subset of the patient population is made. Matching is done based on age, sex, and region of residence available on the 1st January 2018. A case-control ratio of 1:4 is used, considering that including more than four controls per case does not increase significantly the statistical power [42].

Because most European cancer registries do not have a direct variable reflecting cancer relapse [43], cost information for the “relapse” states (Fig 1) is collected from the literature, preferably from national studies but when data is not available it is also gathered from international studies. When necessary, costs found in the literature are converted to the national currency and then indexed to the year 2022 by using the Health Index [44]. For feasibility reasons, cost data related to the follow-up of each cancer stage after treatment is also gathered from published studies and is manipulated similarly to cancer relapse costs.

Patients affected with cancer may need time off from the labour force due to treatment (i.e. absenteeism), which represents on the one hand a loss to themselves through a loss of income and on the other hand a loss to society’s economy (i.e. productivity). Productivity losses are generally estimated using either the human capital approach (HCA) or the friction cost approach (FCA), which both have advantages and disadvantages [45]. In our study, the FCA is employed because it calculates costs for productivity loss regarding short-term consequences and death, while HCA is more efficient when evaluating lifetime costs [45]. The FCA suggests that society suffers from productivity loss during the time it takes to replace a missing individual (i.e. friction period), with an internal employee in the short term or with a pool of unemployed professionals capable of taking over the job rapidly. It considers the length of the friction period (context-specific and based on unemployment levels) and the ability in identifying replacement workers [45, 46]. Data on productivity loss costs due to cancer are obtained from country-specific published studies. In Belgium, we base ourselves on a Dutch report on methods and costs for economic evaluations in healthcare and assume the friction period to last 160 days [47]. The indirect cost per disease state is estimated by multiplying the number of days off work due to cancer by the average cost for one day of absenteeism [48]. In our study, the number of days off work for each cancer and each disease state is found in published literature. To calculate the cost of death, the average friction period (i.e. 160 days) is multiplied by the mean cost of one day’s absenteeism. The costs related to productivity loss are applied to the productive age categories of 30–65 years, considering the proportion of full-time equivalents and the unemployment rate. Costs are then indexed to the year 2022 using the Health Index [44].

Epidemiological data

Information on the aggregated number of cancer patients entering the model is derived from national cancer registries. In this study, the aggregated number of stage I-IV cancer patients and the number of missed cancer diagnoses are collected from the BCR.

For our study, a data request has been submitted to the BCR. The number of cancer patients is requested according to variables of interest, in our case being: the cancer site (i.e. breast (C50), colorectal (C18-20), lung (C34), and head and neck (C00-C14; C30-C32)), the timeframe (i.e. pre-COVID and COVID-19 period), the age category (i.e., 18–29; 30–39; 40–49; 50–59, 60–69; 70–79; 80–89; 90+), gender (i.e. male or female for all cancer types except for breast cancer where only females are considered), the region of residence (i.e. Flemish, Brussels-Capital, and Walloon region), and the stage at diagnosis (i.e. stage I-IV and the missed cancer diagnoses). Data from the usual care period (i.e. pre-COVID-19 period) is needed as well as data from the disrupted period (i.e. COVID-19 period), therefore specific timeframes are defined in our data request. The disrupted period is considered from a yearly perspective (i.e. the years 2020, 2021, and 2022) and also according to the different waves and subsequent interwaves of the pandemic (i.e. the first until the fifth wave of the pandemic). The usual care period is also considered from a yearly perspective (i.e. the year 2019) and according to the pre-COVID-19 dates corresponding to the waves and subsequent interwaves. Seasonal differences in cancer diagnosis are taken into account by comparing the number of cancer diagnosis attributed to each wave and subsequent interwave period (e.g. for the first wave of the pandemic in Belgium: March 1st 2020 until June 22nd 2020) to the number of cancer diagnosis attributed to the corresponding pre-COVID period (e.g. March 1st–June 22nd 2017).

Analysis

A cohort simulation approach is chosen to analyse the MM. The assumption is that the cohort is distributed between patients within the different initial states of the model (i.e. stage I-IV and the missed diagnoses) at time 0. For every cycle of the MM the correct transition probability is applied and the ratio of cancer patients in each state of the model is adjusted. After numerous iterations of the analysis, a “profile” of the number of patients in each state of the model is developed. As each cancer patient can only be present in one state of the model at any point in time, it is therefore important that for each cycle, the sum of the patients in each health state adds up to the initial number. After multiplying the utility value of the state by the time spent in the actual state and the number of patients from the cohort in that state and adding up the total number of cycles, the model can generate QALY loss estimates. Direct costs are estimated similarly by totalling the costs for patients in each disease state for every cycle, and then by adding up each cycle’s costs along all cycles of the model. Two MMs with the same structure are built, one illustrating the usual care period (i.e. pre-COVID-19 times), and the second illustrating the disrupted situation (i.e. COVID-19 period), both having specific input parameter values (Table 1) and a specific starting cohort. The decision-analytic model reports for the selected cancer types (i.e. breast, colorectal, lung, and head and neck) costs (€) and QALY losses and predicts whether or not the disrupted situation compared to the usual care situation engenders increased costs and QALY losses and to what extent. In our case study, the starting cohort of cancer patients is grouped according to their cancer location, cancer diagnosis timeframe, stage at diagnosis, gender, age, and region of residence. For the model to be as realistic as possible and to enable modellers to compare costs and effects in terms of a net present value, it is necessary to make differential time adjustments by discounting costs and effects [29]. Annual discount rates may range from 1.5% to 5% but some countries have different discount rates for costs and effects. In Belgium, health effects are generally discounted at 1.5% and costs at 3.0% [48].

Table 1. Input parameters for which a value is needed for the MM to be operational.

Each cancer (i.e. breast, colorectal, lung, and head and neck) has its own values.

Aggregated number of initial cancer patients Value Transition probabilities Value Utilities Value Direct costs (hospitalisation, appointments, drugs, radiotherapy, surgery, therapeutic intervention) Value Indirect costs (Productivity loss) Value Discount rate Value
Missed cancer diagnoses Stage I to Stage I FU Stage I Stage I Cost per day absenteeism Costs
Stage I Stage I to Stage I LRR Stage I FU Stage I FU Number of days off work for stage I cancer Effects
Stage II Stage I to Stage I DR Stage I LRR Stage I LRR Number of days off work for stage II cancer
Stage III Stage I to Dead Stage I DR Stage I DR Number of days off work for stage III cancer
Stage IV Stage II to Stage II FU Stage II Stage II Number of days off work for stage IV cancer
Stage II to Stage II LRR Stage II FU Stage II FU Death (based on the Friction Cost Approach) in days
Stage II to Stage II DR Stage II LRR Stage II LRR
Stage II to Dead Stage II DR Stage II DR
Stage III to Stage III FU Stage III Stage III
Stage III to Stage III LRR Stage III FU Stage III FU
Stage III to Stage III DR Stage III LRR Stage III LRR
Stage III to Dead Stage III DR Stage III DR
Stage IV to Stage IV FU Stage IV Stage IV
Stage IV to Stage IV LRR Stage IV FU Stage IV FU
Stage IV to Stage IV DR Stage IV LRR Stage IV LRR
Stage IV to Dead Stage IV DR Stage IV DR
Missed cancer diagnoses to Stage I Missed cancer diagnoses
Missed cancer diagnoses to Stage II
Missed cancer diagnoses to Stage III
Missed cancer diagnoses to Stage IV

FU: Follow-up

LRR: Loco-regional relapse

DR: Distant relapse

Time horizon

The time horizon represents the period over which costs and effects are evaluated [49]. It should be long enough to capture relevant differences in effects and costs among the alternatives examined [50]. Therefore, to evaluate the medium-term health economic impact of the COVID-19 pandemic on delayed cancer care, a 5-year time horizon is preferred. Given the 5-year time horizon and the three-month cycle length, the model runs for 20 cycles and therefore costs and health effects are estimated after 20 cycles.

Sensitivity & scenario analysis

A sensitivity analysis is useful to assess how uncertainty in model inputs influences the model outputs. Indeed, input parameter values of MMs can be found in published literature (i.e. clinical trials or observational studies), databases or through expert opinion for example and may therefore be associated with uncertainty. One-way and probabilistic sensitivity analyses (PSA) are performed to consider uncertainty in the input parameters and to assess the robustness of the model’s results. A one-way sensitivity analysis is a deterministic sensitivity analysis where one parameter is varied at a time to see how the model results are affected [51]. For each cancer type, the aggregated number of cancer patients entering the model for each stage at diagnosis, transition probabilities, utilities, direct costs, indirect costs, and discount rates are included in the sensitivity analysis. A tornado diagram is then used to indicate which of the one-way sensitivity analyses influences the model results the most, with each bar representing a one-way sensitivity analysis and their width illustrating the impact on model results [51]. Since one-way sensitivity analyses underestimate uncertainty because they assume that uncertainty exists only in one parameter, it is useful to also perform a PSA [51]. In a PSA, random sampling from each distribution is used to create a set of input parameter values, the model is then “run” to generate outputs, which are stored. The procedure may be repeated several hundreds or thousands of times, which results in a distribution of outputs that can be visualised on a cost-effective plane, and assessed [52]. As a general recommendation, beta distributions are used for proportions and ratios, gamma for right-skewed parameters (i.e. relative risks, hazard ratios, and odds ratios) [51]. Therefore, in our case study, gamma distributions are used for the aggregated number of cancer patients entering the model for each stage at diagnosis and the costs, beta distributions for transition probabilities, and utilities (which can take a negative value).

Scenario analyses are performed to evaluate methodological and structural assumptions. In our case, at least three additional scenarios will be tested. The first scenario uses a different time horizon of 15 years. This is because for some major cancers such as breast cancer, the cumulative incidence of late breast cancer relapse is 8.5% (95% CI = 8.1% to 8.9%) 15 years after primary diagnosis [53]. It is therefore worth estimating the impact of delayed cancer care on late relapses. The second scenario uses an age-specific model for cancer patients aged between 45 and 64 years, this is because 34% of the estimated new cancer diagnoses and 25% of estimated deaths occur in this age group in Europe [54]. Furthermore, since those patients are part of the workforce it is relevant to assess productivity losses associated with their absence due to the disease. The final scenario consists in using a 0% discount rate for both costs and benefits, which will allow decision makers to judge the importance of using different discount rates for the final result [48].

Our study was not submitted to nor approved by any institutional ethics committee because our study does not involve human participants, human data or human tissue.

Discussion

Considering that the health and economic burden of cancer is more than substantial [4], it seems crucial to prioritise resource allocation considering the needs of patients, society, and healthcare systems based on health economic evidence. Given its adaptable and accessible features, decision-analytical modelling, and particularly multistate MM, can be used to unravel the health and health economic impact of delayed cancer care in diverse contexts and settings. Through our study focusing on the COVID-19 pandemic and Belgium we offer a MM methodology assessing the impact of delayed cancer care that can be applied to address a variety of research questions in a range of settings and situations. Decision-makers may be particularly interested in the findings of such health economic analyses since they will help them decide how to deploy resources to enhance cancer patients’ health outcomes and keep costs of care down for both patients and healthcare systems.

In 2016, the World Health Organisation predicted an 18 million shortage of healthcare workers by 2030 [55]. The growing demand for cancer treatment in the past decades when treatment capacity had not increased proportionally enough may partly explain delayed cancer care and therefore play a substantial part in the economic burden of cancer [11, 56]. The recent COVID-19 pandemic caused further disruptions in the cancer care sector which aggravated the baseline situation [16, 17, 57]. The National Institute for Public Health and the Environment (RIVM) in the Netherlands published multiple reports where the indirect impact of the pandemic on delayed care of various diseases are estimated. The RIVM were asked to model in one of their reports, the expected effect of delayed care for skin melanoma on quality of life based on a shift in the stage at which the cancer is diagnosed and treated [58]. Two scenarios were tested with three and six months delayed diagnosis and treatment for a time horizon of five and ten years. Results showed that in a three-month delay scenario patients diagnosed with a certain stage would progress to the next stage (i.e. stage I to stage II). In the latter scenario, the stage shift would result in 549 and 1,229 years of life lost and 853 and 1,704 QALY losses respectively over a five and ten-year time horizon. However, for the six-month delay scenario, patients would advance two stages (i.e. stage I to stage III) which would result in 1,058 and 2,432 years of life lost and 1,454 and 3,021 QALY losses respectively over a five and ten-year time horizon. Those estimations appear substantial, however, it may take a few years before being able to quantify the actual extent of the collateral damage caused by the sanitary crisis for cancers.

A recent systematic review and meta-analysis evaluating the impact of delay in treatment on the risk of death across seven types of major tumours (i.e. bladder, breast, colon, rectum, lung, cervix, and head and neck) found that a four-week treatment delay was associated with a 6 to 13% increased risk of death, depending on the treatment modality [6]. Elective surgery was halted for more than four weeks in most countries during the first wave of the COVID-19 pandemic, delaying the treatment of cancer patients [6]. It therefore seems important to evaluate the collateral damage that the sanitary crisis may have caused on cancer care.

Researchers conducting their study in Belgium or similar settings may find the present study useful in terms of administrative data collection. Indeed, it may allow one to know which data holders to consult when conducting a health economic evaluation on cancer or which variables to select from a particular database when initiating a data request.

The present study may also provide scientists conducting a health economic evaluation in a context including cancer and COVID-19 with insights on cancer type selection, the elaboration of a MM, data inputs, and analysis.

There are multiple applications possible for the type of model exposed in this study other than the COVID-19 pandemic and Belgium. One could investigate the impact of errors in cancer diagnosis on delayed cancer care. The disrupted situation would be compared to the usual care situation (i.e. no error in diagnosis) and the potential increased costs and negative impact on the quality of life of the patient due to mistakes in diagnosis could guide decision-makers in allocating resources in technologies that have proven to decrease those lapses. Another interesting application of this model could be to evaluate the impact of an innovative cancer screening test compared to the standard test or no cancer screening on delayed cancer care in a specific country, for cancers that are typically not diagnosed until they are at an advanced stage. The estimated costs and health effects of the intervention could allow decision-makers to either opt for a new screening test, the standard test or no screening, based on the most cost-effective option in a specific context and setting. Health economists using the present MM protocol may attribute value to their final model by finding comparable results in similar published studies.

We acknowledge some limitations within our study. First of all, non-invasive cancer (stage 0), which may progress into a further cancer stage, is not taken into account, when in reality, a proportion of the population is affected by it. The reason for this is the lack of published evidence related to MM input parameters such as TPs, utilities, and costs. Hence, depending on the proportion of the population presenting non-invasive cancer costs and QALY losses may be underestimated. Another important limitation is that the difference in cancer cases observed when comparing the usual care period to the disrupted situation may not entirely be due to the disrupted situation. Indeed, even during usual care periods there may be several potential delays in the cancer diagnostic and/ or treatment pathway (i.e. patient delay, primary care delay and secondary care delay), which may also explain the potential decrease in cancer cases [8]. A further limitation is that the present study aims to provide a MM methodology that can be adapted to different studies in different countries, however as already stated by Willems et al., accessibility to health economic data differs by country [59]. Although clinical data may be extrapolated across countries, economic information depends on a country’s characteristics, therefore data imputation may occur. The availability and timeliness of a country’s epidemiological and cost data represent another limitation. Even in developed countries, centralised data is not always accessible, necessitating the completion of strenuous and time-consuming administrative tasks (i.e. data linkages along with data requests). The costs and barriers related to reusing these administrative and health data, privacy concerns, and in the case of individual linkage, the administrative burden must not be forgotten.

MMs have some inherent limitations, such as the fact that they always depict a simplification of reality. Moreover, there is uncertainty linked to model parameters (although they are taken into account in the PSA) and modelling assumptions, such as the time horizon and the cycle length [23]. In our study, we account for parameter uncertainty as well as scenario uncertainty, trying to summarise at best the uncertainty coming from methodological choices. An essential and recognised limitation of a MM is its “memoryless” feature also called the “Markovian assumption”, being that the probability of moving from one health state to another is not influenced by the patient’s history [23]. However, this constraint may be overcome by using time-dependent TPs and by using a combination of separate states to model specific patient histories. An additional element to be cautious about is the calculation of TPs for the MM, indeed probabilities found in the literature may not refer to the same cycle length selected for the MM. It is therefore necessary to use adequate equations [23]. Additional elements of a MM may be open to criticism such as its difficulty to simulate interactions between individuals and the environment as well as its lack of ability to manage multiple events simultaneously [23]. Such limitations can be overcome by using agent-based models.

Since cancer already carries a significant health and economic burden, it appears essential to stop the problem from getting worse by, for example, addressing delayed cancer care. Using health economic evaluations in decision-making could result in allocating resources in ways which improve health outcomes of cancer patients and minimise costs for patients, society and healthcare systems. Multistate MMs are analytical frameworks well used in decision analysis, adaptable to various contexts and settings and are well used to describe chronic conditions such as cancer. A future paper is aimed to be published using the presented methodology and as yet unavailable Belgian data, which will allow for estimating the medium-term health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium.

Supporting information

S1 Appendix. Cancer patient selection for the estimation of the direct costs of cancer.

(DOCX)

Acknowledgments

We would like to thank the cancer experts who have kindly accepted to review our study protocol.

Data Availability

No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.

Funding Statement

- The HELICON project received the grant - The grand number is: B2/202/P3/HELICON - The funder is the Belgian Science Policy Office (BELSPO) within the BRAIN-be 2.0 framework supporting pillar 3 Federal societal challenges - https://www.belspo.be/belspo/index_en.stm - The funders had and will not have a role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.ECIS. Estimates of cancer incidence and mortality in 2020, for all cancer sites. 2022 [Cited 2022 April 10]; Available from: https://ecis.jrc.ec.europa.eu/explorer.php?$0-0$1-AEE$2-All$4-1,2$3-All$6-0,85$5-2020,2020$7-7$CEstByCancer$X0_8-3$CEstRelativeCanc$X1_8-3$X1_9-AE27$CEstBySexByCancer$X2_8-3$X2_-1-1
  • 2.GLOBOCAN. Summary cancer statistics for Europe in 2020. 2020. [Cited 2022 March 23]; Available from: https://gco.iarc.fr/today/data/factsheets/populations/908-europe-fact-sheets.pdf [Google Scholar]
  • 3.Institute for Health Metrics and Evaluation (IHME). Global Burden of Disease (GBD). 2022 [Cited 2022 April 5]; Available from: https://vizhub.healthdata.org/gbd-compare/
  • 4.Hofmarcher T, Lindgren P, Wilking N, Jönsson B. The cost of cancer in Europe 2018. Eur J Cancer. 2020. Apr;129:41–9. doi: 10.1016/j.ejca.2020.01.011 [DOI] [PubMed] [Google Scholar]
  • 5.World Health Organization (WHO). Promoting Cancer Early Diagnosis. 2022. [Cited 2022 May 10]; Available from: https://www.who.int/activities/promoting-cancer-early-diagnosis [Google Scholar]
  • 6.Hanna TP, King WD, Thibodeau S, Jalink M, Paulin GA, Harvey-Jones E, et al. Mortality due to cancer treatment delay: systematic review and meta-analysis. BMJ. 2020. Nov 4;m4087. doi: 10.1136/bmj.m4087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Saab MM, Noonan B, Kilty C, FitzGerald S, Collins A, Lyng Á, et al. Awareness and help-seeking for early signs and symptoms of lung cancer: A qualitative study with high-risk individuals. Eur J Oncol Nurs. 2021. Feb 1;50:101880. doi: 10.1016/j.ejon.2020.101880 [DOI] [PubMed] [Google Scholar]
  • 8.National Health Service (NHS). Achieving World-Class Cancer Outcomes: A Strategy for England 2015–2020 –Progress Report 2016–17. 2017; Available from: https://www.england.nhs.uk/wp-content/uploads/2017/10/national-cancer-transformation-programme-2016-17-progress.pdf
  • 9.dos-Santos-Silva I, Gupta S, Orem J, Shulman LN. Global disparities in access to cancer care. Commun Med. 2022. Apr 7;2(1):1–4. doi: 10.1038/s43856-022-00097-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Weaver SJ, Jacobsen PB. Cancer care coordination: opportunities for healthcare delivery research. Transl Behav Med. 2018. May 23;8(3):503–8. doi: 10.1093/tbm/ibx079 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Atun R, Jaffray DA, Barton MB, Bray F, Baumann M, Vikram B, et al. Expanding global access to radiotherapy. Lancet Oncol. 2015. Sep 1;16(10):1153–86. doi: 10.1016/S1470-2045(15)00222-3 [DOI] [PubMed] [Google Scholar]
  • 12.World Health Organization (WHO). Maintaining essential health services: operational guidance for the COVID-19 context, interim guidance. 2020. [Cited 2022 June 5]; Available from: https://www.who.int/publications/i/item/WHO-2019-nCoV-essential_health_services-2020.2 [Google Scholar]
  • 13.Spencer K, Jones CM, Girdler R, Roe C, Sharpe M, Lawton S, et al. The impact of the COVID-19 pandemic on radiotherapy services in England, UK: a population-based study. Lancet Oncol. 2021. Mar;22(3):309–20. doi: 10.1016/S1470-2045(20)30743-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Riera R, Bagattini ÂM, Pacheco RL, Pachito DV, Roitberg F, Ilbawi A. Delays and Disruptions in Cancer Health Care Due to COVID-19 Pandemic: Systematic Review. JCO Glob Oncol. 2021. Dec;(7):311–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Hanna TP, Evans GA, Booth CM. Cancer, COVID-19 and the precautionary principle: prioritizing treatment during a global pandemic. Nat Rev Clin Oncol. 2020. May;17(5):268–70. doi: 10.1038/s41571-020-0362-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Maringe C, Spicer J, Morris M, Purushotham A, Nolte E, Sullivan R, et al. The impact of the COVID-19 pandemic on cancer deaths due to delays in diagnosis in England, UK: a national, population-based, modelling study. Lancet Oncol. 2020. Aug;21(8):1023–34. doi: 10.1016/S1470-2045(20)30388-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Collaborative COVIDSurg. Effect of COVID-19 pandemic lockdowns on planned cancer surgery for 15 tumour types in 61 countries: an international, prospective, cohort study. Lancet Oncol. 2021. Nov;22(11):1507–17. doi: 10.1016/S1470-2045(21)00493-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Peacock HM, Tambuyzer T, Verdoodt F, Calay F, Poirel HA, Schutter HD, et al. Decline and incomplete recovery in cancer diagnoses during the COVID-19 pandemic in Belgium: a year-long, population-level analysis. ESMO Open [Internet]. 2021. Jul 1 [cited 2021 Aug 4];0(0). Available from: https://www.esmoopen.com/article/S2059-7029(21)00158-7/abstract doi: 10.1016/j.esmoop.2021.100197 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Belgian Cancer Registry (BCR). Short report—Cancer in Belgium, 2020. 2022. [Cited 2022 May 6]; Available from: https://kankerregister.org/media/docs/publications/rapporten/CancerenBelgique2020(FINAL020822).pdf [Google Scholar]
  • 20.Garrido-Cantero G, Longo F, Hernández-González J, Pueyo Á, Fernández-Aparicio T, Dorado JF, et al. Impact of the COVID-19 Pandemic on Cancer Diagnosis in Madrid (Spain) Based on the RTMAD Tumor Registry (2019–2021). Cancers. 2023. Mar 14;15(6):1753. doi: 10.3390/cancers15061753 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Adachi K, Kimura F, Takahashi H, Kaise H, Yamada K, Ueno E, et al. Delayed Diagnosis and Prognostic Impact of Breast Cancer During the COVID-19 Pandemic. Clin Breast Cancer. 2023. Apr;23(3):265–71. doi: 10.1016/j.clbc.2023.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Gheorghe A, Maringe C, Spice J, Purushotham A, Chalkidou K, Rachet B, et al. Economic impact of avoidable cancer deaths caused by diagnostic delay during the COVID-19 pandemic: A national population-based modelling study in England, UK. Eur J Cancer. 2021. Jul 1;152:233–42. doi: 10.1016/j.ejca.2021.04.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Briggs AH, Claxton K, Sculpher M. Decision Modelling for Health Economic Evaluation. 2006. [Google Scholar]
  • 24.CHEERS, Drummond M, Augustovski F. Explanation and Elaboration: A report of the ISPOR CHEERS II Good Practices Task Force. Value Health. 2022;25(1):10–31. [DOI] [PubMed] [Google Scholar]
  • 25.Belgian Cancer Registry (BCR). Cancer Burden In Belgium, 2004–2019. 2022 [Cited 2022 June 2]; Available from: https://kankerregister.org/media/docs/publications/Shortreport_Cancerburden_2004-2019.pdf
  • 26.Cone EB, Marchese M, Paciotti M, Nguyen DD, Nabi J, Cole AP, et al. Assessment of Time-to-Treatment Initiation and Survival in a Cohort of Patients With Common Cancers. JAMA Netw Open. 2020. Dec 14;3(12):e2030072. doi: 10.1001/jamanetworkopen.2020.30072 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Sonnenberg F, Beck J. Markov Models in Medical Decision Making: A Practical Guide. Med Decis Mak Int J Soc Med Decis Mak. 1993. Dec 1;13:322–38. doi: 10.1177/0272989X9301300409 [DOI] [PubMed] [Google Scholar]
  • 28.Komorowski M, Raffa J. Markov Models and Cost Effectiveness Analysis: Applications in Medical Research. In: MIT Critical Data, editor. Secondary Analysis of Electronic Health Records [Internet]. Cham: Springer International Publishing; 2016. [cited 2022 Aug 19]. p. 351–67. Available from: doi: 10.1007/978-3-319-43742-2_24 [DOI] [PubMed] [Google Scholar]
  • 29.Carta A, Conversano C. On the Use of Markov Models in Pharmacoeconomics: Pros and Cons and Implications for Policy Makers. Front Public Health [Internet]. 2020. [cited 2022 Aug 18];8. Available from: https://www.frontiersin.org/articles/10.3389/fpubh.2020.569500 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Siebert U, Alagoz O, Bayoumi AM, Jahn B, Owens DK, Cohen DJ, et al. State-Transition Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3. Value Health. 2012. Sep 1;15(6):812–20. doi: 10.1016/j.jval.2012.06.014 [DOI] [PubMed] [Google Scholar]
  • 31.Neki K, Eto K, Kosuge M, Ohkuma M, Ito D, Takeda Y, et al. Identification of the Risk Factors for Recurrence of Stage III Colorectal Cancer. Anticancer Res. 2019. Oct;39(10):5721–4. doi: 10.21873/anticanres.13772 [DOI] [PubMed] [Google Scholar]
  • 32.Osterman E, Glimelius B. Recurrence Risk After Up-to-Date Colon Cancer Staging, Surgery, and Pathology: Analysis of the Entire Swedish Population. Dis Colon Rectum. 2018. Sep;61(9):1016–25. doi: 10.1097/DCR.0000000000001158 [DOI] [PubMed] [Google Scholar]
  • 33.von Schuckmann LA, Hughes MCB, Ghiasvand R, Malt M, van der Pols JC, Beesley VL, et al. Risk of Melanoma Recurrence After Diagnosis of a High-Risk Primary Tumor. JAMA Dermatol. 2019. Jun 1;155(6):688–93. doi: 10.1001/jamadermatol.2019.0440 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.The National Institute for Health and Care Excellence (NICE). Definition of Quality-adjusted life year. 2022. [Cited 2022 August 10]; Available from: https://www.nice.org.uk/glossary?letter=q [Google Scholar]
  • 35.Van Wilder L, Rammant E, Clays E, Devleesschauwer B, Pauwels N, De Smedt D. A comprehensive catalogue of EQ-5D scores in chronic disease: results of a systematic review. Qual Life Res. 2019. Dec 1;28(12):3153–61. doi: 10.1007/s11136-019-02300-y [DOI] [PubMed] [Google Scholar]
  • 36.Zhou T, Guan H, Wang L, Zhang Y, Rui M, Ma A. Health-Related Quality of Life in Patients With Different Diseases Measured With the EQ-5D-5L: A Systematic Review. Front Public Health. 2021;9:675523. doi: 10.3389/fpubh.2021.675523 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Janssen MF, Bonsel GJ, Luo N. Is EQ-5D-5L Better Than EQ-5D-3L? A Head-to-Head Comparison of Descriptive Systems and Value Sets from Seven Countries. Pharmacoeconomics. 2018;36(6):675–97. doi: 10.1007/s40273-018-0623-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.EuroQol. Population Norms. 2022 [Cited 2022 June 7]; Available from: https://euroqol.org/eq-5d-instruments/population-norms/ [Google Scholar]
  • 39.Lei L, Cooley SG, Phibbs CS, Kinosian B, Allman RM, Porsteinsson AP, et al. Attributable Cost of Dementia: Demonstrating Pitfalls of Ignoring Multiple Health Care System Utilization. Health Serv Res. 2018. Dec;53 Suppl 3:5331–51. doi: 10.1111/1475-6773.13048 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Snowden JM, Rose S, Mortimer KM. Implementation of G-Computation on a Simulated Data Set: Demonstration of a Causal Inference Technique. Am J Epidemiol. 2011. Apr 1;173(7):731–8. doi: 10.1093/aje/kwq472 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Keiding N, Clayton D. Standardization and Control for Confounding in Observational Studies: A Historical Perspective. Stat Sci. 2014;29(4):529–58. [Google Scholar]
  • 42.Hennessy S, Bilker WB, Berlin JA, Strom BL. Factors influencing the optimal control-to-case ratio in matched case-control studies. Am J Epidemiol. 1999. Jan 15;149(2):195–7. doi: 10.1093/oxfordjournals.aje.a009786 [DOI] [PubMed] [Google Scholar]
  • 43.In H, Solsky I, Simon CA, Winchester DP. Lack of Cancer Recurrence Data in Large Databases: A National Survey of Hospital Cancer Registries. J Surg Res. 2019. Mar;235:551–9. [DOI] [PubMed] [Google Scholar]
  • 44.Statbel. Health index. 2022 [Cited 2022 April 18]; Available from: https://statbel.fgov.be/en/themes/consumer-prices/health-index
  • 45.Steinmann M, Scholz S, Greiner W, Ultsch B. PRM33—HUMAN CAPITAL VS. FRICTION COST APPROACH–DIFFERENCES IN THE PRESENCE OF DEATH AND LONG-TERM CONSEQUENCES. Value Health. 2018. Oct 1;21:S361. [Google Scholar]
  • 46.Pike J, Grosse SD. Friction cost estimates of productivity costs in cost-of-illness studies in comparison with human capital estimates: a review. Appl Health Econ Health Policy. 2018. Dec;16(6):765–78. doi: 10.1007/s40258-018-0416-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hakkaart-van Roijen L. Handleiding voor kostenonderzoek: Methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg. 2010. [Cited 2022 August 10]; Available from: https://docplayer.nl/6361834-Handleiding-voor-kostenonderzoek-methoden-en-standaard-kostprijzen-voor-economische-evaluaties-in-de-gezondheidszorg.html [Google Scholar]
  • 48.Cleemput I, Neyt M, Van de Sande S. Belgian guidelines for economic evaluations and budget impact analyses: second edition. Health Technology Assessment (HTA). KCE [Internet]. 2012. [Cited 2022 April 17]; Available from: https://kce.paddlecms.net/sites/default/files/2021-11/KCE_183_economic_evaluations_second_edition_Report_update.pdf [Google Scholar]
  • 49.O’Mahony JF, Newall AT, van Rosmalen J. Dealing with Time in Health Economic Evaluation: Methodological Issues and Recommendations for Practice. Pharmacoeconomics. 2015;33(12):1255–68. doi: 10.1007/s40273-015-0309-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Weinstein MC, O’Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, et al. Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices—Modeling Studies. Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2003. Feb;6(1):9–17. doi: 10.1046/j.1524-4733.2003.00234.x [DOI] [PubMed] [Google Scholar]
  • 51.Briggs AH, Weinstein MC, Fenwick EAL, Karnon J, Sculpher MJ, Paltiel AD, et al. Model parameter estimation and uncertainty analysis: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-6. Med Decis Mak Int J Soc Med Decis Mak. 2012. Oct;32(5):722–32. doi: 10.1177/0272989X12458348 [DOI] [PubMed] [Google Scholar]
  • 52.York Health Economics Consortium (YHEC). Probabilistic/Stochastic Sensitivity Analysis. 2016; Available from: https://yhec.co.uk/glossary/probabilistic-stochastic-sensitivity-analysis/ [Google Scholar]
  • 53.Pedersen RN, Esen BÖ, Mellemkjær L, Christiansen P, Ejlertsen B, Lash TL, et al. The Incidence of Breast Cancer Recurrence 10–32 Years After Primary Diagnosis. JNCI J Natl Cancer Inst. 2022. Mar 1;114(3):391–9. doi: 10.1093/jnci/djab202 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Dyba T, Randi G, Bray F, Martos C, Giusti F, Nicholson N, et al. The European cancer burden in 2020: Incidence and mortality estimates for 40 countries and 25 major cancers. Eur J Cancer Oxf Engl 1990. 2021. Nov;157:308–47. doi: 10.1016/j.ejca.2021.07.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Darzi A, Evans T. The global shortage of health workers-an opportunity to transform care. Lancet Lond Engl. 2016. Nov 26;388(10060):2576–7. doi: 10.1016/S0140-6736(16)32235-8 [DOI] [PubMed] [Google Scholar]
  • 56.House of Commons. NHS backlogs and waiting times in England: Forty-Fourth Report of Session 2021–22. 2022. [Cited 2022 June 10]; Available from: https://committees.parliament.uk/publications/9266/documents/160332/default/ [Google Scholar]
  • 57.World Health Organization (WHO). Addressing backlogs and managing waiting lists during and beyond the COVID-19 pandemic. 2022. [Cited 2022 June 4]; Available from: https://apps.who.int/iris/bitstream/handle/10665/351082/Eurohealth-28-1-35-40-eng.pdf?sequence=1&isAllowed=y [PubMed] [Google Scholar]
  • 58.Rijksinstituut voor Volksgezondheid en Milieu (RIVM). Impact van de eerste COVID-19 golf op de reguliere zorg en gezondheid. 2020; Available from: https://www.rivm.nl/bibliotheek/rapporten/2020-0183-bijlagen [Google Scholar]
  • 59.Willems R, Pil L, Lambrinou CP, Kivelä J, Wikström K, Gonzalez-Gil EM, et al. Methodology of the health economic evaluation of the Feel4Diabetes-study. BMC Endocr Disord. 2020. Mar 12;20(Suppl 1):14. doi: 10.1186/s12902-019-0471-3 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Matteo Ruggeri

27 Mar 2023

PONE-D-22-31778Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocolPLOS ONE

Dear Dr. Khan, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please note that I have acted as a reviewer for this manuscript, and you will find my comments below, under Reviewer #2.

Please submit your revised manuscript by May 11 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Matteo Ruggeri

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Our staff editors have determined that your manuscript is likely within the scope of our Early Detection, Screening and Diagnosis of Cancer Call for Papers. This editorial initiative is headed by in-house PLOS editors. This Call for Papers aims to explore recent advances in the early detection of cancer and implications of these advances for patient survival. Additional information can be found on our announcement page: https://collections.plos.org/call-for-papers/early-detection-screening-and-diagnosis-of-cancer/

If you would like your manuscript to be considered for this collection, please let us know in your cover letter and we will ensure that your paper is treated as if you were responding to this call. Please note that being considered for the Call for Papers does not require additional peer review beyond the journal’s standard process and will not delay the publication of your manuscript if it is accepted by PLOS ONE. If you would prefer to remove your manuscript from collection consideration, please specify this in the cover letter

3. Please confirm that all data sources you used were publicly available and anonymized. If this is not the case, please provide information on what permissions you were granted to access these data.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper “Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol” presents a protocol for investigating the health and economic impact of delaying cancer diagnosis due to the pandemic. The protocol deals with all the relevant aspect of such a kind of analysis, even though it mostly relies on a teaching approach that could be considered rude for expert readers. In fact, the main concern of the protocol is that it only presents the underlying methodology. I would have expected to see some input parameters already identified and reported and more information provided on crucial aspects of the analysis. In respect to the latter aspect, Authors mentioned a matched case-control study that is not thoroughly described in its aim and methodology. I guess that querying the BRC would serve to understand how distribution among states has been affected by covid, but this is not clear. Furthermore, Authors spoke about two Belgian experts, but they did not provide any information about their background and selection. Eventually, introduction could be enriched of current literature on the delays (and their impacts) due to the covid also to better disentangle the rationale behind the study and the research gap that it is going to meet.

Reviewer #2: The study protocol is well written and referenced. Methods are technically sound and robust. However, the protocol follows a very traditional approach and I do not see actually a valid reason for publication. 

For a protocol to be published this should include an innovative methodology or a soecial interest for other readers to reply the protocol and therefore compare results, which is not the case at this time.

Authors should publish the manuscript ad full research article once results are ready.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Oct 30;18(10):e0288777. doi: 10.1371/journal.pone.0288777.r002

Author response to Decision Letter 0


26 May 2023

Manuscript title:

Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol

Authors:

Yasmine Khan, Nick Verhaeghe, Robby De Pauw, Brecht Devleesschauwer, Sylvie Gadeyne, Vanessa Gorasso, Yolande Lievens, Niko Speybroek, Nancy Vandamme, Miet Vandemaele, Laura Van den Borre, Sophie Vandepitte, Katrien Vanthomme, Freija Verdoodt, Delphine De Smedt

Dear Editor,

Dear Reviewers,

We appreciate the valuable comments and suggestions you provided for our manuscript, which we have considered carefully. Please refer to our response below, where we address each point raised (indicated in bold and italic). Additionally, we have incorporated the changes in the manuscript, which are highlighted (in italic and underlined) in our response. Furthermore, we updated the manuscript because of an important development regarding data availability. The Belgian Cancer Registry has notified the authors that the data regarding the skin melanoma cancer type cannot be delivered due to quality control issues. Hence, we have suppressed all information regarding skin melanoma cancer from the manuscript.

Reviewer #1: The paper “Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol” presents a protocol for investigating the health and economic impact of delaying cancer diagnosis due to the pandemic. The protocol deals with all the relevant aspect of such a kind of analysis, even though it mostly relies on a teaching approach that could be considered rude for expert readers. In fact, the main concern of the protocol is that it only presents the underlying methodology. I would have expected to see some input parameters already identified and reported and more information provided on crucial aspects of the analysis. In respect to the latter aspect, Authors mentioned a matched case-control study that is not thoroughly described in its aim and methodology. I guess that querying the BRC would serve to understand how distribution among states has been affected by covid, but this is not clear. Furthermore, Authors spoke about two Belgian experts, but they did not provide any information about their background and selection. Eventually, introduction could be enriched of current literature on the delays (and their impacts) due to the covid also to better disentangle the rationale behind the study and the research gap that it is going to meet.

Detail of comment:

“I would have expected to see some input parameters already identified and reported and more information provided on crucial aspects of the analysis. In respect to the latter aspect, Authors mentioned a matched case-control study that is not thoroughly described in its aim and methodology. I guess that querying the BRC would serve to understand how distribution among states has been affected by covid, but this is not clear.”

Reply:

Thank you for your comment. At the moment, input parameters cannot be identified and described accurately by the Authors. When the data will be delivered, we will review the data quality of the requested variables. We will then provide comprehensive details on the input parameters and the data sources, together with the results. Our goal for this manuscript was to provide a methodological framework that enables researchers to evaluate the impact of the COVID-19 pandemic on delayed cancer care from a health-economic perspective in their own country. We believe that presenting the methodology before conducting the analyses is worthwhile to provide a clear, transparent and replicable framework.

We have added more information on the matched case-control study from line 236-250 as follows:

In a parallel study, cancer costs are estimated at the individual level for each considered cancer site and each cancer stage with the method of recycled predictions (also known as the method of standardisation or g-computation), which determines the marginal difference in costs for a sample of patients being affected with one type of cancer compared to a sample of the general population who do not present any cancer diagnosis (39–41). The aim is to estimate the average total healthcare expenditure during one year, being 2018 (the most recent year for which data is available) for cancer patients according to their cancer site and their cancer stage, which will be used as input in the model. The cancer population consists of a sample of the Belgian cancer population alive on the 1st January 2018, and who had at least one cancer diagnosis of the considered cancers during the 10 previous years (S1 Appendix). The control sample is selected from the healthcare insurer database (IMA) if they were alive on the 1st January 2018 and were not diagnosed with cancer in the 10 years preceding 2018. In order to limit the amount of individuals, a random subset of the patient population is made. Matching is done based on age, sex, and region of residence available on the 1st January 2018. A case-control ratio of 1:4 is used, considering that including more than four controls per case does not increase significantly the statistical power (42).

Detail of comment:

“Furthermore, Authors spoke about two Belgian experts, but they did not provide any information about their background and selection.”

Reply:

We agree with this comment and have specified (line 119-127):

To know whether the model is a good reflection of reality, validation is sought by two Belgian experts. Experts were selected using following criteria: at least 10 years of medical practice and active research experience in the field of cancer health economics in Belgium. Expert A has been working as an oncologist for over 20 years and has received health economic training. His research expertise includes the impact of the COVID-19 pandemic on delayed cancer diagnosis and treatment in Belgium. Expert B is an expert in radiation oncology and in health economics. Her work experience includes the organizational aspects of cancer treatment, including the financial and health economic aspects of cancer care.

Detail of comment:

“Eventually, introduction could be enriched of current literature on the delays (and their impacts)

due to the covid also to better disentangle the rationale behind the study and the research gap that it is going to meet.”

Reply:

We appreciate your suggestion. We have subsequently revised the introduction and included new and recent references. We have incorporated this in line 85-94 as follows:

A recent study conducted by the Madrid tumor registry analysed cancer diagnoses between 2019-2021 in Spain. The study evaluated the differences in annual volume, observed-to-expected (O/E) volume ratios, and standardised incidence rate ratios for 2020-2021 compared to 2019, which was found to be 94.5% (95% CI 93.8-95.3). The study revealed that most cancer types were underdiagnosed in 2020, and this trend worsened in 2021 for colorectal and prostate cancers (87.8%). However, lung cancer showed improvement (102.1%), and breast cancer was overdiagnosed (114.4%) compared to pre-COVID-19 reference data (20). Another study conducted in Japan found more aggressive and advanced disease after the suspension of breast cancer screening services during the COVID-19 pandemic with the percentage of stage IIB or higher patients being significantly higher in the pandemic group than in the non-pandemic group (22.0% vs 31.3%, p= 0.0133) (21).

Reviewer #2: The study protocol is well written and referenced. Methods are technically sound and robust. However, the protocol follows a very traditional approach and I do not see actually a valid reason for publication.

For a protocol to be published this should include an innovative methodology or a soecial interest for other readers to reply the protocol and therefore compare results, which is not the case at this time.

Authors should publish the manuscript ad full research article once results are ready.

Reply:

Thank you for taking the time to review our study protocol and for your positive feedback. We appreciate your comment regarding the traditional approach of our protocol, but we would like to clarify that our objective was not to introduce a new or innovative methodology. Instead, our aim was to provide a reproducible and accessible framework that could be used by researchers to evaluate the impact of the COVID-19 pandemic on delayed cancer care from a health-economic perspective in their own country., instead of waiting for long-time observational data.

Our study protocol fills a gap in the literature by providing a detailed and comprehensive description of the methodology and analytical approach we intend to use in our subsequent research article and that may also serve as inspiration for such future research. We conducted a thorough literature review and had discussions with high-value oncologists to ensure that our protocol follows the best practices in the field. Our goal was to develop a framework that other researchers could utilise to evaluate the health-economic impact of the pandemic on cancer care. We recognise the significance of transparency in research and guarantee to provide a comprehensive explanation of our methods.

We acknowledge that our protocol does not provide results or input parameters from a specific study, but we believe that it is an essential first step in evaluating the impact of the pandemic on cancer care. Without a comprehensive study protocol, it may be challenging for researchers to evaluate the methods and analytical approach used in our study. The 2022 version of the CHEERS checklist now includes an item called “Health economic analysis plan” to indicate whether a health economic analysis plan was developed and where to find it, which highlights the importance of developing a robust protocol before diving into health economic evaluations (Husereau et al., 2022).

References:

Husereau, D., Drummond, M., Augustovski, F., de Bekker-Grob, E., Briggs, A. H., Carswell, C., Caulley, L., Chaiyakunapruk, N., Greenberg, D., Loder, E., Mauskopf, J., Mullins, C. D., Petrou, S., Pwu, R.-F., Staniszewska, S., & on behalf of CHEERS 2022 ISPOR Good Research Practices Task Force. (2022). Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement : Updated reporting guidance for health economic evaluations. BMC Medicine, 20(1), 23. https://doi.org/10.1186/s12916-021-02204-0

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 1

Matteo Ruggeri

4 Jul 2023

Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol

PONE-D-22-31778R1

Dear Dr. Kahn

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Matteo Ruggeri

Academic Editor

PLOS ONE

Acceptance letter

Matteo Ruggeri

10 Jul 2023

PONE-D-22-31778R1

Evaluating the health and health economic impact of the COVID-19 pandemic on delayed cancer care in Belgium: A Markov model study protocol

Dear Dr. Khan:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Matteo Ruggeri

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Cancer patient selection for the estimation of the direct costs of cancer.

    (DOCX)

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES