Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2021 Aug 5;24(11):1570–1577. doi: 10.1016/j.jval.2021.05.023

Predicting Hospital Resource Use During COVID-19 Surges: A Simple but Flexible Discretely Integrated Condition Event Simulation of Individual Patient-Hospital Trajectories

J Jaime Caro 1,2,, Jörgen Möller 2, Vatshalan Santhirapala 3, Harpreet Gill 1,4, Jessica Johnston 4, Kariem El-Boghdadly 4, Ramai Santhirapala 4, Paul Kelly 4, Alistair McGuire 1
PMCID: PMC8339677  PMID: 34711356

Abstract

Objectives

To assist with planning hospital resources, including critical care (CC) beds, for managing patients with COVID-19.

Methods

An individual simulation was implemented in Microsoft Excel using a discretely integrated condition event simulation. Expected daily cases presented to the emergency department were modeled in terms of transitions to and from ward and CC and to discharge or death. The duration of stay in each location was selected from trajectory-specific distributions. Daily ward and CC bed occupancy and the number of discharges according to care needs were forecast for the period of interest. Face validity was ascertained by local experts and, for the case study, by comparing forecasts with actual data.

Results

To illustrate the use of the model, a case study was developed for Guy’s and St Thomas’ Trust. They provided inputs for January 2020 to early April 2020, and local observed case numbers were fit to provide estimates of emergency department arrivals. A peak demand of 467 ward and 135 CC beds was forecast, with diminishing numbers through July. The model tended to predict higher occupancy in Level 1 than what was eventually observed, but the timing of peaks was quite close, especially for CC, where the model predicted at least 120 beds would be occupied from April 9, 2020, to April 17, 2020, compared with April 7, 2020, to April 19, 2020, in reality. The care needs on discharge varied greatly from day to day.

Conclusions

The DICE simulation of hospital trajectories of patients with COVID-19 provides forecasts of resources needed with only a few local inputs. This should help planners understand their expected resource needs.

Keywords: capacity, COVID-19, hospital resources, individual simulation, patient trajectories, DICE

Introduction

Faced with the potential for many admissions for COVID-19, hospitals worldwide have sought to anticipate their needs for critical care (CC) beds, related equipment, and staffing. Given the lack of knowledge of this disease,1, 2, 3, 4, 5 it was deemed necessary early in the pandemic to resort to the use of some form of predictive model,6 , 7 formal or informal, capable of forecasting the demand for resources as the epidemic evolved.8 Although various epidemiologic models have been developed,9, 10, 11, 12 these address the likely course of the epidemic at a national or regional level13, 14, 15, 16, 17, 18, 19, 20—a level of aggregation that is not helpful for individual hospitals. Even when the predictions were for a city,15 , 21 , 22 these remained too broad to reflect the needs of an individual institution. In a particular center, the pattern of arrivals and the mix of the population from its catchment population might not reflect that of the larger area.23 Nosocomial infections and tertiary referrals may add further to a hospital’s case load.

Apart from the possible differences in the epidemic between a hospital’s catchment area and the broader region, specialty services may vary locally, and these will affect the demand for resources. To anticipate bottlenecks in delivery, any predictive modeling has to sufficiently adjust to each center’s circumstances. This requires a model capable of simulating in detail the course of patients according to a particular hospital’s practices. Because most centers do not have the capability to develop these simulations on their own, a tool that may be used by many hospitals to model patient flow during the COVID-19 pandemic can be of benefit. Such a tool must allow the customization of inputs to produce suitable estimates that hospital teams can reliably use to make decisions regarding expanding capacity, providing care for patients with other illnesses, requests for external support, and so on. Given the substantial uncertainty surrounding a novel virus epidemic, the model must allow for consideration of many scenarios. Because the epidemic changes as it progresses and is modified by imposition and withdrawal of mitigation measures, the model must be capable of incorporating new data as they become available and its structure must remain flexible and adaptable.

In this article, we describe the development of a model that meets these requirements. It was created at the request of an English National Health Service (NHS) Foundation Trust (Guy’s and St Thomas’ Trust [GSTT]). As is common for individual hospitals, they faced extreme time constraints that required a model able to produce results within days. The intent was to make the model available to other hospitals nationally and internationally, and thus, it had to be constructed using widely available spreadsheet software and be capable of simulating the trajectories at an adequate level of detail; it needed to be extremely flexible and easily and quickly adaptable because the data and needs were rapidly changing. This article focuses on the design and structuring of the simulation of hospital resource use, from arrival in the emergency department (ED) to discharge or death. A separate article, which deals with the local epidemiologic predictions, is in development. These details, though important to the full implementation of the forecasts, are not covered here because the simulation of hospital trajectories is not bound to any specific way of deriving the epidemiologic estimates and users can incorporate to the model what seems logical for their own context by replacing the existing estimates. To illustrate how the simulation works, a case study was presented using the inputs provided by GSTT in early April 2020.

Methods

Discretely Integrated Condition Event Simulation

The model was designed and implemented using a discretely integrated condition event (DICE) simulation.22 This allowed the model to be entirely specified and run in Microsoft Excel (Microsoft Corporation, Redmond, WA), a widely available and familiar spreadsheet application, with no need for specialized software.24 By the same token, DICE models are easily understood and readily modified.25 Using DICE allowed us to develop the model in less than 1 week and to modify the model on a daily basis as understanding of the pandemic and the hospital’s circumstances changed.

DICE simulation has been described in detail elsewhere—additional information, templates, training materials, and the DICE engine are freely available at https://dice.impact-hta.eu/. DICE is an approach to designing and structuring a simulation by separating the information to be processed from the changes that are forecast to happen. The information is stored in a table of uniquely named Conditions (names italicized here), and the changes are specified in Events (named with no spaces, capitalized, and bolded here). Each change is expressed in text that respects Excel syntax but without the “=” sign. A small macro reads the tables and processes them row by row, successively inserting an “=” sign to activate each expression in turn. Because all elements of the model are tabulated with no programming or hidden parts, a DICE model is very transparent, readily understood, and easily modified by editing the text expressions or adding or deleting rows in the tables. DICE has been used by health technology assessment agencies, including the English National Institute for Health and Care Excellence26 and the French Haute Autorité de Santé,27 and further developed as part of the Impact HTA Horizon 2020 project (https://www.impact-hta.eu/).

Model Design

To address the complexities of the hospital trajectories, the model was specified as an individual simulation,28 where the movements between wards and into and out of hospital were considered as events that happened on particular days (Fig. 1 ). Although the pathways were not particular to patients with COVID-19, the model focused on COVID-19–related admissions and not arrivals to the ED for other indications.

Figure 1.

Figure 1

Schematic of the DICE COVID-19 hospital management model. Events are represented by the boxes and arrows indicate possible pathways.

CC indicates critical care; COVID-19, coronavirus disease 2019; DICE, discretely integrated condition event; L1, Level 1; LOS, length of stay.

For each individual patient, the simulation assigned a calendar day on which that patient presented to the ED based on the distribution of arrival times that was obtained from the fits to local data (for the GSTT case study, the data and fits are provided in Appendix 1 in Supplemental Materials found at https://doi.org/10.1016/j.jval.2021.05.023). This arrival happened at the Start event, and the patient was then admitted either to the ward (at event AdmitL1) or to CC (AdmitCC). While in CC, a patient may have had a tracheostomy (Trach), required renal replacement therapy (RRT), or died (DieCC). Survivors were transferred to the ward (TransferL1) and then may be discharged or died in the ward (Discharge). On DieCC, Discharge, or end of the specified calendar period of predictions, End was triggered. This terminated the replication and reported those results.

Admission to either Level 1 (L1) or CC was determined in Start by applying a probability (stored in condition pEDtoL1) using a random number. Depending on the decision, the corresponding event was triggered. In the same way, it was determined in AdmitL1 whether the patient would be transferred to CC. If transferred, the timing of transfer was assigned based on a draw from a distribution describing the length of stay (LOS) on the ward before transfer. If no transfer would occur, the time until discharge or death was drawn from the corresponding LOS distribution. On admission to CC, the model determined whether the patient would die in CC and if so when. If not, then the day of transfer to L1 was selected from the relevant distribution. A tracheostomy may be performed if the LOS in CC met local standards. The need for RRT was determined based on its frequency (stored in pRRT). On TransferL1, the remaining LOS was assigned from the corresponding distribution. At Discharge, the destination (home, home with care, community care, nursing home) was chosen according to the proportions observed locally. At every event, its calendar time of occurrence was recorded.

All information processed by the model was contained in 47 conditions (Table 1 ), 9 event times, and 8 outputs (Table 2 ). Among the conditions, 4 were dynamic (values could change during simulation) and track what was happening to the patient. These were processed during the execution. Of the remainder, 21 were static (values did not change during simulation) and reflected user inputs that covered the time horizon and start date for the simulation, the parameters of the various equations that controlled model flow, and the probabilities that operated at junctures; 6 pertained to model control and the rest were random numbers that helped individualize the course of each patient.

Table 1.

Conditions in the COVID-19 DICE simulation.

Name Initial level for GSTT Description
Dynamic
 Date StartDate Current date in simulation
 StartDay changing Starting day selected for each patient
 AdmitTo changing Admission location (1 = CC, 2 = L1) for each patient
 DischDest changing Destination for each live discharge
Static
 TimeHorizon 100 User-specified number of days to run simulation
 StartDate March 23, 2020 User-specified calendar date for start of simulation
 pEDtoL1 0.96 Probability of transfer from ED to L
 pL1toCC 0.22 Probability of transfer from L1 to CC
 pDieCC 0.3 Fraction of patients who will die in CC
 pSurvL1 0.85 Fraction of patients who will die in L1
 pRRT 0.3 Fraction of patients in CC who require RRT
 pHome 0.15 Cumulative proportion of discharges home
 pHomewCare 0.575 Cumulative proportion of discharges home with care
 pCommBed 0.9575 Cumulative proportion of discharges to community care bed
 pCareHome 0.9915 Cumulative proportion of discharges to care home
 BetaWillGoCC 1 Beta parameter for Weibull LOS in L1 before transfer to CC
 LambdaWillGoCC 0.69314718 Lambda parameter for Weibull LOS in L1 before transfer to CC
 BetaL1 1.4150375 Beta parameter for Weibull LOS in L1 only
 LambdaL1 0.31889391 Lambda parameter for Weibull LOS in L1 only
 BetaDieCC 1 Beta parameter for Weibull LOS before death in CC
 LambdaDieCC 0.11552453 Lambda parameter for Weibull LOS before death in CC
 BetaLiveCC 1 Beta parameter for Weibull LOS in CC before transfer to L1
 LambdaLiveCC 0.1732868 Lambda parameter for Weibull LOS in CC before transfer to L1
 BetaL1post 0.77760758 Beta parameter for Weibull LOS in L1 after transfer from CC
 LambdaL1post 0.05675878 Lambda parameter for Weibull LOS in L1 after transfer from CC
Model control
 NextEventTime 0 System, stores the time of the next event
 NextEvent 1 System, stores the index number of the next event
 Time 0 System, the current model time, in days
 WillGoCC Changing Flag indicating whether patient will transfer from L1 to CC
 WillDieCC Changing Flag indicating whether patient will die in CC
 DieInL1 Changing Flag indicating whether patient will die in L1

Dynamic conditions may change value during the simulation; static conditions retain their initial value during an iteration, but these may change for scenarios and uncertainty analyses (random number conditions not listed).

CC indicates critical care; COVID-19, coronavirus disease 2019; DICE, discretely integrated condition event; ED, emergency department; GSTT, Guy’s and St Thomas’ Trust; L1, Level 1; LOS, length of stay.

Source: GSTT provided the initial values for their location.

Table 2.

Events in the COVID-19 DICE simulation and outputs recorded.

Name Initial time Description
Start Changing Specific to each patient
DieCC Changing When patient will die, if death occurs in CC
AdmitCC Changing Depends on the start date for each patient and admission destination
AdmitL1 Changing Depends on the start date for each patient and admission destination
TransferL1 Changing Depends on survival in CC
Tracheostomy Changing At least 14 days into CC stay
RRT Changing Depends on risk and LOS in CC
Discharge Changing Selected from LOS distribution
End TimeHorizon Duration of simulation set by analyst
Output Recorded at Description
rAdmitL1 AdmitL1 Date of first admission to ward for each patient
rAdmitCC AdmitCC Date of first admission to CC for each patient
rTransferL1 TransferL1 Date of transfer to ward from CC for each patient
rRRT RRT Date of initiating RRT for each patient
rTrach Trach Date of performing tracheostomy for each patient
rDischarge Discharge Date of discharge or death from L1 for each patient
rDischDest Discharge Location of care upon discharge
RepNum System Replication number if model rerun multiple times

CC indicates critical care; COVID-19, coronavirus disease 2019; DICE, discretely integrated condition event; L1, Level 1; LOS, length of stay; RRT, renal replacement therapy.

The distributions of LOS at various points according to the pathway could be specified using various distributions (exponential, Weibull, log-logistic) based on the observed local data. If a user did not have the data or expertise to fit their own LOS distributions, they needed to only specify the median and interquartile range of their local LOS, and the model would automatically refit the distributions on an empirical basis.

The model recorded the dates of all changes in location of care and reported these for each patient. The output was then processed to accumulate the numbers of patients in each location of care on any given day, and these were compared with the capacity limits for each location as set by the user to determine whether they were exceeded. If exceeded, the date and amount beyond capacity were recorded. This approach was implemented because the hospital team believed that all hospitals have means to expand their capacity and implementing queues was less useful and not realistic. The impact of expanding had repercussions on the ability of a hospital to deliver elective hospital care. Knowing when reserve capacities would be required also allowed the hospital to cancel appointments, cancel surgeries, and otherwise prepare.

Validation

The model was validated as far as possible in accordance with published guidelines.29 Face validity of the model was established by the expert clinicians on the team, who ensured that the modeled pathways corresponded to the clinical reality. Verification of the implementation was performed by an independent modeler following a standard protocol. Predictive validity was more difficult to establish because of a lack of data. Forecasts were provided to the hospital team, and anecdotally, they reported back that these were reasonably accurate, but no detailed data were provided back to the modeling team. Given the continued pandemic pressures, even to this date, the data required for detailed predictive validation have not been made available to us. Nevertheless, it was possible to compare predictions of the timing and duration of peak resource requirements.

Uncertainty

A model such as this one bears 3 types of uncertainty.30 The use of random numbers to select values from distributions and to determine trajectories creates stochastic uncertainty. This can be addressed in DICE by setting the number of replications to be done based on stability analyses. To do so, one or more outputs must be designated as the ones for which stability will be measured. The time until the peak CC demand and the level of the peak were of most interest for this model. The assumptions made in the model implementation create structural uncertainty. In DICE, this is handled by specifying alternative scenarios. For this model, scenarios could be specified covering any of the inputs or combinations. Finally, parameter uncertainty arises from the statistical uncertainty surrounding many of the inputs. The uncertainty table in a DICE model allows the analyst to specify the parameters that bear statistical uncertainty and their distributions. Both deterministic and probabilistic analyses can be run on these parameters. In this model, uncertainty analyses could be specified for the probabilities that control the trajectories and for the LOSs in each ward. Other parameters such as those pertaining to mortality can also be included.

Case Study

This work was undertaken by the team at the London School of Economics and Political Science in collaboration with GSTT to assist with planning resource allocation during the initial pandemic surge of COVID-19. This NHS Foundation Trust has a bed capacity of 1277 beds, including 1090 general and acute beds, 75 maternity beds, and 112 CC ICU beds (see https://www.cqc.org.uk/sites/default/files/new_reports/AAAE1480.pdf) and, annually, deals with approximately 2.6 million patient contacts of varying case mix, 95 000 of whom are treated as inpatients (see https://www.guysandstthomas.nhs.uk/about-us/who-we-are/facts-figures.aspx). The Emergency Department and Urgent Care Centre at GSTT is one of the busiest in the NHS, with 240 000 patient encounters per annum, predominately drawn from South London and of widely varying individual characteristics. GSTT was able to expand bed capacity based on surge principles for a conventional response where a hospital’s CC resources should expand immediately by 20% above baseline, followed by capacity expansion of at least 200% above baseline to meet demands using local, regional, national, and international resources.31

The GSTT team made several specifications on Thursday, March 26, 2020, defining a model to characterize their own setting (Table 3 ). To meet these specifications in the time allowed and with the data provided, the initial design for the model considered the wards as compartments and simulated the transfers among them. This cohort model was functional the following Wednesday, April 1, 2020. Eventually, this early cohort model was found to be insufficient to handle the heterogeneity in management, dependencies of transfer probabilities on LOSs, and more complex pathways. Therefore, it was converted to the individual simulation reported here.

Table 3.

Specifications for the model.

  • Patients present to the ED at a given rate, which may change over time.

  • From ED, patients may go home (with or without care), to L1 care (general ward), to L2 or L3 CC, or may die.

  • No patients remain in ED overnight.

  • From L1 care, patients may go home (with or without care), to CC, or die.

  • From CC, patients may go to L1 care or die (no direct discharges).

  • At each level of care, there are capacity constraints:
    • Capacity in CC increases in 6 phases. Each phase is activated when previous capacity is reached.
    • Activation of next phase capacity occurs overnight.
    • Discharges requiring additional care at home or in a facility also face capacity constraints.
  • Staffing requirements are by level of care and per bed or patient.

  • A particular Trust is defined by:
    • Case influx from its catchment population and possible transfers
    • Its capacities at each level and phase
    • Its clinical practices
    • The occupancies at the start of the simulation

CC indicates critical care; ED, emergency department; L1, Level 1; L2, Level 2; L3, Level 3.

The case load data for the case study were obtained for Lambeth and Southwark, the primary catchment populations for the GSTT hospitals. These are inner London boroughs with a population of 644 864, approximately 43% of them in the black, Asian, and minority ethnic category of racial identification and toward the poorest in the United Kingdom. Lambeth is categorized as the 22nd most deprived and Southwark as the 44th most deprived of 326 local English authorities.

The daily cases presenting to the ED in the Lambeth and Southwark catchment area for GSTT were obtained from Public Health England (tabulated in Appendix 1 in Supplemental Materials found at https://doi.org/10.1016/j.jval.2021.05.023). Given the time constraints, flexible fractional polynomials were fit to the data (statistics in Appendix 1 in Supplemental Materials found at https://doi.org/10.1016/j.jval.2021.05.023), and a quadratic distribution was chosen as the simplest reasonable fit. Much later, a full dynamic transmission compartmental epidemiologic model was developed and fit to the data for many locations worldwide. Those fits (not reported here) can also be implemented in the DICE simulation using a separate module to generate the cases. Indeed, the DICE simulator can accept any user-defined way of generating the cases provided that the user’s equations produce estimates of the daily number of cases expected during the period of interest. The DICE model reported here uses these estimates for its purpose of predicting hospital flows once a patient arrives at hospital.

For the LOS distributions, the GSTT team provided the median and interquartile range for each ward, by pathway (eg, separately for patients going to a ward first then to CC from those going directly to CC). The model estimates the corresponding Weibull parameters. A Weibull distribution was chosen because it allows for the longer tail expected by the hospital and encompasses the simpler exponential distribution as a special case. Indeed, in some cases, the fitted shape parameter was 1, indicating that the distribution reduced to exponential.

Analyses for the GSTT case study involved 80 replications (peak CC demand stabilized after 71 replications), with the average across replications taken as the estimate. For GSTT, the local data showed a steady rise in cases with a peak occurring between March 30, 2020, and April 1, 2020. The peak in the fits to these data coincided with those days with a 7-day moving average in this catchment area of 12.7 new COVID-19 cases per 100 000 people, whereas the quadratic fit predicted a rate of 12.4. Based on the fits to the observed data and GSTT’s LOS distributions and probabilities at particular junctures, the DICE model estimated GSTT’s expected daily bed occupancy in L1 and CC (Fig. 2 A). The model tended to predict higher occupancy than what was eventually observed (eg, for the first 7 days of April, the model predicted average ward daily occupancy of 344.9 than an actual average of 325.1). The timing of peaks was quite close, however. For CC, for example, the model predicted more than 120 beds would be needed between April 9, 2020, and April 17, 2020, than from April 7, 2020, to April 19, 2020 in reality. Bed occupancy was forecast to persist long after the case influx diminished to near 0 because of the longer tails in the LOS projections. The predicted number of deaths varied considerably from day to day, as did live discharges by destination (Fig. 2B), but the curves roughly followed those of bed occupancy.

Figure 2.

Figure 2

Daily bed occupancy and predicted discharges predicted by the model.

CC indicates critical care; ICU, intensive care unit; L1, Level 1.

Discussion

This model simulates the within-hospital course of patients with COVID-19 presenting to a hospital ED. It was created in close collaboration with clinical and operational leaders at the hospital level for GSTT and is functional to support local planning during any further surges. The objective was to aid bed utilization capacity planning under circumstances where it was unclear given original informal projections, whether capacity would be sufficient to meet demand.

The model developed was specified entirely in a small set of Excel tables that characterized complex patient flows in a simple yet accurate manner. It was executed by a standard, freely available DICE macro (downloadable from https://www.impact-hta.eu/), which can be used with any DICE model. DICE eases exposition of local circumstances by using readily accessed software and simplifying the expertise required to undertake the modeling by specifying complex patient flows through tabulated conditions and events. These only require the user to add local data to an input template. Additional complexity of patient flows (eg, to a step-down unit) or of resource use (eg, extracorporeal membrane oxygenation) can be incorporated through further specification of conditions and events where data exist.

The model can be downloaded and adapted by any user to their local hospital by modifying any of the small set of inputs. Local practices can be accommodated by changing the probabilities that control movement between wards, RRT, and tracheostomy. These can be obtained from the locally observed frequencies. Other resource use can be added to each ward, including staff requirements, by incorporating additional rows in the corresponding event tables. If the user has access to an epidemiologic forecasting model for new cases per day, this can be coupled to the hospital resource use module. Alternatively, forecasts can be made by fitting local observed case data.

The model itself has a few limitations. At the time the model was constructed, heterogeneity in hospital trajectories according to patient characteristics was not well understood and is, thus, not incorporated. As the determinants of course and outcome become clearer, they can be included in the model by adding patient profiles with these characteristics (a built-in feature of DICE) and deriving the affected condition values based on these. For example, if age and comorbidities affect the probability of going to CC and the case-fatality rates, then profiles covering the local age range and comorbidity distributions can be specified. These would be used to adjust the CC probability and the lambda parameter of the death equation.

The version of the model reported here does not include interventions such as extracorporeal membrane oxygenation or medications used to treat COVID-19 or its complications. As these emerge and their effects become clearer, they can be added to the care in the appropriate wards. Although it was not the purpose of the model to compare treatments for COVID-19, the simulation can accommodate these comparisons if a user provides information on the effects of a treatment on LOS or the various probabilities. DICE automatically reruns the model for each specified intervention, changing only those conditions that are affected by treatment. Incorporating the costs requires adding the relevant inputs (eg, cost of treatment, per diem costs in ward and CC) and specifying corresponding outputs (eg, treatment cost, hospital cost, total cost), which are accrued at the appropriate events. Estimating quality-adjusted life-years would require adding utilities to the inputs and projecting the course of patients after discharge—including consideration of any long-term consequences of COVID-19 infection and their impact on quality-adjusted life-years.

Although the model includes occupancy of beds by patients with other non-COVID diagnoses, these were not actively modeled (kept static) because the clinical team was unable to specify their trajectories during the pandemic. Given its flexibility, the model can incorporate their dynamic management if this information becomes available.

The application of this model to a specific hospital may be constrained by the availability and quality of data for that hospital. At GSTT, they could access electronic patient records. Even with these tools, however, it was difficult to obtain accurate data on ward occupancy. Across the United Kingdom, electronic recording varies, with many hospitals still using paper records. The predictive distribution of arrival dates for new cases and their cumulative volume were obtained by fitting local data for the catchment population of GSTT. The in-hospital trajectories were simulated based on the experience at GSTT. Ideally, the user has estimates of the median LOS and interquartile range in their ward and CC to model local flows. If lacking local data, a hospital wishing to use the model can run plausible scenarios using the default inputs and calibrate these to the specific information available (eg, death rate, range of LOS).

The COVID-19 pandemic has prompted a profusion of mathematical modeling,14 , 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45 but the vast majority of these models focus on the epidemiology46, 47, 48, 49, 50, 51, 52, 53, 54, 55 and the impact of mitigation measures.11 , 56, 57, 58, 59, 60, 61, 62, 63, 64 A few models have sought to inform hospital resource use planning,9 , 65, 66, 67, 68 but these also largely focus on the impact on the capacity of mitigation scenarios at a regional or national level69, 70, 71—they do not attempt to model the actual patient trajectories. Despite some attempts to localize projections to specific hospitals,72 , 73 many of the inputs were obtained from the early publications addressing the epidemics in China and Italy, and they model patient flow in relatively simple terms. The simulation reported here was based on fully local inputs and models the trajectories in detail. Moreover, it is very flexible and can be modified to accommodate other institutions’ practices and data.

Conclusion

It is possible to simulate the hospital and discharge course of patients with COVID-19 using a DICE simulation defined by conditions and event specified in Excel tables and executed by a simple macro. Additional details of the patient flows and resource use can be incorporated through additional conditions and events if local data and expertise allow. The predictions are useful for resource capacity planning and preparedness. A health authority needs to only rely on a small amount of local data to specify a few inputs to adapt the model to their context and aid their understanding of how their own patient flows will affect their ability to match uncertain demands being placed on their capacity. This modeling will be increasingly valuable as the pandemic progresses and should be considered as new waves emerge to ensure appropriate planning of in-hospital resources to deliver safe, timely, and resilient healthcare services.

Article and Author Information

Author Contributions:Concept and design: Caro, Möller, V. Santhirapala, Gill, Johnston, El-Boghdadly, R. Santhirapala, Kelly, McGuire

Acquisition of data: V. Santhirapala, Gill, Johnston, El-Boghdadly, R. Santhirapala, Kelly

Analysis and interpretation of data: Caro, Möller

Drafting of the manuscript: Caro

Critical revision of the paper for important intellectual content: Caro, Möller, V. Santhirapala, Gill, Johnston, El-Boghdadly, R. Santhirapala, Kelly, McGuire

Statistical analysis: Caro, Möller

Obtainingfunding: McGuire

Supervision: El-Boghdadly, McGuire

Other: Construction of Model: Caro, Möller

Conflict of Interest Disclosures: Dr Caro reported receiving grants from the European Union’s Horizon 2020 research and innovation program under grant agreement no. 779312 during the conduct of the study. Drs Caro and Möller are employed by Evidera. No other disclosures were reported.

Funding/Support: This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement no. 779312. The views expressed in this article are those of the authors and not necessarily those of the European Commission.

Role of the Funder/Sponsor: The funder had no role in the work or the content of this paper, or in the decision to submit the manuscript for publication.

Footnotes

Supplementary data associated with this article can be found in the online version at https://doi.org/10.1016/j.jval.2021.05.023.

Supplemental Material

Appendix 1
mmc1.zip (342.4KB, zip)

References

  • 1.Anderson R.M., Heesterbeek H., Klinkenberg D., Hollingsworth T.D. How will country-based mitigation measures influence the course of the COVID-19 epidemic? Lancet. 2020;395(10228):931–934. doi: 10.1016/S0140-6736(20)30567-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Lauer S.A., Grantz K.H., Bi Q., et al. The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Ann Intern Med. 2020;172(9):577–582. doi: 10.7326/M20-0504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lewnard J.A., Liu V.X., Jackson M.L., et al. Incidence, clinical outcomes, and transmission dynamics of severe coronavirus disease 2019 in California and Washington: prospective cohort study [published correction appears in BMJ. 2020;369:m2205] BMJ. 2020;369 doi: 10.1136/bmj.m1923. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Liu Y., Eggo R.M., Kucharski A.J. Secondary attack rate and superspreading events for SARS-CoV-2. Lancet. 2020;395(10227):e47. doi: 10.1016/S0140-6736(20)30462-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wiersinga W.J., Rhodes A., Cheng A.C., Peacock S.J., Prescott H.C. Pathophysiology, transmission, diagnosis, and treatment of coronavirus disease 2019 (COVID-19): a review. JAMA. 2020;324(8):782–793. doi: 10.1001/jama.2020.12839. [DOI] [PubMed] [Google Scholar]
  • 6.Poletto C., Scarpino S.V., Volz E.M. Applications of predictive modelling early in the COVID-19 epidemic. Lancet Digit Health. 2020;2(10):e498–e499. doi: 10.1016/S2589-7500(20)30196-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Wong J.B. Pandemic surge models in the time of severe acute respiratory syndrome coronavirus 2: wrong or useful? Ann Intern Med. 2020;173(5):396–398. doi: 10.7326/M20-1956. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Bertozzi A.L., Franco E., Mohler G., Short M.B., Sledge D. The challenges of modeling and forecasting the spread of COVID-19. Proc Natl Acad Sci U S A. 2020;117(29):16732–16738. doi: 10.1073/pnas.2006520117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Davies N.G., Kucharski A.J., Eggo R.M., Gimma A., Edmunds W.J. Centre for the Mathematical Modelling of Infectious Diseases COVID-19 working group. Effects of non-pharmaceutical interventions on COVID-19 cases, deaths, and demand for hospital services in the UK: a modeling study. Lancet Public Health. 2020;5(7):e375–e385. doi: 10.1016/S2468-2667(20)30133-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Pencina M.J., Goldstein B.A., D’Agostino R.B. Prediction models - development, evaluation, and clinical application. N Engl J Med. 2020;382(17):1583–1586. doi: 10.1056/NEJMp2000589. [DOI] [PubMed] [Google Scholar]
  • 11.Flaxman S., Mishra S., Gandy A., et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020;584(7820):257–261. doi: 10.1038/s41586-020-2405-7. [DOI] [PubMed] [Google Scholar]
  • 12.Bai S. Simulations of COVID-19 spread by spatial agent-based model and ordinary differential equations. Int J Simul Process Model. 2020;15(3):268–277. [Google Scholar]
  • 13.Currie C.S.M., Fowler J.W., Kotiadis K., et al. How simulation modelling can help reduce the impact of COVID-19. J Simul. 2020;14(2):83–97. [Google Scholar]
  • 14.Clark A., Jit M., Warren-Gash C., et al. Global, regional, and national estimates of the population at increased risk of severe COVID-19 due to underlying health conditions in 2020: a modeling study. Lancet Glob Health. 2020;8(8):e1003–e1017. doi: 10.1016/S2214-109X(20)30264-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jewell N.P., Lewnard J.A., Jewell B.L. Caution warranted: using the Institute for Health Metrics and Evaluation model for predicting the course of the COVID-19 pandemic. Ann Intern Med. 2020;173(3):226–227. doi: 10.7326/M20-1565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Abdollahi E., Haworth-Brockman M., Keynan Y., Langley J.M., Moghadas S.M. Simulating the effect of school closure during COVID-19 outbreaks in Ontario, Canada. BMC Med. 2020;18(1):230. doi: 10.1186/s12916-020-01705-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Badr H.S., Du H., Marshall M., Dong E., Squire M.M., Gardner L.M. Association between mobility patterns and COVID-19 transmission in the USA: a mathematical modelling study. Lancet Infect Dis. 2020;20(11):1247–1254. doi: 10.1016/S1473-3099(20)30553-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Manrique-Abril F.G., Agudelo-Calderon C.A., González-Chordá V.M., et al. SIR model of the COVID-19 pandemic in Colombia. Rev Salud Publica. 2020;22(2):e202. doi: 10.15446/rsap.V22n2.85977. [DOI] [PubMed] [Google Scholar]
  • 19.Roques L., Klein E.K., Papaïx J., Sar A., Soubeyrand S. Impact of lockdown on the epidemic dynamics of COVID-19 in France. Front Med (Lausanne) 2020;7:274. doi: 10.3389/fmed.2020.00274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Tuite A.R., Fisman D.N., Greer A.L. Mathematical modelling of COVID-19 transmission and mitigation strategies in the population of Ontario, Canada. CMAJ. 2020;192(19):E497–E505. doi: 10.1503/cmaj.200476. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Giannakeas V., Bhatia D., Warkentin M.T., Bogoch I.I., Stall N.M. Estimating the maximum capacity of COVID-19 cases manageable per day given a health care system’s constrained resources. Ann Intern Med. 2020;173(5):407–410. doi: 10.7326/M20-1169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Caro J.J. Discretely integrated condition event (DICE) simulation for pharmacoeconomics. Pharmacoeconomics. 2016;34(7):665–672. doi: 10.1007/s40273-016-0394-z. [DOI] [PubMed] [Google Scholar]
  • 23.Augustin M., Schommers P., Suárez I., et al. Rapid response infrastructure for pandemic preparedness in a tertiary care hospital: lessons learned from the COVID-19 outbreak in Cologne, Germany, February to March 2020. Euro Surveill. 2020;25(21) doi: 10.2807/1560-7917.ES.2020.25.21.2000531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Möller J., Davis S., Stevenson M., Caro J.J. Validation of a DICE simulation against a discrete event simulation implemented entirely in code. Pharmacoeconomics. 2017;35(10):1103–1109. doi: 10.1007/s40273-017-0534-0. [DOI] [PubMed] [Google Scholar]
  • 25.Möller J. Cooking up a transparent model following a DICE recipe. Pharmacoeconomics. 2019;37(11):1341–1347. doi: 10.1007/s40273-019-00840-2. [DOI] [PubMed] [Google Scholar]
  • 26.Caro J.J., Maconachie R., Woods M., Naidoo B., McGuire A. Leveraging DICE (discretely integrated condition event) simulation to simplify the design and implementation of hybrid models. Value Health. 2020;23(8):1049–1055. doi: 10.1016/j.jval.2020.03.009. [DOI] [PubMed] [Google Scholar]
  • 27.Ghabri S., Binard A., Pers Y.M., Maunoury F., Caro J.J. Economic evaluation of sequences of biological treatments for patients with moderate-to-severe rheumatoid arthritis and inadequate response or intolerance to methotrexate in France. Value Health. 2020;23(4):461–470. doi: 10.1016/j.jval.2019.12.003. [DOI] [PubMed] [Google Scholar]
  • 28.Caro J.J. Pharmacoeconomic analyses using discrete event simulation. Pharmacoeconomics. 2005;23(4):323–332. doi: 10.2165/00019053-200523040-00003. [DOI] [PubMed] [Google Scholar]
  • 29.Eddy D.M., Hollingworth W., Caro J.J., et al. Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--7. Value Health. 2012;15(6):843–850. doi: 10.1016/j.jval.2012.04.012. [DOI] [PubMed] [Google Scholar]
  • 30.Briggs A.H., Weinstein M.C., Fenwick E.A., et al. Model parameter estimation and uncertainty: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--6. Value Health. 2012;15(6):835–842. doi: 10.1016/j.jval.2012.04.014. [DOI] [PubMed] [Google Scholar]
  • 31.Hick J.L., Einav S., Hanfling D., et al. Surge capacity principles: care of the critically ill and injured during pandemics and disasters: CHEST consensus statement. Chest. 2014;146(4 Suppl):e1S–e16S. doi: 10.1378/chest.14-0733. [DOI] [PubMed] [Google Scholar]
  • 32.Holmdahl I.S.M., Buckee C. Wrong but useful — what covid-19 epidemiologic models can and cannot tell us. N Engl J Med. 2020;383(4):303–305. doi: 10.1056/NEJMp2016822. [DOI] [PubMed] [Google Scholar]
  • 33.Jewell N.P., Lewnard J.A., Jewell B.L. Predictive mathematical models of the COVID-19 pandemic: underlying principles and value of projections. JAMA. 2020;323(19):1893–1894. doi: 10.1001/jama.2020.6585. [DOI] [PubMed] [Google Scholar]
  • 34.Sperrin M., Grant S.W., Peek N. Prediction models for diagnosis and prognosis in Covid-19. BMJ. 2020;369:m1464. doi: 10.1136/bmj.m1464. [DOI] [PubMed] [Google Scholar]
  • 35.Deng Q. Dynamics and development of the COVID-19 epidemic in the United States: a compartmental model enhanced with deep learning techniques. J Med Internet Res. 2020;22(8) doi: 10.2196/21173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Amar P. Pandæsim: an epidemic spreading stochastic simulator. Biology (Basel) 2020;9(9):299. doi: 10.3390/biology9090299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mahmood I., Arabnejad H., Suleimenova D., et al. FACS: a geospatial agent-based simulator for analysing COVID-19 spread and public health measures on local regions. J Simul. 2020 doi: 10.1080/17477778.2020.1800422. [DOI] [Google Scholar]
  • 38.Mangiarotti S., Peyre M., Zhang Y., Huc M., Roger F., Kerr Y. Chaos theory applied to the outbreak of COVID-19: an ancillary approach to decision-making in pandemic context. Epidemiol Infect. 2020;148:e95. doi: 10.1017/S0950268820000990. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Meehan M.T., Rojas D.P., Adekunle A.I., et al. Modelling insights into the COVID-19 pandemic. Paediatr Respir Rev. 2020;35:64–69. doi: 10.1016/j.prrv.2020.06.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Overton C.E., Stage H.B., Ahmad S., et al. Using statistics and mathematical modelling to understand infectious disease outbreaks: COVID-19 as an example. Infect Dis Model. 2020;5:409–441. doi: 10.1016/j.idm.2020.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Pacheco-Barrios K., Cardenas-Rojas A., Giannoni-Luza S., Fregni F. COVID-19 pandemic and Farr’s law: a global comparison and prediction of outbreak acceleration and deceleration rates. PLoS One. 2020;15(9) doi: 10.1371/journal.pone.0239175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Perc M., Gorišek Miksić N., Slavinec M., Stožer A. Forecasting COVID-19. Front Phys. 2020;8:127. [Google Scholar]
  • 43.Soubeyrand S., Ribaud M., Baudrot V., Allard D., Pommeret D., Roques L. COVID-19 mortality dynamics: the future modelled as a (mixture of) past(s) PLoS One. 2020;15(9) doi: 10.1371/journal.pone.0238410. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Vespignani A., Tian H., Dye C., et al. Modelling COVID-19. Nat Rev Phys. 2020;2:279–281. doi: 10.1038/s42254-020-0178-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Wang P., Zheng X., Ai G., Liu D., Zhu B. Time series prediction for the epidemic trends of COVID-19 using the improved LSTM deep learning method: case studies in Russia, Peru and Iran. Chaos Solitons Fractals. 2020;140 doi: 10.1016/j.chaos.2020.110214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hartono P. Similarity maps and pairwise predictions for transmission dynamics of COVID-19 with neural networks. Inform Med Unlocked. 2020;20 doi: 10.1016/j.imu.2020.100386. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hilton J., Keeling M.J. Estimation of country-level basic reproductive ratios for novel coronavirus (SARS-CoV-2/COVID-19) using synthetic contact matrices. PLoS Comput Biol. 2020;16(7) doi: 10.1371/journal.pcbi.1008031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Hoertel N., Blachier M., Blanco C., et al. A stochastic agent-based model of the SARS-CoV-2 epidemic in France [published correction appears in Nat Med. 2020;26(11):1801] Nat Med. 2020;26(9):1417–1421. doi: 10.1038/s41591-020-1001-6. [DOI] [PubMed] [Google Scholar]
  • 49.Jones J.H., Hazel A., Almquist Z. Transmission-dynamics models for the SARS Coronavirus-2. Am J Hum Biol. 2020;32(5) doi: 10.1002/ajhb.23512. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kaxiras E., Neofotistos G. Multiple epidemic wave model of the COVID-19 pandemic: modeling study. J Med Internet Res. 2020;22(7) doi: 10.2196/20912. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Kucharski A.J., Russell T.W., Diamond C., et al. Early dynamics of transmission and control of COVID-19: a mathematical modelling study [published correction appears in Lancet Infect Dis. 2020] Lancet Infect Dis. 2020;20(5):553–558. doi: 10.1016/S1473-3099(20)30144-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Lee C., Li Y., Kim J. The susceptible-unidentified infected-confirmed (SUC) epidemic model for estimating unidentified infected population for COVID-19. Chaos Solitons Fractals. 2020;139 doi: 10.1016/j.chaos.2020.110090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Perkins T.A., Cavany S.M., Moore S.M., Oidtman R.J., Lerch A., Poterek M. Estimating unobserved SARS-CoV-2 infections in the United States. Proc Natl Acad Sci U S A. 2020;117(36):22597–22602. doi: 10.1073/pnas.2005476117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Wang P., Zheng X., Li J., Zhu B. Prediction of epidemic trends in COVID-19 with logistic model and machine learning technics. Chaos Solitons Fractals. 2020;139 doi: 10.1016/j.chaos.2020.110058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Zhao Z.Y., Zhu Y.Z., Xu J.W., et al. A five-compartment model of age-specific transmissibility of SARS-CoV-2. Infect Dis Poverty. 2020;9(1):117. doi: 10.1186/s40249-020-00735-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Chowdhury R., Heng K., Shawon M.S.R., et al. Dynamic interventions to control COVID-19 pandemic: a multivariate prediction modelling study comparing 16 worldwide countries. Eur J Epidemiol. 2020;35(5):389–399. doi: 10.1007/s10654-020-00649-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Dagpunar J.S. Sensitivity of UK Covid-19 deaths to the timing of suppression measures and their relaxation. Infect Dis Model. 2020;5:525–535. doi: 10.1016/j.idm.2020.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Jarvis C.I., Van Zandvoort K., Gimma A., et al. Quantifying the impact of physical distance measures on the transmission of COVID-19 in the UK. BMC Med. 2020;18(1):124. doi: 10.1186/s12916-020-01597-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Kennedy D.M., Zambrano G.J., Wang Y., Neto O.P. Modeling the effects of intervention strategies on COVID-19 transmission dynamics. J Clin Virol. 2020;128 doi: 10.1016/j.jcv.2020.104440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Killeen G.F., Kiware S.S. Why lockdown? Why national unity? Why global solidarity? Simplified arithmetic tools for decision-makers, health professionals, journalists and the general public to explore containment options for the 2019 novel coronavirus. Infect Dis Model. 2020;5:442–458. doi: 10.1016/j.idm.2020.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Kucharski A.J., Klepac P., Conlan A.J.K., et al. Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: a mathematical modelling study. Lancet Infect Dis. 2020;20(10):1151–1160. doi: 10.1016/S1473-3099(20)30457-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Silva P.C.L., Batista P.V.C., Lima H.S., Alves M.A., Guimarães F.G., Silva R.C.P. COVID-ABS: an agent-based model of COVID-19 epidemic to simulate health and economic effects of social distancing interventions. Chaos Solitons Fractals. 2020;139 doi: 10.1016/j.chaos.2020.110088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Struben J. The coronavirus disease (COVID-19) pandemic: simulation-based assessment of outbreak responses and postpeak strategies. Syst Dyn Rev. Published online September 24, 2020. https://doi.org/10.1002/sdr.1660. [DOI] [PMC free article] [PubMed]
  • 64.Stutt R.O.J.H., Retkute R., Bradley M., Gilligan C.A., Colvin J. A modelling framework to assess the likely effectiveness of facemasks in combination with ‘lock-down’ in managing the covid-19 pandemic. Proc Math Phys Eng Sci. 2020;476(2238) doi: 10.1098/rspa.2020.0376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Moghadas S.M., Shoukat A., Fitzpatrick M.C., et al. Projecting hospital utilization during the COVID-19 outbreaks in the United States. Proc Natl Acad Sci U S A. 2020;117(16):9122–9126. doi: 10.1073/pnas.2004064117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Rainisch G., Undurraga E.A., Chowell G. A dynamic modeling tool for estimating healthcare demand from the COVID19 epidemic and evaluating population-wide interventions. Int J Infect Dis. 2020;96:376–383. doi: 10.1016/j.ijid.2020.05.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Shoukat A., Wells C.R., Langley J.M., Singer B.H., Galvani A.P., Moghadas S.M. Projecting demand for critical care beds during COVID-19 outbreaks in Canada. CMAJ. 2020;192(19):E489–E496. doi: 10.1503/cmaj.200457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Wood R.M., McWilliams C.J., Thomas M.J., Bourdeaux C.P., Vasilakis C. COVID-19 scenario modelling for the mitigation of capacity-dependent deaths in intensive care. Health Care Manag Sci. 2020;23(3):315–324. doi: 10.1007/s10729-020-09511-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Tan-Torres Edejer T., Hanssen O., Mirelman A., et al. Projected health-care resource needs for an effective response to COVID-19 in 73 low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020;8(11):e1372–e1379. doi: 10.1016/S2214-109X(20)30383-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Wells C.R., Fitzpatrick M.C., Sah P., et al. Projecting the demand for ventilators at the peak of the COVID-19 outbreak in the USA. Lancet Infect Dis. 2020;20(10):1123–1125. doi: 10.1016/S1473-3099(20)30315-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Booton R.D., MacGregor L., Vass L., et al. Estimating the COVID-19 epidemic trajectory and hospital capacity requirements in South West England: a mathematical modelling framework. BMJ Open. 2021;11(1) doi: 10.1136/bmjopen-2020-041536. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Upadhyay S., Smith D.G. Hospital capacity and capacity planning in Washington. J Health Care Finance. 2020;46(4):53–60. [Google Scholar]
  • 73.Weissman G.E., Crane-Droesch A., Chivers C., et al. Locally informed simulation to predict hospital capacity needs during the COVID-19 pandemic. Ann Intern Med. 2020;173(1):21–28. doi: 10.7326/M20-1260. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Appendix 1
mmc1.zip (342.4KB, zip)

Articles from Value in Health are provided here courtesy of Elsevier

RESOURCES