Introduction
An Exemplar of Scientific Evolution
To assist with proactive and effective responses to the global COVID-19 crisis, the scientific community has been rapidly deploying our most advanced analytic tools to model the dynamics of disease transmission based on existing (albeit imperfect) knowledge, data, and available human and material resources. The multifactorial, multilevel influences on transmission dynamics and the disease's pervasive impact at the individual, community, and global levels have required the use of the analytic techniques of complex systems science, namely, systems modeling and simulation, to forecast the trajectory of the disease under different conditions, to quantify uncertainty, and to inform effective responses (1–3). These methods have been deployed by infectious disease epidemiologists for over a century (4), maturing into a robust interdisciplinary field intersecting mathematics, computational epidemiology, ecology, evolutionary biology, immunology, behavioral science, and public health (5). As a result, there have been numerous advances that have informed policies to control infectious diseases, facilitate epidemic and bioterrorism preparedness, and provide governments with critical tools for managing complexity and weighing alternative responses in the midst of the confusion of an evolving crisis (6–14). The field's commitment to achieving rapid response capability in the face of changing conditions has led to advances in rapid assessment of the impact of the pandemic, and data assimilation methods that combine theory with empirical observations in a continuous knowledge feedback process facilitating continuous hypothesis development, testing, and refinement in the service of more effective decision making (15–19).
What Can the Mental Health Research Community Learn From This Evolution?
The individual and societal effects of COVID-19 and resulting economic recession are particularly threatening to mental health and well-being, disrupting nearly every aspect of life; familial, educational, vocational, health, and social structures. Most countries, and international agencies, have begun to recognize the unprecedented magnitude of the adverse impact COVID-19 will have on population-based mental health outcomes, mental health services, and suicide risk (20, 21). The global health, economic, and social recovery from this crisis is likely to be prolonged and incomplete, with more disadvantaged communities experiencing particularly severe effects. The mental health impacts will not be limited to the period of the pandemic but will extend with the depth and duration of economic recession. Some governments, particularly in high income countries, are already instituting measures to reduce economic and social hardship, and linked psychological distress, by making large investments in employment and welfare funding, continuity of education and training, housing stability, family support, and improved access to virtual mental health services, resources, and other psychological supports through various new technologies. However, it is unclear whether these responses will be sufficient or sustained for a long enough period to ameliorate the expected tsunami of mental health issues in the post-COVID-19 era.
Unlike in infectious diseases research, systems modeling and simulation has not pervaded mental health research, nor does it underpin advice given to governments. Instead, an epistemological entrenchment primes us to identify and address individual risk factors across the behavioral, social, cultural, economic, environmental, and services spectrum, with little formal (or statistical) recognition of the complex interrelationships between them (22–24). This entrenchment has bound us to a path of linear thinking, and delayed actions, that lacks the agility required to be responsive to a rapidly changing world. Traditional statistical techniques are inadequate for studying complex systems, with feedback loops, threshold effects, and other types of non-linearity bedeviling even more sophisticated analytic techniques such as structural equation modeling and latent class analysis (25). Moreover, traditional approaches focus on looking backwards to generate understanding of the factors that have driven past events, rather than using the current best knowledge and a range of evidence and data sources to look forward and to anticipate and strategically act to mitigate future trajectories. Without adoption of a more advanced approach, the mental health needs of populations—even in times of genuine crisis—may be met with well-meaning acts of government that are reactive rather than strategic, formulated “on the run,” and based on the prioritization of initiatives that have been heavily lobbied or represent “seemingly” good evidence-based investments, but can be ineffective, or even counterproductive (26).
The complex systems modeling techniques long used in infectious disease epidemiology focus on pathways; pathways from states of being susceptible to exposed to infected to recovered (or death), upon which risk factors interact to drive rates of flow between the states based on given probabilities. Accordingly, the mental health research community can similarly articulate complex causal pathways to and from psychological distress, mental ill health, suicidal behavior, and associated functional outcomes. These paths can include complex interactions with service pathways, alongside the dynamics of the broader social context (determinants) of mental health. Such systems models can leverage decades of existing research evidence, local data, and expert knowledge, and could be used to undertake continuous experimentation, assumption testing, and rapid hypotheses refinement through integration with continuous streams of data. This would allow mental health researchers to develop more sophisticated tools for rapid deployment to respond to national and regional threats to mental health (and national mental wealth), by being able to work collaboratively with governments and local planners to answer the critical questions of: “what combination of responses are required, at what time, in what sequence, targeted at whom, with what intensity, and for how long?” Embedding systems modeling and simulation in ongoing monitoring and evaluation cycles leverages new data and permits continuous feedback between real-world and modeled mental health service systems to strengthen models over time and secure their role as long-term decision support assets.
Infrastructure to support the collection of sound empirical data will also be important for the development and refinement of models that can accurately forecast longer term mental health and associated educational, vocational, and social outcomes. Alternative assumptions and parameter estimates can produce divergent simulated outcomes. Therefore, reducing the long-term individual and societal costs of the looming mental health epidemic will rely on diverse cross system data to characterize the multi-level influences on mental health and its impacts. The CRISIS initiative is an exemplary effort designed to enable researchers and care providers to examine the extent and impact of life changes induced by the epidemic on the mental health and the behavior of individuals and families across diverse international settings. When combined with geographic, health systems, economic, and other indicators of exposure, such data will enable identification of pre-, peri, and post-COVID-19 demographic, social, and clinical predictors of both short- and long-term impairment and distress induced by the pandemic and its sequelae (http://www.crisissurvey.org/). In addition, new digital technologies now permit the capture of large amounts of clinical, behavioral, social, and cross-sectoral services interaction data from population subgroups most affected to further strengthen the data infrastructure that would be invaluable to efforts to deploy complex systems models to inform mental health policy (27). However, there are important ethical, privacy, and security implications for the capture and use of digital mental health data for research that require consideration and are discussed elsewhere (28).
Discussion
As a mental health research community we must immediately recognize that we have reached a critical juncture. A continued lack of engagement with systems modeling to advance our understanding of the complex interactions between drivers of mental health and suicide, as well as guide mental health policy, system reform, strategic planning, and operational decision-making will confine us to simplistic conclusions, delayed actions, wrong turns, trial and error, waste and inefficiency, and a lack of agility to be effective in our responses to a rapidly changing world. Without these tools to help us see forward, on what basis do governments make decisions about how to effectively respond? What combination of initiatives or reforms should be prioritized? What targeting, timing, scale, frequency, and intensity of investments are needed? What impacts should we expect from these investments? How long do we need keep programs and initiatives in place? Will there be rebound effects when we remove them? Will there be unintended consequences? The analytic methods of complex systems science provide us with the tools to answer these important questions; without them decision makers will continue to metaphorically fumble around in the dark as they try to make important strategic decisions that will impact people's lives in fundamental ways for many years to come. As a scientific community, we have a responsibility to use the best tools available, to provide decision makers with the insights needed to make proactive and effective investment decisions to mitigate the adverse impacts on mental health of COVID-19 and recession.
As the impending economic and social risk factors rapidly escalate, we cannot wait until the full impact of the crisis is upon us before we mobilize the decision analytic tools needed to inform strategic societal and health system investments that are preventive rather than reactive. As there may be some delay between the emergence of risk factors and the wider population impacts, and the actual impacts will depend on the length and severity of the social and economic disruption and the unique demographic, behavioral, workforce, and service structure and dynamics of a region, now is the time to lay the groundwork (regionally, nationally, and internationally) for these efforts.
Applications of systems modeling in mental health research and practice have already demonstrated value in providing improved decision support capability and a better understanding of the different ways even “evidence-based” interventions can play out in diverse systems and settings. For example, a system dynamics model of suicide prevention developed and validated for a rural and remote population catchment of New South Wales, Australia, demonstrated that some evidence-based interventions were likely to deliver little or no population-level impact [e.g., general practitioner (GP) training], and some combinations were projected to result in an unintended increase in suicidal behavior (e.g., GP training plus mental health education programs) (26). This unintended consequence arising from two “evidence-based” interventions applied in combination is explained by the imbalance they generate in the dynamics of service capacity vs. demand for services which is regionally specific. A range of similar models have been applied to inform mental health services planning, suicide prevention, and to answer long debated questions that are not able to be tested through real world experimentation (23, 29–32). Most recently, early prototype systems models have been developed for the Australian context to inform national and regional policy responses to the mental health consequences of the economic and social effects of the pandemic (33–37). Transparent, and interactive model interfaces (Figure 1) allow regional or national decision makers and stakeholders to run simulations and test alternative scenarios and assumptions, driving more informed debate abouts trade-offs and facilitating consensus building for collaborative action. These processes are essential to the mobilization of appropriate levels of financial, infrastructure and workforce resourcing for rapid system responses to be mounted effectively.
The time to determine the best responses, governance structures, and resources required to address the emerging mental health crisis is now. For these responses to have the best chance at being effective they need to be underpinned by systems modeling work that is transparent, accessible, inclusive, and embedded in continuous monitoring and evaluation frameworks. It is essential to draw on both the deep foundations provided by the field of infectious diseases modeling and the emerging mental health exemplars that have seen modelers and public health decision makers work actively together to formulate sound policy responses. A blueprint for the approach that has already been developed, applied, and deemed to be feasible and valuable, provides a basis for further technical and operational improvements. Good practice guidelines are available to ensure appropriate implementation of systems modeling including considerations of model scope and design, parameterisation, validation, interpretation, and ongoing maintenance (38). Investments in mental health systems modeling and supportive data infrastructure are required immediately to support both the evolution of the field and the realization of a sustainable capability for rapid deployment of advanced decision support tools to inform government investments and actions.
Author Contributions
J-AA and IH: manuscript drafting. All authors: manuscript concept and critical revision of manuscript for important intellectual content.
Conflict of Interest
J-AA is both Head of Systems Modelling, Simulation & Data Science at the University of Sydney's Brain and Mind Centre and Managing Director of Computer Simulation & Advanced Research Technologies (CSART). IH reports personal fees from The University of Sydney, Brain and Mind Centre, grants from Australian National Health and Medical Research Council (NHMRC), personal fees from Australian National Mental Health Commission, personal fees from Innowell Pty Ltd, non-financial support from Australian National Mental Health Commission, NMHRS, non-financial support from Australian Department of Health, Million Minds Advisory Panel, non-financial support from Psychosis Australia Trust, from Medibank Clinical Reference Group, outside the submitted work; and The BMC operates early-intervention youth services at Camperdown under contract to headspace: the national youth mental health foundation, which was funded by the Department of Health, Australian Government, and has previously led community-based and pharmaceutical industry-supported (Wyeth, Eli Lily, Servier, Pfizer, AstraZeneca) investigator-initiated research projects or professionally directed education programs focused on the identification and better management of anxiety and depression. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
Funding. The authors would like to acknowledge the National Health and Medical Research Council for funding the YOUTHe Centre of Research Excellence for reducing suicidal thoughts and behaviours in young people presenting for health care (GNT1171910).
References
- 1.Moss R, Wood J, Brown D, Shearer F, Black AJ, Cheng AC, et al. Modelling the Impact of COVID-19 in Australia to Inform Transmission Reducing Measures and Health System Preparedness. Melbourne. (2020). Available online at: https://www.doherty.edu.au/uploads/content_doc/McVernon_Modelling_COVID-19_07Apr1_with_appendix.pdf (accessed 17 April, 2020). [Google Scholar]
- 2.Chang SL, Harding N, Zachreson C, Oliver Cliff M, Prokopenko M. Modelling Transmission and Control of the COVID-19 Pandemic in Australia. Sydney: (2020). Available online at: https://arxiv.org/pdf/2003.10218v2.pdf (accessed 17 April, 2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Adam D. Special report: the simulations driving the world's response to COVID-19. Nature. (2020) 580:316–8. 10.1038/d41586-020-01003-6 [DOI] [PubMed] [Google Scholar]
- 4.Brauer F. Mathematical epidemiology: past, present, and future. Infect Dis Model. (2017) 2:113–27. 10.1016/j.idm.2017.02.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Heesterbeek H, Anderson RM, Andreasen V, Bansal S, De Angelis D, Dye C, et al. Modeling infectious disease dynamics in the complex landscape of global health. Science. (2015) 347:aaa4339. 10.1126/science.aaa4339 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Burke DS, Epstein JM, Cummings DA, Parker JI, Cline KC, Singa RM, et al. Individual-based computational modeling of smallpox epidemic control strategies. Acad Emerg Med. (2006) 13:1142–9. 10.1197/j.aem.2006.07.017 [DOI] [PubMed] [Google Scholar]
- 7.Epstein JM. Toward a Containment Strategy for Smallpox Bioterror: An Individual-Based Computational Approach, Washington, DC: Brookings Institution Press; (2004). [Google Scholar]
- 8.Epstein JM. Modelling to contain pandemics. Nature. (2009) 460:687. 10.1038/460687a [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Eubank S, Guclu H MV, Srinivasan Kumar VS, Marathe A, Toroczkai Z, et al. Modelling disease outbreaks in realistic urban social networks. Nature. (2004) 429:180–4. 10.1038/nature02541 [DOI] [PubMed] [Google Scholar]
- 10.Ferguson NM, Cummings DA, Fraser C, Cajka JC, Cooley PC, Burke DS. Strategies for mitigating an influenza pandemic. Nature. (2006) 442:448–52. 10.1038/nature04795 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lee BY, Brown ST, Korch GW, Cooley PC, Zimmerman RK, Wheaton WD, et al. A computer simulation of vaccine prioritization, allocation, and rationing during the 2009 H1N1 influenza pandemic. Vaccine. (2010) 28:4875–9. 10.1016/j.vaccine.2010.05.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Longini IM, Jr, Nizam A, Xu S, Ungchusak K, Hanshaoworakul W, Cummings DA, et al. Containing pandemic influenza at the source. Science. (2005) 309:1083–7. 10.1126/science.1115717 [DOI] [PubMed] [Google Scholar]
- 13.Longini IM, Jr, Halloran ME, Nizam A, Yang Y, Xu S, Burke DS, et al. Containing a large bioterrorist smallpox attack: a computer simulation approach. Int J Infect Dis. (2007) 11:98–108. 10.1016/j.ijid.2006.03.002 [DOI] [PubMed] [Google Scholar]
- 14.Yang Y, Sugimoto JD, Halloran ME, Basta NE, Chao DL, Matrajt L, et al. The transmissibility and control of pandemic influenza A (H1N1) virus. Science. (2009) 326:729–33. 10.1126/science.1177373 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Lee T, Shin H. Combining syndromic surveillance and ILI data using particle filter for epidemic state estimation. Flexible Services Manufact J. (2016) 28:233–53. 10.1007/s10696-014-9204-0 [DOI] [Google Scholar]
- 16.Ong JB, Chen MI, Cook AR, Lee HC, Lee VJ, Lin RT, et al. Real-time epidemic monitoring and forecasting of H1N1–2009 using influenza-like illness from general practice and family doctor clinics in Singapore. PLoS ONE. (2010) 5:e10036. 10.1371/journal.pone.0010036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Osgood N. Frontiers in Health Modeling. In: El-Sayed, Galea S. editors. Systems Science and Population Health. New York, NY: Oxford University Press; (2017) 191–216. [Google Scholar]
- 18.Osgood N, Liu J. Towards closed loop modeling: evaluating the prospects for creating recurrently regrounded aggregate simulation models. In: Proceedings of the 2014 Winter Simulation Conference. Savannah, GA: (2014). p. 829–41. 10.1109/WSC.2014.7019944 [DOI] [Google Scholar]
- 19.Safarishahrbijari A, Lawrence T, Lomotey R, Liu J, Waldner C, Osgood N. Particle filtering in a SEIRV simulation model of H1N1 influenza. In: Proceedings of the 2015 Winter Simulation Conference Huntington Beach, CA: (2015). p. 12 10.1109/WSC.2015.7408249 [DOI] [Google Scholar]
- 20.Reger MA, Stanley IH, Joiner TE. Suicide mortality and coronavirus disease 2019—a perfect storm? JAMA Psychiatry. (2020) 77:1093–4. 10.1001/jamapsychiatry.2020.1060 [DOI] [PubMed] [Google Scholar]
- 21.Pfefferbaum B, North CS. Mental health and the covid-19 pandemic. N Engl J Med. (2020) 383:510–2. 10.1056/NEJMp2008017 [DOI] [PubMed] [Google Scholar]
- 22.Franklin JC, Ribeiro JD, Fox KR, Bentley KH, Kleiman EM, Huang X, et al. Risk factors for suicidal thoughts and behaviors: a meta-analysis of 50 years of research. Psychol Bull. (2017) 143:187–232. 10.1037/bul0000084 [DOI] [PubMed] [Google Scholar]
- 23.Page A, Atkinson JA, Heffernan M, McDonnell G, Prodan A, Osgood N, et al. Static metrics of impact for a dynamic problem: the need for smarter tools to guide suicide prevention planning and investment. Aust N Z J Psychiatry. (2018) 52:660–7. 10.1177/0004867417752866 [DOI] [PubMed] [Google Scholar]
- 24.Arnold KF, Harrison WJ, Heppenstall AJ, Gilthorpe MS. DAG-informed regression modelling, agent-based modelling and microsimulation modelling: a critical comparison of methods for causal inference. Int J Epidemiol. (2019) 48:243–53. 10.1093/ije/dyy260 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Luke DA, Stamatakis KA. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. (2012) 33:357–76. 10.1146/annurev-publhealth-031210-101222 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Atkinson JA, Skinner A, Hackney S, Mason L, Heffernan M, Currier D, et al. Systems modelling and simulation to inform strategic decision making for suicide prevention in rural New South Wales (Australia). Aust N Z J Psychiatry. (2020) 54:892–901. 10.1177/0004867420932639 [DOI] [PubMed] [Google Scholar]
- 27.Hickie IB. The role of new technologies in monitoring the evolution of psychopathology and providing measurement-based care in young people. World Psychiatry. (2020) 19:38–9. 10.1002/wps.20697 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wykes T, Lipshitz J, Schueller SM. Towards the design of ethical standards related to digital mental health and all its applications. Curr Treat Options Psychiatry. (2019) 6:232–42. 10.1007/s40501-019-00180-0 [DOI] [Google Scholar]
- 29.Atkinson JA, Page A, Heffernan M, McDonnell G, Prodan A, Campos W, et al. The impact of strengthening mental health services to prevent suicidal behaviour. Austr N Z J Psychiatry. (2018) 53:642–50. 10.1177/0004867418817381 [DOI] [PubMed] [Google Scholar]
- 30.Atkinson JA, Page A, Prodan A, McDonnell G, Osgood N. Systems modelling tools to support policy and planning. Lancet. (2018) 391:1158–9. 10.1016/S0140-6736(18)30302-7 [DOI] [PubMed] [Google Scholar]
- 31.Atkinson JA, Page A, Skinner A, Prodan A, Hickie I. The impact of reducing psychiatric beds on suicide rates. Front Psychiatry. (2019) 10:448. 10.3389/fpsyt.2019.00448 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Page A, Atkinson JA, Campos W, Heffernan M, Ferdousi S, Power A, et al. A decision support tool to inform local suicide prevention activity in Greater Western Sydney (Australia). Aust N Z J Psychiatry. (2018) 52:983–93. 10.1177/0004867418767315 [DOI] [PubMed] [Google Scholar]
- 33.Atkinson J, Lawson K, Skinner A, Hickie I. Road to Recovery, Part 2: Investing in Australia's Mental Wealth. Sydney, NSW: Brain and Mind Centre, University of Sydney; (2020). Available online at: https://www.sydney.edu.au/content/dam/corporate/documents/brain-and-mind-centre/road-to-recovery-part-2-economic-short-report.pdf (accessed September 14, 2020). [Google Scholar]
- 34.Atkinson J, Skinner A, Lawson K, Song YC, Hickie I. Road to Recovery: Uncovering the Road to Recovery of Our Mental Health and Well-Being Using Systems Modelling and Simulation. Sydney, NSW: Brain and Mind Centre, University of Sydney; (2020). Available online at: https://www.sydney.edu.au/content/dam/corporate/documents/brain-and-mind-centre/youthe/road-to-recovery-v2.pdf (accessed September 14, 2020). [Google Scholar]
- 35.Atkinson J, Skinner A, Lawson K, Song YC, Hickie I. Road to Recovery: Revision of Estimates Based on Revised RBA Forecasts. Sydney, NSW: Brain and Mind Centre, University of Sydney; (2020). Available online at: https://www.sydney.edu.au/content/dam/corporate/documents/brain-and-mind-centre/revision-of-estimates-based-on-revised-rba-forecasts.pdf (accessed September 14, 2020). [Google Scholar]
- 36.Atkinson J, Skinner A, Lawson K, Song YC, Hickie I. COVID-19 Pandemic Response: Every Life Matters. Sydney, NSW: Brain and Mind Centre, University of Sydney; (2020). Available online at: https://www.sydney.edu.au/content/dam/corporate/documents/brain-and-mind-centre/mental-wealth/every-life-matters_final.pdf (accessed September 14, 2020). [Google Scholar]
- 37.Atkinson J, Skinner A, Lawson K, Song YC, Hickie I. COVID-19 Pandemic Response: Every Life Matters—Supplementary Materials. Sydney, NSW: Brain and Mind Centre, University of Sydney; Available online at: https://www.sydney.edu.au/content/dam/corporate/documents/brain-and-mind-centre/supplementary-material—north-coast-phn-system-dynamics-model-for-suicide-prevention.pdf (accessed September 14, 2020). [Google Scholar]
- 38.Marshall DA, Burgos-Liz L, Crown W, Padula WV, Wong PK, Pasupathy KS, et al. Selecting a dynamic simulation modeling method for health care delivery research-part 2: report of the ISPOR Dynamic Simulation Modeling Emerging Good Practices Task Force. Value Health. (2015) 18:147–60. 10.1016/j.jval.2015.01.006 [DOI] [PubMed] [Google Scholar]