Abstract
From fake news to innovative technologies, many contagions spread as complex contagions via a process of social reinforcement, where multiple exposures are distinct from prolonged exposure to a single source.1 Contrarily, biological agents such as Ebola or measles are typically thought to spread as simple contagions.2 Here, we demonstrate that these different spreading mechanisms can have indistinguishable population-level dynamics once multiple contagions interact. In the social context, our results highlight the challenge of identifying and quantifying spreading mechanisms, such as social reinforcement,3 in a world where an innumerable amount of ideas, memes and behaviors interact. In the biological context, this parallel allows the use of complex contagions to effectively quantify the non-trivial interactions of infectious diseases.
On September 27th 2016, the World Health Organization (WHO) declared that measles had been eliminated from the Americas.4 Less than two years later, an outbreak of the disease in Venezuela sparked an epidemic across South America, which is ongoing and has sickened tens-of-thousands.5–7 Concurrently, the number of measles cases has increased in all but one of the WHO regions,8 over 80,000 cases (with a hospitalisation rate >60%) occurred in the European Union,9 and the United States of America experienced 17 measles outbreaks.5,10 The majority of these cases occurred in unvaccinated individuals.11–13 From collapsing public health infrastructure14 and lack of access to vaccines7 to non-medical exemptions, e.g., religious beliefs,15,16 and the spread of fraudulent science,17–19 the precise reason individuals go unvaccinated are myriad; however, underlying all these mechanisms is the coupled transmission of two contagions, one biological and one—or more—social.
Clearly, contagions never occur in a vacuum, instead pathogens and ideas interact with each other and with externalities such as host connectivity, behaviour, and mobility. Nevertheless, many biological contagions are still considered to be “simple”, where infectious individuals transmit to susceptible individuals independently of anything else occurring around the individuals.2 The term simple contagion is somewhat of a misnomer, since many epidemic models need to be incredibly complicated to account for the rich diversity of biological pathogens and human behaviours; including non-Markovian dynamics,20 heterogeneous contact structure,21 vector-borne diseases22 and evolutionary dynamics.23 Yet, in almost all cases, the probability of a transmission event only depends on the states of the possible infector and infectee. Conversely, in complex contagions, as defined for instance in recent multidisciplinary work,1,24 the spreading mechanism explicitly depends on the context of transmission events, usually via the neighbourhood of the susceptible individuals, such that pairwise information becomes insufficient to model the transmission process.25,26 For example, social reinforcement can lead to a transmission rate effectively proportional to the number of different infectious contacts to which a susceptible individual is exposed.3 This mechanistic difference creates a false dichotomy, forcing us to choose the mechanism we think best describe the reality of a given contagion. In practice, the context of transmission events always matters.
When modeling a contagion, the choice of mechanism is critical because simple and complex contagions tend to induce substantially different dynamics and can lead to incompatible conclusions about intervention strategies or risk. An important difference is that complex contagions do not always feature a monotonous relation between the expected epidemic size and their average transmission rate, unlike simple contagions.27,28 Instead, microscopic variations in transmission rate can lead to macroscopic jumps in expected epidemic size. This effect, that small changes in transmission can lead to large differences in outbreak size, occurs because the population effectively builds up a latent epidemic potential29 where many individuals would infect their susceptible neighbours if only a few of them had one more infectious neighbour. Eventually, often due only to small variations in initial conditions or transmission rate, a macroscopic cascade of infections that releases this latent epidemic potential will occur. The importance of correlations between the states of neighbours also explains why complex contagions can benefit from network clustering (i.e. triangles), again unlike simple contagions.30
Several models have been developed to study interacting contagions, often to investigate how the spread of awareness might slow an infectious disease through a dueling contagion framework.31–34 These models are often limited to two interacting contagions since, as we will see, the required number of parameters and assumptions grows exponentially with the number of considered contagions. Despite their complicated structure, these studies have provided several useful insights. Importantly, it was showed that positively interacting contagions feature discontinuous phase transitions and can benefit from network clustering.35 Consider for example the interaction between influenza and other respiratory pathogens–e.g., Streptococcus pneumoniae, Rhinoviruses, adenovirus, etc.–which can interact in different ways: An individual with a compromised immune system due to one infection might be more susceptible to the other, or an individual with both infections might exhibit heightened symptoms and increased transmission rates.36–39 A population can then build up a latent epidemic potential where many individuals would infect their susceptible neighbours if only a few of them were compromised by a second disease. Therefore, it might not be surprising that interacting contagions can also exhibit macroscopic jumps in expected epidemic size under microscopic variation in the average transmission rates, and that interacting contagions can also benefit from network clustering. Even for single pathogens spreading through a population, if different routes of transmission have drastically different transmission probabilities, e.g., HIV sexual transmission vs. needle sharing40,41 or Zika sexual transmission from men vs. women,42 they will spread more like complex contagions.
Here, we demonstrate that the connection between complex and interacting contagions runs far deeper than shared phenomenology. In Box 1, we present simple models of interacting and complex contagions in well-mixed populations and demonstrate that there exists an exact mapping between the two models, i.e. the simple model with interactions can always be expressed as a complex contagion. Figure 1 summarizes the interesting dynamical features of these models, namely their potential for discontinuous jumps in expected epidemic size as well as regimes of faster than exponential spread. Figure 1 also highlights the mathematical mapping between the two dynamics. Every curve of Fig. 1 can be obtained by solving the differential equations for either interacting or complex contagions. The solutions are identical. Consequently, it follows that in any context where the assumption of a well-mixed population holds, interacting contagion models are indistinguishable from complex contagions–provided we are unaware of potential interactions among pathogens, and are not collecting the corresponding coinfection data. Given that both assumptions, well-mixed populations and data from a single pathogen, are often considered to hold in contained environments such as schools, workplaces, and homogenous social groups,43 our results demonstrate that, unless the process follows strictly simple dynamics, even perfect incidence data for a single contagion in these environments cannot be used to identify the true spreading mechanism.
Box 1: Well-mixed compartmental SIS models.
We use the simple Susceptible-Infectious-Susceptible (SIS) process to highlight the mathematical mapping between complex contagions and interacting simple contagions. In the SIS process, infectious individuals infect susceptible individuals, but also recover back to the susceptible state. A general complex contagion model can be followed using an ordinary differential equation (ODE) for the density I(t) of infectious individuals at time t. Omitting the obvious temporal dependency, we write
(1) |
where γ is the recovery rate and where β (I) describes the transmission rate per contact given that there is a density I(t) of infectious individuals in the population. For example, an increasing β (I) can describe a social reinforcement mechanism.
We can write similar equations for two interacting simple contagions by tracking the density [SS] of individuals which are susceptible to both contagions, the densities [IS] and [SI] that are infected by the first or second contagion only, and the density [II] that are coinfected. We are mostly interested in the density of nodes Ĩ = [IS] + [II] which are infected by the first contagion. We therefore follow
(2) |
(3) |
Comparing the sum of Eqs. (2) and (3) with Eq. (1) shows that the two models are equivalent under the mapping
(4) |
which is a valid mapping from interacting contagions to a complex contagion, for every monotonous form of [IS]+[II] (the vast majority of possible SIS curves). A similar mapping can be obtained for Susceptible-Infectious-Recovered dynamics using the monotonicity of the recovered curve assuming recovered individuals are now immune.
The situation is different in heterogeneous environment, where contagions follow some underlying contact network. In this context, a contagion process is not fully described by simply following the number of infections in time, and the identity and contacts of infected individuals matters for the dynamics. One recent study leveraged this idea to study memes by quantifying their spread within and across communities.25 Their approach is based on the fact that for complex contagions, unlike simple contagions, “the spread within highly clustered communities is enhanced, while diffusion across communities is hampered.” They identify a number of statistics that can help distinguish simple and complex contagions, e.g., the number of early adopters of memes (number of contagious nodes at early times) and the state of their neighbours. The logic is that if contagions benefit from network clustering, states of neighbours should be more correlated than expected from the network structure alone.
Unfortunately, interacting contagions also benefit from network clustering in similar ways,35 which can lead us to confuse the two. Using simulations on a known contact networks, we find that looking for state correlations between neighbours can indeed distinguish interacting and complex contagions from simple contagions as previously claimed.25 However, we also find that this method cannot distinguish complex and interacting contagions from one another.
In our experiments we simulate simple, interacting, and complex contagions on both regular random contact networks with 20 random contacts for every node and equivalent but clustered networks where nodes now belong to cliques of size 12 (11 contacts per node within cliques) and have 9 additional random contacts; see Fig. 2. We use these regular networks to avoid confounding the effect of clustering with that of assortativity35 and to reduce noise in the observed statistics. We increase the transmission rates of both contagions by a factor of 7 when they appear on the same contact—this interaction parameter might appear high but is actually far from, for example, the interaction factor between influenza and pneumococcal pneumonia which can be up to 100-fold.44 The results of these simulations are straightforward (Fig. 2): When parametrized correctly such that all 3 contagion models can reach the same level of prevalence after some desired time period, we find that interacting and complex contagions can be easily distinguished from simple contagions, but not from one another. This shows that not only do non-simple contagions benefit from clustering in network structure, but that network structure also leads to similar increases in statistical correlations between cases.
Altogether, the results from Box 1, Fig. 1, and Fig. 2 show that complex contagions and interacting simple contagions possess the same dynamical and statistical features, even if the mechanisms behind both models are completely different. Since we know real-world pathogens can interact with unknown numbers of other pathogens–or different strains/serotypes of the same pathogen–the logical conclusion is that we ought to model real contagions as complex contagions. Critically, these contagions need not all be biological and pathogens can interact with, for example, the spread of a behaviour. Additionally, simple contagions dynamics are a subset of the complex contagion model, meaning that if the pathogen does not interact with other contagions, the model can recapitulate its dynamics. More importantly, by using the complex contagion model, we avoid the need to procure exponentially more data and estimate exponentially more model parameters as the number of interacting contagions increases; instead we can use a general parametrization to find a complex transmission function β(I) governing the effective infection rate for every pathogen of interest.
We thus develop a framework to infer a function β(I) that reproduces some contagion time series from a complex contagion Markov model of Susceptible-Infectious-Recovered dynamics.2 Essentially, this is the same well-mixed model as shown in Box 1 but where individuals who recover are now immune to the contagion instead of returning to the susceptible state. Because most real contagion data tend to be non-monotonous, i.e., they have a growth period, a peak, and a period of decay, the SIR model is likely more appropriate for empirical data. In this framework, we inverse the differential equations to infer a β(I) function from data by assuming some Gaussian noise around the deterministic I(t) equation and using a parametrization of β(I) in terms of Bernstein polynomials (a detailed description is given in the Supplementary Information).
Our procedure focuses on β(I) instead of an instantaneous transmission rate β(t) as used previously45 for two reasons. First, using a β(I) instead of an instantaneous β(t) avoids overfitting to noise in the instantaneous growth rate of a time series I(t), since we combine the information contained in both the rise and fall of a contagion. Second, using β(I) maps real data to well-studied Markovian (i.e. memory-less) complex contagions and therefore also provides an easy way to compare contagions independently of time and initial conditions. Lastly, we provide formulation of the inference procedure for both prevalence (current infectious cases) and incidence data (new cases per unit time) in the Supplementary Information.
We illustrate the value of this inference procedure on simulations of both interacting and non-interacting simple contagions in Fig. 3. We selected parameter values to produce two very similar time series to test our framework on a hard instance of the contagion inference problem. While the only noise in the data is that of the regular stochasticity of epidemic simulations, we used a relative low sampling rate and used a single realization of both interacting and non-interacting contagion process. Even in this context we find that the strength of the interaction is reflected in how much the inferred β(I) function deviates from a simple constant transmission rate, as measured by the ratio of the maximal to minimal values in the inferred β(I) function. One advantage of using the inferred β(I) functions is that it highlights features of a contagion not readily visible in its time series alone, such as the velocity of the contagion, which is not restricted to exponential spread unlike classic models. Our results therefore showcase how a robust framework of complex contagion can be used to quantify interactions or simply distinguish and classify contagions.
To illustrate the potential our framework for real-world contagions, we can infer the presence of complex contagion dynamics in a wide range of contagion data. In doing so, we identified a few interesting cases that go against the conventional wisdom that biological pathogens spread as simple contagions while social pathogens spread as complex contagions through social reinforcement. First, we focus on social pathogens, namely memes and news, to find cases where loss of novelty of the pathogen, or depletion of susceptibles, decreases its transmission rate (i.e. dβ/dI < 0 ∀ I) contrarily to most other social contagions. We show one such case in Fig. 4(a), using the incidence of news and social media posts related to Walter Cronkite’s death in 2009. Nevertheless, recent work on collective attention dynamics on social media finds evidence that meme spreading is–as expected–often characterized by accelerating rates of spreading.46 Our results provide a general explanation for why such dynamics are expected to occur often in social contagions, but can still account for “contagions” where novelty causes a decrease in transmission rate, e.g., the previous example of Walter Cronkite’s death.
Second, we pick a biological contagion with known interactions: dengue virus. Indeed, there are well documented interactions across dengue strains based on antibody-dependent enhancement.47,48 In this interaction mechanism, antibodies from a primary dengue infection bind to dengue virus particles of a different serotype, which does not neutralize virus particles and in fact helps them infect cells. To illustrate the utility of our inference methodology, we focus on the 2005 dengue outbreak in Puerto Rico–as it features a combination of two dengue strains (DENV 2 and 3)–and, as expected from our previous simulations, we find a significant increase in transmission rate from the onset of the outbreak to about half of its peak value. Surprisingly, the inferred transmission function is non-monotonous and then declines around peak incidence; potentially due to the depletion of more susceptible individuals (see Supplementary Information).
Future work should focus on leveraging our effective, complex contagion model to more broadly uncover known and unknown interactions across infectious diseases and social contagions. For example, with data on co-infections by dengue serotype, we could test the model’s ability to distinguish between multi- and single-strain dengue virus outbreaks using only aggregate data. After demonstrating the utility of our model to distinguish dengue outbreaks, one could attempt to quantify unknown biological interactions between various infectious diseases. In doing so one must take care to correctly assess the impact of varied network structures45 and different model mechanisms including: spontaneous infections,49 disease vectors,22 or multiple exposures.50 In addition, our complex contagion model–paired with high-resolution epidemiological data–can be used to search for the presence of complex, biological contagions, i.e., single pathogen systems where the probability of infection is a non-linear function of the number of exposures.
In summary, interacting simple contagions are mathematically equivalent to complex contagions if we assume well-mixed populations. And, even if we know the underlying contact network, previously proposed statistics–such as the number of infectious neighbours upon infection or recovery–mostly help to distinguish complex contagions or interacting contagions from simple contagions, but not necessarily from one another. That we are unable to distinguish interacting contagions from complex contagions on networks using these statistics suggests that their physical equivalence can be proven even the absence of mass action mixing. Unfortunately, this non-identifiability also implies that phenomenology and model fitting cannot identify nor quantify spreading mechanisms if we are not fully aware of all possible interactions and coinfections. One consequence being that measurements of complex spreading mechanisms, such as social reinforcement, might be practically impossible unless one can explicitly control for unknown interactions. Otherwise, observations of the spread of an individual meme or biological contagion in a real social system will always be confounded by the innumerable number of ideas, pathogens and behaviours that might be interacting with each-other and with the contagion. Even worse, in practice we rarely have a perfect knowledge of the underlying contact network, such that the variations in transmission rate due to interactions are also combined with variations due to the unknown contact structure.
We therefore suggest embracing complex contagions as scientifically meaningful, even in context where one believes the underlying mechanisms are not complex (i.e. the complex contagion model can be falsified with experiments). In fact, we claim that, even when social reinforcement and/or non-linear infection rates has little mechanistic support, complex contagions remain a general, effective framework for contagions of all nature.
Supplementary Material
Acknowledgements
L.H.-D. acknowledges support from the National Science Foundations Grant No. NSF grant DMS-1829826 and the National Institutes of Health 1P20 GM125498-01 Centers of Biomedical Research Excellence Award. S.V.S. acknowledges support from startup funds provided by Northeastern University. J.-G.Y. is supported by a James S. McDonnell Postdoctoral Fellowship. The authors also thank Antoine Allard, Benjamin M. Althouse, Mark Newman, George Cantwell, and Alec Kirkley for insightful discussions as well as John Burkardt for sharing his Bernstein polynomial implementation.
Footnotes
Data availability
The data represented in Figs. 1–4 are available as Source Data. Raw data and processing scripts are available online.54,55
Code availability
The inference software is available online.54
Competing financial interests
The authors declare no competing financial interests.
Publisher's Disclaimer: This Author Accepted Manuscript is a PDF file of an unedited peer-reviewed manuscript that has been accepted for publication but has not been copyedited or corrected. The official version of record that is published in the journal is kept up to date and so may therefore differ from this version.
References
- 1.Lehmann S and Ahn Y-Y, Complex spreading phenomena in social systems (Springer, 2018). [Google Scholar]
- 2.Anderson RM and May RM, Infectious diseases of humans: dynamics and control (Oxford university press, 1992). [Google Scholar]
- 3.Centola D, Science 329, 1194 (2010). [DOI] [PubMed] [Google Scholar]
- 4.Plan of action for maintaining measles, rubella, and congenital rubella syndrome elimination in the region of the americas: final report. 55th directing council, 68th session of the regional committee of who for the americas, washington, d.c., 2016 sept. 26–30 (document cd55/inf/10, rev. 1), http://www.paho.org/hq/index.php?option=com_docman&task=doc_download&gid=35681&Itemid=270&lang=en, accessed: 2019-02-18.
- 5.Dabbagh A, Laws RL, Steulet C, Dumolard L, Mulders MN, Kretsinger K, Alexander JP, Rota PA, and Goodson JL, Morbidityand Mortality Weekly Report 67, 1323 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Fraser B, The Lancet 392, 373 (2018). [DOI] [PubMed] [Google Scholar]
- 7.Elidio GA, de França GVA, Pacheco FC, Ferreira MM, dos Santos Pinheiro J, Campos EN, de Albuquerque BC, Pinto RC, da Silva ADCS, Leite P. L. e, et al. , Eurosurveillance 24 (2019). [Google Scholar]
- 8.Friedrich M, Journal of the American Medical Association 321, 238 (2019). [Google Scholar]
- 9.Thornton J, BMJ 364 (2019), ISSN 0959–8138, https://www.bmj.com/content/364/bmj.l634.full.pdf, URL https://www.bmj.com/content/364/bmj.l634. [Google Scholar]
- 10.Us cdc: Measles cases and outbreaks, https://www.cdc.gov/measles/cases-outbreaks.html, accessed: 2019-02-18.
- 11.Majumder MS, Cohn EL, Mekaru SR, Huston JE, and Brownstein JS, JAMA Pediatrics 169, 494 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Phadke VK, Bednarczyk RA, Salmon DA, and Omer SB, JAMA 315, 1149 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Melegaro A, The Lancet Global Health 7, e282 (2019). [DOI] [PubMed] [Google Scholar]
- 14.Paniz-Mondolfi A, Tami A, Grillet M, Márquez M, Hernández-Villena J, Escalona-Rodríguez M, Blohm G, Mejías I, Urbina-Medina H, Rísquez A, et al. , Emerging Infectious Diseases 25 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Salmon DA, Haber M, Gangarosa EJ, Phillips L, Smith NJ, and Chen RT, JAMA 282, 47 (1999). [DOI] [PubMed] [Google Scholar]
- 16.Papachrisanthou MM and Davis RL, The Journal for Nurse Practitioners (2019). [Google Scholar]
- 17.McHale P, Keenan A, and Ghebrehewet S, Epidemiology & Infection 144, 870 (2016). [DOI] [PubMed] [Google Scholar]
- 18.Sansonetti PJ, Measles 2018: a tale of two anniversaries (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Mavragani A and Ochoa G, Big Data and Cognitive Computing 2, 2 (2018). [Google Scholar]
- 20.Van Mieghem P and Van de Bovenkamp R, Physical Review Letters 110, 108701 (2013). [DOI] [PubMed] [Google Scholar]
- 21.Pastor-Satorras R, Castellano C, Van Mieghem P, and Vespignani A, Reviews of Modern Physics 87, 925 (2015). [Google Scholar]
- 22.Ross R, The prevention of malaria (Dutton, 1910). [Google Scholar]
- 23.Lipsitch M, Cohen T, Murray M, and Levin BR, PLoS Medicine 4, e15 (2007). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Centola D and Macy M, American Journal of Sociology 113, 702 (2007). [Google Scholar]
- 25.Weng L, Menczer F, and Ahn Y-Y, Scientific Reports 3, 2522 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Mønsted B, Sapieżyński P, Ferrara E, and Lehmann S, PloS ONE 12, e0184148 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Liu W.-m., Levin SA, and Iwasa Y, Journal of Mathematical Biology 23, 187 (1986). [DOI] [PubMed] [Google Scholar]
- 28.Dodds PS and Watts DJ, Physical Review Letters 92, 218701 (2004). [DOI] [PubMed] [Google Scholar]
- 29.Hébert-Dufresne L, Patterson-Lomba O, Goerg GM, and Althouse BM, Physical Review Letters 110, 108103 (2013). [DOI] [PubMed] [Google Scholar]
- 30.O’Sullivan DJ, O’Keeffe GJ, Fennell PG, and Gleeson JP, Frontiers in Physics 3, 71 (2015). [Google Scholar]
- 31.Funk S and Jansen VA, Physical Review E 81, 036118 (2010). [DOI] [PubMed] [Google Scholar]
- 32.Marceau V, Noël P-A, Hébert-Dufresne L, Allard A, and Dubé LJ, Physical Review E 84, 026105 (2011). [Google Scholar]
- 33.Bauch CT and Galvani AP, Science 342, 47 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Fu F, Christakis NA, and Fowler JH, Scientific Reports 7, 43634 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Hébert-Dufresne L and Althouse BM, Proceedings of the National Academy of Sciences 112, 10551 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Morens DM, Taubenberger JK, and Fauci AS, The Journal of Infectious Diseases 198, 962 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Althouse B, Hammitt LL, Grant L, Wagner B, Reid R, Larzelere-Hinton F, Weatherholtz R, Klugman K, Rodgers G, O’BRIEN KL, et al. , Epidemiology & Infection 145, 2750 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Nickbakhsh S, Mair C, Matthews L, Reeve R, Johnson PC, Thorburn F, von Wissmann B, Reynolds A, McMenamin J, Gunson RN, et al. , Proceedings of the National Academy of Sciences (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mair C, Nickbakhsh S, Reeve R, McMenamin J, Reynolds A, Gunson RN, Murcia PR, and Matthews L, PLoS Computational Biology 15 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Strathdee SA and Stockman JK, Current HIV/AIDS Reports 7, 99 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Volz E, Frost SD, Rothenberg R, and Meyers LA, Epidemics 2, 155 (2010). [DOI] [PubMed] [Google Scholar]
- 42.Allard A, Althouse BM, Scarpino SV, and Hébert-Dufresne L, Proceedings of the National Academy of Sciences 114, 8969 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Wearing HJ, Rohani P, and Keeling MJ, PLoS Medicine 2, e174 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Shrestha S, Foxman B, Weinberger DM, Steiner C, Viboud C, and Rohani P, Science Translational Medicine 5, 191ra84 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Liu Q-H, Ajelli M, Aleta A, Merler S, Moreno Y, and Vespignani A, Proceedings of the National Academy of Sciences 115, 12680 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Lorenz-Spreen P, Mønsted BM, Hövel P, and Lehmann S, Nature Communications 10, 1759 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Halstead S and O’Rourke E, Nature 265, 739 (1977). [DOI] [PubMed] [Google Scholar]
- 48.Halstead SB, Adv virus res 60, 421 (2003). [DOI] [PubMed] [Google Scholar]
- 49.Hill AL, Rand DG, Nowak MA, and Christakis NA, Proceedings of the Royal Society B: Biological Sciences 277, 3827 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Janssen H-K, Muller M, and Stenull O, Physical Review E 70, 026114 (2004). [DOI] [PubMed] [Google Scholar]
- 51.Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, Brubaker M, Guo J, Li P, and Riddell A, Journal ofStatistical Software 76 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Yang J and Leskovec J, in Proceedings of the fourth ACM international conference on Web search and data mining (ACM, 2011), pp. 177–186. [Google Scholar]
- 53.Dengue forecasting project, https://predict.phiresearchlab.org/post/5a4fcc3e2c1b1669c22aa261, accessed: 2019-03-10.
- 54.Young J-G, URL https://github.com/jg-you/complex-coinfection-inference/.
- 55.Scarpino SV, URL https://github.com/Emergent-Epidemics/Puerto_Rico_Arbovirus_Data.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.