Abstract
The burden of sexually transmitted infections (STIs) poses a challenge due to its large negative impact on sexual and reproductive health worldwide. Besides simple prevention measures and available treatment efforts, prophylactic vaccination is a powerful tool for controlling some viral STIs and their associated diseases. Here, we investigate how prophylactic vaccines are best distributed to prevent and control STIs. We consider sex-specific differences in susceptibility to infection, as well as disease severity outcomes. Different vaccination strategies are compared assuming distinct budget constraints that mimic a scarce vaccine stockpile. Vaccination strategies are obtained as solutions to an optimal control problem subject to a two-sex Kermack–McKendrick-type model, where the control variables are the daily vaccination rates for females and males. One important aspect of our approach relies on conceptualizing a limited but specific vaccine stockpile via an isoperimetric constraint. We solve the optimal control problem via Pontryagin’s Maximum Principle and obtain a numerical approximation for the solution using a modified version of the forward–backward sweep method that handles the isoperimetric budget constraint in our formulation. The results suggest that for a limited vaccine supply (– vaccination coverage), one-sex vaccination, prioritizing females, appears to be more beneficial than the inclusion of both sexes into the vaccination program. Whereas, if the vaccine supply is relatively large (enough to reach at least coverage), vaccinating both sexes, with a slightly higher rate for females, is optimal and provides an effective and faster approach to reducing the prevalence of the infection.
Keywords: Epidemic modeling, Optimal control, Vaccine allocation, Sexually transmitted infections
Introduction
According to global estimates of the World Health Organization (2021), the burden of sexually transmitted infections (STIs) remains high, counting over 350 million new infections annually with one of the four most common STIs—chlamydia, gonorrhea, syphilis, and trichomoniasis. Although the majority of these infections can be cured, when not treated, STIs might lead to serious health consequences. In 2020, the human papillomavirus (HPV) caused over 600,000 new cases of cervical cancer and 342,000 deaths (Sung et al. 2021). Mother-to-child transmission of syphilis, or congenital syphilis, leads to over 350,000 adverse birth outcomes such as early fetal and neonatal deaths, stillbirths, and preterm or low-birth-weight babies (Korenromp et al. 2019). Negative effects associated with untreated gonorrhea and chlamydia infections include reproductive tract morbidities, such as tubal factor infertility and pelvic inflammatory diseases among women (Tsevat et al. 2017). Gonorrhea, syphilis, or genital herpes simplex virus infection (HSV) are associated with an increased risk of acquiring or transmitting HIV (Unemo et al. 2017). Moreover, a recent observational trend study showed that the absolute incidence of STI cases increased in the last 30 years, especially in sub-Saharan Africa and Latin America (Zheng et al. 2022). In view of this, more attention should be given to the prevention and control of STIs, particularly in low- and middle-income countries, evaluating the benefits of implementing different public health control strategies.
The spread of STIs can be significantly reduced by a number of non-pharmaceutical interventions including sex abstinence, reduction in the number of sex partners, mutually monogamous relationships, and correct and consistent use of latex condoms (Workowski and Bolan 2015). Effective treatment is available for bacterial and parasitic STIs. For example, gonorrhea, syphilis, chlamydia, and trichomoniasis can be treated with antibiotics, often in a single dose (World Health Organization 2021; Workowski and Bolan 2015). Viral STIs including HIV, genital HSV, viral hepatitis B, and HPV have limited treatment options, but disease symptoms can be weakened or controlled with systematic treatment (World Health Organization 2021; Workowski and Bolan 2015). Antiviral drugs typically reduce the viral load limiting clinical symptoms, though virus eradication is difficult (World Health Organization 2021; Workowski and Bolan 2015). The spread of STIs can also be limited via vaccination, which is the main tool for the primary prevention of disease, and one of the most cost-effective public health measures. Therefore, the development of vaccines against STIs is essential to reduce the vast number of infections globally, and their adverse health outcomes (Gottlieb et al. 2016). Currently, there are vaccines for viral STIs that have been proven to be safe and effective, including vaccines against HPV and hepatitis B virus (Gottlieb et al. 2016). Major efforts continue in the development of vaccines against other STIs e.g. herpes and HIV, with several vaccine candidates in early clinical development (World Health Organization 2021). Nevertheless, as the COVID-19 pandemic has shown, even after successful vaccine development, vaccines usually come on a limited budget and the available stockpile is rarely enough to guarantee the immunization of the entire population (Yamey et al. 2022). Generally, in addition to non-pharmaceutical interventions, public health authorities rely on a fixed amount of vaccines to control an outbreak, and therefore, optimizing the allocation of scarce vaccines becomes an important problem.
For an effective vaccination program, it is extremely important to identify subgroups within the general population that should be prioritized to be vaccinated (Hansen and Day 2011). In the context of STIs, the key allocation problem is to investigate how to effectively distribute a limited vaccine stockpile among individuals, females and males, to minimize the prevalence of the infection in a population (Bogaards et al. 2015; Heffernan et al. 2014; Saldaña et al. 2019). Strategic mathematical modeling has already been directed to study resource allocation problems using different approaches such as mixed-integer linear programming models (Saif and Elhedhli 2016; Tavana et al. 2021), feedback control (Camacho et al. 2019), analytical insights from compartmental models (Bogaards et al. 2011; Duijzer et al. 2018; Heffernan et al. 2014; Gao et al. 2021; Vo et al. 2021), and optimal control (Estadilla et al. 2021; Malik et al. 2016; Saldaña et al. 2019). Here, we focus on optimizing time-dependent control interventions in an epidemiological model, using the optimal control theory (OCT) as a methodology for designing effective vaccination strategies. The OCT has been proven to be a powerful tool in the development and evaluation of intervention strategies to cope with the burden of infectious diseases (Bussell et al. 2019). Several studies have used Kermack–McKendrick-type models coupled with the optimal control theory to devise vaccine prioritization for specific diseases such as influenza (Matrajt et al. 2013; Shim 2013), dengue (Maier et al. 2017; Rodrigues et al. 2014), and COVID-19 (Estadilla et al. 2021; Libotte et al. 2020; Saldaña and Velasco-Hernández 2021). Nevertheless, to the best of the authors’ knowledge, the number of studies investigating vaccine allocation via optimal control theory for STIs is relatively low. For example, Brown and White (2011) used an optimal control model to investigate targeted immunization programs for HPV in the United Kingdom. They found that the inclusion of both males and females into vaccination programs would be cost-effective and that vaccinating older individuals is also relevant for controlling the infection. Malik et al. (2016), explored the optimal vaccination rates of the bivalent, quadrivalent and nonavalent HPV vaccines if all three vaccines are in use but only in the female population. Their main conclusion was that immunization programs can optimally administer the three vaccines simultaneously by administering the quadrivalent and nonavalent vaccines at the maximum rates and the bivalent vaccine at moderate rates. Camacho et al. (2019) used a compartmental pair model coupled with optimal and feedback control to explore different public health strategies for the control of trichomoniasis, gonorrhea, chlamydia, and HPV. Saldaña et al. (2019) used optimal control theory to investigate the best combination of vaccination and screening to reduce the spread of HPV infection, as well as the cost of the intervention strategy. The results in these previous studies are deduced by employing commonly used -type objective functionals. The approach presented in this study differs from previous methodologies in the sense that we consider a limited but specific vaccine supply via an isoperimetric constraint.
In this work, we contribute to the vaccine allocation literature investigating how prophylactic vaccines are best distributed in a population. Assuming sex-specific differences in susceptibility and disease outcomes, the main focus of our study is to investigate under which conditions the inclusion of both sexes into vaccination programs adds to the population-level impact of one-sex-only interventions. Theoretically, high vaccination coverage for one sex might be enough to reach herd immunity and eradicate an STI in a heterosexual population (Bogaards et al. 2011). Yet, some complications can arise depending on many factors such as (i) the male-to-female sexual infectivity rate is generally higher than that of female-to-male (Low et al. 2006; Wong et al. 2004) (ii) the health risks associated with the infection are considerably higher for females e.g. pelvic inflammatory disease, chronic pelvic pain, ectopic pregnancy, infertility, and cervical cancers (Low et al. 2006; Wong et al. 2004). Further, in some cases, there can be a group who is reluctant towards the vaccination; thus, a high vaccination coverage can be difficult to achieve even when targeting one sex-specific group (Saldaña et al. 2019). Our approach to addressing these issues relies on an optimal control problem, where the cumulative level of infected individuals is minimized under a limited vaccine stockpile and subject to a two-sex epidemic model.
The rest of this paper is organized as follows. In Sect. 2, we propose a two-sex Kermack–McKendrick-type model to describe the spread of an STI in a heterosexual population. The model considers prophylactic vaccine strategies that might include both genders. The analysis of equilibria together with the basic and control reproduction numbers are also investigated in Sect. 2. In Sect. 3, we formulate an optimal control problem (OCP) to seek optimal sex-specific vaccination programs aiming to minimize the total number of infections in the population. In Sect. 4, we provide a numerical approximation to the solution of OCP for several realistic vaccine scenarios with budget constraints that mimic a scarce vaccine stockpile insufficient to immunize the total population. We conclude by discussing the implications of our findings for gender-specific vaccination programs against STIs.
Methods
Model formulation
The model stratifies the total population at time t, denoted N(t) according to gender, so , where and represent the number of sexually active females and males, respectively. Both populations () are subdivided into mutually exclusive compartments according to infection status as unvaccinated susceptible (), vaccinated susceptible (), and infectious individuals (). Hence, , (). The transmission dynamics of a sexually transmitted infection in a heterosexual population are described by the following system of differential equations:
1 |
where all the parameters and initial conditions are non-negative.
We assume individuals are recruited into the sexually active population as unvaccinated susceptible at a constant rate proportional to and is the average duration of the sexual life for sex . Prophylactic immunization occurs at a rate . The vaccine reduces the force of infection by a factor ; thus, is the vaccine effectiveness and the vaccine is effective when . Vaccine-induced immunity wanes at a rate , thus if , protection is lifelong. Individuals recover naturally from the infection at a rate . No immunity is assumed after recovery. The acquisition of infection occurs with a sex-specific force of infection given by
2 |
Here, () is the female-to-male (male-to-female) transmission rate. We remark that although system (1) is a minimalist model, it captures the core characteristics of sexually transmitted infections in a heterosexual population under vaccination. For a full description of model parameters, together with their ranges and baseline values see Sect. 4.1 and Table 1.
Table 1.
Parameters | Values-ranges | Units |
---|---|---|
Female’s sexually active life expectancy | 30.7–(30, 31.4) | Year |
Male’s sexually active life expectancy | 34.7–(34.1, 35.3) | Year |
Average number of sexual contacts for males | 52–Tri(0, 100, 52) | Year |
Average number of sexual contacts for females | 50–Tri(0, 97, 50) | Year |
Probability of female infection | 0.70–Tri(0, 1, 0.70) | dimensionless |
Probability of male infection | 0.40–Tri(0, 1, 0.40) | dimensionless |
Vaccine efficacy | 0.80–(0.60, 0.95) | dimensionless |
Duration of the infectious period | 20–(10, 100) | Days |
Vaccination rates | 0.50–(0.0, 1.60) | Year |
Duration of vaccine-induced protection | 20–(1, 30) | Year |
Mathematical analysis
From system (1) it is immediate that the total population for sex satisfies . Since we are interested in studying model (1) over a finite time interval , we assume that the population for both sexes is constant i.e. for all , so . We stress that the constant population size assumption is standard in epidemic modeling and is based on the fact the time scale of the epidemic process is considerably faster than that of the demographic one for a short time horizon. Therefore, the biologically feasible region for system (1) is given by , where
Let be an state variable of model (1), then if then . It follows that all solutions of the system (1) with an initial condition in remain in for all and is forward invariant. The basic existence, uniqueness, and continuation results for model (1) hold in (Wiggins et al. 2003). Therefore system (1) is epidemiologically well-posed (Hethcote 2000) and it is sufficient to study its dynamics in .
The disease-free equilibrium (DFE) of model (1) is given by
Therefore, the susceptible and vaccinated fractions at equilibrium are
3 |
Observe that in the absence of vaccination, at the DFE, the whole population remains susceptible. Using the next-generation operator (Diekmann et al. 1990) and the method of Van den Driessche and Watmough (2002) we obtain the following next-generation matrix
4 |
The control reproduction number is defined as the spectral radius , that is, the largest eigenvalue of the next generation matrix. Therefore, the analytic expression for the control reproduction number is
5 |
The notation is used to emphasize that the reproduction number is derived under control measures, in this case, vaccination. The square root in (5) arises since it takes two generations for infected hosts to produce newly infected hosts of the same sex (Van den Driessche and Watmough 2008). For a biological intuition of observe that an infectious individuals of sex j produces on average infections on the opposite sex k , during his/her infectious period .
The basic reproduction number in the absence of vaccination, , satisfies
6 |
As a direct consequence of Theorem 2 in Van den Driessche and Watmough (2002), we obtain the local stability for the DFE. The result is formalized as follows.
Theorem 1
The disease-free equilibrium for model (1) is locally asymptotically stable if and unstable if .
We now investigate the existence of the endemic equilibria of the form where , and (a straightforward computation can show that implies , and vice-versa). Further, since we are dealing with constant population for both sexes, we can express the endemic equilibria for the susceptible as (). Then we can solve the equilibrium equations for the vaccinated classes and in terms of the infected classes and as
Next, defining
we can express the infected males as where
7 |
Finally, the infected females at the endemic equilibrium correspond to the zeros of the following four order polynomial
8 |
where
In the particular case for which the vaccine efficacy is , that is, , we can find a unique endemic equilibrium given by
9 |
Observe that the above equilibrium only exists if the condition
is fulfilled. This occurs if and only if , therefore the classical forward bifurcation occurs when the vaccine is effective and the two-sex epidemic model (1) presents a unique endemic equilibrium. In the general case, it is not possible to obtain a closed-form solution for the endemic equilibria but numerical results indicate that the number of endemic equilibria is at most two. Furthermore, a backward bifurcation can occur if the vaccine effectiveness () is below a certain threshold. Figure 1 depicts the typical dynamics for the endemic equilibria of the infected female class where the backward bifurcation is present. The equilibrium dynamics for the male infected class follow the same qualitative behavior (not shown).
Optimal vaccine allocation
In this section, we propose an optimal control problem with an isoperimetric constrain to investigate the best sex-specific vaccine deployment under a limited vaccine budget. For this, we consider time-dependent vaccination rates and per unit of time, thus the controlled model becomes
10 |
subject to non-negative initial conditions. The vaccination rates will be called controls and denoted by the vector .
We conceptualize a limited vaccine supply assuming that the number of vaccines available under the time interval of interest is fixed with a value W and that all vaccines will be delivered to the population. We further assume that the vaccine stockpile is not enough to vaccinate the whole population i.e. since in another case there is no need to optimize vaccine allocation.
This condition can be modeled by the following isoperimetric constraint (Kamien and Schwartz 2012; Lenhart and Workman 2007):
11 |
The problem for public health officers is to choose an optimal vaccine deployment to minimize the prevalence of the infection, as well as the overall costs of vaccine deployment. In mathematical terms, such a goal can be achieved by minimizing the following objective functional
12 |
The weight parameters describe the relative impact of the control or state variables on the value of the objective functional (see Sect. 4.3). The dependence on the control in the objective functional (12) is assumed to be a quadratic function of the control itself. A reason for such a choice is that the quadratic terms penalize high levels of vaccine deployment in comparison with the cost of low levels (Saldaña et al. 2019). We follow this approach but we remark that this formulation offers important mathematical and numerical advantages, as for such -type functionals, the application of Pontryagin’s Maximum Principle allows us to obtain a closed-form formula for the controls as a function of the states and adjoints that can be solved numerically as a boundary value problem (Lenhart and Workman 2007).
The control set is defined by
13 |
with bounds
14 |
Observe that besides the budgetary constraint (11), the vaccination rates should be constrained (due to logistic limitations) under a maximum vaccination rate per unit of time e.g. daily vaccination rate. As shown in Saldaña et al. (2022), a vaccination rate u can be approximated by
15 |
where is the fraction of vaccinated individuals at time t, that is, the vaccination coverage. Considering a very optimistic case in which health authorities achieve a vaccination coverage of the population in year, we obtain that the constant vaccination rate per year. Therefore, we choose a maximum daily vaccination rate as .
Given the special structure of (11), we can convert the isoperimetric constraint (11) into a fixed endpoint constrain (Kamien and Schwartz 2012), by defining
16 |
The additional state variable, Z(t), represents the cumulative number of vaccines that have been given at time t, and satisfies
17 |
The Optimal Control Problem (OCP) is stated as follows:
18 |
An application of the Fillipov-Cesari theorem (Fleming and Rishel 1975, Chapter III, Theorem 4.1) gives conditions to assert the existence of an optimal control pair
and corresponding optimal state solutions
for the OCP (18). The proof is standard for -type objective functionals and we omit it. Proofs of such statements can be found in Camacho et al. (2019); Saldaña et al. (2019); Sepulveda-Salcedo et al. (2020). We now use Pontryagin’s Maximum Principle to state the necessary criterion satisfied by an optimal control (Fleming and Rishel 1975; Kamien and Schwartz 2012).
Theorem 2
If and are optimal for the OCP (18), then there exist a constant and piecewise differentiable functions , where for all we have , such that for every
19 |
for all admissible controls , where the Hamiltonian function H is defined by
20 |
Except at points of discontinuity of , the adjoint variable satisfies
21 |
Furthermore,
22 |
Last, the following transversality conditions are satisfied:
23 |
The adjoint variables () have a classical interpretation in OCP as the marginal valuation of the associated state variable at time t (Kamien and Schwartz 2012). The value of the constant in the Hamiltonian (20) is either 0 or 1. If , then the OCP (18) would have a solution in which the objective matters (Kamien and Schwartz 2012). In this scenario, the Hamiltonian function has the standard form, and minimization of the objective functional (12) is equivalent to minimization of H as a function of along the optimal path. This is not always possible for OCPs that include an isoperimetric constraint (Fleming and Rishel 1975). This results from the fact that the controlled system (10) coupled with (17), has more endpoint conditions than differential equations. Hence, the system is over-determined and the optimization problem may become unfeasible. If , one can handle the OCP finding an admissible control that satisfies the isoperimetric constrain (11). However, such control will neglect the value of the objective functional (Sepulveda-Salcedo et al. 2020). Problems in which are called abnormal (Fleming and Rishel 1975) and the optimal control usually presents a bang-bang structure since H is a linear function in the control. A feasible control, in this case, is to start vaccinating with the maximal effort at the initial phase and to continue vaccinating with a maximal effort to deploy all the vaccines at a time (Hansen and Day 2011; Sepulveda-Salcedo et al. 2020).
In our context, we cannot disregard the value of the objective functional since is essential to find the optimal vaccine deployment. Hence, hereafter we assume . From the first-order optimality conditions we have
24 |
25 |
Considering the lower and upper bounds for the controls and the optimality conditions (24)–(25), we obtain the following characterization of the optimal controls:
26 |
27 |
The constant comes from the solution of the last equation in the adjoint system (21), which implies , where K should be chosen to fulfill the condition .
Numerical results
Here, we complement the analytical results in the previous sections with the numerical computation of the optimal control. To obtain the optimal control solutions we must solve the optimality system which is a boundary value problem involving the state equations (10), coupled with the fixed endpoint constrain (17), and the adjoint system (21). The characterization of the optimal control (26)–(27) has to be substituted in the latter equations to get a system that only depends on the state and adjoint variables. Observe that although the model variables for the controlled system (10) have free end conditions, the additional state variable Z(t) has a specified endpoint (17). Therefore, the forward–backward sweep method (FBSM) cannot be applied directly to solve the optimality system (Lenhart and Workman 2007). Instead, we need to find the value K for the adjoint variable such that . To this end, we consider an adapted FBSM that takes as an input a guess for K, and solves the corresponding OCP. The solution obtained by the implementation of FBSM is denoted as , and the corresponding final value for the auxiliary function Z that computes the number of cumulative vaccinated individuals is denoted . The adapted FBSM is an iterative process that seeks the value of K that minimizes the difference . We use the classical secant method to solve this outer iterative process which usually involves several iterations of the FBSM.
The algorithm for the inner FBSM obtains a control update for step m solving the optimality system. Often, a direct update of the control , is sufficient for convergence. Nevertheless, a weighted update such that
28 |
is commonly used to improve convergence properties (Lenhart and Workman 2007). The choice of significantly accelerates convergence relative to the direct update (Sharp et al. 2021), particularly if is updated between iterations. However, since the optimal choice for is problem-dependent, here we use a constant for all iterations. Convergence properties for the FBSM for this case are discussed in Lenhart and Workman (2007); Sharp et al. (2021). As a convergence criterion, we require the relative error to be negligibly small so that
29 |
is satisfied. Here, is the Euclidean norm and is the accepted tolerance (fixed as ). The equivalent convergence criteria should be satisfied by the state and adjoint variables. For the outer FBSM we seek that is satisfied with a desired tolerance using .
Model parameters
We retrieved the baseline values for some of our model parameters using sexual behavior data from the United States of America (USA) and estimations from previous studies on STIs. Rather than studying a single disease, our approach is to investigate a set of scenarios of interest that might be plausible for the most common STIs. The selection of parameters is outlined as follows.
The sexually active life expectancy has been estimated to be on average higher for males than for females (Lindau and Gavrilova 2010). In particular, the sexually active life expectancy for males is 34.7 years with a confidence interval (34.1, 35.3). Thus, years. The sexually active life expectancy for females is 30.7 years with a confidence interval (30, 31.4). Thus, years. In 2020, it was estimated in the USA that the percentage of the female population is compared to in the male population (United Nations 2020). Therefore, and . For simplicity, we assume that the total population is .
The parameter is the transmission rate from males to females, where is the expected number of sexual contacts with men that a typical woman carries out per unit of time and is the probability of female infection given contact with an infectious male. Likewise, the transmission rate from females to males , is the product of the expected number of sexual contacts with women that a typical man carries out per unit of time and the probability of male infection given contact with an infectious female . To obtain the conservation of total sex contacts, the mixing function should satisfy the following condition (Busenberg and Castillo-Chavez 1991):
30 |
Observe that if then the parameters and can differ substantially. Under our conditions, if we assume that is fixed, we can obtain . Men and women in good health report frequent sex (once or more weekly) (Lindau and Gavrilova 2010). In our study, we assume that the expected number of sexual contacts that a typical man carries out follows a triangular distribution per year (Lindau and Gavrilova 2010). Furthermore, there is evidence that the male-to-female sexual infectivity rate is generally greater than that for female-to-male (Low et al. 2006; Wong et al. 2004). For example, for genital herpes HSV-2, estimations indicate that (Heffernan et al. 2014). Therefore, we set , and we propose , and .
According to the WHO, to be approved, vaccines are required to have a high efficacy rate of at least 50% (World Health Organization 2021). Current vaccines against STIs have been proven to be highly effective to prevent infection e.g. vaccines against HPV, and hepatitis B virus (Gottlieb et al. 2016). In this study, we consider vaccine efficacy between - for both sexes (). The average infectious period might vary substantially in STIs, depending on the disease, ranging from a few days up to several months (Workowski and Bolan 2015). As a consequence, we assume days (). Regarding the duration of vaccine-induced immunity, we assume that the protection last from at least one year and can be maintained up to 30 years, hence years (). Model parameters are summarized in Table 1.
Global sensitivity analysis for the reproduction numbers
Here, a global sensitivity analysis is performed to provide a quantitative measure of the contributions of the model parameters on the reproduction numbers and . We use a variance-based sensitivity analysis classically referred as the Sobol method which is, so far, one of the most powerful techniques among current global sensitivity analysis methods (Zhang et al. 2015). Sobol sensitivity analysis determines the contribution of input parameters to the overall variance of a model outcome of interest, in our case, the reproduction numbers. In particular, the so-called first-order Sobol indices measure the contribution to the output variance by a single model input alone. Whereas, the total-order index measures the contribution to the output variance caused by a model input, including both its first-order effects and all higher-order interactions (Saltelli et al. 2008). We perform numerical experiments (100,000 samples) using SALib, an open-source library written in Python for performing sensitivity analyses (Herman and Usher 2017). The ranges used for the parameters are listed in Table 1.
Figure 2a shows the first (blue) and total (red) Sobol’s indices for the basic reproduction number . The dark marks on top of the bars in Fig. 2a represent 95% confidence intervals for the sensitivity indices. Notice that they are very small. Observe that the expected number of sexual contacts together with the recovery rates () are the parameters that contribute the most to the variability of . Whereas, the contribution to the variability of given by the mortality rates () is practically zero. Figure 2b shows a histogram for the distribution of . The solid line represents a kernel density estimation for the continuous distribution. Observe that although in most cases value is below 1, in some extreme scenarios can be as high as 3.
Figure 3a shows the first (blue) and total (red) Sobol’s indices for the control reproduction number . As in the case for , the parameters and () contribute the most to the variance of . Figure 3b shows a histogram for the distribution of . Observe that the distribution for is closer to low values in comparison with the distribution (see Fig. 2b). Hence, even though the vaccine parameters (, , ) are not the most influential parameters on , they still can significantly reduce the value of .
Vaccination scenarios
We investigate several vaccination scenarios to evaluate the optimal sex-specific vaccine deployment among the population. The time horizon for our simulations is 365 days, that is, days and . In the objective functional (12), the parameters and balance the cost of the reduction in health and well-being of infected females and males, respectively. These costs related to pain and suffering are sometimes referred to as morbidity costs (Muennig and Bounthavong 2016). On the other hand, and represent the costs of vaccine deployment in females and males, respectively. In real-life scenarios, the monetary costs and side effects of a vaccination program are typically small compared with the potential losses that an outbreak can inflict. Hence, we assume . Furthermore, females are more severely affected by STIs because of anatomical physiological characteristics. So in a heterosexual setting, women bear the largest burden (Workowski and Bolan 2015). The classical example is HPV infection. While HPV infection can lead to cervical cancer and death in women, the infection in men rarely leads to severe health problems (penile cancer from HPV might happen but the rate is far lower than the rate for cervical cancer) (Sung et al. 2021). Therefore, . In particular, for the numerical simulations, we assume , . The cost of vaccine deployment is assumed to be the same for both sexes and is fixed as .
To better quantify the gender-specific optimal vaccine deployment we define
31 |
Observe that and represent the cumulative number of vaccinated females and males, respectively, at time t, and for all . Furthermore, since vaccinated individuals can still get infected, it follows that , for all .
A starting vaccination roll-out program
As a first scenario, we consider a starting vaccination roll-out program where no individuals in the population have been vaccinated. Initial conditions are set as follows: , , and , . Regarding the vaccine stockpile, we consider three cases corresponding to the supply of vaccines for 20% (), 30% (), and 40% () of the total population.
The first column in Fig. 4 shows the optimal control solutions, that is, the optimal time-dependent vaccination rates for females (blue) and males (red). The second column shows the sex-specific optimal vaccine deployment using cumulative vaccinated individuals. The cumulative number of vaccinated females (blue), and males (red) are obtained from the optimal states corresponding to the optimal controls on the first column. The variable Z(t) that represents the total cumulative number of vaccines administered is also shown. Observe that for each of the cases investigated: (first row), (second row) and (third row). For all cases (see Fig. 4a, c, e), the optimal control solutions suggest that health officers must use all the vaccines available as soon as possible at the early phase of the outbreak.
One important result from Fig. 4a, c, d is that although the vaccination rate for females should be higher than the one for males, this difference is relatively small. Hence, under these conditions, men should be included in vaccination programs together with females. The right column in Fig. 4 shows, as expected from the optimal controls, that the cumulative number of vaccinated females is above the one for males. Nevertheless, the key point to notice is that the difference in the sex-specific cumulative vaccination increases as the vaccine stockpile reduces (note that the difference is bigger in Fig. 4b in comparison with Fig. 4f).
We remark that for all the scenarios explored, the implementation of the vaccination program manages to significantly reduce the prevalence of the infection in comparison with the no-control case. Figure 5 deploys the number of infected individuals without control (solid red line) and under the application of the optimal vaccination rates (solid blue line) corresponding to the three cases , , and . Females and males are presented in the left and right columns in Fig. 5, respectively. The integral of the shaded area corresponds to the number of infections averted by the vaccination programs.
The case of an already existing single-sex vaccination program
The results in Fig. 4 were derived for a starting vaccination roll-out program. Another scenario of interest is when a single-sex vaccination strategy is already established. In this context, public health authorities would like to evaluate if it is better to increase coverage in the existing single-sex program or to vaccinate both sexes simultaneously (Bogaards et al. 2011). To simulate this scenario, we assume that and over an initial period such that at the end of the period 10000 females have been vaccinated. Hence, a substantial number of females have already been vaccinated, but no males have been vaccinated. Then, the optimal vaccine allocation begins. This scenario mimics HPV vaccination programs in several countries currently directed at females only (Bruni et al. 2021). Other model parameters are fixed as shown in Table 1, except the total vaccine stockpile W that now counts 10000 vaccines less (the ones that are already delivered for females).
The optimal control profiles and cumulative vaccinated individuals for these conditions are shown in Fig. 6. The resulting optimal control profiles for the cases and (see Fig. 6a, c), are significantly different in comparison with the corresponding cases (see Fig. 4a, c). The first difference is that now the control profiles no longer suggest that health authorities should deploy as many vaccines as possible at the beginning of the outbreak. Instead, immunization should be delayed by at least 60 days. Second, the optimal vaccination rate for males is now strictly zero i.e. . As a consequence, the total number of vaccinated individuals is equal to the number of vaccinated females, (see Fig. 6b, d). For the case of a starting vaccination roll-out program (see Fig. 4), results showed that females should be vaccinated at a higher rate than males. However, even in the scenario with the lowest vaccine supply, the optimal vaccination rate for males was greater than zero. Finally, observe that for the case (see Fig. 6e, f), the control profiles present again the same qualitative behavior as the ones in the starting vaccination roll-out program. To summarize, for a scenario of very limited vaccine stockpile, i.e. , vaccine administration should continue prioritizing the female-only target population. However, if the stockpile is relatively large, i.e. , the inclusion of males in the vaccination program is the optimal strategy to effectively eliminate the epidemic in the population.
Discussion
The prevention and control of sexually transmitted infections have extensive public health benefits including the reduction of preventable deaths of newborns, and improved sexual and reproductive health (World Health Organization 2021). Vaccine development and successful implementation of effective immunization programs are critical actions to progress in the control of STIs (Gottlieb et al. 2019). Nevertheless, due to cost and logistical challenges, vaccine stockpile is typically limited and not enough to achieve high-immunization coverage, particularly in low-middle-income settings (Yamey et al. 2022). Data reports significant sex-specific differences in biological risks for STI acquisition, the clinical manifestation of the infection, and their potential for transmission to the opposite sex (Hook 2012; Wong et al. 2004). Hence, determining optimal sex-specific vaccination programs against STIs is a challenging task that deserves more attention. A major example are HPV vaccination programs which were introduced in several countries for young girls. These early female-only HPV immunization programs have been found to be cost-effective when cervical cancer prevention is the main objective (see Brisson et al. (2020) and the references therein). Yet, a number of studies (Elfström et al. 2016; Stanley 2012) have suggested that if rather than preventing cervical cancer alone, the aim is to reduce all HPV-associated diseases, then the inclusion of males can be cost-effective. Currently, more than 30% of the HPV programs are gender-neutral (GN), i.e. with both females and males receiving the vaccine. However, 79% of GN programs are from high-income countries whereas only 21% are from upper-middle-income countries (Bruni et al. 2021).
In this study, we investigate under which conditions the inclusion of both males and females into vaccination programs adds to the population-level impact of female-only interventions. Considering sex-specific differences in transmissibility and severity in disease outcomes, we compare vaccination strategies against STI transmission for different realistic settings described by distinct budget constraints associated with the vaccine supply. The vaccination strategies are obtained as solutions to an optimal control problem aiming to reduce the total prevalence of the infection subject to a minimalist two-sex Kermack–McKendrick-type model. The control variables are the daily vaccination rates for females and males, respectively, that mimic a prophylactic vaccine with effectiveness not necessarily equal to . One important aspect of our approach relies upon modeling a limited but specific vaccine stockpile via an isoperimetric constraint (Kamien and Schwartz 2012). We solve the optimal control problem via Pontryagin’s Maximum Principle and obtain a numerical approximation for the solution using a modified version of the FBSM which handles the isoperimetric budget constraint in our formulation.
We considered two main scenarios regarding the current immunization coverage in the population (i) a starting vaccination roll-out program where no individuals in the population have been vaccinated (see Fig. 4) and (ii) a female-only vaccination strategy which is already established and has reached around 20% coverage in females (see Fig. 6). The second scenario is relevant for public health authorities who would like to evaluate if it is better to increase coverage in the existing female-only program or to vaccinate both sexes simultaneously. Each of these scenarios is further subdivided according to the total vaccine supply available which is incorporated via the isoperimetric constraint (11). The simulations for the first scenario show that although the vaccination rate for females should be higher than the one for males. Hence, under these conditions, vaccinating both sexes, with a slightly higher rate for females, is optimal and provides an effective and faster approach to reducing the prevalence of the infection. These results agree with the HPV immunization program currently used in Spain (Linertová et al. 2022). However, the difference in sex-specific vaccine distribution increases as the vaccine stockpile reduces. For the case in which a female-only program is already ongoing, vaccine administration should continue prioritizing the female-only target population and males should only be included if the vaccine stockpile is large (enough to reach at least total coverage). In other words, for a very limited vaccine supply ( coverage or less), female-only vaccination can be more beneficial than the inclusion of both sexes into the vaccination program. Since the male-to-female sexual infectivity rate is generally higher than that of female-to-male, prioritizing female vaccination might seem counterintuitive, because vaccinating super-spreaders (in this case males) is usually effective to reduce the prevalence of the infection. Yet, this may be due to the fact that the health risks associated with STIs are considerably higher for females in comparison with men. This is considered in the solution of our optimal control problem using the weight parameters in the objective functional.
As with the majority of studies, we considered some simplifying modeling assumptions that can be improved in further studies. First, we assumed that single-dose vaccination is enough to reach full immunity. Nevertheless, a two-dose series is often needed and there might be a delay of some days (or weeks) to achieve full immunity. Second, we assumed that susceptible individuals are easily identified for a prophylactic vaccine that lacks therapeutic effects and is therefore not effective in already infected individuals. On the contrary case, some vaccines can be misdirected in the infected population. Finally, we have considered a heterosexual population but the inclusion of individuals with another sexual orientation can play a key role in disease dynamics. Future investigations are necessary to validate if the principal properties of the optimal vaccination policies drawn from this study are affected when these assumptions are relaxed.
Acknowledgements
This research is supported by the Basque Government through the “Mathematical Modeling Applied to Health” BMTF Project, BERC 2022-2025 program and by Spanish Ministry of Sciences, Innovation and Universities: BCAM Severo Ochoa accreditation CEX2021-001142-S / MICIN / AEI / 10.13039/501100011033. The authors would like to thank the members of the Basque Modeling Task Force (BMTF), Dr. Javier Mar, Biodonostia Health Research Institute, Basque Country, Spain, and Dr. Joseba Bidaurrazaga Van-Dierdonck, Public Health Department of the Basque Government, Spain, as well as Dr. Carmen Guirado Fuentes, Fundación Canaria Instituto de Investigación Sanitaria de Canarias, Canary Island, Spain, for fruitful discussions. Moreover, the authors would like to thank the two anonymous reviewers for their thoughtful comments and efforts towards improving this study.
Declarations
Conflict of interest
The authors declare they have no known competing financial interests that could have appeared to influence the results reported in this work.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Bogaards JA, Kretzschmar M, Xiridou M, et al. Sex-specific immunization for sexually transmitted infections such as human papillomavirus: insights from mathematical models. PLoS Med. 2011;8(12):e1001147. doi: 10.1371/journal.pmed.1001147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bogaards JA, Wallinga J, Brakenhoff RH, et al. Direct benefit of vaccinating boys along with girls against oncogenic human papillomavirus: Bayesian evidence synthesis. BMJ. 2015;350:h2016. doi: 10.1136/bmj.h2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brisson M, Kim JJ, Canfell K, et al. Impact of HPV vaccination and cervical screening on cervical cancer elimination: a comparative modelling analysis in 78 low-income and lower-middle-income countries. The Lancet. 2020;395(10224):575–590. doi: 10.1016/S0140-6736(20)30068-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown VL, White KJ. The role of optimal control in assessing the most cost-effective implementation of a vaccination programme: HPV as a case study. Math Biosci. 2011;231(2):126–134. doi: 10.1016/j.mbs.2011.02.009. [DOI] [PubMed] [Google Scholar]
- Bruni L, Saura-Lázaro A, Montoliu A, et al. HPV vaccination introduction worldwide and WHO and UNICEF estimates of national HPV immunization coverage 2010–2019. Prev Med. 2021;144(106):399. doi: 10.1016/j.ypmed.2020.106399. [DOI] [PubMed] [Google Scholar]
- Busenberg S, Castillo-Chavez C. A general solution of the problem of mixing of subpopulations and its application to risk-and age-structured epidemic models for the spread of aids. Math Med Biol J IMA. 1991;8(1):1–29. doi: 10.1093/imammb/8.1.1. [DOI] [PubMed] [Google Scholar]
- Bussell EH, Dangerfield CE, Gilligan CA, et al. Applying optimal control theory to complex epidemiological models to inform real-world disease management. Philos Trans R Soc B. 2019;374(1776):20180284. doi: 10.1098/rstb.2018.0284. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Camacho A, Saldaña F, Barradas I, et al. Modeling public health campaigns for sexually transmitted infections via optimal and feedback control. Bull Math Biol. 2019;81(10):4100–4123. doi: 10.1007/s11538-019-00642-9. [DOI] [PubMed] [Google Scholar]
- Diekmann O, Heesterbeek JAP, Metz JA. On the definition and the computation of the basic reproduction ratio in models for infectious diseases in heterogeneous populations. J Math Biol. 1990;28(4):365–382. doi: 10.1007/BF00178324. [DOI] [PubMed] [Google Scholar]
- Duijzer LE, van Jaarsveld WL, Wallinga J, et al. Dose-optimal vaccine allocation over multiple populations. Prod Oper Manag. 2018;27(1):143–159. doi: 10.1111/poms.12788. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elfström KM, Lazzarato F, Franceschi S, et al. Human papillomavirus vaccination of boys and extended catch-up vaccination: effects on the resilience of programs. J Infect Dis. 2016;213(2):199–205. doi: 10.1093/infdis/jiv368. [DOI] [PubMed] [Google Scholar]
- Estadilla CDS, Uyheng J, de Lara-Tuprio EP, et al. Impact of vaccine supplies and delays on optimal control of the covid-19 pandemic: mapping interventions for the philippines. Infect Dis Poverty. 2021;10(04):46–59. doi: 10.1186/s40249-021-00886-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming W, Rishel R. Deterministic and stochastic optimal control. Berlin: Springer; 1975. [Google Scholar]
- Gao S, Martcheva M, Miao H, et al. A dynamic model to assess human papillomavirus vaccination strategies in a heterosexual population combined with men who have sex with men. Bull Math Biol. 2021;83(1):1–36. doi: 10.1007/s11538-020-00830-y. [DOI] [PubMed] [Google Scholar]
- Gottlieb SL, Deal CD, Giersing B, et al. The global roadmap for advancing development of vaccines against sexually transmitted infections: update and next steps. Vaccine. 2016;34(26):2939–2947. doi: 10.1016/j.vaccine.2016.03.111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gottlieb SL, Jerse AE, Delany-Moretlwe S, et al. Advancing vaccine development for gonorrhoea and the global STI vaccine roadmap. Sex Health. 2019;16(5):426–432. doi: 10.1071/SH19060. [DOI] [PubMed] [Google Scholar]
- Hansen E, Day T. Optimal control of epidemics with limited resources. J Math Biol. 2011;62(3):423–451. doi: 10.1007/s00285-010-0341-0. [DOI] [PubMed] [Google Scholar]
- Heffernan JM, Lou Y, Steben M, et al. Cost-effectiveness evaluation of gender-based vaccination programs against sexually transmitted infections. Discrete Contin Dyn Syst B. 2014;19(2):447. doi: 10.3934/dcdsb.2014.19.447. [DOI] [Google Scholar]
- Herman J, Usher W. Salib: an open-source python library for sensitivity analysis. J Open Source Softw. 2017;2(9):97. doi: 10.21105/joss.00097. [DOI] [Google Scholar]
- Hethcote HW. The mathematics of infectious diseases. SIAM Rev. 2000;42(4):599–653. doi: 10.1137/S0036144500371907. [DOI] [Google Scholar]
- Hook EW. Gender differences in risk for sexually transmitted diseases. Am J Med Sci. 2012;343(1):10–11. doi: 10.1097/MAJ.0b013e31823ea276. [DOI] [PubMed] [Google Scholar]
- Kamien MI, Schwartz NL. Dynamic optimization: the calculus of variations and optimal control in economics and management. New York: Courier corporation; 2012. [Google Scholar]
- Korenromp EL, Rowley J, Alonso M, et al. Global burden of maternal and congenital syphilis and associated adverse birth outcomes-estimates for 2016 and progress since 2012. PloS one. 2019;14(2):e0211720. doi: 10.1371/journal.pone.0211720. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lenhart S, Workman JT. Optimal control applied to biological models. Boca Raton: CRC Press; 2007. [Google Scholar]
- Libotte GB, Lobato FS, Platt GM, et al. Determination of an optimal control strategy for vaccine administration in covid-19 pandemic treatment. Comput Methods Programs Biomed. 2020;196(105):664. doi: 10.1016/j.cmpb.2020.105664. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindau ST, Gavrilova N. Sex, health, and years of sexually active life gained due to good health: evidence from two US population based cross sectional surveys of ageing. BMJ. 2010 doi: 10.1136/bmj.c810. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Linertová R, Guirado-Fuentes C, Mar-Medina J, et al. Cost-effectiveness and epidemiological impact of gender-neutral HPV vaccination in Spain. Hum Vaccines Immunother. 2022;18(6):2127983. doi: 10.1080/21645515.2022.2127983. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Low N, Broutet N, Adu-Sarkodie Y, et al. Global control of sexually transmitted infections. The Lancet. 2006;368(9551):2001–2016. doi: 10.1016/S0140-6736(06)69482-8. [DOI] [PubMed] [Google Scholar]
- Maier SB, Huang X, Massad E, et al. Analysis of the optimal vaccination age for dengue in brazil with a tetravalent dengue vaccine. Math Biosci. 2017;294:15–32. doi: 10.1016/j.mbs.2017.09.004. [DOI] [PubMed] [Google Scholar]
- Malik T, Imran M, Jayaraman R. Optimal control with multiple human papillomavirus vaccines. J Theor Biol. 2016;393:179–193. doi: 10.1016/j.jtbi.2016.01.004. [DOI] [PubMed] [Google Scholar]
- Matrajt L, Halloran ME, Longini IM., Jr Optimal vaccine allocation for the early mitigation of pandemic influenza. PLoS Comput Biol. 2013;9(3):e1002964. doi: 10.1371/journal.pcbi.1002964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muennig P, Bounthavong M. Cost-effectiveness analysis in health: a practical approach. New York: Wiley; 2016. [Google Scholar]
- Rodrigues HS, Monteiro MTT, Torres DF. Vaccination models and optimal control strategies to dengue. Math Biosci. 2014;247:1–12. doi: 10.1016/j.mbs.2013.10.006. [DOI] [PubMed] [Google Scholar]
- Saif A, Elhedhli S. Cold supply chain design with environmental considerations: a simulation-optimization approach. Eur J Oper Res. 2016;251(1):274–287. doi: 10.1016/j.ejor.2015.10.056. [DOI] [Google Scholar]
- Saldaña F, Velasco-Hernández JX. Modeling the covid-19 pandemic: a primer and overview of mathematical epidemiology. SeMA J. 2021 doi: 10.1007/s40324-021-00260-3. [DOI] [Google Scholar]
- Saldaña F, Camacho-Gutiérrez JA, Villavicencio-Pulido G, et al. Modeling the transmission dynamics and vaccination strategies for human papillomavirus infection: an optimal control approach. Appl Math Model. 2022;112:767–785. doi: 10.1016/j.apm.2022.08.017. [DOI] [Google Scholar]
- Saldaña F, Korobeinikov A, Barradas I (2019) Optimal control against the human papillomavirus: protection versus eradication of the infection. In: Abstract and applied analysis, Hindawi. 10.1155/2019/4567825
- Saltelli A, Ratto M, Andres T, et al. Global sensitivity analysis: the primer. New York: Wiley; 2008. [Google Scholar]
- Sepulveda-Salcedo LS, Vasilieva O, Svinin M. Optimal control of dengue epidemic outbreaks under limited resources. Stud Appl Math. 2020;144(2):185–212. doi: 10.1111/sapm.12295. [DOI] [Google Scholar]
- Sharp JA, Burrage K, Simpson MJ. Implementation and acceleration of optimal control for systems biology. J R Soc Interface. 2021;18(181):20210241. doi: 10.1098/rsif.2021.0241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shim E. Optimal strategies of social distancing and vaccination against seasonal influenza. Math Biosci Eng. 2013;10(5 &6):1615. doi: 10.3934/mbe.2013.10.1615. [DOI] [PubMed] [Google Scholar]
- Stanley M. Perspective: vaccinate boys too. Nature. 2012;488(7413):S10–S10. doi: 10.1038/488S10a. [DOI] [PubMed] [Google Scholar]
- Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209–249. doi: 10.3322/caac.21660. [DOI] [PubMed] [Google Scholar]
- Tavana M, Govindan K, Nasr AK, et al. A mathematical programming approach for equitable covid-19 vaccine distribution in developing countries. Ann Oper Res. 2021;1:34. doi: 10.1007/s10479-021-04130-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tsevat DG, Wiesenfeld HC, Parks C, et al. Sexually transmitted diseases and infertility. Am J Obstet Gynecol. 2017;216(1):1–9. doi: 10.1016/j.ajog.2016.08.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Unemo M, Bradshaw CS, Hocking JS, et al. Sexually transmitted infections: challenges ahead. Lancet Infect Dis. 2017;17(8):e235–e279. doi: 10.1016/S1473-3099(17)30310-9. [DOI] [PubMed] [Google Scholar]
- United Nations (2020) World population prospects. https://population.un.org/wpp/Download/Standard/Population/. Accessed 26 Jun 2022
- Van den Driessche P, Watmough J. Reproduction numbers and sub-threshold endemic equilibria for compartmental models of disease transmission. Math Biosci. 2002;180(1–2):29–48. doi: 10.1016/s0025-5564(02)00108-6. [DOI] [PubMed] [Google Scholar]
- Van den Driessche P, Watmough J. Further notes on the basic reproduction number. Math Epidemiol. 2008 doi: 10.1007/978-3-540-78911-6_6. [DOI] [Google Scholar]
- Vo M, Glasser JA, Feng Z. Optimal allocation of resources to healthcare workers or the general populace: a modelling study. R Soc Open Sci. 2021;8(11):210823. doi: 10.1098/rsos.210823. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wiggins S, Wiggins S, Golubitsky M. Introduction to applied nonlinear dynamical systems and chaos. Berlin: Springer; 2003. [Google Scholar]
- Wong T, Singh A, Mann J, et al. Gender differences in bacterial STIs in Canada. BMC Womens Health. 2004;4(1):1–8. doi: 10.1186/1472-6874-4-S1-S26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Workowski KA, Bolan GA. Sexually transmitted diseases treatment guidelines, 2015. MMWR Recomm Rep Morb Mortal Wkly Rep Recomm Rep. 2015;64(RR–03):1. [PMC free article] [PubMed] [Google Scholar]
- World Health Organization (2021) Sexually transmitted infections (STIs). https://www.who.int/news-room/fact-sheets/detail/sexually-transmitted-infections-(stis). Accessed 26 Jun 2022
- Yamey G, Garcia P, Hassan F, et al. It is not too late to achieve global covid-19 vaccine equity. BMJ. 2022 doi: 10.1136/bmj-2022-070650. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang XY, Trame MN, Lesko LJ, et al. Sobol sensitivity analysis: a tool to guide the development and evaluation of systems pharmacology models. CPT Pharmacomet Syst Pharmacol. 2015;4(2):69–79. doi: 10.1002/psp4.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zheng Y, Yu Q, Lin Y, et al. Global burden and trends of sexually transmitted infections from 1990 to 2019: an observational trend study. Lancet Infect Dis. 2022;22(4):541–551. doi: 10.1016/S1473-3099(21)00448-5. [DOI] [PubMed] [Google Scholar]