Skip to main content
BMC Medical Research Methodology logoLink to BMC Medical Research Methodology
. 2024 Jul 13;24:148. doi: 10.1186/s12874-024-02271-w

A compartmental model for smoking dynamics in Italy: a pipeline for inference, validation, and forecasting under hypothetical scenarios

Alessio Lachi 1,2,, Cecilia Viscardi 1,3, Giulia Cereda 1,3, Giulia Carreras 4, Michela Baccini 1,3,
PMCID: PMC11245805  PMID: 39003462

Abstract

We propose a compartmental model for investigating smoking dynamics in an Italian region (Tuscany). Calibrating the model on local data from 1993 to 2019, we estimate the probabilities of starting and quitting smoking and the probability of smoking relapse. Then, we forecast the evolution of smoking prevalence until 2043 and assess the impact on mortality in terms of attributable deaths. We introduce elements of novelty with respect to previous studies in this field, including a formal definition of the equations governing the model dynamics and a flexible modelling of smoking probabilities based on cubic regression splines. We estimate model parameters by defining a two-step procedure and quantify the sampling variability via a parametric bootstrap. We propose the implementation of cross-validation on a rolling basis and variance-based Global Sensitivity Analysis to check the robustness of the results and support our findings. Our results suggest a decrease in smoking prevalence among males and stability among females, over the next two decades. We estimate that, in 2023, 18% of deaths among males and 8% among females are due to smoking. We test the use of the model in assessing the impact on smoking prevalence and mortality of different tobacco control policies, including the tobacco-free generation ban recently introduced in New Zealand.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-024-02271-w.

Keywords: Compartmental models, Smoking dynamics, Tobacco control policies, Global sensitivity analysis, Parametric bootstrap, Cross validation, Smoking attributable deaths, Forecasting, Calibration, Regression splines

Background

Smoking is a significant risk factor for many common chronic diseases, including cancer, cardiovascular, cerebrovascular and respiratory diseases, diabetes, and a leading preventable cause of premature death [1, 2]. Also, smoking reduces length and quality of life [3], and contributes to health inequities [4]. The Global Burden of Disease study [5] reports that in 2019 smoking was responsible for around 8,709,000 deaths in the World (15.4% of all deaths), 907,000 in Europe, and 96,000 in Italy.

The importance of Tobacco Control Policies (TCP) has been firmly established within the World Health Organization’s (WHO) Framework Convention on Tobacco Control (FCTC), an international treaty that came into force in 2005 and has been ratified by 182 countries. Specifically, tobacco control has been included as one of the global development goals, recognized as crucial and necessary to achieve a one-third reduction in premature mortality by 2030 [6].

Focusing on Italy, data from the Italian surveillance system PASSI (Progressi delle Aziende Sanitarie per la Salute in Italia) highlighted that in 2021 23.7% of Italians (27.2% in men and 20.2% in women) described themselves as current smokers [7]. Among adolescents, smoking prevalence stalled in the last years, with a prevalence of current smokers between 27.3% and 32.4% in young people aged 13-16 years [8, 9].

Dynamic simulation models are widely used to describe and project the evolution of smoking habits in the population over time and to estimate the impact of past and hypothetical future TCPs. Since the 2000s, several models have been proposed [1013], some of which developed within the Cancer Intervention and Surveillance Modelling Network (CISNET), a consortium of investigators funded by the National Cancer Institute, that uses mathematical modelling to study the impact of cancer control interventions [14]. These models are mainly of two types: compartmental models and agent-based models. Compartmental models, starting from a baseline year, perform macro-simulations so that the population evolves through deaths, births and changes in smoking habits [1012]. The SimSmoke model [15] is the most used compartmental model [16], implemented for a wide number of countries including Italy [1720]. Agent-based models, also called micro-simulation models, simulate individual life trajectories and interactions with a view to assessing their effects on the system as a whole [21, 22].

In this paper, grounding on previous works [12, 2325], we developed a compartmental model that describes the evolution of smoking habits in Tuscany, a region of Central Italy, from 1993 to 2019, and forecasts them until 2043. The model assumes that at each point in time, the population is divided into non-overlapping groups called compartments, defined according to smoking status (never, current, and former smokers), age and sex [26]. Transitions between compartments are described by simple probabilistic rules and the evolution of the size of the compartments is governed by a system of differential equations.

While some of the transition parameters in the model were assumed as fixed, we estimated via a two-step calibration the age-specific probabilities of starting and quitting smoking, modelled in a flexible way through cubic regression splines [27], the probability of relapsing smoking, modelled as a nonlinear function of the time from quitting [28], and the mortality rate. We calibrated the model on the observed prevalence of never, current, and former smokers for the years from 1993 to 2019, arising from yearly local surveys.

Once we estimated the transition parameters, we predicted the prevalence of never, current, and former smokers in the regional population over time, and quantified the impact of smoking in terms of the number of smoking-attributable deaths (SAD) and population attributable fraction (PAF). With simple examples, we also illustrated the use of the compartmental model to predict the future impact of hypothetical interventions that act on the probabilities of starting and quitting smoking.

Compared to previous studies that dealt with the same problem, we aimed at presenting some methodological advances both in the modelling and estimation strategies. First of all, grounding on a formal definition of the model equations, we addressed the problem of accounting for sampling variability and provided confidence intervals for the estimates of the parameters and compartment sizes. To this end, due to the unavailability of the likelihood function associated with the model, we relied on a parametric bootstrap procedure [29, 30]. Also, we introduced a flexible modelling of the probabilities of starting and stopping smoking, usually assumed as constant, allowing them to change over time as functions of age. Moreover, we assessed the predictive performance of the model using cross-validation on a rolling basis. Finally, we assessed parameter identifiability through Global Sensitivity Analysis (GSA) [31].

Methods

Data

The analyses relied on data from heterogeneous sources. We used data from the National Institute of Statistics (ISTAT) Multipurpose Surveys “Aspect of Daily Life" (AVQ) (www.istat.it/it/archivio/91926), which every year collect fundamental information related to the daily life of individuals and families in Italy, enrolling about 25,000 families distributed in about 800 Italian municipalities of different population sizes. Specifically, we obtained from the ISTAT AVQ surveys an estimate of the distribution by smoking habit (never, current, and former smokers) of the population residing in Tuscany for each year from 1993 to 2019, separately for males and females and by age class (14-17, 18-19, 20-24, 25-34, 35-44, 45-54, 55-59, 60-64, 65-74, 75+). We obtained from the same surveys the smoking intensity distribution for current smokers, by sex and age class.

We used data from the ISTAT Multipurpose Surveys European Health Survey (EHIS) (www.istat.it/it/archivio/167485), a survey on the main aspects of public health carried out every 5 years from 1980 in all member states of the European Union, to obtain an estimate of the smoking intensity distribution among former smokers, as well as information about time since smoking cessation, separately for males and females and by the same age classes reported above. In particular, we considered the surveys for 1994, 1999, 2004, and 2013.

We obtained the size of the Tuscany population on January 1st 1993 and January 1st 2005, by age and sex, from the ISTAT website (www.istat.it). From the same website, we got the mortality rates by age and sex and the number of new births in Tuscany for the period 1993-2019. The relative risks (RRs) of death for smokers and ex-smokers versus never smokers are those reported in the Appendix of [32].

Model specification

We specified a compartmental model for smoking habit dynamics in the population, which we call Smoking Habits Compartmental (SHC) model. In order to better present the SHC model adopted for the analysis, we first introduce a simpler version of it, and then proceed step by step, adding elements of complexity.

The starting model assumes that at each time the alive population is divided into the following non-overlapping compartments: never (N), current (C), and former (F) smokers. We consider only cigarette smoking. Never smokers can become current smokers, current smokers can become former smokers, and former smokers may restart smoking (smoking relapse). The compartments C and F are further divided into sub-compartments denoted by Ci and Fi, where i{l,m,h} indicates the level of smoking intensity, corresponding to low (<10 cigarettes/day), medium (10 and <20 cigarettes/day), and high (20 cigarettes/day) smoking intensity, respectively. During their life, individuals can change their smoking status, but, for the sake of simplicity, we assume that they cannot change their level of smoking intensity. The model admits deaths and new births. From each compartment, subjects can transit to a deceased compartment denoted by the letter D and a subscript corresponding to the compartment of origin. New births (ν(t) is the number of new births at time t) increase the size of the compartment N. Transitions of the individuals from a given compartment to another one determine flows regulated by the transition parameters, among which the rates of starting smoking (γi), stopping smoking (ϵi), and relapsing into smoking after having stopped (ηi). Note that these rates can depend on the level of smoking intensity i. Death happens with different rates for never (δN), current (δi), and former (δi) smokers. For current and former smokers, the mortality rates may depend also on smoking intensity. This compartmental model, graphically represented in Fig. 1, is expressed by the following system of differential equations for each i{l,m,h}:

dN(t)dt=-N(t)1-δNγ-N(t)δN+ν(t)dCi(t)dt=-Ci(t)1-δiϵi-Ci(t)δi+N(t)1-δNγi+Fi(t)1-δiηidFi(t)dt=-Fi(t)1-δiηi-Fi(t)δi+Ci(t)1-δiϵidDN(t)dt=N(t)δNdDCi(t)dt=Ci(t)δidDFi(t)dt=Fi(t)δi, 1

where γ=γl+γm+γh is the overall transition rate from the status of never smoker to the status of current smoker. The initial conditions of the system, i.e. the sizes of the compartments at time 0, set to the 1st of January 1993, are N(0)=n0, DN(0)=0, Fi(0)=f0i, Ci(0)=c0i and DCi(0)=DFi(0)=0 i{l,m,h}, where n0 is the number of never smokers in the considered population on the first day of the study period, and f0i and c0i are the number of ex-smokers and current smokers with smoking intensity i.

Fig. 1.

Fig. 1

Smoking Habits Compartmental model in its simplest form

For computational reasons, it is convenient to discretise the system of differential equations in Eq. (1), assuming that the size of the compartments is constant during 1-year time steps. Hereafter, t will denote discrete time, with the year as a time-unit (t{1,...,T}), and we replace the system in Eq. (1) with a system of difference equations, where the annual probability of stopping smoking (ϵi), and the annual probabilities of smoking relapse (ηi) are derived from the corresponding rates in Eq. (1), as well as the annual probabilities of death for never (δN), current (δCi), and former (δFi) smokers. In particular, δN=1-exp(-δN), and ϵi=1-exp(-ϵi), ηi=1-exp(-ηi), δCi=1-exp(-δi), δFi=1-exp(-δi) with i{l,m,h}. Regarding the probabilities of starting smoking for never smokers, the overall annual probability γ comes from the corresponding rate, γ=1-exp(-γ), while γi=πCiγ, where π=(πCl,πCm,πCh) is the distribution of the level of smoking intensity among the new current smokers. Notice that, if λ is the rate of occurrence of an event, the probability of experiencing at least one event in the time unit is 1-exp(-λ). The resulting system of discretised equations for each i{l,m,h} and t{1,...,T} is:

N(t)=N(t-1)1-δN1-γ+ν(t)Ci(t)=Ci(t-1)1-δCi1-ϵi+N(t-1)1-δNγi+Fi(t-1)1-δFiηiFi(t)=Fi(t-1)1-δFi1-ηi+Ci(t-1)1-δCiϵiDN(t)=DN(t-1)+N(t-1)δNDCi(t)=DCi(t-1)+Ci(t-1)δCiDFi(t)=DFi(t-1)+Fi(t-1)δFi, 2

where ν(t) denotes the newborns in the year t. The initial conditions of the system coincide with those of the previous model in Eq. (1).

The SHC model extends the system in Eq. (2) to account for two additional discrete time axes: age and time since smoking cessation. The final model is a compartmental model with separate compartments for each discrete age (a), where also a stratification by years since smoking cessation (c) is introduced for former smokers. Two separate SHC models are specified by sex. The final SHC model is defined by the following system of equations for each i{l,m,h} and t{1,...,T}:

N(t;a)=ν(t)ifa=0N(t;a)=N(t-1;a-1)1-δN(a-1)1-γ(a-1)ifa>0Ci(t;a)=0ifa=0Ci(t;a)=Ci(t-1;a-1)1-δCi(a-1)1-ϵ(a-1)+N(t-1;a-1)1-δN(a-1)πCiγ(a-1)+c>0Fi(t-1;a-1,c-1)1-δFi(a-1,c-1)η(c-1)ifa>0Fi(t;a,c)=0ifa=0,c0Fi(t;a,c)=Ci(t-1;a-1)1-δCi(a-1)ϵ(a-1)ifa>0,c=0Fi(t;a,c)=Fi(t-1;a-1,c-1)1-δFi(a-1,c-1)1-η(c-1)ifa>0,c>0DN(t;a)=0ifa=0DN(t;a)=DN(t-1;a)+N(t-1;a-1)δN(a-1)ifa>0DCi(t;a)=0ifa=0DCi(t;a)=DCi(t-1;a)+Ci(t-1;a-1)δCi(a-1)ifa>0DFi(t;a,c)=0ifa=0,c0DFi(t;a,c)=0ifa>0,c=0DFi(t;a,c)=DFi(t-1;a,c)+Fi(t-1;a-1,c-1)δFi(a-1,c-1)ifa>0,c>0. 3

The initial conditions of the system are obtained by generalizing those of the model in Eq. (2), to take into account the stratification by age for current smokers, and the stratification by age and time since cessation for former smokers.

For simplicity, ν(t) was assumed to be constant over time. The age a takes values from 0 to 100. We set γ(a) to 0 until 13 and from 35 years of age, and, in order to account for the possible non-linearity between 14 and 34, we modelled the logit transformation of γ(a) through a natural cubic regression spline of age, with 2 equidistant internal knots. Similarly, we set ϵ(a) to 0 until 19 years of age; we introduced a natural cubic regression spline with 2 equidistant internal knots to model non-linearity for a20. The resulting functions are the following:

γ(a)=00a13a35exp(s(a;ψ))1+exp(s(a;ψ))14a34ϵ(a)=00a19exp(s(a;ϕ))1+exp(s(a;ϕ))a20,

where ψ=(ψ0,ψ1,ψ2,ψ3) and ϕ=(ϕ0,ϕ1,ϕ2,ϕ3) are vectors of unknown parameters governing the probabilities of starting and quitting smoking, respectively. The relapsing rate, η(c), was modelled as a negative exponential function of the time since cessation, with parameters ω=(ω0,ω1):

η(c)=0c=0ω0ω1exp(-ω1c)1c15ω0ω1exp(-ω115)c16,

where ω0 governs the lifetime probability of no relapse and ω1 tunes how fast the rate of smoking relapse declines with the time from cessation [12, 23, 28, 33]. Both ω0 and ω1 are assumed to be positive so that η(c) is a positive, decreasing function of c. The assumptions on which the SHC model is based are summarized in Section Model assumptions, Supplemental Material.

Estimation strategy

An important issue in compartmental models concerns parameter identifiability [30]. Complex models with many compartments, such as the model in Eq. (3), have many parameters governing the admitted transitions, but unfortunately observed data are often insufficient to estimate all of them. To overcome this problem we fixed some of the parameters to values from the literature or external data, leaving as unknown the mortality risks and the spline coefficients ϕ and ψ, and ω. Regarding the initial size of the compartments, it was obtained by combining the population size at the beginning of the study period with estimated prevalences arising from the ISTAT AVQ and EHIS surveys. Details on the values assigned to the fixed parameters and the initial size of the compartments are provided in Section S2, Supplemental Material. The unknown parameters have been estimated following the two step-procedure described in the next section.

Two-step estimation

In order to estimate the unknown parameters, we adopted a two-step procedure. Both steps use as observed data the prevalence of never, current and former smokers from ISTAT AVQ, here denoted by pobs(t;a)=pCobs(t;a),pNobs(t;a),pFobs(t;a), where t denotes the year and a the age class. In particular, we considered years from 1993 to 2019 and age classes a{14-17,18-19,20-24,25-34,35-44,45-54,55-59,60-64,65-74,75+}. According to the ISTAT AVQ survey, current smokers are defined as individuals who reported being smokers at the time of the interview, while former smokers as those who reported having quitted.

First step.

We estimated the age-specific risks of mortality for never smokers δN(a) using the prevalence values, as well as relative risks coming from the literature. In particular, the age-specific risks of dying for current and former smokers in the population at time t are respectively δC(t;a)=RRC×δN(t;a) and δF(t;a)=RRF×δN(t;a), with RRC and RRF the relative risks of dying for current smokers and former smokers versus never smokers. Let p(t;a)=pN(t;a),pC(t;a),pF(t;a) be the distribution of never, current and former smokers in the population. The overall mortality at age a in the year t, δpop(t;a), is a weighted average of δN(t;a), δC(t;a), and δF(t;a) with weights p(ta). Thus, δN(t;a) can be derived as the ratio:

δN(t;a)=δpop(t;a)pN(t;a)+RRCpC(t;a)+RRFpF(t;a). 4

Therefore, separately for each year t in the period 1993-2019, we obtained an estimate of δN(t;a), plugging into Eq. (4) the mortality risk at age a reported for Tuscany, the relative risks for current and former smokers versus never smokers [32], and the observed age-specific prevalence of never, current and former smokers pobs(t;a). Finally, we averaged the year-specific δ^N(t;a) over t, obtaining the overall estimate δ^N(a). The risks of dying for current and former smokers by i and c were then derived as:

δ^Ci(a)=RRCi×δ^N(a)δ^Fi(a,c)=RRFi(c)×δ^N(a).
Second step.

After fixing the mortality risks to the values computed at the first step, δ^(a,c), we calibrated the model on the observed prevalence pobs(t;a) to estimate the vector of parameters which were still unknown, θ=(ψ,ϕ,ω). Let p(t;a,θ)=pC(t;a,θ),pN(t;a,θ),pF(t;a,θ) be the vector of the prevalence of never, current and former smokers belonging to the class of age a at time t, calculated on the population predicted by the model in Eq. (3), given a specific value of θ. With calibration, we searched for the value of θ that leads to predicted prevalences as close as possible to the observed ones. To compare observed and simulated trajectories, we considered the following objective function, where H(·,·) denotes the Hellinger distance [34] between two discrete probability distributions:

Obj(θ)=1T×At,aHp(t;a,θ),pobs(t;a)=1T×A×2t,ak{C,N,F}pk(t;a,θ)-pkobs(t;a)2, 5

where A is the number of age classes a. We minimized the objective function in Eq. (5) over θ via a global optimization procedure, resorting to the JULIA package Optim.jl [35]. It is well-known that, in the context of compartmental models, optimization results often depend on the chosen starting points of the algorithm [36, 37]. To avoid the problem of getting stuck in local minima, we performed several optimizations using different starting points, then we selected the solution that brought to the minimum Hellinger distance [30, 36]. The two-step procedure was performed separately by sex, obtaining different estimates for males and females and sex-specific evolution of the compartment sizes. We estimated the compartment sizes up to 2043 by projecting the model dynamics, assuming that parameters and model structure do not change after 2019.

Parametric bootstrap procedure

We quantified the sampling variability around point estimates and projections by using a parametric bootstrap procedure [29, 30]. Let θ^ be the vector of parameters minimizing the objective function in Eq. (5) and p(t;a,θ^) the corresponding estimated vector of prevalence for never, current and former smokers of age a in the population at time t. Let n(t;a) be the number of subjects belonging to the age class a, enrolled in the ISTAT AVQ in the year t in Tuscany (i.e. the denominator of the observed prevalence pobs(t;a)). The bootstrap procedure consisted of the following steps:

  1. for each a and t, we sampled a vector of prevalence from a Dirichlet distribution:
    pb(t;a)DirichletpC(t;a,θ^)n(t;a),pN(t;a,θ^)n(t;a),pF(t;a,θ^)n(t;a); 6
  2. we considered the collection of these sampled vectors as the observed values and performed the two-step estimation, computing the vector δb(a,c) and finding θb that minimized the objective function;

  3. we repeated the previous two steps B=1000 times, collecting a sample of B bootstrap estimates of δ(a,c) and θ to be used to estimate as many curves describing the transition parameters and compartment size trajectories;

  4. we calculated the 90% confidence intervals for the quantities of interest as the 5th and 95th percentiles of the bootstrap estimates; pointwise confidence intervals were calculated for the curves.

Model validation

In order to evaluate the predictive performance of the estimation procedure described in Estimation strategy section, we applied cross-validation (CV) on a rolling basis. We started defining the first 3 years of the period 1993-2019 as the training set, and the subsequent q years as the test set. Then, we calibrated the compartmental model in Eq. (3) on the training set and used the estimated model to forecast the prevalence of never, current and former smokers in the years belonging to the test time window. The discrepancy between observed and projected prevalence was evaluated in terms of absolute percentage error. Then, we progressively extended the length of the training set by adding one year at a time, and we obtained the projections for the q subsequent years every time. We stopped when the last training set considered the years between 1993 to 2019-q. We finally computed the Mean Absolute Percentage Error (MAPE), by averaging the absolute percentage errors across different types of smokers over time, age classes, and training sets. Note that in general, for a set of n observations, MAPE is defined as 100ni=1n|Oi-Ei|Oi, where Oi is the observed value and Ei is the expected one for unit i. We calculated the MAPE for different forecasting horizons by setting q=3,6,9,12 years.

Sensitivity analysis

A key assumption of our model is that the dynamics of the studied phenomenon, particularly the transition probabilities between compartments, remain constant from 1993 to 2019 (and continue to do so until 2043). To verify its appropriateness, we conducted two separate analyses, first calibrating the model on the period 1993-2004 and then on the period 2005-2019, and compared the results. Notice that in the analysis 2005-2019 the initial sizes of the compartments were set to values obtained from 2005 surveys (see Section Details on the fixed parameters, Supplemental Material).

Another crucial point concerns the fact that the inference results could be affected by the model parameters assumed as fixed. To address this issue, we utilized a variance-based approach to Global Sensitivity Analysis (GSA) [31]. Given KX mutually independent inputs (X1,X2,...,XKX) and a model which, given the inputs, returns KY outputs (Y1,Y2,...,YKY), this approach quantifies the relative importance of each input to the model’s outcomes by propagating uncertainty from the inputs to the outputs and computing variance indices. In our application, given the model in Eq. (3), we considered as inputs all the parameters, both fixed and unknown, and the Hellinger distance in Eq. (5) as the output Y. Note that, considering the Hellinger distance as the output, we directly measure the influence of the inputs on the discrepancy between observed and predicted data, thus, ultimately, on the inference results. Then we calculated, for each input Xi, the so-called total variance index, which Sitot measures the overall effect of the i-th input on the output Y, including all the interactions of Xi with the other inputs. This index corresponds to the expected variance of Y that would be left on average when all the parameters but Xi, Xi, are fixed:

Sitot=EXi(VarXi(Y|Xi))Var(Y).

A total variance index close to zero indicates that the parameter Xi does not influence Y, and therefore, the inference results. Conversely, a large total variance index indicates that the parameter does have an impact on them. In the former case, the parameter can be fixed without affecting our estimates, or in other words, our model and data do not provide information on this parameter. The computation of Sitot relies on Monte Carlo simulations [38]. We simulated K=10,000 different combinations of the model inputs, then, for each of them, we predicted the prevalence values via the model in Eq. (3) and calculated the corresponding Hellinger distance. Specifically, we draw the model parameters from the distributions reported in Table S3.1, Supplemental Material, adopting a quasi-random numbers sampling which provides a more efficient exploration of the sample space [39, 40]. On the basis of the simulated Hellinger distance and the combination of the parameters, we computed the total variance indices as described in [38]. It is worth noting that in the GSA we did not include the age-specific mortality rates, δpop(t;a), among the model inputs. It is reasonable, as done elsewhere [23], to treat these parameters as not affected by uncertainty, given that they were estimated based on the entire population.

Health impact assessment

The impact of smoking on population health was quantified in terms of attributable deaths. We calculated the Smoking-Attributable Deaths (SADs) in the year t as the difference between the number of deaths occurring in that year under the actual scenario, i.e. the number of deaths predicted by the model in Eq. (3) given θ^ and δ^(a), and the deaths we would observe under a specific counterfactual condition. We considered the counterfactual condition where current smokers and former smokers in the year t were never smokers. Therefore, for each age a, we applied to the size of the compartments of smokers or ex-smokers the excess risk relative to never-smokers. The excess risk is defined as the difference between risks. For example, the excess risk of current smokers of age a and smoking intensity i relative to never-smokers is δCi(a,c)-δN(a). Thus, for the year t, the number of SADs among people of age a was calculated as:

SAD(t;a)=iCi(t,a;θ^)(δ^Ci(a)-δ^N(a))+icFi(t,a,c;θ^)(δ^Fi(a,c)-δ^N(a)).

The age-specific SAD(t;a) can be summed over a to obtain the total number of attributable deaths in population or in a certain class of age: SAD(t)=aSAD(t;a). The impact of smoking on population health can be expressed also in terms of Population Attributable Fraction (PAF), defined as the proportion of deaths that would be avoided if all current and former smokers in the population or in a subset of it were never smokers [41]. For details, see Section Population Attributable Fraction computation, Supplemental Material. We calculated SADs and PAFs over the period 1993-2043, separately by sex and for the ages 35+ and 65+.

Impact of future hypothetical policies

In order to illustrate the use of the compartmental model to assess the impact of hypothetical TCPs on SAD, we focused on three policies acting on the rates of starting and stopping smoking, γ(a) and ϵ(a). We assumed that all the defined policies are implemented in 2023 and that, in the absence of policies, the smoking habit dynamics would not change.

Taking inspiration from [42], and from a recent policy introduced in New Zealand (www.bbc.com/news/world-asia-63954862) we defined the following hypothetical TCPs starting from 2023:

  • TCP1, a policy able to reduce the rate of starting smoking by 25% in 10 years for subjects between 14 and 34 years of age; for simplicity, we assumed a linear decrease, starting with a decrease of 2.5% the first year, a decrease of 5% the second one and so on, up to a final decrease of 25% after 10 years;

  • TCP2, a policy able to increase the rate of stopping smoking by 25% in 10 years for subjects between 25 and 100 years of age; for simplicity, we assumed a linear growth, starting with an increase of 2.5% the first year, an increase of 5% the second one and so on, up to a final increase of 25% after 10 years;

  • TCP3, a policy that imposes a complete smoking ban on cohorts born since 2009.

For each policy, we calculated the evolution of smoking prevalence and the number of avoided deaths expected from its implementation, taking the scenario without policies as a reference (TCP0). To better appreciate the impact of policies in terms of SAD, limited to this analysis, we extended the projections up to 2063.

Results

The Tuscany population in 1993 counted 1,697,495 million males and 1,824,090 million females, and the proportions of never, current, and former smokers estimated from the ISTAT AVQ survey were respectively 35%, 34%, 31% for males and 67%, 20%, 13% for females.

Figure 2, Panel (a) and (b) show, separately for males and females, the estimates of the parameters left unknown in the SHC model in Eq. (3), with their 90% confidence intervals (CI), as obtained from the two-step estimation procedure and bootstrap. In particular, Panel (b) compares the estimated risk of death for never smokers with the one in the general population. It is worth noting that while the two risks are similar for females (the mortality among never-smokers is 8% lower than among the general population), a not negligible difference is observed for males (25% lower) as noted also in [43].

Fig. 2.

Fig. 2

Results of the two-step estimation procedure for males in blue and females in red, with their bootstrap 90% confidence intervals: parameters tuning the probabilities of starting (ψ) and stopping smoking (ϕ), and the probability of smoking relapse (ω) (a), age-specific mortality for never smokers and for the general population (b), probabilities of starting (γ(a)), and stopping smoking ( ϵ(a)) and probability of smoking relapse (η(c)) (c), observed and predicted prevalence for never (N), current (C) and former (F) smokers (d), Population Attributable Fraction (PAF) and Smoking Attributable Deaths (SAD) for people over the age of 35 (e) and 65 (f)

Figure 2, Panel (c) shows the estimates of the probabilities of starting and quitting smoking and the probability of smoking relapse, derived from the estimated coefficients in Panel (a). Table 1 reports some summaries of the curves. Males are more likely to start and quit smoking than females. In particular, the probability of starting smoking has a peak around 19.9 years of age for males and 19.1 for females, with a maximum of just over 9% for males and just over 6% for females. The mean age of initiation is 20.7 for males and 20.5 for females. The probability of stopping smoking increases after 50 years of age, reaching a maximum of 29.5% for males and a maximum of 24.0% for females. The probability of smoking relapse is affected by large sampling variability. However, our results seem to indicate that it is about 80% after 1 year, then declines to about 40% after two years and progressively becomes negligible after 3 years (Fig. 2). On average, former smokers relapse into smoking after 1.7–1.5 years, for males and females respectively (Table 1).

Table 1.

Summaries with 90% confidence intervals of the probabilities of starting and stopping smoking, and of the probability of smoking relapse, for males and females

Smoking event Sex Maximum probability Age at maximum Mean probability Mean time at the event
Starting smoking Male 0.09 (0.08 - 0.11) 19.9 (19.5 - 20.3) 0.04 (0.03 - 0.05) 20.7a (19.9 - 21.6)
Female 0.06 (0.05 - 0.08) 19.1 (18.6 - 19.9) 0.03 (0.02 - 0.04) 20.5a (19.4 - 21.6)
Stopping smoking Male 0.29 (0.19 - 0.62) 79.6 (70.3 - 100.0) 0.19 (0.10 - 0.30) 66.5a (58.2 - 72.5)
Female 0.24 (0.14 - 0.97) 20.1 (20.6 - 100.0) 0.10 (0.05 - 0.34) 57.2a (52.2 - 74.9)
Relapsing smoking Male 0.76 (0.63 - 0.79) - 0.04 (0.03 - 0.05) 1.7b (1.6 - 2.1)
Female 0.69 (0.34 - 0.83) - 0.02 (0.01 - 0.06) 1.5b (1.4 - 2.3)

aMean age of starting and stopping smoking

bMean number of years from smoking cessation to relapse

Panel (d) shows the estimated prevalence of never, current, and former smokers among those over 14 years old from 1993 to 2043, predicted through the SHC model, together with the observed data used to calibrate the model (blue and red dots respectively for males and females with their 90% CI). The model fit appears to be adequate, with the predicted values close to the observed ones. Our forecasts, starting from 2020, suggest that the smoking prevalence will decrease in the coming years. Panels (e) and (f) show the predicted SAD and PAF over the period 1993-2043, separately for males and females, calculated for the population over 35 years of age and for the population over 65 years of age. The impact on males is higher than on females both in absolute and relative terms. However, while a clear reduction of the attributable deaths is expected in the coming years for males, for females they slightly decline only after having reached a maximum around 2030 [44]. Note that the majority of attributable deaths in the population over 35 are due to deaths in individuals over 65, as shown by the similarity of the curves.

Tables 2 and 3 report the percentages of never, current, and former smokers, the SAD and PAF, estimated every 10 years from 1993 to 2043, with their 90% confidence intervals. As an example, we estimated that in Tuscany in 2023 smoking was responsible for 4,070 (90% CI:3,795-4,247) deaths among men over 35 years old (one death per 745 people over the age of 35) and 1,976 (90% CI:1,741-2,407) deaths among women in the same age class (one death per 1655 people over the age of 35), corresponding to a PAF of 18% and 8%, respectively. Most of the attributable burden, however, was on people older than 65 (3,497 SAD for men and 1,765 for women).

Table 2.

Estimated prevalence (%) of never, current, and former smokers in the population with 90% confidence intervals, evaluated every 10 years from 1993 to 2043, for males and females

Never Current Former
Year Male Female Male Female Male Female
1993 35.7 (33.6 - 37.4) 66.9 (65.2 - 68.8) 33.7 (31.9 - 35.4) 20.3 (19.0 - 21.8) 30.5 (28.3 - 33.1) 12.8 (11.4 - 14.1)
2003 36.5 (35.0 - 37.9) 63.4 (61.9 - 64.9) 28.7 (27.9 - 29.2) 19.4 (18.5 - 20.0) 34.8 (34.0 - 36.3) 17.2 (16.4 - 18.4)
2013 39.2 (38.1 - 40.6) 60.8 (59.5 - 62.0) 25.1 (24.1 - 25.5) 17.8 (17.2 - 18.6) 35.7 (34.8 - 37.0) 21.4 (20.4 - 22.2)
2023 42.2 (41.2 - 43.8) 59.1 (58.0 - 60.3) 22.9 (21.5 - 23.3) 16.5 (15.7 - 17.6) 34.9 (33.8 - 36.1) 24.5 (23.1 - 25.4)
2033 45.1 (44.0 - 47.1) 59.2 (58.0 - 60.8) 21.8 (20.0 - 22.3) 15.3 (14.5 - 16.7) 33.2 (32.0 - 34.3) 25.5 (23.7 - 26.4)
2043 47.4 (46.0 - 49.9) 60.3 (58.9 - 62.4) 21.6 (19.6 - 22.4) 14.8 (13.8 - 16.1) 31.0 (29.6 - 32.4) 25.0 (23.0 - 25.8)

Table 3.

Estimated number of Smoking Attributable Deaths (SAD), Population Attributable Fraction (PAF) (%), and the ratio between overall age-specific population size and sex and age-specific SAD in the years 1993, 2003, 2013, 2023, 2033, 2043, 2053 and 2063, with 90% confidence intervals, among males and females aged over 35 and over 65

SAD (90% CI) PAF (90% CI) Pop/SAD (90% CI)
Age Year Male Female Male Female Male Female
35+ 1993 3,768 (3,390 - 4,273) 783 (625 - 965) 25.0 (23.0 - 27.4) 4.9 (3.9 - 6.0) 789 (695 - 877) 4,388 (3,558 - 5,499)
2003 4,187 (3,948 - 4,403) 1,127 (985 - 1,312) 21.7 (20.4 - 22.8) 5.4 (4.7 - 6.2) 768 (728 - 816) 3,211 (2,756 - 3,674)
2013 4,331 (4,076 - 4,498) 1,581 (1,402 - 1,877) 19.5 (18.4 - 20.2) 6.6 (5.9 - 7.8) 759 (730 - 808) 2,280 (1,916 - 2,574)
2023 4,070 (3,795 - 4,247) 1,976 (1,741 - 2,407) 17.6 (16.4 - 18.3) 7.9 (7.0 - 9.6) 745 (713 - 801) 1,655 (1,353 - 1,884)
2033 3,597 (3,316 - 3,749) 2,043 (1,873 - 2,496) 15.7 (14.5 - 16.4) 8.6 (7.8 - 10.4) 763 (731 - 831) 1,428 (1,164 - 1,564)
2043 3,007 (2,746 - 3,153) 1,780 (1,628 - 2,341) 13.3 (12.1 - 14.0) 7.7 (7.0 - 10.1) 828 (788 - 910) 1,470 (1,111 - 1,610)
65+ 1993 2,920 (2,555 - 3,445) 525 (369 - 704) 23.0 (20.7 - 26.0) 3.6 (2.5 - 4.8) 330 (280 - 378) 2,552 (1,903 - 3,635)
2003 3,371 (3,128 - 3,592) 823 (672 - 1,017) 20.0 (18.6 - 21.2) 4.2 (3.4 - 5.1) 337 (315 - 366) 1,820 (1,470 - 2,232)
2013 3,657 (3,423 - 3,811) 1,338 (1,164 - 1,589) 18.3 (17.1 - 19.1) 5.9 (5.2 - 7.0) 336 (322 - 360) 1,166 (977 - 1,341)
2023 3,497 (3,239 - 3,663) 1,765 (1,532 - 2,165) 16.5 (15.5 - 17.4) 7.5 (6.5 - 9.1) 351 (334 - 381) 855 (692 - 991)
2033 3,158 (2,887 - 3,319) 1,910 (1,743 - 2,356) 14.9 (13.7 - 15.7) 8.3 (7.6 - 10.2) 415 (394 - 458) 801 (644 - 881)
2043 2,674 (2,439 - 2,829) 1,680 (1,541 - 2,233) 12.5 (11.4 - 13.3) 6.9 (6.9 - 9.9) 483 (455 - 533) 870 (647 - 951)

Regarding the CV procedure, the average values of MAPE for different prediction horizons are lower than 30% (Table 4), indicating that the predictive performance of the model is adequate, even if not optimal [45]. The MAPE is lower for the model on the male population than for the model on the female one.

Table 4.

Cross-validation results: Mean Absolute Percentage Error (MAPE) calculated on four time horizons for the model on males and the model on females

Horizon Male Female
3 years 23.7 28.7
6 years 23.7 29.1
9 years 23.9 29.4
12 years 24.2 30.0

Figure 3 reports the results of the two separate calibrations of the SHC model, one on the prevalence data from 1993 to 2004 and one on the prevalence data from 2005 to 2019. The confidence bands are wider in the second period of calibration than in the first one. For males, there is evidence of a downward shift of age corresponding to the maximum probability of starting smoking. For females, calibrating the model in the first years brought a lower projection of the prevalence of never smokers, which likely reflects a change over time in the smoking habits among women. Apart from these differences, the two calibrations provided qualitatively similar results. For numerical details see Tables S5.1-S5.6, Supplemental Material and Figures S5.1 and S5.2, Supplemental Material.

Fig. 3.

Fig. 3

Results of the two-step estimation procedure for males in blue and females in red, by period of calibration (from 1993 to 2004 in a light colour and from 2005 to 2019 in a dark colour): probabilities of starting (γ(a)) and stopping smoking (ϵ(a)), and probability of smoking relapse (η(c)), with 90% confidence bands, (a) and (c); prevalence of never (N), current (C) and former (F) smokers, with 90% confidence bands, (b) and (d)

The total variance indices derived from the GSA (Table 5) reveal that the primary factor contributing to the variability of the Hellinger distance is the probability of starting smoking and its interaction with the other model inputs, resulting in Sitot values of 0.58 for males and 0.76 for females. This is followed by the probability of quitting smoking, with values of 0.36 for males and 0.21 for females, and by the probability of smoking relapse, with values of 0.15 for males and 0.09 for females. Conversely, the parameters assumed to be fixed have a negligible impact on the Hellinger distance, with total variance indices very close to 0. This latter result indicates that fixing the aforementioned parameters to specific values does not significantly affect the calibration results, and consequently the prevalence estimates, demonstrating their robustness against variations in π, ν, and RRs specifications.

Table 5.

Total variance indices quantifying the contribution of each input on the Hellinger distance, calculated for the model on males and the model on females

Input Male Female
ψ 0.58 0.76
ϕ 0.36 0.21
ω 0.15 0.09
π <0.01 <0.01
ν <0.01 <0.01
RRs <0.01 <0.01

Figure 4 compares the evolution of smoking habits in the male and female populations under three alternative scenarios that simulate hypothetical tobacco control policies. These scenarios are compared with the status quo, corresponding to the absence of actions to reduce tobacco consumption (TCP0). We assumed that the TCPs are applied since 2023. They have no substantial effect on the prevalence of never, former, and current smokers during the 10 years following their implementation. TCP3 has the largest impact: in 2043 it is expected to increase by 12 percentage points the prevalence of never-smokers among males and by 8 among females, compared with TCP0 (see Table 6).

Fig. 4.

Fig. 4

Estimated prevalence of never (N), current (C) and former (F) smokers under different tobacco control policies (TCP) with 90% confidence bands, for males (a) and females (b)

Table 6.

Estimated prevalence (%) of never, current, and former smokers in the population under different tobacco control policies (TCP) evaluated in 2023, 2033 and 2043, with 90% confidence intervals, for males and females

Male Female
Status Year TCP0 TCP1 TCP2 TCP3 TCP0 TCP1 TCP2 TCP3
Never 2023 42.1 (41.2 - 43.8) 42.2 (41.2 - 43.8) 42.2 (41.2 - 43.8) 42.2 (41.2 - 43.8) 59.1 (58.0 - 60.3) 59.1 (58.0 - 60.3) 59.1 (58.0 - 60.3) 59.1 (58.0 - 60.3)
2033 45.1 (44.0 - 47.1) 45.2 (44.9 - 48.0) 45.1 (44.0 - 47.1) 48.9 (47.8 - 50.8) 59.2 (58.0 - 60.8) 59.8 (58.6 - 61.4) 59.2 (58.0 - 60.8) 61.9 (60.6 - 63.4)
2043 47.4 (46.0 - 49.9) 49.7 (48.3 - 52.0) 47.3 (45.9 - 49.8) 58.7 (57.4 - 60.5) 60.3 (58.9 - 62.4) 62.0 (60.7 - 64.0) 60.3 (58.9 - 62.4) 67.9 (66.5 - 69.5)
Current 2023 22.9 (21.5 - 23.3) 22.9 (21.5 - 23.3) 22.9 (21.4 - 23.3) 22.9 (21.5 - 23.3) 16.5 (15.7 - 17.6) 16.4 (15.7 - 17.6) 16.4 (15.6 - 17.5) 16.4 (15.7 - 17.6)
2033 21.8 (20.0 - 22.3) 21.0 (19.2 - 21.5) 20.3 (18.6 - 20.8) 18.4 (16.8 - 19.0) 15.3 (14.5 - 16.7) 14.8 (13.9 - 16.1) 14.3 (13.4 - 15.3) 13.0 (12.2 - 14.4)
2043 21.6 (19.6 - 22.4) 19.8 (17.9 - 20.5) 19.3 (17.4 - 20.0) 12.9 (11.4 - 13.5) 14.8 (13.8 - 16.1) 13.5 (12.7 - 14.8) 13.1 (12.2 - 14.4) 9.4 (8.6 - 10.7)
Former 2023 34.9 (33.8 - 36.1) 34.9 (33.8 - 36.1) 35.0 (33.9 - 36.2) 34.9 (33.8 - 36.1) 24.5 (23.1 - 25.4) 24.5 (23.1 - 25.4) 24.5 (23.1 - 25.5) 24.5 (23.1 - 25.4)
2033 33.1 (32.0 - 34.3) 33.0 (31.9 - 34.1) 34.7 (33.4 - 35.8) 32.6 (31.5 - 33.8) 25.5 (23.7 - 26.3) 25.4 (23.6 - 26.2) 26.5 (24.5 - 27.4) 25.0 (23.3 - 25.9)
2043 31.0 (29.6 - 32.4) 30.5 (29.0 - 31.9) 33.4 (31.8 - 34.8) 28.4 (27.0 - 29.8) 24.9 (22.9 - 25.9) 24.4 (22.4 - 25.3) 26.7 (24.6 - 27.6) 22.7 (20.6 - 23.4)

In order to better appreciate the impact of the TCPs on mortality, we extended the forecasting horizon up to 2063. Table 7 reports the predicted number of attributable deaths every 10 years, from 2023 to 2063, for both males and females under different TCPs, for the classes of age 35+ and 65+. TCP2, which increases the probability of stopping smoking, is the policy that most impact mortality in both classes of age. TCP3, which bans access to smoking to the new generations, despite its effectiveness in reducing current smokers, does not reduce SADs within the time window considered. Indeed, this policy is expected to have a longer-term impact, which is not visible before 2063. Additional Tables and Figures are reported in Section Additional results, Supplemental Material.

Table 7.

Expected number of Smoking Attributable Deaths (SAD) under different tobacco control policies (TCP), in the years 2023, 2033, 2043, 2053 and 2063, with 90% confidence intervals, among males and females aged over 35 and over 65

Male Female
Age Year TCP0 TCP1 TCP2 TCP3 TCP0 TCP1 TCP2 TCP3
35+ 2023 4,070 (3,975 - 4,247) 4,070 (3,975 - 4,247) 4,070 (3,975 - 4,247) 4,070 (3,975 - 4,247) 1,976 (1,741 - 2,407) 1,976 (1,741 - 2,407) 1,976 (1,741 - 2,407) 1,976 (1,741 - 2,407)
2033 3,597 (3,316 - 3,749) 3,597 (3,315 - 3,749) 3,547 (3,263 - 3,702) 3,597 (3,316 - 3,749) 2,043 (1,873 - 2,496) 2,043 (1,873 - 2,496) 2,010 (1,841 - 2,460) 2,043 (1,873 - 2,496)
2043 3,007 (2,746 - 3,153) 3,005 (2,774 - 3,151) 2,843 (2,578 - 2,986) 3,007 (2,746 - 3,153) 1,780 (1,628 - 2,341) 1,779 (1,627 - 2,340) 1,672 (1,524 - 2,243) 1,780 (1,628 - 2,341)
2053 2,401 (2,171 - 2,505) 2,389 (2,159 - 2,490) 2,182 (1,958 - 2,291) 2,352 (2,126 - 2,454) 1,432 (1,313 - 1,868) 1,427 (1,309 - 1,865) 1,295 (1,179 - 1,740) 1,418 (1,299 - 1,853)
2063 1,889 (1,663 - 1,972) 1,855 (1,633 - 1,937) 1,664 (1,447 - 1,746) 1,739 (1,533 - 1,819) 982 (870 - 1,235) 969 (855 - 1,224) 855 (749 - 1,115) 936 (824 - 1,185)
65+ 2023 3,497 (3,239 - 3,663) 3,497 (3,239 - 3,663) 3,497 (3,239 - 3,663) 3,497 (3,239 - 3,663) 1,765 (1,532 - 2,165) 1,765 (1,532 - 2,165) 1,765 (1,532 - 2,165) 1,765 (1,532 - 2,165)
2033 3,158 (2,887 - 3,319) 3,158 (2,887 - 3,319) 3,114 (2,846 - 3,279) 3,158 (2,887 - 3,319) 1,910 (1,743 - 2,356) 1,910 (1,743 - 2,356) 1,879 (1,710 - 2,322) 1,910 (1,743 - 2,356)
2043 2,674 (2,439 - 2,829) 2,674 (2,439 - 2,829) 2,529 (2,299 - 2,691) 2,674 (2,439 - 2,829) 1,680 (1,541 - 2,233) 1,680 (1,541 - 2,233) 1,578 (1,441 - 2,140) 1,680 (1,541 - 2,233)
2053 2,073 (1,874 - 2,174) 2,073 (1,874 - 2,174) 1,885 (1,696 - 1,993) 2,073 (1,874 - 2,174) 1,334 (1,219 - 1,760) 1,334 (1,219 - 1,760) 1,207 (1,089 - 1,641) 1,334 (1,219 - 1,760)
2063 1,550 (1,361 - 1,626) 1,548 (1,360 - 1,625) 1,368 (1,189 - 1,440) 1,550 (1,361 - 1,626) 881 (774 - 1,123) 879 (773 - 1,123) 768 (671 - 1,016) 881 (774 - 1,123)

Discussion

Interesting findings emerged from our analysis. We found that the probability of starting smoking reaches its maximum, just over 9% for males and just over 6% for females, between 19 and 20 years of age. Considering that younger people have a large probability of becoming stable smokers [46], these probabilities are quite worrying. The difference in the mean age of initiation between males and females is lower than one year, confirming what is reported for high-income countries [47]. Regarding the probability of stopping smoking, we found that it increases after 50 years of age and has a maximum of 29.5% for males and 24.0% for females, even if the confidence bands around these curves are quite wide. The 80% of ex-smokers relapse into smoking after 1 year, in line with the results of the Italian surveillance system PASSI for the years 2020-2021 (www.epicentro.iss.it/passi/dati/SmettereFumo). On average, former smokers relapse into smoking during the second year from cessation (after 1.7 and 1.5 years for males and females, respectively).

According to our model, in 2023 in Tuscany, 23% of men smoke, while 35% are ex-smokers. These percentages are lower among women: 16% smoke and 24% are ex-smokers. The prevalence of smokers estimated by our model is lower than the one reported in the PASSI survey for the period 2020-2021 (26.1% and 20.5% in the age class 18-69 for males and females, respectively), but consistent if we consider that our estimates are calculated on all population, while PASSI focuses on the age class 18-69 (www.epicentro.iss.it/passi/pdf2020/Scheda-fumo-PASSI-regione-2016-2019.pdf).

We estimated that, in 2023, 18% of deaths among males and 8% among females are due to smoking, corresponding to 4,070 and 1,976 deaths, respectively. These PAFs are in line with those estimated by the Global Burden of Disease Study for Italy in 2019 (https://vizhub.healthdata.org/gbd-results/), 20.5% (CI: 19.5-21.7) in males and 8.17% (CI: 7.51-9.02) in females, slightly lower than those reported for Italy by the Tobacco Atlas initiative (https://tobaccoatlas.org/challenges/deaths/), and overall coherent with previous results for Italy and Tuscany ([48]; www.deathsfromsmoking.net).

As shown by the cross-validation results, the model produces quite reliable predictions of prevalence. Thus, subject to the assumption that all mechanisms underlying smoking dynamics and demographic evolution do not change in the future, we projected the dynamics. For the next two decades, we estimated an evident decrease in the prevalence of current smokers for males, due to an increase in the percentage of never-smokers. For females, substantial stability is expected. Similar considerations apply to PAFs: a decrease is observed for males and stability for females. These results confirm that Italy is in the fourth stage of the tobacco epidemic model, characterized by a continuing slow decline of smoking prevalence in both men and women with converging rates between sex [49, 50]. The robustness of the long-term predictions to events that could change the described dynamics over time could be assessed by implementing a specific GSA procedure. However, in this work, we used the GSA only to assess the sensitivity of the inference results to changes in the parameters treated as fixed.

The proposed model can be used for assessing the impact of alternative TCPs. For illustrative purposes, we considered the impact of three policies aimed at reducing smoking in the population. The first two policies are completely hypothetical and defined in terms of their effect on the probability of starting (TCP1) and stopping (TCP2) smoking. They are not real policies but represent the intentions of the legislator to change the rates of smoking initiation and cessation. The third one (TCP3), which bans smoking in new cohorts since 2009, is inspired by the tobacco-free generation real intervention implemented in New Zealand as part of a plan for the tobacco endgame, including also additional strategies aimed at decreasing the affordability and availability of smoking, reducing the levels of nicotine in tobacco products, and restricting sales to designated tobacco outlets. We evaluated the expected marginal impact that this tobacco-free generation intervention would have in Tuscany, assuming complete compliance of new generations to the smoking ban. The results indicate that under TCP1 and TCP2 the prevalence of current smokers is reduced by a few percentage points either for women or men. On the contrary, TCP3 produces a clear increase in never-smokers, thus a reduction in smoking prevalence, which is expected to decrease in ten years by 9 and 6 percentage points among males and females, respectively. The impact on mortality of the three policies, in particular TCP1 and TCP3, that act by increasing the number of never smokers, can be appreciated only by extending the time horizon of forecasting. Interventions able to increase the probability of stopping smoking, like TCP2, are expected to produce the largest reduction of SADs in the medium term, especially among the over-65s. However, this kind of policy does not contribute to reducing smoking among the youngest, thus effectively stopping the tobacco epidemic.

From a methodological point of view, we introduced several elements of novelty. First of all, we provided a formal definition of the equations that describe the system dynamics and made explicit assumptions on the distribution of the involved random variables. We also introduced cubic regression splines for modelling in a flexible way the probabilities of starting and quitting smoking as functions of age, thus obtaining more realistic trajectories. Furthermore, we included in the model dependencies from the smoking intensity, which may allow assessing the impact of personalized TCPs specific for heavy or moderate smokers, such as lung cancer screening, use of pharmacological treatment, or smoking cessation campaigns.

Regarding the inference on the unknown parameters, we proposed a two-step estimation strategy to estimate the curves describing the probability of starting and stopping smoking and the probability of smoking relapse, as well as the mortality risk among never, current and former smokers. At the second step of the estimation procedure, we defined the calibration objective function in terms of a Hellinger distance between observed and predicted prevalence, instead of the widely used sum of squares function. The use of this discrepancy measure is relatively new in this framework and allowed handling a bounded loss function, defined in [0, 1], that is simple to minimise and to be interpreted. Finally, we provided confidence intervals/bands for the parameters/curves of interest. To the best of our knowledge, this is the first time that quantification of sampling variability is performed in this field. To this aim, we resorted to a parametric bootstrap procedure defined by adapting to our framework a method proposed for compartmental models describing infectious dynamics [30]. The assumed Dirichlet distribution enabled us to model the prevalence values complying with the constraint that their sum equals one. Furthermore, specifying appropriate values for the concentration parameters of the Dirichlet distributions, we were able to quantify the sampling variability accounting for the sample size of the surveys from which we derived the observed prevalence used in calibration. The estimation procedure has also limitations. We estimated the parameters in a deterministic way, in the sense that we considered the distributional assumptions on the prevalence only in the bootstrap procedure but not in the calibration phase. While likelihood-based approaches are unfeasible in this framework, likelihood-free inference methods such as Approximate Bayesian Computation algorithms would allow a full uncertainty quantification [25].

The reliability of the model’s results depends on several factors. First of all, it depends on the quality of the data used for calibration. In our case, we used data from yearly surveys conducted according to well-established methodology on reasonably large sample sizes. Secondly, it depends on the values of the fixed parameters, and we demonstrated, through the GSA, that the inference was robust to variations of the fixed parameters within plausible ranges of values. Lastly, the reliability of the results depends on the structural assumptions on which the model is based, not assessed via GSA. Underneath, we qualitatively review the main assumptions of the model and discuss the limitations that may arise from them. With respect to demographic dynamics, we assumed that the population was close to immigration and emigration and that the number of new births did not vary during the study period, effectively feeding the model with identical cohorts of subjects each year. For more realistic modelling, we could use the observed yearly number of births to create the new cohorts up to 2019. However, in light of the GSA, we expect that the impact of this choice on the results has not been significant. We also assumed that the age-specific mortality rates did not vary over the study period.

Regarding smoking dynamics, we assumed that the probabilities of starting and stopping smoking were functions of age and that the probability of smoking relapse was a function of time since cessation, but not of age. We did not allow any of these probabilities to vary over time. By defining the transition probabilities in this way, we have made a clear choice about which time axes were most important in our opinion to capture appropriately the smoking dynamics in the population. This choice is not without problems because in some cases there is evidence suggesting otherwise. For example, a decreasing trend in the probability of starting smoking has been reported for both males and females in Europe [51], while evidence of a dependence between age and risk of smoking relapse has been found in the US population [52]. However, if introducing multiple time-axes dependence in the transition probabilities could lead to more realistic results, this would be at the price of further complicating the model by introducing new unknown parameters to be estimated. We partially explored the goodness of the assumption of no calendar time dependence through a simple sensitivity analysis, which confirmed that the probabilities of starting and stopping smoking, and the probability of smoking relapse were quite similar when two separate calibrations were performed on the periods 1993-2004 and 2005-2019. It is worth stressing that, even if these two periods correspond to before and after the introduction of the so-called Sirchia law that banned smoking in all indoor public places in Italy, it was not our goal to speculate about the causal effect of this intervention on smoking dynamics. We also assumed that people could not change their smoke intensity during their entire life, that the probability of stopping and relapsing did not depend on smoking intensity, and, again, that the distribution of smokers by smoking intensity did not change over the study period.

In general, it is important to note that underlying all the simplifications introduced in model specification is the fact that adding details to a compartmental model goes along with the definition of new compartments and new transitions, and without available and reliable data, the model could become non-identifiable producing more uncertain and unstable results [53]. Moreover, microsimulation models or social network models, that explore smoking dynamics from an individual point of view, could be more suitable solutions to introduce detail and complexity, including those related, for example, to the course of disease [54, 55], or to explore the exposure to second-hand smoke that, being related to the social network of the individuals, was not considered in our analysis.

Conclusions

We developed an approach for modelling smoking dynamics in the population that overcomes many of the limitations of previously proposed models. It includes validation tools like cross-validation on a rolling basis and GSA, aimed at checking the robustness of our results and supporting our findings.The model can be generalized and applied to other Italian regions changing the initial conditions of the system. The fact that the surveys we relied on provide information about all regions makes this extension easily feasible. The proposed approach can be straightforwardly applied also to other countries after a careful check of the validity of the model assumptions, which, however, can be mostly adapted to different contexts. Finally, it can be also used to assess the impact of other tobacco control policies on smoking prevalence and mortality, beyond those considered in this paper.

Supplementary Information

Supplementary Material 1. (397.3KB, pdf)

Acknowledgements

We thank Maria Chiara Malevolti for her contribution to data collection and validation, and all ACAB project participants for their support.

Authors’ contributions

A.L. wrote the code and conducted the statistical analysis; A.L., C.V. and M.B. conceptualized the model and wrote the first version of the paper; G.Ce. and G.Ca. provided critical feedback; M.B. supervised the project. All the authors read and approved the final version of the paper.

Funding

The present work is part of the Attributable Cancer Burden in Tuscany (ACAB) project, funded by Regione Toscana under the grant "Bando Ricerca Salute 2018" (www.acab-toscana.it). The funding body played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Availability of data and materials

Data are available on request from the corresponding author.

Code availability

Codes are available on request from the corresponding author.

Declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Alessio Lachi, Email: alessio.lachi@cnr.it.

Michela Baccini, Email: michela.baccini@unifi.it.

References

  • 1.IARC, editor. Tobacco smoke and involuntary smoking: this publication represents the views and expert opinions of an IARC Working Group on the Evaluation of Carcinogenic Risks to Humans, which met in Lyon, 11 - 18 June 2002. No. 83 in IARC monographs on the evaluation of carcinogenic risks to humans. Lyon: IARC; 2004. [PMC free article] [PubMed]
  • 2.Institute of Medicine (U S ), Bonnie RJ, Stratton KR, Wallace RB, editors. Ending the tobacco problem: a blueprint for the nation. Washington, DC: National Academies Press; 2007.
  • 3.IARC, editor. A review of human carcinogens. No. 100 in IARC monographs on the evaluation of carcinogenic risks to humans. Lyon: IARC; 2012.
  • 4.Loring B. Tobacco and inequities: guidance for addressing inequities in tobacco-related harm. Copenhagen: World Health Organization, Regional Office for Europe; 2014. [Google Scholar]
  • 5.GBD 2019 Risk Factors Collaborators. Global burden of 87 risk factors in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396(10258):1223–49. 10.1016/S0140-6736(20)30752-2. [DOI] [PMC free article] [PubMed]
  • 6.World Health Organization . Tobacco control for sustainable development. New Delhi: Regional Office for South-East Asia; 2017. [Google Scholar]
  • 7.Gorini G, Carreras G, Lugo A, Gallus S, Masocco M, Spizzichino L, et al. Electronic cigarette use as an aid to quit smoking: Evidence from PASSI survey, 2014–2021. Prev Med. 2023;166:107391. doi: 10.1016/j.ypmed.2022.107391. [DOI] [PubMed] [Google Scholar]
  • 8.Gorini G, Gallus S, Carreras G, Mei BD, Masocco M, Faggiano F, et al. Prevalence of tobacco smoking and electronic cigarette use among adolescents in Italy: Global Youth Tobacco Surveys (GYTS), 2010, 2014, 2018. Prev Med. 2020;131:105903. doi: 10.1016/j.ypmed.2019.105903. [DOI] [PubMed] [Google Scholar]
  • 9.Cerrai S, Benedetti E, Colasante E, Scalese M, Gorini G, Gallus S, et al. E-cigarette use and conventional cigarette smoking among European students: findings from the 2019 ESPAD survey. Addiction. 2022;117(11):2918–2932. doi: 10.1111/add.15982. [DOI] [PubMed] [Google Scholar]
  • 10.Mendez D, Warner KE, Courant PN. Has Smoking Cessation Ceased? Expected Trends in the Prevalence of Smoking in the United States. Am J Epidemiol. 1998;148(3):249–258. doi: 10.1093/oxfordjournals.aje.a009632. [DOI] [PubMed] [Google Scholar]
  • 11.Levy DT, Friend K. A Simulation Model of Policies Directed at Treating Tobacco Use and Dependence. Med Dec Mak. 2002;22(1):6–17. doi: 10.1177/02729890222062874. [DOI] [PubMed] [Google Scholar]
  • 12.Carreras G, Gallus S, Iannucci L, Gorini G. Estimating the probabilities of making a smoking quit attempt in Italy: stall in smoking cessation levels, 1986–2009. BMC Public Health. 2012;12(1):183. doi: 10.1186/1471-2458-12-183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.National Center for Chronic Disease Prevention and Health Promotion (US) Office on Smoking and Health. The Health Consequences of Smoking-50 Years of Progress: A Report of the Surgeon General. Reports of the Surgeon General. Atlanta (GA): Centers for Disease Control and Prevention (US); 2014. http://www.ncbi.nlm.nih.gov/books/NBK179276/. [PubMed]
  • 14.Feuer EJ, Levy DT, McCarthy WJ. Chapter 1: The Impact of the Reduction in Tobacco Smoking on U.S. Lung Cancer Mortality, 1975-2000: An Introduction to the Problem: Introduction: Impact of the Reduction in Tobacco Smoking on U.S. Lung Cancer Mortality. Risk Anal. 2012;32:S6–S13. 10.1111/j.1539-6924.2011.01745.x. [DOI] [PMC free article] [PubMed]
  • 15.Levy DT, Nikolayev L, Mumford E, Compton C. The Healthy People 2010 smoking prevalence and tobacco control objectives: results from the SimSmoke tobacco control policy simulation model (United States) Cancer Causes Control. 2005;16(4):359–371. doi: 10.1007/s10552-004-7841-4. [DOI] [PubMed] [Google Scholar]
  • 16.Singh A, Wilson N, Blakely T. Simulating future public health benefits of tobacco control interventions: a systematic review of models. Tob Control. 2021;30(4):460–470. doi: 10.1136/tobaccocontrol-2019-055425. [DOI] [PubMed] [Google Scholar]
  • 17.Levy DT, Gallus S, Blackman K, Carreras G, Vecchia CL, Gorini G. Italy SimSmoke: the effect of tobacco control policies on smoking prevalence and smoking-attributable deaths in Italy. BMC Public Health. 2012;12(1):709. doi: 10.1186/1471-2458-12-709. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Levy DT, Sánchez-Romero LM, Li Y, Yuan Z, Travis N, Jarvis MJ, et al. England SimSmoke: the impact of nicotine vaping on smoking prevalence and smoking-attributable deaths in England. Addiction. 2021;116(5):1196–1211. doi: 10.1111/add.15269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Near AM, Blackman K, Currie LM, Levy DT. Sweden SimSmoke: the effect of tobacco control policies on smoking and snus prevalence and attributable deaths. Eur J Public Health. 2014;24(3):451–458. doi: 10.1093/eurpub/ckt178. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Sánchez-Romero LM, Zavala-Arciniega L, Reynales-Shigematsu LM, Miera-Juárez BSD, Yuan Z, Li Y, et al. The Mexico SimSmoke tobacco control policy model: Development of a simulation model of daily and nondaily cigarette smoking. PLoS One. 2021;16(6):e0248215. doi: 10.1371/journal.pone.0248215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Institute of Medicine (US), Wallace RB, Geller A, Ogawa VA, editors. Assessing the use of agent-based models for tobacco regulation. Washington, D.C: National Academies Press; 2015. [PubMed]
  • 22.Tam J, Levy DT, Jeon J, Clarke J, Gilkeson S, Hall T, et al. Projecting the effects of tobacco control policies in the USA through microsimulation: a study protocol. BMJ Open. 2018;8(3):e019169. doi: 10.1136/bmjopen-2017-019169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Carreras G, Gorini G, Paci E. Can a National Lung Cancer Screening Program in Combination with Smoking Cessation Policies Cause an Early Decrease in Tobacco Deaths in Italy? Cancer Prev Res. 2012;5(6):874–882. doi: 10.1158/1940-6207.CAPR-12-0019. [DOI] [PubMed] [Google Scholar]
  • 24.Lachi A, Viscardi C, Malevolti MC, Carreras G, Baccini M. Compartmental models in epidemiology: Application on Smoking Habits in Tuscany. In: Book of short papers SIS. Italia: Pearson; 2022. pp. 1437–42.
  • 25.Lachi A, Viscardi C, Baccini M. Approximate Bayesian inference for smoking habit dynamics in Tuscany. Italia: Springer Nature; 2023. [Google Scholar]
  • 26.Broemeling LD. Bayesian analysis of infectious diseases: COVID-19 and beyond. Chapman and Hall/CRC biostatistics series. Boca Raton, London, New York: CRC Press, Taylor and Francis Group; 2021.
  • 27.Baccini M, Cereda G, Viscardi C. The first wave of the SARS-CoV-2 epidemic in Tuscany (Italy): A SI2R2D compartmental model with uncertainty evaluation. PLoS One. 2021;16(4):e0250029. doi: 10.1371/journal.pone.0250029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hoogenveen RT, Baal PHV, Boshuizen HC, Feenstra TL. Dynamic effects of smoking cessation on disease incidence, mortality and quality of life: The role of time since cessation. Cost Eff Resour Allocation. 2008;6(1):1. doi: 10.1186/1478-7547-6-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Efron B, Tibshirani R. An introduction to the bootstrap. No. 57 in Monographs on statistics and applied probability. New York: Chapman and Hall; 1993.
  • 30.Chowell G. Fitting dynamic models to epidemic outbreaks with quantified uncertainty: A primer for parameter uncertainty, identifiability, and forecasts. Infect Dis Model. 2017;2(3):379–398. doi: 10.1016/j.idm.2017.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, et al. Global sensitivity analysis: the primer. Italia: Wiley; 2008. [Google Scholar]
  • 32.Thun MJ, Carter BD, Feskanich D, Freedman ND, Prentice R, Lopez AD, et al. 50-Year Trends in Smoking-Related Mortality in the United States. N Engl J Med. 2013;368(4):351–364. doi: 10.1056/NEJMsa1211127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Carreras G, Gorini G, Gallus S, Iannucci L, Levy DT. Predicting the future prevalence of cigarette smoking in Italy over the next three decades. Eur J Public Health. 2012;22(5):699–704. doi: 10.1093/eurpub/ckr108. [DOI] [PubMed] [Google Scholar]
  • 34.Hellinger E. Neue Begründung der Theorie quadratischer Formen von unendlichvielen Veränderlichen. J Reine Angew Math. 1909;1909(136):210–271. doi: 10.1515/crll.1909.136.210. [DOI] [Google Scholar]
  • 35.Mogensen PK, Riseth AN. Optim: A mathematical optimization package for Julia. J Open Source Softw. 2018;3(24):615. doi: 10.21105/joss.00615. [DOI] [Google Scholar]
  • 36.Zucchini W, MacDonald IL, Langrock R. Hidden Markov models for time series: an introduction using R. 2nd ed. New York: Chapman and Hall/CRC; 2016. 10.1201/b20790.
  • 37.Roosa K, Chowell G. Assessing parameter identifiability in compartmental dynamic models using a computational approach: application to infectious disease transmission models. Theor Biol Med Model. 2019;16(1):1. doi: 10.1186/s12976-018-0097-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Saltelli A, Annoni P, Azzini I, Campolongo F, Ratto M, Tarantola S. Variance-based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Comput Phys Commun. 2010;181(2):259–270. doi: 10.1016/j.cpc.2009.09.018. [DOI] [Google Scholar]
  • 39.Sobol IM. A primer for the Monte Carlo method. Boca Raton: CRC Press; 1994. [Google Scholar]
  • 40.Kucherenko S, Albrecht D, Saltelli A. Exploring multi-dimensional spaces: a Comparison of Latin Hypercube and Quasi Monte Carlo Sampling Techniques. arXiv - University of Cornell (USA) JRC98050. 2015. 10.48550/arXiv.1505.02350.
  • 41.GBD 2019 Tobacco Collaborators. Spatial, temporal, and demographic patterns in the prevalence of smoking tobacco use and attributable disease burden in 204 countries and territories, 1990-2019: a systematic analysis from the Global Burden of Disease Study 2019. Lancet. 2021;397(10292):2337–60. 10.1016/S0140-6736(21)01169-7. [DOI] [PMC free article] [PubMed]
  • 42.Kulik MC, Nusselder WJ, Boshuizen HC, Lhachimi SK, Fernández E, Baili P, et al. Comparison of Tobacco Control Scenarios: Quantifying Estimates of Long-Term Health Impact Using the DYNAMO-HIA Modeling Tool. PLoS ONE. 2012;7(2):e32363. doi: 10.1371/journal.pone.0032363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hara M, Sobue T, Sasaki S, Tsugane S, the JPHC Study Group. Smoking and Risk of Premature Death among Middle-aged Japanese: Ten-year Follow-up of the Japan Public Health Center-based Prospective Study on Cancer and Cardiovascular Diseases (JPHC Study) Cohort I. Jpn J Cancer Res. 2002;93(1):6–14. 10.1111/j.1349-7006.2002.tb01194.x. [DOI] [PMC free article] [PubMed]
  • 44.Wensink M, Alvarez JA, Rizzi S, Janssen F, Lindahl-Jacobsen R. Progression of the smoking epidemic in high-income regions and its effects on male-female survival differences: a cohort-by-age analysis of 17 countries. BMC Public Health. 2020;20(1):39. doi: 10.1186/s12889-020-8148-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Meade N. Industrial and business forecasting methods, Lewis, C.D., Borough Green, Sevenoaks, Kent: Butterworth, 1982. Price: £9.25. Pages: 144. J Forecast. 1983;2(2):194–6. 10.1002/for.3980020210.
  • 46.Mahajan SD, Homish GG, Quisenberry A. Multifactorial Etiology of Adolescent Nicotine Addiction: A Review of the Neurobiology of Nicotine Addiction and Its Implications for Smoking Cessation Pharmacotherapy. Front Public Health. 2021;9:664748. doi: 10.3389/fpubh.2021.664748. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Reitsma MB, Flor LS, Mullany EC, Gupta V, Hay SI, Gakidou E. Spatial, temporal, and demographic patterns in the prevalence of smoking tobacco use and initiation among young people in 204 countries and territories, 1990–2019. Lancet Public Health. 2021;6(7):e472–e481. doi: 10.1016/S2468-2667(21)00102-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Gorini G, Costantini A, Franchi G, Terrone R. Environmental tobacco smoke (ETS) at the workplace: considerations about a survey carried out in a pharmaceutical industry. Epidemiol Prev. 2002;26(1):35–39. [PubMed] [Google Scholar]
  • 49.Lopez AD, Collishaw NE, Piha T. A descriptive model of the cigarette epidemic in developed countries. Tob Control. 1994;3(3):242–247. doi: 10.1136/tc.3.3.242. [DOI] [Google Scholar]
  • 50.Gorini G, Carreras G, Allara E, Faggiano F. Decennial trends of social differences in smoking habits in Italy: a 30-year update. Cancer Causes Control. 2013;24(7):1385–1391. doi: 10.1007/s10552-013-0218-9. [DOI] [PubMed] [Google Scholar]
  • 51.Marcon A, Pesce G, Calciano L, Bellisario V, Dharmage SC, Garcia-Aymerich J, et al. Trends in smoking initiation in Europe over 40 years: A retrospective cohort study. PLoS One. 2018;13(8):e0201881. doi: 10.1371/journal.pone.0201881. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Alboksmaty A, Agaku IT, Odani S, Filippidis FT. Prevalence and determinants of cigarette smoking relapse among US adult smokers: a longitudinal study. BMJ Open. 2019;9(11):e031676. doi: 10.1136/bmjopen-2019-031676. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Puy A, Beneventano P, Levin SA, Piano SL, Portaluri T, Saltelli A. Models with higher effective dimensions tend to produce more uncertain estimates. Sci Adv. 2022;8(42):eabn9450. doi: 10.1126/sciadv.abn9450. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Bongers ML, Ruysscher DD, Oberije C, Lambin P, Groot CAU, Coupé VMH. Multistate Statistical Modeling: A Tool to Build a Lung Cancer Microsimulation Model That Includes Parameter Uncertainty and Patient Heterogeneity. Med Dec Making. 2016;36(1):86–100. doi: 10.1177/0272989X15574500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Chrysanthopoulou SA. MILC: A Microsimulation Model of the Natural History of Lung Cancer. Int J Microsimulation. 2016;10(3):5–26. doi: 10.34196/ijm.00164. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material 1. (397.3KB, pdf)

Data Availability Statement

Data are available on request from the corresponding author.

Codes are available on request from the corresponding author.


Articles from BMC Medical Research Methodology are provided here courtesy of BMC

RESOURCES