Abstract
Background
Tick-borne encephalitis (TBE) presents an increasing burden in many parts of Europe, Asian Russia, Siberia, Asian former USSR and Far East. Incidence can be considered as one way to express the burden. A more comprehensive measure concerns disability-adjusted life years (DALYs), better characterizing the full burden of TBE. TBE burden in DALYs has not yet been estimated, nor has it been specified by the Global Burden of Disease (GBD) studies.
Objective
The purpose of the present study is to estimate the burden of TBE in Slovenia, expressed in DALYs, both from the population and individual perspectives. We discuss the impact of TBE burden on public health and potential strategies to reduce this burden in Slovenia.
Methods
The burden of TBE is estimated by using the updated DALYs' methodology first introduced in the GBD project. The DALYs᾽ calculations are based on the health outcomes of the natural course of the disease being modelled. Corrections for under-reporting and under-ascertainment are applied. The impact of uncertainty in parameters in the model was assessed using sensitivity analyses.
Results
From the population perspective, total DALYs amount to 3,450 (167.8 per 100,000 population), while from the individual perspective they amount to 3.1 per case in 2011. Notably, the consequences of TBE present a larger burden than TBE itself.
Conclusions
TBE presents a relatively high burden expressed in DALYs compared with estimates for other infectious diseases from the GBD 2010 study for Slovenia. Raising awareness and increasing vaccination coverage are needed to reduce TBE and its consequences.
Introduction
Tick-borne encephalitis (TBE) presents an increasing public health concern in many parts of Europe and in some Asian countries [1]. TBE is an infectious disease of the central nervous system (CNS) which may lead to long term or permanent neurological sequelae or even death [2–6]. Three genetically closely related TBE virus (TBEV) subtypes (the European, Far-Eastern and Siberian) cause TBE [1,7]. These three TBE virus subtypes are usually transmitted by the infected tick genus Ixodes [1]. The virus can also be transmitted through unpasteurized dairy products [8]. All three subtypes are associated with varying courses of the disease and degrees of severity [7]. The European subtype of the virus, which is prevalent in most of Europe (including Slovenia), usually causes disease that follows a biphasic course [7]. This course presents a short-lasting acute disease of the first stage with flu-like symptoms, starting about two weeks after the tick bite, followed by a few symptom-free days with subsequent acute disease of the second stage in the CNS, mostly concerning meningitis, meningoencephalitis and meningoencephalomyelitis [9]. With increasing age, severity of the disease increases [9,10] and mortality rates due to TBE in adults increasing up to 2% [7]. The Far Eastern subtype of the virus is mainly found in Eastern Russia, China, and Japan and the Siberian is found mostly in the Urals, Siberia and Eastern Russian provinces [7]. Both the Far Eastern and Siberian subtypes of the virus cause a monophasic course of the disease [7], characterized by CNS involvement [7]. Disease with the Far Eastern subtype of the virus is usually severe, is frequently associated with encephalitic symptoms and lacks the tendency to develop chronic disease [7]. Mortality rate due to the Far Eastern subtype is between 5 and 35% [7]. Disease from the Siberian subtype of the virus is less severe, but associated with diverse neurological and/or neuropsychiatric symptoms and a tendency to develop chronic or extremely prolonged disease [7]. Mortality rate of the Siberian subtype is between 1 and 3% [7]. Finally, the disease characteristics also depend on the tropism of the TBEV for different regions of the CNS and on the individual immunity of patients [9–11].
TBE is endemic in regions from Alsace-Lorraine and Scandinavia to the North-eastern parts of China and Northern Japan [1,12–19]. In many parts of Europe, Russia, Siberia and the Far East, the incidence is increasing and new foci have appeared due to increasing mobility, changes in lifestyle, human leisure activities, agricultural practices and effects of climate changes on vectors and reservoir hosts [20–24]. In spite of increasing awareness and knowledge of the disease, the incidence of TBE is underestimated [21], mainly due to insufficient routine diagnostics and surveillance [9]. Therefore the full burden of TBE, using corrections for this underestimation, still has to be assessed. Vaccination with safe, efficacious and well tolerated vaccines is the most effective way of preventing TBE [25–28] and reducing its burden. In Slovenia, TBE has been a relevant disease from the public-health point of view since 1953 [29]. Slovenia is one of the countries where the European subtype of the virus is prevalent, with a high incidence of TBE and very low vaccination coverage [30,31] despite favourable cost-effectiveness [32]. Though the cost-effectiveness of vaccination against TBE in Slovenia was evaluated [32] the exact full burden of TBE is also still unknown in this country and needs to be estimated.
The burden of TBE is mostly expressed by incidence only [9,30,33]. The burden of the disease can be better evaluated if information on the incidence/prevalence, mortality and sequelae are all combined into a composite measure which can be found in the disability-adjusted life years (DALYs) [34]. DALYs reflect lost years of healthy life, as defined by the World Health Organization (WHO) [35]. DALYs, as one criteria, can be used for effective planning and prioritizing of scarce and therefore limited public health resources [34]. The burden of TBE, expressed in DALYs, has not yet been assessed nor has it been specified in the Global Burden of Disease (GBD) studies [36].
The purpose of the present study is to estimate the burden of TBE in Slovenia, expressed in DALYs from both the population and individual perspectives. Furthermore, we discuss strategies to reduce this public health burden in Slovenia. Data used reflect 2011 as the most recent year with data availability. Additionally, we consider the trend in DALYs to analyse how reflective 2011 is for other recent years. Our study can help to guide health policy and action locally as well as provide suggestions globally to mitigate the burden of TBE.
Methods
Brief overview of the DALYsʼ methodology
The DALYsʼ methodology was first introduced by Murray and co-workers in the Global Burden of Disease (GBD) project [37] using the following equation:
(1) |
where YLLs are the number of life years lost due to premature death and YLDs are the number of life years lost due to disability, weighted with a factor between 0 (perfect health) and 1 (death) reflecting the severity of the disability. According to the GBD-terminology and the International Classification of Functioning, Disability and Health, [38] the term disability refers to any short-term or long-term health loss in terms of functional capacity such as mobility, self-care, participation in normal activities, pain and discomfort, anxiety and depression and cognition.
In the original GBD study in 1990 and further WHO updates [39–47], 3% and 0% discount rates and both presence and absence of age weights in the DALYs’ calculations were used. Discounting means that the value of health is weighted less in the future than in the present due to time preference related to growth in life expectancy [48]. Age weights give less weight to years of healthy life lost at young ages and older ages, with productivity as the main rationale [48]. For the GBD 1990 study, the reference standard life table has a life expectancy at birth of 82.5 years for females and 80.0 years for males [48].
Since the GBD 1990 study was published, there have been intense debates on the key methodological choices used for the DALYs’ calculation, especially regarding the discounting, age weights, disability weights, the years lost per death and the incidence estimates for the YLDs calculation [48–54]. As one outcome of these debates, the new GBD 2010 study, done by Institute of Health Metrics and Evaluation, used a simplified calculation of DALYs without discounting and age weights, and the YLDs are calculated from prevalence estimates rather than incidence estimates [48,55–58]. The GBD 2010 study also involves some modifications of disability weights for the DALYsʼ calculus and uses a new reference standard life table for the YLLs calculation. The new GBD 2010 reference standard life table has a life expectancy at birth of 86 years for both males and females and expresses an aspiration for high and healthy life expectancy [55].
The GBD studies estimate the global burden of diseases, including communicable, maternal, neonatal, nutritional, non-communicable diseases and injuries [48]. In 2008, the European Centre for Disease Prevention and Control urged to develop a new methodology to estimate the burden for communicable diseases in European Member States and EEA/EFTA countries by using a pathogen-based approach, taking into account subsequent sequelae and complications associated with infection [59,60]. No age weights or discounting are considered [59]. Adjustment to correct for under-ascertainment and under-reporting is applied [59,61]. Under-ascertainment refers to cases who do not seek medical care due to mild or absence of symptoms, or who have knowledge that the disease is self-limiting [61,62]. Due to under-ascertainment, cases will not enter the notification or surveillance system [61,62]. Under-reporting refers to cases who seek medical care but are not captured by the surveillance or notification systems because the infection/pathogen is not diagnosed or is misdiagnosed, misclassified or miscounted [61,62]. Further development of this methodology is in progress [60]. Using this methodology to estimate the full burdens of different communicable diseases enables comparisons among these diseases within and between countries to help guide public health policy and action in Europe [59]. In the present study, the updated methodology [60,61,62] will be applied for one individual country.
The DALYs methodology to calculate the burden of TBE
On the basis of the natural course of the disease, the following health outcomes of a model were included for the calculation of DALYs [32]: death due to TBE, the acute disease of the second stage with signs of meningitis, meningoencephalitis and/or meningoencephalomyelitis and mild, moderate and severe neurological sequelae. Mild neurological sequelae (emotional liability, tiredness and intermittent headache) can be assumed not to have a significant impact on patientsʼ daily activities, social and working capacity. Moderate neurological sequelae (ataxia of gait, paresis of extremities, cognitive disorders, pronounced dementia or severe deafness) will however affect patients’ daily activities, social and working capacity. In patients with severe neurological sequelae, social life and working capacity can be seriously affected and in a few cases patients need institutional care. In the present study, these neurological sequelae are considered as permanent neurological sequelae.
Data in Table 1 were used to calculate the burden for TBE in a straightforward disease burden model programmed in Microsoft Excel. The reported age-dependent number of cases with acute disease of the second stage (nra) was obtained from the National Institute of Public Health (NIJZ) data [63] and was used as the initial model input. These numbers of cases were corrected for under-estimation by a factor γ. This factor γ is the product of a factor βa to correct for under-ascertainment and a factor βr to correct for under-reporting. Both correction factors βa and βr are calculated based on the schematic presentation of disease progression presented in Fig 1. [32]. In the present study the factor βa was calculated on the basis of targeted specific information. Firstly, the natural course of TBE takes into account that around 90% of symptomatic infections develops acute disease of the first stage with symptoms similar to flu and about one third develops acute disease of the second stage with CNS involvement and the remaining 10% of infections involves more serious disease of the CNS [33,64]. Secondly, all reported cases were assumed to concern patients with acute disease of the second stage with CNS involvement in Slovenia [63].
Table 1. Model input parameters for calculating DALYs of TBE: the number of reported cases with acute disease of the second stage for 2011, duration of the acute disease of the second stage, disability weights for the acute disease of the second stage, probabilities of permanent neurological sequelae, disability weights for permanent neurological sequelae and probabilities of death from TBE, inclusive references.
Health Outcomes | Base-case | Range | Reference (base-case) |
---|---|---|---|
Acute disease of the second stage | |||
Correction factor for underestimation (γ) | 4.5 a | 3.5–5.5 b | |
Number of all acute cases, by age groups | |||
0–4 | 5 | [63] | |
5–14 | 17 | [63] | |
15–24 | 20 | [63] | |
25–34 | 19 | [63] | |
35–44 | 34 | [63] | |
45–54 | 38 | [63] | |
55–64 | 65 | [63] | |
65–74 | 41 | [63] | |
75+ | 8 | [63] | |
Duration of hospitalization, by age groups c | |||
0–14 | 0.0164 years (6 days) | 0.0082 years (3 days)-0.0274 years (10 days) d | [70] |
15–64 | 0.0247 years (9 days) | 0.0082 years (3 days)-0.1671 years (61 days) d | [71] |
65–74 | 0.0274 years (10 days) | 0.0082 years (3 days)-0.1205 (44 days) d | [71] |
75+ | 0.0274 years (10 days) | 0.0082 years (3 days)-0.1205 (44 days) d | [71] |
Disability weights, by age groups e | |||
0–14 | 0.616 per life year lived with disability | [68] | |
15–74 | 0.613 per life year lived with disability | [68] | |
75+ | 0.613 per life year lived with disability | [68] | |
Permanent neurological sequelae | |||
Probability of mild sequelae, by age groups | |||
<15 | 0% | [29] | |
>15 | 10% | 10–15.4% f | [65] |
Probability of moderate sequelae, by age groups | |||
<5 | 0% | [29] | |
5–14 | 1.50% | 0–1.5% g | [29] |
>15 | 46% | 22–46% f | [65] |
Probability of severe sequelae, by age groups | |||
<5 | 0% | [29] | |
5–14 | 0.80% | 0–4.1% g | [29] |
>15 | 2% | 2–8.6% f | [65] |
Duration | Remaining life expectancy in years | ||
Disability weights, all ages h | |||
Mild sequelae | 0.023 per life year lived with disability | 0–0.1 per life year lived with disability | |
Moderate sequelae | 0.160 per life year lived with disability | 0.1–0.25 per life year lived with disability | |
Severe sequelae | 0.629 per life year lived with disability | 0.5–0.7 per life year lived with disability | |
Death due to TBE | |||
Correction factor for underreporting (βd) | 2 i | 0–4 j | |
Probability of death from TBE | 0.4% k | ||
Duration | Remaining life expectancy in years | ||
Disability weights | 1 per life year lived with disability | [36] |
a The calculated factor γ (4.5) is a product of factor βa (100/40 = 2.5) and factor βr (100/55 = 1.8). The factor βa was calculated on the basis of: (i) the natural course of TBE [33,64] and (ii) all reported cases in Slovenia (patients with acute disease of the second stage with CNS involvement). The factor βr for TBE in Slovenia is not available, therefore βr (100/55 = 1.8) is calculated taking into account that 55% TBE cases are reported in Slovenia.
b The calculated average coefficient of variation (23%) of reported cases during the period 2002 to 2011 [63] was used for calculating the maximum and the minimum values of the factor γ. As it is stated that 97% of all reported cases are hospitalized in 2011 [63], a simplified assumption that all reported cases are hospitalized is used.
c The age groups available for duration of hospitalization at 15 to 60 years and >60 years [71] is adapted into a set of age groups of 15–24, 25–34, 35–44, 45–54, 55–64, 65–74 and 75+ years based on official sources of the NIJZ [63].
d The maximum and the minimum values for duration of hospitalization by all age group, were taken from published studies in Slovenia [70,71].
e Disability weights for acute disease of the second stage are not available, therefore the disability weights of Japanese encephalitis from GBD 2004 were updated and subsequently taken into account [68].
f The maximum and minimum values of probabilities for mild, moderate and severe permanent neurological sequelae for those aged 15 years and over were taken from the highest and lowest values from both studies in Slovenia [65] and Lithuania [4].
g The maximum and the minimum values of probabilities for mild, moderate and severe permanent neurological sequelae for under the age of 15 years were taken from both studies in Slovenia [72,73].
h Disability weights for mild, moderate and severe permanent neurological sequelae due to TBE are not available, therefore the disability weights for each of these sequelae as well as their maximum and minimum values were calculated as 1 minus available quality weights. The quality weights for mild, moderate and severe permanent neurological sequelae and their maximum and the minimum values were derived from published data [69].
i The factor βd (100/50 = 2) was calculated taking into account that 50% TBE deaths are reported [66].
j The maximum and minimum values for factor βd is calculated as ± 2 times the base case value.
Specifically, factor βr was calculated taking into account that 55% of TBE cases are reported; i.e., 45% of TBE cases are assumed misdiagnosed, misclassified or miscounted. The age-dependent estimated numbers of cases with acute disease of the second stage (nea) were calculated as follows:
(2) |
The estimated number of cases for mild (nemild), moderate (nemod), and severe (nesev) permanent neurological sequelae and deaths due to TBE (ned) were calculated, using the annual transition probabilities pmild, pmod, psev and pd of moving from acute disease of the second stage to health outcomes (mild, moderate, severe permanent neurological sequelae and deaths due to TBE, respectively). The age-dependent annual transition probabilities for mild, moderate, and severe permanent neurological sequelae were obtained from national studies [29,65]. The age-dependent annual probabilities of deaths due to TBE (pd) were calculated from the NIJZ data [63] and were corrected for under-reporting due to under-diagnosis by a factor βd. The factor βd for TBE was calculated based on a published study [66] So, the age-dependent estimated numbers of cases for mild, moderate, severe permanent neurological sequelae and deaths due to TBE (ned) were calculated as follows:
(3) |
(4) |
(5) |
(6) |
These estimated numbers of cases for the various health outcomes were subsequently incorporated in the DALYs calculation for TBE. YLLs were calculated by multiplying the estimated age specific numbers of deaths due to TBE (ned) with the remaining life expectancy (e) at that age. For life expectancy, the latest GBD 2010 reference standard life table [58] was used.
(7) |
The YLDsacute for the acute disease of the second stage were calculated by multiplying the estimated number of cases with acute disease of the second stage (nea) with the appropriate disability weights (Dwa) and duration of hospitalization (la).
(8) |
The YLDsseq for mild, moderate and severe permanent neurological sequelae were calculated by multiplying the estimated number of cases for mild (nemild), moderate (nemod) and, severe (nesev) permanent neurological sequelae with its disability weights (Dwmild, Dwmod and Dwsev) and remaining life expectancies (emild, emod and esev).
(9) |
The YLDs for all health outcomes (acute disease of the second stage, mild, moderate and severe permanent neurological sequelae) were aggregated to get the total YLDs.
(10) |
The full burden for TBE is the sum of YLLs and YLDs as follows:
(11) |
The burden of the disease for one year is presented from the population (total DALYs and DALYs per 100,000 populations) and the individual perspectives (DALYs per case) [62].
Neither discounting nor age weighting was applied in the DALYs calculus.
Data
The number of TBE cases for 2011 for age groups from 0–4 years, 5–14 years, 15–24 years, 25–34 years, 35–44 years, 45–54 years 55–64 years, 65–74 years and 75+ years originated from official sources of the NIJZ [63]. In the present study, a maximum age of 105 years was taken, corresponding to the maximum age of 105 years from the GBD 2010 new standard life table. In the present study, the ages of onset for the acute disease of the second stage and mild, moderate and severe permanent neurological sequelae were assumed at the mid-points of each age group.
We used the new GBD 2010 reference standard life table for the calculation of YLLs, with a life expectancy at birth of 86 years for males and females [58]. An incidence-based approach was used to estimate YLDs. In the absence of discounting and age weights, this approach converges to incidence multiplied by estimated duration times with disability weighting for sequelae [67]. In a prevalence-based approach without discounting and age weights, YLDs would follow from prevalence of sequelae times disability weights [67]. As prevalence is approximately incidence times duration, our incidence-based YLDs across all ages would approximately equal the prevalence-based YLDs, in particular in the absence of discount and age weighting [67]. Notably, when discounting and age weights are applied, the prevalence-based YLDs for all ages may be quite different from the incidence-based YLDs [67].
As no disability weights for the acute disease of the second stage of TBE exist, age-dependent disability weights were derived from the GBD 2004 updated study for Japanese encephalitis [68]. Also, no disability weights for the various levels of TBE-related neurological sequelae severities exist, and such disability weights for the mild and moderate and severe permanent neurological sequelae were derived as 1 minus the respective quality weights for each of these sequelae. The quality weights for mild, moderate and severe permanent neurological sequelae were derived from a published study [69]. As mentioned, all base-case parameter values are listed in Table 1.
In sensitivity analyses, we tested how the results change with changes in the input parameters’ values. One-way and probabilistic sensitivity analyses (PSA) were conducted. With one-way sensitivity analyses one parameter was changed while other parameters were kept constant at the base case values. The maximum and minimum values of each parameter were defined by the range from Table 1. The results of one-way sensitivity analyses were represented as a tornado diagram for the population perspective. PSA was conducted in the form of simulations using @Risk® (Palisade Corporation) and 1000 repetitions. Uniform distributions were used between maximum and minimum values as defined by the ranges from Table 1. Results of the PSA were presented using 95%-uncertainty cut-offs.
Results
Base-case analyses
Table 2 shows that from the population perspective total DALYs amount to 3,450 or 167.8 per 100,000 population, while from the individual perspective they amount to 3.1 per case. The disease burden is dominated by permanent neurological sequelae (93.9%), followed by the burden of premature death due to TBE (5.6%), while the burden due to the acute disease of the second stage reflects the smallest proportion (0.5%). Within the total permanent neurological sequelae, the burden of moderate sequelae presents the biggest proportion (77.6%) followed by the burden of severe sequelae (14.0%) and the burden of mild sequelae (2.4%).
Table 2. Calculated DALYs due to TBE for one year from the population perspective (YLLs, YLDs, DALYs and DALYs per 100,000 population) and individual perspective (DALYs per case).
Health outcomes | Cases | YLLs | YLDs | DALYs | DALYs per case | DALYs per 100,000 population |
---|---|---|---|---|---|---|
Acute disease of the second stage | 1,112 | 0 | 17 | 17 | 0.015 | 0.8 |
Permanent neurological sequelae | ||||||
Mild sequelae | 101 | 0 | 83 | 83 | 0.075 | 4.0 |
Moderate sequelae | 467 | 0 | 2,672 | 2,672 | 2.403 | 129.9 |
Sever sequelae | 21 | 0 | 484 | 484 | 0.435 | 23.5 |
Total permanent neurological sequelae | 3,239 | 3,239 | 2.913 | 157.5 | ||
Death due to TBE | 9 | 194 | 0 | 194 | 0.174 | 9.4 |
All health outcomes | 194 | 3,256 | 3,450 | 3.1 | 167.8 |
Cases = estimated cases. Results in the Table 2 are presented in both disaggregated form (YLLs, YLDs) and aggregated form (DALYs) for one year and are in line with the methodology protocol for calculating the burden of communicable diseases in EU and EEA/EFTA [62]. YLLs = the number of life years lost due to premature death due to TBE at an age of 67 years [30]. YLDs = the number of life years lost due to disability. DALYs = disability-adjusted life years. DALYs are calculated as the sum of YLLs and YLDs. DALYs per case are calculated as DALYs divided by the number of estimated cases of acute disease of the second stage. DALYs per 100,000 populations are calculated as DALYs divided by the Slovene population of 2,050,189 people [74] and then multiply by 100,000.
Fig 2 shows that, from the population perspective, the burden of TBE expressed in DALYs in the age group from 15 to 54 years amounts to 68% of the total burden. The burden in the working age population from 15 to 64 years amounts to 85%. Within working age populations, the burden in the prime-aged workers group from 25 to 54 years of age amounts to 53%, followed by the burden in the youth workers group from 15–24 years of age and older workers group from 55 to 64 years (16–17%).
The burden expressed as the number of reported cases in the age group from 15 to 54 years amounts to 51% of the total burden and to 72% in the working age population aged 15 to 64 years. The burden in the prime-aged workers group amounts to 43%, followed by the burden in the older workers group (21%), while the burden in youth workers group amounts to 8%.
Fig 3 demonstrates annual data of total DALYs over time, with the peak of 5,279 DALYs in 2006 and the lowest value of 2,572 DALYs in 2010. Long-term burden average between 2004 and 2011 amounts to 3,626 DALYs while a short-term average between 2009 and 2011 amounts to 3,439 DALYs. Our 2011 estimate can therefore be considered as representative for previous years, despite a slight overall decline during the years.
Sensitivity analyses
With one-way sensitivity analyses, it was tested which parameters have the greatest influence on the modelʼs results. From Fig 4, the ordering of parameters according to their influence on DALYs can be seen. The disability weights of moderate permanent neurological sequelae have the greatest influence on estimated DALYs.
Results of the probabilistic sensitivity analyses presented in Fig 5 show a 95% uncertainty interval from 2,394 to 5,774 DALYs. It shows that, for example, with 0.95 likelihood total DALYs are higher than 2,394, whereas DALYs are higher than 2,631 with 0.9 likelihood.
Discussion
DALYs as a composite measure enable the combination of information on incidence, mortality and sequelae associated with TBE infection. Therefore, DALYs provide unique insight into the disease burden [34]. From the population perspective, total DALYs amount to 3,450 (167.8 per 100,000 population) in 2011 in Slovenia, while from the individual perspective they amount to 3.1 per case for that same year. The majority of the estimated burden is centered in adults with potential major impact on productivity losses. 1.5% of TBE burden in the age group from 5–14 years seems low compared to the burden in adults. However, as these are children and disease in children is often considered as of even higher subjective burden than in adults, a greater relative burden of disease may well be conceived than reflected just by the bare percentages. Also, the present study emphasizes the impact of neurological sequelae. These sequelae have significant impact on patients᾽ quality of life, social and working activities. Cognitive impairments are perhaps one of the most relevant sequelae of TBE and potentially are crucial in the work environment.
In the present study, TBE country-specific data were used for the DALYs calculation. The study estimates are based on the best evidence the authors could find, however, some data and information were not available for Slovenia, such as disability weights for TBE, both correction factors βd (under-reporting of deaths due to TBE) and βr (under-reporting of cases of the acute disease of the second stage). In Slovenia, only cases with the acute disease of the second stage with CNS [75] and death due to TBE [63] are routinely reported, DALYs have previously not been used to measure the burden of TBE and application of correction factors for TBE as done in the present study reflects an innovative approach in DALYs’ calculations. The disease burden model developed in the present study could be used as a representative model for TBE DALYs’ calculations for other countries. Cases with asymptomatic infection and symptomatic cases including acute disease of the first stage are not captured by notification or surveillance systems in Slovenia [75] nor by our correction factors, causing potential under-estimation of our DALYs’ estimates.
Disability weights of mild and severe permanent neurological sequelae, as addressed in the one-way sensitivity analyses, appeared to have no crucial impact on DALYs. Additionally, correction for under-reporting of deaths due to TBE shows only a slight impact on YLLs in the full disease burden. It is estimated that at the European level (Albania, Austria, Croatia, the Czech Republic, Denmark, Estonia, Finland, France, Germany, Hungary, Italy, Latvia, Lithuania, Poland, Russian Federation, Slovak Republic, Slovenia, Sweden, Switzerland) only 30–40% of TBE cases are reported [76], meaning that 60–70% of TBE cases are misdiagnosed, misclassified and miscounted. These figures are derived from varying systems of TBE surveillance and notification and varying diagnostic procedures among these countries in the investigated time period up to 2000 [7]. As TBE has been mandatory notifiable since 1977 in Slovenia [7] and awareness about TBE might increased in the last years, we decided to use a conservative estimate of 55% of TBE cases being reported in Slovenia. Taking into account the proportion of 30–40% of TBE reported cases [76], our total DALYs estimation would obviously still reflect an under-estimate.
Trend analysis of the TBE burden may be interpreted as showing a slight decrease in DALYs for the time period between 2004 and 2011, likely mainly due to increasing awareness of the disease among the general population. Despite increasing awareness during the last years, vaccination coverage of 13% in terms of persons receiving one or two doses of TBE vaccine was low in 2009 [77]. Notably, vaccination seems far too low in Slovenia for efficient prevention and control of TBE [31]. Still, the trend analysis shows that the estimated burden of 3,450 DALYs for 2011 is likely representative for the national disease burden.
In a report of the Dutch National Institute of Public Health & the Environment, burdens are presented as measured in DALYs, incidence and mortality for seven selected infectious diseases (influenza, measles, HIV, campylobacteriosis, infection with enterohaemorrhagic Escherichia coli, salmonellosis and tuberculosis) and compared between some European countries [34]. It was concluded that the relative burden of these diseases expressed in DALYs is different compared to the relative burden expressed just by incidence or mortality data [34]. In a related study [78] explicitly recommend to calculate DALYs also for other infectious diseases in Europe to prioritize interventions.
DALYs have previously not been used to measure the burden of TBE. TBE burden, expressed in DALYs is not included in GBD studies, and results of the present study give novel information in that respect. Comparison of the TBE burden expressed in DALYs in the present study to DALYs for other infectious diseases from the GBD 2010 study for Slovenia [79] is possible. However, this comparison should be considered with caution as no GBD disability weights for TBE exist. In the GBD 2010 study for Slovenia [79], the cluster for communicable, maternal, neonatal and nutritional disorders presents 25,501 DALYs per year. Within this group [79], lower respiratory infections present the highest burden with 7,545 DALYs amounting to 29.6%, followed by diarrheal diseases with 1,225 DALYs (4.8%), otitis media with 954 DALYs (3.7%), upper respiratory infections with 951 DALYs (3.7%), tuberculosis with 776 DALYs (3%) and HIV/AIDS with 547 DALYs (2.1%). The potential proportion of our estimated TBE burden in this cluster amounts to 13.5%, demonstrating a relatively high burden in Slovenia. Thus, the present study can serve as an informative estimation of the TBE᾿s national burden and the importance of the TBE on population's health in Slovenia. TBE can be considered to have a high impact on public health and to present a challenge for more efficient health policies and actions to reduce TBE in Slovenia. Such action may lead to huge population health benefits on national scales.
Austria is the only European country where an extended vaccination campaign was launched in 1981. In Austria, vaccination is free of charge only for people with an occupational risk of TBE, while for the rest of the Austrian population a part of the costs are still covered by health insurance [9,80]. Vaccination coverage of persons receiving at least one dose of vaccine increased from 6% at the beginning of the programme to 88% in 2006, with 58% being regularly vaccinated within the recommended schedule [27]. This has led to drastic reductions in TBE in all age groups [27]. In the years between 2000 and 2006, about 2800 cases were prevented in Austria [27].
TBE is endemic in Slovenia, one of the countries with the highest incidence worldwide [30]. In Slovenia, vaccination is recommended for the general population from the age of one. TBE vaccine is free of charge only for those who are potentially exposed during fieldwork while the rest of the population has to pay for the vaccination [81,82]. Furthermore, because of limited public health resources in Slovenia, it was recommended [30] to provide only selective access to free of charge vaccination for specific age groups in specific regions. The findings of the present study may suggest the need to prioritize prevention of TBE disease further and reallocation of limited public health resources in Slovenia, for example, for an extended TBE vaccination for all groups, ages and regions, potentially free of charge or at a reduced price. It has been shown before that extended TBE vaccination can be beneficial from an economic perspective [80]. Extended vaccination may result in major health benefits to the population as a whole as well as cost savings to the health-care system.
Conclusions
TBE presents a relatively high burden in Slovenia, expressed in DALYs both from the population and individual perspectives. Public-health impact may justify reallocation of scarce budgets to better control TBE. In particular, continued awareness raising and corresponding increased vaccination coverage is needed to reduce TBE and its consequences in Slovenia.
Data Availability
All relevant data are within the paper.
Funding Statement
The authors have no support or funding to report.
References
- 1. Süss J. Tick-borne encephalitis 2010: epidemiology, risk areas, and virus strains in Europe and Asia—an overview. 2011;2: 2–15. 10.1016/j.ttbdis.2010.10.007 [DOI] [PubMed] [Google Scholar]
- 2. Haglund M, Günther G. Tick-borne encephalitis—pathogenesis, clinical course and long-term follow-up. Vaccine. 2003;21: S11–S18. [DOI] [PubMed] [Google Scholar]
- 3. Dumpis U, Crook D, Oksi J. Tick-borne encephalitis. Clin Infect Dis. 1999;28: 882–890. [DOI] [PubMed] [Google Scholar]
- 4. Mickiene A, Laiskonis A, Gunther G, Vene S, Lundkvist A, Lindquist L. Tickborne encephalitis in an area of high endemicity in lithuania: disease severity and long-term prognosis. Clin Infect Dis. 2002;35: 650–658. [DOI] [PubMed] [Google Scholar]
- 5. Kaiser R. The clinical and epidemiological profile of tick-borne encephalitis in southern Germany 1994–98: a prospective study of 656 patients. Brain. 1999;122 (Pt 11): 2067–2078. [DOI] [PubMed] [Google Scholar]
- 6. Kaiser R. Tick-borne encephalitis (TBE) in Germany and clinical course of the disease. 2002;291: 58–61. [DOI] [PubMed] [Google Scholar]
- 7. Mantke OD, Schädler R, Niedrig M. A survey on cases of tick-borne encephalitis in European countries. 2008. [PubMed] [Google Scholar]
- 8. Lindquist L, Vapalahti O. Tick-borne encephalitis. 2008;371: 1861–1871. 10.1016/S0140-6736(08)60800-4 [DOI] [PubMed] [Google Scholar]
- 9.Kollaritsch H, Krasilnikov V, Holzmann H, Karganova G, Barrett A, Süss J, et al. Background Document on Vaccines and Vaccination against Tick-borne Encephalitis (TBE)*. Available: http://www.who.int/immunization/sage/6_TBE_backgr_18_Mar_net_apr_2011.pdf. Accessed April 2011.
- 10. Kaiser R. Tick-borne encephalitis. Infect Dis Clin North Am. 2008;22: 561–575. 10.1016/j.idc.2008.03.013 [DOI] [PubMed] [Google Scholar]
- 11. Maximova OA, Faucette LJ, Ward JM, Murphy BR, Pletnev AG. Cellular inflammatory response to flaviviruses in the central nervous system of a primate host. J Histochem Cytochem. 2009;57: 973–989. 10.1369/jhc.2009.954180 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Süss J. Epidemiology and ecology of TBE relevant to the production of effective vaccines. Vaccine. 2003;21: S19–S35. [DOI] [PubMed] [Google Scholar]
- 13. Amicizia D, Domnich A, Panatto D, Lai PL, Cristina ML, Avio U, et al. Epidemiology of tick-borne encephalitis (TBE) in Europe and its prevention by available vaccines. 2013;9: 1163–1171. 10.4161/hv.23802 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Suss J. Tick-borne encephalitis in Europe and beyond—the epidemiological situation as of 2007. Euro Surveill. 2008;13: 18916 [PubMed] [Google Scholar]
- 15. Kunz C. Tick-borne encephalitis in Europe. Acta Leiden. 1992;60: 1–14. [PubMed] [Google Scholar]
- 16. Hansmann Y, Gut J, Remy V, Martinot M, Christmanna D. Infection à virus TBE: données cliniques et épidémiologiques. 2004;34: S28–S30. [DOI] [PubMed] [Google Scholar]
- 17. Mansfield KL, Johnson N, Phipps LP, Stephenson JR, Fooks AR, Solomon T. Tick-borne encephalitis virus—a review of an emerging zoonosis. J Gen Virol. 2009;90: 1781–1794. 10.1099/vir.0.011437-0 [DOI] [PubMed] [Google Scholar]
- 18.Lindenbach B, Rice C. Flaviviridae, the viruses and their replication, Knipe DM, Howley PM, Fields Virology, 2001, 991–1041.
- 19. Šmit R, Postma MJ. Review of tick-borne encephalitis and vaccines: clinical and economical aspects. 2014: 1–11. [DOI] [PubMed] [Google Scholar]
- 20. Kollaritsch H, Chmelík V, Dontsenko I, Grzeszczuk A, Kondrusik M, Usonis V, et al. The current perspective on tick-borne encephalitis awareness and prevention in six Central and Eastern European countries: report from a meeting of experts convened to discuss TBE in their region. Vaccine. 2011;29: 4556–4564. 10.1016/j.vaccine.2011.04.061 [DOI] [PubMed] [Google Scholar]
- 21. Kunze U, Baumhackl U, Bretschneider R, Chmelik V, Grubeck-Loebenstein B, Haglund M, et al. The golden agers and tick-borne encephalitis. 2005;155: 289–294. [DOI] [PubMed] [Google Scholar]
- 22. Randolph SE. To what extent has climate change contributed to the recent epidemiology of tick-borne diseases? Vet Parasitol. 2010;167: 92–94. 10.1016/j.vetpar.2009.09.011 [DOI] [PubMed] [Google Scholar]
- 23. Süss J, Kahl O, Aspöck H, Hartelt K, Vaheri A, Oehme R, et al. Tick-borne encephalitis in the age of general mobility. 2010;160: 94–100. 10.1007/s10354-010-0756-7 [DOI] [PubMed] [Google Scholar]
- 24. Bröker M, Gniel D. New foci of tick-borne encephalitis virus in Europe: consequences for travellers from abroad. 2003;1: 181–184. [DOI] [PubMed] [Google Scholar]
- 25. Demicheli V, Debalini MG, Rivetti A. Vaccines for preventing tick‐borne encephalitis. Cochrane Database Syst Rev. 2009. January 21;(1):CD000977 10.1002/14651858.CD000977.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Zent O, Bröker M. Tick-borne encephalitis vaccines: past and present. Expert Rev Vaccines. 2005. October;4(5):747–55. [DOI] [PubMed] [Google Scholar]
- 27. Heinz FX, Holzmann H, Essl A, Kundi M. Field effectiveness of vaccination against tick-borne encephalitis. Vaccine. 2007;25: 7559–7567. [DOI] [PubMed] [Google Scholar]
- 28. Kunze U. Tick-borne encephalitis: From childhood to golden age does increased mobility mean increased risk?: Conference report of the 11th meeting of the International Scientific Working Group on Tick-Borne Encephalitis (ISW-TBE). Vaccine. 2010;28: 875–876. 10.1016/j.vaccine.2009.11.032 [DOI] [PubMed] [Google Scholar]
- 29. Cizman M, Rakar R, Zakotnik B, Pokorn M, Arnez M. Severe forms of tick-borne encephalitis in children. Wien Klin Wochenschr. 1999;111: 484–487. [PubMed] [Google Scholar]
- 30. Grgič-Vitek M, Klavs I. High burden of tick-borne encephalitis in Slovenia—challenge for vaccination policy. Vaccine. 2011;29: 5178–5183. 10.1016/j.vaccine.2011.05.033 [DOI] [PubMed] [Google Scholar]
- 31. Grgic-Vitek M. Estimating vaccination coverage against tick-borne encephalitis: comment on: Kosnik IG, Lah AK. A campaign to increase the vaccination rate in a highly endemic tick-borne encephalitis region of Slovenia. Vaccine 2013;31(5):732–4. Vaccine. 2014;32: 2944. [DOI] [PubMed] [Google Scholar]
- 32. Šmit R. Cost-effectiveness of tick-borne encephalitis vaccination in Slovenian adults. Vaccine. 2012;30: 6301–6306. 10.1016/j.vaccine.2012.07.083 [DOI] [PubMed] [Google Scholar]
- 33. Zavadska D, Anca I, Andre F, Bakir M, Chlibek R, Čižman M, et al. Recommendations for tick-borne encephalitis vaccination from the Central European Vaccination Awareness Group (CEVAG). 2013;9: 362–374. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Van Lier E, Havelaar A. Disease burden of infectious diseases in Europe: a pilot study 2007. Available: http://www.researchgate.net/profile/Arie_Havelaar/publication/27453442_Disease_burden_of_infectious_diseases_in_Europe_a_pilot_study/links/004635272cbb29f378000000.pdf. Accessed: March 2014. [DOI] [PubMed]
- 35.World Health Organization (WHO). Metrics: Disability-Adjusted Life Year (DALY). Definition. Available: http://www.who.int/healthinfo/global_burden_disease/metrics_daly/en/. Accessed: February 2014.
- 36.World Health Organization (WHO). Global Burden of Disease (GBD). Available: http://www.who.int/healthinfo/global_burden_disease/gbd/en/. Accessed: November 2015
- 37. Murray CJ. Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ. 1994;72: 429–445. [PMC free article] [PubMed] [Google Scholar]
- 38.World Health Organization (WHO). The Global Burden of Disease Concept. http://www.who.int/quantifying_ehimpacts/publications/en/9241546204chap3.pdf. Accessed: February 2014.
- 39. Murray CJ, Acharya AK. Understanding DALYs. J Health Econ. 1997;16: 703–730. [DOI] [PubMed] [Google Scholar]
- 40. Murray CJ, Lopez AD. Global mortality, disability, and the contribution of risk factors: Global Burden of Disease Study. 1997;349: 1436–1442. [DOI] [PubMed] [Google Scholar]
- 41. Murray CJ, Lopez AD. Mortality by cause for eight regions of the world: Global Burden of Disease Study. 1997;349: 1269–1276. [DOI] [PubMed] [Google Scholar]
- 42. Murray CJ, Lopez AD. Regional patterns of disability-free life expectancy and disability-adjusted life expectancy: Global Burden of Disease Study. 1997;349: 1347–1352. [DOI] [PubMed] [Google Scholar]
- 43. Murray CJ, Lopez AD. Alternative projections of mortality and disability by cause 1990–2020: Global Burden of Disease Study. 1997;349: 1498–1504. [DOI] [PubMed] [Google Scholar]
- 44. Murray CJ, Ferguson BD, Lopez AD, Guillot M, Salomon JA, Ahmad O. Modified logit life table system: principles, empirical validation, and application. 2003;57: 165–182. [Google Scholar]
- 45. Salomon JA, Murray CJ. The epidemiologic transition revisited: compositional models for causes of death by age and sex. 2002;28: 205–228. [Google Scholar]
- 46. Salomon JA, Tandon A, Murray CJ. Comparability of self rated health: cross sectional multi-country survey using anchoring vignettes. BMJ. 2004;328: 258 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. World Health Organization (WHO). The World Health Report 2000 –health systems: improving performance Geneva: World Health Organization. [Google Scholar]
- 48.World Health Organization (WHO). Methods and data sources for global burden of disease estimates 2000–2011. Available: http://www.who.int/healthinfo/statistics/GlobalDALYmethods_2000_2011.pdf?ua=12014. Accessed: April 2014.
- 49. Anand S, Hanson K. Disability-adjusted life years: a critical review. J Health Econ. 1997;16: 685–702. [DOI] [PubMed] [Google Scholar]
- 50. Barendregt JJ, Bonneux L, Van der Maas PJ. DALYs: the age-weights on balance. Bull World Health Organ. 1996;74: 439–443. [PMC free article] [PubMed] [Google Scholar]
- 51. Bognar G. Age-weighting. Cambridge Univ Press 2008;24: 167–189. [Google Scholar]
- 52. Arnesen T, Kapiriri L. Can the value choices in DALYs influence global priority-setting? Health Policy. 2004;70: 137–149. [DOI] [PubMed] [Google Scholar]
- 53. Airoldi M, Morton A. Adjusting life for quality or disability: stylistic difference or substantial dispute? Health Econ. 2009;18: 1237–1247. 10.1002/hec.1424 [DOI] [PubMed] [Google Scholar]
- 54. Lyttkens CH. Time to disable DALYs? 2003;4: 195–202. [DOI] [PubMed] [Google Scholar]
- 55. Murray CJ, Ezzati M, Flaxman AD, Lim S, Lozano R, Michaud C, et al. GBD 2010: design, definitions, and metrics. 2013;380: 2063–2066. [DOI] [PubMed] [Google Scholar]
- 56. Murray CJ, Ezzati M, Flaxman AD, Lim S, Lozano R, Michaud C, et al. GBD 2010: a multi-investigator collaboration for global comparative descriptive epidemiology. 2013;380: 2055–2058. [DOI] [PubMed] [Google Scholar]
- 57. Murray CJ, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. 2013;380: 2197–2223. [DOI] [PubMed] [Google Scholar]
- 58. Murray CJ, Ezzati M, Flaxman AD, Lim S, Lozano R, Michaud C, et al. Comprehensive Systematic Analysis of Global Epidemiology: Definitions, Methods, Simplification of DALYs, and Comparative Results from the Global Burden of Disease 2010 Study. 2010: 2063–2066. [Google Scholar]
- 59. Mangen MJ, Plass D, Havelaar AH, Gibbons CL, Cassini A, Mühlberger N, et al. The pathogen-and incidence-based DALY approach: an appropriated methodology for estimating the burden of infectious diseases. 2013;8: e79740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60. Kretzschmar M, Mangen MJ, Pinheiro P, Jahn B, Fevre EM, Longhi S, et al. New methodology for estimating the burden of infectious diseases in Europe. 2012;9: e1001205 10.1371/journal.pmed.1001205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61. Gibbons CL, Mangen MJ, Plass D, Havelaar AH, Brooke RJ, Kramarz P, et al. Measuring underreporting and under-ascertainment in infectious disease datasets: a comparison of methods. BMC Public Health. 2014;14: 147 10.1186/1471-2458-14-147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Mangen M, Gibbons C, Kretzschmar M, de Wit A, Havelaar A, van Lier A, et al. Current and future Burden of Communicable Diseases in the European Union and EEA/EFTA countries (BCoDE). Methodology protocol; 2011. [Google Scholar]
- 63.Nacionalni institut za javno zdravje (NIJZ). Epidemiolosko spremljanje nalezljivih bolezni v Sloveniji. 2014. Available: http://www.ivz.si/. Accessed February 2014.
- 64. Jereb M, Karner P, Muzlovič I, Jurca T. Severe tick-borne encephalitis in Slovenia in the years 2001–2005: Time for a mass vaccination campaign? Wien Klin Wochenschr. 2006;118: 765–768. [DOI] [PubMed] [Google Scholar]
- 65. Radšel-Medvešček A, Marolt-Gomišček M, Povše-Trojan M, Gajšek-Zima M, Cvetko B. Late sequelae after tick-borne meningoencephalitis in patients treated at the Hospital for Infectious Diseases, University Medical Centre of Ljubljana during the period 1974–1975 In: Vesenjak-Hirjan J, editor. Arboviruses in the Mediterranean countries. In: Anonymous Zbl Bakt Suppl. 9. Stuttgart, New York: Gustav Fischer Verlag.; 1980. pp. 281–284. [Google Scholar]
- 66. Kelly TA, O'Lorcain P, Moran J, Garvey P, McKeown P, Connell J, et al. Underreporting of viral encephalitis and viral meningitis, Ireland, 2005–2008. Emerg Infect Dis. 2013;19: 1428–1436. 10.3201/eid1909.130201 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.World Health Organization (WHO). Disability weights, discounting and age weighting of DALYs. Available: http://www.who.int/healthinfo/global_burden_disease/daly_disability_weight/en/. Accessed: February 2014.
- 68.World Health Organization (WHO). Global Burden of Disease 2004 update: Disability weights for diseases and conditions. Available: http://www.who.int/healthinfo/global_burden_disease/tools_national/en/index.html/. Accessed February 2014.
- 69. Livartowski A, Boucher J, Detournay B, Reinert P. Cost-effectiveness evaluation of vaccination against Haemophilus influenzae invasive diseases in France. Vaccine. 1996;14: 495–500. [DOI] [PubMed] [Google Scholar]
- 70. Logar M, Arnez M, Kolbl J, Avsic-Zupanc T, Strle F. Comparison of the epidemiological and clinical features of tick-borne encephalitis in children and adults. Infection. 2000;28: 74–77. [DOI] [PubMed] [Google Scholar]
- 71. Logar M, Bogovič P, Cerar D, Avšič-Županc T, Strle F. Tick-borne encephalitis in Slovenia from 2000 to 2004: comparison of the course in adult and elderly patients. Wien Klin Wochenschr. 2006;118: 702–707. [DOI] [PubMed] [Google Scholar]
- 72. Rakar R. Tick-borne meningoencephalitis In: Lesnicar J, ed. Bedjanic symposion on tick-borne meningoencephalitis. Dobrna: Infektoloska Sekcija SZD: 37–41. [Google Scholar]
- 73. Lesnicar G, Poljak M, Seme K, Lesnicar J. Pediatric tick-borne encephalitis in 371 cases from an endemic region in Slovenia, 1959 to 2000. Pediatr Infect Dis J. 2003;22: 612–617. [DOI] [PubMed] [Google Scholar]
- 74.Statistical Office of the Republic of Slovenia. Population by large and 5-year age groups and sex, statistical regions, Slovenia, half-yearly. Available: http://www.stat.si. Accessed February 2014.
- 75. European Centre for Disease Prevention and Control (ECDC). Epidemiological situation of tick -borne encephalitis in the European Union and European Free Trade Association countries Stockholm: ECDC; 2012. Available at: http://ecdc.europa.eu/en/publications/Publications/TBE-in-EU-EFTA.pdf. Accessed: March 2015. [Google Scholar]
- 76.International Scientific Working Group on Tick-Borne Encephalitis (ISW-TBE). ECDC presentation Tick-borne diseases: ECDC initiatives. Available: http://www.tbe-info.com/tbe.aspx. Accessed April 2015.2015.
- 77. Kunze U. TBE–awareness and protection: the impact of epidemiology, changing lifestyle, and environmental factors. 2010;160: 252–255. 10.1007/s10354-010-0798-x [DOI] [PubMed] [Google Scholar]
- 78. van Lier EA, Havelaar AH, Nanda A. The burden of infectious diseases in Europe: a pilot study. Euro Surveill. 2007;12: E3–4. [DOI] [PubMed] [Google Scholar]
- 79. Institute for Health Metrics and Evaluation (IHME). GBD Database. Seattle, WA: IHME, University of Washington, 2014. Available: http://www.healthdata.org/search-gbd-data?s=Slovenia. Accessed April 2015. [Google Scholar]
- 80. Kunz C. TBE vaccination and the Austrian experience. Vaccine. 2003;21: S50–S55. [DOI] [PubMed] [Google Scholar]
- 81.Nacionalni institut za javno zdravje (NIJZ). Navodila za izvajanje Programa cepljenja in zaščite z zdravili za leto 2013. Available: Accessed February 2014.
- 82.Nacionalni institut za javno zdravje (NIJZ). Priporocila za cepljenje proti klopnemu meningoencefalitisu za zdravnike cepitelje. Available: http://www.img.ivz.si/. Accessed February 2014.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All relevant data are within the paper.