Abstract
Appealing product characteristics, such as flavors, may stimulate e-cigarette use. While switching to e-cigarettes may reduce harm for smokers, concerns exist about e-cigarette use among never-smokers. The role of flavors in the decision to switch to or refrain from vaping is unclear. This study used a bottom–up approach to investigate the relation between flavor preferences and individual factors related to vaping between various user groups. A cross-sectional survey was conducted among never-users (n = 407), smokers (n = 138), dual users (n = 122), and exclusive vapers (n = 61) in the Netherlands. Demographics, attractiveness of product characteristics, flavor preferences, and individual factors related to vaping (knowledge, trust, perceived susceptibility, attitude, social influence, deliberation, and intention) were assessed. The availability of different flavors was the most attractive characteristic of e-cigarettes. Dual users and exclusive vapers had most often used tobacco and menthol/mint flavors when they first started vaping. Compared to dual users, exclusive vapers currently used more fruit and sweet flavors. Never-users who were interested in trying an e-liquid flavor had more knowledge about and a more positive attitude towards e-cigarettes. Smokers who were interested in trying a flavor had a more positive attitude towards e-cigarettes and experienced the social influence towards not using e-cigarettes as less strong than those who did not want to try any flavor. Hence, individual factors related to vaping differed depending on whether never-users and smokers wanted to try an e-liquid flavor. This means that flavors may moderate differences found in individual factors related to vaping, or vice versa.
Keywords: electronic cigarettes, flavors, preference, smoking, vaping, knowledge, attitude, deliberation, perceived susceptibility
1. Introduction
Although vaping prevalence in the Netherlands is currently rather low (3%) [1], the use of electronic cigarettes (e-cigarettes) increased worldwide in recent years [2,3]. The majority of e-cigarette users are former or current smokers [4,5,6] and literature has showed that e-cigarette use (i.e., vaping) may be associated with smoking cessation and reduction [7,8]. In the Netherlands, e-cigarettes are more often used by daily smokers (12%) compared to non-daily smokers (4%). Worldwide, vaping is also becoming increasingly popular among adolescent non- and never-smokers [3,9,10]. The regulation of e-cigarettes in order to optimize public health benefits is challenging and is currently an important topic of debate. Compared to cigarette smoking, vaping may reduce harm among smokers [11,12,13,14], but literature showed that e-cigarettes contain toxic ingredients [11]. In addition, concerns have been raised that vaping may contribute to nicotine addiction and the renormalization of cigarette smoking in adolescent never-smokers [3,15,16,17,18]. Consequently, from a public health perspective, the initiation of vaping by current non- and never-smokers and, thereby, exposure to potentially toxic ingredients should be prevented [18].
Research is needed to better understand differences between the initiation of e-cigarette use by current smokers versus non-smokers in order to inform regulators about policy making regarding e-cigarettes in order to develop targeted health communication for smokers, non-smokers, and e-cigarette users. Previous studies found differences in individual factors related to e-cigarettes among never-users, smokers, dual users, and e-cigarette users [19]. Individual factors that were found to differ included, for example, knowledge, perceived susceptibility, severity, trust, attitudes, deliberation, social influence, and intention [19,20,21,22,23]. Furthermore, literature showed that the importance of product characteristics such as design, price, and flavors may differ between adult smokers and adolescent non-smokers [24,25,26,27]. However, the relation between e-cigarette product characteristics and individual-level factors has been neglected.
A recent study hypothesized that there is an important interplay between individual-level factors and the characteristics of tobacco products [28]. Since product characteristics (e.g., flavors, design, and price) influence e-cigarette appeal [24,25,26,27] and may influence a person’s attitude towards e-cigarettes [24,28], such an interplay may also exist for e-cigarettes. However, thus far, most studies on e-cigarettes focused either on product characteristics [29], or on socio-cognitive factors related to vaping behavior [30]. In contrast, researchers in the food and nutrition domain have already recognized the importance of the interaction between product characteristics and individual-level decision-making factors in food choice [31,32,33]. For example, a model by Shepherd [31] shows that food choice is influenced by the interaction between physical or chemical properties of food, such as flavors (product factor), and the individual’s perception of and attitude towards those sensory properties (individual-level factors). Furthermore, flavors and other sensory properties are recognized as by far the most important factors in the acceptance and rejection of food products [32].
Similarly, since e-liquid flavors are recognized as an important reason for e-cigarette use [24], flavors may interact with individual-level factors related to vaping. Moreover, the availability of many different, mostly sweet, e-liquid flavors is an important reason for vaping among different types of users [24,29]. Research showed that for most e-cigarette users, and in particular for youth, the first and current e-liquid had a flavor other than tobacco [26,34,35]. In addition, flavors increase the probability of choosing e-cigarettes in an online discrete choice experiment among youth, for both never-users and ever-users of e-cigarettes [36]. Therefore, besides investigating product characteristics as reasons for e-cigarette use, additional research is needed to investigate the interaction between flavors as an e-cigarette product characteristic and individual factors related to vaping.
To increase our understanding of differences in e-cigarette appeal between user groups, this study firstly investigates which product characteristics are found attractive by Dutch never-users, smokers, dual users, and exclusive vapers. Secondly, we aim to determine the flavor preferences of Dutch never-users, smokers, dual users, and exclusive vapers. Thirdly, we aim to explore whether eight individual factors related to vaping differ between never-users and smokers who reported to be interested in trying an e-liquid flavor compared to those who reported not to be interested in trying any e-liquid flavor.
2. Materials and Methods
A cross-sectional survey was conducted in the Netherlands among never-users of e-cigarettes and cigarettes, cigarette smokers, dual users of e-cigarettes and cigarettes, and e-cigarette users. The survey was administered in May 2017 through the online survey panel Flycatcher, which is an ISO-certified independent research panel specialized in online research [37]. The study was approved by the Medical Ethics Committee of Zuyderland – Zuyd (17-N-88). The recruitment, participant characteristics, and survey were previously described in Romijnders, et al. [38].
2.1. Recruitment and Participant Characteristics
In total, 12,750 invitations were sent to panelists who met the following inclusion criteria: being able to understand Dutch; being aware of e-cigarettes; aged 13–17 years (adolescents) or 18 years and older (adults). Sample size was determined based on a power of 80% to identify a minimal difference of 1 on a 7-point Likert scale for attitude (based on previous literature [39]) as significant at p < 0.05. The sample cannot be considered representative of the Dutch population, as oversampling for the smokers and e-cigarette users was performed in order to achieve sufficient observations. Participants were asked to provide consent before the start of the survey. Parents of panelists under the age of 18 had previously provided consent for participation of their child in research questionnaires. Overall, 1307 surveys were completed, and the response rate was 10.3% (69.7% for adults, n = 694; 5.2% for adolescents, n = 613). For the current study, respondents were eligible if they met the definition of one of the following user groups (see Supplementary file 1 for the survey items used [38]): never-users are participants who reported to never have smoked and never used an e-cigarette; smokers are participants who reported to currently exclusively use cigarettes on a daily or weekly basis; dual users are participants who reported to currently simultaneously use cigarettes on a daily or weekly basis and e-cigarettes on a daily or weekly basis; vapers are participants who reported to currently exclusively use e-cigarettes on a daily or weekly basis [40].
It should be noted that these definitions, similar to studies performed before [39], includes individuals who had no history of smoking prior to becoming an exclusive vaper. In addition, and due to the cross-sectional nature of the data, no transitory phases for dual users and exclusive vapers can be determined [40]. We aimed for mutually exclusive groups. Hence, as the group of exclusive vapers may also include former smokers and the group of exclusive smokers may also include former vapers, former users were not included as a separate group. An overview of the items used to determine whether respondents met our definitions can be found in Supplementary file 1 [38]. In total, 728 participants met the eligibility criteria of this study. Of those, 394 were adults (62.4% female) and 334 were adolescents (46.7% female).
2.2. Survey
The current study included measures on basic demographics, attractiveness of e-cigarettes, flavor preferences, and individual factors related to vaping. The survey included routing to ensure that participants were asked about relevant items only (e.g., never-users were not asked which flavor their first e-cigarette had). A full overview of the items and concepts is available in Supplementary file 1 [38].
First, participants were asked about basic demographics, and smoking and vaping characteristics [19,24,40,41,42,43,44]. Educational level was determined based on the Dutch version of the International Standard Classification of Education (ISCED) [45].
Second, participants were asked to evaluate the attractiveness of eight product characteristics of e-cigarettes from a predetermined list using a check all that apply (CATA) approach that was based on previous research [19,24]. For the items that were used to assess demographics and attractiveness of product characteristics, see Supplementary file 1 [38].
Third, interest in trying an e-liquid flavor (for never-users and smokers), and the first and current e-liquid flavors used (for dual and e-cigarette users) were assessed. For the items that were used to assess flavor preferences, see Supplementary file 1 [38]. To assess flavor interest among never-users and smokers, multiple flavor categories [46] (CATA) or the option “none of the flavors” were selected. If the latter answer option was selected, no flavor category could be selected simultaneously. E-cigarette users and dual users were asked about their current and first e-liquid flavor used: “Which flavor do you currently use most? If possible, please specify the name of the flavor” and “Which flavor did you try first? If possible, please specify the name of the flavor.” For both current and first flavor used, dual users and e-cigarette users could select only one flavor category [46] and had to specify their choice through an open question. The answer options for never-users, smokers, dual users and e-cigarette users were: tobacco, menthol/mint, nuts, herbs, spices, coffee/tea, cocktails, alcohol, other, sodas, sweet (chocolate, vanilla, desserts, or other), fruit, milk products, candy, floral, unflavored, and none of the flavors. The closed answer options that were used to assess flavor preference in all user groups were recoded according to the thirteen main categories of the recently published e-liquid flavor wheel [47], except for the option “none of the flavors”. Recoding the reported flavor preferences resulted in the in the following thirteen main categories: tobacco (survey item: tobacco), menthol/mint (survey item: menthol/mint), nuts (survey item: nuts), spices (survey items: herbs, spices), coffee/tea (survey items: coffee; tea), alcohol (survey items: alcohol, cocktail; alcohol, other), other beverages (survey items: soda; sweet, other), fruit (survey item: fruit), dessert (survey items: sweet, dessert; milk product), other sweets (survey items: sweet, chocolate; sweet, vanilla), candy (survey items: sweet, candy), other flavors (survey items: floral; other) and unflavored (survey item: unflavored). Open answers from dual and e-cigarette users were assessed by two authors (KR and EK) to support recoding of the closed answers according to the categories of the e-liquid flavor wheel [47]. In some cases, multiple survey items were associated with one flavor category (e.g., the survey answer options “sweet, chocolate” and “sweet, vanilla” were both recoded to the other sweets flavor category). For equal weight of the flavor categories, each participant could obtain a maximum score of “1” for each flavor category. Thus, participants who reported being interested in both chocolate- and vanilla-flavored e-liquids received a total score of “1” for the other sweets flavor category.
Fourth, individual factors related to vaping were assessed (see Supplementary file 1 [38] for the items that were used). Evidence-based knowledge about smoking and vaping was measured with 12 statements that were either correct or incorrect. We consider evidence-based knowledge as knowledge that is based on scientific consensus—that is, information provided by the Dutch National Institute of Public Health and the Environment (RIVM) and previous research [19,48,49]. The knowledge items were summed (1 = correct, 0 = incorrect; ‘I don’t know’ was categorized as incorrect). Furthermore, a 7-point Likert scale was used to assess trust in information (two items) [50], perceived susceptibility towards e-cigarettes (three items: item A, item B, item C) [51,52], severity related to vaping (four items [51,52]), attitude towards e-cigarettes (four items) [39,48], social influence (one item) [53], deliberation about vaping (three items) [48], and intention to start using e-cigarettes (one item). A scale was computed for trust in information, severity related to vaping, attitude towards e-cigarettes, and deliberation of the pros and cons of vaping, by averaging the scores of the two items for trust (Cronbach’s α = 0.915), the four items for severity (Cronbach’s α = 0.639), the four items of attitude (Cronbach’s α = 0.927), and the three items for deliberation (Cronbach’s α = 0.656). No scale could be computed for perceived susceptibility towards e-cigarettes (Cronbach’s α ≤ 0.6)—thus, for each user group, the three mean scores for perceived susceptibility towards e-cigarettes and the three mean scores for perceived susceptibility towards cigarettes (for each individual survey item) were used. Similarly, for each user group, the mean score for each item regarding intention and social influence was determined.
2.3. Data Analysis
IBM statistics SPSS version 24 (IBM, Armonk, NY, USA) [54] was used for data analysis. No data were excluded. Attractiveness of product characteristics, and the e-liquid flavor categories preferred (for never-users and smokers, excluding those who selected the answer option “I don’t want to try any flavor”) and firstly and currently used (for dual and exclusive vapers) were analyzed using frequencies. Flavor preferences were presented in a pie chart as the percentage of the total number of responses.
Spearman correlation analyses showed that age (p < 0.05), gender, and level of education (<0.05) were significantly associated with individual factors related to vaping. However, these Spearman correlations were small, ranging from −0.211 to 0.169. Age, level of education, and gender were therefore excluded from further analyses due to small or non-significant correlations.
Individual factors were compared between both never-users and smokers interested in trying an e-liquid flavor and those not interested in trying a flavor (answer option: “none of the flavors”) using t-tests. Results were considered significant if p < 0.05.
3. Results
Of the 728 never-users, smokers, dual users, and exclusive e-cigarette users, 23.7% was highly educated (50.0% low education level and 26.2% middle education level), and the average age was 34.1 (± 20.2, min = 13, max = 84) (see Table 1).
Table 1.
Participants’ Demographics and the Attractiveness of E-Cigarette Product Characteristics | Never-users (n = 407) |
Smokers (n = 138) |
Dual Users (n = 122) |
Exclusive Vapers (n = 61) |
|
---|---|---|---|---|---|
Mean age (±SD) | 31 (18.6) D | 35 (20.6) | 37 (18.8) N | 37 (19.4) | |
Gender | Male | 44.0% | 37.7% | 53.3% | 49.2% |
Female | 56.0% | 62.3% | 46.7% | 50.8% | |
Education | Low | 52.1% | 52.9% | 43.4% | 39.3% |
Middle | 20.6% D,E | 30.4% | 35.2% N | 44.3% N | |
High | 27.3% | 16.7% | 21.3% | 16.4% | |
Attractive characteristics of e-cigarettes (%) | All the different flavors | 10.3% | 30.4% | 34.4% | 68.9% |
The product looks nice | 6.6% | 19.6% | 22.1% | 44.3% | |
The nicotine level can be varied | 4.7% | 13.8% | 15.6% | 31.1% | |
It is possible to alter the setting of the e-cigarette to my wishes | 3.7% | 10.9% | 12.3% | 24.6% | |
Its varying designs | 3.2% | 9.4% | 10.7% | 21.3% | |
You can blow nice smoke clouds with it (cloud chasing) | 2.5% | 7.2% | 8.2% | 16.4% | |
Price of the product | 2.0% | 5.8% | 6.6% | 13.1% | |
Price of the e-liquids | 2.0% | 5.8% | 6.6% | 13.1% |
N,D,E Superscripts indicate significant differences in a row between user groups (p < 0.05), with N = never-users, D = dual users, and E = exclusive vapers. Significant differences between user groups were determined for age, gender, and education using Bonferroni post-hoc corrections. General note: due to rounding, percentages may not add up to 100%.
3.1. Attractiveness of Product Characteristics
Table 1 shows attractiveness of e-cigarette product characteristics, stratified by user group. From the e-cigarette product characteristics assessed, all groups reported flavors as the most attractive.
3.2. E-Liquid Flavor Preferences
Of the 407 never-users, 68% selected the option “none of the flavors” (n = 278 participants) and 32% selected to be interested in trying one or more e-liquid flavor” and 32% (n = 248 responses)). Of the 138 smokers, 20% (n = 27 participants) were interested in none of the flavors and 80% (n = 208 responses) selected to be interested in trying one or more e-liquid flavor categories.
Figure 1 shows e-liquid flavor preferences as the percentage of each flavor category for never-users and smokers. Never-users were mostly interested in trying e-liquid flavors from the menthol/mint (19% of 248 responses) and sweet categories, such as other sweets (19%) and fruit (14%). Smokers were mostly interested in e-liquids with tobacco flavor (30%), followed by menthol/mint (18%) and other sweets (9%).
Of the 122 dual users, 120 reported the flavor of their first e-cigarette used and 121 reported the flavor they currently use (see Figure 2). Of the 61 exclusive vapers, 58 reported the flavor of both their first and current e-cigarette. Among dual users, the most frequently reported flavors of their current and first e-cigarette used were similar: tobacco (52% vs. 53%), menthol/mint (26% vs. 27%), other sweets (10% vs. 11%), and fruit (7% vs. 6%). Among exclusive vapers, differences were observed in the most frequently reported flavors of their current and first e-cigarette used: tobacco (43% vs. 53%), menthol/mint (19% vs. 28%)), and fruit (14% vs. 9%) and other sweets (14% vs. 7%).
3.3. Individual Factors Related to Vaping
Table 2 shows differences in individual factors related to vaping between never-users and smokers. In addition, differences within the groups of never-users and smokers between those who were interested in trying an e-liquid flavor and those who did not want to try any flavor are shown. Never-users who were interested in trying a flavor had significantly less knowledge about e-cigarettes compared to never-users who did not want to try any e-liquid flavor (p < 0.05). Not surprisingly, never-users and smokers who were interested in trying a flavor were significantly more positive towards e-cigarettes and had a significant higher intention to start vaping, compared to never users and smokers who reported not wanting to try any e-liquid flavor (p < 0.05), within both never-users and smokers. Never-users who were interested in trying a flavor reported a lower perceived susceptibility (item C) than never-users who did not want to try a flavor (p < 0.05). In addition, smokers who were interested in trying a flavor considered the social influence towards not using e-cigarettes as less strong, which means that the smokers who were not interested in trying an e-cigarette flavor more often find that society thinks that one should not vape (p < 0.05).
Table 2.
Individual Factors Related to Vaping | Never-users (n = 407) |
Smokers (n = 138) |
||
---|---|---|---|---|
Knowledge about e-cigarettes and cigarettes (±SD) | Overall | 9.3 (1.5) * | 8.4 (1.8) * | |
Those interested in trying a flavor | 8.9 (1.7) ° | 8.4 (1.7) | ||
Those who did not want to try any flavor | 9.4 (1.4) ° | 8.3 (2.1) | ||
Trust in information (±SD) | Overall | 5.2 (1.1) | 4.9 (1.4) | |
Those interested in trying a flavor | 5.2 (1.0) | 4.9 (1.4) | ||
Those who did not want to try any flavor | 5.2 (1.4) | 5.1 (1.5) | ||
Perceived susceptibility about vaping (±SD) | A | Overall | 4.9 (1.3) * | 4.3 (1.2) * |
Those interested in trying a flavor | 4.8 (1.3) | 4.2 (1.2) | ||
Those who did not want to try any flavor | 4.9 (1.3) | 4.4 (1.2) | ||
B | Overall | 5.0 (1.2) * | 4.3 (1.2) * | |
Those interested in trying a flavor | 4.8 (1.2) | 4.3 (1.2) | ||
Those who did not want to try any flavor | 5.1 (1.2) | 4.5 (1.2) | ||
C | Overall | 4.9 (1.2) * | 4.3 (1.2) * | |
Those interested in trying a flavor | 4.8 (1.3) ° | 4.2 (1.2) | ||
Those who did not want to try any flavor | 5.0 (1.2) ° | 4.6 (1.2) | ||
Severity of vaping (±SD) | Overall | 4.6 (1.1) * | 4.4 (1.1) * | |
Those interested in trying a flavor | 4.6 (1.1) | 4.4 (1.2) | ||
Those who did not want to try any flavor | 4.6 (1.1) | 4.1 (1.1) | ||
Attitude towards e-cigarettes (±SD) | Overall | 2.1 (1.1) * | 3.5 (1.1) * | |
Those interested in trying a flavor | 2.6 (1.2) ° | 3.7 (1.0) ° | ||
Those who did not want to try any flavor | 1.9 (1.0) ° | 2.9 (1.2) ° | ||
Social influence (±SD) | Overall | 5.1 (1.7) * | 4.4 (1.5) N | |
Those interested in trying a flavor | 4.9 (1.7) | 4.2 (1.5) ° | ||
Those who did not want to try any flavor | 5.2 (1.7) | 5.1 (1.2) ° | ||
Deliberation on the pros and cons of e-cigarette use (±SD) | Overall | 2.8 (1.5) | 3.0 (1.5) | |
Those interested in trying a flavor | 2.9 (1.6) | 3.1 (1.4) | ||
Those who did not want to try any flavor | 2.7 (1.5) | 2.7 (1.7) | ||
Intention to start vaping (±SD) | Overall | 1.2 (±0.8) * | 2.5 (±1.7) * | |
Those interested in trying a flavor | 1.4 (1.1) ° | 2.7 (1.7) ° | ||
Those who did not want to try any flavor | 1.1 (0.6) ° | 1.6 (1.4) ° |
* Indicates significant differences (p < 0.05) in a row between user groups. ° Indicates a within-group significant difference (p < 0.05) between those who were interested in trying any e-liquid flavor and those who were not interested in trying any e-liquid flavor (only for never-users and smokers). Knowledge was determined using 12 statements. A higher score represents more knowledge, with 0 = no correct answers and 12 = correct answers for all statements. Trust was assessed with two items, using a 7-point Likert scale; 1 low to 7 = high level of trust in information provided. Perceived susceptibility assessed the chance of developing cancer as a result of vaping with three statements: (A) If I vape, then my risk of developing some form of cancer during my lifetime is…; (B) I think that if I vape, my risk of developing some form of cancer during my lifetime is …; (C) My feeling is that if I vape, the risk of developing some form of cancer during my lifetime is…; 1 = low to 7 = perception of cognitive risk of health risks related to e-cigarette use. Severity was assessed with four items, on a 7-point Likert scale ranging from very bad to not bad at all (1–7); Attitude was assessed with four items, using a 7-point Likert scale, with 1 = very negative towards e-cigarette use and 7 = very positive towards e-cigarette use. Deliberation was assessed with three items on a 7-point Likert scale, with 1 = no deliberation about E-cigarette use to 7 = very extensive deliberation about E-cigarette use. Intention to start vaping was reported on a 7-point Likert scale, with 1= very low intention to start vaping and 7 = very high intention to start vaping.
4. Discussion
This study shows that the availability of different flavors was reported to be the most attractive product characteristic of e-cigarettes by all user groups, and that flavor preferences differ between never-users, smokers, dual users, and exclusive vapers. The first e-cigarette used by dual users and vapers mostly had a tobacco or menthol/mint flavor, but compared to dual users, we observed that exclusive vapers use more sweet- and fruit-flavored e-liquids than dual users. While tobacco was the most appealing flavor category among smokers, never-users were mostly interested in trying menthol- and sweet-flavored e-liquids. In addition, individual factors related to vaping differed within the groups of never-users and smokers. That is, never-users interested in trying a flavor had less knowledge about cigarettes and e-cigarettes than those who did not want to try any flavor. Attitude was more positive, and intention to start vaping was higher among both never-users and smokers who were interested in trying a flavor compared to those not interested in trying a flavor. Perceived susceptibility of health consequences was lower among never-users who were interested in trying a flavor, and social influence regarding not using e-cigarettes was lower among smokers who were interested in trying a flavor. Thus, similarly to the role of flavors in food choice [31,32], our results indicate that interest in flavors may moderate the differences in individual factors related to vaping.
While concerns have been raised about potential e-cigarette use among never-users [3,9,55], the never-users in our study had a low intention to start vaping and more than two-third (68%) of the never-users did not want to try any e-liquid flavor. However, nearly one-third of the never-users were still interested in trying an e-liquid flavor. Not surprisingly, they perceived a lower susceptibility towards negative health consequences of vaping, had a more positive attitude towards e-cigarettes, less knowledge about cigarettes and e-cigarettes, and a higher intention to start vaping than never-users who did not want to try any flavor. It should, however, be noted that a causal relation between these findings was not examined. For example, never-users could report to find e-liquid flavors interesting because they were already interested in trying e-cigarettes. On the other hand, they may have become interested in trying e-cigarettes because of the appealing flavors that they recognize from palatable food products. This means that being interested in flavors has a positive effect on the decision to start using e-cigarettes, or vice versa. Nevertheless, our findings regarding the interest of never-users in e-liquid flavors indicate that never-users may be vulnerable to flavor marketing of e-cigarettes [26,27,56,57]. For example, marketing of appealing e-liquid flavors may make never-users even more positive towards vaping, thereby potentially influencing their choice to initiate or refrain from vaping [19]. This suggests that the reverse can also be true: adapting product characteristics, for example restricting e-liquid flavors or regulating other product characteristics, may reduce attractiveness and consequently make never-users more negative about vaping. Some characteristics of e-liquids are currently regulated by Tobacco Regulation in the Netherlands [58,59]. However, legislation regarding e-liquid flavors currently does not exist. Further research is needed to help regulators decide whether and how the regulation of e-liquid flavors can improve public health.
This study showed that smokers who were interested in trying an e-liquid flavor had a more positive attitude towards e-cigarettes than smokers who were not interested in trying a flavor. In addition, smokers who were interested in trying a flavor considered the social influence towards not using e-cigarettes as less strong, which means that the smokers who were not interested in trying an e-cigarette flavor more often find that society thinks that one should not vape. Furthermore, two-third of the smokers reported interest in an e-liquid flavor other than tobacco. This indicates that flavors could support the decision of smokers to switch to vaping [57], for example by allowing the marketing of e-liquid flavors and other product characteristics that smokers find attractive [4]. The role of e-liquid flavors in supporting both the decision to switch towards e-cigarette use (for smokers) and to refrain from using e-cigarettes (for never-users) demonstrates the complexity of developing future regulations on e-liquid flavors.
Additional support for the interest in flavors moderating differences in individual factors related to vaping is provided by the different patterns of e-liquid flavors used by dual users and exclusive vapers. In line with previous research, both groups mostly used tobacco and mint flavored e-cigarettes at initiation, but exclusive vapers currently used more fruit and sweet e-liquid flavors than dual users [5,34,60,61,62]. This could be interpreted as vapers switching from tobacco to non-tobacco flavors over time, which is supported by a previous study [5]. Because most adult exclusive vapers included in this study used e-cigarettes for 1 to 5 years and most dual users reported to vape for only less than 6 months (data not shown), it is possible that the dual users may switch to fruit or sweet e-liquid flavors in the future. Longitudinal research is needed to investigate whether and how e-liquid flavors could support dual users in their decision to switch to exclusive vaping. In addition, it would be interesting to investigate the process of e-liquid flavors (or other product characteristics) eventually not living up to dual users’ expectation, thereby leaving them to quit vaping and relapse into exclusive cigarette smoking. This information could be used to, for example, stimulate an exchange of knowledge and experiences between exclusive vapers and dual users about the flavored e-liquids they use [63].
4.1. Future Research
Previous studies assessing individual factors related to vaping mostly focused their survey items on e-cigarettes in general. This means that participants are typically asked about their mental representation or beliefs of an unspecified e-cigarette, thereby not taking into account that the e-cigarette is a product that is available in various shapes, sizes, colors, flavors, and more. As our results suggest that flavors may moderate the differences in individual factors related to vaping, we recommend using survey items that represent a specific flavor or other product characteristic. For example, instead of only focusing on perceived susceptibility attitude towards e-cigarettes in general [64,65], researchers should also assess perceived susceptibility attitudes towards a specific e-liquid flavor categories, such as fruit, candy, and tobacco [47].
In addition, as other product characteristics may moderate differences found in individual factors related to vaping, the impact of for example price, labeling, and packaging of e-cigarettes and e-liquids on individual factors related to vaping should be investigated in different user groups [66] to determine which characteristics make up their “ideal” e-cigarette.
Furthermore, it would be interesting to use sensory research to investigate differences in e-liquid flavor liking between user groups, and how this relates to individual factors related to vaping. Finally, research is needed to investigate the interaction between product characteristics and individual factors related to new and emerging products, such as heated tobacco products and products containing nicotine salts. This will provide insight into which specific product characteristics are most appealing to vulnerable user groups, such as never-users and youth, and thus need to be regulated.
4.2. Limitations
Ideally, our sample size would be large enough to stratify our sample into different age groups and different flavor categories. However, our sample size was too small to determine differences in the preference of specific flavor categories between age groups (adults vs. adolescents), and differences in individual factors related vaping between specific flavor categories. In addition, response rates among adolescents was very low, and the rather high education level of participants in this study was not be representative of the Dutch population [67,68]. In addition, the sample cannot be considered representative of the Dutch population, as oversampling for the smokers and e-cigarette users was performed in order to have sufficient observations. As a result, the percentages of smokers and vapers in our study do not reflect the actual percentages of smokers and vapers in the Dutch population.
5. Conclusions
This study demonstrates that being interested in flavors moderates the differences in individual factors related to vaping for never-users and smokers, or vice versa. While the availability of different flavors was reported to be the most attractive product characteristic of e-cigarettes in all user groups, the specific flavor preferences varied between never-users, smokers, dual users, and exclusive vapers. Importantly, individual factors related to vaping (knowledge, perceived susceptibility attitude, social influence, and intention to start vaping) differed between never-users and/or smokers who were interested in trying an e-liquid flavor and those who did not want to try a flavor. Our results confirm the importance and complexity of regulating e-liquid flavors in a way that both the decision to switch towards vaping (for smokers) and the decision to refrain from vaping (for never-users) are supported. Ideally, regulation should allow marketing of e-liquid flavors that stimulate smokers and dual users to keep or start using e-cigarettes. To make never-users more negative about and keep them from using e-cigarettes, product appeal should be reduced by, for example, restricting the marketing and promotion of e-liquid flavors that they find particularly appealing.
Acknowledgments
We gratefully thank the study participants for their time and thoughtful consideration, and we thank Selma Eising for her critical feedback on the manuscript. The authors would also like to thank Liesbeth van Osch for her valuable contribution during the conceptualization of this study.
Supplementary Materials
The following are available online at https://www.mdpi.com/1660-4601/16/23/4661/s1, Supplementary file 1 was previously described in Romijnders, Pennings, van Osch, de Vries and Talhout [38].
Author Contributions
K.A.G.J.R. and E.J.Z.K. contributed equally. Conceptualization: K.A.G.J.R., E.J.Z.K., H.d.V., and R.T.; methodology, K.A.G.J.R.; formal analysis, K.A.G.J.R. and E.J.Z.K.; data curation, K.A.G.J.R.; writing—original draft preparation, K.A.G.J.R. and E.J.Z.K.; writing—review and editing, K.A.G.J.R., E.J.Z.K., H.d.V., S.B., K.d.G., and R.T.; visualization, E.J.Z.K.; supervision, H.d.V., S.B., K.d.G., and R.T.
Funding
This research received no external funding but was supported by the Dutch National Institute for Public Health and the Environment (RIVM) (grant number S132006).
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Springvloet L., Bommele J., Willemsen M., van Laar M. Kerncijfers Roken 2017. Trimbos-instituut; Utrecht, The Netherlands: 2018. [Google Scholar]
- 2.Filippidis F.T., Laverty A.A., Gerovasili V., Vardavas C.I. Two-year trends and predictors of e-cigarette use in 27 European Union member states. Tob. Control. 2017;26:98–104. doi: 10.1136/tobaccocontrol-2015-052771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.McMillen R.C., Gottlieb M.A., Shaefer R.M., Winickoff J.P., Klein J.D. Trends in Electronic Cigarette Use Among U.S. Adults: Use is Increasing in Both Smokers and Nonsmokers. Nicotine Tob. Res. 2015;17:1195–1202. doi: 10.1093/ntr/ntu213. [DOI] [PubMed] [Google Scholar]
- 4.Diamantopoulou E., Barbouni A., Merakou K., Lagiou A., Farsalinos K. Patterns of e-cigarette use, biochemically verified smoking status and self-reported changes in health status of a random sample of vapeshops customers in Greece. Intern. Emerg. Med. 2019 doi: 10.1007/s11739-018-02011-1. [DOI] [PubMed] [Google Scholar]
- 5.Russell C., McKeganey N., Dickson T., Nides M. Changing patterns of first e-cigarette flavor used and current flavors used by 20,836 adult frequent e-cigarette users in the USA. Harm Reduct. J. 2018;15:33. doi: 10.1186/s12954-018-0238-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Nationaal Expertisecentrum Tabaksontmoediging (Trimbos-instituut). Kerncijfers Roken. 2017. [(accessed on 12 September 2019)]; Available online: https://www.trimbos.nl/docs/cdade14e-20dc-462a-9f63-1b71ee995a84.pdf.
- 7.Rahman M.A., Hann N., Wilson A., Mnatzaganian G., Worrall-Carter L. E-cigarettes and smoking cessation: Evidence from a systematic review and meta-analysis. PLoS ONE. 2015;10:e0122544. doi: 10.1371/journal.pone.0122544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chan G., Morphett K., Gartner C., Leung J., Yong H.H., Hall W., Borland R. Predicting vaping uptake, vaping frequency and ongoing vaping among daily smokers using longitudinal data from the International Tobacco Control (ITC) Four Country Surveys. Addiction. 2018 doi: 10.1111/add.14537. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Miech R., Johnston L., O’Malley P.M., Bachman J.G., Patrick M.E. Adolescent Vaping and Nicotine Use in 2017–2018—U.S. National Estimates. N. Engl. J. Med. 2019;380:192–193. doi: 10.1056/NEJMc1814130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cullen K.A., Gentzke A.S., Sawdey M.D., Chang J.T., Anic G.M., Wang T.W., Creamer M.R., Jamal A., Ambrose B.K., King B.A. e-Cigarette Use Among Youth in the United States, 2019. JAMA. 2019 doi: 10.1001/jama.2019.18387. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Prochaska J.J. The public health consequences of e-cigarettes: A review by the National Academies of Sciences. A call for more research, a need for regulatory action. Addiction. 2019;114:587–589. doi: 10.1111/add.14478. [DOI] [PubMed] [Google Scholar]
- 12.Chen J., Bullen C., Dirks K. A Comparative Health Risk Assessment of Electronic Cigarettes and Conventional Cigarettes. Int. J. Environ. Res. Public Health. 2017;14:382. doi: 10.3390/ijerph14040382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Goniewicz M.L., Gawron M., Smith D.M., Peng M., Jacob P., Benowitz N.L. Exposure to Nicotine and Selected Toxicants in Cigarette Smokers Who Switched to Electronic Cigarettes: A Longitudinal Within-Subjects Observational Study. Nicotine Tob. Res. 2017;19:160–167. doi: 10.1093/ntr/ntw160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Levy D.T., Borland R., Lindblom E.N., Goniewicz M.L., Meza R., Holford T.R., Yuan Z., Luo Y., O’Connor R.J., Niaura R., et al. Potential deaths averted in USA by replacing cigarettes with e-cigarettes. Tob. Control. 2018;27:18–25. doi: 10.1136/tobaccocontrol-2017-053759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kinouani S., Pereira E., Tzourio C. Electronic Cigarette Use in Students and Its Relation with Tobacco-Smoking: A Cross-Sectional Analysis of the i-Share Study. Int. J. Environ. Res. Public Health. 2017;14:1345. doi: 10.3390/ijerph14111345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Liu X., Lugo A., Davoli E., Gorini G., Pacifici R., Fernandez E., Gallus S. Electronic cigarettes in Italy: A tool for harm reduction or a gateway to smoking tobacco? Tob. Control. 2019 doi: 10.1136/tobaccocontrol-2018-054726. [DOI] [PubMed] [Google Scholar]
- 17.Soneji S., Barrington-Trimis J.L., Wills T.A., Leventhal A.M., Unger J.B., Gibson L.A., Yang J., Primack B.A., Andrews J.A., Miech R.A., et al. Association Between Initial Use of e-Cigarettes and Subsequent Cigarette Smoking Among Adolescents and Young Adults: A Systematic Review and Meta-analysis. JAMA Pediatr. 2017;171:788–797. doi: 10.1001/jamapediatrics.2017.1488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.McRobbie H. Modelling the Population Health Effects of E-Cigarettes Use: Current Data Can Help Guide Future Policy Decisions. Nicotine Tob. Res. 2017;19:131–132. doi: 10.1093/ntr/ntw387. [DOI] [PubMed] [Google Scholar]
- 19.Romijnders K., van Osch L., de Vries H., Talhout R. A Deliberate Choice? Exploring the Decision to Switch from Cigarettes to E-Cigarettes. Int. J. Environ. Res. Public Health. 2019;16:624. doi: 10.3390/ijerph16040624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Marteau T.M., Dormandy E., Crockett R. Informed choice: Why measuring behaviour is important. Arch. Dis. Child. 2005;90:546–547. [PMC free article] [PubMed] [Google Scholar]
- 21.Van den Berg M., Timmermans D.R., ten Kate L.P., van Vugt J.M., van der Wal G. Informed decision making in the context of prenatal screening. Patient Educ. Couns. 2006;63:110–117. doi: 10.1016/j.pec.2005.09.007. [DOI] [PubMed] [Google Scholar]
- 22.Baron J. Thinking and Deciding. 4th ed. Cambridge University Press; Cambridge, UK: 2007. [Google Scholar]
- 23.Gray R.J., Hoek J., Edwards R. A qualitative analysis of ‘informed choice’ among young adult smokers. Tob. Control. 2016;25:46–51. doi: 10.1136/tobaccocontrol-2014-051793. [DOI] [PubMed] [Google Scholar]
- 24.Romijnders K., van Osch L., de Vries H., Talhout R. Perceptions and Reasons Regarding E-Cigarette Use among Users and Non-Users: A Narrative Literature Review. Int. J. Environ. Res. Public Health. 2018;15:1190. doi: 10.3390/ijerph15061190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Laverty A.A., Vardavas C.I., Filippidis F.T. Design and marketing features influencing choice of e-cigarettes and tobacco in the EU. Eur. J. Public Health. 2016;26:838–841. doi: 10.1093/eurpub/ckw109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Villanti A.C., Johnson A.L., Ambrose B.K., Cummings K.M., Stanton C.A., Rose S.W., Feirman S.P., Tworek C., Glasser A.M., Pearson J.L., et al. Flavored Tobacco Product Use in Youth and Adults: Findings From the First Wave of the PATH Study (2013–2014) Am. J. Prev. Med. 2017;53:139–151. doi: 10.1016/j.amepre.2017.01.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chen-Sankey J.C., Kong G., Choi K. Perceived ease of flavored e-cigarette use and e-cigarette use progression among youth never tobacco users. PLoS ONE. 2019;14:e0212353. doi: 10.1371/journal.pone.0212353. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.McClernon F.J., Pacek L.R., Wiley J.L. A Conceptual Framework for Understanding Multiple Tobacco Product Use and the Impact of Regulatory Action. Nicotine Tob. Res. 2018;21:268–277. doi: 10.1093/ntr/nty129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Zare S., Nemati M., Zheng Y. A systematic review of consumer preference for e-cigarette attributes: Flavor, nicotine strength, and type. PLoS ONE. 2018;13:e0194145. doi: 10.1371/journal.pone.0194145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Adriaens K., Van Gucht D., Baeyens F. Differences between Dual Users and Switchers Center around Vaping Behavior and Its Experiences Rather than Beliefs and Attitudes. Int. J. Environ. Res. Public Health. 2017;15:12. doi: 10.3390/ijerph15010012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Shepherd R. Social determinants of food choice. Proc. Nutr. Soc. 1999;58:807–812. doi: 10.1017/S0029665199001093. [DOI] [PubMed] [Google Scholar]
- 32.Rozin P., Fallon A. The psychological categorization of foods and non-foods: A preliminary taxonomy of food rejections. Appetite. 1980;1:193–201. doi: 10.1016/S0195-6663(80)80027-4. [DOI] [Google Scholar]
- 33.Stafleu A., de Graaf C., Van Staveren W.A., Burema J. Affective and cognitive determinants of intention to consume twenty foods that contribute to fat intake. Ecol. Food Nutr. 2001;40:193–214. doi: 10.1080/03670244.2001.9991650. [DOI] [Google Scholar]
- 34.Harrell M.B., Weaver S.R., Loukas A., Creamer M., Marti C.N., Jackson C.D., Heath J.W., Nayak P., Perry C.L., Pechacek T.F., et al. Flavored e-cigarette use: Characterizing youth, young adult, and adult users. Prev. Med. Rep. 2017;5:33–40. doi: 10.1016/j.pmedr.2016.11.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Huang L.L., Baker H.M., Meernik C., Ranney L.M., Richardson A., Goldstein A.O. Impact of non-menthol flavours in tobacco products on perceptions and use among youth, young adults and adults: A systematic review. Tob. Control. 2017;26:709–719. doi: 10.1136/tobaccocontrol-2016-053196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Shang C., Huang J., Chaloupka F.J., Emery S.L. The impact of flavour, device type and warning messages on youth preferences for electronic nicotine delivery systems: Evidence from an online discrete choice experiment. Tob. Control. 2018;27:e152–e159. doi: 10.1136/tobaccocontrol-2017-053754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.B.V. FIR. Voed de discussie met onderzoek dat zelf nooit ter discussie staat. [(accessed on 17 August 2019)]; Available online: https://www.flycatcher.eu/
- 38.Romijnders K., Pennings J.L.A., van Osch L., de Vries H., Talhout R. A Combination of Factors Related to Smoking Behavior, Attractive Product Characteristics, and Socio-Cognitive Factors are Important to Distinguish a Dual User from an Exclusive E-Cigarette User. Int. J. Environ. Res. Public Health. 2019;16:4191. doi: 10.3390/ijerph16214191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Schoren C., Hummel K., Vries H. Electronic cigarette use: Comparing smokers, vapers, and dual users on characteristics and motivational factors. Tob. Prev. Cessat. 2017;3 doi: 10.18332/tpc/69392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Borland R., Murray K., Gravely S., Fong G.T., Thompson M.E., McNeill A., O’Connor R.J., Goniewicz M.L., Yong H.H., Levy D.T., et al. A new classification system for describing concurrent use of nicotine vaping products alongside cigarettes (so-called dual use): Findings from the ITC-4 Country Smoking and Vaping wave 1 Survey. Addiction. 2019;114(Suppl. 1):24–34. doi: 10.1111/add.14570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Pearson J.L., Hitchman S.C., Brose L.S., Bauld L., Glasser A.M., Villanti A.C., McNeill A., Abrams D.B., Cohen J.E. Recommended core items to assess e-cigarette use in population-based surveys. Tob. Control. 2018;27:341–346. doi: 10.1136/tobaccocontrol-2016-053541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Amato M.S., Boyle R.G., Levy D. How to define e-cigarette prevalence? Finding clues in the use frequency distribution. Tob. Control. 2016;25:e24–e29. doi: 10.1136/tobaccocontrol-2015-052236. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.International Tobacco Control Policy Evaluation Project. ITC Netherlands (NL11_Pw) [(accessed on 10 January 2018)]; Available online: https://www.itcproject.org/files/ITC_NL11_Replenishment_S_web_Eng_Dut.pdf.
- 44.Heatherton T.F., Kozlowski L.T., Frecker R.C., Fagerstrom K.O. The Fagerstrom Test for Nicotine Dependence: A revision of the Fagerstrom Tolerance Questionnaire. Br. J. Addict. 1991;86:1119–1127. doi: 10.1111/j.1360-0443.1991.tb01879.x. [DOI] [PubMed] [Google Scholar]
- 45.Centraal Bureau voor Statistiek (CBS) International Standard Classification of Education (ISCED) [Dutch version] Centraal Bureau voor Statistiek (CBS); Heerlen, The Netherlands: 2018. p. 39. [Google Scholar]
- 46.Yingst J.M., Veldheer S., Hammett E., Hrabovsky S., Foulds J. A Method for Classifying User-Reported Electronic Cigarette Liquid Flavors. Nicotine Tob. Res. 2017;19:1381–1385. doi: 10.1093/ntr/ntw383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Krusemann E.J.Z., Boesveldt S., de Graaf K., Talhout R. An E-liquid Flavor Wheel: A Shared Vocabulary based on Systematically Reviewing E-liquid Flavor Classifications in Literature. Nicotine Tob. Res. 2018 doi: 10.1093/ntr/nty101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Lehmann B.A., de Melker H.E., Timmermans D.R.M., Mollema L. Informed decision making in the context of childhood immunization. Patient Educ. Couns. 2017;100:2339–2345. doi: 10.1016/j.pec.2017.06.015. [DOI] [PubMed] [Google Scholar]
- 49.National institute for Public Health and the Environment (RIVM). Tobacco. [(accessed on 19 June 2019)]; Available online: https://www.rivm.nl/tabak.
- 50.Siegrist M., Earle T.C., Gutscher H. Test of a trust and confidence model in the applied context of electromagnetic field (EMF) risks. Risk Anal. 2003;23:705–716. doi: 10.1111/1539-6924.00349. [DOI] [PubMed] [Google Scholar]
- 51.Janssen E., van Osch L., Lechner L., Candel M., de Vries H. Thinking versus feeling: Differentiating between cognitive and affective components of perceived cancer risk. Psychol. Health. 2012;27:767–783. doi: 10.1080/08870446.2011.580846. [DOI] [PubMed] [Google Scholar]
- 52.De Vries H., van Osch L., Eijmael K., Smerecnik C., Candel M. The role of risk perception in explaining parental sunscreen use. Psychol. Health. 2012;27:1342–1358. doi: 10.1080/08870446.2012.684059. [DOI] [PubMed] [Google Scholar]
- 53.Montano D.E., Kasprzyk D. Theory of Reasoned Action, Theory of Planned Behavior, and the Integrated Behavioral Model. In: Glanz K., Rimer B.K., Viswanath K., editors. Health Behavior and Health Education: Theory, Research and Practice. 4th ed. John Wiley & Sons; Hoboken, NJ, USA: 2008. pp. 67–96. [Google Scholar]
- 54.IBM SPSS Statistics for Windows, 24.0. IBM Corp; Armonk, NY, USA: 2017. [Google Scholar]
- 55.Cullen K.A., Ambrose B.K., Gentzke A.S., Apelberg B.J., Jamal A., King B.A. Notes from the Field: Use of Electronic Cigarettes and Any Tobacco Product Among Middle and High School Students—United States, 2011–2018. Morb. Mortal Wkly. Rep. 2018;67:1276–1277. doi: 10.15585/mmwr.mm6745a5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Chen J.C. Flavored E-cigarette Use and Cigarette Smoking Reduction and Cessation-A Large National Study among Young Adult Smokers. Subst. Use Misuse. 2018;53:2017–2031. doi: 10.1080/10826084.2018.1455704. [DOI] [PubMed] [Google Scholar]
- 57.Buu A., Hu Y.H., Piper M.E., Lin H.C. The association between e-cigarette use characteristics and combustible cigarette consumption and dependence symptoms: Results from a national longitudinal study. Addict. Behav. 2018;84:69–74. doi: 10.1016/j.addbeh.2018.03.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.The European Parliament and of the Council . Tobacco Products Directive. The European Parliament and of the Council; Brussels, Belgium: 2014. p. 38. [Google Scholar]
- 59.De Raad van State . Tabaks-en rookwarenwet. In: De Raad van State; Volksgezondheid; Welzijn en Sport, editor. BWBR0004302/2019-11-17/0. De Raad van State; Den Haag, The Netherlands: 2018. [Google Scholar]
- 60.Schneller L.M., Bansal-Travers M., Goniewicz M.L., McIntosh S., Ossip D., O’Connor R.J. Use of flavored electronic cigarette refill liquids among adults and youth in the US-Results from Wave 2 of the Population Assessment of Tobacco and Health Study (2014–2015) PLoS ONE. 2018;13:e0202744. doi: 10.1371/journal.pone.0202744. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.O’Connor R.J., Fix B.V., McNeill A., Goniewicz M.L., Bansal-Travers M., Heckman B.W., Cummings K.M., Hitchman S., Borland R., Hammond D., et al. Characteristics of nicotine vaping products used by participants in the 2016 ITC Four Country Smoking and Vaping Survey. Addiction. 2019 doi: 10.1111/add.14571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Berg C.J. Preferred flavors and reasons for e-cigarette use and discontinued use among never, current, and former smokers. Int. J. Public Health. 2016;61:225–236. doi: 10.1007/s00038-015-0764-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Russell C., Dickson T., McKeganey N. Advice from Former-Smoking E-Cigarette Users to Current Smokers on How to Use E-Cigarettes as Part of an Attempt to Quit Smoking. Nicotine Tob. Res. 2018;20:977–984. doi: 10.1093/ntr/ntx176. [DOI] [PubMed] [Google Scholar]
- 64.Feirman S.P., Lock D., Cohen J.E., Holtgrave D.R., Li T. Flavored Tobacco Products in the United States: A Systematic Review Assessing Use and Attitudes. Nicotine Tob. Res. 2016;18:739–749. doi: 10.1093/ntr/ntv176. [DOI] [PubMed] [Google Scholar]
- 65.Camenga D.R., Fiellin L.E., Pendergrass T., Miller E., Pentz M.A., Hieftje K. Adolescents’ perceptions of flavored tobacco products, including E-cigarettes: A qualitative study to inform FDA tobacco education efforts through videogames. Addict. Behav. 2018;82:189–194. doi: 10.1016/j.addbeh.2018.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Buckell J., Sindelar J.L. The impact of flavors, health risks, secondhand smoke and prices on young adults’ cigarette and e-cigarette choices: A discrete choice experiment. Addiction. 2019 doi: 10.1111/add.14610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Centraal Bureau voor Statistiek (CBS). Society: Numbers of Level of Education. [(accessed on 1 March 2019)]; Available online: https://longreads.cbs.nl/trends18/maatschappij/cijfers/onderwijs/
- 68.Van Gelder M., Pijpe A. E-epidemiology: a comprehensive update. OA Epidemiology. 2013;1:1–7. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.