Abstract
Objectives
Research that can provide a scientific foundation for the United States Food and Drug Administration (FDA) tobacco policy decisions is needed to inform tobacco regulatory policy. One factor that affects the impact of a tobacco product on public health is its intensity of use, which is determined, in part, by its abuse liability or reinforcing efficacy. Behavioral economic tasks have considerable utility for assessing the reinforcing efficacy of current and emerging tobacco products.
Methods
This paper provides a narrative review of several behavioral economic laboratory tasks and identifies important applications to tobacco regulatory science.
Results
Behavioral economic laboratory assessments, including operant self-administration, choice tasks and purchase tasks, can be used generate behavioral economic data on the effect of price and other constraints on tobacco product consumption. These tasks could provide an expedited simulation of the effects of various tobacco control policies across populations of interest to the FDA.
Conclusions
Tobacco regulatory research questions that can be addressed with behavioral economic tasks include assessments of the impact of product characteristics on product demand, assessments of the abuse liability of novel and potential modified risk tobacco products (MRTPs), and assessments of the impact of conventional and novel products in vulnerable populations.
Keywords: behavioral economics, laboratory methods, behavioral pharmacology, reinforcement, nicotine, cigarettes
With the passage of the Family Smoking Prevention and Tobacco Control Act in 2009, the United States (US) Food and Drug Administration (FDA) was granted the authority to regulate how tobacco products are manufactured, marketed and sold in the US.1 This includes the authority to mandate changes to the nicotine content of tobacco products (although not to eliminate nicotine), to reduce or eliminate other harmful ingredients, components, and constituents of these products, and to require the evaluation of these products, as appropriate for the protection of the public health. Therefore, research studies that can provide a scientific foundation for the FDA’s decisions are needed to inform tobacco regulatory policy.2,3 The impact of a tobacco product on public health is a function of 3 factors: its harmfulness per use; the intensity of use per user; and the prevalence of use in the population.4 A product’s intensity of use is determined by its abuse liability, or reinforcing efficacy, as well as other factors such as consumer perceptions, appeal, price, and availability. 5 It is with the assessment of the reinforcing efficacy of current and future tobacco products that we believe that behavioral economic laboratory tasks have considerable utility.
The field of behavioral economics applies consumer demand theory and other economic concepts to understanding behavior.6 With regard to drug use, behavioral economics researchers examine how varying the cost of the drug (in terms of either money or the effort required to obtain it) affects drug consumption.7,8 Plotting drug consumption as a function of cost yields a demand curve and several indices of the relative reinforcing effects of the drug to that individual under those experimental conditions.8 Using these indices, it is possible to compare the relative reinforcing effects of different drugs to a particular individual, to compare how different individuals respond to the same drug, and to examine how increasing the price of one drug affects consumption of another. In terms of tobacco regulatory science, behavioral economic laboratory procedures could be used to investigate the influence of manipulating product characteristics on demand for the product, whether certain subpopulations, such as adolescents or people with serious mental illness (SMI), may be more likely to use the product, and whether using the novel product may reduce the consumption of conventional cigarettes.
METHODS
In this paper we summarize several common behavioral economics laboratory procedures, provide a targeted, narrative review of some behavioral economic laboratory studies that have tested the reinforcing efficacies of different tobacco products, and describe how behavioral economic procedures can be applied to studying several potential tobacco regulatory policies. Previous reviews on similar topics include reviews of behavioral economic factors that contribute to drug use disorders and a conceptual review that describes how behavioral economics can be applied to estimate the impact of public policy initiatives related to drug use, transportation choice and charitable giving.7,9,10 However, the present review is the first, to our knowledge, to discuss how human behavioral economic laboratory research can be used to inform tobacco regulatory policy. We focus primarily on operant tasks, choice tasks, and cigarette purchase tasks because of the relevance of these procedures for assessing the reinforcing efficacy of tobacco products. Given space limitations, we do not include discounting tasks such as delay discounting and probability discounting. 8 However, these procedures have been used to characterize tobacco product use in vulnerable subpopulations of smokers such as adults with SMI, adults with low educational attainment, and adolescents.11–13 Other measures that can be used to assess the abuse liability of tobacco products include discriminability, physiologic measures, subjective measures, and use in the natural environment.14–16
Papers that we describe for illustrative purposes were identified through searches of human studies listed in PubMed and ScienceDirect from inception to April 1, 2016, using the search strategy (“behavioral economics” OR “choice task” OR “demand curve” OR “FR schedule” OR “PR schedule” OR “purchase task”) AND (cigarette OR nicotine OR tobacco). Papers also were identified from relevant reviews and the authors’ files.
RESULTS
Operant Studies
Operant drug self-administration studies in humans are closely based on studies conducted in laboratory animals.17,18 In these studies, the research participant presses a lever or emits another response to gain access to a dose of a drug, and reinforcement is inferred when the rate of responding for the drug is greater than the rate of responding for placebo.19 The pattern of responding and number of responses required to obtain drug is referred to as the schedule of reinforcement. Two schedules of reinforcement that are used most frequently in human drug self-administration research are fixed-ratio (FR) and progressive-ratio (PR) schedules (Table 1). In FR schedules, participants make a fixed number of responses to acquire a drug, and the response rate is interpreted as the measure of relative reinforcing efficacy.20 The ratio of response requirement per unit of drug administered is referred to in behavioral economics as the unit price; in this ratio, increasing the response requirement is functionally equivalent to reducing the magnitude of the reinforcer.21 In PR schedules, the number of responses required to acquire a drug increases progressively after each drug delivery, and the maximum ratio completed (“breakpoint”) is interpreted as the measure of relative reinforcing efficacy. 20 Typically, drug liking and other subjective effects are assessed along with self-administration behavior.19 However, subjective effects are not always correlated with drug demand, indicating the importance of behavioral measurements in abuse liability assessment.22,23
Table 1.
Behavioral Economic Laboratory Tasks
| Task | Description | Measures | Examples of Studies Relevant to Tobacco Regulatory Science |
|---|---|---|---|
| Fixed Ratio (FR) Task | Participants make a fixed number of responses to acquire a substance. | Response rate is interpreted as the measure of relative reinforcing efficacy. If the number of required responses increases across sessions, demand curve analysis can be conducted to obtain demand parameters: Q0 (Intensity), Omax, Pmax, Breakpoint, α (see text) | Johnson et al, 2004 Shahan et al, 1999 |
| Progressive Ratio (PR) Task | The number of responses required to acquire a substance increases progressively after each drug delivery. | The maximum ratio completed (breakpoint) is interpreted as the measure of relative reinforcing efficacy. | Rusted et al, 1998 |
| Choice Task | Participants make discreet choices between 2 products, a product vs placebo, or a product vs a fixed amount of money. These tasks typically begin with a sampling phase followed by a choice phase. | The option that is chosen more frequently is considered to have greater relative reinforcing efficacy. Time to first smoking choice is another measure of reinforcing efficacy. If the price of one option is varied, the degree of substitutability of one commodity for another can be obtained (see text). | Audrain-McGovern et al, 2014 Cassidy et al, 2015 Donny et al, 2015 Higgins et al, 2016 Johnson et al, 2004 Shahan et al, 1999 Tidey et al, 1999 |
| Cigarette Purchase Task | Participants estimate the amount of a product they would use in a single day across a variety of prices. | A demand analysis is completed producing demand parameters: Q0 (Intensity), Omax, Pmax, Breakpoint, α (see text). If the task is adapted to include two commodities, the degree of substitutability of one commodity for another can be obtained. | Donny et al, 2016 Grace et al, 2015 MacKillop and Tidey, 2011 |
When the size of the FR schedule varies across sessions, a demand curve can be constructed that relates response cost to consumption.8 Several demand indices can be derived from the data that reflect multiple dimensions of the relative reinforcing efficacy of the drug to the individual across changes in response cost: Intensity (Q0), or the amount of drug consumed at zero price, Omax, the maximum amount that participants would spend on drug across all prices, Pmax, the price at which Omax is reported and α, the rate of decrease in consumption as a function of price,7,24 which is derived from the following exponential equation
where Q represents cigarettes consumed and C is cigarette price, k is set to a constant, and Q0 is the estimate of cigarette consumption at zero price. These indices, which describe the relationship between behavior and drug consumption in that particular context, can be compared across products, or values for the same product can be compared across subgroups of smokers to provide an indication of how the products or subgroups differ in abuse liability. Furthermore, assessing the effects of increasing response requirements on tobacco intake may model the effects of other environmental restrictions, such as decreasing the density of tobacco outlets.
Choice Tasks
Behavioral choice tasks are well-established laboratory methods for assessing the relative reinforcing effects of different products.25 These tasks have a long history in preclinical behavioral pharmacology research, where they have been used to assess thresholds for abuse liability and toxicity. Later, it became apparent that choice studies in humans were useful for assessing correspondence between subjective effects and drug-seeking behavior and investigating drug effects in special populations considered to be at risk for abuse.25 Choice tasks may involve 2 drugs, a drug versus placebo, or a drug versus a fixed amount of money.26 These tasks typically begin with a sampling phase, in which the participant initially samples and rates the subjective effects of each option (this phase is skipped when the reinforcer is money), followed by a choice phase, consisting of a series of discrete trials in which the participant makes choices between the options. Typically, some level of effort is required to register the choice; for example, participants may have to complete 10 computer mouse clicks (FR 10) to earn 2 puffs of a cigarette. The option that is chosen more frequently is considered to have greater relative reinforcing efficacy (Table 1). Additional measures of reinforcing efficacy include time to first smoking choice in a smoking versus monetary reinforcement choice arrangement, either within a single laboratory session, using a relapse analogue task, or across days, using an abstinence incentive task.27,28 Both tasks model latency to smoking lapse or relapse after a period of abstinence. In the context of tobacco regulatory science, these tasks could be used to compare latency to relapse in different subpopulations of smokers, or to evaluate how changes to a tobacco product might affect a smoker’s ability to abstain from the product. Behavioral choice tasks can be more sensitive to differences between reinforcers than free-access procedures, in which ad libitum consumption of one or more options is measured.29 Furthermore, choice tasks have ecological validity as they mimic situations in which smokers choose which product to purchase among those concurrently available in the natural environment.
Choice tasks in which the cost of at least one option is manipulated can be used to assess the degree to which one tobacco product is likely to substitute for another product, such as the extent to which a MRTP or e-cigarette substitutes for combustible cigarettes.10 Substitution is said to occur if the use of one product increases as the cost of the other product increases. The degree of substitution can be characterized by fitting the data to an exponential equation
where Qalone is consumption of the fixed-price product when the price of the primary product is infinity, I is the interaction constant, β is the sensitivity of the fixed-price product to the primary product, and C is the cost of the primary product. A negative interaction constant indicates that the fixed-price product is a substitute of the primary product, and the value of β indicates the degree of substitution.
Cigarette Purchase Tasks
The Cigarette Purchase Task (CPT) evolved from the human operant self-administration procedures described above. Purchase tasks and similar procedures such as the “multiple choice task” assess hypothetical responses that do not require drug self-administration.30–32 In the CPT, participants are asked: “How many cigarettes would you smoke in a day if they cost $X?” From the resultant data, a demand curve can be constructed that relates price to consumption. 33 A sample demand curve using hypothetical data is shown in Figure 1. The same demand indices described above with demand curves that relate response requirement or unit price to consumption can be derived from the data (Table 1).
Figure 1.
Idealized Demand Curve for Cigarettes Depicting the Demand Indices Derived from the Cigarette Purchase Task
Cigarette purchase tasks have been shown to generate consistent estimates of demand over time in the absence of a specific manipulation.34 The validity of these tasks has been demonstrated by studies that have found significant associations between demand indices and number of cigarettes smoked per day, severity of nicotine dependence, or smoking behavior in the laboratory.11,32,35,36 Demand indices are sensitive to smoking status, and can predict response to smoking treatment, further demonstrating their validity and utility.37–39 Importantly for researchers, hypothetical purchase tasks are relatively easy for participants to understand and complete, do not require multiple sessions or specialized equipment to administer, and do not involve actual consumption of the drug. As such, they can be disseminated easily and included in widely varying research protocols, including studies that collect data online.40 They also can be administered to populations for whom ethical issues prohibit actual drug administration, such as treatment-seeking smokers.
As with choice tasks, cigarette purchase tasks also can be used to assess the degree to which one tobacco product is likely to substitute for another product. With the CPT, this is assessed by modifying the questions to ask about the use of 2 products as the price of one product is manipulated. As described above in the Choice Procedures section, the data can be fit to an exponential equation that indicates whether the fixed-price product is a substitute of the primary product, and the degree of substitution (Table 1).
Applications of Behavioral Economic Tasks to Tobacco Regulatory Science
Assessing the relative reinforcing efficacies and substitutability of tobacco products
In the context of tobacco regulatory science, dependent measures from behavioral economic studies can be used to compare the relative reinforcing efficacy of a new tobacco product, or an existing product that has been modified in some way, with that of an existing product. Two areas in which behavioral economics measures have been used for this purpose are assessments of very low nicotine content (VLNC) cigarettes and e-cigarettes. Given the primacy of nicotine in tobacco addiction, the idea of mandating a reduction in the nicotine content of cigarettes to a minimally-addictive level is one potential tobacco regulatory strategy that has received particular attention.4,41 The reinforcing efficacies of cigarettes varying in nicotine content have been compared using self-administration, choice, and CPT procedures. Rusted et al42 used a progressive ratio schedule to compare the acute reinforcing efficacies of cigarettes varying in nicotine content (0.5 mg vs 0.1 mg yield) in smokers that had been abstinent for at least 8 hours. In participants who smoked either the higher or lower nicotine cigarettes, the cigarettes produced similar breakpoints, suggesting that they had similar reinforcing efficacies. Shahan et al29 compared standard and very low nicotine content (VLNC) cigarettes using a progressive ratio procedure that increased across sessions rather than within the session, and then compared their relative reinforcing efficacies using a choice procedure. Similar to results from Rusted et al,42 the cigarettes produced similar breakpoints when each was available in separate sessions. However, when both cigarettes were offered concurrently in the choice task, participants were significantly more likely to choose the higher-nicotine cigarettes. Johnson et al43 used a behavioral economic substitution design to compare the extent to which nicotine gum and very low nicotine cigarettes would substitute for higher-nicotine cigarettes. In the first phase of the experiment, a demand curve for standard-nicotine cigarette puffs was determined by varying the response requirement for puffs across sessions. Then, the demand curve for standard puffs was re-determined with either nicotine gum or VLNC cigarette puffs concurrently available. Although both nicotine gum and VLNC cigarette puffs substituted for standard-nicotine puffs as the price of standard puffs increased, VLNC cigarette puffs were found to be a more effective substitute for standard-nicotine puffs than nicotine gum. These studies demonstrate that choice studies are more sensitive to differences between reinforcers than are self-administration studies in which products are sampled independently, and that VLNC cigarette puffs are highly reinforcing in smokers, presumably because the sensorimotor stimuli associated with smoking have acquired conditioned reinforcing properties through frequent pairing with nicotine delivery.44
An abstinence incentive procedure was included in a large clinical trial of VLNC cigarettes, to determine if an extended period of VLNC cigarette use reduced cigarette dependence.45 Participants were randomly assigned to receive their usual brand cigarettes or research cigarettes varying in nicotine content (15.8, 5.2, 2.4, 1.3, or 0.4 mg nicotine/g tobacco) for a 6-week period. At the end of this period, participants received a high-value monetary incentive to abstain from smoking for 24 hours, and those who met the biochemical abstinence criterion completed measures of craving and nicotine withdrawal. Study results indicated that participants who had smoked cigarettes with 2.4 mg nicotine/g tobacco or less had lower craving levels during abstinence than those who had smoked normal-nicotine content cigarettes, suggesting that limiting the nicotine content of cigarettes could reduce the difficulty of abstaining from smoking. 45 Similar studies that are currently underway in smokers sampled from the general population46 and smokers with schizophrenia47 are using a one-week abstinence incentive task, in which incentives are highest on the first day of abstinence and decrease for each subsequent day of abstinence,28 to determine if VLNC cigarette use facilitates abstinence in these groups.
The CPT also has been used to address research questions related to the reduction of nicotine in cigarettes.48 In the large clinical trial of VLNC cigarettes described above, participants were instructed to smoke only their assigned cigarette for 6 weeks before completing a version of the CPT about their study cigarette.45 A reduction in nicotine content to the lowest nicotine content (0.4 mg/g) decreased Intensity (Q0, estimated cigarette consumption if cigarettes were free), Omax (maximum amount of money spent on cigarettes), and breakpoint (highest price at which participants reported smoking any cigarettes). These results suggest that a reduction in nicotine content is likely to decrease the reinforcing efficacy of cigarettes if VLNC cigarettes are the only cigarettes available. A modified 2-product version of the CPT also would be useful for evaluating the degree to which emerging tobacco products are likely to substitute for combustible cigarettes if cigarettes were made less desirable (eg, by decreasing nicotine content) or available (eg, by decreasing cigarette outlets), effectively increasing their cost.
One additional use of the CPT involves a novel application of behavioral economics to nicotine reduction. According to a behavioral economics framework, changes in consumption are a function of the unit price of the reinforcer (Table 1). If nicotine is the primary reinforcing constituent in cigarettes, than an increase in cigarette cost may be functionally equivalent to a decrease in nicotine content.49 If this assumption is true, existing data from the CPT could be used to inform nicotine reduction policy. Rodent data suggest that the increases in cost and decreases in nicotine content may not be equivalent, and nicotine consumption may be more sensitive to changes in nicotine cost than nicotine dose.50 However, the relationship between cost and nicotine content has not been evaluated in human smokers.
Electronic nicotine delivery systems (ENDS) are potentially the most important emerging class of tobacco products. ENDS use has risen dramatically in the last 10 years, and now surpasses the use of conventional cigarettes among adolescents.51 Whether ENDS will have a net beneficial or harmful effect on public health depends on rates of ENDS initiation among non-smokers versus effects of ENDS on smoking cessation in current smokers.52 Factors such as nicotine delivery and flavoring affect the reinforcing efficacy of these products.53,54 One advantage of using the CPT to evaluate the abuse liability of new products is that it involves minimal exposure to the product in the laboratory; participants could sample the product and then complete the CPT to estimate their use of that product in a single session. Versions of the CPT could be used to compare the abuse liability for ENDS versus conventional cigarettes, for “cigalike” electronic cigarettes versus newer “tank-style” devices, or for preferred-flavor e-liquid versus tobacco-flavored e-liquid. As noted above, the CPT can be modified to assess substitution by asking about the use of 2 products as the price of one product is manipulated. Use of the CPT for this purpose is scarce as of now, but at least one paper has used a modified version of the CPT to characterize substitution of e-cigarettes for combustible cigarettes as the price of cigarettes increases.55
However, the CPT first must first be adapted to assess demand for ENDS. The development of an e-cigarette purchase task requires careful thought about the relevant unit of consumption. As the proxy of reinforcing value in purchase tasks is daily drug consumption, the unit of daily use is a critical variable.7 Whereas number of cigarettes smoked per day is an established metric for conventional cigarettes, the relevant daily unit is currently unclear for e-cigarettes. Puffs per day may be the most face valid unit of consumption; however, individual puffs are not easily quantifiable by ENDS users. 56 Tank style devices are refilled with e-liquid, which is purchased separately in units of milliliters (mLs) per bottle.54 For these users, purchase tasks that equate mLs of liquid to money spent may best reflect behavior. In contrast, older style e-cigarettes are sold individually or with refillable cartridges. In short, behavioral economic researchers should strive to ensure their measures to reflect real-world behavior. A validated e-cigarette purchase task that accurately reflects behavior could be used to determine how flavors and other characteristics influence demand for these products, both in absolute terms and in the context of the availability of conventional tobacco products.
Characterizing responses to products in vulnerable populations
Factors such as sex, age, race, ethnicity, nicotine metabolic rate and biological response to nicotine may moderate intensity of tobacco product use.57 The FDA’s Tobacco Regulatory Science program is particularly concerned with characterizing responses to new or modified tobacco products in subpopulations that have high rates of smoking initiation or low rates of cessation, such as adolescents, women, racial and ethnic minorities, people with low socioeconomic status, pregnant women, the lesbian, gay, bi sexual, transgendered, questioning (LGBTQ) community, and people with mental health or medical co-morbidities. 58 In behavioral economic laboratory studies, responses of vulnerable subpopulations to tobacco products can be investigated by comparing self-administration rates, product choice, or sensitivity to cost (either financial or in terms of response requirement) among groups. For example, Cassidy et al59 examined adolescent smoking behavior using a procedure in which participants were given the opportunity to make choices between receiving cigarette puffs versus a monetary reinforcer that varied in value across sessions. Similar to data from adults, adolescents’ choices for cigarette puffs decreased as a function of increasing monetary reinforcement; however, boys were more sensitive to this effect than girls, suggesting that girls may over-value cigarette reinforcement compared to boys.
Given the elevated smoking rates and low cessation rates among smokers with serious mental illness, it is important to understand if these groups may be impacted differentially by tobacco regulatory policy.60 Few experimental studies have made a direct assessment of whether smokers with and without serious mental illness differ in their sensitivity to cigarette reinforcement. Tidey et al61,62 examined how responses for cigarette puffs among people with schizophrenia were affected by varying the response requirement for puffs and the opportunity to obtain an alternative (monetary) reinforcer, using the same experimental procedure and equipment as a study that had compared these factors in heavy smokers without psychiatric illness. The effect of response requirement on cigarette puff consumption was similar in these groups. Audrain-McGovern et al63 used a similar procedure to compare responses for cigarette puffs versus money in smokers with a history of depression and current depression symptoms versus smokers without current or past depression, and found that the smokers with depression made twice as many responses for puffs than controls across a range of response costs, indicating that they were more sensitive to nicotine reinforcement but not more sensitive to response cost. MacKillop and Tidey used a CPT to compare changes in cigarette demand as a function of price in smokers with schizophrenia and controls, and found that the smokers with schizophrenia had a higher intensity of cigarette consumption but that the groups were equally sensitive to increases in cigarette price.11 Based on this limited evidence, the relative reinforcing value of smoking appears to be higher in SS and SD, but these groups do not appear to be more or less sensitive to the monetary and behavioral costs of smoking than controls.
As noted above, a current tobacco regulatory science initiative is to characterize the effects of very low nicotine content cigarettes, with the goal of examining whether reducing the nicotine content of cigarettes to a minimally-addictive level would reduce cigarette use and dependence.57 However, a nicotine reduction policy may have unintended negative consequences for certain smokers, such as those with increased sensitivity to nicotine reinforcement or withdrawal.60,64 Using a laboratory choice paradigm, researchers can simulate and compare, under predetermined constraints, the resultant behavioral profiles of different populations across various reinforcers. For example, choice of normal nicotine content and reduced nicotine content cigarettes could be compared across vulnerable populations by determining the amount of effort participants would expend to earn access to each cigarette. Several studies are currently underway to test the extent to which very low nicotine content cigarettes substitute for standard-nicotine content cigarettes in vulnerable populations. In a preliminary report of a study assessing acute response to VLNC cigarettes in vulnerable populations, VLNC cigarettes were equally effective as standard-nicotine cigarettes in reducing nicotine withdrawal levels among socioeconomically disadvantaged women of reproductive age, opioid dependent adults and adults with comorbid affective disorders; however, in a choice task, participants preferred the standard-nicotine dose over the VLNC doses, demonstrating that choice tasks can be more sensitive for detecting changes in tobacco products than subjective measures.65
The CPT is also well-suited for studying the potential impact of regulatory policy on vulnerable populations. The CPT has been used to characterize cigarette demand indices in adolescents and to compare demand indices in individuals with schizophrenia compared to equally-heavy smokers without psychiatric illness.11,66,67 However, considerable work remains to be done to characterize and compare other subpopulations with respect to the relative reinforcing efficacy of cigarettes, MRTPs and novel products such as e-cigarettes. The predictive validity of these tasks allows for conclusions to be drawn about real-world behavior. As regulatory pathways are identified, the potential effects of different policies on vulnerable populations will be important areas for researchers to target, and the CPT offers a robust, reliable and data-rich method that can be used to identify initial characteristics of a sample population with regard to motivation to smoke, and to show changes in reinforcing efficacy as a result of an experimental or hypothetical exposure to a product in these populations.
DISCUSSION
Future Directions for Researchers
The field of tobacco regulatory science has an increasing need for behavioral economics assessments of abuse liability. With regard to combustible cigarettes, behavioral economics can be used to assess the impact of various cigarette components on abuse liability including aspects of cigarette design such as ventilation, additives, and individual constituents. When tools are available (ie, cigarettes both with the component of interest and without), choice tasks may be especially useful to the FDA’s Center for Tobacco Products in determining the role that these components play in reinforcing smoking behavior. In the case of individual constituents, a version of the cigarette without a given constituent often does not exist for testing, but in some cases animal models of self-administration have filled this gap using behavioral economics.68,69 Many of the research priorities outlined by the FDA’s Center for Tobacco Products focus on the abuse liability of tobacco products other than combustible cigarettes.58 Four of the 10 priorities focus on characterizing products other than combustible cigarettes on several factors including consumer perceptions and dependence (cigars, smokeless tobacco, e-cigarettes, hookah, pipes, and dissolvables are all specifically mentioned). These research questions are rich for a behavioral economic framework because the abuse liability of each product, and the degree to which each product is likely to substitute for other tobacco products, can be assessed. Data from these experiments will be most useful if researchers include a condition with combustible cigarettes for comparison. One barrier in these experiments will be determining the unit of consumption that is the most appropriate dependent variable. Although some headway has been made in this area for ENDS, work is still required for the other products.
Behavioral economics tasks could be used to assess a claim of “less addictive” made by the tobacco industry about one of their tobacco products. One component of the Family Smoking Prevention and Tobacco Control Act required that the FDA’s Center for Tobacco Products ensure that any claim from the tobacco industry regarding modified risk be supported by scientific evidence.1 The FDA has yet to grant any applications for tobacco products to be labeled as modified risk, but to evaluate each application, the FDA’s Center for Tobacco Products will need reliable tasks upon which to make such determinations. The tasks outlined in the present paper could be used to assess the abuse liability of a potential modified risk product compared to combustible cigarettes, which are known to carry a high risk of abuse liability.
Two of the FDA’s tobacco policy research priorities focus on the impact of communication strategies, including communication of risks by the FDA and marketing by the tobacco industry. Behavioral economics can be useful for these research questions as well because consumer perception is likely to impact how a product is used and may impact abuse liability either directly or indirectly through changes in use leading to changes in dependence.5 Researchers can use choice tasks and the CPT to assess (1) how sample messages about a product risk might influence the reinforcing efficacy of that product (which will inform the FDA regarding the creation of effective communication campaigns) and (2) how potential changes to the marketing and labeling of tobacco products are likely to impact the abuse liability of a product.
Researchers interested in tobacco use among vulnerable populations should consider including behavioral economics tasks in their assessments. One of the research priorities of the FDA’s Center for Tobacco Products focuses on the impact of tobacco product characteristics like those discussed above on initiation of tobacco products in adolescents and other vulnerable populations. Whereas these laboratory tasks are unlikely to be useful for assessing abuse liability in those who have not yet used the product (due to ethical issues), they may be useful for individuals who are relatively early in the transition from first use to dependence. The CPT has been well-validated in adolescents and college students who have been presumably been using cigarettes for less time than older adults.22,67
IMPLICATIONS FOR TOBACCO REGULATION
Researchers have begun to use behavioral economics tasks in tobacco regulatory science research areas, especially as they relate to the potential reduction of nicotine in cigarettes, ENDS, and vulnerable populations. Although not the focus of this paper, they also have been used by animal researchers assessing whether tobacco constituents other than nicotine might contribute to reinforcement by tobacco products. However, as we discuss here, behavioral economics tasks may be useful in a variety of other tobacco regulatory science research areas including: (1) assessing impact of various tobacco product characteristics including design, flavorings, additives, and individual constituents; (2) assessing how tobacco products other than combustible cigarettes compare to cigarettes in terms of abuse liability and the degree to which they are likely to substitute for cigarettes if use of cigarettes decreases; (3) assessing claims of modified risk including claims of “less addictive;” (4) assessing the impact of communication campaigns including those that communicate risk by the FDA as well as potential changes to labeling and marketing on abuse liability; and (5) assessing abuse liability among vulnerable populations such as those individuals who are early on in the transition from first use to dependence. These tasks range from highly controlled behavioral choice procedures in which participants’ use behavior can shift toward or away from available products, to easily administered hypothetical purchase tasks that do not require actual drug consumption. The behavioral economic framework can encompass data derived from all along this continuum of tasks, and modification of these tasks to fit the needs of tobacco regulatory researchers will result in fruitful new avenues for understanding tobacco product use. Behavioral economics tasks have a long history of being used for assessing reinforcement value, and researchers who are interested in tobacco regulatory science should consider adopting them into their laboratory assessments.
Acknowledgments
Salary support for this manuscript was provided by grants U54DA031659, P50DA036114, K01CA189300 and T32CA186783 from the National Institutes of Health (NIH) and the Food and Drug Administration (FDA) Center for Tobacco Products. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the FDA.
Footnotes
Human Subject Statement
Not applicable.
Conflict of Interest Statement
The authors have no conflicts of interest to report.
Contributor Information
Jennifer W. Tidey, Professor, Center for Alcohol & Addiction Studies, Brown University, Providence, RI.
Rachel N. Cassidy, Assistant Professor (Research), Center for Alcohol & Addiction Studies, Brown University, Providence, RI.
Mollie E. Miller, Postdoctoral Fellow, Center for Alcohol & Addiction Studies, Brown University, Providence, RI.
Tracy T. Smith, Postdoctoral Fellow, Department of Psychology, University of Pittsburgh, Pittsburgh, PA.
References
- 1.United States Congress. [Accessed July 18, 2016];Family Smoking Prevention and Tobacco Control Act. 2009 Available at: https://www.govtrack.us/congress/bills/111/hr1256/text.
- 2.Ashley DL, Backinger CL, van Bemmel DM, Neveleff DJ. Tobacco regulatory science: research to inform regulatory action at the Food and Drug Administration’s Center for Tobacco Products. Nicotine Tob Res. 2014;16(8):1045–1049. doi: 10.1093/ntr/ntu038. [DOI] [PubMed] [Google Scholar]
- 3.3Leischow SJ, Zeller M, Backinger CL. Research priorities and infrastructure needs of the Family Smoking Prevention and Tobacco Control Act: science to inform FDA policy. Nicotine Tob Res. 2012;14(1):1–6. doi: 10.1093/ntr/ntr057. [DOI] [PubMed] [Google Scholar]
- 4.4Stratton K, Shetty P, Wallace R, Bondurant S. Clearing the smoke: the science base for tobacco harm reduction--executive summary. Tob Control. 2001;10(2):189–195. doi: 10.1136/tc.10.2.189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hatsukami DK, Biener L, Leischow SJ, Zeller MR. Tobacco and nicotine product testing. Nicotine Tob Res. 2012;14(1):7–17. doi: 10.1093/ntr/ntr027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hursh SR. Behavioral economics. J Exp Anal Behav. 1984;42(3):435–452. doi: 10.1901/jeab.1984.42-435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bickel WK, Johnson MW, Koffarnus MN, et al. The behavioral economics of substance use disorders: reinforcement pathologies and their repair. Annu Rev Clin Psychol. 2014;10:641–677. doi: 10.1146/annurev-clinpsy-032813-153724. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hursh SR. Behavioral economics of drug self-administration: an introduction. Drug Alcohol Depend. 1993;33(2):165–172. doi: 10.1016/0376-8716(93)90058-x. [DOI] [PubMed] [Google Scholar]
- 9.Heinz AJ, Lilje TC, Kassel JD, de Wit H. Quantifying reinforcement value and demand for psychoactive substances in humans. Curr Drug Abuse Rev. 2012;5(4):257–272. doi: 10.2174/1874473711205040002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hursh SR, Roma PG. Behavioral economics and empirical public policy. J Exp Anal Behav. 2013;99(1):98–124. doi: 10.1002/jeab.7. [DOI] [PubMed] [Google Scholar]
- 11.MacKillop J, Tidey JW. Cigarette demand and delayed reward discounting in nicotine-dependent individuals with schizophrenia and controls: an initial study. Psychopharmacology (Berl) 2011;216(1):91–99. doi: 10.1007/s00213-011-2185-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Wilson AG, Franck CT, Mueller ET, et al. Predictors of delay discounting among smokers: education level and a utility measure of cigarette reinforcement efficacy are better predictors than demographics, smoking characteristics, executive functioning, impulsivity, or time perception. Addict Behav. 2015;45:124–133. doi: 10.1016/j.addbeh.2015.01.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Audrain-McGovern J, Rodriguez D, Epstein LH, et al. Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend. 2009;103(3):99–106. doi: 10.1016/j.drugalcdep.2008.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Carter LP, Stitzer ML, Henningfield JE, et al. Abuse liability assessment of tobacco products including potential reduced exposure products. Cancer Epidemiol Biomarkers Prev. 2009;18(12):3241–3262. doi: 10.1158/1055-9965.EPI-09-0948. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hatsukami DK, Giovino GA, Eissenberg T, et al. Methods to assess potential reduced exposure products. Nicotine Tob Res. 2005;7(6):827–844. doi: 10.1080/14622200500266015. [DOI] [PubMed] [Google Scholar]
- 16.Hatsukami DK, Hanson K, Briggs A, et al. Clinical trials methods for evaluation of potential reduced exposure products. Cancer Epidemiol Biomarkers Prev. 2009;18(12):3143–3195. doi: 10.1158/1055-9965.EPI-09-0654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Deneau G, Yanagita T, Seevers MH. Self-administration of psychoactive substances by the monkey. Psychopharmacologia. 1969;16(1):30–48. doi: 10.1007/BF00405254. [DOI] [PubMed] [Google Scholar]
- 18.Thompson T, Schuster CR. Morphine self-administration, food-reinforced, and avoidance behavior in rhesus monkeys. Psychopharmacologia. 1964;5:87–94. doi: 10.1007/BF00413045. [DOI] [PubMed] [Google Scholar]
- 19.Comer SD, Ashworth JB, Foltin RW, et al. The role of human drug self-administration procedures in the development of medications. Drug Alcohol Depend. 2008;96(1–2):1–15. doi: 10.1016/j.drugalcdep.2008.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Arnold JM, Roberts DC. A critique of fixed and progressive ratio schedules used to examine the neural substrates of drug reinforcement. Pharmacol Biochem Behav. 1997;57(3):441–447. doi: 10.1016/s0091-3057(96)00445-5. [DOI] [PubMed] [Google Scholar]
- 21.Bickel WK, DeGrandpre RJ, Higgins ST. The behavioral economics of concurrent drug reinforcers: a review and reanalysis of drug self-administration research. Psychopharmacology. 1995;118(3):250–259. doi: 10.1007/BF02245952. [DOI] [PubMed] [Google Scholar]
- 22.Lamb RJ, Preston KL, Schindler CW, et al. The reinforcing and subjective effects of morphine in post-addicts: a dose-response study. J Pharmacol Exp Ther. 1991;259(3):1165–1173. [PubMed] [Google Scholar]
- 23.Petry NM, Bickel WK. Buprenorphine dose self-selection: effects of an alternative reinforcer, behavioral economic analysis of demand, and examination of subjective drug effects. Exp Clin Psychopharmacol. 1999;7(1):38–48. doi: 10.1037//1064-1297.7.1.38. [DOI] [PubMed] [Google Scholar]
- 24.Hursh SR, Silberberg A. Economic demand and essential value. Psychol Rev. 2008;115(1):186–198. doi: 10.1037/0033-295X.115.1.186. [DOI] [PubMed] [Google Scholar]
- 25.De Wit H, Johanson CE. A drug preference procedure for use with human volunteers. In: Bozarth MA, editor. Methods of Assessing the Reinforcing Properties of Abused Drugs. New York, NY: Springer-Verlag; 1987. pp. 559–572. [Google Scholar]
- 26.Higgins ST, Bickel WK, Hughes JR. Influence of an alternative reinforcer on human cocaine self-administration. Life Sci. 1994;55(3):179–187. doi: 10.1016/0024-3205(94)00878-7. [DOI] [PubMed] [Google Scholar]
- 27.McKee SA. Developing human laboratory models of smoking lapse behavior for medication screening. Addict Biol. 2009;14(1):99–107. doi: 10.1111/j.1369-1600.2008.00135.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Sweitzer MM, Denlinger RL, Donny EC. Dependence and withdrawal-induced craving predict abstinence in an incentive-based model of smoking relapse. Nicotine Tob Res. 2013;15(1):36–43. doi: 10.1093/ntr/nts080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Shahan TA, Bickel WK, Madden GJ, Badger GJ. Comparing the reinforcing efficacy of nicotine containing and de-nicotinized cigarettes: a behavioral economic analysis. Psychopharmacology. 1999;147(2):210–216. doi: 10.1007/s002130051162. [DOI] [PubMed] [Google Scholar]
- 30.Griffiths RR, Troisi JR, Silverman K, Mumford GK. Multiple-choice procedure: an efficient approach for investigating drug reinforcement in humans. Behav Pharmacol. 1993;4(1):3–13. [PubMed] [Google Scholar]
- 31.Jacobs EA, Bickel WK. Modeling drug consumption in the clinic using simulation procedures: demand for heroin and cigarettes in opioid-dependent outpatients. Exp Clin Psychopharmacology. 1999;7(4):412–426. doi: 10.1037//1064-1297.7.4.412. [DOI] [PubMed] [Google Scholar]
- 32.MacKillop J, Murphy JG, Ray LA, et al. Further validation of a cigarette purchase task for assessing the relative reinforcing efficacy of nicotine in college smokers. Exp Clin Psychopharmacol. 2008;16(1):57–65. doi: 10.1037/1064-1297.16.1.57. [DOI] [PubMed] [Google Scholar]
- 33.Hursh SR, Raslear TG, Shurtleff D, et al. A cost-benefit analysis of demand for food. J Exp Anal Behav. 1988;50(3):419–440. doi: 10.1901/jeab.1988.50-419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Few LR, Acker J, Murphy C, MacKillop J. Temporal stability of a cigarette purchase task. Nicotine Tob Res. 2012;14(6):761–765. doi: 10.1093/ntr/ntr222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Chase HW, Mackillop J, Hogarth L. Isolating behavioural economic indices of demand in relation to nicotine dependence. Psychopharmacology. 2013;226(2):371–380. doi: 10.1007/s00213-012-2911-x. [DOI] [PubMed] [Google Scholar]
- 36.O’Connor RJ, Heckman BW, Adkison SE, et al. Persistence and amplitude of cigarette demand in relation to quit intentions and attempts. Psychopharmacology. 2016;233(12):2365–2371. doi: 10.1007/s00213-016-4286-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.MacKillop J, Brown CL, Stojek MK, et al. Behavioral economic analysis of withdrawal- and cue-elicited craving for tobacco: an initial investigation. Nicotine Tob Res. 2012;14(12):1426–1434. doi: 10.1093/ntr/nts006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Madden GJ, Kalman D. Effects of bupropion on simulated demand for cigarettes and the subjective effects of smoking. Nicotine Tob Res. 2010;12(4):416–422. doi: 10.1093/ntr/ntq018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mackillop J, Murphy CM, Martin RA, et al. Predictive validity of a cigarette purchase task in a randomized controlled trial of contingent vouchers for smoking in individuals with substance use disorders. Nicotine Tob Res. 2016;18(5):531–537. doi: 10.1093/ntr/ntv233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.O’Connor RJ, June KM, Bansal-Travers M, et al. Estimating demand for alternatives to cigarettes with online purchase tasks. Am J Health Behav. 2014;38(1):103–113. doi: 10.5993/AJHB.38.1.11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Benowitz NL, Henningfield JE. Reducing the nicotine content to make cigarettes less addictive. Tob Control. 2013;22(Suppl 1):i14–i17. doi: 10.1136/tobaccocontrol-2012-050860. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Rusted JM, Mackee A, Williams R, Willner P. Deprivation state but not nicotine content of the cigarette affects responding by smokers on a progressive ratio task. Psychopharmacology. 1998;140(4):411–417. doi: 10.1007/s002130050783. [DOI] [PubMed] [Google Scholar]
- 43.Johnson MW, Bickel WK, Kirshenbaum AP. Substitutes for tobacco smoking: a behavioral economic analysis of nicotine gum, denicotinized cigarettes, and nicotine-containing cigarettes. Drug Alcohol Depend. 2004;74(3):253–264. doi: 10.1016/j.drugalcdep.2003.12.012. [DOI] [PubMed] [Google Scholar]
- 44.Rose JE, Levin ED. Inter-relationships between conditioned and primary reinforcement in the maintenance of cigarette smoking. Br J Addict. 1991;86(5):605–609. doi: 10.1111/j.1360-0443.1991.tb01816.x. [DOI] [PubMed] [Google Scholar]
- 45.Donny EC, Denlinger RL, Tidey JW, et al. Randomized trial of reduced-nicotine standards for cigarettes. N Engl J Med. 2015;373(14):1340–1349. doi: 10.1056/NEJMsa1502403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Donny E. [Accessed July 18, 2016];The combined impact of nicotine replacement and spectrum cigarettes. Available at: https://clinical-trials.gov/ct2/show/NCT02301325. NLM Identifier: NCT02301325.
- 47.Tidey J. [Accessed July 18, 2016];Very low nicotine cigarettes in smokers with schizophrenia. Available at: https://clinicaltrials.gov/ct2/show/NCT02019459. NLM Identifier: NCT02019459.
- 48.Donny EC, Smith TT, Cassidy RN, et al. Impact of smoking very low nicotine content cigarettes on sensitivity to cost: results from a multi-site clinical trial. Poster presented at the College on Problems of Drug Dependence Annual Meeting; Palm Springs, CA. 2016; [Accessed July 18, 2016]. Available at: http://cpdd.org/wp-content/uploads/2016/06/CPDD2016_Abstracts-FINAL.pdf. [Google Scholar]
- 49.Smith TT, Sved AF, Hatsukami DK, Donny EC. Nicotine reduction as an increase in the unit price of cigarettes: a behavioral economics approach. Prev Med. 2014;68:23–28. doi: 10.1016/j.ypmed.2014.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Smith TT, Rupprecht LE, Sved AF, Donny EC. Increasing nicotine cost and decreasing nicotine dose are not equivalent manipulations: a behavioral economics analysis. Paper presented at the College on Problems of Drug Dependence Annual Meeting; Palm Springs, CA. 2016; [Accessed July 18, 2016]. Available at: http://cpdd.org/wp-content/uploads/2016/06/CPDD2016_Abstracts-FINAL.pdf. [Google Scholar]
- 51.Neff LJ, Arrazola RA, Caraballo RS, et al. Frequency of tobacco use among middle and high school students – United States, 2014. MMWR Morb Mortal Wkly Rep. 2015;64(38):1061–1065. doi: 10.15585/mmwr.mm6438a1. [DOI] [PubMed] [Google Scholar]
- 52.Levy DT, Cummings KM, Villanti AC, et al. A framework for evaluating the public health impact of e-cigarettes and other vaporized nicotine products. Addiction. 2016 Apr 25; doi: 10.1111/add.13394. Epub ahead of print. [DOI] [PMC free article] [PubMed]
- 53.Shihadeh A, Eissenberg T. Electronic cigarette effectiveness and abuse liability: predicting and regulating nicotine flux. Nicotine Tob Res. 2015;17(2):158–162. doi: 10.1093/ntr/ntu175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Yingst JM, Veldheer S, Hrabovsky S, et al. Factors associated with electronic cigarette users’ device preferences and transition from first generation to advanced generation devices. Nicotine Tob Res. 2015;17(10):1242–1246. doi: 10.1093/ntr/ntv052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Grace RC, Kivell BM, Laugesen M. Estimating cross-price elasticity of e-cigarettes using a simulated demand procedure. Nicotine Tob Res. 2015;17(5):592–598. doi: 10.1093/ntr/ntu268. [DOI] [PubMed] [Google Scholar]
- 56.Cassidy RN, Tidey JW, Colby SM, Higgins ST. Initial development of an e-cigarette purchase task. Poster Presented at the Tobacco Centers for Regulatory Science Annual Meeting; Bethesda, MD. 2015; [Accessed July 18, 2016]. Available at: https://trsknowledge.com/theme/tcorslms/components/posters/uploads/336425781.png. [Google Scholar]
- 57.Hatsukami DK, Benowitz NL, Donny E, et al. Nicotine reduction: strategic research plan. Nicotine Tob Res. 2013;15(6):1003–1013. doi: 10.1093/ntr/nts214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.United States Food and Drug Administration Center for Tobacco Products. [Accessed April 27, 2016];Research Priorities. Available at: https://prevention.nih.gov/tobacco-regulatory-science-program/research-priorities.
- 59.Cassidy RN, Tidey JW, Kahler CW, et al. Increasing the value of an alternative monetary reinforcer reduces cigarette choice in adolescents. Nicotine Tob Res. 2015;17(12):1449–1455. doi: 10.1093/ntr/ntv033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Gaalema DE, Miller ME, Tidey JW. Predicted impact of nicotine reduction on smokers with affective disorders. Tob Regul Sci. 2015;1(2):154–165. doi: 10.18001/TRS.1.2.5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Tidey JW, Higgins ST, Bickel WK, Steingard S. Effects of response requirement and the availability of an alternative reinforcer on cigarette smoking by schizophrenics. Psychopharmacology. 1999;145(1):52–60. doi: 10.1007/s002130051031. [DOI] [PubMed] [Google Scholar]
- 62.Bickel WK, DeGrandpre RJ, Higgins ST, Hughes JR. Behavioral economics of drug self-administration. I. Functional equivalence of response requirement and drug dose. Life Sci. 1990;47(17):1501–1510. doi: 10.1016/0024-3205(90)90178-t. [DOI] [PubMed] [Google Scholar]
- 63.Audrain-McGovern J, Wileyto EP, Ashare R, et al. Reward and affective regulation in depression-prone smokers. Biol Psychiatry. 2014;76(9):689–697. doi: 10.1016/j.biopsych.2014.04.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Donny EC, Hatsukami DK, Benowitz NL, et al. Reduced nicotine product standards for combustible tobacco: building an empirical basis for effective regulation. Prev Med. 2014;68:17–22. doi: 10.1016/j.ypmed.2014.06.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Higgins ST, Heil SH, Sigmon SC, et al. Response to varying the nicotine content level in cigarettes: acute effects in vulnerable populations. Poster presented at the Annual Meeting of the Society for Research on Nicotine and Tobacco; Chicago, IL. 2016; [Accessed June 6, 2016]. Available at: http://c.ymcdn.com/sites/www.srnt.org/resource/resmgr/Conferences/2016_Annual_Meeting/Program/FINAL_SRNT_Abstract_WEB02171.pdf. [Google Scholar]
- 66.Bidwell LC, MacKillop J, Murphy JG, et al. Latent factor structure of a behavioral economic cigarette demand curve in adolescent smokers. Addict Behav. 2012;37(11):1257–1263. doi: 10.1016/j.addbeh.2012.06.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Murphy JG, MacKillop J, Tidey JW, et al. Validity of a demand curve measure of nicotine reinforcement with adolescent smokers. Drug Alcohol Depend. 2011;113(2–3):207–214. doi: 10.1016/j.drugalcdep.2010.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Smith TT, Schaff MB, Rupprecht LE, et al. Effects of MAO inhibition and a combination of minor alkaloids, beta-carbolines, and acetaldehyde on nicotine self-administration in adult male rats. Drug Alcohol Depend. 2015;155:243–252. doi: 10.1016/j.drugalcdep.2015.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.LeSage MG, Burroughs D, Muelken P, Harris AC. Self-administration of smokeless tobacco products in rats. Tob Regul Sci. 2016;2(4):329–342. doi: 10.18001/TRS.2.4.5. [DOI] [PMC free article] [PubMed] [Google Scholar]

