Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2019 Jan 1.
Published in final edited form as: Pharmacol Biochem Behav. 2017 Aug 26;164:71–83. doi: 10.1016/j.pbb.2017.08.010

Clinical models of decision making in addiction

Mikhail N Koffarnus 1,*, Brent A Kaplan 1
PMCID: PMC5747979  NIHMSID: NIHMS906997  PMID: 28851586

Abstract

As research on decision making in addiction accumulates, it is increasingly clear that decision-making processes are dysfunctional in addiction and that this dysfunction may be fundamental to the initiation and maintenance of addictive behavior. How drug-dependent individuals value and choose among drug and nondrug rewards is consistently different from non-dependent individuals. The present review focuses on the assessment of decision-making in addiction. We cover the common behavioral tasks that have shown to be fruitful in decision-making research and highlight analytical and graphical considerations, when available, to facilitate comparisons within and among studies. Delay discounting tasks, drug demand tasks, drug choice tasks, the Iowa Gambling Task, and the Balloon Analogue Risk Task are included.

Keywords: Decision-making, Delay discounting, Drug demand, Drug choice, Iowa Gambling Task, Balloon Analogue Risk Task

1. Introduction

As research on decision making in addiction accumulates, it is increasingly clear that decision-making processes are dysfunctional in addiction and that this dysfunction may be fundamental to the initiation and maintenance of addictive behavior. How drug-dependent individuals value and choose among drug and nondrug rewards is consistently different from non-dependent individuals. A number of recent reviews from our laboratory and others have catalogued these differences (Bickel et al., 2014a, 2014b, 2012; MacKillop et al., 2011, 2010a), and we suggest that readers interested in how these measures relate to various aspects of addiction consult these papers. The present review focuses on the assessment of decision-making in addiction. We will cover the common behavioral tasks that have shown to be fruitful in decision-making research and highlight analytical and graphical considerations when available, to facilitate comparisons within and among studies.

2. Delay discounting

2.1. Role of delay discounting in addiction

It is normal to prefer a reward available now to the same reward available after some delay, but excessively discounting the value of delayed rewards can represent an overemphasis on near-term rewards (e.g., drug high) instead of more long-term rewards (e.g., career, good health, interpersonal relationships; Ainslie, 1975). Excessive delay discounting seems to be a reliable marker of short-sighted unhealthy behavior (Bickel and Marsch, 2001) with substance use and addiction being prototypical examples (Bickel et al., 2012; MacKillop et al., 2011; Madden and Bickel, 2010). The evidence supporting a link between excessive delay discounting and addiction now spans most common classes of addictive drugs including alcohol (MacKillop et al., 2010a), tobacco (Bickel et al., 1999; Johnson et al., 2007), stimulants (Coffey et al., 2003; Heil et al., 2006; Hoffman et al., 2006; Washio et al., 2011), opiates (Kirby et al., 1999; Petry et al., 1998), and possibly marijuana (Johnson et al., 2010). This body of research has firmly established a robust relationship across studies and contexts, as was confirmed by a recent meta-analysis (Amlung et al., 2017).

Research also supports an etiological role of excessive discounting in addiction. Excessive discounting predates the initiation of smoking (Audrain-McGovern et al., 2009), and the similar construct of delay of gratification predicts later drug use (Ayduk et al., 2000). Among substance users entering treatment, relatively self-controlled responding on delay discounting tasks predicts treatment success (Dallery and Raiff, 2007; MacKillop and Kahler, 2009; Mueller et al., 2009; Sheffer et al., 2012; Stanger et al., 2012; Yoon et al., 2007), indicating that excessive delay discounting may be behavioral marker of both the onset of drug use and difficulty abstaining after use is established (Bickel et al., 2014b).

2.2. Delay discounting tasks

Delay discounting tasks measure how delaying a reward reduces the value of that reward, typically by arranging a series of discrete choices between some amount of a commodity available at a short delay (or no delay) and a larger amount of that commodity available at a longer delay. A series of questions of this type can be used to infer indifference points, or a series of values that represent the amount of an immediately available commodity that is subjectively equivalent to a greater amount of that commodity available after a delay. For example, if someone were to indicate a preference for $870 right now over $1000 in one month while also indicating a preference for $1000 in one month over $850 right now, we could conclude that $1000 in one month is worth somewhere between $850 and $870 right now. In other words, this individual is indifferent between ~$860 now and $1000 in one month. By assessing a series of indifference points across a range of delays, a discount rate can be calculated.

The first addiction delay discounting studies used a task where indifference points were obtained by asking two series of questions at each of seven delays (Madden et al., 1999, 1997; Rachlin et al., 1991). The first of these series started with a question between a set amount of a commodity available after a delay and the same amount available immediately (e.g., $1000 now versus $1000 in one month), with the expectation that everyone would choose the immediate option. The amount available immediately was then progressively decreased until the participant switched to the delayed amount. An analogous series of questions started with the same delayed amount and none of the commodity available immediately (e.g., $0 now versus $1000 in one month) with the expectation that everyone would then choose the delayed option. The immediate amount was then progressively increased until the participant switched to that option. These two switchover points were then averaged for each delay. This procedure seemed to work well, but was time consuming. Adaptive algorithms were developed by a number of labs, most of which shortened the number of choice trials necessary to obtain an indifference point. Probably the most commonly used today of these is a simple adjusting amount algorithm that was developed by Du et al. (2002). This procedure starts at each delay by asking participants to choose between a set delayed amount and half that amount available immediately. The immediate amount then adjusts up or down depending on the participant's choice in a series of five choice trials to narrow in on the indifference point. These five trials take little participant time while still allowing for 25 or 32 discrete indifference points at each delay.

2.3. Measuring rate of discounting

Indifference points generated from a discounting task are typically fit with a curve to obtain an overall rate of discounting. Although different methods for obtaining discount rates have been proposed (Laibson, 1997; Mazur, 1987; Myerson and Green, 1995; Rachlin, 2006; Samuelson, 1937), the most common method in the psychology literature consists of fitting the indifference points with nonlinear regression to a hyperbolic curve first validated by Mazur (1987):

V=A1+kD (1)

where V is the discounted value (i.e., indifference point) of the delayed amount A at a given delay, D. The single free parameter, k, represents the rate of discounting. This model has a number of attractive features. First, it requires only a single free parameter to quantify discount rate, making comparisons among individuals or groups relatively straight-forward. Second, this model has been shown to provide a good description of delay discounting data, particularly compared to an exponential decay model that was assumed to describe intertemporal choice for many years (Green and Myerson, 2004; Madden et al., 1999). The discounting rate k has a unit of 1/time or time−1, which is not straightforward to interpret. A more intuitive alternative to reporting k has been proposed in the form of an effective delay 50 (ED50; Yoon and Higgins, 2008), or the delay at which the delayed commodity loses half of its subjective value. This measure can be shown to be the simple reciprocal of k (i.e., is equal to 1/k), and because of this, the transformation does not affect statistical comparisons. An ED50 of 90 days, indicating that a commodity loses half of its value when delayed 90 days, is arguably more intuitive than the equivalent k value of 0.011 days−1. Both k values and ED50 values are typically not normally distributed and must be logarithmically transformed prior to parametric statistical analysis (Mitchell et al., 2015).

While the model above typically describes discounting data well, systematic deviations from the hyperbolic shape described by this function have been noted (Green and Myerson, 1996; Rachlin, 2006). Often, these deviations consist of more pronounced discounting (i.e., steep slope) over relatively brief delays and less pronounced discounting (i.e., shallow slope) at longer delays than what is predicted by Mazur's hyperbola. As a result, multi-parameter, hyperbola-like models have been proposed to better account for these deviations. The most prevalent of these are extensions of Mazur's equation with an additional free parameter. Rachlin (2006) proposed that a free parameter should be inserted as an exponent on D (delay), while Myerson and Green (1995) proposed that the entire denominator of the right side of Eq. (1) be raised to a freely varying exponent. Each of these modifications allow the shape of the discounting curve to better approximate the shape of much discounting data, albeit in slightly different ways and at the cost of an additional free parameter in the model (McKerchar et al., 2009). These additional free parameters typically improve fit, but complicate interpretation of the data. In both cases, we have shown (Franck et al., 2015) that the added exponents are not independent of the k parameter, and therefore k cannot be compared directly across conditions or individuals if the exponents also vary. This is a problem for most experiments where discount rate is the variable of interest. Furthermore, several interpretations of the exponent exist (McKerchar et al., 2010; Myerson et al., 2011), and in the context of delay discounting may be related to nonlinear scaling of time (Green and Myerson, 1996), a psychophysical phenomenon known for some time (Stevens, 1957). We have proposed ED50 as a solution to this problem of collinear parameters (Franck et al., 2015). This measure can be straightforwardly calculated from both single- and multi-parameter discounting models, and importantly, its scale and interpretation is unaffected by the underlying model. If different models are used in different experiments or even different subjects within a single experiment, the ED50 can still be compared across all the data.

The nonlinear scaling of time that forms the basis of these multi-parameter models may actually be the basis for the human tendency to discount value hyperbolically instead of exponentially (Takahashi et al., 2008). Since from a psychophysical perspective time is perceived nonlinearly, we propose that discount curves ought to be best depicted graphically in log-linear space (see Fig. 1). We propose this for several reasons. First, with a logarithmic x-axis, Mazur's (1987) hyperbolic curve forms an ‘S’ shape (compare A and B of Fig. 1). The ‘S’ curve transitions from asymptotic valuations near a proportion of 1.0 to asymptotic valuations near 0.0 with the midpoint of this transition being the participant's ED50 value. This makes differences in discount rate or ED50 more easily observed and visually discern. Second, using the same equation (the simple hyperbolic in this case), differences in discounting can be seen as a location shift of the curve. The curve itself maintains the same shape; it is its location along the x-axis that shifts. This may suggest that in psychophysical space, the shape of discounting curves do not differ by rate, only the delay range over which the valuation transition takes place differs among people. Third, depicting curves in this way provides rationale for using longer delays, especially in the case of discounting among typical controls or the general population. Panel C of Fig. 1 displays individual-subject data from a dataset we reported previously (Koffarnus and Bickel, 2014) of college participants who completed an adjusting amount discounting task (Du et al., 2002). As can be seen, the transition point of many of the curves and the corresponding ED50 values fall on the right side of graph, centered around the longer delays. In some cases, especially with control or participants unaffected by addiction, excluding longer delays results in only a partial understanding of the participant's decision-making process.

Fig. 1.

Fig. 1

Panels A and B show hypothetical discounting curves for relatively high (i.e., steep) and low (i.e., shallow) discount rates. Panel A depicts discounting curves as displayed on a linearly scaled x-axis, where spacing between delay values is arithmetic. Many of the shorter delays are grouped together in an indistinguishable bunch as shown in the circled area of the x-axis. Panel B depicts discounting curves on a logarithmic x-axis, where the progression of values is exponential. Note that effective delay 50 (ED50) is more easily identifiable and differences in discount rates are manifested in a location shift (i.e., left or right) along the x-axis. Panel C depicts real data from Koffarnus and Bickel (2014) for college-aged participants completing an adjusting amount discounting task showing the range of discounting rates seen with control subjects.

An alternative to finding k values with nonlinear regression is calculating area under the curve (AUC), or the area below a series of trapezoids formed by connecting the indifference points with successive straight lines (Myerson et al., 2001). Although this method alleviates complications and interpretations associated with model selection and curve fitting, it is not free from other analytic challenges. Recent analysis has shown that AUC, as it is typically calculated, is heavily influenced by the indifference points associated with the largest delays, while the shorter delays contribute a trivial amount to the AUC measure (Borges et al., 2016; Yoon et al., 2017). This is directly the cause of the linear x-axis that is commonly used with discounting data. The k parameter, however, is influenced by choices across the range of delays. Borges and colleagues suggest alternate methods of calculating AUC that correct this imbalance – either weighting all delays identically in AUC calculations or using a log-transformed delay spacing before drawing the trapezoids forming the AUC. For the reasons discussed above, a log-transformed delay sequence is not only more convenient for measurement and graphical display, it better represents the psychophysical scaling of time perception (Takahashi et al., 2008). If AUC is used to quantify discount rate, these proposed methods may provide measurements that more realistically characterize the choices made by participants.

The distribution of each of these variables used to quantify delay discounting rate should be examined for normality before statistical analysis. Discount rates quantified as a k value, AUC, or ED50 have all been shown to typically be highly skewed (e.g., Mitchell et al., 2015; Yoon et al., 2017). Often, logarithmic transformation normalizes these data, but differences among data collection methods and analytical models result in a need to carefully consider skewness with each new dataset.

2.4. Brief discounting measures

While the majority of delay discounting tasks resolve a discounting rate by generating a series of indifference points and fitting those to a nonlinear curve or calculating AUC, brief discounting measures have been developed to measure discounting rates in situations where there is little time to devote to the task or the subject population has limited attention, making a longer task onerous. The first of these is the monetary choice questionnaire (Kirby et al., 1999), which consists of 27 predetermined questions. This questionnaire can save some time over tasks like the adjusting amount task described above (Du et al., 2002), but at 27 questions, is only slightly shorter than the commonly used 35 question adjusting amount task with seven delays. Use of the monetary choice questionnaire is especially advantageous in situations where computerized administration is not feasible. Most discounting tasks are administered on a computer due to branching logic that adjusts question options dependent on the participant's previous responses. One disadvantage of the monetary choice questionnaire is that the number of discount rates is bounded within a specified range, given the finite number of response combinations of the 27 predetermined questions. Another disadvantage is that its scoring procedure can be complex and time consuming, however we recently developed Excel-based software to help alleviate these burdens (Kaplan et al., 2016). In addition, Wileyto et al. (2004) have proposed the use of logistic regression to estimate k from the monetary choice questionnaire. They found close correspondence in the resulting values when standard scoring was compared to the logistic regression.

To maximize brevity for situations where task administration time is a concern, we recently developed a brief, adjusting delay discounting task that can measure discount rates with only five questions (Koffarnus and Bickel, 2014). This task uses branching logic to assign participants one of 32 discount rates with just five questions, providing more range and resolution than the monetary choice questionnaire with fewer questions. We found that discount rates measured with this task were highly correlated with rates from a longer adjusting amount task and we were able to replicate a number of reliable effects in the literature with the abbreviated task. The advantage of this task is its very brief duration, taking participants around 30 s to complete. The task, however, is unable to discern responding that is internally inconsistent since any series of responses in such a short task are plausible.

2.5. Probability discounting

In addition to discounting of delayed rewards, much research has also been devoted to discounting of probabilistic rewards. Probability discounting assesses how the value of a reward is diminished by the odds against receiving it (Rachlin et al., 1991). When indifference points are plotted as a function of odds against receiving the award, the same hyperbolic and hyperbolic-like functions described above fit the data well. This process seems to be largely distinct from delay discounting (Green and Myerson, 2004; Ohmura et al., 2005), and its relationship to addiction is not entirely clear. Unlike with delay discounting rates, probability discounting rates do not appear to robustly distinguish people diagnosed with a drug addiction from those without a diagnosis (for a review, see Bickel et al., 2014a). In contrast, probability discounting rates do often distinguish problem gamblers from nongamblers (Holt et al., 2003; Madden and Bickel, 2010). In an analogous way to delay discounting differentiating drug addicts, probability discounting provides a measure of how problem gamblers overvalue probabilistic rewards leading to excessive gambling choices. Probability discounting may be better than delay discounting, however, in detecting acute alcohol intoxication (Bidwell et al., 2013).

2.6. Other types of discounting

A discounting framework can be used to assess how many manipulations affect reward value. For example, in addition to delay to receipt and probability of receipt, effort required to obtain a reward (Mitchell, 2004) and closeness of social relationship to the reward recipient (Jones and Rachlin, 2006) have been modeled in a discounting framework. While interesting in other contexts, neither of these measures has received much attention in relation to addiction. A modification of delay discounting to model risky sexual choices is related to addiction, however. Stimulant users are known to have a greater incidence risky sexual behavior and a corresponding increased rate of HIV infection (Joe and Simpson, 1995). The sexual delay discounting task was developed to model the decision-making process in risky sexual choices. Participants are asked to choose between having safer sex now with a condom or other barrier protection and having riskier sex after a delay to get a condom (Johnson and Bruner, 2012). All choices are made regarding hypothetical sexual partners chosen by the participants from an array of images of clothed individuals who vary in appearance. Discounting rates from this task are related to self-reported risky sexual behavior (Johnson and Bruner, 2012), are increased by alcohol intoxication (Johnson et al., 2016), are increased by acute stimulant administration commiserate when those stimulants cause sexual arousal (Johnson et al., 2017), and are greater in stimulant users than controls (Herrmann et al., 2014; Koffarnus et al., 2016).

2.7. Task fidelity and dealing with nonsystematic data

Delay discounting tasks consist of a series of hypothetical self-reported preferences and as such, fidelity of participant responses may be a concern. Not all studies use hypothetical rewards instead of actual rewards that are given to the participant, but most do. Research comparing hypothetical and real rewards has found that similar data are obtained with either, including behavioral choice data (Baker et al., 2003; Johnson et al., 2007; Johnson and Bickel, 2002; Lagorio and Madden, 2005; Madden et al., 2004, 2003) and the neural correlates of those choices (Bickel et al., 2009). These data suggest that in most situations, hypothetical rewards are sufficient for studying intertemporal choice with delay discounting tasks. In addition, hypothetical rewards allow for studying time frames that are unrealistic for real rewards (e.g., 5 years or more) and commodities that are impractical or unethical to arrange in a laboratory setting (e.g., risky sexual encounters; Johnson and Bruner, 2012).

Delay discounting tasks operate on the fundamental assumption that a delayed reward is less valuable than an immediate one. When a participant's choices violate this assumption, it is likely that the participant was not attending to the task, did not understand the task, or was responding dishonestly. When this occurs, researchers may want to isolate that participant's data to apply greater scrutiny and possibly remove it from the main analysis. Johnson and Bickel (2008) have proposed two criteria to judge whether data adhere to the assumption that value is systematically related to delay. These criteria are ‘bounce’ and ‘trend’, where bounce refers to how often value increases instead of decreases from one delay in the series assessed to the next longest delay, and trend refers to whether value is lower at the longest delay than at the shortest. The authors of these rules also suggest that they be used as guidelines and adapted as necessary to the specific experiment. For example, in the sexual delay discounting task described above (Johnson and Bruner, 2012), participants choose between hypothetical activity with or without a condom. One of these qualitatively different options may be preferred exclusively, which would indicate no effect of delay and indicate a violation of the ‘trend’ rule of Johnson and Bickel (2008). However, exclusive responding in this case could be perfectly logical if someone prefers one option enough that delay to the safer sex option has no impact on choice. In this case, only the ‘bounce’ criteria make sense to use.

2.8. Assessing goodness of fit for nonlinear discounting models

When fitting data to a nonlinear regression model like those commonly used to fit indifference points from a delay discounting task, it is good practice to report one or more goodness-of-fit statistics to describe how well the model's predictions map onto the obtained data. Goodness-of-fit statistics report how close the observed data are to a model fit, and therefore tend to focus on the residual sum of squares (SSresidual), or the sum of the squared distance along the y-axis from each point to the regression line. There are at least three general approaches taken to report the SSresidual by goodness-of-fit statistics, which we have summarized in Table 1. R2 is probably the most commonly reported, and is the SSresidual expressed as a ratio to the total variability in the dataset (SStotal). Note that there are different ways of calculating R2, but we are using the one identified as most conceptually appealing by Kvålseth (1985) and also commonly used in software packages such as GraphPad Prism. As a ratio expressing the proportion of the spread in the data that is reduced by the model, R2 is independent of the units the data are in and has the same interpretation across datasets and experiments. However, this statistic has been criticized as a goodness-of-fit measure for nonlinear regression in some contexts. Instead of R2, others have promoted the use of either root mean squared error (RMSE; Johnson and Bickel, 2008) or Akaike's information criterion (AIC; Spiess and Neumeyer, 2010). Both of these statistics are closely related to R2 and each other, with RMSE simply being a transformation of the SSresidual without expressing it as a ratio to the total sum of squares, and AIC being a transformation of the SSresidual that is penalized by the model complexity (i.e., the number of fitted parameters in the model). Bayesian information criterion and adjusted R2 are other goodness-of-fit measures with penalties for model complexity (e.g., Raftery, 1995). As interrelated descriptive statistics, we think each of these three measures has a place. Previous criticisms of R2 were made in specific contexts where the authors were right to point out that R2 is not appropriate. Johnson and Bickel (2008) correctly pointed out that arbitrary R2 cutoffs should not be used to identify datasets for elimination from an experiment, and Spiess and Neumeyer (2010) correctly pointed out that R2 should not be used to compare nonlinear regression models of differing complexities. We do not disagree with either of these papers, but we would also warn against overextending these conclusions to other contexts. Each of these statistics has its place, which we have high-lighted in Table 1. For example, we recently used R2 to compare a model separately applied to untransformed and logarithmically transformed data, and we specifically chose this statistic because the models were of equal complexity and the different scale of the transformed and untransformed data precluded the use of either RMSE or AIC (Koffarnus et al., 2015).

Table 1.

A comparison of goodness-of-fit statistics for the characterization or comparison of nonlinear regression models. Care should be taken to choose the appropriate statistic(s) for the intended use case.

Statistic Formulation What is described Unit
independent
Range of possible
values
Direction of
better fits
Appropriate use cases
R2
1.0SSresidualSStotal
The SSresidual expressed as a proportion of SStotal. Yes −∞ ↔ 1.0 Closer to 1.0 Describing how much of the variability in a dataset is accounted for by a model
RMSE
SSresidualn1
The square root of the mean SSresidual No 0 ↔ ∞ Closer to 0.0 Describing the fit of the model in the units of the dependent variable without considering total data variability
AIC
n×ln(SSresidualn)+2k
The mean SSresidual with an additional penalty for the complexity of the model No −∞ ↔ ∞ Lower values Determine which of a set of models is the most parsimonious after accounting for model complexity

Note: SS = sum of squares; n = number of data points; k = number of fitted parameters in the regression model.

3. Drug demand

3.1. Role of drug demand in addiction

Standard economic demand analyses quantify the relationship between the cost of a commodity and population-level measures of consumption of that commodity. Behavioral economic demand analyses are analogous to these population-level analyses, but can be used to understand the level of motivation to consume a product on either an individual or small group level, including for cigarettes (Bickel et al., 1991; MacKillop et al., 2008), alcohol (Gray and MacKillop, 2015; MacKillop et al., 2010a; Murphy and MacKillop, 2006), and other drugs (Aston et al., 2015; Bruner and Johnson, 2014; Christensen et al., 2008; Jacobs and Bickel, 1999; Johnson and Johnson, 2014; Reed et al., 2016a). This level of analysis allows for experimental manipulations to be made on variables of interest. By quantifying how consumption decreases as costs to obtain and consume a product increase, important indices of demand are obtained. These indices can be grouped into two main measures of consumption, demand intensity and demand elasticity, which are associated with use level and dependence severity (MacKillop et al., 2010a, 2009, 2008; Murphy et al., 2011). Demand intensity is the amount of the commodity consumed when available at a very low cost approaching free, and demand elasticity quantifies the degree to which the individual is willing to increase monetary or effort-based expenditures to maintain the same level of consumption as costs increase. Elasticity of demand has been shown to be a characteristic of the drug itself and independent of drug dose for many drugs. That is, when consumption is plotted as a function of unit price (responses/mg of drug), the consumption data from each dose converges to a single function (Bickel et al., 1991; Hursh and Roma, 2013; Hursh and Silberberg, 2008; Hursh and Winger, 1995). This makes demand elasticity a convenient measure of drug abuse liability without the complication of selecting a representative dose that could impact conclusions drawn.

3.2. Demand tasks

Fundamentally, demand measures are obtained by measuring consumption of a commodity over a range of prices for that commodity. Price can be conceptualized as either monetary cost per unit of drug or effort required per unit of drug. Procedures to assess consumption across unit price can be grouped into two types. First, there are laboratory self-administration measures modeled after preclinical self-administration procedures (Greenwald and Hursh, 2006; Johnson and Bickel, 2006; Madden et al., 2000; Spiga et al., 2005). Participants make responses on a manipulandum for some drug reward (e.g., a puff from a cigarette; Shahan et al., 2001), and actually consume those drug rewards in the context of the session. The number of responses per unit of drug reward is considered the price, and this is typically varied across or within sessions to obtain consumption across prices.

The second main category of demand tasks consist of drug purchase tasks (for a review of purchase tasks generally, see Reed et al., 2016b). Here, participants are asked to indicate how much of a drug they would purchase for their own consumption at a range of monetary prices. The first drug purchase task study was conducted with units of heroin (Jacobs and Bickel, 1999), but research has since greatly expanded with alcohol (Murphy and MacKillop, 2006) and cigarette purchase tasks (Murphy et al., 2011). In drug purchase tasks, price is conceptualized as monetary cost, with the price typically varied across a wide range (e.g., $0.01 per cigarette to $1000 per cigarette). While hypothetical purchases are often used, similar data are obtained with hypothetical purchases and actual purchases of products in a lab setting (Amlung et al., 2012; Wilson et al., 2016). These tasks have been used in combination with cue-reactivity paradigms (e.g., Acker and MacKillop, 2013; Amlung and MacKillop, 2014; Mackillop et al., 2012; MacKillop et al., 2010b), whereby following cue exposure (e.g., smelling an alcoholic drink, opening a pack of cigarettes) responses on the task typically increase coinciding with increases in self-reported cravings for that drug. Thus, demand tasks may serve as a valid, alternative measure of state-based craving.

A related variant of the drug purchase task is the Brief Assessment of Alcohol Demand (BAAD) developed by Owens et al. (2015). Rather than assessing purchasing at a range of prices, the BAAD contains three questions: (1) “If drinks were free, how many would you have?”, (2) “What is the maximum total amount that you would spend on drinking (approximately)?”, and (3) “What is the maximum you would pay for a single drink?”. These three questions are intended to quickly assess demand intensity, Omax (the maximum expenditure at any price, closely correlated with Pmax or the price at which Omax occurs), and breakpoint. Although this task is indeed brief, measures of elasticity are necessarily unable to be determined.

3.3. Assessing product interactions

Single-commodity demand tasks measure how the consumption of a single commodity decreases with increases in price, but do not directly assess choice. Choice is implied, since decreasing consumption at high prices is typically replaced by increased consumption of other commodities, but single-commodity demand tasks do not overtly assess this. Multiple-commodity demand tasks can more straightforwardly assess how decisions are made among the many products available to us every day. Like single-commodity tasks, multiple-commodity tasks still ask about consumption patterns across a range of prices for a specific variable-price commodity (e.g., cigarettes). However, consumption of one or more other constant-price products (e.g., nicotine gum) is measured as a function of the price of the variable-price commodity. By measuring consumption of both products, the researcher can determine how these products interact. Three types of economic interactions are possible, which can be illustrated with the cigarette and nicotine gum example with cigarettes being a variable-price (i.e., primary) product and gum being a constant-price (i.e., alternative) product (Hursh and Roma, 2013). If the consumption of nicotine gum does not vary with the price of cigarettes (and declining consumption of cigarettes), then the two are economic independents. If the consumption of nicotine gum follows that of cigarettes (i.e., both decrease together as cigarette price increases), then they are complements. If nicotine gum consumption increases when cigarette consumption decreases, then gum is a substitute for cigarettes.

Most multiple commodity demand tasks have focused on two to three commodities or drugs available at the same time to model specific questions. For example, Johnson et al. (2004) found that nicotine gum and cigarettes with most of the nicotine removed were both substitutes for conventional cigarettes. Focusing on interactions between a limited number of products simplifies the experimental context, but such focus may not capture the complex economic choices we make every day where seemingly hundreds of product choices are available for purchase in the real-world marketplace. These complex interactions have recently been modeled with studies using the Experimental Tobacco Marketplace (Quisenberry et al., 2016), a modification of procedures used with complex food purchasing choices (Epstein et al., 2010). In this model, multiple products are available simultaneously in a web-based storefront, similar to a real-world marketplace. Participants allocate a budget to whatever mix of products they choose, and the procedure is repeated with the primary product of interest set to a new price. This procedure allows for the measurement of multiple product interactions simultaneously, which can both save time and more closely resemble actual product marketplaces.

3.4. Extracting behavioral economic demand parameters

Consumption for a variable-price commodity decrease as price increases in a characteristic way that is well described by a function first proposed by Hursh and Silberberg (2008):

log10Q=log10Q0+k(eαQ0C1) (2)

where Q is consumption of a given commodity at price C, Q0 is derived consumption as price approaches zero and is a measure of demand intensity, α is demand elasticity, and k is the vertical span of the function in log10 units from unconstrained consumption (free price) to the minimum consumption as price approaches infinity. Span can be set to a constant determined separately from the main analysis by either fitting it as a global shared parameter to all data under consideration or setting it to the actual span from the log-transformed consumption at the lowest price to the log-transformed consumption at the highest price. By fixing span to a constant across analyses, two free parameters representing demand intensity (Q0) and demand elasticity (α) remain. This equation generally provides very good fits to data from a wide variety of contexts (Amlung et al., 2012; Aston et al., 2015; Madden and Kalman, 2010; Roma et al., 2016). However, the left side of this equation is log10-transformed consumption data. Log transforming consumption data can pose a logistical problem as zero consumption values cannot be log transformed. With a sufficiently wide range of prices assessed, zero consumption values are inevitable. Both removing zeros and replacing them with nonzero values create problems of their own (Koffarnus et al., 2015; Liao et al., 2013; Yu et al., 2014), so to alleviate those issues, we recently proposed a modification of the Hursh and Silberberg (2008) function:

Q=Q010k(eαQ0C1) (3)

where Q, C, Q0, k, and α function the same as in Eq. (2). The only difference between the two is that we raised each side of the equation to a power of 10 so the untransformed consumption (Q) data can be fit without log transformation. We found that this modification allows for the same interpretation of the fitted parameters and, if anything, improved fits to the data (Koffarnus et al., 2015), as did an independent follow-up evaluation (Strickland et al., 2016).

Similar to discounting parameters, fitted demand parameters are often highly skewed (e.g. Lemley et al., 2016; MacKillop et al., 2010a). If these parameters are to be incorporated in statistical models that assume normally distributed data, transformation should be considered before proceeding with data analysis. Demand parameters can often be normalized with a logarithmic or square-root transformation (e.g., Amlung et al., 2013; Koffarnus et al., 2015), although this may not hold for all datasets. Also note that when selecting a goodness-of-fit statistic, the same considerations discussed in Section 2.8 and summarized in Table 1 apply as with nonlinear regression models applied to discounting data.

3.4.1. Normalization

When demand elasticity is the primary emphasis of a figure, normalization is a procedure that can be used to visually isolate those differences. A fundamental aspect of Eqs. (2) and (3) is that α is standardized based on level of consumption at free price (i.e., Q0), such that magnitude differences in a commodity reflect the same elasticity, or as termed by Hursh and Silberberg (2008), “essential value.” A full explanation is beyond the scope of this paper, so we direct readers to their 2008 publication; rather, here we aim to distinguish the standardization procedure inherent within the aforementioned equations with the normalization procedure proposed by Hursh and Winger (1995). In Hursh and Winger's normalization procedure,1 both unit price and consumption data are standardized to a “normalized dose”, which is equal to 100 ÷ Q0, Using this quantity, normalized consumption (Qnorm) is calculated as: Qnorm = (Q * 100) ÷ Q0 and normalized price (Pnorm) is calculated as: Pnorm = (C * Q0) ÷100. Normalized consumption is then plotted as a function of normalized price. As long as the parameters in Eqs. (2) or (3) are held constant, values of α are identical to that of non-normalized data.

Take Fig. 2 for illustration. We generated a series of curves using known, a priori selected parameters (see figure and caption for specific values) and graphed the normalized and non-normalized data. Panel A in Fig. 2 shows non-normalized data. Notice that although the curves with differing values of Q0 intersect, the values of α are identical. It may be difficult to judge the equality of α by visual analysis alone, so this is made easier when data are transformed using the normalization procedure just described (i.e., the overlapping curves; Panel B). On normalized coordinates, demand curves with the same elasticity values will always fall on the same curve. Contrast this with the bottom two panels in Fig. 2. Here, we have generated three sets of curves with differing values of α and Q0. In Panel C, it is still difficult to tell the degrees of differences in elasticity between the curves as compared to Panel A. However, now when normalized transformed data are depicted (and levels of Q0 are again not of interest as all three curves start at 100; same as Panel B), it is much easier to visualize differences in α, which now show up as roughly parallel curves (Panel D).

Fig. 2.

Fig. 2

Typical examples of how differences in demand intensity (Q0) and elasticity (α) are affected by the normalization procedure proposed by Hursh and Winger (1995). When Q0 differs (panel A), it can be hard to identify curves with similar elasticities, but normalization of the same data makes this obvious visually because all data with the same elasticity fall on the same curve when normalized (panel B). When both Q0 and α differ (panel C), distinguishing which curve is most or least elastic is also difficult, but normalization of these data produces parallel curves aligned from highest to lowest elasticity (panel D).

3.4.2. Cross-product interactions

To measure product interactions, Hursh and Roma (2013) proposed a cross-price elasticity equation as a complement to Eq. (2) above:

log10Q=log10Qalone+(IeβC) (4)

In this equation, Qalone represents the maximum consumption of the fixed-price commodity when the primary commodity has a price high enough to drive its consumption to zero, β is the sensitivity of fixed-price commodity consumption to the price of the primary commodity, I is an interaction parameter that indicates whether the fixed-price commodity is a substitute (positive I value), complement (negative I value), or independent (I value near zero), and Q and C represent consumption of the fixed-price commodity and cost of the primary commodity, respectively, and are known from data. Like Eq. (2), this equation requires log-transformed data to be fitted, which poses more of a problem than with the Eq. (2) since zero consumption data can be very common in substitution experiments (e.g., Quisenberry et al., 2016). Analogous to how we modified Eq. (3) above to allow for untransformed data to be fit, a logical extension of Eq. (4) would be to raise it to the power of 10 to fit cross price elasticity data including zero consumption values. Future work will determine the utility of this approach.

3.5. Nonsystematic data

Like with discounting data, data are sometimes obtained from demand tasks that are not internally consistent or indicate illogical responding. For example, a participant may indicate they would consume 1000 cigarettes in a 24-hour period, a level of consumption that would not be feasible. Alternatively, a participant may indicate no consumption at $5 per cigarette, but report they would consume 10 cigarettes at $100 per cigarette, a pattern that defies logic. These patterns can make it difficult to compare groups because they often represent outlier data that is not under the control of the experimental manipulations. Data consistency checks analogous to those proposed by Johnson and Bickel (2008) for discounting data have been used (Bruner and Johnson, 2014) and formally proposed (Stein et al., 2015) to identify and potentially censor datasets with illogical response patterns. Three criteria were proposed. The first two are ‘bounce’ and ‘trend’, which are directly analogous to the similarly named criteria for discounting data proposed by Johnson and Bickel (2008). Bounce refers to how often consumption increases as price increases, and trend refers to whether consumption is lower at the highest price than at the lowest price. Additionally, a third category, ‘reversals from zero’ was proposed as a special case of the pattern described in the bounce criterion. This criterion flags nonzero consumption at a price higher than a price where the participant indicated zero consumption, even if the increase was too small to be detected by the bounce criterion.

4. Drug choice

Drug abuse and addiction, fundamentally, can be conceptualized as repeated decisions to take a drug over abstaining. Drug choice procedures have been used to straightforwardly model the tendency to repeatedly take a drug by arranging a series of choices between an active drug and a comparator, typically placebo and/or an alternative drug. Participants are usually allowed to sample the drug or drugs in a blinded fashion, which is followed by a series of choice trials on separate sessions or within a session. Drug choice procedures have been used to study choices to use coffee (Griffiths et al., 1986), alcohol (de Wit and Chutuape, 1993), pentobarbital (Griffiths et al., 1980), diazepam (Griffiths et al., 1980; Johanson and Uhlenhuth, 1980a), and amphetamine (Johanson and Uhlenhuth, 1980b). Although studies of this type are often considered the gold standard of abuse liability assessments, most standard drug choice research where each option chosen is consumed by the subject is conducted in animal models due to the greater flexibility and control that is possible (Bergman and Paronis, 2006).

Another common drug choice procedure presents the opportunity to self-administer a drug against a non-drug reinforcer, which is typically money or a close analogue of money (e.g., vouchers). If the monetary amount is varied across trials, these procedures have the added ability to provide a measure of how much a drug is worth to participants. This type of procedure has been used widely to study self-administration of opiates like heroin, oxycodone, morphine, hydromorphone, and buprenorphine (Comer et al., 2013, 2005a, 2005b, 2002, 2001, 1999; Comer and Collins, 2002; Greenwald and Hursh, 2006; Greenwald and Steinmiller, 2009; Jones et al., 2014; Middleton et al., 2012). Additional drugs from other classes have also been studied like marijuana (Hart et al., 2002).

4.1. Multiple-choice procedure

The multiple-choice procedure was developed in response to the time consuming nature of human drug choice procedures and drug self-administration procedures that were impractical to conduct in many situations (Griffiths et al., 1993). Traditional choice procedures arranged the delivery of each consequence chosen. Since multiple choice trials are typically necessary to determine if a drug has abuse liability or a treatment is effective, these procedures are time-consuming. The multiple-choice procedure typically begins with an exposure period where the participants sample a drug, although this step can be skipped if the drug is not delivered blinded and the participant is familiar with it (e.g., Benson et al., 2009 with alcohol choices). This exposure period is followed by a series of choice trials all completed in a short time frame. Instead of delivering the consequence of each choice trial, participants are told that they will receive the option chosen for one of the choice trials that will be randomly selected. This preserves the fidelity of the data because any given choice in the experiment could be selected as the ‘real’ one, but a great deal of experimental time is saved since many choices can be made in a single session.

Since it was first developed (Griffiths et al., 1993), the multiple-choice procedure has been used in a number of contexts. A frequent use has been to assess abuse liability of a drug. In these experiments, participants are typically exposed to a blinded drug dose and a comparator (often money) on separate sessions. If the participant then chooses the active drug over money on subsequent choice trials, the drug can be said to have some abuse liability. This procedure has the extra benefit of being able to determine not only if the participant would like to self-administer the drug, but how much those administrations are worth. This procedure has been used to assess the abuse liability of a range of drugs including pentobarbital (Griffiths et al., 1993), cigarettes (Griffiths et al., 1996), alcohol (Benson et al., 2009; Correia and Little, 2006), stimulants (Alessi et al., 2003; Jones et al., 1999; Stoops, 2003), MDMA (Tancer and Johanson, 2006), electronic cigarettes (Vansickel et al., 2012), caffeine (Garrett and Griffiths, 1998; Schuh and Griffiths, 1997), marijuana (Greenwald and Stitzer, 2000), opiates (Greenwald et al., 1999), and tobacco/alcohol combinations (Schmitz et al., 2003). This procedure has also been used to evaluate treatment services. Effectiveness of treatment components can be evaluated by their ability to reduce or abolish choices for drug over alternatives in the multiple-choice procedure (e.g., Lile et al., 2004), and patient preference for different treatment approaches have also been evaluated (Chutuape et al., 1998; Kidorf et al., 1995).

4.2. Quantifying drug choice

Choice experiments typically present participants with a series of discrete choices with the chosen drug or drug alternative given to the participant for at least one of the choices. The quantification of drug choice is then simply the number of times it was chosen compared to an alternative. However, some researchers have begun to apply behavioral economic demand analyses to serial money vs. choice data collected from these experiments (e.g., Greenwald and Hursh, 2006). The combination of choice and demand methodologies may allow for the integration of concepts such as demand intensity and elasticity with discrete-trial choice data.

5. Iowa Gambling Task (IGT)

Initially developed as a task to detect insufficiencies/damage to the ventromedial prefrontal cortex (Bechara et al., 1994) in individuals who otherwise displayed normal performance on other decision-making tasks, applications of the IGT have been expanded to assess a wide range of decision-making and cognitive deficits (Bechara, 2007), including addiction and pathological gambling.

The original implementation of the IGT (also known simply as the gambling task) used physical decks of cards and although it is now often administered electronically (e.g., via computer), core aspects of the task remain. Importantly, research suggests performance is comparable between both versions (Bechara et al., 2000; Bowman et al., 2005). However, it appears that the instruction set is likely to affect performance (Fernie and Tunney, 2006). In addition, performance on versions using real or facsimile money (Bowman and Turnbull, 2003; Carter and Pasqualini, 2004) is comparable. In the IGT, participants are endowed with $2000 of “play money” and they are told to choose cards from four decks of cards, identical in appearance, to maximize the amount of money earned. Typically ended after 100 trials, participants are not told how many choices they will have to make.

In the long run, two of the four decks, decks A and B, are considered disadvantageous, whereas the other two decks, decks C and D, are considered advantageous. Each card choice in decks A and B results in a $100 gain and each card choice in decks C and D results in a $50 gain. In this respect, it would be advantageous to choose cards from the first two decks. However, each deck is also associated with a punishment contingency. For each card chosen from any deck, there is a chance that a participant will lose money (in addition to what is gained). Associated with each of block of 10 trials, decks A and B result in a net loss of $250, whereas decks C and D results in a net gain of $250. Further broken down within each block of 10 trials, decks A and C are associated with more frequent, yet smaller money losses and decks B and D with one large money loss. More choices of the advantageous decks indicate more optimal performance. Bechara et al. (1994) found that compared to healthy controls, participants with damage to parts of their ventromedial prefrontal cortex chose more cards from the disadvantageous decks and that selections from these decks persisted. Control participants, on the other hand, sampled from all decks initially, but allocated more choices towards the advantageous decks as trials progressed.

5.1. Role of IGT in addiction

Similar to choice trials in the delay discounting paradigm, the IGT incorporates outcomes where decisions can result in relatively immediate, large gains, but that are also associated with greater long-term losses. Additionally, optimal responding requires an accurate accounting of probabilistic rewards, which relates to probability discounting as well. Poor performance on the IGT may be reflective of greater sensitivity to immediate rewards or low sensitivity to probabilistic losses. An individual who is insensitive to smaller, more frequent losses and to long term payouts (i.e., outcomes) would be more likely to persist in choosing from deck A. A similar individual who is also insensitive to the delayed outcomes, but is sensitive to the more frequent punishments may be more likely to persist on deck B. Recall, however, that both of these decks are disadvantageous in the long run.

5.2. Distinguishing addiction from typical performance

Several studies have evaluated performance on the IGT among a variety of clinical populations including alcohol, nicotine, cocaine, opiate, and marijuana users. Overall, results from these studies indicate suboptimal performance (i.e., persistence in card selections from the disadvantageous decks) by substance abusers compared to controls, however caution must be exercised given the different methods by which performance on the IGT can be measured. For example, alcohol-dependent participants had lower scores compared to healthy controls during the latter blocks of the IGT (Kim et al., 2011). Alcohol-dependent participants scored lower on all blocks of trials compared to controls (Goudriaan et al., 2005). Fein et al. (2004) showed that long-term abstinent (≥6 mo) alcoholics performed more poorly on the task (less difference between advantageous and disadvantageous decks) compared to controls. However, not all of the research clearly points to decreased performance (Bowden-Jones et al., 2005) and differences exist between initial trials and later trials (Ernst et al., 2003).

Similar decrements in performance were noted in other substance using populations compared to controls, including opiate users (Mintzer and Stitzer, 2002; Petry et al., 1998) and cocaine users (Verdejo-Garcia et al., 2007; Stout et al., 2004).

In addition to distinguishing drug users from controls, IGT performance is also related to drug use severity or frequency. Higher reported amounts of cocaine use was related to poorer performance (Monterosso et al., 2001) among cocaine-dependent participants and longer-term heavy marijuana use was also associated with decreased performance (Whitlow et al., 2004).

Finally, IGT performance has also been shown to be associated with initiation and maintenance of abstinence among substance users. Bartzokis et al. (2000) found recently abstinent cocaine-dependent males performed statistically significantly better than current cocaine-dependent males. Nejtek et al. (2013) conducted a longitudinal study with two groups of participants: individuals with comorbid mood disorder and cocaine/methamphetamine use and cocaine-dependent individuals with no mood disorders. Although they found no group differences in IGT performance, baseline performance (i.e., selections from the disadvantageous decks) of the comorbid group statistically significantly predicted the number of negative urine tests throughout the 20-week study. In contrast, Schmitz et al. (2009) found that IGT score was not predictive of retention in a treatment program for cocaine-dependent participants, yet they did find that participants who successfully achieved abstinence scored better on the task. Bolla et al. (2005) examined performance among recently abstinent (~25 days) marijuana users and found they performed more poorly compared to controls.

5.3. Measuring the IGT

Outcome measures from the IGT include total amount of money earned and choice allocation among the two sets of decks. Most often, choice allocation, or a net score, is defined as the difference between card selections from the advantageous deck and from the disadvantageous deck. Choice allocation may also be broken down by subsets of trials, typically five blocks of 20 trials each. More rarely, however, cutoff scores may be used (Bechara et al., 2001; Verdejo-Garcia et al., 2006). In these cases, a cutoff score of 10 or less, calculated by taking the sum of advantageous decks minus the sum of disadvantageous decks, has been used.

6. Balloon Analogue Risk Task (BART)

The BART is a behavioral task used to measure risky behavior (Lejuez et al., 2002). The task is administered electronically (i.e., on a computer). Participants view what looks to be a balloon, which is the same size at the beginning of each trial. At any time during the task, participants have two options: they can click the balloon or click a button to redeem the money earned thus far from pumping up the balloon. Choosing the latter ends the current trial, money is earned, and a new trial begins. Each time the participant clicks on the balloon, it gets larger (e.g., 0.125 in increase) and the participant is awarded (e.g., 5 cents). However, associated with each pump is a probability that the balloon explodes, a “popping” sound is emitted, and the participant loses any money that had been accrued during that trial. Three different balloon colors (i.e., blue, yellow, orange) are presented during 90 trials and each balloon color is associated with a different probability of exploding, resulting in an expected 64, 16, and 4 pumps before popping, respectively. Variants of the task use fewer trials or colors (Lejuez et al., 2003).

6.1. Role of BART in addiction

The BART attempts to approximate risky choice in everyday behavior, such that at some point there are diminished returns for continuing to engage in a given behavior (e.g., drinking alcohol). With everyday behavior, one simply stops engaging in that behavior and with the BART, the individual can “cash out”. The BART may be conceived in a loose sense as having similar features to both the IGT. The IGT consists of risky choices that also pay out, very much similar to the BART.

In their seminal article, Lejuez et al. (2002) demonstrated performance on the BART was statistically significantly correlated with self-report measures of impulsivity, including the Barratt Impulsiveness total score (Barratt, 1985), Eysenck Impulsivity subscale score (Eysenck et al., 1984), Multidimensional Personality Questionnaire Behavioral Constraint subfactor score (Tellegen and Waller, 2008), and Sensation Seeking total score (Zuckerman and Eysenck, 1978). The researchers also found performance was correlated with self-report measures of everyday risk behavior, for example, scores on the Alcohol Use Disorders Identification Task, number of cigarettes smoked per day, and gambling behavior. Lejuez et al. also demonstrated the BART had incremental validity over and above demographic and impulsivity self-report measures when predicting delinquency risk behaviors and substance use and sexual risk behaviors.

More pumps may be thought of as indicative of greater impulsivity and risk taking because each additional pump increases the chances of the balloon popping and, thus, losing all money earned during that trial. However, many of the studies examining the BART reveal that participants (designated as a clinical sample or not) do not pump past the “optimal” number, for example 64 pumps on the blue balloon and so, although risky, more pumps ultimately earn more money.

6.2. Distinguishing addiction from typical performance

Lejuez et al. (2005, 2003) found smokers displayed greater adjusted scores (average number of pumps for all non-exploded balloons) and higher earnings compared to control participants. However, Dean et al. (2011) were unable to replicate these results in smokers. Crowley et al. (2006) found that adolescents with substance use and conduct disorder engaged in more pumps compared to the control participants. Performance on the BART was also correlated with number of alcoholic drinks consumed per week, AUDIT score, and binge drinking questionnaire score among college students (Fernie et al., 2010). The BART is sensitive to individuals' histories of alcohol use disorders. In a comparison of three groups that included participants diagnosed with bipolar disorder with a history of alcohol use disorder, bipolar with no history of alcohol use disorder, and healthy controls, the group with a history of alcohol use disorder displayed statistically significantly greater number of pumps than the comparison groups (Holmes et al., 2009). Healthy controls and those with no history of an alcohol use disorder did not differ. Hopko et al. (2006) found differences in BART scores between college-aged participants who had never used MDMA (i.e., ecstasy), had used MDMA once, and had used MDMA more than once. Never users scored the lowest, whereas multiple-time users scored the highest.

6.3. Measuring the BART

Measures calculated from performance on the BART include monetary earnings, number of pumps, and number of explosions. Number of pumps can be adjusted (as a relative measure) by taking the average of only the pumps when balloons did not explode as this measure is “… preferable because the number of pumps was necessarily constrained on balloons that exploded, thereby limiting between-subjects variability in the absolute averages” (Lejuez et al., 2002; p. 78).

7. Conclusions

Delay discounting tasks, demand tasks, choice tasks, the IGT, and the BART are all commonly used to study dysfunctional decision making in addiction. As researchers continue to investigate how decision making is integral to addiction processes, the wealth of methodological detail reviewed here should assist them in their efforts.

Acknowledgments

This work was supported by the National Institutes of Health grant R01 DA042535. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Footnotes

1

Note that we have changed the variable letters used in Hursh and Winger (1995) to be consistent with those used in Eq. (2), which is as it appears in Hursh and Silberberg (2008).

References

  1. Acker J, MacKillop J. Behavioral economic analysis of cue-elicited craving for tobacco: a virtual reality study. Nicotine Tob. Res. 2013 doi: 10.1093/ntr/nts341. http://dx.doi.org/10.1093/ntr/nts341. [DOI] [PMC free article] [PubMed]
  2. Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol. Bull. 1975;82:463–496. doi: 10.1037/h0076860. http://dx.doi.org/10.1037/h0076860. [DOI] [PubMed] [Google Scholar]
  3. Alessi S, Greenwald M, Johanson C. The prediction of individual differences in response to D-amphetamine in healthy adults. Behav. Pharmacol. 2003;14:19–32. doi: 10.1097/00008877-200302000-00002. http://dx.doi.org/10.1097/01.fbp.0000054302.62624.cc. [DOI] [PubMed] [Google Scholar]
  4. Amlung M, MacKillop J. Understanding the effects of stress and alcohol cues on motivation for alcohol via behavioral economics. Alcohol. Clin. Exp. Res. 2014;38:1780–1789. doi: 10.1111/acer.12423. http://dx.doi.org/10.1111/acer.12423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Amlung M, Acker J, Stojek MK, Murphy JG, Mackillop J. Is talk “cheap”? An initial investigation of the equivalence of alcohol purchase task performance for hypothetical and actual rewards. Alcohol. Clin. Exp. Res. 2012;36:716–724. doi: 10.1111/j.1530-0277.2011.01656.x. http://dx.doi.org/10.1111/j.1530-0277.2011.01656.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Amlung M, Few LR, Howland J, Rohsenow DJ, Metrik J, MacKillop J. Impulsivity and alcohol demand in relation to combined alcohol and caffeine use. Exp. Clin. Psychopharmacol. 2013;21:467–474. doi: 10.1037/a0034214. http://dx.doi.org/10.1037/a0034214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Amlung M, Vedelago L, Acker J, Balodis I, MacKillop J. Steep delay discounting and addictive behavior: a meta-analysis of continuous associations. Addiction. 2017;112:51–62. doi: 10.1111/add.13535. http://dx.doi.org/10.1111/add.13535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Aston ER, Metrik J, MacKillop J. Further validation of a marijuana purchase task. Drug Alcohol Depend. 2015;152:32–38. doi: 10.1016/j.drugalcdep.2015.04.025. http://dx.doi.org/10.1016/j.drugalcdep.2015.04.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Audrain-McGovern J, Rodriguez D, Epstein LH, Cuevas J, Rodgers K, Wileyto EP. Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend. 2009;103:99–106. doi: 10.1016/j.drugalcdep.2008.12.019. http://dx.doi.org/10.1016/j.drugalcdep.2008.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Ayduk O, Mendoza-Denton R, Mischel W, Downey G, Peake PK, Rodriguez M. Regulating the interpersonal self: strategic self-regulation for coping with rejection sensitivity. J. Pers. Soc. Psychol. 2000;79:776–792. doi: 10.1037//0022-3514.79.5.776. http://dx.doi.org/10.1037/0022-3514.79.5.776. [DOI] [PubMed] [Google Scholar]
  11. Baker F, Johnson MW, Bickel WK. Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude. J. Abnorm. Psychol. 2003;112:382–392. doi: 10.1037/0021-843x.112.3.382. http://dx.doi.org/10.1037/0021-843X.112.3.382. [DOI] [PubMed] [Google Scholar]
  12. Barratt ES. Impulsiveness subtraits: arousal and information processing. Motiv. Emot. Personal. 1985;5:137–146. [Google Scholar]
  13. Bartzokis G, Lu PH, Beckson M, Rapoport R, Grant S, Wiseman EJ, London ED. Abstinence from cocaine reduces high-risk responses on a gambling task. Neuropsychopharmacology. 2000;22:102–103. doi: 10.1016/S0893-133X(99)00077-9. http://dx.doi.org/10.1016/S0893-133X(99)00077-9. [DOI] [PubMed] [Google Scholar]
  14. Bechara A. Iowa Gambling Task. Psychological Assessment Resources 2007 [Google Scholar]
  15. Bechara A, Damasio AR, Damasio H, Anderson SW. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition. 1994;50:7–15. doi: 10.1016/0010-0277(94)90018-3. http://dx.doi.org/10.1016/0010-0277(94)90018-3. [DOI] [PubMed] [Google Scholar]
  16. Bechara A, Tranel D, Damasio H. Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain. 2000;123:2189–2202. doi: 10.1093/brain/123.11.2189. http://dx.doi.org/10.1093/brain/123.11.2189. [DOI] [PubMed] [Google Scholar]
  17. Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE. Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia. 2001;39:376–389. doi: 10.1016/s0028-3932(00)00136-6. http://dx.doi.org/10.1016/S0028-3932(00)00136-6. [DOI] [PubMed] [Google Scholar]
  18. Benson TA, Little CS, Henslee AM, Correia CJ. Effects of reinforcer magnitude and alternative reinforcer delay on preference for alcohol during a multiple-choice procedure. Drug Alcohol Depend. 2009;100:161–163. doi: 10.1016/j.drugalcdep.2008.09.005. http://dx.doi.org/10.1016/j.drugalcdep.2008.09.005. [DOI] [PubMed] [Google Scholar]
  19. Bergman J, Paronis CA. Measuring the reinforcing strength of abused drugs. Mol. Interv. 2006;6:273–283. doi: 10.1124/mi.6.5.9. http://dx.doi.org/10.1124/mi.6.5.9. [DOI] [PubMed] [Google Scholar]
  20. Bickel WK, Marsch LA. Toward a behavioral economic understanding of drug dependence: delay counting process. Addiction. 2001;96:73–86. doi: 10.1046/j.1360-0443.2001.961736.x. http://dx.doi.org/10.1080/09652140020016978. [DOI] [PubMed] [Google Scholar]
  21. Bickel WK, Degrandpre RJ, Hughes JR, Higgins ST. Behavioral economics of drug self-administration. II. A unit-price analysis of cigarette smoking. J. Exp. Anal. Behav. 1991;55:145–154. doi: 10.1901/jeab.1991.55-145. http://dx.doi.org/10.1901/jeab.1991.55-145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Bickel WK, Odum AL, Madden GJ. Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology. 1999;146:447–454. doi: 10.1007/pl00005490. http://dx.doi.org/10.1007/PL00005490. [DOI] [PubMed] [Google Scholar]
  23. Bickel WK, Pitcock JA, Yi R, Angtuaco EJC. Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses. J. Neurosci. 2009;29:8839–8846. doi: 10.1523/JNEUROSCI.5319-08.2009. http://dx.doi.org/10.1523/JNEUROSCI.5319-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Bickel WK, Jarmolowicz DP, Mueller ET, Koffarnus MN, Gatchalian KM. Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacol. Ther. 2012;134:287–297. doi: 10.1016/j.pharmthera.2012.02.004. http://dx.doi.org/10.1016/j.pharmthera.2012.02.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Bickel WK, Johnson MW, Koffarnus MN, MacKillop J, Murphy JG. The behavioral economics of substance use disorders: reinforcement pathologies and their repair. Annu. Rev. Clin. Psychol. 2014a;10:641–677. doi: 10.1146/annurev-clinpsy-032813-153724. http://dx.doi.org/10.1146/annurev-clinpsy-032813-153724. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Bickel WK, Koffarnus MN, Moody L, Wilson AG. The behavioral- and neuro-economic process of temporal discounting: a candidate behavioral marker of addiction. Neuropharmacology. 2014b;76:518–527. doi: 10.1016/j.neuropharm.2013.06.013. http://dx.doi.org/10.1016/j.neuropharm.2013.06.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Bidwell LC, MacKillop J, Murphy JG, Grenga A, Swift RM, McGeary JE. Biphasic effects of alcohol on delay and probability discounting. Exp. Clin. Psychopharmacol. 2013;21:214–221. doi: 10.1037/a0032284. http://dx.doi.org/10.1037/a0032284. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Bolla KI, Eldreth DA, Matochik JA, Cadet JL. Neural substrates of faulty decision-making in abstinent marijuana users. NeuroImage. 2005;26:480–492. doi: 10.1016/j.neuroimage.2005.02.012. http://dx.doi.org/10.1016/j.neuroimage.2005.02.012. [DOI] [PubMed] [Google Scholar]
  29. Borges AM, Kuang J, Milhorn H, Yi R. An alternative approach to calculating Area-Under-the-Curve (AUC) in delay discounting research. J. Exp. Anal. Behav. 2016;106:145–155. doi: 10.1002/jeab.219. http://dx.doi.org/10.1002/jeab.219. [DOI] [PubMed] [Google Scholar]
  30. Bowden-Jones H, McPhillips M, Rogers R, Hutton S, Joyce E. Risk-taking on tests sensitive to ventromedial prefrontal cortex dysfunction predicts early relapse in alcohol dependency: a pilot study. J. Neuropsychiatr. Clin. Neurosci. 2005;17:417–420. doi: 10.1176/jnp.17.3.417. http://dx.doi.org/10.1176/appi.neuropsych.17.3.417. [DOI] [PubMed] [Google Scholar]
  31. Bowman CH, Turnbull OH. Real versus facsimile reinforcers on the Iowa Gambling Task. Brain Cogn. 2003;53:207–210. doi: 10.1016/s0278-2626(03)00111-8. http://dx.doi.org/10.1016/S0278-2626(03)00111-8. [DOI] [PubMed] [Google Scholar]
  32. Bowman CH, Evans CEY, Turnbull OH. Artificial time constraints on the Iowa Gambling Task: the effects on behavioural performance and subjective experience. Brain Cogn. 2005;57:21–25. doi: 10.1016/j.bandc.2004.08.015. http://dx.doi.org/10.1016/j.bandc.2004.08.015. [DOI] [PubMed] [Google Scholar]
  33. Bruner NR, Johnson MW. Demand curves for hypothetical cocaine in cocaine-dependent individuals. Psychopharmacology. 2014;231:889–897. doi: 10.1007/s00213-013-3312-5. http://dx.doi.org/10.1007/s00213-013-3312-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Carter S, Pasqualini MS. Stronger autonomic response accompanies better learning: a test of Damasio's somatic marker hypothesis. Cognit. Emot. 2004;18:901–911. http://dx.doi.org/10.1080/02699930341000338. [Google Scholar]
  35. Christensen CJ, Silberberg A, Hursh SR, Roma PG, Riley AL. Demand for cocaine and food over time. Pharmacol. Biochem. Behav. 2008;91:209–216. doi: 10.1016/j.pbb.2008.07.009. http://dx.doi.org/10.1016/j.pbb.2008.07.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Chutuape MA, Silverman K, Stitzer ML. Survey assessment of methadone treatment services as reinforcers. Am. J. Drug Alcohol Abuse. 1998;24:1–16. doi: 10.3109/00952999809001695. [DOI] [PubMed] [Google Scholar]
  37. Coffey SF, Gudleski GD, Saladin ME, Brady KT. Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp. Clin. Psychopharmacol. 2003;11:18–25. doi: 10.1037//1064-1297.11.1.18. http://dx.doi.org/10.1037/1064-1297.11.1.18. [DOI] [PubMed] [Google Scholar]
  38. Comer SD, Collins ED. Self-administration of intravenous buprenorphine and the buprenorphine/naloxone combination by recently detoxified heroin abusers. J. Pharmacol. Exp. Ther. 2002;303:695–703. doi: 10.1124/jpet.102.038141. http://dx.doi.org/10.1124/jpet.102.038141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Comer SD, Collins ED, MacArthur RB, Fischman MW. Comparison of intravenous and intranasal heroin self-administration by morphine-maintained humans. Psychopharmacology. 1999;143:327–338. doi: 10.1007/s002130050956. http://dx.doi.org/10.1007/s002130050956. [DOI] [PubMed] [Google Scholar]
  40. Comer SD, Collins ED, Fischman MW. Buprenorphine sublingual tablets: effects on IV heroin self-administration by humans. Psychopharmacology. 2001;154:28–37. doi: 10.1007/s002130000623. http://dx.doi.org/10.1007/s002130000623. [DOI] [PubMed] [Google Scholar]
  41. Comer SD, Collins ED, Fischman MW. Intravenous buprenorphine self-administration by detoxified heroin abusers. J. Pharmacol. Exp. Ther. 2002;301:266–276. doi: 10.1124/jpet.301.1.266. http://dx.doi.org/10.1124/jpet.301.1.266. [DOI] [PubMed] [Google Scholar]
  42. Comer SD, Sullivan MA, Walker EA. Comparison of intravenous buprenorphine and methadone self-administration by recently detoxified heroin-dependent individuals. J. Pharmacol. Exp. Ther. 2005a;315:1320–1330. doi: 10.1124/jpet.105.090423. http://dx.doi.org/10.1124/jpet.105.090423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Comer SD, Walker EA, Collins ED. Buprenorphine/naloxone reduces the reinforcing and subjective effects of heroin in heroin-dependent volunteers. Psychopharmacology. 2005b;181:664–675. doi: 10.1007/s00213-005-0023-6. http://dx.doi.org/10.1007/s00213-005-0023-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Comer SD, Metz VE, Cooper ZD, Kowalczyk WJ, Jones JD, Sullivan MA, Manubay JM, Vosburg SK, Smith ME, Peyser D, Saccone PA. Comparison of a drug versus money and drug versus drug self-administration choice procedure with oxycodone and morphine in opioid addicts. Behav. Pharmacol. 2013;24:504–516. doi: 10.1097/FBP.0b013e328363d1c4. http://dx.doi.org/10.1097/FBP.0b013e328363d1c4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Correia CJ, Little C. Use of a multiple-choice procedure with college student drinkers. Psychol. Addict. Behav. 2006;20:445–452. doi: 10.1037/0893-164X.20.4.445. http://dx.doi.org/10.1037/0893-164X.20.4.445. [DOI] [PubMed] [Google Scholar]
  46. Crowley TJ, Raymond KM, Mikulich-Gilbertson SK, Thompson LL, Lejuez CW. A risk-taking “set” in a novel task among adolescents with serious conduct and substance problems. J. Am. Acad. Child Adolesc. Psychiatry. 2006;45:175–183. doi: 10.1097/01.chi.0000188893.60551.31. http://dx.doi.org/10.1097/01.chi.0000188893.60551.31. [DOI] [PubMed] [Google Scholar]
  47. Dallery J, Raiff BR. Delay discounting predicts cigarette smoking in a laboratory model of abstinence reinforcement. Psychopharmacology. 2007;190:485–496. doi: 10.1007/s00213-006-0627-5. http://dx.doi.org/10.1007/s00213-006-0627-5. [DOI] [PubMed] [Google Scholar]
  48. Dean AC, Sugar CA, Hellemann G, London ED. Is all risk bad? Young adult cigarette smokers fail to take adaptive risk in a laboratory decision-making test. Psychopharmacology. 2011;215:801–811. doi: 10.1007/s00213-011-2182-y. http://dx.doi.org/10.1007/s00213-011-2182-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Du W, Green L, Myerson J. Cross-cultural comparisons of discounting delayed and probabilistic rewards. Psychol. Rec. 2002;52:479–492. [Google Scholar]
  50. Epstein LH, Dearing KK, Roba LG, Finkelstein E. The influence of taxes and subsidies on energy purchased in an experimental purchasing study. Psychol. Sci. 2010;21:406–414. doi: 10.1177/0956797610361446. http://dx.doi.org/10.1177/0956797610361446. [DOI] [PubMed] [Google Scholar]
  51. Ernst M, Grant SJ, London ED, Contoreggi CS, Kimes AS, Spurgeon L. Decision making in adolescents with behavior disorders and adults with substance abuse. Am. J. Psychiatry. 2003;160:33–40. doi: 10.1176/appi.ajp.160.1.33. http://dx.doi.org/10.1176/appi.ajp.160.1.33. [DOI] [PubMed] [Google Scholar]
  52. Eysenck SB, Barrett P, Eysenck HJ. Eysenck Personality Questionnaire-revised. Pergamon Press; 1984. [Google Scholar]
  53. Fein G, Klein L, Finn P. Impairment on a simulated gambling task in long-term abstinent alcoholics. Alcohol. Clin. Exp. Res. 2004;28:1487–1491. doi: 10.1097/01.alc.0000141642.39065.9b. (doi:00000374-200410000-00007 [pii]) [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Fernie G, Tunney RJ. Some decks are better than others: the effect of reinforcer type and task instructions on learning in the Iowa Gambling Task. Brain Cogn. 2006;60:94–102. doi: 10.1016/j.bandc.2005.09.011. http://dx.doi.org/10.1016/j.bandc.2005.09.011. [DOI] [PubMed] [Google Scholar]
  55. Fernie G, Cole JC, Goudie AJ, Field M. Risk-taking but not response inhibition or delay discounting predict alcohol consumption in social drinkers. Drug Alcohol Depend. 2010;112:54–61. doi: 10.1016/j.drugalcdep.2010.05.011. http://dx.doi.org/10.1016/j.drugalcdep.2010.05.011. [DOI] [PubMed] [Google Scholar]
  56. Franck CT, Koffarnus MN, House LL, Bickel WK. Accurate characterization of delay discounting: a multiple model approach using approximate Bayesian model selection and a unified discounting measure. J. Exp. Anal. Behav. 2015;103:218–233. doi: 10.1002/jeab.128. http://dx.doi.org/10.1002/jeab.128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Garrett BE, Griffiths RR. Physical dependence increases the relative reinforcing effects of caffeine versus placebo. Psychopharmacology. 1998;139:195–202. doi: 10.1007/s002130050704. http://dx.doi.org/10.1007/s002130050704. [DOI] [PubMed] [Google Scholar]
  58. Goudriaan AE, Oosterlaan J, De Beurs E, Van Den Brink W. Decision making in pathological gambling: a comparison between pathological gamblers, alcohol dependents, persons with Tourette syndrome, and normal controls. Cogn. Brain Res. 2005;23:137–151. doi: 10.1016/j.cogbrainres.2005.01.017. http://dx.doi.org/10.1016/j.cogbrainres.2005.01.017. [DOI] [PubMed] [Google Scholar]
  59. Gray JC, MacKillop J. Using behavior economics to understand alcohol use disorders: a concise review and identification of research priorities. Curr. Addict. Rep. 2015;2:68–75. doi: 10.1007/s40429-015-0045-z. http://dx.doi.org/10.1007/s40429-015-0045-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Green L, Myerson J. Exponential versus hyperbolic discounting of delayed outcomes: risk and waiting time. Am. Zool. 1996;36:496–505. http://dx.doi.org/10.1093/icb/36.4.496. [Google Scholar]
  61. Green L, Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychol. Bull. 2004;130:769–792. doi: 10.1037/0033-2909.130.5.769. http://dx.doi.org/10.1037/0033-2909.130.5.769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Greenwald MK, Hursh SR. Behavioral economic analysis of opioid consumption in heroin-dependent individuals: effects of unit price and pre-session drug supply. Drug Alcohol Depend. 2006;85:35–48. doi: 10.1016/j.drugalcdep.2006.03.007. http://dx.doi.org/10.1016/j.drugalcdep.2006.03.007. [DOI] [PubMed] [Google Scholar]
  63. Greenwald MK, Steinmiller CL. Behavioral economic analysis of opioid consumption in heroin-dependent individuals: effects of alternative reinforcer magnitude and post-session drug supply. Drug Alcohol Depend. 2009;104:84–93. doi: 10.1016/j.drugalcdep.2009.04.006. http://dx.doi.org/10.1016/j.drugalcdep.2009.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Greenwald MK, Stitzer ML. Antinociceptive, subjective and behavioral effects of smoked marijuana in humans. Drug Alcohol Depend. 2000;59:261–275. doi: 10.1016/s0376-8716(99)00128-3. http://dx.doi.org/10.1016/S0376-8716(99)00128-3. [DOI] [PubMed] [Google Scholar]
  65. Greenwald MK, Johanson C-E, Schuster CR. Opioid reinforcement in heroin-dependent volunteers during outpatient buprenorphine maintenance. Drug Alcohol Depend. 1999;56:191–203. doi: 10.1016/s0376-8716(99)00032-0. http://dx.doi.org/10.1016/S0376-8716(99)00032-0. [DOI] [PubMed] [Google Scholar]
  66. Griffiths RR, Bigelow GE, Liebson I, Kaliszak JE. Drug preference in humans: double-blind choice comparison of pentobarbital, diazepam and placebo. J. Pharmacol. Exp. Ther. 1980;215:649–661. [PubMed] [Google Scholar]
  67. Griffiths RR, Bigelow GE, Liebson IA. Human coffee drinking: reinforcing and physical dependence producing effects of caffeine. J. Pharmacol. Exp. Ther. 1986;239:416–425. [PubMed] [Google Scholar]
  68. Griffiths RR, Troisi JRI, Silverman K. Multiple-choice procedure: an efficient approach for investigating drug reinforcement in humans. Behav. Pharmacol. 1993;4:3–13. [PubMed] [Google Scholar]
  69. Griffiths RR, Rush CR, Puhala KA. Validation of the multiple-choice procedure for investigating drug reinforcement in humans. Exp. Clin. Psychopharmacol. 1996;4:97–106. http://dx.doi.org/10.1037/1064-1297.4.1.97. [Google Scholar]
  70. Hart CL, Haney M, Ward AS, Fischman MW, Foltin RW. Effects of oral THC maintenance on smoked marijuana self-administration. Drug Alcohol Depend. 2002;67:301–309. doi: 10.1016/s0376-8716(02)00084-4. http://dx.doi.org/10.1016/S0376-8716(02)00084-4. [DOI] [PubMed] [Google Scholar]
  71. Heil SH, Johnson MW, Higgins ST, Bickel WK. Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addict. Behav. 2006;31:1290–1294. doi: 10.1016/j.addbeh.2005.09.005. http://dx.doi.org/10.1016/j.addbeh.2005.09.005. [DOI] [PubMed] [Google Scholar]
  72. Herrmann ES, Hand DJ, Johnson MW, Badger GJ, Heil SH. Examining delay discounting of condom-protected sex among opioid-dependent women and non-drug-using control women. Drug Alcohol Depend. 2014;144:53–60. doi: 10.1016/j.drugalcdep.2014.07.026. http://dx.doi.org/10.1016/j.drugalcdep.2014.07.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Hoffman WF, Moore M, Templin R, McFarland B, Hitzemann RJ, Mitchell SH. Neuropsychological function and delay discounting in methamphetamine-dependent individuals. Psychopharmacology. 2006;188:162–170. doi: 10.1007/s00213-006-0494-0. http://dx.doi.org/10.1007/s00213-006-0494-0. [DOI] [PubMed] [Google Scholar]
  74. Holmes MK, Bearden CE, Barguil M, Fonseca M, Monkul ES, Nery FG, Soares JC, Mintz J, Glahn DC. Conceptualizing impulsivity and risk taking in bipolar disorder: importance of history of alcohol abuse. Bipolar Disord. 2009;11:33–40. doi: 10.1111/j.1399-5618.2008.00657.x. http://dx.doi.org/10.1111/j.1399-5618.2008.00657.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Holt DD, Green L, Myerson J. Is discounting impulsive? Evidence from temporal and probability discounting in gambling and non-gambling college students. Behav. Process. 2003;64:355–367. doi: 10.1016/s0376-6357(03)00141-4. http://dx.doi.org/10.1016/S0376-6357(03)00141-4. [DOI] [PubMed] [Google Scholar]
  76. Hopko DR, Lejuez CW, Daughters SB, Aklin WM, Osborne A, Simmons BL, Strong DR. Construct validity of the balloon analogue risk task (BART): relationship with MDMA use by inner-city drug users in residential treatment. J. Psychopathol. Behav. Assess. 2006;28:95–101. http://dx.doi.org/10.1007/s10862-006-7487-5. [Google Scholar]
  77. Hursh SR, Roma PG. Behavioral economics and empirical public policy. J. Exp. Anal. Behav. 2013;99:98–124. doi: 10.1002/jeab.7. http://dx.doi.org/10.1002/jeab.7. [DOI] [PubMed] [Google Scholar]
  78. Hursh SR, Silberberg A. Economic demand and essential value. Psychol. Rev. 2008;115:186–198. doi: 10.1037/0033-295X.115.1.186. http://dx.doi.org/10.1037/0033-295X.115.1.186. [DOI] [PubMed] [Google Scholar]
  79. Hursh SR, Winger G. Normalized demand for drugs and other reinforcers. J. Exp. Anal. Behav. 1995;64:373–384. doi: 10.1901/jeab.1995.64-373. http://dx.doi.org/10.1901/jeab.1995.64-373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Jacobs EA, Bickel WK. Modeling drug consumption in the clinic using simulation procedures: demand for heroin and cigarettes in opioid-dependent outpatients. Exp. Clin. Psychopharmacol. 1999;7:412–426. doi: 10.1037//1064-1297.7.4.412. http://dx.doi.org/10.1037//1064-1297.7.4.412. [DOI] [PubMed] [Google Scholar]
  81. Joe GW, Simpson DD. HIV risks, gender, and cocaine use among opiate users. Drug Alcohol Depend. 1995;37:23–28. doi: 10.1016/0376-8716(94)01030-o. http://dx.doi.org/10.1016/0376-8716(94)01030-O. [DOI] [PubMed] [Google Scholar]
  82. Johanson CE, Uhlenhuth EH. Drug preference and mood in humans: diazepam. Psychopharmacology. 1980a;71:269–273. doi: 10.1007/BF00433061. http://dx.doi.org/10.1007/BF00433061. [DOI] [PubMed] [Google Scholar]
  83. Johanson CE, Uhlenhuth EH. Drug preference and mood in humans: D-amphetamine. Psychopharmacology. 1980b;71:275–279. doi: 10.1007/BF00433062. http://dx.doi.org/10.1007/BF00433062. [DOI] [PubMed] [Google Scholar]
  84. Johnson MW, Bickel WK. Within-subject comparison of real and hypothetical money rewards in delay discounting. J. Exp. Anal. Behav. 2002;77:129–146. doi: 10.1901/jeab.2002.77-129. http://dx.doi.org/10.1901/jeab.2002.77-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Johnson MW, Bickel WK. Replacing relative reinforcing efficacy with behavioral economic demand curves. J. Exp. Anal. Behav. 2006;85:73–93. doi: 10.1901/jeab.2006.102-04. http://dx.doi.org/10.1901/jeab.2006.102-04. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Johnson MW, Bickel WK. An algorithm for identifying nonsystematic delay-discounting data. Exp. Clin. Psychopharmacol. 2008;16:264–274. doi: 10.1037/1064-1297.16.3.264. http://dx.doi.org/10.1037/1064-1297.16.3.264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  87. Johnson MW, Bruner NR. The Sexual Discounting Task: HIV risk behavior and the discounting of delayed sexual rewards in cocaine dependence. Drug Alcohol Depend. 2012;123:15–21. doi: 10.1016/j.drugalcdep.2011.09.032. http://dx.doi.org/10.1016/j.drugalcdep.2011.09.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Johnson PS, Johnson MW. Investigation of “bath salts” use patterns within an online sample of users in the United States. J. Psychoactive Drugs. 2014;46:369–378. doi: 10.1080/02791072.2014.962717. http://dx.doi.org/10.1080/02791072.2014.962717. [DOI] [PMC free article] [PubMed] [Google Scholar]
  89. Johnson MW, Bickel WK, Kirshenbaum AP. Substitutes for tobacco smoking: a behavioral economic analysis of nicotine gum, denicotinized cigarettes, and nicotine-containing cigarettes. Drug Alcohol Depend. 2004;74:253–264. doi: 10.1016/j.drugalcdep.2003.12.012. http://dx.doi.org/10.1016/j.drugalcdep.2003.12.012. [DOI] [PubMed] [Google Scholar]
  90. Johnson MW, Bickel WK, Baker F. Moderate drug use and delay discounting: a comparison of heavy, light, and never smokers. Exp. Clin. Psychopharmacol. 2007;15:187–194. doi: 10.1037/1064-1297.15.2.187. http://dx.doi.org/10.1037/1064-1297.15.2.187. [DOI] [PubMed] [Google Scholar]
  91. Johnson MW, Bickel WK, Baker F, Moore BA, Badger QJ, Budney AJ. Delay discounting in current and former marijuana-dependent individuals. Exp. Clin. Psychopharmacol. 2010;18:99–107. doi: 10.1037/a0018333. http://dx.doi.org/10.1037/A0018333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Johnson PS, Sweeney MM, Herrmann ES, Johnson MW. Alcohol increases delay and probability discounting of condom-protected sex: a novel vector for alcohol- related HIV transmission. Alcohol. Clin. Exp. Res. 2016;40:1339–1350. doi: 10.1111/acer.13079. http://dx.doi.org/10.1111/acer.13079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  93. Johnson MW, Herrmann ES, Sweeney MM, LeComte RS, Johnson PS. Cocaine administration dose-dependently increases sexual desire and decreases condom use likelihood: the role of delay and probability discounting in connecting cocaine with HIV. Psychopharmacology. 2017;234:599–612. doi: 10.1007/s00213-016-4493-5. http://dx.doi.org/10.1007/s00213-016-4493-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  94. Jones B, Rachlin H. Social discounting. Psychol. Sci. 2006;17:283–286. doi: 10.1111/j.1467-9280.2006.01699.x. http://dx.doi.org/10.1111/j.1467-9280.2006.01699.x. [DOI] [PubMed] [Google Scholar]
  95. Jones HE, Garrett BE, Griffiths RR. Subjective and physiological effects of intravenous nicotine and cocaine in cigarette smoking cocaine abusers. J. Pharmacol. Exp. Ther. 1999;288:188–197. [PubMed] [Google Scholar]
  96. Jones JD, Madera G, Comer SD. The reinforcing and subjective effects of intravenous and intranasal buprenorphine in heroin users. Pharmacol. Biochem. Behav. 2014;122:299–306. doi: 10.1016/j.pbb.2014.04.012. http://dx.doi.org/10.1016/j.pbb.2014.04.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Kaplan BA, Amlung M, Reed DD, Jarmolowicz DP, McKerchar TL, Lemley SM. Automating scoring of delay discounting for the 21- and 27-item monetary choice questionnaires. Behav. Anal. 2016;39:293–304. doi: 10.1007/s40614-016-0070-9. http://dx.doi.org/10.1007/s40614-016-0070-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  98. Kidorf M, Stitzer ML, Griffiths RR. Evaluating the reinforcement value of clinic-based privileges through a multiple choice procedure. Drug Alcohol Depend. 1995;39:167–172. doi: 10.1016/0376-8716(95)01136-7. http://dx.doi.org/10.1016/0376-8716(95)01136-7. [DOI] [PubMed] [Google Scholar]
  99. Kim YT, Sohn H, Jeong J. Delayed transition from ambiguous to risky decision making in alcohol dependence during Iowa Gambling Task. Psychiatry Res. 2011;190:297–303. doi: 10.1016/j.psychres.2011.05.003. http://dx.doi.org/10.1016/j.psychres.2011.05.003. [DOI] [PubMed] [Google Scholar]
  100. Kirby KN, Petry NM, Bickel WK. Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. J. Exp. Psychol. Gen. 1999;128:78–87. doi: 10.1037//0096-3445.128.1.78. http://dx.doi.org/10.1037/0096-3445.128.1.78. [DOI] [PubMed] [Google Scholar]
  101. Koffarnus M, Bickel W. A 5-trial adjusting delay discounting task: accurate discount rates in less than one minute. Exp. Clin. Psychopharmacol. 2014;22:222–228. doi: 10.1037/a0035973. http://dx.doi.org/10.1037/a0035973. [DOI] [PMC free article] [PubMed] [Google Scholar]
  102. Koffarnus MN, Franck CT, Stein JS, Bickel WK. A modified exponential behavioral economic demand model to better describe consumption data. Exp. Clin. Psychopharmacol. 2015;23:504–512. doi: 10.1037/pha0000045. http://dx.doi.org/10.1037/pha0000045. [DOI] [PMC free article] [PubMed] [Google Scholar]
  103. Koffarnus MN, Johnson MW, Thompson-Lake DGY, Wesley MJ, Lohrenz T, Montague PR, Bickel WK. Cocaine-dependent adults and recreational cocaine users are more likely than controls to choose immediate unsafe sex over delayed safer sex. Exp. Clin. Psychopharmacol. 2016;24:297–304. doi: 10.1037/pha0000080. http://dx.doi.org/10.1037/pha0000080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  104. Kvålseth TO. Cautionary note about R2. Am. Stat. 1985;39:279–285. http://dx.doi.org/10.1080/00031305.1985.10479448. [Google Scholar]
  105. Lagorio CH, Madden GJ. Delay discounting of real and hypothetical rewards III: steady-state assessments, forced-choice trials, and all real rewards. Behav. Process. 2005;69:173–187. doi: 10.1016/j.beproc.2005.02.003. http://dx.doi.org/10.1016/j.beproc.2005.02.003. [DOI] [PubMed] [Google Scholar]
  106. Laibson D. Golden eggs and hyperbolic discounting. Q. J. Econ. 1997;112:443–478. http://dx.doi.org/10.1162/003355397555253. [Google Scholar]
  107. Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, Stuart GL, Strong DR, Brown RA. Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART) J. Exp. Psychol. Appl. 2002;8:75–84. doi: 10.1037//1076-898x.8.2.75. http://dx.doi.org/10.1037/1076-898X.8.2.75. [DOI] [PubMed] [Google Scholar]
  108. Lejuez CW, Aklin WM, Jones HA, Richards JB, Strong DR, Kahler CW, Read JP. The balloon analogue risk task (BART) differentiates smokers and non-smokers. Exp. Clin. Psychopharmacol. 2003;11:26–33. doi: 10.1037//1064-1297.11.1.26. http://dx.doi.org/10.1037/1064-1297.11.1.26. [DOI] [PubMed] [Google Scholar]
  109. Lejuez CW, Aklin W, Bornovalova M, Moolchan ET. Differences in risk-taking propensity across inner-city adolescent ever- and never-smokers. Nicotine Tob. Res. 2005;7:71–79. doi: 10.1080/14622200412331328484. http://dx.doi.org/10.1080/14622200412331328484. [DOI] [PubMed] [Google Scholar]
  110. Lemley SM, Kaplan BA, Reed DD, Darden AC, Jarmolowicz DP. Reinforcer pathologies: predicting alcohol related problems in college drinking men and women. Drug Alcohol Depend. 2016;167:57–66. doi: 10.1016/j.drugalcdep.2016.07.025. http://dx.doi.org/10.1016/j.drugalcdep.2016.07.025. [DOI] [PubMed] [Google Scholar]
  111. Liao W, Luo X, Le CT, Chu H, Epstein LH, Yu J, Ahluwalia JS, Thomas JL. Analysis of cigarette purchase task instrument data with a left-censored mixed effects model. Exp. Clin. Psychopharmacol. 2013;21:124–132. doi: 10.1037/a0031610. http://dx.doi.org/10.1037/a0031610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  112. Lile JA, Stoops WW, Allen TS, Glaser PEA, Hays LR, Rush CR. Baclofen does not alter the reinforcing, subject-rated or cardiovascular effects of intranasal cocaine in humans. Psychopharmacology. 2004;171:441–449. doi: 10.1007/s00213-003-1598-4. http://dx.doi.org/10.1007/s00213-003-1598-4. [DOI] [PubMed] [Google Scholar]
  113. MacKillop J, Kahler CW. Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug Alcohol Depend. 2009;104:197–203. doi: 10.1016/j.drugalcdep.2009.04.020. http://dx.doi.org/10.1016/j.drugalcdep.2009.04.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  114. MacKillop J, Murphy JG, Ray LA, Eisenberg DTA, Lisman SA, Lum JK, Wilson DS. Further validation of a cigarette purchase task for assessing the relative reinforcing efficacy of nicotine in college smokers. Exp. Clin. Psychopharmacol. 2008;16:57–65. doi: 10.1037/1064-1297.16.1.57. http://dx.doi.org/10.1037/1064-1297.16.1.57. [DOI] [PubMed] [Google Scholar]
  115. MacKillop J, Murphy JG, Tidey JW, Kahler CW, Ray LA, Bickel WK. Latent structure of facets of alcohol reinforcement from a behavioral economic demand curve. Psychopharmacology. 2009;203:33–40. doi: 10.1007/s00213-008-1367-5. http://dx.doi.org/10.1007/s00213-008-1367-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  116. MacKillop J, Miranda R, Monti PM, Ray LA, Murphy JG, Rohsenow DJ, McGeary JE, Swift RM, Tidey JW, Gwaltney CJ. Alcohol demand, delayed reward discounting, and craving in relation to drinking and alcohol use disorders. J. Abnorm. Psychol. 2010a;119:106–114. doi: 10.1037/a0017513. http://dx.doi.org/10.1037/a0017513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  117. MacKillop J, O'Hagen S, Lisman SA, Murphy JG, Ray LA, Tidey JW, McGeary JE, Monti PM. Behavioral economic analysis of cue-elicited craving for alcohol. Addiction. 2010b;105:1599–1607. doi: 10.1111/j.1360-0443.2010.03004.x. http://dx.doi.org/10.1111/j.1360-0443.2010.03004.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  118. MacKillop J, Amlung MT, Few LR, Ray LA, Sweet LH, Munafò MR. Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology. 2011;216:305–321. doi: 10.1007/s00213-011-2229-0. http://dx.doi.org/10.1007/s00213-011-2229-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  119. Mackillop J, Brown CL, Stojek MK, Murphy CM, Sweet L, Niaura RS. Behavioral economic analysis of withdrawal- and cue-elicited craving for tobacco: an initial investigation. Nicotine Tob. Res. 2012;14:1426–1434. doi: 10.1093/ntr/nts006. http://dx.doi.org/10.1093/ntr/nts006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  120. Madden GJ, Bickel WK. Impulsivity. American Psychological Association; 2010. [Google Scholar]
  121. Madden GJ, Kalman D. Effects of bupropion on simulated demand for cigarettes and the subjective effects of smoking. Nicotine Tob. Res. 2010;12:416–422. doi: 10.1093/ntr/ntq018. http://dx.doi.org/10.1093/ntr/ntq018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  122. Madden GJ, Petry N, Badger G, Bickel WK. Impulsive and self-control choices opiod-dependent subjects and non-drug using controls: drug and monetary rewards. Exp. Clin. Psychopharmacol. 1997;5:256–262. doi: 10.1037//1064-1297.5.3.256. [DOI] [PubMed] [Google Scholar]
  123. Madden GJ, Bickel WK, Jacobs EA. Discounting of delayed rewards in opioid-dependent outpatients: exponential or hyperbolic discounting functions? Exp. Clin. Psychopharmacol. 1999;7:284–293. doi: 10.1037//1064-1297.7.3.284. http://dx.doi.org/10.1037/1064-1297.7.3.284. [DOI] [PubMed] [Google Scholar]
  124. Madden GJ, Bickel WK, Jacobs EA. Three predictions of the economic concept of unit price in a choice context. J. Exp. Anal. Behav. 2000;73:45–64. doi: 10.1901/jeab.2000.73-45. http://dx.doi.org/10.1901/jeab.2000.73-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  125. Madden GJ, Begotka AM, Raiff BR, Kastern LL. Delay discounting of real and hypothetical rewards. Exp. Clin. Psychopharmacol. 2003;11:139–145. doi: 10.1037/1064-1297.11.2.139. http://dx.doi.org/10.1037/1064-1297.11.2.139. [DOI] [PubMed] [Google Scholar]
  126. Madden GJ, Raiff BR, Lagorio CH, Begotka AM, Mueller AM, Hehli DJ, Wegener AA. Delay discounting of potentially real and hypothetical rewards: II. Between- and within-subject comparisons. Exp. Clin. Psychopharmacol. 2004;12:251–261. doi: 10.1037/1064-1297.12.4.251. http://dx.doi.org/10.1037/1064-1297.12.4.251. [DOI] [PubMed] [Google Scholar]
  127. Mazur JE. An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H, editors. Quantitative Analysis of Behavior: The Effects of Delay and Intervening Events on Reinforcement Value. 1987. pp. 55–73. [Google Scholar]
  128. McKerchar TL, Green L, Myerson J, Pickford TS, Hill JC, Stout SC. A comparison of four models of delay discounting in humans. Behav. Process. 2009;81:256–259. doi: 10.1016/j.beproc.2008.12.017. http://dx.doi.org/10.1016/j.beproc.2008.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  129. McKerchar TL, Green L, Myerson J. On the scaling interpretation of exponents in hyperboloid models of delay and probability discounting. Behav. Process. 2010;84:440–444. doi: 10.1016/j.beproc.2010.01.003. http://dx.doi.org/10.1016/j.beproc.2010.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  130. Middleton LS, Lofwall MR, Nuzzo PA, Siegel AJ, Walsh SL. Intranasal oxycodone self-administration in non-dependent opioid abusers. Exp. Clin. Psychopharmacol. 2012;20:310–317. doi: 10.1037/a0028327. http://dx.doi.org/10.1037/a0028327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  131. Mintzer M, Stitzer M. Cognitive impairment in methadone maintenance patients. Drug Alcohol Depend. 2002;67:41–51. doi: 10.1016/s0376-8716(02)00013-3. [DOI] [PubMed] [Google Scholar]
  132. Mitchell SH. Effects of short-term nicotine deprivation on decision-making: delay, uncertainty and effort discounting. Nicotine Tob. Res. 2004;6:819–828. doi: 10.1080/14622200412331296002. http://dx.doi.org/10.1080/14622200412331296002. [DOI] [PubMed] [Google Scholar]
  133. Mitchell SH, Wilson VB, Karalunas SL. Comparing hyperbolic, delay-amount sensitivity and present-bias models of delay discounting. Behav. Process. 2015;114:52–62. doi: 10.1016/j.beproc.2015.03.006. http://dx.doi.org/10.1016/j.beproc.2015.03.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  134. Monterosso J, Ehrman R, Napier KL, O'Brien CP, Childress AR. Three decision-making tasks in cocaine-dependent patients: do they measure the same construct? Addiction. 2001;96:1825–1837. doi: 10.1046/j.1360-0443.2001.9612182512.x. http://dx.doi.org/10.1046/j.1360-0443.2001.9612182512.x. [DOI] [PubMed] [Google Scholar]
  135. Mueller ET, Landes RD, Kowal BP, Yi R, Stitzer ML, Burnett CA, Bickel WK. Delay of smoking gratification as a laboratory model of relapse: effects of incentives for not smoking, and relationship with measures of executive function. Behav. Pharmacol. 2009;20:461–473. doi: 10.1097/FBP.0b013e3283305ec7. http://dx.doi.org/10.1097/FBP.0b013e3283305ec7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  136. Murphy JG, MacKillop J. Relative reinforcing efficacy of alcohol among college student drinkers. Exp. Clin. Psychopharmacol. 2006;14:219–227. doi: 10.1037/1064-1297.14.2.219. http://dx.doi.org/10.1037/1064-1297.14.2.219. [DOI] [PubMed] [Google Scholar]
  137. Murphy JG, MacKillop J, Tidey JW, Brazil LA, Colby SM. Validity of a demand curve measure of nicotine reinforcement with adolescent smokers. Drug Alcohol Depend. 2011;113:207–214. doi: 10.1016/j.drugalcdep.2010.08.004. http://dx.doi.org/10.1016/j.drugalcdep.2010.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  138. Myerson J, Green L. Discounting of delayed rewards: models of individual choice. J. Exp. Anal. Behav. 1995;64:263–276. doi: 10.1901/jeab.1995.64-263. http://dx.doi.org/10.1901/jeab.1995.64-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  139. Myerson J, Green L, Warusawitharana M. Area under the curve as a measure of discounting. J. Exp. Anal. Behav. 2001;76:235–243. doi: 10.1901/jeab.2001.76-235. http://dx.doi.org/10.1901/jeab.2001.76-235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  140. Myerson J, Green L, Morris J. Modeling the effect of reward amount on probability discounting. J. Exp. Anal. Behav. 2011;95:175–187. doi: 10.1901/jeab.2011.95-175. http://dx.doi.org/10.1901/jeab.2011.95-175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  141. Nejtek VA, Kaiser KA, Zhang B, Djokovic M. Iowa gambling task scores predict future drug use in bipolar disorder outpatients with stimulant dependence. Psychiatry Res. 2013;210:871–879. doi: 10.1016/j.psychres.2013.08.021. http://dx.doi.org/10.1016/j.psychres.2013.08.021. [DOI] [PubMed] [Google Scholar]
  142. Ohmura Y, Takahashi T, Kitamura N. Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology. 2005;182:508–515. doi: 10.1007/s00213-005-0110-8. http://dx.doi.org/10.1007/s00213-005-0110-8. [DOI] [PubMed] [Google Scholar]
  143. Owens MM, Murphy CM, MacKillop J. Initial development of a brief behavioral economic assessment of alcohol demand. Psychol. Conscious. Theory Res. Pract. 2015;2:144–152. doi: 10.1037/cns0000056. http://dx.doi.org/10.1037/cns0000056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  144. Petry NM, Bickel WK, Arnett M. Shortened time horizons and insensitivity to future consequences in heroin addicts. Addiction. 1998;93:729–738. doi: 10.1046/j.1360-0443.1998.9357298.x. http://dx.doi.org/10.1046/j.1360-0443.1998.9357298.x. [DOI] [PubMed] [Google Scholar]
  145. Quisenberry AJ, Koffarnus MN, Hatz LE, Epstein LH, Bickel WK. The experimental tobacco marketplace I: substitutability as a function of the price of conventional cigarettes. Nicotine Tob. Res. 2016;18:1642–1648. doi: 10.1093/ntr/ntv230. http://dx.doi.org/10.1093/ntr/ntv230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  146. Rachlin H. Notes on discounting. J. Exp. Anal. Behav. 2006;85:425–435. doi: 10.1901/jeab.2006.85-05. http://dx.doi.org/10.1901/jeab.2006.85-05. [DOI] [PMC free article] [PubMed] [Google Scholar]
  147. Rachlin H, Raineri A, Cross D. Subjective probability and delay. J. Exp. Anal. Behav. 1991;55:233–244. doi: 10.1901/jeab.1991.55-233. http://dx.doi.org/10.1901/jeab.1991.55-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  148. Raftery AE. Bayesian model selection in social research. Sociol. Methodol. 1995;25:111–163. http://dx.doi.org/10.2307/271063. [Google Scholar]
  149. Reed DD, Kaplan BA, Becirevic A, Roma PG, Hursh SR. Toward quantifying the abuse liability of ultraviolet tanning: a behavioral economic approach to tanning addiction. J. Exp. Anal. Behav. 2016a;106:93–106. doi: 10.1002/jeab.216. http://dx.doi.org/10.1002/jeab.216. [DOI] [PubMed] [Google Scholar]
  150. Reed DD, Kaplan BA, Becirevic A. Basic research on the behavioral economics of reinforcer value. In: DiGennaro Reed FD, Reed DD, editors. Autism Service Delivery. Springer; New York, NY, US: 2016b. pp. 279–306. http://dx.doi.org/10.1007/978-1-4939-2656-5_10. [Google Scholar]
  151. Roma PG, Hursh SR, Hudja S. Hypothetical purchase task questionnaires for behavioral economic assessments of value and motivation. Manag. Decis. Econ. 2016;37:306–323. http://dx.doi.org/10.1002/mde.2718. [Google Scholar]
  152. Samuelson P. A note on measurement of utility. Rev. Econ. Stud. 1937;4:155–161. [Google Scholar]
  153. Schmitz JM, Sayre SL, Hokanson PS, Spiga R. Assessment of the relative reinforcement value of smoking and drinking using a multiple-choice measurement strategy. Nicotine Tob. Res. 2003;5:729–734. doi: 10.1080/1462220031000158618. http://dx.doi.org/10.1080/1462220031000158618. [DOI] [PubMed] [Google Scholar]
  154. Schmitz JM, Mooney ME, Green CE, Lane SD, Steinberg JL, Swann AC, Moeller FG. Baseline neurocognitive profiles differentiate abstainers and non-abstainers in a cocaine clinical trial. J. Addict. Dis. 2009;28:250–257. doi: 10.1080/10550880903028502. http://dx.doi.org/10.1080/10550880903028502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  155. Schuh KJ, Griffiths RR. Caffeine reinforcement: the role of withdrawal. Psychopharmacology. 1997;130:320–326. doi: 10.1007/s002130050246. http://dx.doi.org/10.1007/s002130050246. [DOI] [PubMed] [Google Scholar]
  156. Shahan TA, Bickel WK, Badger GJ, Giordano LA. Sensitivity of nicotine-containing and de-nicotinized cigarette consumption to alternative non-drug reinforcement: a behavioral economic analysis. Behav. Pharmacol. 2001;12:277–284. doi: 10.1097/00008877-200107000-00006. http://dx.doi.org/10.1097/00008877-200107000-00006. [DOI] [PubMed] [Google Scholar]
  157. Sheffer C, MacKillop J, McGeary J, Landes R, Carter L, Yi R, Jones B, Christensen D, Stitzer M, Jackson L, Bickel W. Delay discounting, locus of control, and cognitive impulsiveness independently predict tobacco dependence treatment outcomes in a highly dependent, lower socioeconomic group of smokers. Am. J. Addict. 2012;21:221–232. doi: 10.1111/j.1521-0391.2012.00224.x. http://dx.doi.org/10.1111/j.1521-0391.2012.00224.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  158. Spiess AN, Neumeyer N. An evaluation of R2 as an inadequate measure for nonlinear models in pharmacological and biochemical research: a Monte Carlo approach. BMC Pharmacol. 2010;10:6. doi: 10.1186/1471-2210-10-6. http://dx.doi.org/10.1186/1471-2210-10-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  159. Spiga R, Martinetti MP, Meisch RA, Cowan K, Hursh S. Methadone and nicotine self-administration in humans: a behavioral economic analysis. Psychopharmacology. 2005;178:223–231. doi: 10.1007/s00213-004-2020-6. http://dx.doi.org/10.1007/s00213-004-2020-6. [DOI] [PubMed] [Google Scholar]
  160. Stanger C, Ryan SR, Fu H, Landes RD, Jones BA, Bickel WK, Budney AJ. Delay discounting predicts adolescent substance abuse treatment outcome. Exp. Clin. Psychopharmacol. 2012;20:205–212. doi: 10.1037/a0026543. http://dx.doi.org/10.1037/a0026543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  161. Stein JS, Koffarnus MN, Snider SE, Quisenberry AJ, Bickel WK. Identification and management of nonsystematic purchase task data: toward best practice. Exp. Clin. Psychopharmacol. 2015;23:377–386. doi: 10.1037/pha0000020. http://dx.doi.org/10.1037/pha0000020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  162. Stevens SS. On the psychophysical law. Psychol. Rev. 1957;64:153–181. doi: 10.1037/h0046162. http://dx.doi.org/10.1037/h0046162. [DOI] [PubMed] [Google Scholar]
  163. Stoops WW. Reinforcing, subject-rated, and physiological effects of intranasal methylphenidate in humans: a dose–response analysis. Drug Alcohol Depend. 2003;71:179–186. doi: 10.1016/s0376-8716(03)00131-5. http://dx.doi.org/10.1016/S0376-8716(03)00131-5. [DOI] [PubMed] [Google Scholar]
  164. Stout JC, Busemeyer JR, Lin A, Grant SJ, Bonson KR. L8 cognitive modeling analysis of decision-making processes in cocaine abusers. Psychon. Bull. Rev. 2004;11:742–747. doi: 10.3758/bf03196629. http://dx.doi.org/10.3758/BF03196629. [DOI] [PubMed] [Google Scholar]
  165. Strickland JC, Lile JA, Rush CR, Stoops WW. Comparing exponential and exponentiated models of drug demand in cocaine users. Exp. Clin. Psychopharmacol. 2016;24:447–455. doi: 10.1037/pha0000096. http://dx.doi.org/10.1037/pha0000096. [DOI] [PMC free article] [PubMed] [Google Scholar]
  166. Takahashi T, Oono H, Radford MHB. Psychophysics of time perception and intertemporal choice models. Phys. A Stat. Mech. Appl. 2008;387:2066–2074. http://dx.doi.org/10.1016/j.physa.2007.11.047. [Google Scholar]
  167. Tancer M, Johanson C-E. The effects of fluoxetine on the subjective and physiological effects of 3,4-methylenedioxymethamphetamine (MDMA) in humans. Psychopharmacology. 2006;189:565–573. doi: 10.1007/s00213-006-0576-z. http://dx.doi.org/10.1007/s00213-006-0576-z. [DOI] [PubMed] [Google Scholar]
  168. Tellegen A, Waller N. Exploring personality through test construction: development of the multidimensional personality questionnaire. The SAGE Handbook of Personality Theory and Assessment. 2008;2:261–292. [Google Scholar]
  169. Vansickel AR, Weaver MF, Eissenberg T. Clinical laboratory assessment of the abuse liability of an electronic cigarette. Addiction. 2012;107:1493–1500. doi: 10.1111/j.1360-0443.2012.03791.x. http://dx.doi.org/10.1111/j.1360-0443.2012.03791.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  170. Verdejo-Garcia A, Vilar-Lopez R, Perez-Garcia M, Podell K, Goldberg E. Altered adaptive but not veridical decision-making in substance dependent individuals. J. Int. Neuropsychol. Soc. 2006;12:90–99. doi: 10.1017/S1355617706060127. http://dx.doi.org/10.1017/S1355617706060127. [DOI] [PubMed] [Google Scholar]
  171. Verdejo-Garcia A, Benbrook A, Funderburk F, David P, Cadet JL, Bolla KI. The differential relationship between cocaine use and marijuana use on decision-making performance over repeat testing with the Iowa Gambling Task. Drug Alcohol Depend. 2007;90:2–11. doi: 10.1016/j.drugalcdep.2007.02.004. http://dx.doi.org/10.1016/j.drugalcdep.2007.02.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  172. Washio Y, Higgins ST, Heil SH, McKerchar TL, Badger GJ, Skelly JM, Dantona RL. Delay discounting is associated with treatment response among cocaine-dependent outpatients. Exp. Clin. Psychopharmacol. 2011;19:243–248. doi: 10.1037/a0023617. http://dx.doi.org/10.1037/a0023617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  173. Whitlow CT, Liguori A, Brooke Livengood L, Hart SL, Mussat-Whitlow BJ, Lamborn CM, Laurienti PJ, Porrino LJ. Long-term heavy marijuana users make costly decisions on a gambling task. Drug Alcohol Depend. 2004;76:107–111. doi: 10.1016/j.drugalcdep.2004.04.009. http://dx.doi.org/10.1016/j.drugalcdep.2004.04.009. [DOI] [PubMed] [Google Scholar]
  174. Wileyto EP, Audrain-Mcgovern J, Epstein LH, Lerman C. Using logistic regression to estimate delay-discounting functions. Behav. Res. Methods Instrum. Comput. 2004;36:41–51. doi: 10.3758/bf03195548. http://dx.doi.org/10.3758/BF03195548. [DOI] [PubMed] [Google Scholar]
  175. Wilson AG, Franck CT, Koffarnus MN, Bickel WK. Behavioral economics of cigarette purchase tasks: within-subject comparison of real, potentially real, and hypothetical cigarettes. Nicotine Tob. Res. 2016;18:524–530. doi: 10.1093/ntr/ntv154. http://dx.doi.org/10.1093/ntr/ntv154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  176. de Wit H, Chutuape MA. Increased ethanol choice in social drinkers following ethanol preload. Behav. Pharmacol. 1993:29–36. http://dx.doi.org/10.1097/00008877-199302000-00003. [PubMed]
  177. Yoon J, Higgins S. Turning k on its head: comments on use of an ED50 in delay discounting research. Drug Alcohol Depend. 2008;95:169–172. doi: 10.1016/j.drugalcdep.2007.12.011. http://dx.doi.org/10.1016/j.drugalcdep.2007.12.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  178. Yoon JH, Higgins ST, Heil SH, Sugarbaker RJ, Thomas CS, Badger GJ. Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Exp. Clin. Psychopharmacol. 2007;15:176–186. doi: 10.1037/1064-1297.15.2.186. http://dx.doi.org/10.1037/1064-1297.15.2.186. [DOI] [PubMed] [Google Scholar]
  179. Yoon JH, De La Garza R, Newton TF, Suchting R, Weaver MT, Brown GS, Omar Y, Haliwa I. A comparison of Mazur's k and area under the curve for describing steep discounters. Psychol. Rec. 2017:1–9. doi: 10.1007/s40732-017-0220-9. http://dx.doi.org/10.1007/s40732-017-0220-9. [DOI] [PMC free article] [PubMed]
  180. Yu J, Liu L, Collins RL, Vincent PC, Epstein LH. Analytical problems and suggestions in the analysis of behavioral economic demand curves. Multivar. Behav. Res. 2014;49:178–192. doi: 10.1080/00273171.2013.862491. http://dx.doi.org/10.1080/00273171.2013.862491. [DOI] [PubMed] [Google Scholar]
  181. Zuckerman M, Eysenck S. Sensation seeking in England and America: cross-cultural, age, and sex comparisons. J. Consult. Clin. Psychol. 1978;46:139–149. doi: 10.1037//0022-006x.46.1.139. http://dx.doi.org/10.1037/0022-006X.46.1.139. [DOI] [PubMed] [Google Scholar]

RESOURCES