Abstract
Quantifying individual differences in higher-order cognitive functions is a foundational area of cognitive science that also has profound implications for research on psychopathology. For the past 2 decades, the dominant approach in these fields has been to attempt to fractionate higher-order functions into hypothesized components (e.g., inhibition, updating) through a combination of experimental manipulation and factor analysis. However, the putative constructs obtained through this paradigm have recently been met with substantial criticism on both theoretical and empirical grounds. Concurrently, an alternative approach has emerged focusing on parameters of formal computational models of cognition that have been developed in mathematical psychology. These models posit biologically plausible and experimentally validated explanations of the data-generating process for cognitive tasks, allowing them to be used to measure the latent mechanisms that underlie performance. One of the primary insights provided by recent applications of this approach is that individual and clinical differences in performance on a wide variety of cognitive tasks, ranging from simple choice tasks to complex executive paradigms, are largely driven by efficiency of evidence accumulation, a computational mechanism defined by sequential sampling models. This review assembles evidence for the hypothesis that efficiency of evidence accumulation is a central individual difference dimension that explains neurocognitive deficits in multiple clinical disorders and identifies ways in which this insight can advance clinical neuroscience research. We propose that recognition of efficiency of evidence accumulation as a major driver of neurocognitive differences will allow the field to make clearer inferences about cognitive abnormalities in psychopathology and their links to neurobiology.
Keywords: Cognitive control, Diffusion model, Executive function, Linear ballistic accumulator, Mathematical psychology, Transdiagnostic risk
The study of individual differences in performance on laboratory cognitive tasks and the neural basis of these differences has been a pillar of biological psychiatry research over the past several decades. This work is driven by the consistent observation that impairments in executive functions and cognitive control (hereafter referred to as higher-order cognition) are observed transdiagnostically across multiple mental disorders, including schizophrenia, externalizing disorders (attention-deficit/hyperactivity disorder [ADHD], substance use) (1, 2, 3, 4), depression, and anxiety (5,6). Links between deficits in higher-order cognition and psychopathology have prompted a swell of clinical neuroscience research aimed at better understanding their psychological and neurobiological basis (10, 11, 12, 13, 14, 15, 16, 7, 8, 9). Moreover, this work is heavily emphasized in major funding agency initiatives, such as the Research Domain Criteria project (17) and Computational Psychiatry Program (18).
Our aim in this review is to offer a critical perspective on the current state of the science; we identify a set of interrelated obstacles that have arisen for current approaches and lay out the case for an alternative framework. The Fractionation Paradigm and Recent Challenges section reviews the dominant fractionation paradigm, which aims to use factor analysis to break cognitive functions into constituent elements with selective relations to clinical disorders, and details recent findings that present serious challenges for this approach. The next three sections introduce an alternative paradigm based on computational modeling, specifically focusing on efficiency of evidence accumulation (EEA), a central individual difference dimension measured in sequential sampling models (SSMs) of cognition. We review evidence that EEA is a primary driver of individual and clinical differences in cognitive performance across a broad array of ostensibly quite distinct cognitive tasks and exhibits several advantages over metrics derived from the fractionation paradigm. Finally, we highlight key implications of this framework for clinical neuroscience.
The Fractionation Paradigm and Recent Challenges
The dominant approach toward studying individual differences, and by extension clinical differences, in higher-order cognition involves fractionation. This framework assumes that higher-order cognition consists of multiple component functions and that each constitutes a relatively distinct individual difference dimension. This latter assumption is especially relevant to clinical neuroscience research, where it is common to postulate that disorders involve selective impairments in specific functions.
A primary tool for fractionation involves batteries of carefully constructed experimental tasks that are intended to selectively engage specific functions. For example, in the incongruent condition of the Stroop task (19), participants must respond as to the ink color of a word while ignoring the word’s semantic meaning, which indicates a discrepant color. This discrepancy is thought to engage an inhibition process that suppresses the dominant tendency to provide the (incorrect) word response. In an otherwise-similar congruent condition, in which the color of the word and its meaning are matched, it is assumed that the inhibition process is unengaged. Performance differences between the two conditions are thus assumed to precisely index individuals’ inhibition. Tasks such as the Stroop are often paired with factor analysis to study patterns of covariance across task batteries. Foundational work by Miyake et al. (20) yielded evidence for three core executive dimensions—response inhibition, task switching, and working memory updating—and this framework remains the most influential fractionation taxonomy [e.g., (21,22)].
A growing body of findings, however, presents serious challenges for the fractionation approach. First, in a systematic review, Karr et al. (23) provided evidence that many factor models in this literature were overfit to underpowered samples and that alternative models that contradict the foundational three-factor structure may be more plausible. A second challenge for this paradigm concerns fundamental psychometric properties of widely used tasks that utilize difference scores to selectively index higher-order functions (e.g., the Stroop). Such measures consistently demonstrate poor test-retest reliability (24, 25, 26, 27); that is, the rank order of subjects fails to be preserved across testing occasions, limiting the usefulness of these metrics for individual differences research (28,29). The same measures also have poor predictive validity; recent well-powered studies show that they have tenuous relationships with relevant criterion variables, such as self-regulation questionnaires (30, 31, 32, 33). A third challenge for fractionation is the failure of disorder specificity, the idea that selective executive deficits could help establish boundaries between disorders. Researchers have long sought to selectively link deficits in working memory to schizophrenia (34, 35, 36), behavioral inhibition to ADHD (37, 38, 39), and inhibition of negative thoughts to anxiety and depression (40, 41, 42). However, such selectivity has been elusive. People with psychiatric disorders, including schizophrenia, bipolar disorder, and ADHD, typically exhibit diverse cognitive impairments that cut across the higher-order domains fractionation researchers seek to distinguish (3,15,43, 44, 45, 46, 47, 48, 49).
None of these challenges to the fractionation paradigm are necessarily decisive, but they are serious enough that alternative approaches, the subject to which we now turn, deserve greater attention.
Mathematical Psychology, Computational Psychiatry, and SSMs
Multiple recent commentaries in psychiatry, clinical psychology, and the broader behavioral sciences (50, 51, 52, 53) have highlighted a critical paradox: these fields have largely eschewed the use of formal mathematical process models, despite the substantial advancements in precision, theory development, and cumulative knowledge that such models have provided for other sciences. One notable exception is the subfield of mathematical psychology, which has a long tradition of using formalisms to specify, and stringently test, theories about the mechanisms behind cognitive processing (54, 55, 56). Beyond the general scientific advantages of mathematical modeling, including allowing greater explanatory clarity and stronger empirical tests of theoretical predictions (52,53,55), this approach has recently shown unique promise for identifying links between human cognition and neural functioning (57, 58, 59). Furthermore, mathematical psychology’s models are beginning to play a pivotal role in the emerging field of computational psychiatry, where they are used to identify candidate biobehavioral dimensions linked to psychopathology that may have clearer relationships with neurobiological mechanisms than existing cognitive constructs (50,60,61).
SSMs (62) are a prime example of computational frameworks from mathematical psychology that are now seeing wide application in the neurosciences and psychiatry. Although models in this class were originally developed to explain recognition memory and simple perceptual decisions (62, 63, 64), they have been successfully applied to a variety of complex behavioral domains (65, 66, 67), including executive tasks (68, 69, 70, 71, 72). For tasks in which individuals must choose between response options, SSMs assume that they gradually accumulate noisy evidence for each option from the environment over time until evidence for one option reaches a critical threshold, which initiates the corresponding response.
SSMs come in two general variants (62) (Figure 1). In accumulator-type models, such as the linear ballistic accumulator (LBA) (73), evidence is gathered by separate accumulators for each response option that race toward an upper threshold. In random-walk models, such as the diffusion decision model (DDM) (63,74), relative evidence for each choice is represented as a single total that drifts between boundaries representing each option. The DDM and LBA, which are the most widely used models in each class, differ on several major assumptions. Most prominently, the DDM assumes that the rate of evidence accumulation varies stochastically over time within a trial. Conversely, the LBA assumes that the evidence accumulates in a linear and deterministic manner and that any variability in accumulation rate occurs between trials. Although the within-trial variability of the DDM may be more biologically plausible, the LBA’s simplified assumptions do not appear to limit its descriptive power and make it easier to apply (73).
Despite these differences, parameters from both models can be used to measure three key latent processes: 1) the drift rate, or EEA; 2) the threshold or boundary separation, which reflects an individual’s level of caution (i.e., speed/accuracy trade-off); and 3) nondecision time, which accounts for the time spent on peripheral (e.g., motor) operations. Applications of the DDM and LBA to the same empirical data generally suggest similar conclusions about these three key processes (75,76), although process parameterization differs slightly between the models (Figure 1), and they sometimes offer divergent accounts of other constructs [e.g., variability in memory evidence (77)].
Several considerations are relevant when using these models. First, researchers should seek to ensure that the behavioral tasks analyzed respect SSM assumptions [e.g., number of processing stages, parameter invariance across time, and others detailed in (65)]. That said, recent work on complex paradigms has suggested that inferences from SSMs often remain robust despite violations of certain assumptions (78,79). Second, parameters that measure processes of interest must be able to be accurately estimated from empirical data (80). Small numbers of trials and greater model complexity (i.e., more parameters) impede parameter estimation, which may force investigators to select more parsimonious models. For example, several specialized SSMs have been proposed to explain processing on inhibition (e.g., Stroop) tasks (70,72), but parameters for these complex models are difficult to estimate at trial numbers common in empirical studies (81). Therefore, an alternative approach [e.g., (25,30)] is to fit a standard DDM to these tasks under the assumption that measurement of the main processes of interest will be robust despite some misspecification in the simpler model.
The use of SSMs to describe and differentiate cognitive mechanisms has several benefits. First, SSMs posit detailed mechanistic accounts that explain how underlying cognitive operations produce observed patterns of behavior. Thus, they make specific, quantitative predictions about behavioral data (e.g., skew of response time distributions, slow vs. fast errors) that are generally well supported in a substantial literature (73,74,82). Second, mechanisms posited in these models have clear links to neurophysiological processes. Neural firing patterns recorded in nonhuman primates across multiple brain regions during decision making display properties consistent with evidence accumulation (62,83, 84, 85), and these patterns have recently been quantitatively linked to SSM parameters in joint neural and behavioral models (86,87). Hence, SSMs display clear evidence of biological plausibility, providing an important bridge between neurophysiology and human behavioral research. Third, SSMs allow selective measurement of latent cognitive mechanisms. Standard metrics derived from laboratory tasks, such as response time (RT) and accuracy, are influenced by confounding factors such as subjects’ preferences to prioritize speed versus accuracy. However, SSMs can recover precise estimates of critical parameters irrespective of subjects’ strategies (65). A recent simulation study suggests that SSMs’ ability to measure latent processes selectively (e.g., indexing cognitive efficiency independent of speed/accuracy preferences) boosts statistical power (88). Finally, as detailed below, SSMs are beginning to provide novel insights into the structure of individual differences in cognition across the spectrum of health and psychopathology.
EEA as a Foundational Individual Difference Dimension
A burgeoning individual differences literature [reviewed in detail in (89,90)] has begun to demonstrate SSMs’ utility for characterizing fundamental mechanisms of cognition. This work has primarily focused on the DDM’s drift rate parameter, which indexes EEA, or the rate at which an individual gathers relevant evidence from the environment to make accurate choices in the context of background noise. Simulated DDM data in Figure 2 illustrate the behavioral consequences of variation in EEA; lower drift rates lead to lower accuracy and greater RT variability, primarily by increasing the positive skew of RT distributions (91).
Observed EEA for an individual on a given cognitive task is likely the product of multiple processes (Figure 3). Although task-specific mechanisms (e.g., individuals’ color identification ability on the Stroop) and state factors [e.g., motivation (92, 93, 94, 95)] may play key roles, a growing body of findings suggests that a large portion of the variance in EEA is explained by a domain-general, trait-like factor. EEA estimates from choice tasks across different cognitive domains show strong correlations with one another, allowing the formation of a domain-general latent variable (96, 97, 98, 99, 100, 101), and recent work demonstrates that this general factor remains present even after explicitly accounting for domain-specific variance in EEA (78). EEA estimates are test-retest reliable under ideal measurement conditions [e.g., 200–400 trials (102)], and work using latent state-trait modeling across an 8-month interval found that state-related variance in EEA measures was statistically indistinguishable from zero, while trait-related variance was close to that found for intelligence tests (44% on average) (96). As EEA measured via relatively simple choice tasks correlates strongly with EEA on more complex paradigms and predicts better working memory ability and intelligence (78,97, 98, 99, 100, 101,103, 104, 105), trait EEA may be a critical determinant of individual differences in higher-order cognitive abilities. Taken together, this body of work indicates that EEA is a psychometrically robust cognitive individual difference dimension that appears to be foundational to the performance of a wide variety of tasks. Importantly, the fact that trait EEA is derived from a formal, mechanistic theory of the data-generating process across cognitive measures contrasts with constructs in the fractionation paradigm, which are not linked to a generally applicable mechanistic theory.
Reduced EEA as a Transdiagnostic Neurocognitive Risk Factor for Psychopathology
The behavioral signatures of reduced EEA—variable RTs and less accurate responding—have long been documented in the task performance of individuals with diverse psychiatric diagnoses (95,106, 107, 108, 109, 110). Yet, SSMs have only recently been applied in the context of clinical research. Because RT variability has been of longstanding interest in ADHD (95), SSMs have been most extensively used to study this disorder. As reviewed by others (95,111,112) and supported by subsequent work (104,113, 114, 115, 116, 117), individuals with ADHD consistently display reduced EEA in SSM analyses, and meta-analytic effect size estimates for comparisons with healthy participants are in the moderate to large range: d = 0 .75 (112) and g = 0.63 (95). What is arguably most striking about these effects is the breadth of domains in which EEA reductions are observed, including simple perceptual decision making (105,114,118), sustained attention (112,117,119), inhibition (120, 121, 122, 123), pattern learning (116,124), and interval timing (115). Furthermore, stimulant medication treatments for ADHD have been found to improve EEA in both children with the disorder (92) and healthy adults (125), suggesting that EEA could help mediate treatment effects. In the latter study (125), stimulants enhanced EEA similarly in an incongruent task condition (thought to engage executive control) and a congruent task condition (where control is thought to be unengaged). Taken together with the pattern of cross-task effects observed in ADHD, this finding suggests that both ADHD-related deficits and treatment-related improvements in EEA are domain general, spanning diverse tasks and conditions with varying levels of complexity and executive demands.
Beyond ADHD, reduced EEA has been documented in schizophrenia (126,127), depression (128), and individuals at risk for frequent substance use (129). Extending these findings, our recent work has provided evidence that EEA is a transdiagnostic risk factor for psychopathology (130). In a large sample drawn from the UCLA Consortium for Neuropsychiatric Phenomics (131) we found that a latent EEA factor derived from multiple tasks was substantially reduced in patients with ADHD, schizophrenia, and bipolar disorder relative to healthy participants (d = 0.51, 1.12, and 0.40, respectively) and displayed a negative correlation with the overall severity of individuals’ cross-disorder psychopathology symptoms (r = −.20). As this study made the simplifying assumption, discussed above—that the standard DDM can provide adequate measures of EEA on inhibition tasks—replication of these results using more complex modeling procedures is warranted.
We now present a hypothesis that seeks to build on this growing array of observations. We posit that lower trait EEA conveys broad risk for psychopathology and that EEA can therefore account for a substantial proportion of performance decrements on tests of neurocognitive abilities that are observed across psychiatric disorders. Moreover, we propose that reductions in EEA similarly impair performance across tasks of varying levels of complexity, rather than selectively impacting executive tasks. These claims are rendered plausible by the research reviewed above documenting that 1) trait EEA displays clear validity as a task-general cognitive individual difference dimension; 2) in healthy individuals, EEA explains a large portion of the variance in higher-order cognitive functioning; 3) EEA is impaired across multiple psychopathologies; 4) EEA impairments are present across a wide range of cognitive paradigms; and 5) individuals with psychiatric diagnoses linked to neurocognitive decrements, such as ADHD and schizophrenia, have been found to display such decrements across both complex executive tasks and simple choice RT paradigms.
Although we view this evidence as compelling, we note that direct tests of our hypothesis, which have yet to be completed, would require several features. First, these tests would require that large and demographically diverse samples of individuals with and without psychiatric diagnoses complete batteries of tasks that can be used to accurately estimate SSM parameters. Second, because precise measurement of trait EEA requires latent variables informed by performance in multiple domains (78,90), tasks would need to span cognitive processing modalities (e.g., verbal, numeric) and the executive/nonexecutive continuum. Such data would allow the derivation of latent trait EEA metrics and assessments of EEA’s relations with an array of disorders and psychopathology symptoms.
We also note three important qualifications to our claims. First, the task generality of trait EEA does not imply that the computational processes involved in the execution of tasks from diverse cognitive domains are identical. Rather, the psychometric work reviewed above indicates that trait EEA is a primary factor driving individual differences (and therefore, we suspect, clinical differences) in task performance. Although different tasks require cognitive operations involving distinct types of evidence (Figure 3), the fact that SSMs provide a highly generalizable account of processing across tasks suggests that task-general mechanisms involved in accumulation of multiple types of evidence could plausibly drive individual differences in EEA. Indeed, estimates of task-specific variance in EEA from state-trait models are strikingly low (≤17%) (96). Second, we do not claim that trait EEA is itself determined by a single underlying process. As we outline below, current evidence suggests that EEA is likely influenced by an array of biological and contextual factors. EEA may thus serve as a “watershed node” (132) in a complex matrix of causation. Watersheds are shaped by multitudinous converging water channels, but once formed, they are subsequently relatively unitary drivers of downstream effects. Similarly, we propose that EEA has multifactorial determinants but serves as a relatively unitary driver of cognitive deficits and clinical symptoms. Third, although we posit that EEA is a prominent contributor to psychopathology-related deficits on tests of cognitive abilities, it is almost certainly the case that a much broader array of factors, beyond EEA and beyond other influences on cognitive test performance, contribute to individuals’ psychopathology symptoms. Unlike EEA, other contributors to psychopathology may be difficult to capture on laboratory cognitive tasks and may therefore be better measured with alternative methods (e.g., questionnaires, biomarkers).
The overall framework we propose is outlined and contrasted with the conventional fractionation framework in Figure 4. We now examine its broader implications.
Implications of an EEA-Based Computational Framework for Clinical Neuroscience
A Focus on Complex Executive Tasks May Be Misplaced
The preoccupation of psychiatric cognitive neuroscience with response inhibition and other executive constructs is understandable. There are clearly clinically important individual differences in the ability to resist cravings for an addictive substance or to regulate tendencies to mind wander during a boring lecture. Because tasks such as the Stroop were designed to selectively isolate top-down control, it makes sense that these tasks are seen as key elements of research into regulatory problems in psychopathology. However, the evidence reviewed above suggests that these tasks are not, in fact, selectively isolating executive processes.
The alternative possibility we put forward is that aberrant performance on complex executive tasks in psychopathology largely reflects task-general reductions in EEA. If this view is correct, it follows that the field’s focus on executive functions, and the experimental paradigms thought to measure them, is overly narrow. To better understand the ability to attend to a lecture or resist cravings, it may be more fruitful to investigate the clinical correlates and neural basis of task-general impairments in EEA. At the level of study design, cross-domain batteries of relatively simple cognitive tasks that are optimized for computational modeling (e.g., perceptual choice) may be as good as, or preferable to, complex tasks that attempt to experimentally isolate executive processes.
Subtraction in Cognitive and Neuroimaging Measures Is Counterproductive
EEA’s potential role in task-general deficits similarly calls into doubt the use of subtraction methods that attempt to isolate individual differences in specific neurocognitive processes (e.g., contrasting behavior or neural activation in conditions that do and do not require inhibition). If EEA is the primary driver of individual differences in performance across task conditions, subtraction likely obscures, rather than enhances, measurement of the clinically relevant process.
Recent findings support this notion. In a large nonclinical sample (30), we found that subtraction-based metrics show negligible relations across tasks and do not predict self-report indices of self-control (133). Nonetheless, EEA estimates across these same tasks, and across executive/nonexecutive conditions (again obtained under the simplifying assumption that the standard DDM can adequately index EEA from inhibition paradigms), formed a coherent latent factor that was related to self-regulation (r = .18) (133). Similarly, in a neuroimaging study of the go/no-go task (134), EEA estimated from trials that require inhibition (no-go) was strongly correlated (r = .73) with EEA on trials that do not (go), suggesting that performance across conditions was largely determined by a single dimension (134). At the neural level, activation from the commonly used neuroimaging contrast that subtracts activity during go trials from activity during correct no-go trials displayed little evidence of relationships with performance metrics (including EEA), questioning the utility of subtraction for neural measures (134). Hence, clinical neuroscientists may be better off focusing on commonalties across cognitive task conditions than on differences between them.
Findings of Disorder-Specific Deficits in Neurocognitive Test Data May Be Elusive
A related implication is that efforts to use neurocognitive test data to identify deficits in specific cognitive functions that differentiate disorders (e.g., inhibition in ADHD) may face significant challenges. Indeed, our hypothesis that EEA is a primary driver of individual differences in performance across commonly used tasks provides an explanation for the already well-acknowledged failure of such tasks to characterize selective deficits for many disorders (3,15,43, 44, 45, 46, 47, 48, 49). Although some may view this conclusion as discouraging, we believe that it fits with emerging views of psychopathology that emphasize transdiagnostic individual difference dimensions (e.g., Research Domain Criteria and Hierarchical Taxonomy of Psychopathology) (17,135), in which positions on multiple such dimensions characterize disorders. Specifically, it is likely that EEA, as measured on neurocognitive tasks, is one of many relevant transdiagnostic dimensions and must be combined with indices of constructs derived from other measurement domains (e.g., socioemotional, biological) to better characterize variation in, and the multifactorial causes of, psychopathology.
EEA Can Provide a Window Into the Basis of Neurocognitive Deficits in Psychopathology
A shift in psychiatric cognitive neuroscience research focus toward EEA is likely to produce novel mechanistic insights and facilitate translation across behavioral, systems, and neurophysiological levels of analysis. As outlined above, a major advantage of using SSMs to guide research is that the evidence accumulation processes they posit are not only biologically plausible but well supported by extant neurophysiological research in nonhuman primates (62,83, 84, 85, 86,136). Corresponding neural signatures of these processes in humans have also been well characterized with electroencephalography (137, 138, 139) and functional magnetic resonance imaging (140, 141, 142, 143). Although these signatures are distributed throughout multiple cortical areas, there is converging evidence that the frontoparietal network and anterior insula play especially important roles (144).
Research on the neural basis of trait EEA is sparser. A small number of studies using disparate methodologies have linked between-individual differences in EEA to parietal activation during decision making (145), salience network responses to errors (134), and greater structural and functional connectivity in the frontoparietal network (146). However, these studies are limited by their measurement of EEA with individual tasks, rather than with the recommended cross-domain latent factors (90). Findings that EEA is enhanced by catecholamine agonists (92,125,147) indicate that EEA may be related to the integrity of dopamine or norepinephrine systems. Incentives also alter EEA (92, 93, 94), suggesting that stable traits related to motivational processes [e.g., cognitive effort discounting (148)] could affect how individuals react to these state-related factors during cognitive performance. We do not offer a comprehensive hypothesis about the etiology of individual and clinical differences in EEA because we believe doing so would be premature. However, strong evidence for the existence of a task-general trait EEA factor suggests that broad neurobiological and/or contextual (e.g., poverty) influences could affect cognitive performance though EEA.
The study of individual differences in EEA could usher in a new paradigm for understanding cognitive abnormalities in psychopathology. Rather than attempting to fractionate putative disorder-specific deficits, this paradigm would instead focus on how EEA is determined by neurophysiological processes, neurotransmitter systems, brain networks, and contextual factors such as motivation, stress, and social adversity. Doing so would move the study of these influences on disordered cognition into a more mechanistic computational framework.
Conclusions
This review assessed the emerging literature on the application of mathematical process models to the study of individual and clinical differences in neurocognition. We argue that this literature presents a compelling case that trait EEA, a foundational individual difference dimension formally defined in computational models, is likely a primary driver of observed deficits on tests of neurocognitive abilities across clinical disorders. Adopting an EEA-focused research approach has the potential to transition clinical neuroscience away from measures that have poor psychometric properties and constructs that are biologically amorphous. In contrast, EEA is a precisely defined construct that has strong psychometric properties, displays clear links to psychopathology, and is well positioned to yield richer connections with neurobiology.
Acknowledgments and Disclosures
This work was supported by National Institute on Alcohol Abuse and Alcoholism Grant No. T32 AA007477 (to AW, awarded to Dr. Frederic Blow), National Institute of Mental Health Grant No. R01 MH107741 (to CS) and the Dana Foundation David Mahoney Neuroimaging Program (to CS).
A previous version of this article was published as a preprint on PsyArXiv: psyarxiv.com/q9hge.
The authors report no biomedical financial interests or potential conflicts of interest.
Contributor Information
Alexander Weigard, Email: asweigar@med.umich.edu.
Chandra Sripada, Email: sripada@umich.edu.
References
- 1.Lipszyc J., Schachar R. Inhibitory control and psychopathology: A meta-analysis of studies using the stop signal task. J Int Neuropsychol Soc. 2010;16:1064–1076. doi: 10.1017/S1355617710000895. [DOI] [PubMed] [Google Scholar]
- 2.Smith J.L., Mattick R.P., Jamadar S.D., Iredale J.M. Deficits in behavioural inhibition in substance abuse and addiction: A meta-analysis. Drug Alcohol Depend. 2014;145:1–33. doi: 10.1016/j.drugalcdep.2014.08.009. [DOI] [PubMed] [Google Scholar]
- 3.Willcutt E.G., Doyle A.E., Nigg J.T., Faraone S.V., Pennington B.F. Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biol Psychiatry. 2005;57:1336–1346. doi: 10.1016/j.biopsych.2005.02.006. [DOI] [PubMed] [Google Scholar]
- 4.Barch D.M., Ceaser A. Cognition in schizophrenia: Core psychological and neural mechanisms. Trends Cogn Sci. 2012;16:27–34. doi: 10.1016/j.tics.2011.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Snyder H.R. Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review. Psychol Bull. 2013;139:81–132. doi: 10.1037/a0028727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bantin T., Stevens S., Gerlach A.L., Hermann C. What does the facial dot-probe task tell us about attentional processes in social anxiety? A systematic review. J Behav Ther Exp Psychiatry. 2016;50:40–51. doi: 10.1016/j.jbtep.2015.04.009. [DOI] [PubMed] [Google Scholar]
- 7.Aron A.R. The neural basis of inhibition in cognitive control. Neuroscientist. 2007;13:214–228. doi: 10.1177/1073858407299288. [DOI] [PubMed] [Google Scholar]
- 8.Rosenberg M.D., Finn E.S., Scheinost D., Papademetris X., Shen X., Constable R.T., Chun M.M. A neuromarker of sustained attention from whole-brain functional connectivity. Nat Neurosci. 2016;19:165–171. doi: 10.1038/nn.4179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mill R.D., Ito T., Cole M.W. From connectome to cognition: The search for mechanism in human functional brain networks. Neuroimage. 2017;160:124–139. doi: 10.1016/j.neuroimage.2017.01.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.McTeague L.M., Huemer J., Carreon D.M., Jiang Y., Eickhoff S.B., Etkin A. Identification of common neural circuit disruptions in cognitive control across psychiatric disorders. Am J Psychiatry. 2017;174:676–685. doi: 10.1176/appi.ajp.2017.16040400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Chambers C.D., Garavan H., Bellgrove M.A. Insights into the neural basis of response inhibition from cognitive and clinical neuroscience. Neurosci Biobehav Rev. 2009;33:631–646. doi: 10.1016/j.neubiorev.2008.08.016. [DOI] [PubMed] [Google Scholar]
- 12.Green M.F., Kern R.S., Braff D.L., Mintz J. Neurocognitive deficits and functional outcome in schizophrenia: Are we measuring the “right stuff”? Schizophr Bull. 2000;26:119–136. doi: 10.1093/oxfordjournals.schbul.a033430. [DOI] [PubMed] [Google Scholar]
- 13.Green M.F., Nuechterlein K.H., Gold J.M., Barch D.M., Cohen J., Essock S., et al. Approaching a consensus cognitive battery for clinical trials in schizophrenia: The NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry. 2004;56:301–307. doi: 10.1016/j.biopsych.2004.06.023. [DOI] [PubMed] [Google Scholar]
- 14.Abi-Dargham A., Mawlawi O., Lombardo I., Gil R., Martinez D., Huang Y., et al. Prefrontal dopamine D1 receptors and working memory in schizophrenia. J Neurosci. 2002;22:3708–3719. doi: 10.1523/JNEUROSCI.22-09-03708.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Castellanos F.X., Sonuga-Barke E.J., Milham M.P., Tannock R. Characterizing cognition in ADHD: beyond executive dysfunction. Trends Cogn Sci. 2006;10:117–123. doi: 10.1016/j.tics.2006.01.011. [DOI] [PubMed] [Google Scholar]
- 16.Casey B.J., Jones R.M. Neurobiology of the adolescent brain and behavior: Implications for substance use disorders. J Am Acad Child Adolesc Psychiatry. 2010;49:1189–1201. doi: 10.1016/j.jaac.2010.08.017. quiz 1285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Cuthbert B.N., Insel T.R. Toward the future of psychiatric diagnosis: The seven pillars of RDoC. BMC Med. 2013;11:126. doi: 10.1186/1741-7015-11-126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ferrante M., Redish A.D., Oquendo M.A., Averbeck B.B., Kinnane M.E., Gordon J.A. Computational psychiatry: A report from the 2017 NIMH workshop on opportunities and challenges. Mol Psychiatry. 2019;24:479–483. doi: 10.1038/s41380-018-0063-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Stroop J.R. Studies of interference in serial verbal reactions. J Exp Psychol. 1935;18:643–662. [Google Scholar]
- 20.Miyake A., Friedman N.P., Emerson M.J., Witzki A.H., Howerter A., Wager T.D. The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cogn Psychol. 2000;41:49–100. doi: 10.1006/cogp.1999.0734. [DOI] [PubMed] [Google Scholar]
- 21.Hull R., Martin R.C., Beier M.E., Lane D., Hamilton A.C. Executive function in older adults: A structural equation modeling approach. Neuropsychology. 2008;22:508–522. doi: 10.1037/0894-4105.22.4.508. [DOI] [PubMed] [Google Scholar]
- 22.Lee K., Bull R., Ho R.M. Developmental changes in executive functioning. Child Dev. 2013;84:1933–1953. doi: 10.1111/cdev.12096. [DOI] [PubMed] [Google Scholar]
- 23.Karr J.E., Areshenkoff C.N., Rast P., Hofer S.M., Iverson G.L., Garcia-Barrera M.A. The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychol Bull. 2018;144:1147–1185. doi: 10.1037/bul0000160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hedge C., Powell G., Sumner P. The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behav Res Methods. 2018;50:1166–1186. doi: 10.3758/s13428-017-0935-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Enkavi A.Z., Eisenberg I.W., Bissett P.G., Mazza G.L., MacKinnon D.P., Marsch L.A., Poldrack R.A. Large-scale analysis of test-retest reliabilities of self-regulation measures. Proc Natl Acad Sci U S A. 2019;116:5472–5477. doi: 10.1073/pnas.1818430116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Rouder J.N., Haaf J.M. A psychometrics of individual differences in experimental tasks. Psychon Bull Rev. 2019;26:452–467. doi: 10.3758/s13423-018-1558-y. [DOI] [PubMed] [Google Scholar]
- 27.Dang J., King K.M., Inzlicht M. Why are self-report and behavioral measures weakly correlated? Trends Cogn Sci. 2020;24:267–269. doi: 10.1016/j.tics.2020.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Nunnally J.C., Jr. McGraw-Hill; New York: 1970. Introduction to Psychological Measurement. [Google Scholar]
- 29.Draheim C., Mashburn C.A., Martin J.D., Engle R.W. Reaction time in differential and developmental research: A review and commentary on the problems and alternatives. Psychol Bull. 2019;145:508–535. doi: 10.1037/bul0000192. [DOI] [PubMed] [Google Scholar]
- 30.Eisenberg I.W., Bissett P.G., Zeynep Enkavi A., Li J., MacKinnon D.P., Marsch L.A., Poldrack R.A. Uncovering the structure of self-regulation through data-driven ontology discovery. Nat Commun. 2019;10:2319. doi: 10.1038/s41467-019-10301-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Toplak M.E., West R.F., Stanovich K.E. Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? J Child Psychol Psychiatry. 2013;54:131–143. doi: 10.1111/jcpp.12001. [DOI] [PubMed] [Google Scholar]
- 32.Stahl C., Voss A., Schmitz F., Nuszbaum M., Tüscher O., Lieb K., Klauer K.C. Behavioral components of impulsivity. J Exp Psychol Gen. 2014;143:850–886. doi: 10.1037/a0033981. [DOI] [PubMed] [Google Scholar]
- 33.Saunders B., Milyavskaya M., Etz A., Randles D., Inzlicht M. Reported self-control is not meaningfully associated with inhibition-related executive function: A Bayesian analysis. Collabra Psychol. 2018;4:39. [Google Scholar]
- 34.Forbes N.F., Carrick L.A., McIntosh A.M., Lawrie S.M. Working memory in schizophrenia: A meta-analysis. Psychol Med. 2009;39:889–905. doi: 10.1017/S0033291708004558. [DOI] [PubMed] [Google Scholar]
- 35.Glahn D.C., Therman S., Manninen M., Huttunen M., Kaprio J., Lönnqvist J., Cannon T.D. Spatial working memory as an endophenotype for schizophrenia. Biol Psychiatry. 2003;53:624–626. doi: 10.1016/s0006-3223(02)01641-4. [DOI] [PubMed] [Google Scholar]
- 36.Park S., Gooding D.C. Working memory impairment as an endophenotypic marker of a schizophrenia diathesis. Schizophr Res Cogn. 2014;1:127–136. doi: 10.1016/j.scog.2014.09.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Slaats-Willemse D., Swaab-Barneveld H., De Sonneville L., Van Der Meulen E., Buitelaar J. Deficient response inhibition as a cognitive endophenotype of ADHD. J Am Acad Child Adolesc Psychiatry. 2003;42:1242–1248. doi: 10.1097/00004583-200310000-00016. [DOI] [PubMed] [Google Scholar]
- 38.Wodka E.L., Mahone E.M., Blankner J.G., Larson J.C., Fotedar S., Denckla M.B., Mostofsky S.H. Evidence that response inhibition is a primary deficit in ADHD. J Clin Exp Neuropsychol. 2007;29:345–356. doi: 10.1080/13803390600678046. [DOI] [PubMed] [Google Scholar]
- 39.Crosbie J., Arnold P., Paterson A., Swanson J., Dupuis A., Li X., et al. Response inhibition and ADHD traits: Correlates and heritability in a community sample. J Abnorm Child Psychol. 2013;41:497–507. doi: 10.1007/s10802-012-9693-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Becker E.S., Rinck M., Roth W.T., Margraf J. Don’t worry and beware of white bears: Thought suppression in anxiety patients. J Anxiety Disord. 1998;12:39–55. doi: 10.1016/s0887-6185(97)00048-0. [DOI] [PubMed] [Google Scholar]
- 41.Wenzlaff R.M., Luxton D.D. The role of thought suppression in depressive rumination. Cognit Ther Res. 2003;27:293–308. [Google Scholar]
- 42.Beevers C., Meyer B. Brief report: Thought suppression and depression risk. Cogn Emot. 2004;18:859–867. [Google Scholar]
- 43.Heinrichs R.W., Zakzanis K.K. Neurocognitive deficit in schizophrenia: A quantitative review of the evidence. Neuropsychology. 1998;12:426–445. doi: 10.1037//0894-4105.12.3.426. [DOI] [PubMed] [Google Scholar]
- 44.Mesholam-Gately R.I., Giuliano A.J., Goff K.P., Faraone S.V., Seidman L.J. Neurocognition in first-episode schizophrenia: A meta-analytic review. Neuropsychology. 2009;23:315–336. doi: 10.1037/a0014708. [DOI] [PubMed] [Google Scholar]
- 45.Bora E., Pantelis C. Meta-analysis of cognitive impairment in first-episode bipolar disorder: Comparison with first-episode schizophrenia and healthy controls. Schizophr Bull. 2015;41:1095–1104. doi: 10.1093/schbul/sbu198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Snyder H.R., Friedman N.P., Hankin B.L. Transdiagnostic mechanisms of psychopathology in youth: Executive functions, dependent stress, and rumination. Cognit Ther Res. 2019;43:834–851. doi: 10.1007/s10608-019-10016-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Snyder H.R., Kaiser R.H., Warren S.L., Heller W. Obsessive-compulsive disorder is associated with broad impairments in executive function: A meta-analysis. Clin Psychol Sci. 2015;3:301–330. doi: 10.1177/2167702614534210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Bloemen A.J.P., Oldehinkel A.J., Laceulle O.M., Ormel J., Rommelse N.N.J., Hartman C.A. The association between executive functioning and psychopathology: General or specific? Psychol Med. 2018;48:1787–1794. doi: 10.1017/S0033291717003269. [DOI] [PubMed] [Google Scholar]
- 49.Nigg J.T. Neuropsychologic theory and findings in attention-deficit/hyperactivity disorder: The state of the field and salient challenges for the coming decade. Biol Psychiatry. 2005;57:1424–1435. doi: 10.1016/j.biopsych.2004.11.011. [DOI] [PubMed] [Google Scholar]
- 50.Wiecki T.V., Poland J., Frank M.J. Model-based cognitive neuroscience approaches to computational psychiatry: Clustering and classification. Clin Psychol Sci. 2015;3:378–399. [Google Scholar]
- 51.Sharp P.B., Eldar E. Computational models of anxiety: Nascent efforts and future directions. Curr Dir Psychol Sci. 2019;28:170–176. [Google Scholar]
- 52.Haslbeck J., Ryan O., Robinaugh D., Waldorp L., Borsboom D. Modeling psychopathology: From data models to formal theories. PsyArXiv. 2019 doi: 10.31234/osf.io/jgm7f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Guest O., Martin A.E. How computational modeling can force theory building in psychological science [published online ahead of print Jan 22] Perspect Psychol Sci. 2021 doi: 10.1177/1745691620970585. [DOI] [PubMed] [Google Scholar]
- 54.Estes W.K. Some targets for mathematical psychology. J Math Psychol. 1975;12:263–282. [Google Scholar]
- 55.Townsend J.T. Mathematical psychology: Prospects for the 21 century: A guest editorial. J Math Psychol. 2008;52:269–280. doi: 10.1016/j.jmp.2008.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Van Zandt T., Townsend J.T. In: APA Handbook of Research Methods in Psychology, Vol. 2. Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological. Cooper H., Camic P.M., Long D.L., Panter A.T., Rindskopf D., Sher K.J., editors. American Psychological Association; Washington, DC: 2012. Mathematical psychology; pp. 369–386. [Google Scholar]
- 57.Forstmann B.U., Dutilh G., Brown S., Neumann J., Von Cramon D.Y., Ridderinkhof K.R., Wagenmakers E.J. Striatum and pre-SMA facilitate decision-making under time pressure. Proc Natl Acad Sci U S A. 2008;105:17538–17542. doi: 10.1073/pnas.0805903105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Turner B.M., Forstmann B.U., Love B.C., Palmeri T.J., Van Maanen L. Approaches to analysis in model-based cognitive neuroscience. J Math Psychol. 2017;76:65–79. doi: 10.1016/j.jmp.2016.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Hawkins G.E., Mittner M., Boekel W., Heathcote A., Forstmann B.U. Toward a model-based cognitive neuroscience of mind wandering. Neuroscience. 2015;310:290–305. doi: 10.1016/j.neuroscience.2015.09.053. [DOI] [PubMed] [Google Scholar]
- 60.Maia T.V., Huys Q.J.M., Frank M.J. Theory-based computational psychiatry. Biol Psychiatry. 2017;82:382–384. doi: 10.1016/j.biopsych.2017.07.016. [DOI] [PubMed] [Google Scholar]
- 61.Huys Q.J.M., Maia T.V., Frank M.J. Computational psychiatry as a bridge from neuroscience to clinical applications. Nat Neurosci. 2016;19:404–413. doi: 10.1038/nn.4238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Smith P.L., Ratcliff R. Psychology and neurobiology of simple decisions. Trends Neurosci. 2004;27:161–168. doi: 10.1016/j.tins.2004.01.006. [DOI] [PubMed] [Google Scholar]
- 63.Ratcliff R. A theory of memory retrieval. Psychol Rev. 1978;85:59–108. [Google Scholar]
- 64.Usher M., McClelland J.L. The time course of perceptual choice: The leaky, competing accumulator model. Psychol Rev. 2001;108:550–592. doi: 10.1037/0033-295x.108.3.550. [DOI] [PubMed] [Google Scholar]
- 65.Voss A., Nagler M., Lerche V. Diffusion models in experimental psychology: A practical introduction. Exp Psychol. 2013;60:385–402. doi: 10.1027/1618-3169/a000218. [DOI] [PubMed] [Google Scholar]
- 66.Krajbich I., Lu D., Camerer C., Rangel A. The attentional drift-diffusion model extends to simple purchasing decisions. Front Psychol. 2012;3:193. doi: 10.3389/fpsyg.2012.00193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Johnson E.J., Ratcliff R. Neuroeconomics. Elsevier; Amsterdam, the Netherlands: 2014. Computational and process models of decision making in psychology and behavioral economics; pp. 35–47. [Google Scholar]
- 68.Ratcliff R., Huang-Pollock C., McKoon G. Modeling individual differences in the Go/No-go task with a diffusion model. Decision (Wash D C) 2018;5:42–62. doi: 10.1037/dec0000065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Evans N.J., Steyvers M., Brown S.D. Modeling the covariance structure of complex datasets using cognitive models: An application to individual differences and the heritability of cognitive ability. Cogn Sci. 2018;42:1925–1944. doi: 10.1111/cogs.12627. [DOI] [PubMed] [Google Scholar]
- 70.White C.N., Ratcliff R., Starns J.J. Diffusion models of the flanker task: Discrete versus gradual attentional selection. Cogn Psychol. 2011;63:210–238. doi: 10.1016/j.cogpsych.2011.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Servant M., Montagnini A., Burle B. Conflict tasks and the diffusion framework: Insight in model constraints based on psychological laws. Cogn Psychol. 2014;72:162–195. doi: 10.1016/j.cogpsych.2014.03.002. [DOI] [PubMed] [Google Scholar]
- 72.Ulrich R., Schröter H., Leuthold H., Birngruber T. Automatic and controlled stimulus processing in conflict tasks: Superimposed diffusion processes and delta functions. Cogn Psychol. 2015;78:148–174. doi: 10.1016/j.cogpsych.2015.02.005. [DOI] [PubMed] [Google Scholar]
- 73.Brown S.D., Heathcote A. The simplest complete model of choice response time: Linear ballistic accumulation. Cogn Psychol. 2008;57:153–178. doi: 10.1016/j.cogpsych.2007.12.002. [DOI] [PubMed] [Google Scholar]
- 74.Ratcliff R., Smith P.L., Brown S.D., McKoon G. Diffusion decision model: Current issues and history. Trends Cogn Sci. 2016;20:260–281. doi: 10.1016/j.tics.2016.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Donkin C., Brown S., Heathcote A., Wagenmakers E.J. Diffusion versus linear ballistic accumulation: Different models but the same conclusions about psychological processes? Psychon Bull Rev. 2011;18:61–69. doi: 10.3758/s13423-010-0022-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Dutilh G., Annis J., Brown S.D., Cassey P., Evans N.J., Grasman R.P.P.P., et al. The quality of response time data inference: A blinded, collaborative assessment of the validity of cognitive models. Psychon Bull Rev. 2019;26:1051–1069. doi: 10.3758/s13423-017-1417-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Osth A.F., Bora B., Dennis S., Heathcote A. Diffusion vs. linear ballistic accumulation: Different models, different conclusions about the slope of the zROC in recognition memory. J Mem Lang. 2017;96:36–61. [Google Scholar]
- 78.Lerche V., von Krause M., Voss A., Frischkorn G.T., Schubert A.L., Hagemann D. Diffusion modeling and intelligence: Drift rates show both domain-general and domain-specific relations with intelligence. J Exp Psychol Gen. 2020;149:2207–2249. doi: 10.1037/xge0000774. [DOI] [PubMed] [Google Scholar]
- 79.Lerche V., Voss A. Experimental validation of the diffusion model based on a slow response time paradigm. Psychol Res. 2019;83:1194–1209. doi: 10.1007/s00426-017-0945-8. [DOI] [PubMed] [Google Scholar]
- 80.Matzke D., Logan G.D., Heathcote A. A cautionary note on evidence-accumulation models of response inhibition in the stop-signal paradigm. Comp Brain Behav. 2020;3:269–288. [Google Scholar]
- 81.White C.N., Servant M., Logan G.D. Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery study. Psychon Bull Rev. 2018;25:286–301. doi: 10.3758/s13423-017-1271-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Evans N.J., Wagenmakers E.J. Evidence accumulation models: Current limitations and future directions. Quant Meth. 2020;16:73–90. [Google Scholar]
- 83.Gold J.I., Shadlen M.N. The neural basis of decision making. Annu Rev Neurosci. 2007;30:535–574. doi: 10.1146/annurev.neuro.29.051605.113038. [DOI] [PubMed] [Google Scholar]
- 84.Hanes D.P., Schall J.D. Neural control of voluntary movement initiation. Science. 1996;274:427–430. doi: 10.1126/science.274.5286.427. [DOI] [PubMed] [Google Scholar]
- 85.Kiani R., Hanks T.D., Shadlen M.N. Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J Neurosci. 2008;28:3017–3029. doi: 10.1523/JNEUROSCI.4761-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Cassey P.J., Gaut G., Steyvers M., Brown S.D. A generative joint model for spike trains and saccades during perceptual decision-making. Psychon Bull Rev. 2016;23:1757–1778. doi: 10.3758/s13423-016-1056-z. [DOI] [PubMed] [Google Scholar]
- 87.Aoi M.C., Mante V., Pillow J.W. Prefrontal cortex exhibits multidimensional dynamic encoding during decision-making. Nat Neurosci. 2020;23:1410–1420. doi: 10.1038/s41593-020-0696-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Stafford T., Pirrone A., Croucher M., Krystalli A. Quantifying the benefits of using decision models with response time and accuracy data. Behav Res Methods. 2020;52:2142–2155. doi: 10.3758/s13428-020-01372-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Schubert A.L., Frischkorn G.T. Neurocognitive psychometrics of intelligence: How measurement advancements unveiled the role of mental speed in intelligence differences. Curr Dir Psychol Sci. 2020;29:140–146. [Google Scholar]
- 90.Frischkorn G.T., Schubert A.L. Cognitive models in intelligence research: Advantages and recommendations for their application. J Intell. 2018;6:34. doi: 10.3390/jintelligence6030034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Matzke D., Wagenmakers E.J. Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis. Psychon Bull Rev. 2009;16:798–817. doi: 10.3758/PBR.16.5.798. [DOI] [PubMed] [Google Scholar]
- 92.Fosco W.D., White C.N., Hawk L.W., Jr. Acute stimulant treatment and reinforcement increase the speed of information accumulation in children with ADHD. J Abnorm Child Psychol. 2017;45:911–920. doi: 10.1007/s10802-016-0222-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Spaniol J., Voss A., Bowen H.J., Grady C.L. Motivational incentives modulate age differences in visual perception. Psychol Aging. 2011;26:932–939. doi: 10.1037/a0023297. [DOI] [PubMed] [Google Scholar]
- 94.Dix A., Li S.C. Incentive motivation improves numerosity discrimination: Insights from pupillometry combined with drift-diffusion modelling. Sci Rep. 2020;10:2608. doi: 10.1038/s41598-020-59415-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Karalunas S.L., Geurts H.M., Konrad K., Bender S., Nigg J.T. Annual research review: Reaction time variability in ADHD and autism spectrum disorders: Measurement and mechanisms of a proposed trans-diagnostic phenotype. J Child Psychol Psychiatry. 2014;55:685–710. doi: 10.1111/jcpp.12217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Schubert A.L., Frischkorn G., Hagemann D., Voss A. Trait characteristics of diffusion model parameters. J Intell. 2016;4:7. [Google Scholar]
- 97.Schmiedek F., Oberauer K., Wilhelm O., Süß H.M., Wittmann W.W. Individual differences in components of reaction time distributions and their relations to working memory and intelligence. J Exp Psychol Gen. 2007;136:414–429. doi: 10.1037/0096-3445.136.3.414. [DOI] [PubMed] [Google Scholar]
- 98.Schmitz F., Wilhelm O. Modeling mental speed: Decomposing response time distributions in elementary cognitive tasks and correlations with working memory capacity and fluid intelligence. J Intell. 2016;4:13. [Google Scholar]
- 99.Schulz-Zhecheva Y., Voelkle M.C., Beauducel A., Biscaldi M., Klein C. Predicting fluid intelligence by components of reaction time distributions from simple choice reaction time tasks. J Intell. 2016;4:8. [Google Scholar]
- 100.Ratcliff R., Thapar A., McKoon G. Individual differences, aging, and IQ in two-choice tasks. Cogn Psychol. 2010;60:127–157. doi: 10.1016/j.cogpsych.2009.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Schubert A.L., Nunez M.D., Hagemann D., Vandekerckhove J. Individual differences in cortical processing speed predict cognitive abilities: A model-based cognitive neuroscience account. Comp Brain Behav. 2019;2:64–84. [Google Scholar]
- 102.Lerche V., Voss A. Retest reliability of the parameters of the Ratcliff diffusion model. Psychol Res. 2017;81:629–652. doi: 10.1007/s00426-016-0770-5. [DOI] [PubMed] [Google Scholar]
- 103.Ratcliff R., Thapar A., McKoon G. Effects of aging and IQ on item and associative memory. J Exp Psychol Gen. 2011;140:464–487. doi: 10.1037/a0023810. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Weigard A., Huang-Pollock C. The role of speed in ADHD-related working memory deficits: A time-based resource-sharing and diffusion model account. Clin Psychol Sci. 2017;5:195–211. doi: 10.1177/2167702616668320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Karalunas S.L., Huang-Pollock C.L. Integrating impairments in reaction time and executive function using a diffusion model framework. J Abnorm Child Psychol. 2013;41:837–850. doi: 10.1007/s10802-013-9715-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Epstein J.N., Langberg J.M., Rosen P.J., Graham A., Narad M.E., Antonini T.N., et al. Evidence for higher reaction time variability for children with ADHD on a range of cognitive tasks including reward and event rate manipulations. Neuropsychology. 2011;25:427–441. doi: 10.1037/a0022155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Kofler M.J., Rapport M.D., Sarver D.E., Raiker J.S., Orban S.A., Friedman L.M., Kolomeyer E.G. Reaction time variability in ADHD: A meta-analytic review of 319 studies. Clin Psychol Rev. 2013;33:795–811. doi: 10.1016/j.cpr.2013.06.001. [DOI] [PubMed] [Google Scholar]
- 108.Kaiser S., Roth A., Rentrop M., Friederich H.C., Bender S., Weisbrod M. Intra-individual reaction time variability in schizophrenia, depression and borderline personality disorder. Brain Cogn. 2008;66:73–82. doi: 10.1016/j.bandc.2007.05.007. [DOI] [PubMed] [Google Scholar]
- 109.Schwartz F., Carr A.C., Munich R.L., Glauber S., Lesser B., Murray J. Reaction time impairment in schizophrenia and affective illness: The role of attention. Biol Psychiatry. 1989;25:540–548. doi: 10.1016/0006-3223(89)90214-x. [DOI] [PubMed] [Google Scholar]
- 110.Brotman M.A., Rooney M.H., Skup M., Pine D.S., Leibenluft E. Increased intrasubject variability in response time in youths with bipolar disorder and at-risk family members. J Am Acad Child Adolesc Psychiatry. 2009;48:628–635. doi: 10.1097/CHI.0b013e3181a27527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Ziegler S., Pedersen M.L., Mowinckel A.M., Biele G. Modelling ADHD: A review of ADHD theories through their predictions for computational models of decision-making and reinforcement learning. Neurosci Biobehav Rev. 2016;71:633–656. doi: 10.1016/j.neubiorev.2016.09.002. [DOI] [PubMed] [Google Scholar]
- 112.Huang-Pollock C.L., Karalunas S.L., Tam H., Moore A.N. Evaluating vigilance deficits in ADHD: A meta-analysis of CPT performance. J Abnorm Psychol. 2012;121:360–371. doi: 10.1037/a0027205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Kofler M.J., Irwin L.N., Sarver D.E., Fosco W.D., Miller C.E., Spiegel J.A., Becker S.P. What cognitive processes are “sluggish” in sluggish cognitive tempo? J Consult Clin Psychol. 2019;87:1030–1042. doi: 10.1037/ccp0000446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Weigard A., Huang-Pollock C., Brown S., Heathcote A. Testing formal predictions of neuroscientific theories of ADHD with a cognitive model–based approach. J Abnorm Psychol. 2018;127:529–539. doi: 10.1037/abn0000357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Shapiro Z., Huang-Pollock C. A diffusion-model analysis of timing deficits among children with ADHD. Neuropsychology. 2019;33:883–892. doi: 10.1037/neu0000562. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Weigard A., Huang-Pollock C., Brown S. Evaluating the consequences of impaired monitoring of learned behavior in attention-deficit/hyperactivity disorder using a Bayesian hierarchical model of choice response time. Neuropsychology. 2016;30:502–515. doi: 10.1037/neu0000257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Huang-Pollock C., Ratcliff R., McKoon G., Roule A., Warner T., Feldman J., Wise S. A diffusion model analysis of sustained attention in children with attention deficit hyperactivity disorder. Neuropsychology. 2020;34:641–653. doi: 10.1037/neu0000636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Karalunas S.L., Huang-Pollock C.L., Nigg J.T. Decomposing attention-deficit/hyperactivity disorder (ADHD)-related effects in response speed and variability. Neuropsychology. 2012;26:684–694. doi: 10.1037/a0029936. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 119.Killeen P.R., Russell V.A., Sergeant J.A. A behavioral neuroenergetics theory of ADHD. Neurosci Biobehav Rev. 2013;37:625–657. doi: 10.1016/j.neubiorev.2013.02.011. [DOI] [PubMed] [Google Scholar]
- 120.Salum G.A., Sergeant J., Sonuga-Barke E., Vandekerckhove J., Gadelha A., Pan P.M., et al. Specificity of basic information processing and inhibitory control in attention deficit hyperactivity disorder. Psychol Med. 2014;44:617–631. doi: 10.1017/S0033291713000639. [DOI] [PubMed] [Google Scholar]
- 121.Metin B., Roeyers H., Wiersema J.R., van der Meere J.J., Thompson M., Sonuga-Barke E. ADHD performance reflects inefficient but not impulsive information processing: A diffusion model analysis. Neuropsychology. 2013;27:193–200. doi: 10.1037/a0031533. [DOI] [PubMed] [Google Scholar]
- 122.Huang-Pollock C., Ratcliff R., McKoon G., Shapiro Z., Weigard A., Galloway-Long H. Using the diffusion model to explain cognitive deficits in attention deficit hyperactivity disorder. J Abnorm Child Psychol. 2017;45:57–68. doi: 10.1007/s10802-016-0151-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 123.Karalunas S.L., Weigard A., Alperin B. Emotion–cognition interactions in Attention-Deficit/Hyperactivity Disorder: Increased early attention capture and weakened attentional control in emotional contexts. Biol Psychiatry Cogn Neurosci Neuroimaging. 2020;5:520–529. doi: 10.1016/j.bpsc.2019.12.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 124.Weigard A., Huang-Pollock C. A diffusion modeling approach to understanding contextual cueing effects in children with ADHD. J Child Psychol Psychiatry. 2014;55:1336–1344. doi: 10.1111/jcpp.12250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 125.Weigard A., Heathcote A., Sripada C. Modeling the effects of methylphenidate on interference and evidence accumulation processes using the conflict linear ballistic accumulator. Psychopharmacology. 2019;236:2501–2512. doi: 10.1007/s00213-019-05316-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.Heathcote A., Suraev A., Curley S., Gong Q., Love J., Michie P.T. Decision processes and the slowing of simple choices in schizophrenia. J Abnorm Psychol. 2015;124:961–974. doi: 10.1037/abn0000117. [DOI] [PubMed] [Google Scholar]
- 127.Fish S., Toumaian M., Pappa E., Davies T.J., Tanti R., Saville C.W.N., et al. Modelling reaction time distribution of fast decision tasks in schizophrenia: Evidence for novel candidate endophenotypes. Psychiatry Res. 2018;269:212–220. doi: 10.1016/j.psychres.2018.08.067. [DOI] [PubMed] [Google Scholar]
- 128.Lawlor V.M., Webb C.A., Wiecki T.V., Frank M.J., Trivedi M., Pizzagalli D.A., Dillon D.G. Dissecting the impact of depression on decision-making. Psychol Med. 2020;50:1613–1622. doi: 10.1017/S0033291719001570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Weigard A.S., Brislin S.J., Cope L.M., Hardee J.E., Martz M.E., Ly A., et al. Evidence accumulation and associated error-related brain activity as computationally informed prospective predictors of substance use in emerging adulthood. bioRxiv. 2020 doi: 10.1101/2020.03.06.981035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 130.Sripada C., Weigard A.S. Impaired evidence accumulation as a transdiagnostic vulnerability factor in psychopathology. Front Psychiatry. 2021;12:627179. doi: 10.3389/fpsyt.2021.627179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 131.Poldrack R.A., Congdon E., Triplett W., Gorgolewski K.J., Karlsgodt K.H., Mumford J.A., et al. A phenome-wide examination of neural and cognitive function. Sci Data. 2016;3:160110. doi: 10.1038/sdata.2016.110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 132.Keller M.C., Miller G. Resolving the paradox of common, harmful, heritable mental disorders: Which evolutionary genetic models work best? Behav Brain Sci. 2006;29:385–404. doi: 10.1017/S0140525X06009095. discussion 405–452. [DOI] [PubMed] [Google Scholar]
- 133.Weigard A., Clark D.A., Sripada C. Cognitive efficiency beats subtraction-based metrics as a reliable individual difference dimension relevant to self-control. PsyArXiv. 2020 doi: 10.31234/osf.io/qp2ua. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 134.Weigard A., Soules M., Ferris B., Zucker R.A., Sripada C., Heitzeg M. Cognitive modeling informs interpretation of Go/No-go task-related neural activations and their links to externalizing psychopathology. Biol Psychiatry Cogn Neurosci Neuroimaging. 2020;5:530–541. doi: 10.1016/j.bpsc.2019.11.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.Kotov R., Krueger R.F., Watson D., Achenbach T.M., Althoff R.R., Bagby R.M., et al. The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. J Abnorm Psychol. 2017;126:454–477. doi: 10.1037/abn0000258. [DOI] [PubMed] [Google Scholar]
- 136.Ratcliff R., Cherian A., Segraves M. A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J Neurophysiol. 2003;90:1392–1407. doi: 10.1152/jn.01049.2002. [DOI] [PubMed] [Google Scholar]
- 137.O’Connell R.G., Dockree P.M., Kelly S.P. A supramodal accumulation-to-bound signal that determines perceptual decisions in humans. Nat Neurosci. 2012;15:1729–1735. doi: 10.1038/nn.3248. [DOI] [PubMed] [Google Scholar]
- 138.Nunez M.D., Vandekerckhove J., Srinivasan R. How attention influences perceptual decision making: Single-trial EEG correlates of drift-diffusion model parameters. J Math Psychol. 2017;76:117–130. doi: 10.1016/j.jmp.2016.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 139.Loughnane G.M., Newman D.P., Bellgrove M.A., Lalor E.C., Kelly S.P., O’Connell R.G. Target selection signals influence perceptual decisions by modulating the onset and rate of evidence accumulation. Curr Biol. 2016;26:496–502. doi: 10.1016/j.cub.2015.12.049. [DOI] [PubMed] [Google Scholar]
- 140.Ho T.C., Brown S., Serences J.T. Domain general mechanisms of perceptual decision making in human cortex. J Neurosci. 2009;29:8675–8687. doi: 10.1523/JNEUROSCI.5984-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 141.Liu T., Pleskac T.J. Neural correlates of evidence accumulation in a perceptual decision task. J Neurophysiol. 2011;106:2383–2398. doi: 10.1152/jn.00413.2011. [DOI] [PubMed] [Google Scholar]
- 142.Krueger P.M., van Vugt M.K., Simen P., Nystrom L., Holmes P., Cohen J.D. Evidence accumulation detected in BOLD signal using slow perceptual decision making. J Neurosci Methods. 2017;281:21–32. doi: 10.1016/j.jneumeth.2017.01.012. [DOI] [PubMed] [Google Scholar]
- 143.Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature. 2004;431:859–862. doi: 10.1038/nature02966. [DOI] [PubMed] [Google Scholar]
- 144.Mulder M.J., Van Maanen L., Forstmann B.U. Perceptual decision neurosciences - a model-based review. Neuroscience. 2014;277:872–884. doi: 10.1016/j.neuroscience.2014.07.031. [DOI] [PubMed] [Google Scholar]
- 145.Kühn S., Schmiedek F., Schott B., Ratcliff R., Heinze H.J., Düzel E., et al. Brain areas consistently linked to individual differences in perceptual decision-making in younger as well as older adults before and after training. J Cogn Neurosci. 2011;23:2147–2158. doi: 10.1162/jocn.2010.21564. [DOI] [PubMed] [Google Scholar]
- 146.Brosnan M.B., Sabaroedin K., Silk T., Genc S., Newman D.P., Loughnane G.M., et al. Evidence accumulation during perceptual decisions in humans varies as a function of dorsal frontoparietal organization. Nat Hum Behav. 2020;4:844–855. doi: 10.1038/s41562-020-0863-4. [DOI] [PubMed] [Google Scholar]
- 147.Loughnane G.M., Brosnan M.B., Barnes J.J.M., Dean A., Nandam S.L., O’Connell R.G., Bellgrove M.A. Catecholamine modulation of evidence accumulation during perceptual decision formation: A randomized trial. J Cogn Neurosci. 2019;31:1044–1053. doi: 10.1162/jocn_a_01393. [DOI] [PubMed] [Google Scholar]
- 148.Westbrook A., van den Bosch R., Määttä J.I., Hofmans L., Papadopetraki D., Cools R., Frank M.J. Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work. Science. 2020;367:1362–1366. doi: 10.1126/science.aaz5891. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 149.Singmann H., Brown S., Gretton M., Heathcote A., Voss A., Voss J., Terry A. Package ‘rtdists’, 2016. cran.r-project.org/web/packages/rtdists/index.html