Abstract
Schizophrenia research is plagued by enormous challenges in integrating and analyzing large datasets and difficulties developing formal theories related to the etiology, pathophysiology, and treatment of this disorder. Computational psychiatry provides a path to enhance analyses of these large and complex datasets and to promote the development and refinement of formal models for features of this disorder. This presentation introduces the reader to the notion of computational psychiatry and describes discovery-oriented and theory-driven applications to schizophrenia involving machine learning, reinforcement learning theory, and biophysically-informed neural circuit models.
Keywords: computational psychiatry, computational neuroscience, schizophrenia, delusions, medication selection, working memory, machine learning
Introduction
Computational approaches may assist the field of schizophrenia research in dealing with its own disordered thoughts. Schizophrenia researchers engaged in discovery-oriented research are overwhelmed by the complexity of large datasets and the challenge of “convergence science,”1 ie, the effort to integrate many types of data in the pursuit of deep insights into etiology, pathophysiology, and treatment. The field also has struggled to develop formal theory that might guide research conducted within a hypothesis-testing framework. The application of recently developed analytic and mathematical modeling approaches to psychiatry, “computational psychiatry,”2–4 is facilitating both discovery-oriented and hypothesis-based research. This commentary is intended to introduce readers to computational psychiatry and its applications to schizophrenia and thereby raise awareness and broaden the adoption of these computational approaches in schizophrenia research.
Computational Psychiatry
Discovery-oriented computational psychiatry approaches have their roots in statistics and computer science.5 This research is exemplified by the application of machine learning techniques, such as random forests, support vector machines, linear discriminant analysis, and k-means clustering. These approaches are most useful when analyzing highly complex datasets, as they enable one to uncover relationships that are not evident from summary or simple statistics and then to make accurate predictions based on these statistics. Examples of this approach are the effort to predict the response to treatments6 or to cluster patients on the basis of biological or behavioral traits to supplement or supplant current diagnostic groupings.4
Another important approach in computational psychiatry is the application of a Bayesian statistical framework to reinforcement learning (RL) theory.2,4,5 In Bayesian statistics, predictions (ie, statistical models) are updated with each new observation. Each salient new piece of information teaches you something new because it is, to some degree, different from one’s prior expectations, in other words there is a mismatch between the new information and the prior model. This difference, known as a “prediction error,” causes one to update one’s prior model. In a simplified way,2 this process may be represented using the following equation, δt = rt−Vt, where δt is the prediction error, rt is the salient new information, and Vt is your prior, what you expected to see at time t. The rate of new learning may be represented as αδt, where α may be mediated via neuromodulators like dopamine or acetylcholine. These models provide a powerful framework for studying disturbances in reward learning and concept formation. However, as will be discussed later, “model-based” forms of RL are complemented by “model-free” forms that establish relatively rigidly expressed forms of thought or behavior, such as habits or fixed beliefs.7
A second important domain of theory-driven computational psychiatry research emerged as a clinical translation of computational neuroscience. Computational neuroscience emerged with advances in neurophysiology, computing capacity, informatics, and computational modeling.8 Increasingly, neural simulations emerged that were informed by the specific biophysical properties of actual neural circuits and that represented signaling alterations that were implicated in psychiatric disorders. One early example of this was the modeling of deficits in the maintenance of persisting prefrontal neural activity, thought to underlie working memory deficits in schizophrenia.2 The emergence of advances in mechanistic psychiatric research employing psychopharmacology, genomics, and molecular brain imaging, and functional neuroimaging created new opportunities to apply neural simulations derived from preclinical models to data from individuals diagnosed with psychiatric disorders. In this way, computational psychiatry could facilitate, for the first time, the development of formal hypotheses regarding the nature of microcircuit dysfunction in psychiatric disorders.2–4 In so doing, these approaches set the stage for deep understanding of brain-behavior relationships and the development of novel therapeutics.
Three Brief Exemplars of Applications of Computational Psychiatry to Schizophrenia
Increasingly, computational psychiatry approaches9,10 are applied in both discovery-oriented and theory-oriented studies of schizophrenia. For example, a recent discovery-oriented study applied machine learning to data from a large randomized study, the European First Episode of Schizophrenia Trial (EUFEST).11 It identified a set of variables that predicted multiple clinical outcomes with over 70% accuracy at 4 weeks and 1 year of treatment.
Computational psychiatry approaches building on temporal difference RL approaches have contributed advances in theory, including a cognitive theory of delusions.7 In this model, simplified here, aberrant prediction errors in the right lateral prefrontal cortex are generated by a number of factors associated with psychosis, such as heightened salience of irrelevant stimuli as a consequence of increased striatal dopamine release, distortion of information in memory, and other factors.7 Distortions in the resulting beliefs produce “top-down,” ie, cortically driven distortions of perceptual processes that reinforce aberrant expectancies. The cycle of altered perceptual experiences and false inference formation recurrently reinforce each other as a result of the need to attempt to reconcile sensory experiences, memories, and expectancies. This repetitive process appears to shift the learning of expectancies, ie, the formation of beliefs, from a model-based to model-free form of learning. In other words, the beliefs lose the properties of “regular” beliefs, which are recalled voluntarily and updated flexibly, and acquire the properties of habits, ie, they are fixed and not falsifiable. This aberrant process may be maintained by high levels of dopamine D2 receptor signaling, as D2 receptor antagonists can alleviate delusions.
Lastly, a biophysically-informed computational model of cortical microcircuits sheds light on disturbances in microcircuits that might arise in schizophrenia as a consequences of deficits in glutamate signaling, particular signaling mediated by NMDA glutamate receptors (NMDA-R). In these models, NMDA-Rs contribute to recurrent excitation in layer 3 of the lateral prefrontal cortex that underlies the maintenance of information in working memory.2 Reductions in NMDA-R signaling undermine sustained activity, compromising working memory-related PFC activity and working memory performance. These findings are consistent with subsequent studies of NMDA-R antagonist effects on working memory-related PFC activity in humans and reduced working memory-related PFC activity associated with schizophrenia. However, these models also suggest that reduced excitatory drive of interneurons would impair working memory in schizophrenia by undermining the suppression of “noisy” neural activity at rest and during working memory. Loss of spatial tuning also reduces the precision of memory.12 Again, these disturbances in cortical activity could be demonstrated in healthy subjects administered ketamine and in schizophrenia. Further, this model predicted that in patients who have reduced working memory precision, a metabotropic-2 glutamate receptor agonist (mGluR2) would improve memory function by restoring the balance of excitation and inhibition in disinhibited networks. This hypothesis has yet to be tested. However, mGluR2 agonists do attenuate ketamine-related impairment in working memory in humans13 and may have therapeutic effects in subgroups of schizophrenia patients.14
Toward Computational Schizophrenia Research
Computational psychiatry is not a panacea, but it constitutes both a conceptual and a practical advance. Advances in this area highlight the limitations of prior analytic approaches and missed opportunities to develop formal theories related to schizophrenia etiology, pathophysiology, and treatment. In order to achieve the opportunities created by computational psychiatry, clinical investigators may need to establish new collaborations with computational neuroscientists, statisticians, computer scientists, as well as scientists and engineers in related fields. This breaking down of the intellectual silos that separate fields should benefit everyone. Further, there is an opportunity to train a new generation of translational and clinical investigators in the emerging computational methods. For them, the field of computational psychiatry will be a foregone conclusion.
Funding
This article was supported by the National Center for Advancing Translational Sciences grant 1UH2TR000960-01, the National Institute on Alcohol Abuse and Alcoholism grants P50AA12870 (J.H.K.), the Yale Center for Clinical Investigation grant UL1 RR024139, and the Department of Veterans Affairs through its support for the VA National Center for PTSD (J.H.K.). Additional support came from National Institutes of Health grants DP50D012109-02 (A.A.); the National Alliance for Research on Schizophrenia and Depression Independent Investigator award (A.A.); Blackthorn Therapeutics (A.A.); R01 MH108590 (A.A.); NIMH R01-MH062349 (X-J.W., J.D.M.); and NIMH F30 MH107149 and NIH T32GM 007205 (G.Y.). P.R.C. was funded by NIMH-R01MH067073 an IMHRO/Janssen Rising Star Translational Research Award and CTSA grant number UL1 TR000142 from the National Center for Advancing Translational Science (NCATS), components of the National Institutes of Health (NIH), and NIH roadmap for Medical Research.
Acknowledgments
J.H.K. is a co-inventor for the following approved and pending patents: (1) Seibyl JP, Krystal JH, Charney DS. Dopamine and noradrenergic reuptake inhibitors in treatment of schizophrenia. US Patent #:5,447,948. September 5, 1995; (2) Vladimir, Coric, Krystal, John H, Sanacora, Gerard. Glutamate Modulating Agents in the Treatment of Mental Disorders US Patent No. 8,778,979 B2 Patent Issue Date: July 15, 2014; (3) Charney D, Krystal JH, Manji H, Matthew S, Zarate C. Intranasal Administration of Ketamine to Treat Depression United States Application No. 14/197,767 filed on March 5, 2014; United States application or PCT International application No. 14/306,382 filed on June 17, 2014; (4) Arias A, Petrakis I, Krystal JH. Composition and methods to treat addiction. Provisional Use Patent Application no.61/973/961. April 2, 2014. Filed by Yale University Office of Cooperative Research; and (5) Chekroud, A., Gueorguieva, R., & Krystal, JH. “Treatment Selection for Major Depressive Disorder” USPTO docket number Y0087.70116US00, filed on June 3, 2016. Provisional patent submitted by Yale University. Over the past year, he has received over $5000 in compensation related to consulting or licensed patents from Janssen Pharmaceuticals. He serves in a paid capacity as editor of Biological Psychiatry and has fiduciary responsibilities as president of the International College of Neuropsychopharmacology. A.C. holds equity in Spring Health (d.b.a. Spring Care Inc.), a behavioral health startup. He is lead inventor on a provisional patent submission by Yale University titled “Treatment selection for Major Depressive Disorder” (filing date June 3, 2016, USPTO docket number Y0087.70116US00). A.A. and J.D.M. also provide paid consultation to BlackThorn Therapeutics. No other authors have relevant financial interests to disclose.
References
- 1. Sharp PA, Langer R. Research agenda. Promoting convergence in biomedical science. Science. 2011;333:527. [DOI] [PubMed] [Google Scholar]
- 2. Wang XJ, Krystal JH. Computational psychiatry. Neuron. 2014;84:638–654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Montague PR, Dolan RJ, Friston KJ, Dayan P. Computational psychiatry. Trends Cogn Sci. 2012;16:72–80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Redish AD, Gordon JA. Computational Psychiatry: New Perspectives on Mental Illness. Cambridge, MA: The MIT Press; 2016. [Google Scholar]
- 5. Huys QJ, Maia TV, Frank MJ. Computational psychiatry as a bridge from neuroscience to clinical applications. Nat Neurosci. 2016;19:404–413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Chekroud AM, Zotti RJ, Shehzad Z, et al. Cross-trial prediction of treatment outcome in depression: a machine learning approach. Lancet Psychiatry. 2016;3:243–250. [DOI] [PubMed] [Google Scholar]
- 7. Corlett PR, Taylor JR, Wang XJ, Fletcher PC, Krystal JH. Toward a neurobiology of delusions. Prog Neurobiol. 2010;92:345–369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Sejnowski TJ, Koch C, Churchland PS. Computational neuroscience. Science. 1988;241:1299–1306. [DOI] [PubMed] [Google Scholar]
- 9. Deserno L, Heinz A, Schlagenhauf F. Computational approaches to schizophrenia: a perspective on negative symptoms [published online ahead of print December 13, 2016]. Schizophr Res. [DOI] [PubMed] [Google Scholar]
- 10. Dowd EC, Frank MJ, Collins A, Gold JM, Barch DM. Probabilistic reinforcement learning in patients with schizophrenia: relationships to anhedonia and avolition. Biol Psychiatry Cogn Neurosci Neuroimaging. 2016;1:460–473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Koutsouleris N, Kahn RS, Chekroud AM, et al. Multisite prediction of 4-week and 52-week treatment outcomes in patients with first-episode psychosis: a machine learning approach. Lancet Psychiatry. 2016;3:935–946. [DOI] [PubMed] [Google Scholar]
- 12. Murray JD, Anticevic A, Gancsos M, et al. Linking microcircuit dysfunction to cognitive impairment: effects of disinhibition associated with schizophrenia in a cortical working memory model. Cereb Cortex. 2014;24:859–872. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Krystal JH, Abi-Saab W, Perry E, et al. Preliminary evidence of attenuation of the disruptive effects of the NMDA glutamate receptor antagonist, ketamine, on working memory by pretreatment with the group II metabotropic glutamate receptor agonist, LY354740, in healthy human subjects. Psychopharmacology (Berl). 2005;179:303–309. [DOI] [PubMed] [Google Scholar]
- 14. Kinon BJ, Millen BA, Zhang L, McKinzie DL. Exploratory analysis for a targeted patient population responsive to the metabotropic glutamate 2/3 receptor agonist pomaglumetad methionil in schizophrenia [published online ahead of print March 19, 2015]. Biol Psychiatry. [DOI] [PubMed] [Google Scholar]