Abstract
Attenuated psychotic symptoms (APS) are the key criteria to identify the individuals at enhanced risk of developing psychotic disorders. Competing clinicians-rated or self-rated psychometric instruments can also be used to detect APS, which makes it difficult to interpret their actual clinical significance. This article summarizes the empirical differences between the clinicians-rated and self-rated interviews and explores the impact of the context (referral pathways, settings, and assessment procedures) on the clinical significance of the APS.
Keywords: psychosis, schizophrenia, risk, ARMS, prevention, symptoms
The Ultra High-Risk State for Psychosis
Over the past two decades, clinical criteria have been developed to identify the individuals at ultra high-risk (UHR) of developing the first episode of psychosis within a relatively short period of time (eg, 2–3 years1). UHR individuals have become a major focus of academic research, and the detection of UHR individuals is increasingly being recognized as an important component of clinical services for early psychosis intervention2 (eg, NICE guidelines3, recent NHS England AWT EIP guidelines,4 and DSM-5 diagnostic manual). Research in this field has the potential to shed light on the development of major psychotic disorders and to alter their course.5
Recognition of Attenuated Psychotic Symptoms: At the Core of Psychosis Prevention
The diagnosis of the UHR state requires the presence of one or more of the following clinical features: attenuated psychotic symptoms (APS) and/or brief limited and intermittent psychotic symptoms (BLIPS); and/or genetic risk and deterioration (GRD) syndrome (for details see6). However, recent evidence indicated that the GRD subgroup is not actually associated with an increased risk for psychosis,6 while the BLIPS subgroup also includes individuals who are already presenting symptoms of psychotic disorders.7,8 Therefore, the APS subgroup, which represents the vast majority of UHR cases (85%),6 can be considered as the core high-risk subgroup.
Psychometric Assessment of Attenuated Psychotic Symptoms
Clinicians-Rated Psychometric Instruments
The APS features can be assessed trough semi-structured psychometric interviews.9 The original instrument, the Comprehensive Assessment of At-Risk Mental State (CAARMS 12/200610) is a detailed psychopathological interview (7 subscales with 177 questions, footnote to table 1) addressing a wide array of signs and symptoms of the potential risk of psychosis, among which APS are of primary importance. Clinicians are required to investigate and rate the severity, frequency, onset time, and overall distress of each component of the APS. Since the CAARMS is semi-structured, CAARMS interviews are conducted with a fairly open framework, which allows focused, conversational, two-way communication. The interviewer follows a specific guideline but is able to follow topical trajectories in the conversation or that may stray from the guide when it seems appropriate or to ask additional questions to better elucidate the clinical meaning of each answer. Such diagnostic assessment is time consuming, as it may encompass multiple sessions (up to 2 hours for the diagnostic part2) and several post hoc clinicians-based and team-based discussions to ensure clinical validity.2 More importantly, it also requires specific psychopathological training11 in order to ensure an adequate inter-rater reliability. The CAARMS assessment is one of the most complex psychopathological investigations in clinical psychiatry. Recognizing this, the NICE clinical guidelines CG178 1.2.2.1 have recommended that the CAARMS assessment should be carried out by “a consultant psychiatrist or a trained specialist with experience”12 in the field.
Table 1.
Qualitative Comparison of Item Similarities Between the Semi-Structured Clinicians-Rated Psychometric Instruments (CAARMS 12/2006) and the Structured Self-Reported Psychometric Instruments for the assessment of Attenuated Psychotic Symptoms
| CAARMS Version 12/200610 | CAPE-P1515 |
|---|---|
| [Positive symptoms: Unusual thought content] Have you felt that people were trying to give you messages? What is it like? How did it start? | Do you ever feel as if people seem to drop hints about you or say things with a double meaning? |
| [Positive symptoms: Unusual thought content] Do you feel that others, or the world, have changed in some way? | Do you ever feel as if some people are not what they seem to be? |
| [Positive symptoms: Non-bizarre ideas] Has anybody been giving you a hard time or trying to hurt you? | Do you ever feel as if you are being persecuted in some way? |
| [Positive symptoms: Non-bizarre ideas] Has anybody been giving you a hard time or trying to hurt you? | Do you ever feel as if there is a conspiracy against you? |
| [Positive symptoms: Unusual thought content] Have you felt that someone, or something, outside yourself has been controlling your thoughts, feelings, actions or urges? Have you had feelings or impulses that don’t seem to come from yourself? | Do you ever feel as if electrical devices such as computers can influence the way you think? |
| [Positive symptoms: Non-bizarre ideas] Do you feel like people have been talking about you, laughing at you, or watching you? What is it like? How do you know this? | Do you ever feel that people look at you oddly because of your appearance? |
| [Positive symptoms: Unusual thought content] Have you felt that ideas or thoughts are being taken out of your head? How does that happen? | Do you ever feel as if the thoughts in your head are being taken away from you? |
| [Positive symptoms: Unusual thought content] Have you felt that ideas or thoughts that are not your own have been put into your head? How do you know they are not your own? Where do they come from? | Do you ever feel as if the thoughts in your head are not your own? |
| [Positive symptoms: Unusual thought content] Are your thoughts broadcast so that other people know what you are thinking? | Have your thoughts ever been so vivid that you were worried other people would hear them? |
| [Positive symptoms: Perceptual abnormalities] Do you ever hear things that other people seem not to (such as sounds or voices)? | Do you ever hear your own thoughts being echoed back to you? |
| [Positive symptoms: Unusual thought content] Have you felt that someone, or something, outside yourself has been controlling your thoughts, feelings, actions or urges? Have you had feelings or impulses that don’t seem to come from yourself? | Do you ever feel as if you are under the control of some force or power other than yourself? |
| [Positive symptoms: Perceptual abnormalities] Do you ever hear things that may not really be there? Do you ever hear things that other people seem not to (such as sounds or voices)? What do you hear? At the time you hear these things, how real do they seem? Do you realise they are not real at the time, or only later? | Do you ever hear voices when you are alone? |
| Do you ever hear voices talking to each other when you are alone? | |
| [Positive symptoms: Unusual thought content] Do you feel puzzled by anything? Do familiar surroundings feel strange? | Do you ever feel as if a double has taken the place of a family member, friend or acquaintance? |
| [Positive symptoms: Perceptual abnormalities] Do you have visions, or see things that may not really be there? Do you ever see things that others can’t, or don’t seem to? What do you see? At the time that you see these things, how real do they seem? Do you realise they are not real at the time, or only later? | Do you ever see objects, people or animals that other people cannot see? |
Note: CAARMS 12/2006 subscales:
• Positive symptoms: Unusual thought content, Non-bizarre ideas, Perceptual abnormalities, Disorganized speech
• Cognitive change attention/concentration: Subjective experience, Observed cognitive change
• Emotional disturbance: Subjective emotional disturbance, Observed blunted affect, Observed inappropriate affect
• Negative symptoms: Alogia, Avolition/apathy, Anhedonia
• Behavioural change: Social isolation, Impaired role function, Disorganising/odd/stigmatizing behavior, Aggression/dangerous behavior
• Motor/physical changes: Subjective complaints of impaired motor functioning, Informant reported or observed changes in motor functioning, Subjective complaints of impaired bodily sensation, Subjective complaints of impaired autonomic functioning
• General psychopathology: Mania, Depression, Suicidality and self harm, Mood swings/lability, Anxiety, Obsessive compulsive disorder symptoms, Dissociative symptoms, Impaired tolerance to normal stress
Total number of items/questions in the CAARMS 12/2006: 176 (follow-up questions for severity, frequency/duration, distress not accounted). A subset of the items that are matching the CAPE-15 items is reported here.
Self-Reported Psychometric Instruments
As conducting semi-structured clinical interviews, such as the CAARMS, is highly demanding, the researchers have developed several structured self-reported screening tools that are aimed at quick identification of APS. Among the others (eg, the PRIME Screening [PS], the Prodromal Questionnaire [PQ], and the Psychosis-Like Symptom Interview [PLSI], for a systematic review of all available screening instruments see13), the Community Assessment of Psychic Experiences [CAPE] is one of the most widely used tools and also the one with the most robust prospective research. The original 42-item version takes 10–12 minutes to complete and includes items for self-reported APS (self-reported APS are also termed “psychotic-like experiences,” PLE14), items for self-reported negative symptoms, and items on depressive experiences.13 Based on the direct questions, the person is required to self-evaluate the presence of APS (ranging from “never” to “nearly always”), as well as the extent of associated distress (ranging from “not distressed” to “very distressed”). Recently, the CAPE-42 has been further reduced to a 15-item screener (CAPE-15),15 which takes only 5 minutes to complete,13 and selectively focuses on the persecutory ideation, perceptual abnormalities, and bizarre experiences. Other self-reported instruments can take even less time to be completed (eg, 1 minute and 40 seconds on average for the PS16).
2 Hours vs 5 Minutes Assessment for Attenuated Psychotic Symptoms: Does it Make any Difference?
Despite the different target populations, for which they were originally developed, clinicians-rated and self-reported instruments for the assessment of APS have been interchangeably and inconsistently17,18 used to identify the individuals at risk of developing psychosis. However, not all the APS are the same, and some important differences should be taken into account.17
Psychometric Validity
The clinical validity of semi-structured clinician-rated interviews has been confirmed at the meta-analytical levels, including the large samples collected worldwide. These meta-analyses have indicated a good ability to rule out psychosis and a modest ability to rule it in, with an overall excellent area under the curve of 0.90 (95% confidence interval: 0.87–0.93), which is comparable to the other tests in preventive medicine.19 Conversely, the majority of self-reported structured instruments are poorly validated (ie, sensitivity, specificity, positive and negative predictive values, and inter-rater reliability are unknown13) and lack the appropriate assessment of the relevant psychometric properties and acceptance by patients and clinicians20 in suitable clinical samples.
Prognostic Validity
APS detected by trained clinicians are associated with up to 29% risk of developing into psychosis over the following 2 years,1,21 while self-reported APS (measured with the Psychiatric Epidemiology Research Interview) are associated with just a 0.5% risk of developing psychosis over the following 24 years.22 There is less data and quality is poor regarding prognostic accuracy of other self-reported APS instruments for the longitudinal prediction of psychosis. The available small studies employing the PS and PQ lacked the external validation and were biased toward overoptimistic estimates16 like those produced by post hoc manipulation of cutoffs.23 Furthermore, some of these studies have been conducted in samples that had already been filtered through semi-structured interviews.16 Indeed, larger studies employing the PQ revealed poor positive predictive values of 5% at more than 3-year follow-up, with a rate of false positives to true positives that was approximately 20-fold.24 A large study employing the PLSI concluded that positive predictive values for predicting psychotic disorders were too low to offer real potential for clinical use.25
How the Context Impacts the Clinical Significance of Attenuated Psychotic Symptoms
Sampling Biases
The profound difference between the risk of psychosis yielded by clinicians-rated and self-reported interviews of APS is partially due to the fact that the former are usually employed in selected individuals who are referred to high-risk services on the suspicion of psychosis risk,26,27 while the latter are usually used in unselected individuals of the general population.28 This phenomenon has been described as risk enrichment in help-seeking populations. A recent study has confirmed that the individuals referred to high-risk services have a pretest (ie, before the UHR assessment is performed) 15% risk (at 38 months) of developing psychosis, a value which is significantly higher than the 0.1% 38-month risk expected in the general population,27 which confirms substantial risk enrichment.
The Setting and the Clinical Meaning of Attenuated Psychotic Symptoms
Earlier studies showed that prevalence of psychosis in community samples is strongly influenced by the methods of assessments and diagnosis.29 A more recent study has directly challenged the assumption that self-reported APS are a reliable estimate of clinicians-rated APS, within the same pool of individuals accessing high-risk services (n = 123), and thus controlling for sampling biases and differential risk enrichment.18 The authors found that level of agreement between the two instruments was poor and insufficient, even if additional qualifiers, such as level of distress, preoccupation, and conviction, were considered.18 In particular, self-rated APS overestimated the prevalence of clinician-rated psychotic symptoms several fold.18 The disagreement was evident for delusion-like experiences and was maximum for hallucination-like experiences.18 The study concluded that self-reported APS cannot be used to assess the pathological meaningfulness of these experiences as evaluated by clinicians.18
Recruitment Strategies Impact Clinical Significance of APS
Likewise, there is evidence that the type of recruitment strategies adopted to select individuals for UHR assessment can enrich the clinical significance of APS.27 The highest pretest risk of psychosis is observed when the individuals are exclusively referred from mental health professionals or services, “because of difficulties that had arisen in the diagnostic procedure.”30 Such samples have become increasingly enriched with psychosis-prone individuals, who were passing through several mental health service filters and talking with psychiatrists about their problem. Conversely, when the individuals were recruited from the general population or were self-referred, the clinical significance of their APS and the associated risk of developing psychosis was the lowest.31 These data confirm that the pathological meaningfulness of APS accumulates if the clinicians filter them. A recent study confirmed these hypotheses.26
A Practical Example
The above arguments indicate that the context (both in terms of filtered/unfiltered referral pathways, setting and assessment procedures) impacts the clinical significance of APS. Despite that the CAARMS and the CAPE share some qualitative item similarities (see table 1 for a summary), this does not exclude the important differences. For instance, self-answering to the questions like (table 1)
“Do you ever hear voices when you are alone?”
“Do you ever feel as if you are being persecuted in some way?”
“Do you ever feel that people look at you oddly because of your appearance?”
at the beginning of class during the first week of the college course32 does not have the same clinical significance, as answering to these same questions when they are put forward by a psychiatrist in a clinical service. In other words, the clinical significance of the responses to these questions cannot be “predefined”33 by the virtue of their similar verbal formulation. APS cannot be considered as atomic features that become individuated “in themselves,”, independent of their developmental34 and experiential context.33
Contextual Recognition of Attenuated Psychosis Symptoms
What does it mean that the attenuated psychotic symptom changes its clinical significance depending on the contextual circumstances in which it occurs? How is it possible? Before answering that question, we need to address the issue and understand what is the meaning of the term “symptom” in psychiatry.35 The notion of symptom was imported to psychiatry after the medicalization of madness in the beginning of 19th century. However, whereas the clinical validity of a symptom in somatic medicine is strongly associated with its referential function toward its root cause in a malfunctioning biological substrate (eg, coughing may indicate a lung disease, an acute abdominal pain may indicate appendicitis), this is not the case in psychiatry. In contemporary psychiatry, first there is no robust knowledge on the specific pathophysiology of the vast majority of symptoms (eg, lack of clinically valid biomarkers36) and, second, there is even a lack of theoretical account on the nature of symptoms and on the processes of their formation. Thus, the symptom in psychiatry is considered at the implicit common sense level as an unproblematic thing-like object, independent of other symptoms and easily described by the so-called operational definition. The symptom is envisaged in analogy with a ripe fruit hanging in the patient’s consciousness and only waiting for a gentle push from the structured interview questions in order to fall down and come into complete view to trickle down to its corresponding diagnostic criterion.37 This is a fundamentally mistaken epistemological position. In psychiatry, the operations do not comprise autonomous things-like semi-permanent objects, which can be defined in themselves without any contextual dimension. Mental phenomena are essentially different from physical objects. As insightfully observed by Descartes, mental phenomena have no spatial extension (a perception of a tall building is not itself tall). Much later, Henri Bergson drove the attention to the fact that the use of the terms, such as intensity and magnitude applied to mental phenomena, is, in fact, practical, but an abusive transfer of spatial metaphors, valid only for the external world. Psychiatric symptoms are not semi-permanent well-delimited objects but consist of certain aspects of the stream of consciousness that is reported by the patient. Indeed, they contain affective and cognitive elements that are always relative and dependent on other experiences and manifest the underlying changes in the structure of consciousness. Finally, they are subjected to the processes of conceptualization and verbalization, both embedded in the interpersonal context of the psychiatric interview. To conclude, the behavioristic ideal of the impersonal access to a preexisting “objective mental reality” is a dangerous illusion.
In other words, the articulation of a symptom is not entirely independent of the way in which it is elicited, eg, through the introspective attention required in self-assessment questionnaires or through the dialogic framework of the semi-structured psychiatric interview. In the latter case, the validity of symptom’s description and the nature of the symptom are objectively arrived at by the intersubjective agreement with a trained and experienced psychiatrist, who recognizes psychologically meaningful interrelations among the patient’s descriptions and thereby discerns their clinical value. Further to this point, it is also possible that patients themselves may talk to doctors differently in a clinical semi-structured context than they do to self-reports. To take an instance from the table 1 concerning the experience of self-reference (eg, “Do you ever feel that people look at you oddly because of your appearance?), there are countless possibilities of false positive and negative responses. A patient may misunderstand the question or think that the formulation does not apply to him because his own experience of other’s exaggerated interest is not really bound to his appearance. He may believe that he is actually the center of the universe and therefore it is not surprising or odd to be looked at, or he may simply feel self-reference for no reason (which is typically characteristic of incipient psychosis) or because others consider him as being outside of human kind. Finally, the patient may answer negatively because he thinks that others avoid looking at him because they are polite and will not acknowledge his inhuman presentation. No wonder that the same interview question elicits responses with diverse clinical importance. Clearly, while the potential for tangential answers or misunderstandings is relatively uncontrolled in self-assessment structured tools, clinician-based semi-structured interviews enable a more articulated investigation and understanding of the meaning and context of the answers, with optimal tuning between the interviewer and the patient.18 Such context-sensitive understanding is what guarantees a more precise recognition of prototypical APS presentations, as they emerge in the clinical dialogue.
Conclusions
The clinical significance of APS depends on the way (and the context) in which it is assessed. Discerning the validity and nature of APS presupposes the availability of extensive contextual information that only trained and experienced clinicians can elicit through semi-structured interviews. Self-reported APS detected with structured instruments, not filtered by contextual information, have minimal direct clinical significance for the prediction of psychosis onset. On the contrary, self-reported instruments may have some clinical impact, when used in sequential testing to enrich samples undergoing subsequent semi-structured interviews.38,39 These issues should be carefully considered by researchers and clinicians, who are working in the field of psychosis prevention.
Funding
The study was funded in part by a 2014 NARSAD Young Investigator Award to P.F.-P.
Conflict of Interest
None.
References
- 1. Kempton MJ, Bonoldi I, Valmaggia L, McGuire P, Fusar-Poli P. Speed of psychosis progression in people at ultra-high clinical risk: a complementary meta-analysis. JAMA Psychiatry. 2015;72:622–623. [DOI] [PubMed] [Google Scholar]
- 2. Fusar-Poli P, Byrne M, Badger S, Valmaggia LR, McGuire PK. Outreach and support in south London (OASIS), 2001–2011: ten years of early diagnosis and treatment for young individuals at high clinical risk for psychosis. Eur Psychiatry. 2013;28:315–326. [DOI] [PubMed] [Google Scholar]
- 3. NICE. Psychosis and schizophrenia in children and young people: recognition and management. Periodical. 2013; First published on January 2013. [Google Scholar]
- 4. NHS England. Achieving better access to mental health services by 2020. Periodical. 2014. [Google Scholar]
- 5. Millan MJ, Andrieux A, Bartzokis G, et al. Altering the course of schizophrenia: progress and perspectives. Nat Rev Drug Discov. 2016;15:485–515. [DOI] [PubMed] [Google Scholar]
- 6. Fusar-Poli P, Cappucciati M, Borgwardt S, et al. Heterogeneity of risk for psychosis within subjects at clinical high risk: meta-analytical stratification. JAMA Psychiatry. 2016;73:113–120. [DOI] [PubMed] [Google Scholar]
- 7. Fusar-Poli P, Cappucciati M, Bonoldi I, et al. Prognosis of brief psychotic episodes: a meta-analysis. JAMA Psychiatry. 2016;73:211–220. [DOI] [PubMed] [Google Scholar]
- 8. Fusar-Poli P, Cappucciati M, De Micheli A, et al. Diagnostic and prognostic significance of Brief Limited Intermittent Psychotic Symptoms in subjects at ultra high risk. Schizophr Bull. 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Fusar-Poli P, Cappucciati M, Rutigliano G, et al. Towards a standard psychometric diagnostic interview for subjects at ultra high risk of psychosis: CAARMS versus SIPS. Psychiatry J. 2016;2016:7146341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Yung A, Yuen H, McGorry P, et al. Mapping the onset of psychosis: the comprehensive assessment of at-risk mental states. ANZJP. 2005;39:964–971. [DOI] [PubMed] [Google Scholar]
- 11. Nelson B, Simmons MB, Yung AR, et al. Identifying the ultra-high risk (prodromal) population: evaluation of training workshops with mental health services. Aust NZJ Psychiatry. 2008;42:236–243. [DOI] [PubMed] [Google Scholar]
- 12. NICE. Psychosis and schizophrenia in adults: prevention and management. Periodical. 2014; First published on February 2014. [Google Scholar]
- 13. Addington J, Stowkowy J, Weiser M. Screening tools for clinical high risk for psychosis. Early Intervention Psychiatry. 2015;9:345–356. [DOI] [PubMed] [Google Scholar]
- 14. Preti A, Cella M, Raballo A. How psychotic-like are unusual subjective experiences? Psychol Med. 2011;41:2235–2236. [DOI] [PubMed] [Google Scholar]
- 15. Capra C, Kavanagh DJ, Hides L, Scott J. Brief screening for psychosis-like experiences. Schizophr Res. 2013;149:104–107. [DOI] [PubMed] [Google Scholar]
- 16. Kline E, Thompson E, Demro C, Bussell K, Reeves G, Schiffman J. Longitudinal validation of psychosis risk screening tools. Schizophr Res. 2015;165:116–122. [DOI] [PubMed] [Google Scholar]
- 17. Yung AR, Lin A. Psychotic experiences and their significance. World Psychiatry. 2016;15:130–131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Schultze-Lutter F, Renner F, Paruch J, Julkowski D, Klosterkötter J, Ruhrmann S. Self-reported psychotic-like experiences are a poor estimate of clinician-rated attenuated and frank delusions and hallucinations. Psychopathology. 2014;47:194–201. [DOI] [PubMed] [Google Scholar]
- 19. Fusar-Poli P, Cappucciati M, Rutigliano G, et al. At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction. World Psychiatry. 2015;14:322–332. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Michel C, Schultze-Lutter F, Schimmelmann BG. Screening instruments in child and adolescent psychiatry: general and methodological considerations. Eur Child Adolesc Psychiatry. 2014;23:725–727. [DOI] [PubMed] [Google Scholar]
- 21. Fusar-Poli P, Schultze-Lutter F. Predicting the onset of psychosis in patients at clinical high risk: practical guide to probabilistic prognostic reasoning. Evid Based Ment Health. 2016;19:10–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Werbeloff N, Drukker M, Dohrenwend BP, et al. Self-reported attenuated psychotic symptoms as forerunners of severe mental disorders later in life. Arch Gen Psychiatry. 2012;69:467–475. [DOI] [PubMed] [Google Scholar]
- 23. Kobayashi H, Nemoto T, Koshikawa H, et al. A self-reported instrument for prodromal symptoms of psychosis: testing the clinical validity of the PRIME Screen-Revised (PS-R) in a Japanese population. Schizophr Res. 2008;106:356–362. [DOI] [PubMed] [Google Scholar]
- 24. Therman S, Lindgren M, Manninen M, et al. Predicting psychosis and psychiatric hospital care among adolescent psychiatric patients with the Prodromal Questionnaire. Schizophr Res. 2014;158:7–10. [DOI] [PubMed] [Google Scholar]
- 25. Zammit S, Kounali D, Cannon M, et al. Psychotic experiences and psychotic disorders at age 18 in relation to psychotic experiences at age 12 in a longitudinal population-based cohort study. Am J Psychiatry. 2013;170:742–750. [DOI] [PubMed] [Google Scholar]
- 26. Fusar-Poli P, Rutigliano G, Stahl D, et al. Deconstructing pretest risk enrichment to optimize prediction of psychosis in individuals at clinical high risk. JAMA Psychiatry. 2016. [DOI] [PubMed] [Google Scholar]
- 27. Fusar-Poli P, Schultze-Lutter F, Cappucciati M, et al. The dark side of the moon: meta-analytical impact of recruitment strategies on risk enrichment in the clinical high risk state for psychosis. Schizophr Bull. 2016;42:732–743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Kaymaz N, Drukker M, Lieb R, et al. Do subthreshold psychotic experiences predict clinical outcomes in unselected non-help-seeking population-based samples? A systematic review and meta-analysis, enriched with new results. Psychol Med. 2012;42:2239–2253. [DOI] [PubMed] [Google Scholar]
- 29. Kendler KS, Gallagher TJ, Abelson JM, Kessler RC. Lifetime prevalence, demographic risk factors, and diagnostic validity of nonaffective psychosis as assessed in a US community sample. The National Comorbidity Survey. Arch Gen Psychiatry. 1996;53:1022–1031. [DOI] [PubMed] [Google Scholar]
- 30. Klosterkötter J, Hellmich M, Steinmeyer EM, Schultze-Lutter F. Diagnosing schizophrenia in the initial prodromal phase. Arch Gen Psychiatry. 2001;58:158–164. [DOI] [PubMed] [Google Scholar]
- 31. Lee J, Rekhi G, Mitter N, et al. The Longitudinal Youth at Risk Study (LYRIKS)—an Asian UHR perspective. Schizophr Res. 2013;151:279–283. [DOI] [PubMed] [Google Scholar]
- 32. Loewy RL, Johnson JK, Cannon TD. Self-report of attenuated psychotic experiences in a college population. Schizophr Res. 2007;93:144–151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Parnas J. The core Gestalt of schizophrenia. World Psychiatry. 2012;11:67–69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Preti A, Cella M, Raballo A. All that shines is not psychosis: a cautionary note on the assessment of psychotic symptoms in childhood and adolescence. Psychol Med. 2012;42:1787–1788. [DOI] [PubMed] [Google Scholar]
- 35. Nordgaard J, Sass LA, Parnas J. The psychiatric interview: validity, structure, and subjectivity. Eur Arch Psychiatry Clin Neurosci. 2013;263:353–364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Kapur S, Phillips AG, Insel TR. Why has it taken so long for biological psychiatry to develop clinical tests and what to do about it? Mol Psychiatry. 2012;17:1174–1179. [DOI] [PubMed] [Google Scholar]
- 37. Parnas J, Bovet P. Psychiatry made easy: operation(al)ism and some of its consequences. In: Kendler KS, Parnas J, eds. Philosophical Issues in Psychiatry III: The Nature and Sources of Historical Changes. Oxford: Oxford University Press; 2015:190–212. [Google Scholar]
- 38. Rietdijk J, Klaassen R, Ising H, et al. Detection of people at risk of developing a first psychosis: comparison of two recruitment strategies. Acta Psychiatr Scand. 2012;126:21–30. [DOI] [PubMed] [Google Scholar]
- 39. Calkins M, Moore T, Satterthwaite T, et al. Persistence of psychosis spectrum symptoms in the Philadelphia Neurodevelopmental Cohort: a prospective two year follow-up. World Psychiatry. In press 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
