Abstract
Cognitive dysfunction is a well recognized symptom of schizophrenia, as well as patients having poor insight into their illness. The subjective scale to investigate cognition in schizophrenia (SSTICS) is one of several scales that have been developed to study subjective cognitive dysfunction and has been compared to patients’ objective cognitive level. A literature search was performed using PubMed, psychINFO, Web of Science, and cross-referencing to find 26 articles which used 14 different subjective cognitive dysfunction scales to investigate the relationship between subjective and objective measures of cognition in schizophrenia. Although the majority of studies using the SSTICS found significant correlations between subjective and objective measures of cognition, the findings from the other scales were less clear. From this review, the issue of whether or not schizophrenic patients have good cognitive insight remains unsure. However, due to the heterogeneous nature of the study designs and their outcome measures, continued work in this area with consistency on these points is necessary; on the path to better provide management options for a very debilitating component of this illness.
Keywords: subjective, objective, cognitive, insight, schizophrenia, self-assessment
Background
The presence of cognitive dysfunction in patients with schizophrenia has long been recognized (O'Carroll, 1992; Heinrichs and Zakzanis, 1998; Fioravanti et al., 2005), notably in the areas of attention, memory and executive function (Gold and Harvey, 1993). They are found in up to 75% of patients (Goldberg et al., 1998) and are a frequent source of complaint, leading patients to score themselves higher on subjective questionnaires of cognitive dysfunction than healthy controls (Moritz et al., 2001). Cognitive deficits are a major contributor to the functional and social impairment suffered by schizophrenic patients (Addington and Addington, 1999; Bell and Bryson, 2001; Hofer et al., 2005) and have been noted to have more of an impact on daily life than a patient's positive and negative symptoms (Green, 1996). Cognitive dysfunction in schizophrenia is generally associated with a poor outcome (Green et al., 2000; Bodnar et al., 2008), which has led to the development of cognition targeted treatments such as pharmacological agents, aided by the National Institute of Mental Health initiative entitled “measurement and treatment research to improve cognition in schizophrenia” (MATRICS; Marden and Fenton, 2004).
It has also been well documented that patients with schizophrenia have a specifically poor level of insight into their condition in comparison to other mental health disorders (Amador et al., 1994; Pini et al., 2001), affecting approximately 30–80% of patients (Amador and Gorman, 1998; Cuesta et al., 2000). Poor insight is again linked to poor clinical outcome and also contributes to compliance (Smith et al., 1999; Buckley et al., 2007). Medication non-compliance is estimated to be at a level of 42% in the schizophrenic population (Cramer and Rosenheck, 1998) and is associated with a wide range of adverse consequences such an increased risk of relapse (Fenton et al., 1997) and re-hospitalization (Weiden et al., 2004). If this lack of insight into the need for treatment extends to cognitive symptoms as well, then this will have a huge impact on how it is managed, and affect all stages of the process from referral, to monitoring progress, and assessing improvement.
One way to assess patient insight into their cognitive deficits is to use subjective scales, and since the first mention of these “basic symptoms” by Huber (1957), several such instruments have been developed and tested for validity with objective neuro-cognitive tests.
The subjective scale to investigate cognition in schizophrenia (SSTICS) was developed by our research center and published by Stip et al. (2003). The design aim was to develop a simple and ecological scale to assess patients’ subjective experiences of cognitive impairment as indicated from objective tests. The scale eventually consisted of 21 Likert-type questions set in the context of everyday activities and situations.
This review aims to give an up-to-date account of studies which have used scales of subjective cognitive deficits in schizophrenia alongside objective assessments of cognition. In accessing the degree of correlation between subjective and objective tests we focus on the question of whether schizophrenic patients are just as hindered in their insight into their cognitive dysfunction as in their illness overall. If indeed patient insight is less affected in the domain of cognition, therapies targeted in this area could theoretically increase compliance and thus patient outcome. Designers of clinical trials measuring the effectiveness of schizophrenia treatments in general may wish to incorporate measures of cognitive dysfunction into their study. And so, better understanding of the relationship between subjective and objective measures of cognitive dysfunction in schizophrenia will also serve to help guide the choice of clinical trial outcome measures.
Literature
A search within MEDLINE, psychINFO, and Web of Science using the criteria “subjective, cognition, schizophrenia” was performed. After filtering and cross-referencing, a total of 26 articles were found which used a scale to assess subjective cognitive dysfunction in schizophrenia patients and then compared scores to objective measures. The SSTICS was the most frequently used scale, being found in 10 of the 26 studies.
Findings
A total of 14 different scales that have been used to assess subjective cognitive dysfunction in schizophrenia patients were identified from the literature search and summarized in Table 1. Twelve of the scales were self-rated and two were interview based, seven were designed for patients with schizophrenia, one for patients with psychosis, one for those with known cognitive deficits, and five were designed for a non-specific patient group. Eleven scales covered more than one cognitive domain.
Table 1.
subjective scales to assess cognitive dysfunction.
| Scale name | Authors | Population | Design | Areas covered |
|---|---|---|---|---|
| Subjective scale to investigate cognition in schizophrenia (SSTICS) | Stip et al. (2003) | Schizophrenia patients | Self-rated 21 Likert-type questions | Memory, attention, executive function, praxia, language |
| Measure of insight into cognition-self-rated (MIC-SR) | Medalia et al. (2008) | Schizophrenia patients | Self-rated, 12 items rated on a scale of frequency 0–3 | Attention, memory, executive functioning |
| Measure of insight into cognition- clinician-rated (MIC-CR) | Medalia and Thysen (2008) | Schizophrenia patients | Interview, 12 questions, scale 1–5 | Attention, memory, executive functioning |
| Schizophrenia cognition rating scale (SCoRS) | Keefe et al. (2006) | Schizophrenia patients | Interview 18 items, 4 point scale. Three scores, generated from patient, informant and interviewer rating. | Attention, memory, reasoning and problem solving, working memory, language production, motor skills. |
| Subjective perception of attention improvement questionnaire (SPAIQ) | López-Luengo (2000) | Schizophrenia patients | Self-rated, 7 point Likert scale | Attention |
| Eppendorf schizophrenia inventory (ESI) | Mass (2000) | Schizophrenia patients | Self-rated, 138 items, 4 subscales, on a 4 point Likert scale | Attention and speech impairment (AS), ideas of reference (IR), auditory uncertainty (AU), deviant perception (DP). |
| Frankfurt complaint questionnaire (FCQ) | Süllwold (1977) | Schizophrenia patients | Self-rated, 98 yes/no questions | 10 subscales in four factors of: central cognitive disturbances, perception and motility, depressivity, internal and external overstimulation |
| Work-readiness cognitive screen (WCS) | Erlanger and Feldman (2002) | Populations with known or suspected cognitive dysfunction | Self-rated, web based, 10-point Likert scale, clinician-rated on 5 point scale | Vocational preferences, work values, self-confidence in attention, memory, working, and socializing. |
| Questionnaire for self-experienced deficits of attention (FEDA) | Zimmerman et al. (1991) | Non-specific | Self-rated, 76 items with 5 point Likert scale. | Attention-divided, selective memory-prospective, long term, forgetting medicines, remembering names. |
| Test of Attentional Style (TAS) | van den Bosch et al. (1993) | Non-specific | Self-report, 31 items, 5 subscales | Attention in everyday life-distractibility, overload, processing capacity, attentional control, conceptual control |
| Prospective and retrospective memory questionnaire (PRMQ) | Smith et al. (2000) | Non-specific | Self-rated, 16 items rated on a 5 point Likert scale. | Memory |
| Dysexecutive questionnaire (DEX) | Wilson et al. (1996) | Non-specific | Self-rated 20 items, rate the frequency of occurrence | Dysexecutive characteristics |
| Cognitive failures questionnaire (CFQ) | Broadbent et al. (1982) | Non-specific | Self-rated, 25 items, 5 point Likert scale | Daily cognitive failures such as forgetting names, confusing left and right. |
| Patient perception of functioning scale (PPFS) | Ehmann et al. (2007) | Psychotic patients | Self-rated, six items on a 5 point Likert scale | Concentration, conversational ability, thinking clearly, handling money, carrying out everyday tasks, memory |
A summary of the 26 studies using these scales and comparing results to objective cognitive tests is presented in Table 2. The results are unclear, with 12 of the 26 studies lending support to the idea that insight into cognitive deficits in schizophrenia is intact, whereas 14 suggest that cognition is no different from other schizophrenia symptoms in terms of insight. In the four cases where a scale was used in more than one study, all verdicts pointed in the same direction for two scales, but four of the 10 studies with the SSTICS differed in their conclusions, and one of three did with the FCQ.
Table 2.
subjective scales of cognitive dysfunction in schizophrenia and comparison with objective tests.
| Authors | Schizophrenia patients | Scale | Objective tests | Correlation |
|---|---|---|---|---|
| Medalia et al. (2008) | 71 schizophrenic in and outpatients, 43 healthy controls, USA | MIC-SR | BACS | No correlation |
| Medalia and Thysen (2008) | 75 schizophrenic in and outpatients, USA | MIC-CR | BACS | No correlation between subsets or total score |
| Medalia and Thysen (2010) | 71 schizophrenic in and outpatients, USA | MIC-CR | BACS | No correlation between subsets or total score |
| Medalia and Lim, (2004) | 185 schizophrenia/schizoaffective outpatients, USA | WCS | WCS | Correlation between the clients’ ratings of their cognition and the WCS objective scores were only significant on verbal memory (rho = 0.15, p < 0.05) |
| Keefe et al. (2006) | 60 schizophrenic inpatients, USA | SCoRS | BACS | No correlation with patients’ awareness |
| Ehman et al. (2007) | 60 psychotic patients-inpatients, outpatients and a specialized residential care facility, Canada | PPFS | WMS, COWAT, TMT | No correlation with total score (item on ability to carry out conversations correlated with paragraph recall test, r = −0.22, p < 0.05) |
| Mass (2000) | 114 schizophrenic in and outpatients, Germany | ESI | CPT, SAT, RT | Correlation first episode patients with all subscales and CPT response bias (ESI-AS r = −0.28, p < 0.1, ESI-IR r = −0.43, p < 0.01, ESI-AU r = −0.43, p < 0.01, ESI-DP r = −0.35, p < 0.05) and SAT eight letter condition left visual field. (ESI-AS r = −0.28, p < 0.1, ESI-IR r = −0.29, p < 0.1, ESI-AU r = −0.48, p < 0.001, ESI-DP r = −0.30, p < 0.01) no correlation for negative symptom group |
| Mass et al. (2005) | 100 schizophrenic inpatients, Germany | ESI | CPT, WCST, TMT, digit symbol and digit span from WAIS-R, NSS scale, VF | Correlation only in recent onset schizophrenia, strongest for verbal fluency (ESI-AS r = −0.34, p < 0.05, ESI-AU r = −0.48, p < 0.01, ESI-IR r = −0.57, p < 0.001, ESI-DP r = −0.47, p < 0.01), TMT-part B (ESI-AS r = 0.20, p > 0.1, ESI-AU r = 0.42, p < 0.01, ESI-IR r = 0.45, p < 0.01, ESI-DP r = 0.38, p < 0.01) and non-perseverative errors on WCST (ESI-AS r = 0.24, p > 0.1, ESI-AU r = 0.44, p < 0.01, ESI-IR r = 0.37, p < 0.05, ESI-DP r = 0.42, p < 0.01) |
| Moritz et al. (2004) | 53 schizophrenia spectrum disorder inpatients, Germany | FEDA | AVLT, RBMT, test d2, TAP, TMT | No correlation |
| López-Luengo and Vásquez (2005) | 24 schizophrenic outpatients, Spain | SPAIQ | CPT, TMT, PASAT | No correlation with percentage improvement of each task and SPAIQ score |
| Chan et al. (2008) | 36 schizophrenic inpatients, 34 schizoptypic college students, 28 healthy controls, China | PRMQDEX | PMT, WMS-R, WCST | No correlation |
| van den Bosch and Rombouts (1998) | 21 schizophrenic inpatients, Netherlands | TAS | CPT | No correlation |
| van den Bosch and Rozendaal (1998) | 21 Schizophrenic and schizoaffective psychotic inpatients, Netherlands | FCQ | Eye tracking (SPEM), CNV-Fz and Cz, RT | Correlation in recovery phase but not during the psychotic episodes (SPEM r = 0.66, p < 0.01, CNV-Fz r = 0.53, p < 0.01, CNV-(Fz-Cz) r = 0.44, p < 0.05, RT r = 0.58, p < 0.01) |
| Cuesta et al. (1996) | 32 schizophrenic inpatients, Spain | FCQ | Edinburg test, MMS, WAIS, TMT, RCF, Bender's visual-motor test, neurological signs | Correlation, after Bonferroni correction of WAIS (vocabulary r = 0.67, p ≤ 0.001, digit span r = 0.60, p ≤ 0.01, block design r = 0.74, p ≤ 0.001), Bender's test r = 0.43, p ≤ 0.05, RCF-copy r = 0.51, p ≤ 0.01, and TMT form A r = 0.72, p ≤ 0.001, B r = 0.77, p ≤ 0.001. |
| Williams et al. (1984) | 24 schizophrenic inpatients, UK | FCQ | WAIS, RT and CRT Tasks | No correlation |
| Donohoe et al. (2009) | 51 schizophrenic outpatients, UK | CFQ | WAIS-III, WMS-III, CANTAB | Correlation (p < 0.05) for patients with intact insight with several tests of general cog and episodic memory function (WTAR r = −0.48, WAIS vocabulary r = −0.41, WMS logical memory I r = -0.45, WMS Logical Memory II r = −0.37, WMS faces I r = 0.39, WMS faces II r = 0.42) no correlation for patients with impaired clinical insight |
| Johnson et al. (2009) | 105 schizophrenic outpatients, Tunisia | SSTICS (SACCS) | PANSS | No correlation with total score and the cognitive five factor model of PANSS |
| Johnson et al. (2011) | 104 schizophrenic outpatients, Tunisia | SSTICS (SACCS) | The tunisian cognitive battery for patients with schizophrenia | No correlation |
| Zhornitsky et al. (2011) | 81, schizophrenia, schizoaffective or schizophreniform disorder outpatients | SSTICS | CANTAB | No correlation |
| Chouinard et al. (2003) | 27 schizophrenic outpatients, Canada | SSTICS | RBANS | No correlation |
| Prouteau et al. (2004) | 73 schizophrenic outpatients, Canada | SSTICS | CANTAB visuo-spatial tests | Correlation for attention section of SSTICS with explicit memory (B = −2.61, Rp = −0.31, p = 0.01) and planning tasks (B = −2.31, Rp = −0.27, p = 0.02) and executive functioning section with the explicit memory task (B = −3.23, Rp = −0.37, p = 0.002) |
| Potvin et al. (2005) | 76 schizophrenic or schizoaffective outpatients, Canada | SSTICS | CANTAB | Correlation in two stages of paired associates learning task (r = −0.372, p = 0.017 and r = −0.361, p = 0.02) |
| Hake et al. (2007) | 20 schizophrenic or schizoaffective outpatients, USA | SSTICS | WCST | Correlation with non-learners group had highest executive functioning scores on SSTICS $t (df = 18) = 2.29, p = 0.03$$ |
| Lecardeur et al. (2009) | 176 schizophrenia, schizoaffective or delusional disorder outpatients, Canada | SSTICS | Cognition section of PANSS | Correlation (r = 0.338, p = 0.004) |
| Stip et al. (2003) | 114, schizophrenia, schizophreniform, schizoaffective outpatients, Canada | SSTICS | COWAT, RAVLT, TMT | Correlation with explicit memory measure (r = −0.224, p = 0.0009) |
| Bengochea Seco et al. (2010) | 46 schizophrenic outpatients, Spain | SSTICS | Cognitive factor component of PANSS. barcelona battery | Correlation with barcelona battery subtests and SSTICS daily living factor (r = 0.612; p < 0.05) and SSTICS total score with 3 subtests-(direct digits r = −0.385, p < 0.05, “P”-words r = −0.325, p < 0.01, Key numbers r = −0.346, p < 0.01) no correlation which PANSS |
AVLT, auditory verbal learning test; BACS, brief assessment of cognition in schizophrenia; BVMT, Bender's visual-motor test; CANTAB, Cambridge neuropsychological test automated battery; CNV-Fz, contingent negative variation-frontal midline position; CNV Cz, contingent negative variation, central midline position; COWAT, controlled oral word association test; CPT, continuous performance task; CRT, choice reaction time; MMS, mini-mental state; NSS Scale, neurological soft signs scale; PASAT, paced auditory serial addition task; PMT, prospective memory tasks; RAVLT, Rey auditory verbal learning test; RBANS, repeatable battery for assessment of neuropsychological status; RBMT, rivermead behavioral memory test; RCF, Rey's complex figure; RT, reaction time; SACCS, self-assessment scale of cognitive complaints in schizophrenia, now called the SSTICS tunisian arabic version (SSTICS_tun_arab); SAT, span of apprehension task; SPEM, smooth pursuit eye movements; TAP, test battery for the assessment of attentional dysfunction; TMT, trail making test; VF, verbal fluency; WAIS, Wechsler adult intelligence scale; WAIS-III, Wechsler adult intelligence scale, 3rd edition; WAIS-R, Wechsler adult intelligence scale, revised; WCS, work-readiness cognitive screen; WCST, Wisconsin card-sorting test; WMS-III, Wechsler memory scale 3rd edition; WTAR, Wechsler test of adult reading.
Overall, a wide variety of objective tests of cognition were used to compare against subjective scores, ranging from using the cognitive question on the positive and negative symptom scale interview (PANSS; Kay et al., 1987) to the pencil and paper brief assessment of cognition in schizophrenia (BACS; Keefe et al., 2004) and computer based neuropsychological batteries such as Cambridge neuropsychological test automated battery (CANTAB; Fray et al., 1996).
Conclusion
The aim of this paper was to review the literature on the use of subjective scales to assess cognitive deficits in schizophrenia and to see if these scales could predict results on objective tests. Overall, the findings were inconclusive, with approximately half of the studies supporting the hypothesis and half not. The individual scales however did yield the same outcome in half of the cases where the same scale was used more than once, although this is difficult to interpret due to a small number of studies, except the SSTICS which was used in 10 studies on this topic and showed a correlation with subjective and objective measures of cognitive deficit in six of these.
A number of the studies also included rater and clinician scores of the patient's cognitive dysfunction, and interestingly it seems that as well as the inconclusive findings about the patients’ ability to correctly estimate their level of cognitive impairment, the ability of raters and clinician to do this is also variable. Keefe et al. (2006) found that the interviewer score on the SCoRS was correlated to objective tests, even though the informant and patient scores were not. However Moritz et al. (2004) found that in 20–40% of cases, clinicians rated the patient's memory as normal even though they had significant impairment. López-Luengo and Vázquez (2005) found that there was no significant difference in the scores given by patients and raters on the SPAIQ, and Medalia et al. (2008) saw no difference in schizophrenic patients’ and healthy controls’ total scores. In Chan et al. (2008) study, neither schizophrenic and schizotypy patients nor healthy controls had subjective cognitive dysfunction scores that correlated with objective results. Indeed Hermann (1982) found that self-rated memory questionnaires given to healthy subjects in the general population bare little relation to actual memory ability. Therefore it seems that lack of insight into cognitive deficits is not just a schizophrenia-specific phenomenon.
Several of the studies reviewed here also included a measure of insight into general illness, as well as investigating cognitive insight by comparing subjective scores to objective tests. Five of the studies on the SSTICS (Chouinard et al., 2003; Stip et al., 2003; Lecardeur et al., 2009; Bengochea Seco et al., 2010; Johnson et al., 2011) looked at the relationship between SSTICS total scores and insight by use of the scale to assess unawareness of mental disorder (SUMD; Amador and Strauss, 1990), or the insight question on the PANSS (Kay et al., 1987), but no significant correlations were found. Medalia et al. (2008) found no correlation between MIC-SR score and the PANSS question on insight and Medalia and Thysen (2008) found that half of the patients in their study using the MIC-CR had no awareness of their cognitive deficit and 39% of those that did have some awareness were not able to attribute this to mental illness. In Medalia and Thysen (2010) found that 70% of patients had full insight into their clinical symptoms, whereas only 27% had full insight into their cognitive symptoms, coming to the conclusion that the issue of insight in schizophrenia is not a unitary concept.
Indeed, Osatuke et al. (2008) point out in their review on the topic of insight in schizophrenia that the issue is far from straight forward. In terms of definition, research suggests that it should be regarded as a continuum, rather than something that a patient either does or does not have (Markova and Berios, 1995). It is also multidimensional, meaning that patients can have awareness of not just the presence of an illness, but also the consequences and need for treatment (Amador and David, 1998). And to further complicate the matter, insight has been recognized to vary within an individual in terms of different clinical aspects of the illness (Peralta and Cuesta, 1994) and even along the course of the disease (Kemp and Lambert, 1995). The reviewers also discuss the many proposed aetiological models of insight in schizophrenia such as it being a defense mechanism, or included as a positive or even negative symptom. They also touch on theories surrounding, neuro-cognitive deficits as well as an impairment of metacognition, or in other words, the ability to think about thinking, both in terms of oneself and others.
Proponents of the theory that neuro-cognitive deficits play a central role in the lack of insight into illness in schizophrenia, focus particularly on frontal and parietal dysfunction (David, 1999). Indeed there have been associations with the Wisconsin card-sorting test and poor insight (Young et al., 2003) and Drake and Lewis (2003) showed that perseveration was strongly linked to poor insight. Smith et al. (2000) found that symptom misattribution was correlated with card-sorting measures of frontal lobe function although symptom unawareness was largely unrelated to neuro-cognitive functioning, which led them to conclude that insight in schizophrenia is a multidimensional construct. McEvoy et al. (1996) found that the insight and treatment attitudes questionnaire (ITAQ) score was significantly correlated to only one of nine measures of performance on neuro-cognitive tasks, and Medalia and Thysen (2010) found that only performance on the BACS Tower of London Task was correlated with clinical insight. In addition, Donohoe et al. (2009) found that although subjective and objective tests of cognitive dysfunction only correlated in the patients with intact clinical insight, just 33% of those with poor clinical insight also had poor cognitive insight, again indicating that these two types of insight are fundamentally different in their nature.
In an attempt to clarify this idea that insight into cognitive dysfunction could be distinct from overall insight into schizophrenia, the term “schizoanosognosia” was coined by Stip (2006). Anosognosia derives from the Greek words for disease (nosos) and knowledge (gnosis) and is a term similar in definition to insight and originally used to describe patients with prefrontal cortical damage. Patients with prefrontal lesions typically display less concern and a lack of regulation and control of their behavior, leading to abnormalities in self-awareness. Indeed Langevin and Legal (1999) drew a parallel with frontal lobe dysfunction and schizophrenia in terms of metacognition and we can postulate that it is a malfunction of the control function of the metacognitive system as described by Frith (1992) that can lead to a lack of self-awareness about a cognitive dysfunction, distinct from the traditional, and less specific term of insight.
A number of studies have used the metacognition assessment scale (MAS; Semerari et al., 2003) to further understand the relationship between metacognition, neurocognition, and insight. Lysaker et al. (2008) found links with the MAS and an executive function tool, and Lysaker et al. (2011) demonstrated significant links with the SUMD insight scale. Lysaker et al. (2005) saw that understanding of one's own mind correlated with better neuro-cognitive functioning across a number of domains, especially verbal memory, as well as being associated with less emotional withdrawal in the form of a greater depressed mood. This highlights a potential disadvantage of having greater metacognitive and neuro-cognitive function, in that patients experience the pain of having their illness to a greater degree. However, the complexity of the situation is revealed in that although better metacognition is linked with improved treatment outcomes (Roncone et al., 2002), it is also linked with more depression as mentioned above, where Sands and Harrow (1999) found that having a co-morbid diagnosis of depression with schizophrenia leads to an overall poorer patient outcome.
Limitations
One of the major limitations of this review is the heterogeneity in the target population, style, length, and cognitive areas covered by the scales used to assess subjective cognitive dysfunction in schizophrenia. There is also a bias in the numbers of studies using the SSTICS and several also have small sample sizes, which all together limit their reliability and ability for generalization. The argument of ecological validity of objective cognition tests must also be considered, as the laboratory settings and tests are very different from the day to day environment of the patient. In addition, the psychometric properties of the subjective measures should be questioned as the reliability and validity of each scale is not always known and these limitations can in turn give a false impression of the actual links between subjective and objective measures of cognitive dysfunction in schizophrenia.
There is also the issue of patient populations differing between studies, for example in medications, chronicity of illness, inpatients or outpatients, and the country where the study was conducted, which could all generate potential confounding factors. Another limitation is the unequal distribution and a general lack of focus on the gender of patients. It is well established that there are a number differences in male and female schizophrenic patients, such as symptomatology (Hafner, 2003), where males generally have more negative symptoms and females display more affective symptoms. There are also differences in IQ (Flor-Henry, 1985) and brain anatomy (Goldstein et al., 2001) and even insight into clinical symptoms (Grossman et al., 2008), which could also have an effect on cognition and the subjective perception of dysfunction in this area. Indeed Cuesta et al. (1996) did find that female patients had significantly higher complaint scores on the FCQ, however it must be noted that there were only six females from a small sample of just 32 patients. Similar under representation of females is seen in most of the other studies in this review, with only van den Bosch and Rombouts (1998) having an equal number of males and females in their study.
Another potential limitation of this review is that within studies, results from objective and subjective tests of cognitive dysfunction were not compared in a domain specific fashion. This generalizes the findings from the subjective and objective tests and may have lead to a masking of associations in particular areas. In a number of papers, this information was simply not included, and the importance of this is demonstrated by results from the SSTICS in particular, which suggest that the relationship between subdivisions of cognition on subjective scales and their corresponding areas on objective tests is not necessarily straight forward. Stip et al. (2003) pointed out that in the cognitive domain of memory; only the global SSTICS score was reliable. In addition, Prouteau et al. (2004) found that although there was no correlation with objective memory dysfunction and memory complaints, the former was correlated with attention complaints and objective executive functioning scores, and that subjective complaints of executive functioning were correlated with objective memory scores.
This discrepancy between the cognitive performance of executive functioning and the subject's perception of it, could suggest a malfunction of the control function of the metacognitive system. Indeed, the same function of “control” that allows good planning. The discrepancy between perception of memory deficits and objective memory scores, also suggests a dysfunction of the monitoring process that informs the metacognitive system on the state of the cognitive system.
The gap between objective and the subjective cognitive constructs could be the long term result of a malfunction in bottom-up monitoring which collects information on cognitive tasks in order to supply and enrich the “model” of the cognitive system contained in the metacognitive system. In fact Stip et al. (2003) noted that factorial grouping based on the responses of patients with schizophrenia differed from that worked out from cognitive neuropsychology models. Thus, elements usually placed in the field of memory, could find themselves in that of attention, according to patient perceptions.
Further Research
Due to the aforementioned correlation with poor insight, the potential for aiding medication compliance and thus overall patient outcome is immense if there is indeed greater insight of cognitive impairments in schizophrenia compared to the other domains of insight into this illness. We can imagine that adherence to the recent developments in cognitive enhancing pharmacological and psychological treatments may also suffer from poor insight, but before more is known on the complex issue of insight in schizophrenia, it is reassuring to learn that Medalia et al. (2009) found that patients who participated in a short psycho-educational therapy called Brain check that taught them about cognitive dysfunction in mental illness, had more self-awareness about their own cognitive deficits than those who had not participated.
This review demonstrates that current knowledge on this subject is inconclusive and that at present there is no consensus on a reliable method to be used to identify schizophrenic patients most in need of cognitive therapies, apart from sometimes lengthy and costly objective tests of cognition. Further research could be directed toward initially ensuring and improving the reliability and validity of current subjective tests of cognitive dysfunction in schizophrenia to limit the times that that null hypotheses are being reached for methodological reasons alone. Looking at specific cognitive domains being tested with the subjective and objective measures could help reveal currently unnoticed associations and also explore the aforementioned discrepancies when comparisons are made. Generalizability would be increased with larger population sizes and more equal numbers of males and females. Longitudinal studies could additionally address the issue of changes in insight being affected by clinical course.
Better understanding of this important and difficult to tackle area of cognitive insight in schizophrenia is eagerly awaited. In doing so, benefits for patient outcome are readily anticipated, through better comprehension and management by medical practitioners as well as improved clinical trial effectiveness by the inclusion of cognitive dysfunction measures to recognize successful treatments for this frequently debilitating disease.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
- Addington J., Addington D. (1999). Neurocognitive and social functioning in schizophrenia. Schizophr. Bull. 25, 173–182 [DOI] [PubMed] [Google Scholar]
- Amador X. F., David A. S. (1998). Insight and Psychosis New York: Oxford University Press [Google Scholar]
- Amador X. F., Gorman J. (1998). Psychopathologic domains and insight in schizophrenia. Psychiatr. Clin. North Am. 21, 27–42 10.1016/S0193-953X(05)70359-2 [DOI] [PubMed] [Google Scholar]
- Amador X. F., Strauss D. H. (1990). The Scale to Assess Unawareness of Mental Disorder New York Psychiatric Institute, Columbia University, New York [Google Scholar]
- Amador X. F., Flaum M., Andreasen N. C., Strauss D. H., Yale S. A., Clark S., Gorman J. M. (1994). Awareness of illness in schizophrenia, schizoaffective, and mood disorders. Arch. Gen. Psychiatry 51, 826–836 [DOI] [PubMed] [Google Scholar]
- Bell M. D., Bryson G. (2001). Work rehabilitation in schizophrenia: does cognitive impairment limit improvement? Schizophr. Bull. 27, 269–279 [DOI] [PubMed] [Google Scholar]
- Bengochea Seco R., Gil Sanz D., Fernández Modamio M. (2010). Cognitive complaints in schizophrenia: relationship with insight and other cognitive measures. Rev. Psiquiatr. Salud Men.(Barc.) 3, 55–60 10.1016/j.rpsm.2010.03.002 [DOI] [PubMed] [Google Scholar]
- Bodnar M., Malla A., Joober R., Lepage M. (2008). Cognitive markers of short-term clinical outcome in first-episode psychosis. Br. J. Psychiatry 193, 297–304 10.1192/bjp.bp.107.040410 [DOI] [PubMed] [Google Scholar]
- Broadbent D. E., Cooper P. F., FitzGerald P., Parkes K. R. (1982). The cognitive failures questionnaire (CFQ) and its correlates. Br. J. Clin. Psychol. 21(Pt 1), 1–16 [DOI] [PubMed] [Google Scholar]
- Buckley P. F., Wirshing D. A., Bhushan P., Pierre J. M., Resnick S. A., Wirshing W. C. (2007). Lack of insight in schizophrenia: impact on treatment adherence. CNS Drugs 21, 129–141 10.2165/00023210-200721020-00004 [DOI] [PubMed] [Google Scholar]
- Chan R., Wang Y., Ma Z., Hong X., Yuan Y., Yu X., Li Z., Shum D., Gong Q. (2008). Objective measures of prospective memory do not correlate with subjective complaints in schizophrenia. Schizophr. Res. 103, 229–239 10.1016/j.schres.2008.02.019 [DOI] [PubMed] [Google Scholar]
- Chouinard S., Stip E., Comtois G., Corbière M., Bolé P., Lamontagne L., Lecavalier M., Beauregard F. (2003). Retour à l'école de jeunes patients souffrant de troubles mentaux graves: premier regard sur un projet pilote montréalais. Sante Ment. Que. 28, 273–290 [PubMed] [Google Scholar]
- Cramer J. A., Rosenheck R. (1998). Compliance with medication regimens for mental and physical disorders. Psychiatr. Serv. 49, 196–201 [DOI] [PubMed] [Google Scholar]
- Cuesta M. J., Peralta V., Zarzuela A. (2000). Reappraising insight in psychosis: multi-scale longitudinal study. Br. J. Psychiatry 177, 233–240 10.1192/bjp.177.3.233 [DOI] [PubMed] [Google Scholar]
- Cuesta M. J., Peralta V., Juan J. A. (1996). Abnormal subjective experiences in schizophrenia: its relationships with neuropsychological disturbances and frontal signs. Eur. Arch. Psychiatry Clin. Neurosci. 246, 101–105 10.1007/BF02274900 [DOI] [PubMed] [Google Scholar]
- David A. S. (1999). “To see oursels as others see us”. Aubrey Lewis's insight. Br. J. Psychiatry 175, 210–216 10.1192/bjp.175.3.210 [DOI] [PubMed] [Google Scholar]
- Donohoe G., Hayden J., McGladen N., O'Gráda C., Burke T., Barry S., Behan C., Dinan T. G., O'Callaghan E., Gill M., Corvin A. P. (2009). Is “clinical” insight the same as “cognitive” insight in schizophrenia? J. Int. Neuropsychol. Soc. 15, 471–475 10.1017/S1355617709090559 [DOI] [PubMed] [Google Scholar]
- Drake R. J., Lewis S. W. (2003). Insight and neurocognition in schizophrenia. Schizophr. Res. 62, 165–173 10.1016/S0920-9964(02)00382-1 [DOI] [PubMed] [Google Scholar]
- Ehmann T. S., Goldman R., Yager J., Xu Y., MacEwan G. W. (2007). Self-reported cognitive and everyday functioning in persons with psychosis: the patient perception of functioning scale. Compr. Psychiatry 48, 597–604 10.1016/j.comppsych.2007.05.017 [DOI] [PubMed] [Google Scholar]
- Erlanger D. M., Feldman D. J. (2002). Headminderk Work-Readiness Cognitive ScreenSM (WCS) Professional Manual. New York: Headminder, Inc. and Pan Medix, Inc. [Google Scholar]
- Fenton W. S., Blyer C., Heinssen R. K. (1997). Determinants of medication compliance in schizophrenia: empirical and clinical findings. Schizophr. Bull. 23, 637–651 [DOI] [PubMed] [Google Scholar]
- Fioravanti M., Carlone O., Vitale B., Cinti M. E., Clare L. (2005). A meta-analysis of cognitive deficits in adults with a diagnosis of schizophrenia. Neuropsychol. Rev. 15, 73–95 10.1007/s11065-005-6254-9 [DOI] [PubMed] [Google Scholar]
- Flor-Henry P. (1985). Schizophrenia: sex differences. Can. J. Psychiatry 30, 319–322 [DOI] [PubMed] [Google Scholar]
- Fray P. J., Robbins T., Sahakian B. J. (1996). Neuropsychiatric applications of CANTAB. Int. J. Geriatr. Psychiatry 11, 329–336 10.1002/(SICI)1099-1166(199604)11:4<329::AID-GPS453>3.0.CO;2-6 [DOI] [Google Scholar]
- Frith C. D. (1992). The Cognitive Neuropsychology of Schizophrenia Hove: Erlbaum, 113–132 [Google Scholar]
- Gold J. M., Harvey P. D. (1993). Cognitive deficits in schizophrenia. Psychiatr. Clin. North Am. 16, 295–312 [PubMed] [Google Scholar]
- Goldberg T. E., Kelsoe J. R., Weinberger D. R., Pilskin N. H., Kirwin P. D., Berman K. F. (1988). Performance of schizophrenic patients on putative neuropsychological tests of frontal lobe function. Int. J. Neurosci. 42, 51–58 10.3109/00207458808985758 [DOI] [PubMed] [Google Scholar]
- Goldstein J. M., Seidman L., Horton N. J., Makris N., Kennedy D. N., Caviness V. S., Jr, Faraone S. V., Tsuang M. T. (2001). Normal sexual dimorphism of the adult human brain assessed by in vivo magnetic resonance imaging. Cereb. Cortex 11, 490–497 10.1093/cercor/11.6.490 [DOI] [PubMed] [Google Scholar]
- Green M. F. (1996). What are the functional consequences of neurocognitive deficits in schizophrenia? Am. J. Psychiatry 153, 321–330 [DOI] [PubMed] [Google Scholar]
- Green M. F., Kern R. S., Braff D. L., Mintz J. (2000). Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the “right stuff.” Schizophr. Bull. 26, 119–136 [DOI] [PubMed] [Google Scholar]
- Grossman L. S., Harrow M., Rosen C., Faull R., Strauss G. P. (2008). Sex differences in schizophrenia and other psychotic disorders: a 20-year longitudinal study of psychosis and recovery. Compr. Psychiatry 49, 523–529 10.1016/j.comppsych.2008.03.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hafner H. (2003). Gender differences in schizophrenia. Psychoneuroendocrinology 2, 17–54 10.1016/S0306-4530(02)00125-7 [DOI] [PubMed] [Google Scholar]
- Hake D. L., Hamera E., Rempfer M. (2007). Self-report of cognitive functioning and learning in schizophrenia. J. Am. Psychiatr. Nurses Assoc. 13, 93–100 10.1177/1078390307303111 [DOI] [Google Scholar]
- Heinrichs R. W., Zakzanis K. K. (1998). Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. Neuropsychology 12, 426–445 10.1037/0894-4105.12.3.426 [DOI] [PubMed] [Google Scholar]
- Hermann D. J. (1982). Know thy memory: the use of questionnaires to assess and study memory. Psychol. Bull. 92, 434–452 10.1037/0033-2909.92.2.434 [DOI] [Google Scholar]
- Hofer A., Baumgartner S., Bodner T., Edlinger M., Hummer M., Kemmler G., Rettenbacher M., Fleischhacker W. (2005). Patient outcomes in schizophrenia II: the impact of cognition. Eur. Psychiatry 20, 395–402 10.1016/j.eurpsy.2005.02.005 [DOI] [PubMed] [Google Scholar]
- Huber G. (1957). Pneumenzepha-lographische und psychopathologische bilder bei endogenen psychosen. Berlin: Springer. [Google Scholar]
- Johnson I., Kebir O., Ben Azouz O., Dellagi L., Rabah Y., Tabbane K. (2009). The self-assessment scale of cognitive complaints in schizophrenia: a validation study in Tunisian population. BMC Psychiatry 9, 66. 10.1186/1471-244X-9-66 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson I., Tabbane K., Dellagi L., Kebir O. (2011). Self-perceived cognitive functioning does not correlate with objective measures of cognition in schizophrenia. Compr. Psychiatry. 10.1016/j.comppsych.2010.12.008 [DOI] [PubMed] [Google Scholar]
- Kay S. R., Fitzbein A., Opler L. A. (1987). The positive and negative symptom scale (PANSS) for schizophrenia. Schizophr. Bull. 13, 261–267 [DOI] [PubMed] [Google Scholar]
- Keefe R. S. E., Goldberg T., Harvey P. D., Gold J. M., Poe M., Coughenour L. (2004). The brief assessment of cognition in schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery. Schizophr. Res. 68, 283–297 10.1016/j.schres.2003.09.011 [DOI] [PubMed] [Google Scholar]
- Keefe R. S. E., Poe M., Walker T., Kang J., Harvey P. (2006). The schizophrenia cognition rating scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. Am. J. Psychiatry 163, 426–432 10.1176/appi.ajp.163.3.426 [DOI] [PubMed] [Google Scholar]
- Kemp R. A., Lambert T. J. R. (1995). Insight in schizophrenia and its relationship to psychopathology. Schizophr. Res. 18, 21–28 10.1016/0920-9964(95)00018-6 [DOI] [PubMed] [Google Scholar]
- Langevin P., Legal D. (1999). “L'agnosognosie secondaire à une atteinte frontale,” in Neuropsychologie des lobes frontaux eds Van der Linden M., Seron X. (Marseilles: Solal; ), 289–308 [Google Scholar]
- Lecardeur L., Briand C., Prouteau A., Lalonde L., Nicole L., Lesage A., Stip E. (2009). Preserved awareness of their cognitive deficits in patients with schizophrenia: convergent validity of the SSTICS. Schizophr. Res. 107, 303–306 10.1016/j.schres.2008.09.003 [DOI] [PubMed] [Google Scholar]
- López-Luengo B. (2000). Rehabilitación cognitiva en esquizofrenia: aplicación del APT (Attention Process Training). Doctoral dissertation, Complutense University of Madrid, Spain [Google Scholar]
- López-Luengo B., Vázquez C. (2005). Effects of a neuropsychological rehabilitation programme on schizophrenic patients’ subjective perception of improvement. Neuropsychol. Rehabil. 15, 605–618 10.1080/09602010443000146 [DOI] [PubMed] [Google Scholar]
- Lysaker P. H., Carcione A., Dimaggio G., Johannesen J. K., Nicol G., Procacci M., Semerari A. (2005). Metacognition amidst narratives of self and illness in schizophrenia: associations with neurocognition, symptoms, insight and quality of life. Acta Psychiatr. Scand. 112, 64–71 10.1111/j.1600-0447.2005.00514.x [DOI] [PubMed] [Google Scholar]
- Lysaker P. H., Dimaggio G., Buck K. D., Callaway S. S., Salvatore G., Carcione A., Nicolò G., Stanghellini G. (2011). Poor insight in schizophrenia: links between different forms of metacognition with awareness of symptoms, treatment need, and consequences of illness. Compr. Psychiatry 52, 253–260 10.1016/j.comppsych.2010.07.007 [DOI] [PubMed] [Google Scholar]
- Lysaker P. H., Warman D. M., Dimaggio G., Procacci M., LaRocco V. A., Clark L. K., Dike C. A., Nicolo G. (2008). Metacognition in Schizophrenia: associations with multiple assessments of executive function. J. Nerv. Ment. Dis. 196, 384–389 10.1097/NMD.0b013e3181710916 [DOI] [PubMed] [Google Scholar]
- Marden S. R., Fenton W. (2004). Measurement and treatment research to improve cognition in schizophrenia: NIMH MATRICS initiative to support the development of agents for improving cognition in schizophrenia. Schizophr. Res. 72, 5–9 10.1016/j.schres.2004.09.010 [DOI] [PubMed] [Google Scholar]
- Markova I. S., Berios G. E. (1995). Insight in clinical psychiatry. J. Nerv. Ment. Dis. 183, 743–751 10.1097/00005053-199512000-00003 [DOI] [PubMed] [Google Scholar]
- Mass R. (2000). Characteristic subjective experiences of schizophrenia. Schizophr. Bull. 26, 921–931 [DOI] [PubMed] [Google Scholar]
- Mass R. T., Haasen C., Borgart E. J. (2005). Abnormal subjective experiences of schizophrenia: evaluation of the Eppendorf schizophrenia inventory. Compr. Psychiatry 135, 91–101 [DOI] [PubMed] [Google Scholar]
- McEvoy J. P., Hartman M., Gottlieb D., Godwin S., Apperson L. J., Wilson W. (1996). Common sense, insight, and neuropsychological test performance in schizophrenia patients. Schizophr. Bull. 22, 635–641 [DOI] [PubMed] [Google Scholar]
- Medalia A., Choi J., Schwalbe E., King E. (2009). Efficacy of a brief intervention to improve awareness of neurocognitive deficit in schizophrenia. Schizophr. Bull. 35, 351 [Google Scholar]
- Medalia A., Lim R. (2004). Self-awareness of cognitive functioning in schizophrenia. Schizophr. Res. 71, 31–338 10.1016/j.schres.2004.03.003 [DOI] [PubMed] [Google Scholar]
- Medalia A., Thysen J. (2008). Insight into neuro-cognitive dysfunction in schizophrenia. Schizophr. Bull. 34, 1221–1230 10.1093/schbul/sbm144 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medalia A., Thysen J. (2010). A comparison of insight into clinical symptoms versus insight into neuro-cognitive symptoms in schizophrenia. Schizophr. Res. 118, 134–139 10.1016/j.schres.2009.09.027 [DOI] [PubMed] [Google Scholar]
- Medalia A., Thysen J., Freilich B. (2008). Do people with schizophrenia who have objective cognitive impairment identify cognitive deficits on a self report measure? Schizophr. Res. 105, 156–164 10.1016/j.schres.2008.07.007 [DOI] [PubMed] [Google Scholar]
- Moritz S., Ferahli S., Naber D. (2004). Memory and attention performance in psychiatric patients: lack of correspondence between clinician-rated and patient-rated functioning with neuropsychological test results. J. Int. Neuropsychol. Soc. 10, 623–633 10.1017/S1355617704107042 [DOI] [PubMed] [Google Scholar]
- Moritz S., Lambert M., Andresen B., Bothern A., Naber D., Krausz M. (2001). Subjective cognitive dysfunction in first-episode and chronic schizophrenic patients. Compr. Psychiatry 42, 213–216 10.1053/comp.2001.23144 [DOI] [PubMed] [Google Scholar]
- O'Carroll R. E. (1992). Neuropsychology of psychosis. Curr. Opin. Psychiatry 5, 38–44 10.1097/00001504-199202000-00009 [DOI] [Google Scholar]
- Osatuke K., Ciesla J., Kasckow J. W., Zisook S., Mohamed S. (2008). Insight in schizophrenia: a review of etiological models and supporting research. Compr. Psychiatry 49, 70–77 10.1016/j.comppsych.2007.08.001 [DOI] [PubMed] [Google Scholar]
- Peralta V., Cuesta M. J. (1994). Lack of insight: its status within schizophrenic psychopathology. Biol. Psychiatry 36, 559–561 10.1016/0006-3223(94)90083-3 [DOI] [PubMed] [Google Scholar]
- Pini S., Cassano G., Dell'Osso L., Amador X. (2001). Insight into illness in schizophrenia, schizoaffective disorder, and mood disorders with psychotic features. Am. J. Psychiatry 158, 122–125 10.1176/appi.ajp.158.1.122 [DOI] [PubMed] [Google Scholar]
- Potvin S., Briand C., Prouteau A., Bouchard R.-H., Lipp O., Laldone P., Nicole L., Lesage A., Stip E. (2005). CANTAB explicit memory is less impaired in addicted schizophrenia patients. Brain Cogn. 59, 38–42 10.1016/j.bandc.2005.04.002 [DOI] [PubMed] [Google Scholar]
- Prouteau A., Verdoux H., Briand C., Lesage A., Laldone P., Nicole L., Reinharz D., Stip E. (2004). Self-assessed cognitive dysfunction and objective performance in outpatients with schizophrenia participating in a rehabilitation program. Schizophr. Res. 69, 85–91 10.1016/j.schres.2003.08.011 [DOI] [PubMed] [Google Scholar]
- Roncone R., Falloon I. R., Mazza M., De Risio A., Pollice R., Necozione S., Morosini P., Casacchia M. (2002). Is theory of mind in schizophrenia more strongly associated with clinical and social function than with neurocognitive deficit? Psychopathology 35, 280–288 10.1159/000067062 [DOI] [PubMed] [Google Scholar]
- Sands J. R., Harrow M. (1999). Depression during the longitudinal course of schizophrenia. Schizophr. Bull. 25, 157–171 [DOI] [PubMed] [Google Scholar]
- Semerari A., Carcione A., Dimaggio G., Falcone M., Nicolo G., Procaci M., Alleva G. (2003). How to evaluate metacognitive function in psychotherapy? The metacognition assessment scale its applications. Clin. Psychol. Psychother. 10, 238–261 10.1002/cpp.362 [DOI] [Google Scholar]
- Smith T., Hull J., Israel L., Willson D. (2000). Insight, symptoms, and neurocognition in schizophrenia and schizoaffective disorder. Schizophr. Bull. 26, 193–200 [DOI] [PubMed] [Google Scholar]
- Smith T. E., Hull J. W., Goodman M., Hedayat-Harris A., Willson D. F., Israel L. M., Munich R. L. (1999). The relative influences of symptoms, insight, and neurocognition on social adjustment in schizophrenia and schizoaffective disorder. J. Nerv. Ment. Dis. 187, 102–108 10.1097/00005053-199902000-00006 [DOI] [PubMed] [Google Scholar]
- Stip E. (2006) “La Schizophrenie,” in Neuropsychologie clinique et neurologie du comportement, eds. Botez-Marquard T., Boller F. (Montréal: Les Presses de l'Universite de Montréal; ), 523–539 [Google Scholar]
- Stip E., Caron J., Renaud S., Pampoulova T., Lecomte Y. (2003). Exploring cognitive complaints in schizophrenia: the subjective scale to investigate cognition in schizophrenia. Compr. Psychiatry 44, 331–340 10.1016/S0010-440X(03)00086-5 [DOI] [PubMed] [Google Scholar]
- Süllwold L. (1977). Symptome schizophrener Erkrankungen. Berlin: Springer-Verlag; [PubMed] [Google Scholar]
- van den Bosch R. J., Rombouts R. P. (1998). Casual mechanisms of subjective cognitive dysfunction in schizophrenic and depressed patients. J. Nerv. Ment. Dis. 186, 364–368 10.1097/00005053-199806000-00007 [DOI] [PubMed] [Google Scholar]
- van den Bosch R. J., Rombouts R. P., van Asma M. J. O. (1993). Subjective cognitive dysfunction in schizophrenia and depressed patients. Compr. Psychiatry 34, 130–136 10.1016/0010-440X(93)90058-C [DOI] [PubMed] [Google Scholar]
- van den Bosch R. J., Rozendaal N. (1998). Subjective cognitive dysfunction, eye tracking, and slow brain potentials in schizophrenic and schizoaffective patients. Biol. Psychiatry 7, 741–746 [DOI] [PubMed] [Google Scholar]
- Weiden P. J., Kozma C., Grogg A., Locklear J. (2004). Partial compliance and risk of rehospitalization among California medicaid patients with schizophrenia. Psychiatr. Serv. 55, 886–891 10.1176/appi.ps.55.8.886 [DOI] [PubMed] [Google Scholar]
- Williams R. M., Alagaratnam W., Hemsley D. R. (1984). Relationship between subjective self-report of cognitive dysfunction and objective information-processing performance in a group of hospitalized schizophrenic patients. Eur. Arch. Psychiatr. Neurol. Sci. 234, 48–53 10.1007/BF00432883 [DOI] [PubMed] [Google Scholar]
- Wilson B. A., Alderman N., Burgess P. W., Emsley H., Evans J. (1996). Behavioural Assessment of the Dysexecutive Syndrome Bury St Edmunds: Thames Valley Test Company [Google Scholar]
- Young D. A., Campbell Z., Zakzanis K. K., Weinstein E. (2003). A comparison between an interview and a self-report method of insight assessment in chronic schizophrenia. Schizophr. Res. 63, 103–109 10.1016/S0920-9964(02)00378-X [DOI] [PubMed] [Google Scholar]
- Zhornitsky S., Potvin S., Aubin G., Gélinas I., Stip E. (2011). Relationship between insight into cognition, extrapyramidal symptoms and mental illness in schizophrenia. Aust. N. Z. J. Psychiatry. 10.3109/00048674.2011.561483 [DOI] [PubMed] [Google Scholar]
- Zimmerman P., Messner C., Poser U., Sedelmeier P. (1991). Ein Frageboden erlebter Defizite der Aufmerksamkeit (FEDA) Freiburg: Psychologisches Institut der Universität Freiburg. [Google Scholar]
