Skip to main content
Clinical Practice and Epidemiology in Mental Health : CP & EMH logoLink to Clinical Practice and Epidemiology in Mental Health : CP & EMH
. 2006 Dec 5;2:34. doi: 10.1186/1745-0179-2-34

Adaptation and validation of the Portuguese version of the Lithium Knowledge Test (LKT) of bipolar patients treated with lithium: cross-over study

Adriane R Rosa 1,5,, Ana Cristina Andreazza 1,2, Fernando Kratz Gazalle 1,3, Jose Sanchez-Moreno 5, Aida Santin 1, Airton Stein 4, Helena MT Barros 4, Eduard Vieta 5, Flávio Kapczinski 1
PMCID: PMC1716160  PMID: 17147815

Abstract

Objective

Adherence problems are a common feature among bipolar patients. A recent study showed that lithium knowledge was the main difference between adherent and non adherents bipolar patients. The Lithium Knowledge Test (LKT), a brief questionnaire, was developed as a means of identifying aspects of patients' practical and pharmacological knowledge which are important if therapy is to be safe and effective. The original English version is validated in psychiatric population, but a validated Portuguese one is not yet available.

Methods

One hundred six patients selected were diagnosed with bipolar disorder (I or II) according to DSM-IV criteria and had to be on lithium treatment for at least one month. The LKT was administered on only one occasion. We analysed the internal consis tency, concurrent validity, sensitivity and specificity of the LKT for the detection of the knowledge about lithium treatment of bipolar patients.

Results

The internal consistency, evaluated by Cronbach's alpha was 0.596. The mean of total score LKT by bipolar patients was 9.0 (SD: 0.75) for men and 8.74 (SD: 0.44) for women. Concurrent validity based on plasma lithium concentration showed a significant correlation between the total LKT score and plasma lithium (r = 0,232; p = 0.020). The sensitivity was 84% and specificity was 81%.

Conclusion

LKT is a rapid, reliable instrument which appears to be as effective as a lengthier standard interview with a lithium clinic doctor, and which has a high level of acceptability to lithium patients. We found that the psychometric assessment of the Portuguese version of LKT showed good internal consistency, sensitivity and specificity.

Background

To date, lithium is probably still the gold standard for the long term treatment of bipolar disorder, as shown in classical papers [1], newer studies [2] and a recent and thoughtful meta analysis [3]. However, a marked gap has been noted between the efficacy of lithium in clinical trials and its effectiveness in ordinary clinical practice [4,5], this difference being almost certainly due to poor treatment adherence [4,6,7]. A survey conducted in the United States showed that the average time of lithium intake was as start as 76 days [8].

Adherence problems are a common feature among bipolar patients. A recent study showed that lithium knowledge was the main difference between adherent and non-adherent bipolar patients [9]. Several studies have shown that psychoeducative interventions are associated with high adherence rates, stabilization of plasma lithium levels, reduction of the total number of episodes and total number of patients needing to hospitalization [10-12]. The fact that patients are informed about the disease, the treatment and the risks of not treating it positively, influences adherence, because it facilitates their acceptance of the disease and maintenance therapy [13-15].

The Lithium Knowledge Test (LKT) a brief questionnaire, was developed as a means of identifying aspects of patients' practical and pharmacological knowledge which are important if therapy is to be safe and effective. One point is scored for each correct answer and one is deducted for each wrong answer, giving a total Lithium Knowledge Score. Some incorrect answers, since they constitute potential hazards to patients on lithium, are added up to give a Lithium Hazard Score (LHS). The original English version has been validated in psychiatric population and has shown good reliability [16].

Methods

2.1. Subjects

The study was conducted in two psychiatric outpatient services specialized in mood disorders in the city of Porto Alegre, Brazil. The psychiatric patients selected were diagnosed with bipolar disorder, I and II according to DSM-IV criteria. The study was approved by the Ethics Committees on Research of the hospital where the research took place, where the research took place and was carried out in compliance with the Helsinki Declaration.

The patient selection criteria included a well-established diagnosis, being on lithium treatment for at least one month, and regularly complying with the weekly visits scheduled in two psychiatric outpatients who agreed in take part in the survey.

In the weekly consultations, the patients were evaluated for both their symptoms and general state. The patients participated in psycho-educational groups about lithium with a specialized nurse and support groups with psychiatrists to discuss topics related to the disease.

The patients who agreed to participate in the study gave informed consent, were interviewed and had blood drawn immediately for comparison between the concentrations of lithium in the plasma with the LKT responses.

2.2. Variables

Demographical data

Every subject gave information about marital status, work, age, gender and education level.

Current clinical status

Bipolar patients were diagnosed using the Structured Clinical Interview for DSM-IV TR (SCID) and all patients were followed up prospectively using mood charts.

LKT

LKT is a brief questionnaire to identify aspects of patients' practical and pharmacological knowledge which are important if therapy is to be safe and effective. The LKT comprises 20 questions, which 1 point to be added for every correct answer and 1 point to be deducted for every wrong one. The correct answers are: 1-b; 2-b-c-f-h; 3-a-d-f; 4-a-b; 5-a-d; 6-c-e-f-g-i-k; 7-a-c-e. The total LKT score is obtained by adding together the responses to the 20 points. The mean LKT scores were close to 6. The mean LKT scores were > 6 indicating more knowledgeable. The LKT Hazard comprises of 3, 4, 6 and 7 questions for rating of identify aspects of intoxication symptoms about lithium. The total LKT Hazard score was obtained by adding together the responses to the 9 points. The mean LKT Hazard score was close to 4 or more indicating more hazard.

The linguistic adaptation of the LKT started with document in Portuguese obtained by a translation back translation method [17,18]. The items resulting in optimal word equivalence with the original text were analysed by the five of psychiatric investigators that agreed upon translation. Subsequently, bilingual people evaluated the degree of equivalence between the English original and the Portuguese version, as shown table 1. Finally, the comprehension of each item was assessed with a sample of 106 bipolar patients.

Table 1.

Teste de Conhecimento do Lítio

Marque com um X as respostas que o Sr considerar correta.
1. Na sua opinião o LÍTIO age: (a) Como tranqüilizante; (b) Para prevenir mudanças de humor; (c) Como pílula para dormir; (d) Como tratamento para deficiência de LÍTIO
2. Quais os efeitos colaterais o LÍTIO pode causar? (a) Prisão de ventre (dificuldade de ir aos pés); (b) Mal-estar como enjôos; (c) Tremores; (d) Dor de cabeça; (e) Palpitações; (f) Urinar mais; (g) Insônia; (h) Aumento de peso
3. O que você deve tentar não fazer enquanto estiver tomando LÍTIO? (a) Suar excessivamente; (b) Tomar medicamento para tosse; (c) Climas muito frio; (d) Ficar grávida; (e) Fazer exercícios vigorosos; (f) Tomar diuréticos
4. Se você tivesse uma diarréia aguda e vômitos, o que você faria?(a) Ligaria para o seu médico; (b) Pararia de tomar LÍTIO imediatamente; (c) Iria para a cama e continuaria tomando LÍTIO regularmente; (d) Chamaria uma ambulância; (e) Aumentaria a dose de LÍTIO
5. Para que os exames de sangue regulares são necessários? (a) Para medir a quantidade de LÍTIO em seu sangue; (b) Para verificar se a doença é recorrente; (c) Para verificar se tem anemia; (d) Para testar o funcionamento da glândula tireóide
6. Quais das seguintes afirmações são verdadeiras?
(a) O LÍTIO deve ser tomado exatamente no mesmo horário todos os dias
(b) Deve-se tomar doses extras de LÍTIO se você se sente deprimido
(c) Não deve-se tomar LÍTIO pela manhã quando for fazer exame de sangue
(d) É normal não tomar algumas doses de LÍTIO se você se sente bem
(e) O LÍTIO não é eficaz se o nível sangüíneo estiver muito baixo
(f) O LÍTIO tem efeitos tóxicos se o nível sangüíneo estiver muito alto
(g) É comum o LÍTIO ser receitado por vários anos
(h) Parar de tomar o LÍTIO por completo geralmente leva a uma recaída
(i) O LÍTIO tem sido experimentado e testado por muitos anos
(j) O LÍTIO tem sido substituído por medicamentos modernos mais eficazes
(k) Uma recaída durante o tratamento com LÍTIO não prova que ele não seja eficaz para o indivíduo
7. Quando você estiver tomando LÍTIO, o que deveria evitar na sua alimentação? (a) Dieta para emagrecimento; (b) Comer queijo; (c) Reduzir o consumo de sal; (d) Comida vegetariana (e) Beber álcool

The LKT was administered on one occasion, when venous blood to determine lithium concentration was collected from each patient. The time to application of LKT was 10 minutes. We analysed the internal consistency, concurrent validity in relation to plasma lithium concentration, sensitivity and specificity. Internal consistency was assessed with Cronbach's Alpha for the total scale.

Concurrent validity was studied considering plasma lithium concentration and the score obtained on the LKT by means of Pearson's correlation.

To study the sensitivity, specificity and positive and negative values of the LKT, we calculated the proportion of fully adherent bipolar patients by plasma lithium concentration and the proportion of non-adherent bipolar patients identified as such.

Lithium plasma concentration

The subjects were contacted seven days before the scheduled appointment and were instructed to be at the hospital early in the morning, without having taken their lithium dose in the morning because the lithium blood levels were to be measured, respecting a 12-hour interval between the last dose of lithium and the blood sampling. Venous blood was collected from each patient into Vacutainer tube containing edetic acid. The whole blood was then centrifuged 1600 × g for 10 minutes and the plasma removed by aspiration. A 1/20 dilution in water was made of 99 μl of plasma. Lithium concentrations were measured on the plasma dilutions by the indirect method, using an Instrumentation Laboratory CELM Flame Photometer. Assays were performed in duplicate [19].

Statistical analysis

Statistical analysis was performed using SPSS for Windows – Version 12.0 (SPSS Inc., Chicago, IL, USa). The Kolmogorov-Smirnov test was used to compare an observed cumulative distribution to a theoretical cumulative distribution function. ANOVA test was used for compare LKT scores and plasma levels of lithium. Pearson's correlation coefficient was performed to examine the relationship between plasma lithium concentration and LKT scores. The binomial variables (clinical state and LKT scores) were compared using Chi-Square test. Validity was assessed with Cronbach's alpha.

Results

The sample included 73 (68.9%) women, mean age 43.56 ± 9.83 and 33 (31.1%) men with a mean age of 41.61 ± 9.72. At the time when the present study was carried out, there were 77 (71.7%) euthymic, 12 (11.1%) manic and 17 (17.2%) depressed patients, according to the mood charts and physician is assessment. Habits showed 40 (37.7%) were smokers, 70 (66%) used coffee on a regular basis, and 68 (64.2%) had tea on a regular basis.

The answers to the LKT were obtained from 106 bipolar patients and the mean score on the LKT was 9.0 ± 0.75 for men and 8.74 ± 0.44 for woman and LKT HAZARD was 4.06 ± 0.19 for men and 3.96 ± 0.15 for woman. Table 2 describes the principal sociodemographic and clinical characteristics of the study sample.

Table 2.

Demographics and clinical characteristics

Euthymic 71.7%
Manic 11.1%
Depressed 17.2%
Smokers 37.7%
Coffe 66%
Tea 64.2%
Men Women
31.1% 68.9%
Age 41,61 ± 9,72 43,56 ± 9,83
Mean total LKT 9,0 ± 0,75 8,74 ± 0,44
Mean LKT Hazard 4,06 ± 0,19 3,96 ± 0,15

The internal consistency coefficient obtained to 43 items and the mean Cronbach's alpha of 0.596, for the total scale indicating that the items are sufficiently homogeneous.

Concurrent validity based on diagnosis according to plasma lithium concentration showed a significant correlation between the total LKT score and plasma lithium levels (r = 0.232; p = 0.020). The patients with higher LKT scores are more likely to have plasma levels within the therapeutic range.

We analysed the scale's discriminative capacity for bipolar patients by means of the knowledge about lithium treatment performance on sensitivity and specificity analysis. The sensitivity was 84% and specificity was 81%.

There were no significant differences between the total LKT scores among manic, depressive and euthymic patients (Pearson Chi-Square < .05). Date not shown.

We analysed the frequency of positive/negative answers on the LKT test by bipolar patients in comparison with standard answers offered by the original scale, as shown in table 3.

Table 3.

Frequency of answers from TCL

Questions % true answer % false answer
1a 81.9 18.1
1b 64.8 35.2
1c 95.2 4.8
1d 77.1 22.9
2a 66.7 33.3
2b 41.9 58.1
2c 68.6 31.4
2d 61.9 38.1
2e 66.7 33.3
2f 67.6 32.4
2g 74.3 25.7
2h 83.8 16.2
53a 14.3 85.7
53b 91.4 8.6
53c 96.2 3.8
53d 43.8 56.2
53e 96.2 3.8
53f 37.1 62.9
54a 68.6 31.4
54b 12.4 87.6
54c 89.5 10.5
54d 93.3 6.7
54e 99.0 1.0
55a 89.5 10.5
55b 95.2 4.8
55c 96.2 3.8
55d 7.6 92.4
56a 20.0 80.0
56b 95.2 4.8
56c 82.9 17.1
56d 89.5 10.5
56e 52.4 47.6
56f 61.0 39.0
56g 79.0 21.0
56h 16.3 83.7
56i 75.2 24.8
56j 76.2 23.8
56k 73.3 26.7
57a 19.0 81.0
57b 89.5 10.5
57c 19.0 81.0
57d 95.2 4.8
57e 81.7 18.3

There was a significantly negative correlation between age and LKT scores (r = -0.2; p = 0.04). Age was positively correlated with LKT HAZARD scores (r = 0.366; p = 0.001)

Discussion

Psychometric tests may be useful tools for the assessment of bipolar patients, not only in research protocols, but also in clinical practice [20]. LKT is a rapid, reliable instrument which appears to be as effective as a lengthier standard interview with a lithium clinic doctor, and which has a high level of acceptability to lithium patients. We found that the psychometric assessment of the Portuguese version of LKT showed good internal consistency, sensitivity and specificity. In Brazilian bipolar patients, the Portuguese version of LKT showed total scores which were similar of those described by Dharmendra et al. [21], in Scottish bipolar patients (total scores 9.6). Indeed, there was a significant negative correlation age and LKT scores and a significant positive correlation between LKT and Hazard scores, as shown in previous studies [21,22]. In the convergent analysis the total LKT scores were significantly correlated with plasma lithium levels, meaning that, the patients with higher LKT scores were more likely to have plasma levels within the therapeutic levels of lithium. Moreover, sensitivity and specificity tests showed good results, reinforcing the validation of Portuguese version of the LKT.

The LKT scale asked bipolar patients about lithium pharmacology aspects, such as, side effects, lithium interactions, risks of intoxication, food and lithium, necessity of measuring lithium levels, continuation of the lithium dosages and others [23]. Our study indicated that Could not you to do while you was taken lithium? Which of these would be sensible actions if you developed acute diarrhoea and vomiting? Why the regular blood tests are necessary? Lithium must be taken at exactly the same times each day? Lithium is not effective if the blood level falls too low? Stopping lithium altogheter usually leads to a relapse? Which of the following changes in diet can cause problems with lithium? were mainly difficulties reported by bipolar patients, because of this that patients with lower LKT scores are more uninformed about intoxication risks.

The identification of problems about lithium treatment and bipolar disorder with LKT could contribute to better understanding of the difficulties that bipolar patients have, and offer this specific information in the clinical consultations. Indeed, knowledge about prescribed medication tends to be poor in the ederly and these patients could have higher risks of intoxicacion with lithium than younger patients. While it is possible that patients who have been on lithium for a long time did not receive comprehensive information as did those who commenced treatment more recently and they required some reeducation about lithium for some time [21].

The knowledge level is a predictor of the adherence rates in bipolar patients in according recent reported [9]. In fact, Colom et al. [24] had reported that educated bipolar patients showed lower relapses rates, lower number and during hospitalizations. Psychoeducation is important to definitely mean more than providing information to patients and has shown its efficacy in stabilizing lithium plasma levels by improving pharmacological treatment adherence.

It is important to highlight several methodological issues. First, as with any study of treatment adherence we are hampered by the likelihood that the sample might have included a representative sample. Such methodological problems affect all studies in this field, as individuals who are non- adherent with lithium are also likely to fail to agree to participate or fail to adhere with research protocols. Second, we did not assess current symptom severity or comorbidity of bipolar disorder with other psychiatric or physical disorders. Third, this was a cross-over study, as we assessed knowledge about medication in only one occasion. As yet, there is no research on the stability or variability of such beliefs over time.

Conclusion

In conclusion, the LKT is a brief questionnaire to evaluate the knowledge level in bipolar patients, identify aspects of patients' practical and pharmacological knowledge which are important if therapy is to be safe and effective. The LKT scale may now be used in Portuguese speaking populations as a direct measure of knowledge on lithium as a valid indirect measure of treatment adherence.

Contributor Information

Adriane R Rosa, Email: adrianerrosa@yahoo.com.br.

Ana Cristina Andreazza, Email: ana_andreazza@yahoo.com.br.

Fernando Kratz Gazalle, Email: fgazalle@terra.com.br.

Jose Sanchez-Moreno, Email: jsanchezmore@menta.net.

Aida Santin, Email: asantin@terra.com.br.

Airton Stein, Email: astein@via-rs.net.

Helena MT Barros, Email: helenbar@fffcmpa.tche.br.

Eduard Vieta, Email: evieta@clinic.ub.es.

Flávio Kapczinski, Email: kapcz@terra.com.br.

References

  1. Dunner DL, Stallone F, Fieve RR. Lithium carbonate and affective disorders. V: A double-blind study of prophylaxis of depression in bipolar illness. Arch Gen Psychiatry. 1976;33:117–120. doi: 10.1001/archpsyc.1976.01770010073014. [DOI] [PubMed] [Google Scholar]
  2. Tondo L, Baldessarini RJ, Floris G. Long-term clinical effectiveness of lithium maintenance treatment in types I and II bipolar disorders. Br J Psychiatry Suppl. 2001;41:s184–s190. doi: 10.1192/bjp.178.41.s184. [DOI] [PubMed] [Google Scholar]
  3. Geddes JR, Burgess S, Hawton K, Jamison K, Goodwin GM. Long-term lithium therapy for bipolar disorder: systematic review and meta-analysis of randomized controlled trials. Am J Psychiatry. 2004;161:217–222. doi: 10.1176/appi.ajp.161.2.217. [DOI] [PubMed] [Google Scholar]
  4. Guscott R, Taylor L. Lithium prophylaxis in recurrent affective illness. Efficacy, effectiveness and efficiency. Br J Psychiatry. 1994;164:741–746. doi: 10.1192/bjp.164.6.741. [DOI] [PubMed] [Google Scholar]
  5. Schou M. The combat of non-compliance during prophylactic lithium treatment. Acta Psychiatr Scand. 1997;95:361–363. doi: 10.1111/j.1600-0447.1997.tb09646.x. [DOI] [PubMed] [Google Scholar]
  6. Kulhara P, Basu D, Mattoo SK, Sharan P, Chopra R. Lithium prophylaxis of recurrent bipolar affective disorder: long-term outcome and its psychosocial correlates. J Affect Disord. 1999;54:87–96. doi: 10.1016/S0165-0327(98)00145-1. [DOI] [PubMed] [Google Scholar]
  7. Schumann C, Lenz G, Berghofer A, Muller-Oerlinghausen B. Non-adherence with long-term prophylaxis: a 6-year naturalistic follow-up study of affectively ill patients. Psychiatry Res. 1999;89:247–257. doi: 10.1016/S0165-1781(99)00108-0. [DOI] [PubMed] [Google Scholar]
  8. Johnson RE, McFarland BH. Lithium use and discontinuation in a health maintenance organization. Am J Psychiatry. 1996;153:993–1000. doi: 10.1176/ajp.153.8.993. [DOI] [PubMed] [Google Scholar]
  9. Rosa AR, Marco M, Fachel JMG, Stein A, Barros HMT. Correlation between drug treatment adherence and lithium treatment attitudes and knowledge by bipolar patients. Prog Neuropsychopharmacol Biol Psychiatry. 2006. in press . [DOI] [PubMed]
  10. Colom F, Vieta E, Reinares M, Martinez-Aran A, Torrent C, Goikolea JM, Gasto C. Psychoeducation efficacy in bipolar disorders: beyond compliance enhancement. J Clin Psychiatry. 2003;64:1101–1105. doi: 10.4088/jcp.v64n0917. [DOI] [PubMed] [Google Scholar]
  11. Colom F, Vieta E, Sanchez-Moreno J, Martinez-Aran A, Reinares M, Goikolea JM, Scott J. Stabilizing the stabilizer: group psychoeducation enhances the stability of serum lithium levels. Bipolar Disord. 2005;7 Suppl 5:32–36. doi: 10.1111/j.1399-5618.2005.00249.x. [DOI] [PubMed] [Google Scholar]
  12. Molnar G, Feeney MG, Fava GA. Duration and symptoms of bipolar prodromes. Am J Psychiatry. 1988;145:1576–1578. doi: 10.1176/ajp.145.12.1576. [DOI] [PubMed] [Google Scholar]
  13. Paykel ES. Psychotherapy, medication combinations, and compliance. J Clin Psychiatry. 1995;56 Suppl 1:24–30. [PubMed] [Google Scholar]
  14. Harvey NS, Peet M. Lithium maintenance: 2. Effects of personality and attitude on health information acquisition and compliance. Br J Psychiatry. 1991;158:200–204. doi: 10.1192/bjp.158.2.200. [DOI] [PubMed] [Google Scholar]
  15. Clarke DJ, Pickles KJ. Lithium treatment for people with learning disability: patients' and carers' knowledge of hazards and attitudes to treatment. J Intellect Disabil Res. 1994;38 ( Pt 2):187–194. doi: 10.1111/j.1365-2788.1994.tb00373.x. [DOI] [PubMed] [Google Scholar]
  16. Peet M, Harvey NS. Lithium maintenance: 1. A standard education programme for patients. Br J Psychiatry. 1991;158:197–200. doi: 10.1192/bjp.158.2.197. [DOI] [PubMed] [Google Scholar]
  17. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–3191. doi: 10.1097/00007632-200012150-00014. [DOI] [PubMed] [Google Scholar]
  18. Bullinger M, Alonso J, Apolone G, Leplege A, Sullivan M, Wood-Dauphinee S, Gandek B, Wagner A, Aaronson N, Bech P, Fukuhara S, Kaasa S, Ware JE Jr.. Translating health status questionnaires and evaluating their quality: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:913–923. doi: 10.1016/S0895-4356(98)00082-1. [DOI] [PubMed] [Google Scholar]
  19. Harvey NS. The development and descriptive use of the Lithium Attitudes Questionnaire. J Affect Disord. 1991;22:211–219. doi: 10.1016/0165-0327(91)90067-3. [DOI] [PubMed] [Google Scholar]
  20. Vieta E, Sanchez-Moreno J, Bulbena A, Chamorro L, Ramos JL, Artal J, Perez F, Oliveras MA, Valle J, Angst J, Lahuerta.J.; for the EDHIPO (Hypomania Detection Study) group. Cross validation with the mood disorder questionnaire (MDQ) of an instrument for the detection of hypomania in Spanish: the 32 item hypomania symptom check list (HCL-32) J Affect Disord. 2006. in press . [DOI] [PubMed]
  21. Dharmendra MS, Eagles JM. Factors associated with patients' knowledge of and attitudes towards treatment with lithium. J Affect Disord. 2003;75:29–33. doi: 10.1016/s0165-0327(02)00027-7. [DOI] [PubMed] [Google Scholar]
  22. Kessing LV, Hansen HV, Bech P. Attitudes and beliefs among patients treated with mood stabilizers. Clin Pract Epidemol Ment Health. 2006;2:8. doi: 10.1186/1745-0179-2-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Scott J, Pope M. Nonadherence with mood stabilizers: prevalence and predictors. J Clin Psychiatry. 2002;63:384–390. doi: 10.4088/jcp.v63n0502. [DOI] [PubMed] [Google Scholar]
  24. Colom F, Vieta E, Martinez-Aran A, Reinares M, Goikolea JM, Benabarre A, Torrent C, Comes M, Corbella B, Parramon G, Corominas J. A randomized trial on the efficacy of group psychoeducation in the prophylaxis of recurrences in bipolar patients whose disease is in remission. Arch Gen Psychiatry. 2003;60:402–407. doi: 10.1001/archpsyc.60.4.402. [DOI] [PubMed] [Google Scholar]

Articles from Clinical Practice and Epidemiology in Mental Health : CP & EMH are provided here courtesy of Bentham Science Publishers

RESOURCES