Abstract
Objective
Promoting mental health and preventing mental health problems are important tasks for international organizations and nations. Such goals entail the establishment of active information networks and effective systems and indicators to assess the mental health of populations. This being said, there is a need in Korea develop ways to measure the state of mental health in Korea.
Methods
This paper reviews the mental health indicator development policies and practices of seven organizations, countries, and regions: WHO, OECD, EU, United States, Australia, UK, and Scotland. Using Delphi method, we conducted two surveys of mental health indicators for experts in the field of mental health. The survey questionnaire included 5 domains: mental health status, mental health factor, mental health system, mental health service, and quality of mental health services. We considered 124 potential mental health indicators out of more than 600 from indicators of international organizations and foreign countries.
Results
We obtained the top 30 mental health indicators from the surveys. Among them, 10 indicators belong to the mental health system. The most important five mental health indicators are suicide rate, rate of increase in mental disorder treatment, burden caused by mental disorders, adequacy of identifying problems of mental health projects and deriving solutions, and annual prevalence of mental disorders.
Conclusion
Our study provides information about the process for indicator development and the use of survey results to measure the mental health status of the Korean population. The aim of mental health indicator development is to improve the mental health system by better grasping the current situation. We suggest these mental health indicators can monitor progress in efforts to implement reform policies, provide community services, and involve users, families and other stakeholders in mental health promotion, prevention, care and rehabilitation.
Keywords: Mental health, Mental health indicator, Development
INTRODUCTION
According to the results of an epidemiological survey on mental disorders, the lifetime prevalence of mental disorders - the percentage of population experiencing one or more mental disorders through life - in Korean adults (at the age of 18-64) is as high as 27.6%.1 Throughout the world as well, 120 million people are suffering depression and less than 25% of them are known to get adequate treatment.2 Moreover, social and economic burdens caused by mental disorders are increasing steadily, and according to the Global burden of disease project of the World Health Organization (WHO), mental disorders such as depression, alcohol use disorder, bipolar affective disorder and schizophrenia are included in the 20 major causes of disability. In particular, unipolar depressive disorder, which makes the biggest contribution to disease burden among mental disorders, ranked third in terms of contribution to disease burden in 2004 and is expected to be first in 2030.3 What is more, mental disorders show early onset age and cause high indirect expenses resulting from the reduction or loss of productivity at workplaces, and consequently they impose high economic burdens on society compared to physical diseases. Nevertheless, mental disorders are generally overlooked by policy makers due to lower mortality than physical diseases and social prejudice against mental disorders.
In order to reduce the serious social and economic impacts of mental health problems, it is necessary to survey the general status and level of mental health of the corresponding country and to monitor the trend of change periodically. Particularly in these days, statistical data are used in setting the priority of national policies or evaluating national projects and therefore it is necessary to create various mental health indicators through statistical surveys or reports and to utilize them in policy making. That is, mental health indicators are essential for monitoring people's mental health status in a country, developing mental health policies, and evaluating the performance of such policies. In addition, mental health indicators are required for comparison and benchmarking among countries.
Developed countries have developed mental health indicators systematically based on theoretical grounds as national projects not only for surveying people's mental health status and monitoring its trends but also for providing scientific grounds to policy makers and monitoring the processes and outcomes of policies. On the contrary, few mental health indicators have been developed in Korea. As to statistical data and indicator-related studies in Korea, epidemiological surveys on mental disorders and surveys on disabled persons are conducted in every five years and these surveys cover part of population with mental disorders. In addition, the National Health and Nutrition Survey collect data on mental health such as activity restriction caused by mental disorder, stress awareness level, depression and suicide impulse, and on drinking and smoking. Except these surveys, there are few national projects for monitoring mental health in Korea.
This study was conducted in order to review the current state of mental health indicator development in international organizations and major foreign countries and, based on the results, to develop and propose mental health indicators that can determine and monitor the current level of mental health in Korea, set the priority of promotion or resource allocation in projects to improve mental health, and enable international comparison.
METHODS
Concept of mental health indicator
Mental health is one's state of well-being that enables the person to display his/her abilities, to cope with daily stress, to work productively and to contribute to community. Mental health in such a positive sense becomes the base of well-being and effective roles for individuals and community. In a positive sense, mental health may involve both health and diseases and, accordingly, everybody desires mental health and feels subjective health regardless of whether he/she has a mental disorder.4
Health indicators are scales not only on the health status of a population group but also on the general level or characteristic of all relevant items including health policy, healthcare system, healthcare resource, natural environment, size and composition of population, and people's perception and value of health.5 That is, they express the quantitative and qualitative aspects of health by comprehensively indicating systems and statuses related to a population group's health promotion and prevention of diseases.6
Accordingly, 'mental health indicators,' which combines the two concepts, are scales showing people's mental disorders as well as their positive mental health including subjective wellbeing and expressing the quantitative and qualitative state of policies and services promoted to solve mental health problems, to promote mental health and to prevent mental disorders. That is, these indicators are used to measure various aspects of mental health system like population groups' need of mental health services (e.g., the percentage of population belonging to vulnerable groups), resources invested in mental health service systems (e.g., the number of mental health professionals per 100,000 persons, and the percentage of budgets for mental health promotion programs in budgets for general health promotion), quality of service activities including the ways of delivering protection (e.g., the annual number of mental inpatients per 100,000 persons), and the effect of mental health services in service consumers (e.g., annual suicide rate, symptom reduction, disability level, quality of life).7
Indicator development in international organizations and other developed countries
Recently, several international organizations promoted indicator development projects. The Organisation for Economic Co-operation and Development (OECD) conducted the Health Care Quality Indicators Project, through which it defined mental health as one of the five priority areas, reviewed indicators in the member countries, and developed internationally comparable indicators on the quality of mental health.8 WHO performed a indicator development project for evaluating mental health policies and services usable in underdeveloped countries in order to solve the problem that over 24% of 202 areas, including the member states, associated members, territories, and areas, did not have systems for collecting and reporting mental health information and that mental health evaluation and monitoring tools used in developed countries are not applicable to developing and underdeveloped countries in terms of objective, scope, structure and contents.9 The European Union (EU) also promoted the Mental Health Information and Determinants for the European Level (MINDFUL) project based on previous projects for improvement in mental health information and comparison among its member countries with the object of expanding the scope of mental health monitoring systems so that they comprehend not only negative mental health but also positive mental health, mental health promotion, and mental disorder prevention.10
Among individual countries, the U.S., Australia, the U.K., Scotland, etc. have developed indicators in order to monitor the performance and services of mental health. The U.S. developed indicators on the performance of mental health services to meet consumers' needs actively,11 and Australia developed indicators on the performance of mental health services in public sectors in connection to the strategic directions of national mental health plans and characteristically it included indicators related to safety.12 In the U.K., mental health indicators have been used in evaluating the performance of the Mental Health Trust since 2001,13 and the indicators were designed jointly by the government, the Commission for Health Improvement, and the Ministry of Health. Developed indicators aim to help people understand the performance of community health services and to provide information easily and conveniently, and every year new indicators are developed in the process of setting the goals of the National Health Service in order to reflect changes timely and evaluate performance properly.14 Scotland gives national priority to mental health promotion and promotes national visions such as people's mental health, quality of life, welfare, and social integration of those with mental disorders or mental health problems. Moreover, it has defined the concept of mental health in two aspects, namely, mental health problems such as anxiety and positive mental health such as satisfaction with life and positive relations with others, and developed mental health indicators focusing on the measurement of positive mental health.15 Table 1 summarizes the current state of indicator development in international organizations and major countries as presented above.
Table 1.
Indicator development of international organizations and other countries
OECD: Organisation for Economic Co-operation and Development, WHO: World Health Organization, AIMS: Assessment Instrument for Mental Health Systems, EU: European Union, MINDFUL: Mental Health Information and Determinants for the European Level, MHSIP: Mental Health Statistics Improvement Program, NHS: National Health Service
The characteristics of mental health indicator development in foreign countries are as follows. First, the objectives of mental health indicator development reflect each country's national mental health strategies and aim at measuring and monitoring the performance of current national mental health policies for mental health promotion. In case of international organizations, indicators are developed mainly to compare the quality of mental health among countries. Second, most countries are making efforts to build up a comprehensive frame including the performance of mental health policies, the provision of services, each population group's current mental health status, etc. in order to measure the performance of mental health services. Third, the concept of mental health is being expanded so that it connotes not only mental disorders but also personal protection factors of positive mental health such as resilience, self-esteem and self-efficacy. Fourth, with regard to the contents of indicators, consumers' viewpoint emphasizing consumers' experience in provided mental health services is being introduced in addition to the current state of mental health like mental disorders and the contents of mental health services. Introducing these kinds of indicators will contribute to changing mental health services consumer-centered. Fifth, indicator systems for inter-regional comparison and frameworks for standardized measurements are being developed. Sixth, the development of mental health indicators does not take place in a short period but goes through long-term refinement and revision.
Principles of developing mental health indicators in Korea
This study attempted to develop indicators that reflect the current state of mental health in Korea, the objectives of national policies and people's needs of mental health, and are internationally comparable. In addition, indicators were developed with the object of enhancing quality of mental health, improving mental health facilities and personnel, upgrading the quality of mental health service, respecting the human rights of people with mental disorders, and using limited mental health resources efficiently and effectively.
For the development of mental health indicators in Korea, we made an effort to include mental health indicators of Health Plan 201016 and the National Mental Health Commission report17 (Table 2). Health Plan 2010 was a national plan intended to improve the accessibility of mental health service, the level of national mental health and the quality of life of people with mental disorders. The National Mental Health Commission developed some indicators to assess community mental health services.
Table 2.
Mental health related indicators in Korea
In developing indicators, we focused on adults and the scope of indicators comprehended mental health problems including mental disorders, resources including manpower, facilities and finance, mental health services, risk and protection factors, etc. Moreover, the scope of mental health services was divided into five domains, that is, mental health status, mental health factor, mental health system, mental health service, and the quality of mental health services so that it includes prevention, treatment, continuous management and early interventions, and divided again into 21 subdomains according to the nature of indicators (Table 3).
Table 3.
Expert survey results of mental health indicator categories
'Mental health status' covers positive mental health and mental health problems including mental disorders, and 'mental health factor' covers personal factors and environmental factors that may affect mental health. 'Mental health system' includes indicators related to mental health resources and covered policies and plans related to mental health, organizations and human resources involved in mental health services, and budgets and finance. 'Mental health service' comprehends all mental health activities conducted in the area of mental health including services for the prevention, treatment, and rehabilitation of mental disorders, and 'Quality of mental health' includes indictors to measure whether mental health services enhance the level of mental health and whether such services are provided based on evidence.
By reviewing indicators developed in Korea and major foreign countries presented above, we collected around 600 indicators. Then, in consideration of their redundancy and availability, the principles of indicator development in this study, and the indicator system, we reduced them into 22 indicators on mental health status, 8 on mental health factor, 29 on mental health system, 38 on mental health service and 27 on the quality of mental health services, so a total of 124 indicators in the 1st questionnaire.
Expert questionnaire survey
We conducted the 1st and 2nd questionnaire surveys with experts recommended by academic societies related to mental health in Korea. In detail, we recruited 19 participants who have expertise in the area under investigation from the following societies: Korean Neuropsychiatric Association, Korean Society of Clinical Psychology, Korean Association of Mental Health Social Workers, and Korean Academy of Psychiatric and Mental Health Nursing.
The purpose of the surveys was to collect the experts' opinions on the fitness of mental health indicators developed by the authors. Based on the results of the 1st questionnaire survey, the 2nd questionnaire was developed through adding new indicators and revising the terms of indicators. The 1st questionnaire survey presented each expert indicator categories and 124 indicators developed by the authors, and had them rate the importance of each indicator domain/subdomain and item on a 5-point scale. Then, the importance of the indicator categories and items was assessed by the mean score and the proposed indicators were revised.
RESULTS
Indicator categories
In the results of the questionnaire survey on the suitability of indicator category, adequacy was high in order of mental health system, mental health service, mental health status, the quality of mental health services, and mental health factor among the 5 higher domains. Among the subdomains, those belonging to mental health system such as policies and plans, organizations, finance, and human resource, and those belonging to mental health service such as early interventions, treatment and rehabilitation attained a high score, showing high consistency with the results on the fitness of the 5 higher domains. In the questionnaire for assessing the importance of individual indicators, 40 out of the 124 indicators got a mean score of 4 or higher.
We developed the 2nd questionnaire containing a total of 127 indicators by revising terms and adding new indicators based on experts' opinions collected in the 1stt questionnaire survey. The 2nd questionnaire survey presented the results of the 1st survey and the revised questionnaire. As in the 1st questionnaire survey, the respondents rated the importance of each indicator category and item at a 5-point-scale, and then the fitness and importance of the indicator categories and individual indicators were assessed by the mean score. In the 2nd questionnaire survey, the suitability of mental health system and mental health services was also rated high and this result was mostly consistent with the results on the subdomains. To put it concretely in the results on the subdomains, 'policies and plans,' 'organizations,' 'human resources' and 'finance' belonging to mental health system, and 'early interventions' and 'treatment' belonging to mental health service showed high importance (Table 3).
Mental health indicators
In the results of expert survey on individual indictors, the number of indicators scoring 4 or higher was 59 out of 127, which was 19 larger than that in the 1st survey. Among the top 30 indicators based on the mean score, 10 belonged to 'mental health system' and this is considered to suggest the importance of resources such as policies, organizations, human resources and finance in understanding the current situation of mental health and making related policies in Korea. Moreover, indicators in the subdomain of 'mental health problem' ranked high. In particular, 'suicide rate' ranked first probably because of the rapidly increasing number of suicides. Besides, the annual prevalence of mental disorders, depression and alcoholism was found to be an important indicator. It is also considered necessary to measure social and economic burdens caused by mental disorders including socioeconomic expenses resulting from mental disorders and suicides (Table 4).
Table 4.
Thirty key mental health indicators
DISCUSSION
As a preliminary study for developing mental health indicators that reflect the current situation of Korea, this study reviewed mental health indicators in Korea and other countries and proposed individual indicators in the domains of mental health status, mental health factor, mental health system, mental health service, and the quality of mental health services.
These indicators include the objectives of mental health suggested in national health policies such as Health Plan and the objectives of national mental health plans suggested by the National Mental Health Commission. Moreover, we aimed to develop indicators that can assess the current situation of mental health, suggest the future directions of policies, and monitor the quality of current mental health services and evaluate its trend. In particular, we included equality as a quality indicator in order to measure difference in the quality of mental health among areas and ultimately to spot inequalities among areas and redistribute resources in this age of decentralization. What is more, we tried to develop internationally comparable indicators by including mental health indicators used in international organizations such as WHO and OECD and foreign countries.
Various socioeconomic changes such as economic crisis, unemployment and poverty experienced by our society are becoming the risk factors of mental health causing chronic mental disorders as well as depression, suicide, stress and addiction. Mental health services for solving these problems are faced with diverse challenges in addition to their traditional tasks like chronic mental disease patients' returning to community, higher effectiveness of treatment services, human rights promotion, and enhanced quality of life. Although the mental health system of Korea has achieved quantitative expansion steadily including the increase in the number of mental health institutions and community mental health centers since the Mental Health Act in 1995, it is still incompetent to cope with various mental health problems.17 In this situation, it is considered very desirable to conduct research for developing mental health indicators that represent the current state of mental health and mental health system and the quality of mental health services comprehensively.
As the indicators developed in this study targeted only adults not children, adolescents or elderly people, however, further research is required on the tasks below for the use of the results of this study. First, we need to obtain the values of the indicators using the indicator calculation models in order to monitor the current situation of mental health in Korea and improve the unmet needs. That is, by monitoring changes in the calculated values of the indicators, we may be able to evaluate the performance of government policies and monitor the trends of mental health. In other words, we can lay the base for a system to monitor national mental health policies through assessing the level and performance of mental health policies according to the directions and objectives of national mental health policies and through periodically monitoring national mental health policies for providing information necessary in policy making. Second, we need to accumulate indicators continuously and analyze them periodically, and utilize the results as materials for effective policy making. Third, we need to regularize national surveys with annual refinement of the developed mental health indicators and to develop standardized questionnaires for the surveys. Fourth, future studies developing dimensional mental health indicators are warranted because it is also important to measure the status of mental health not only categorically but also dimensionally.
The ultimate objectives of the development of mental health indicators are to find unsatisfactory parts or new needs by surveying the current state of mental health and mental health services, to reflect them in policies for high-quality mental health services, and ultimately to enhance people's mental health level. The mental health indicators proposed in this study are expected to be useful tools contributing to improving people's mental health by assessing the performance of mental health policies in connection to mental health problems and services, analyzing trends in mental health problems and mental health policies over time, and providing high-quality mental health services.
Acknowledgments
This study was conducted with the support of Lee Si-Hyung Social Psychiatry Research Fund of the Korean Foundation of Neuropsychiatric Research (DHA and SR) and the National Center for Mental Health Research and Education of Seoul National Hospital (HH). The authors would also like to acknowledge the contributions of the participating experts: Jeongyee Bae, RN, PhD, Inje University; Yong-Mae Baek, PhD, Catholic University of Daegu; An Kee Chang, MD, Seoul National Hospital; Duk Hee Chun, PhD, Tongwon College; Duck-Gyu Kang, PhD, Haein Mental Health Center; Donghyeon Kim, MD, Choongmoosarang Hospital; Sun Ah Kim, RN, PhD, Yonsei University; Yoon Kim, MD, PhD, Seoul National University; Jong-Eun Lee, RN, PhD, Inha University; Jonggook Lee, MD, Yong-In Mental Hospital; Woo Kyeong Lee, PhD, Yong-In Mental Hospital; Yu Jin Lee, MD, PhD, Gachon University; Kyoung A Nam, RN, PhD, Ajou University; Jong-Woo Paik, MD, PhD, Kyung Hee University; Yongjin Seo, MD, Yong-In Mental Hospital; Jun Mo Sung, PhD, Korea Nazarene University; Hae-Joo Yoon, MA, Seoul National Hospital.
References
- 1.Cho MJ. The Epidemiological Survey of Mental Disorders in Korea. Seoul: Ministry of Health and Welfare; 2011. [Google Scholar]
- 2.10 facts on the global burden of disease. [Accessed May 7, 2012]. Available at: http://www.who.int/features/factfiles/global_burden/en/index.html.
- 3.World Health Organization. The Global Burden of Disease: 2004 Update. Geneva: World Health Organization; 2008. [Google Scholar]
- 4.Herrman H, Saxena S, Moodie R, editors. Promoting Mental Health: Concepts, Emerging Evidence, Practice. Geneva: World Health Organization; 2005. [Google Scholar]
- 5.World Health Organization. Constitution of the World Health Organization. Geneva: World Health Organization; 1948. [Google Scholar]
- 6.Yoon CK, Yoon BJ, Lee JH, Kim YS. A study on development of health indicator system in Korea. Korean J Health Policy Adm. 2003;13:44–66. [Google Scholar]
- 7.World Health Organization. Mental Health Policy and Service Guidance Package: Mental Health Information Systems. Geneva: World Health Organization; 2005. [Google Scholar]
- 8.Hermann R, Mattke S Members of the OECD Mental Health Care Panel. Selecting Indicators for the Quality of Mental Health Care at the Health Systems Level in OECD Countries. Paris: Head of Publications Service, OECD; 2004. OECD Health Technical Papers NO. 17. [Google Scholar]
- 9.Saxena S, Lora A, van Ommeren M, Barrett T, Morris J, Saraceno B. WHO's Assessment Instrument for Mental Health Systems: collecting essential information for policy and service delivery. Psychiatr Serv. 2007;58:816–821. doi: 10.1176/ps.2007.58.6.816. [DOI] [PubMed] [Google Scholar]
- 10.MINDFUL-Mental Health Information and Determinants for the European Level. [Accessed May 8, 2012]. Available at: http://info.stakes.fi/mindful/EN/frontpage.htm.
- 11.Mental Health Statistics Improvement Program's Consumer-Oriented Mental Health Report Card. [Accessed May 8, 2012]. Available at: http://www.mhsip.org/reportcard/
- 12.National Mental Health Performance Subcommittee. Key Performance Indicators for Australian Public Mental Health Services: Technical Specification Summary. Canberra: Department of Health and Ageing, Commonwealth of Australia; 2008. [Google Scholar]
- 13.Department of Health. NHS Performance Ratings: Acute Trusts, Specialist Trusts, Ambulance Trusts, Mental Health Trusts 2001/02. London: Department of Health Publications; 2002. [Google Scholar]
- 14.Commission for Health Improvement. [Accessed May 8, 2012]. Available at: http://www.chi.nhs.uk/Ratings/Trust/Overview/mht_overview.asp.
- 15.Parkinson J. Establishing a Core Set of National, Sustainable Mental Health Indicators for Adults in Scotland: Final Report. Edinburgh: NHS Health Scotland; 2007. [Google Scholar]
- 16.Suh MK, Kim HR, Suh T, Sun WD, Shin YJ, Choi EJ, et al. Establish of New Health Plan 2010. Seoul: Korea Institute for Health and Social Affairs, Ministry of Health and Welfare; 2005. [Google Scholar]
- 17.National Mental Health Commission. 2007 National Mental Health Commission Report. Seoul: Ministry of Health, Welfare and Family Affairs; 2008. [Google Scholar]