Test blueprints for psychiatry residency in-training written examinations in Riyadh, Saudi Arabia

Abstract

Background

The postgraduate training program in psychiatry in Saudi Arabia, which was established in 1997, is a 4-year residency program. Written exams comprising of multiple choice questions (MCQs) are used as a summative assessment of residents in order to determine their eligibility for promotion from one year to the next. Test blueprints are not used in preparing examinations.

Objective

To develop test blueprints for the written examinations used in the psychiatry residency program.

Methods

Based on the guidelines of four professional bodies, documentary analysis was used to develop global and detailed test blueprints for each year of the residency program. An expert panel participated during piloting and final modification of the test blueprints. Their opinion about the content, weightage for each content domain, and proportion of test items to be sampled in each cognitive category as defined by modified Bloom’s taxonomy were elicited.

Results

Eight global and detailed test blueprints, two for each year of the psychiatry residency program, were developed. The global test blueprints were reviewed by experts and piloted. Six experts participated in the final modification of test blueprints. Based on expert consensus, the content, total weightage for each content domain, and proportion of test items to be included in each cognitive category were determined for each global test blueprint. Experts also suggested progressively decreasing the weightage for recall test items and increasing problem solving test items in examinations, from year 1 to year 4 of the psychiatry residence program.

Conclusion

A systematic approach using a documentary and content analysis technique was used to develop test blueprints with additional input from an expert panel as appropriate. Test blueprinting is an important step to ensure the test validity in all residency programs.

A test blueprint defines the scope and focus of a test, ensuring congruence between the learning objectives and the course contents, thus verifying the validity of the content.¹ Test blueprinting organizes the process of test development to best represent the teaching/learning process. It identifies the objectives at each level of the cognitive domain of Bloom’s taxonomy, ² weightage for objectives, and determines how many items need to be selected for each sub-category of a test. The cognitive domain deals with a person’s ability to process and utilize information in a meaningful way. Other domains of Bloom’s taxonomy include affective, which relates to the attitudes and feelings that result from the learning process, and psychomotor, which involves manipulative or physical skills. Bloom identified six levels within the cognitive domain. From lowest to highest, the levels are as follows: knowledge (remembrance), comprehension (understand), application (apply), analysis (analyze), synthesis (evaluate/evaluating) and finally evaluation (create/creating). Currently, the latter three are placed in a similar hierarchy (Table 1).^3,4 Test blueprinting is also used to avoid haphazard test development. Unplanned test development results in a test with little content validity.⁵ Without a test blueprint, a test will produce scores that are of limited use and interpretation.^2,6,7 Another rationale for developing test blueprints is that doing so improves the teaching and learning experiences of residents in training and facilitates curricular consonance.

Table 1.

Bloom’s taxonomy - old and revised hierarchy link

Old Bloom	Neo-Bloom (A&K)
Evaluation**	Creating**
Synthesis	Evaluating
Analysis	Analyzing
Application	Applying
Comprehension	Understanding
Knowledge*	Remembering*

Notes: From lower order* to higher order thinking skills**. When comparing the traditional version with the new version, the top two levels are exchanged.²³

The postgraduate training program in psychiatry in Saudi Arabia was established in 1997 in an effort to develop local professional, culturally sensitive manpower and further expand and improve the specialized mental health services supported by qualified and well-trained psychiatrists. It has local training committees in Dammam and in Riyadh. Each local program has its own selection criteria, training centers, and in-training assessment. It is a four year program and consists of two levels. Level 1, junior residency in year 1 and 2, addresses general psychiatry, consultation-liaison psychiatry, addiction and drug abuse, neurology, basic principles of pharmacotherapy and psychotherapy, and neurosciences related to psychiatry. Level 2, senior residency of year 3 and 4, focuses on sub-specialties of clinical psychiatry.

The assessment methods, which are used to determine whether residents are promoted from one year to the next, include the summation of end of rotation evaluations for the year using rating scales (comprising 50% of the total score) and the annual in-training examination scores (50% of the total score). These methods constitute the overall annual evaluation. In order to be promoted to the next year, the candidate is required to pass the end year examination, which is the annual in-training examination. This examination comprises of 100 multiple choice questions (MCQs) in year 1 and year 3 and 60% is required to pass. In year 2 and year 4, the assessment includes a written exam that is comprised of 100 MCQs each and a clinical oral exam that consists of clinical vignettes and a long case. The passing score for the written exam is 40% and 60% for the clinical oral component. However, the former does not reflect the relative weight of the written component. Surprisingly, there are no specific learning objectives for each year, and test blueprints are not used for test item construction and designing written examinations. Therefore, the purpose of this methodological paper is to describe a systematic approach, coupled with documentary and content analysis, to develop test blueprints for psychiatry residency in-training written examinations in Riyadh, Saudi Arabia.

Method

A descriptive qualitative study was conducted in the following three stages:

Development of test blueprints

Documentary and content analysis were used to develop test blueprints. The contents of these test blueprints were identified from different sources: (i) the booklet produced by American Board of Psychiatry and Neurology which describes part I summative examination;⁸ (ii) the Instructional Manual of the American College of Psychiatrists for the year 2006, which is used as a formative exam for the psychiatry resident in-training examination (PRITE);⁹ (iii) the contents of new MRCPsych examination from Royal College of Psychiatrists, UK,¹⁰ was used for summative exam purpose; and (iv) documents from the Saudi Board Training Program in Psychiatry, including an information booklet entitled Saudi Board of Psychiatry. These contents were organized into four global test blueprints. Two investigators (EMG and RAN) independently did the original abstraction of weighting the aforesaid four existing certification exams and any disagreement was discussed with other authors (KSA and RPS). All four of them were agreed on any conflicting weighting.

According to modified Bloom’s taxonomy, each test blueprint was comprised of contents representing the following cognitive categories: recall, interpretation and problem solving.¹¹ For each year, two formats of the test blueprints were developed: the global test blueprint, which is comprised of the main themes derived from contents, and the detailed test blueprint, which is comprised of the main themes as well as the subcategories.

A cover letter, along with the four global blueprints, was sent to seven consultant psychiatrists outside Riyadh for piloting. They were contacted by one of the investigators (EMG) and their verbal consent to participate was obtained. They were asked to provide written feedback on blueprints in terms of content areas, weightage for each area, and percentage of test items to be included in each cognitive category. They were also asked to critique, add, delete, and/or reorganize content.

Gathering the opinions of experts about the test blueprints

The test blueprints were modified after piloting. Eight psychiatrists from Riyadh were invited to participate as panelists. An expert was defined as a person who has national or international board certification in psychiatry, has at least 5 years postgraduate teaching experience in a specialty, at least 8 years clinical experience, professional status as a consultant, and is involved in the Saudi Board of Psychiatry as a member or as an examiner. The modified global test blueprints were hand-delivered to each expert with a cover letter explaining the task, along with a questionnaire for recording the demographic data.

The expert panelists were asked to provide written feedback on the modified blueprints regarding content areas, weightage for each area, and percentage of test items to be included in each cognitive category – recall, interpretation and problem solving – according to modified Bloom’s taxonomy.¹¹ They were also asked to critique, add, delete, and/or reorganize the content. Using an approach described earlier for the neurology content of a new occupational therapy course,¹² the written opinions were analyzed to determine the extent of consensus among the experts. A “modified” nominal group technique was used: the expert panel was grouped together in two sessions to further explore the written responses and reach consensus on each of the four blueprints in terms of content, total weightage for each content area, and percentage of test items to be included under each of the cognitive categories, which are recall, interpretation and problem solving.

Nominal group discussion

Six experts who provided the written opinion participated in the group discussion. One of the investigators facilitated the group activity and was assisted by a psychiatric senior registrar who documented the final responses of the panel. The tasks expectations were clarified, the collected written opinions were projected, and the group was asked whether they agreed or disagreed with the identified content areas, total weightage for each content area, and the percentage of test items allocated. A final consensus on the four global test blueprints was reached.

Results

Pilot studies on test blueprints developed

Two out of the seven consultants (29%) provided feedback by email. After piloting, the four “global” test blueprints were modified accordingly.

The modified test blueprints based on expert opinions

Six experts (75%), whose profile is given in Table 2, provided printed written feedback. Based on their feedback, the weightage for each content area, and percentage of test items to be included in each cognitive category – recall, interpretation and problem solving – were analyzed and transformed into tables of specification.

Table 2.

Profile of the panel experts

	Sex
4	Male
2	Female
	Specialty qualifications
4	National
2	International
	Years of teaching experience
3	5–10
2	11–15
1	≥16
	Professional/academic status
3	Consultant
1	Senior consultant
1	Assistant professor
1	Associate professor
	Years of clinical experience
–	5–10
4	11–15
2	≥16
	Involvement in Saudi board of psychiatry
6	Member
3	Examiner

The “modified” nominal group discussion

As a group, the six experts discussed and reached a final consensus on each of the four test blueprints. In all four global test blueprints, experts differed about the total weightage for each content area and the proportion of test items to be included in each cognitive category. The main themes in the final version of the blueprints were 14 for the first and second years and 15 for the third and fourth years. A consensus (90%) was achieved among experts regarding the total weightage for each content area and the proportion of test items to be included in each cognitive category based on modified test blueprints. Accordingly, the test blueprints, both global (see Tables 3–6) and detailed (appendix I to IV), were further modified.

Table 3.

Global test blueprint for the first year

Problem solving	Interpretation (%)	Recall (%)	Total weightage (%)	Content area
0	0	2	2	Introduction to psychiatry
1	2	5	8	Basic neurosciences
0	2	3	5	Classification of psychiatric disorders
1	2	3	6	Etiology of psychiatric disorders
3	3	2	8	Diagnostic procedures
1	2	4	7	Basic psychopharmacology
2	2	4	8	Somatic treatment methods
2	3	5	10	Adult psychiatric disorders
0	1	1	2	Personality disorders
1	1	2	4	Cognitive disorders
4	3	1	8	Psychiatric emergencies
0	7	8	15	Psychopathology
0	2	8	10	Basic psychology
(0)	(2)	(5)	(7)	Miscellaneous
0	1	2	3	Other basic sciences related to psychiatry.
0	0	2	2	– Ethics
0	1	1	2	– Basic statistics
15	32	53	100	Total

Table 6.

Global test blueprint for the fourth year

Problem solving (%)	Interpretation (%)	Recall (%)	Total weightage (%)	Content area
5	3	2	10	Psychosocial interventions
3	5	2	10	Research methods, evidence based practices, critical appraisal, and clinical information management
5	3	2	10	Public psychiatry
from the previous years (1, 2 and 3)
2	1	0	3	Diagnostic procedures
4	1	1	6	Child psychiatry
5	4	0	10	Adult psychiatric disorders
3	2	0	5	Substance use disorders
4	2	0	6	Consultation-liaison and psychosomatic medicine
3	1	0	4	Geriatric psychiatry
3	1	0	5	Forensic psychiatry
3	2	0	5	Personality disorders
3	0	0	5	Cognitive disorders
4	3	0	7	Somatic treatment methods and other treatment methods
4	1	0	5	Psychiatric emergencies
(5)	(3)	(1)	(9)	Miscellaneous
2	1	0	3	Psychotherapy
2	1	0	3	Ethics
1	1	1	3	Psychopharmacology
57	35	8	100	Total

Appendix I.

Detailed test blueprint for the first year

Content area	Total weightage (%)	Recall (%)	Interpretation (%)	Problem solving (%)
Introduction to psychiatry	2	2	0	0
History and development of psychiatry as medical science
Basic neurosciences	8	5	2	1
Neuroanatomy
Neurophysiology
Neuroendocrinology
Neuropathology
Genetics
Others
Psychiatric disorders classification	5	3	2	0
Historical background
Normality in mental health
Role of culture and religion in psychiatry
Dimensional vs categorical approaches
Etiology of the psychiatric disorders	6	3	2	1
Diagnostic procedures	8	2	3	3
Psychiatric interview and mental status examination
Biomedical laboratory testing
Psychological and neuropsychological testing
Diagnostic assessment and rating scales
Neurophysiological testing
Neuroimaging
Others
Basic psychopharmacology	7	4	2	1
Pharmacodynamics
Pharmacokinetics
Others
Somatic treatment methods	8	4	2	2
Pharmacotherapy of mental disorders (treatment guidelines, side effects, complications, etc)
Psychotropic drugs
ECT and other somatic treatments
Adult psychiatric disorders	10	5	3	2
Schizophrenia
Other psychoses
Mood disorders
– Bipolar affective disorders
– Major depressive disorders
– Others (postpartum, dysthymic, etc)
Anxiety disorders
– Obsessive compulsive disorders
– Generalized anxiety disorders
– Panic disorders
Adjustment disorders
Somatoform and factitious disorders
Dissociative disorders
Impulse-control disorders
Others
Personality disorders	2	1	1	0
Cognitive disorders	4	2	1	1
Delirium
Dementias
Amnestic syndrome
Mental disorders due to a general medical condition (including HIV)
Psychiatric emergencies	8	1	3	4
Suicide
Violent behavior
Treatment methods in emergency situations
Differential diagnosis in emergency situations
Others
Psychopathology	15	8	7	0
Basic psychology	10	8	2	0
Miscellaneous:	7
Behavioral and other basic sciences related to psychiatry	3	2	1	0
Bio statistics and research	2	1	1
Ethics	2	2	0	0
Total	100%	53	32	15

The expert panel suggested progressively decreasing the weightage for recall type of test-items and increasing interpretation/problem-solving type of test-items from year 1 to year 4 exams. This echoed the most pertinent part of Bloom’s taxonomy, which emphasizes the transition from mastery of facts to capacity for analysis as residents advance through years of training.

For any item of the test blueprints, 90% or more participants agreed. In addition, the four investigators themselves attempted to achieve nearly 100% final consensus on all items, including contents, weightage for each area, and percentage of test items. With regard to exceptions to some items, such as neurology and research, the final version of test blueprints weighting did not vary significantly from the original weighting. The authors feel that all three methods contributed fairly to the construction of the test blueprints.

Discussion

In developing test blueprints, three steps need to be considered.¹³ The first step is preparation of a list of the instructional objectives. The second step is preparation of course content outlines. The third step is designing a two-way chart that relates instructional objectives to instructional content. In this study, the first and third steps could not be achieved because the learning objectives for each year were not specified. Only course content outlines (second step) were available for the first and second years. The contents of the test blueprint were based on alternative documentary sources, including the Royal College of Psychiatrists, UK; the American Board of Psychiatry and Neurology; the American College of Psychiatrists;^8–10 and the Saudi Board Training Program in Psychiatry.

Relying upon documents or records in research studies has both advantages and disadvantages. The main advantage is that the data provided are rich, detailed, and readily available for use. It is inexpensive, both economically and in terms of time, to collect data. The limitations of using documentary analysis are missing or incomplete data, inaccuracies in material, and inherent biases. Another difficulty encountered by the researchers in analyzing documents is that often documents are presented and organized in different ways.^14,15

In this study, the documents used were prepared by professional organizations for different purposes – each with its own format, style, and content classification. The Royal College of Psychiatrists and The American Board of Psychiatry and Neurology^8,10 uses these for a single summative exam purpose; whereas, the American College of Psychiatrists⁹ uses these for a single formative exam purpose. In this study, the researchers used a documentary analysis approach, because there were no suitable checklists to be used at this stage of the study. Global test blueprints, one for each year, were used. Each table of specifications is comprised of three elements:⁷ contents, processes that are cognitive categories, and the importance of each showing proportion of test items to be included under each category.

According to this study, the researchers faced difficulty in categorizing divergent contents, which were primarily intended for a single exam purpose, into four test blueprints and exams. As a result, the Saudi Board Training Program in Psychiatry information booklet and content outlines, the Saudi Board experience of one of the researchers (EMG), and the expert panels’ opinion formed the bases on which the test blueprints were designed.

Both a global and detailed test format were developed each year. The detailed test blueprints, which were comprised of the main themes and subcategories, were identified to avoid confusion that could arise from divergent classifications. For example, the Royal College of Psychiatrists relied upon WHO classification, in terms of International Classification of Diseases (ICD 10), while the American Board of Psychiatry and Neurology and the American College of Psychiatrists relied upon the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) Revised Text. However, the Saudi Board Training Program in Psychiatry relies upon both classifications.

In the pilot study, the low response rate was perhaps due to the length of the tasks expected from experts. The experts were asked to provide written feedback about blueprints in terms of content, weightage, and proportion of test items to be included in each cognitive category; they were also expected to comment, add, delete and/or reorganize contents. An alternative explanation could be the unfamiliarity of respondents with Bloom’s old and revised taxonomy or with test blueprinting.

The experts’ opinion varied as to the contents to be included on each exam, weightage for topics, and proportion of test items in different cognitive categories. Webb and associates¹⁶ reported similar findings when they sought the training directors’ opinions about psychiatry residents’ in-service training exam. This finding can be explained by the diverse training background and clinical experience of experts. Two were British graduates, one is a current academic staff member, two are former academic staff members, and three were clinical in-service providers. There were also divergent views about the competencies that residents were expected to master. For example, one of the experts suggested that 15% of the test items be allocated to research methods in the second year, whereas another expert suggested only 2% and justified his views by asserting that, when compared to researchers, the residents who are expected to provide services in hospitals need to master clinical topics such as adult psychiatry. Another explanation could be the experts’ awareness that there is only one assessment method, MCQs, that is used in the first and third years of the residency program. In addition to being an expert in the subject area they are assessing, Osterlind⁷ emphasized the need for training judges in the expected task of test blue printing as an important criterion.

There was a unanimous consensus on all content areas suggested to be included in each test blueprint with the exception of neurology. According to the head of the local committee of Psychiatry Residency Training Program at Riyadh, no test items on neurology should be included in the exam paper, even though neurology is an obligatory rotation during the second year of the residency program. This finding contradicts the recommendation that the instructional time should be based on relative curriculum weightage.^2,17 Although residents undergo a three month rotation in neurology, no test items were included in the examinations.

Several caveats of the study need to be considered. Perhaps it is useful to further refine the test blueprints in terms of specific learning objectives rather than content. Furthermore, these learning objectives need to consider test blueprinting from a broader perspective to include knowledge, skills, and attitude domains. The poor response rate (29% of participants provided feedback during pilot study) reflected another weakness. These have ramifications in terms of appropriate instructional methods for instructors and learning strategies for residents. According to some academicians, the role of learning and rotation specific objectives for residents training, although important but not highlighted in this research, needs to be fully addressed in future studies on test blueprints development. The generalizability issue is also pertinent. The researchers are of the opinion that the methodology described is useful, appropriate for any test blueprint designing, especially for in-service assessment of postgraduate residents, in order to render the evaluation process educationally sound and rational. The specifics of content, instruments and weightage can be determined by keeping in mind the program goals and institutional mission and vision.

Another pertinent issue is the use of the modified nominal group technique (NGT), which shortens the process from 2–3 hours (classic NGT and other types of group discussions) to 90 minutes. This increases the practicality of the exercise and is used to elicit feedback from groups of six to 40 experts or learners. Participation in the modified NGT evaluation can be mandatory or voluntary. Every individual contributes equally to the exercise, and the nonjudgmental process encourages individuals to give honest observations and constructive criticisms. The modified NGT has some other advantages; it produces rank-ordered, weighted, semi-quantitative data on learners’ perceptions of the strengths and weaknesses of a course; generates both positive and negative feedback; and minimizes the influence that a “vocal minority” of learners with strong opinions can have in typical focus-group settings. The modified NGT is a valuable tool that may be used to evaluate both new curricula and established courses or programs. Most importantly, the modified NGT reflects more consensus and greater understanding of reasons for disagreement. On the other hand, the Delphi approach has greater reliability and can be combined with the NGT for developing a hybrid method.^18,19

Conclusion

A systematic approach used to develop test blueprints is appropriate and is advocated. Using test blueprints will guide the test developer on how many items are to be selected for the test, the types of content being tested, and the range of competencies addressed. Test blueprinting is an important step for ensuring test validity in all residency programs including psychiatry.

Recommendations

1. In order to enhance the response rate of experts, the planners need to use strategies for the development of test blueprints for residents in training exams in psychiatry or other specialties in future. One such option recommended by some academicians is to combine expert panelists and local experts in the group discussion.

2. When the test blueprints for any specialty are designed, the teaching and learning objectives should be broad based, comprehensive, and precisely addressed. The objectives of postgraduate medical education may include competency-based residency training including medical knowledge, medical sciences, research, clinical skills, advocacy, leadership, professionalism, communication, outcomes, and system-based practice. A tailored test blueprint should enable tutorial interaction between experts and resident and between peers. It should also enhance self-directed learning. Overall, clinical, training, and research competency development topics need to be integrated into a test blueprints meant for postgraduate medical education.

3. In a related development, it remains unascertained how the MCQs are constructed from tailored blueprints for postgraduate medical training. From training and examination perspectives, this will be research to be conducted in future.

Special note

Critics of Bloom’s taxonomy of learning objective

Some researchers criticized the Bloom’s classification because it was not a properly constructed taxonomy, as it lacked a systemic rationale of construction.²⁰ This was subsequently acknowledged by Anderson and colleagues in the revision of the taxonomy and the taxonomy reestablished on more systematic lines.²¹ Some critiques of cognitive domain admitted the existence of these six categories, but questioned the existence of a sequential, hierarchical link.²² Also, the revised edition of Bloom’s taxonomy has moved Synthesis in higher order than Evaluation. Some consider the three lowest levels as hierarchically ordered, but the three higher levels as parallel.²¹

Table 4.

Global test blueprint for the second year

Problem solving (%)	Interpretation (%)	Recall (%)	Total weightage (%)	Content area
1	4	5	10	Substance use disorders
4	4	2	10	Consultation-liaison and psychosomatic medicine
1	1	2	4	Geriatric psychiatry
0	2	3	5	Research methods, and evidence based psychiatry
0	2	3	5	Clinical psychology
(from the previous year) (1)
4	2	1	7	Psychopathology
3	2	0	5	Etiology of the psychiatric disorders
3	2	0	5	Diagnostic procedures
5	3	2	10	Somatic treatment methods and other treatment methods
8	5	2	15	Adult psychiatry
1	2	2	5	Personality disorders
2	2	1	5	Cognitive disorders
5	3	0	8	Psychiatric emergencies
(0)	(3)	(3)	(6)	Miscellaneous
0	2	1	3	Ethics
0	1	2	3	Other conditions that may be a focus of clinical attention
37	37	26	100	Total

Table 5.

Global test blueprint for the third year

Problem solving (%)	Interpretation (%)	Recall (%)	Total weightage (%)	Content area
5	5	5	15	Child psychiatry
1	1	2	4	Sleep disorders
4	2	2	8	Forensic psychiatry
1	1	1	3	Eating disorders
2	2	1	5	Sexual and gender identity disorders
6	4	2	12	Psychotherapy and rehabilitation
From the previous years (1 and 2)
3	2	0	5	Substance use disorders
3	2	1	6	Research methods, and evidence based practices
6	3	2	11	Consultation-liaison and psychosomatic medicine
3	2	1	6	Somatic treatment methods and other treatment methods
6	3	1	10	Adult psychiatric disorders
2	0	0	2	Geriatric psychiatry
2	0	0	2	Cognitive disorders
3	0	0	3	Psychiatric emergencies
(5)	(2)	(1)	(8)	Miscellaneous
1	0	0	1	Diagnostic procedures
3	0	0	3	Ethics
1	0	0	1	Etiology of the psychiatric disorders
0	2	1	3	Culture-bound syndromes
52	29	19	100	Total

Appendix II.

Detailed test blueprint for the second year

Content area	Total weightage (%)	Recall (%)	Interpretation (%)	Problem solving (%)
Substance use disorders	10	5	4	1
Alcohol
Benzodiazepine and other sedative hypnotics
inhalants
Marijuana
Opiates
Stimulants
Others
Consultation-liaison and psychosomatic medicine	10	2	4	4
Geriatric psychiatry	4	2	1	1
Research methods, evidence based psychiatry	5	3	2	0
Clinical psychology	5	3	2	0
From the 1st year
Psychopathology	7	1	2	4
Etiology of the psychiatric disorders	5	0	2	3
Diagnostic procedures	5	0	2	3
Psychiatric interview and mental status examination
Biomedical laboratory testing
Psychological and neuropsychological testing
Diagnostic assessment and rating scales
Neurophysiological testing
Neuroimaging
Others
Somatic treatment methods and other treatment methods	10	2	3	5
Pharmacotherapy of mental disorders
Psychotropic drugs
ECT and other somatic therapies
Psycho-social interventions
Others
Adult psychiatric disorders	15	2	5	8
Schizophrenia
Other psychoses
Mood disorder
– Bipolar affective disorders
– Major depressive disorders
– Others (postpartum, dysthymic, etc)
Anxiety disorders
– Obsessive compulsive disorders
– Generalized anxiety disorders
– Panic disorders
Adjustment disorders
Somatoform and factitious disorders
Dissociative disorders
Impulse-control disorders
Others
Personality disorders	5	2	2	1
Cognitive disorders	5	1	2	2
Delirium
Dementias
Amnestic syndrome
	Mental disorders due to general medical conditions (including HIV)
Psychiatric emergencies	8	0	3	5
Suicide
Treatment methods in emergency situations
Differential diagnosis in emergency situations
Others
Miscellaneous	(6)
Ethics (professional behavior-malpractice)	3	2	1	0
Other conditions that may be a focus of clinical attention	3	1	2	0
Total	100%	26	37	37

Appendix III.

Detailed test blueprint for the third year

Content area	Total weightage (%)	Recall (%)	Interpretation (%)	Problem solving (%)
Child psychiatry	15	5	5	5
Assessment of child and adolescent
Disorder first diagnosed in infancy, childhood, or adolescence
Mental retardation
Learning disorders
Communication disorders
Behavior disorders
Pervasive developmental disorders
Elimination disorders
Feeding and eating disorders
Tic disorders
Autism and psychotic disorders
Mood and anxiety disorders
Child abuse
Attention-deficient and disruptive disorders
Principles of treatment (psychopharmacology andpsychotherapy)
Childhood disorders that persist into adolescence and adulthood
Others
Sleep disorders	4	2	1	1
Insomnia and parasomnia
Sleep apnea
Others
Forensic psychiatry	8	2	2	4
Confidentiality
Competence
Criminality issues
Others
Eating disorders	3	1	1	1
Anorexia nervosa
Bulimia nervosa
Obesity
Sexual and gender identity disorders	5	1	2	2
Paraphilias
Sexual dysfunction
Gender identity disorder
Psychotherapy and rehabilitation	12	2	4	6
Supportive
Cognitive and behavior
Crisis intervention
Couples and family
Others
From the previous years’ content
Substance use disorders	5	0	2	3
Research methods, evidence based psychiatry	6	1	2	3
Consultation-liaison and psychosomatic medicine	11	2	3	6
Somatic treatment methods and other treatment methods	6	1	2	3
Pharmacotherapy of mental disorders
Psychotropic drugs
ECT and other somatic therapies
Psycho-social interventions
Others
Adult psychiatric disorders	10	1	3	6
Schizophrenia
Other psychoses
Mood disorder
Anxiety disorders
Adjustment disorders
Somatoform and factitious disorders
Dissociative disorders
Impulse-control disorders
Others
Geriatric psychiatry	2	0	0	2
Cognitive disorders	2	0	0	2
Delirium
Dementias
Amnestic syndrome
Others (mental disorder due to a generalmedical condition)
Psychiatric emergencies	3	0	0	3
Suicide
Violent behavior
Treatment methods in emergency situations
Differential diagnosis in emergency situations
Miscellaneous	(8)	(1)	(2)	(5)
Diagnostic procedures	1	0	0	1
Ethics	3	0	0	3
Etiology of psychiatric disorders	1	0	0	1
Culture bound syndromes	3	1	2	0
Total	100%	19	29	52

Appendix IV.

Detailed test blueprint for the fourth year

Content area	Total weightage (%)	Recall (%)	Interpretation (%)	Problem Solving (%)
Psychosocial interventions	10	2	3	5
Psychoeducation
Rehabilitation
Relapse prevention
Community-based treatment programs
Others
Research methods, evidence-based practices, Critical appraisal, and clinical information management	10	2	5	3
Public psychiatry	10	2	3	5
Community mental health center factors
Prevention (primary, secondary, and tertiary)
Deinstitutionalization
Outpatient commitment program
Other (homeless mentally ill people, psychogeriatriclong-term care)
From the previous years’ content
Diagnostic procedures	3	0	1	2
Child psychiatry	6	1	1	4
Assessment of child and adolescent
Disorders first diagnosed in infancy, child hood, or adolescence
Mental retardation
Learning disorders
Communication disorders
Behavior disorders
Pervasive developmental disorders
Elimination disorders
Feeding and eating disorders
Tic disorders
Autism and psychotic disorders
Mood and anxiety disorders
Child abuse
Attention-deficient and disruptive disorders
Treatment principles (psychopharmacology and psychotherapy)
Childhood disorders that persist into adolescence andadulthood
Others
Adult psychiatric disorders	10	0	4	6
Schizophrenia
Other psychoses
Mood disorders
Anxiety disorders
Adjustment disorders
Somatoform and factitious disorders
Dissociative disorders
Impulse-control disorders
Others
Substance use disorders	5	0	2	3
Consultation-liaison and psychosomatic medicine	6	0	2	4
Geriatric psychiatry	4	0	1	3
Forensic psychiatry	5	0	2	3
Personality disorders	5	0	2	3
Cognitive disorders	5	0	2	3
Somatic treatment methods and other treatment methods	7	0	3	4
Psychiatric emergencies	5	0	1	4
Suicide
Violent behavior
Treatment methods in emergency situations
Differential diagnosis in emergency situations
Others
Miscellaneous	(9)	(1)	(3)	(5)
Psychotherapy	3	0	1	2
Ethics	3	0	1	2
Etiology of the psychiatric disorders	3	1	1	1
Total	100%	8	35	57