Abstract
The transition from a pre-clerkship curriculum to the clerkship year presents a need to re-examine and modify study strategies for clinical subject examinations and ultimately the United States Medical License Examination STEP 2 Clinical Knowledge. Efficient and effective learning are keys in balancing the significantly increased responsibility of patient care and decreased time for examination preparation.
We describe several customizable study approaches, advice on selecting resources, and methods for applying the educational framework of deliberate practice and corrective feedback to learning during a medical student’s clerkship years. These strategies focus on intentional and outcome-driven self-assessments to identify and patch knowledge gaps tailored to the clerkship year that will empower learners.
Abstract
Le passage du programme de préexternat à l’année d’externat exige que les étudiants revoient leurs stratégies d’étude pour les examens de matières cliniques et, à terme, pour l’examen STEP 2 Clinical Knowledge du United States Medical License Examination. Un apprentissage efficace et efficient est essentiel pour trouver un équilibre entre l’importante augmentation des responsabilités de soins aux patients et la diminution du temps consacré à la préparation des examens.
Nous proposons aux étudiants en médecine plusieurs approches d’étude personnalisables, ainsi que des conseils sur la sélection de ressources et méthodes pour appliquer le modèle éducatif de la pratique délibérée et de la rétroaction corrective à leur apprentissage pendant les années d’externat. Ces stratégies, adaptées à l’année d’externat, sont focalisées sur l’autoévaluation intentionnelle et axée sur les résultats pour repérer et combler les lacunes en matière de connaissances. Elles aideront les apprenants à se sentir en confiance de leurs moyens.
Introduction
Transitioning from the pre-clerkship to clinical phase of medical school can be challenging.1-3 While pre-clerkship curricula are generally classroom-centered, clerkships are completed in the hospital where students participate in and learn from patient care while also preparing for clinical knowledge assessments, which include the National Board of Medical Education (NBME) clinical science subject examinations (SHELF). The limited time available to prepare for these examinations means that learners must be able to self-direct their learning, reflect on their effectiveness, and implement changes to improve their performance.1
Most clinical curricula focus on patient care and diagnostics, both of which aid in SHELF examination preparation, but are not specifically geared toward it. Moreover, with long clinical hours students have limited time for studying. As a result, many learners find that study strategies they used in the pre-clerkship setting are no longer successful. This results in increased stress, frustration, and ultimately ineffective retention of material.
Research describing examination preparation strategies under these circumstances is limited, but often contains themes of deliberate practice and corrective feedback.4 Activities geared toward improving one’s performance combined with feedback aimed to enhance learning and retention help create successful strategies.5,6 Guided by this framework, YH created two methods to combat the roadblocks above.7-10 First is recognition and correction of weak topics via Self-assessment, Identification, and Patching of knowledge gaps (SIP). These are topics in which the learner frequently misses questions or lacks understanding. Second is intentional acquisition and retention using Goals, Means, and Outcomes (GMO). These strategies work together to develop a goal that is feasible, manageable, and measurable within the time available.11
Here, we describe four ways to create an integrated approach for developing effective study habits for clinical examinations, as well as examples of their implementation from the experiences of two learners at different medical schools (CZ and HJ).
How to get a grip on studying during the clerkship years
1. Be the boss of question banks
Question banks are among the most popular tools for learners. In Uworld, questions are organized by organ systems. Therefore, a systems-based approach allows for targeted assessment (e.g., learning about Gastrointestinal (GI) is followed by self-assessing GI). Initially focusing on subtopics within a discipline (e.g., hepatic disorders) can aid in the initial self-assessment of knowledge. This strategy is more conducive for learners to assess what they have learned and patch gaps before combining topics. Analysis of missed questions within each self-assessment is critical. For example, a systematic breakdown of missed questions allows learners to identify which topics to focus their efforts on to maximize their effectiveness (Figure 1).
Figure 1.
An example of analyzing performance data using the pivot table function in an excel sheet. Learners can directly import the missed questions on a question bank, already organized by ID, Subject, Systems, Topics, % correct others, Time spent, and Time spent others onto an excel document. In this example, the data shows the number of missed questions organized in each system, and the topics within the systems.
Diagnosis is a high-yield topic assessed on clinical examinations. One method of analyzing diagnostic errors in questions is to create comparison tables, focusing on key differences between diagnoses. For example, when author CZ incorrectly selected schizophreniform disorder in a question involving the diagnosis of schizophrenia, she did not differentiate duration of symptoms as a key diagnostic criterion. Therefore, she created a table comparing the two diseases to emphasize this difference.5 Active processes such as this provide an additional layer of engagement and understanding.
2. Be intentional with self-assessment
STEP 2 CK is more comprehensive and challenging in comparison to single-subject SHELF examinations. In preparation, it is important to reflect on strategies used for SHELF examinations by reviewing and analyzing longitudinal performance data from question banks.
An example best demonstrates the application of SIP and GMO in this context. In preparation for STEP 2 CK, HJ utilized her performance in UWorld to identify Family Medicine as a weak subject from her clerkship year. She further identified her weakest subtopics using past performance data to help her create a study plan using the GMO framework. Her method was to select questions and learn from both incorrect and correct answers, supplementing with textbooks or videos if needed. After reaching her outcome (70% correct), she could move these topics from her “weak topics'' list and shift focus to other lower-scoring areas. Through these methods, she drastically improved her performance and surpassed her SHELF performance on STEP 2 CK.
3. Select individualized resources
Resource selection is largely based on students’ past experiences and time constraints. One example is texts such as First Aid for Step 2 CK, Step Up, or Case Files.13-15 These books consist of topic descriptions and questions aimed to assess understanding of the material. Another example is videos, such as Online MedEd, which focuses on the key differentiating features of similar diseases, as well as pathophysiology, diagnosis, and treatment.
Flashcards (Anki), can be helpful for retaining details quickly and efficiently, as well as for quick self-assessment. HJ selected cards from premade decks based on her weaker topics, which allowed her to create a customized resource. CZ preferred to utilize cards to train herself to identify key features that differentiated diagnoses, treatments, etc. For example, if a card emphasized that the patient with chest pain also has a nosebleed, it triggered her to ask why this detail was mentioned.
No matter the resource selected, monitoring its effectiveness through self-assessments, which both first authors found to be the most useful tool, is essential and can be made more efficient through SIP and GMO. It also allows learners to practice in the format that they will be assessed.
4. Manage time
Managing time while on clinical rotations can be difficult. Creating a feasible strategy and breaking material into segments is key. When it comes to question banks, dividing the total questions in one category by days on a rotation gives a rough framework of time that should be spent daily on examination preparation. Reviewing content from incorrect questions and re-testing missed concepts should occur parallel to this process to monitor for weaker topics and evaluate effectiveness.
Final thoughts
Transitioning from pre-clerkship to clinical curricula creates an opportunity to revamp strategies for knowledge acquisition, retention, and time management. Utilizing GMO and SIP within the framework of deliberate practice, corrective feedback, and reinforcement, we have provided strategies that can be customized to individuals for their clerkship year. Continued efforts in self-reflection and deliberate practice while incorporating corrective feedback are learning skills which can improve a student’s performance on future examinations.
Funding Statement
Funding: None.
Conflicts of Interest
None.
Authorship
Dr Johnston and Miss Zhao are co-first authors for this submission.
References
- 1.O’Brien B, Cooke M, Irby DM. Perceptions and attributions of third year learner struggles in clerkships: do learners and clerkship directors agree? Acad Med. 2007; 82(10):970-8. 10.1097/ACM.0b013e31814a4fd5 [DOI] [PubMed] [Google Scholar]
- 2.Prince K, Boshuizen H, van der Vleuten C, Scherpbier A. Students’ opinions about their preparation for clinical practice. Med Educ. 2005; 39(7): 704-12. 10.1111/u.1365-2929.2005.02207. [DOI] [PubMed] [Google Scholar]
- 3.Surmon L, Bialocerkowski A, Hu W. Perceptions of preparedness for the first medical clerkship: a systematic review and synthesis. BMC Med Educ. 2016; 16:89. 10.1186/s12909-016-0615-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Volk AS, Rhudy AK, Marturano MN, et al. Best study strategy for the NBME clinical science surgery exam. J Surg Educ. 2019; 76(6): 1539-45. 10.1016/j.surg.2019.05.012. [DOI] [PubMed] [Google Scholar]
- 5.Eder T, Richter J, Scheiter K, et al. How to support dental students in reading radiographs: effects of a gaze-based compare-and-contrast intervention. Adv Health Sci Educ Theory Pract. 2021; 26(1): 159-81. 10.1007/s10459-020-009974-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Simonian MJ, Brand D. Assessing the efficacy of and preference for positive and corrective feedback. J Appl Behav Anal. 2022. Jun; 55(3): 727-45. 10.1002/jaba.911. [DOI] [PubMed] [Google Scholar]
- 7.Ericsson KA, Krampe RT, Tesch-Romer C. The role of deliberate practice in the acquisition of expert performance. Psychological Review. 1993; 100(3): 363-406. 10.1098/rsos.190327. [DOI] [Google Scholar]
- 8.Ericsson KA. Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice. Acad Med. 2015; 90(11): 1471-86. 10.1097/ACM.0000000000000939. [DOI] [PubMed] [Google Scholar]
- 9.Davila-Cervantes A, Foulds JL, Gomaa NA, et al. Experiences of faculty members giving corrective feedback to medical trainees in a clinical setting. J Contin Educ Health Prof. 2021; 41(1): 24-30. 10.1097/CEH.0000000000000322 [DOI] [PubMed] [Google Scholar]
- 10.Zhao C, Hu Y. Reflections on study strategy modifications using cognitive load theory and dual processing theory in the first year of medical school. Med Sci Educ. 2021; 31: 813-18. 10.1007/s40670-020-01198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Borsheim B, Ledford C, Zitelny E, et al. Preparation for the United States medical licensing examinations in the face of COVID-19. Med Sci Educ. 2020; 30(3): 1267-1272. 10.1007/s40670-020-01011-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Garino A. Ready, willing and able: a model to explain successful use of feedback. Adv Health Sci Educ Theory Pract. 2020; 25(2): 337-61. https://link.springer.com/article/10.1007/s10459-019-09924- [DOI] [PubMed] [Google Scholar]
- 13.Le T, Bhushan V, Deol M, et al. First Aid for the USMLE Step 2 CK, Tenth Edition. New York: McGraw-Hill Education; 2018. https://www.mhebooklibrary.com/doi/book/10.1036/9781260440300 [Google Scholar]
- 14.Agabegi ED, Agabegi SS. Step-Up to Medicine. 4th ed. Philadelphia: Wolters Kluwer; 2016. [Google Scholar]
- 15.Toy EC, Briscoe D, Britton B, et al. Case files: family medicine. 5th ed. New York: McGraw Hill Education; 2020. https://accessmedicine.mhmedical.com/cases.aspx?groupid=373. [Google Scholar]

