Skip to main content
PMC home page
BMC Medical Education logoLink to BMC Medical Education
. 2018 Mar 27;18:46. doi: 10.1186/s12909-018-1157-7

Early musculoskeletal classroom education confers little advantage to medical student knowledge and competency in the absence of clinical experiences: a retrospective comparison study

Derek Khorsand 1, Ansab Khwaja 2, Gregory A Schmale 3,✉
PMCID: PMC5870478  PMID: 29580252

Abstract

Background

Deficiencies in medical student knowledge in musculoskeletal medicine have been well documented. To address these deficiencies, numerous curricular changes at our institution were instituted. The objective of this study was to determine whether medical students in their preclinical years benefit from early exposure to musculoskeletal medicine when compared to students exposed to musculoskeletal medicine just prior to completion of their preclinical curriculum.

Methods

United States Medical Licensing Examination (USMLE) Step 1 and 2 scores were compared for periods of time before and after institution of the new curriculum. Scores on the previously validated 24-question short answer survey from Freedman and Bernstein were also compared over these same periods of time between these two groups and to established standards for competency, using a student’s two-tailed unpaired t-test for significance. Entering Medical College Admission Test (MCAT) scores were used to compare baseline preparation of students.

Results

Overall USMLE scores as well as scores on the USMLE subtest on Musculoskeletal, Skin and Connective Tissue Disease showed no improvement when scores were compared between the two groups of students. There was a statistically significant lower performance on the Freedman and Bernstein knowledge assessment exam for students in the new pre-clinical curriculum as compared to those introduced under the old model, considering both musculoskeletal knowledge (p < 0.001) and proficiency (p < 0.01), though the response rate on the recent survey was low (112/986 or 11%). Spine remained the least understood sub-topic, while a dedicated course in rheumatology likely contributed to increased student knowledge in that area. Additional exposure to musculoskeletal topics during the clinical years increased student knowledge. There was no difference between groups when comparing entering MCAT scores.

Conclusions

Classroom curricular changes, including moving the introductory musculoskeletal course to the first year, intended to optimize musculoskeletal medicine education in the pre-clinical years of medical school did not appear to improve student musculoskeletal knowledge at any year of training. Further efforts to improve the education of medical students in musculoskeletal medicine should be directed towards providing more clinical experiences with patients having musculoskeletal concerns. This was a retrospective comparative study, level III evidence.

Keywords: Musculoskeletal medicine, Musculoskeletal education, Medical education

Background

Musculoskeletal problems number among the most frequent seen by primary care providers [1–4], yet US medical school instruction in musculoskeletal medicine has been found to be absent [4–6] or inadequate [7–13] by many. Low confidence in treating musculoskeletal problems and performing basic treatments for these complaints was seen in surveys of many primary care physicians [14–17]. Reported changes to medical school pre-clinical curricula in musculoskeletal medicine to address these deficiencies have included introducing basic introductory courses where none previously existed [18, 19], designing courses that mixed small groups with large-group lecture instruction, including instruction in physical exam [13, 18, 20], using interactive seminars where small group instructors were few in number in place of or to supplement didactic lecture sessions [21–23], and providing instruction in clinical history-taking and physical examination to a degree allowing for student evaluation using Objective Structured Clinical Examinations to encourage and evaluate student progress [24–26].

Highly successful musculoskeletal medicine pre-clinical courses have typically included a mix of two or more instructional formats, with frequent framing of common problems using clinical scenarios, in small group settings led by clinicians, typically preceded by an anatomy course studying the spine and extremities [27, 28], or have included musculoskeletal anatomy instruction reinforced by review of common and pertinent clinical correlations [18, 20, 29–31]. This latter description best matches our curriculum.

The medical school’s history

Until recently, ours was the only medical school in a five state area. First year students from each of the five states took their first year basic science courses within their home state, coming to the main campus for their second year organ-system based courses. Each medical school class between 2010 and 2013 consisted of about 250 students, an increase of 70 students from 2003, counting students at all sites. Third-year clerkships were primarily conducted at the main campus, though electives were offered in each state. The introductory course in musculoskeletal medicine was originally a second-year course, residing in the organ-system curriculum, but because of staffing challenges at the outlying sites, pressure came to bear to move the course to the first year of the medical school curriculum, which occurred in the 2009-2010 academic year. USMLE Board exams were taken at the end of the second year (Step 1) and after completion of required clerkships - during the fourth year (Step 2).

An assessment of medical student knowledge and competence in musculoskeletal medicine was conducted in the early 2000’s at our institution [9]. That study revealed a generally unsatisfactory foundation in musculoskeletal medicine for the majority of our students, with the exception of those who went on to participate in clerkships in their clinical years with emphases in musculoskeletal medicine. In response, a working group was formed in 2006 to evaluate our current state and make recommendation to the Dean of Curriculum, following an evaluation and curriculum-planning model as described by Bordage [32]. Being constrained in our number of course meeting hours, and without the benefit of a required clerkship or clinical experience in musculoskeletal medicine, we sought to enrich our students’ pre-clinical experiences via institution of a number of large and small changes to our curriculum:

  1. Small group meetings focused on the musculoskeletal living anatomy and common pathologies were modified via institution of a Team-Based Learning (TBL) environment for musculoskeletal clinical problem solving [33, 34], designed to take advantage of clinical instructors in small group settings with case-based scenarios. The format included the addition of a 6-8 question pre-class on-line quiz relating to clinical correlations, to be completed in class as a graded 4-student exercise, followed by larger group (12-16 students) debate and discussion. TBL became the major teaching tool used in many courses through the first two years of the medical school curriculum beginning in approximately 2008.

  2. Physical exam videos of the spine and extremities were prepared by clinical instructors using professional videographers, to assist students in better learning examination of the musculoskeletal system, available at all sites through the course web-site.

  3. Objective Structured Clinical Examinations (OSCEs) were introduced, more than 50% of which included a case with a musculoskeletal focus [24], given twice to second-year students and once to fourth year students.

  4. A short 2-3 day required rheumatology course in the second year was instituted that included both classroom and clinical experiences.

Soon thereafter, the administration countered with the additional plan of moving the required pre-clinical course in musculoskeletal medicine from the second pre-clinical year to the first, to shift all anatomy teaching into the first year. The hope was that early exposure would lead to a foundation that could grow with future musculoskeletal experiences in pre-clinical electives and clinical clerkships.

Though all students participated in a limited clinical preceptorship during the initial two pre-clinical years during both the old and new curricula, in clinics where care of patients with musculoskeletal problems may have occurred, this exposure was neither routine nor predictable. Classroom instruction in examination of the shoulder and knee routinely occurred late in the second-year and was not routinely coordinated with the musculoskeletal system class.

With the move of the required musculoskeletal medicine course from the second to the first year, neither were the total number of contact hours changed (39 h), nor was the breakdown of hours by large-group, small group discussion, or dissection changed. The faculty remained essentially constant for approximately 50% of students. The other 50% of students obtained their musculoskeletal introductory course instruction from a cadre of basic science and clinical instructors utilizing similar educational materials at the five separate sites where our first year medical school classes are taught. The curriculum, learning objectives, and examinations remained the same across all sites. The School of Medicine is highly regarded for the training it provides students and residents in primary care, with Primary Care ranked highly for over 20 years by US News and World Report [35].

In the time since this follow-up study was conducted, the School of Medicine has radically altered the curriculum of the first two years, condensing it into an 18-month Foundations of Science training phase, combining subjects into theme-based organizations known as “blocks”, adding numerous case scenarios to each block. The timing and duration of exposure to topics in musculoskeletal medicine in this newest curriculum currently remains in flux.

We examined the results of curricular changes instituted between 2005 and 2010 on student musculoskeletal knowledge and subject proficiency, with the hope and expectation that these changes would result in an improvement in student understanding in musculoskeletal medicine. We posed the following questions:

  • ○ Did the move to teaching musculoskeletal medicine to the first year of the medical school curriculum, in combination with focusing the small group experience and offering instruction and testing in the musculoskeletal examination, result in increased student knowledge and proficiency, and improve the retention of musculoskeletal knowledge into the clinical years?

  • ○ Should further efforts to improve musculoskeletal medicine education focus on ensuring clinical experiences in musculoskeletal medicine?

Methods

The academic performance of medical students from one institution was established by comparing their United States Medical Licensing Examination (USMLE) Step 1 and Step 2 overall and sub-test means with national averages for the periods 2001-2003 to 2010-2013. In addition, all students enrolled in the School of Medicine in spring quarter of 2013 were invited to participate in a musculoskeletal knowledge assessment via e-mail to all members of each medical school class. A reminder e-mail was sent to all approximately one week after the initial invitation. No incentive was offered to complete the survey. An online version of the 24-question short-answer musculoskeletal medicine survey by Freedman and Bernstein [36] was given to those electing to participate, the study having been approved by our institutional review board. The survey has been validated by 100 orthopedic program directors [36] and 240 internal medicine program directors [37] across the country. All students in the recent survey received musculoskeletal training under our new curriculum, with the introductory course occurring in the first year of medical school, followed by a focused second year rheumatology unit. Proficiency was set at 70% or greater of questions answered correctly, as previously defined [37]. The results of this survey were compared to data from the same survey obtained from medical students at our institution while the musculoskeletal course was taught during the second year of medical school over the 2001-2002 and 2002-2003 academic years [9]. Comparisons were made using a student’s two-tailed unpaired t-test for significance. The cohorts were compared by years elapsed since taking the introductory musculoskeletal medicine course, on the assumption that the greatest impact on student knowledge and proficiency in musculoskeletal topics would be related to timing of this course, as opposed to the other curricular changes.

Student preparation and readiness for the introductory unit in musculoskeletal medicine was assessed via a mean composite Medical College Admission Test (MCAT) score for each entering class. These scores were then compared between the two groups using the student’s two-tailed unpaired t-test for significance.

Results

Between 2010 and 2013, our medical students tended to score at or near the national average on the Steps 1 and 2 of the USMLE: Step 1 overall means equal to the national average, with subtest means ranging from 0.4 standard deviations above to 0.3 standard deviations below the national averages; Step 2 overall means equal to the national average, with subtest means ranging from 0.5 standard deviations above to 0.4 standard deviations below the national averages. Results on the Musculoskeletal, Skin, and Connective Tissue Diseases subtest revealed scores equal to the national average, ranging from 0.2 standard deviations above to 0.2 standard deviations below the national average. These recent scores were perhaps slightly lower than scores ten years earlier (2001-2003), when our mean scores were greater than the national averages (at least two points or 0.1 standard deviations) on five of six Step 1 and Step 2 USMLE sub-tests, including the Musculoskeletal, Skin, and Connective Tissue Diseases subtest of the Step 2 USMLE, where scores were above the national average by 0.1 – 0.3 standard deviations.

The survey of student musculoskeletal knowledge conducted on-line through a web-based questionnaire had a response rate of 11% (112/986). When looking at the combined student scores, there was a statistically significant higher overall performance for students first exposed to musculoskeletal medicine during the second year of medical school compared to the those students first exposed to musculoskeletal medicine during the first year of medical school (61% correct combined overall average scores for students exposed to musculoskeletal medicine during their second years vs. 54% correct for students exposed to musculoskeletal medicine during their first years, p < 0.001). Only 12% of students overall were seen to achieve proficiency in musculoskeletal medicine knowledge when exposed during their first year as opposed to 27% achieving proficiency when exposed during their second years (p = 0.01). Students exposed to musculoskeletal medicine during their first year of medical school who were more than one year out from that course achieved an average 48% correct with 5% achieving proficiency, compared to 54% correct with 14% achieving proficiency for students at a similar stage of training first exposed to musculoskeletal medicine during their second year of medical school (p = 0.09 and 0.13 respectively, Figs. 1 and 2).

Fig. 1.

Fig. 1

Open in a new tab

Comparison of student performance by curriculum based on time elapsed since instruction

Fig. 2.

Fig. 2

Open in a new tab

Comparison of student proficiency by curriculum based on time elapsed since instruction

Students exposed to musculoskeletal medicine during their first year who were more than two years out from that course, achieved an average 56% overall correct, with 14% of students achieving proficiency, compared to 67% correct with 43% achieving proficiency for students at a similar stage of training first exposed to musculoskeletal medicine during their second year (p = 0.004 and 0.001 respectively, Figs. 1 and 2).

Students first exposed to musculoskeletal medicine during their first year who had taken an elective clerkship with a musculoskeletal focus during their third or fourth years scored significantly higher than students without these clinical experiences (63% vs. 53%, p = 0.047), similar to previous results (77% vs. 65%, p < 0.006) [9] reinforcing the notion that the most effective learning of musculoskeletal medicine appears to occur in the clinic.

The addition of a two-day rheumatology-teaching event during the second year of classroom instruction was followed by a significant improvement in knowledge of arthritis. Performance on the survey’s arthritis-based question improved from 72% of students in all grades answering correctly to 91% answering correctly (p < 0.001). Three of the 24 questions were spine-related, including questions about back pain and disc disease. Students in both cohorts performed most poorly on spine-related questions (30% correct for spine questions vs. 54% average correct for all subject areas, Fig. 3).

Fig. 3.

Fig. 3

Open in a new tab

Comparison of student performance by topic based on time elapsed under the new curriculum

The preparation of incoming medical students as assessed by their mean sub-test and aggregate MCAT scores revealed no significant differences (p = 0.9) between groups.

Discussion

Numerous reports describe insufficient knowledge of important topics in musculoskeletal medicine by medical students. Though moving the introductory musculoskeletal course to an earlier year in the curriculum was not intentionally done to improve student knowledge and understanding in musculoskeletal medicine, the hope was that it would provide students with more opportunities to link concepts in musculoskeletal medicine to new learning in other basic science and organ-system courses, as well as in preclinical experiences, to reinforce and broaden understandings in ways that would be of benefit in future clinical experiences. However, with the major exposure to musculoskeletal medicine occurring in the first year of medical school, there was no evidence of improvement in student scores on the related USMLE subtest or Freedman and Bernstein’s web based questionnaire of musculoskeletal knowledge. Perhaps this was due to first year students not yet having the clinical framework needed to put pathology into context, thereby limiting mastery of the subject. We also found that earlier exposure to musculoskeletal medicine did not improve understanding in spine, which remained the weakest subject area despite the curricular change. Given the frequency with which physicians of all specialties encounter patients presenting with back pain, this suggests that greater emphasis on spine-related topics and exposure to patients with spine problems should occur during medical student training.

With the curricular changes, retention of musculoskeletal knowledge did not appear to be maintained into the clinical years. There is no evidence from this limited survey that early exposure improved student knowledge and proficiency when compared to similar assessment of students having taken the introductory musculoskeletal medicine course in the second year of medical school, though addition of a dedicated second-year short course in rheumatology did improve results on a rheumatology-based question. Many clinical faculty members informally surveyed at our institution expressed disappointment with regards to recent student readiness for interviewing, examining and diagnosing the most basic and straightforward musculoskeletal problems. Faculty comments along the lines of "It sounds like a good introductory course, but it just didn't translate into sustained knowledge" and "They never remember musculoskeletal facts and concepts by the time they get to the third or fourth year..." were typical.

The institution of numerous electronic resources, including a course web-site available to all sites, with links to video resources on physical exams, video copies of lectures, and links to additional educational resources including musculoskeletal cases with carefully worked-through differential diagnoses were not enough to improve the efficacy of the course in the face of its move to the first year.

As previously noted [9], taking specific clinical rotations with a musculoskeletal focus significantly improved student knowledge, suggesting that those who had a greater exposure to the topic in clinical settings came away with a better foundation in musculoskeletal medicine, a finding corroborated by others as well [8, 20, 36, 38–40].

Limitations

The USMLE Musculoskeletal, Skin, and Connective Tissue Diseases subtest score includes an evaluation of understanding of skin and subcutaneous tissues as well as the musculoskeletal system, hence consideration of scores from this test as a surrogate for knowledge and understanding of facts and concepts in musculoskeletal medicine may be an oversimplification. However, as our mean scores dropped somewhat on this subtest when comparing 2001-2003 results to those of 2010-2013, one may conclude that student understanding in musculoskeletal medicine with the new curriculum is not measurably better than that student understanding with the old. This is supported by the results on the web-based survey.

Our response rate of 11% for the web-based survey is lower than most surveys in the literature, slightly lower than the 15-30% response rate described for internet or web-based surveys [41, 42] and lower than our previous survey (33%) [9], reflecting a limited sample of the student population. Errors in conducting the survey likely included sending the survey out towards the end of a grading period, with the reminder e-mail being sent around the time of the start of the next major instructional period. No incentive was offered, which may have also discouraged participation. Despite the poor response rate, one would expect that in a medical school program with criterion-referenced grading, where ideally all students would meet an accepted level of mastery of topics, knowledge scores would be above 70% and proficiency rates closer to 100% than these surveys revealed. The use of our university’s on-line system for querying students may have discouraged completion of survey by many, as the passive format of the survey made immediately apparent the large number of short-answer questions to be completed prior to submission, without offering the option of partial completion and/or delayed submission. In the case of poor response on web-based surveys, it has been argued that those responding may have a particular interest in the subject or object of the inquiry [41], potential skewing the respondent population in this survey towards those with an interest in musculoskeletal medicine. If that were the case here, one might argue that those responding to the survey were those with greater confidence in their musculoskeletal knowledge, and perhaps those more likely to score highly on exams such as the Freedman and Bernstein assessment.

As first year medical students at our medical school receive basic science instruction at several sites, gathering at a common site for the second year of training, multiple instructors lead the first year musculoskeletal medicine course at these various sites. Though overall student achievement in the musculoskeletal course has not varied appreciably from site to site over the past four years, as assessed by common exam results and USMLE scores, the confidential nature of our surveys did not allow us to obtain breakdown of scores by instructional site. Our data also does not allow us to assess the varying extent of exposure to musculoskeletal clinical experiences by our students during third and fourth year clerkships, except where students noted enrollment in a musculoskeletal-focused clinical elective.

There appears to be a correlation with the amount of time spent in pre-clinical musculoskeletal education with musculoskeletal knowledge. As programs have retooled curriculum that, among other changes, increased the amount of time spent studying musculoskeletal medicine, higher exam scores resulted [13, 18, 43]. This trend has not been entirely reproducible however, as the addition of an upper extremity course at one institution increased student confidence without actually increasing national exam scores [44]. We would argue that time allotted may not be as important as the timing of course delivery, as our study has revealed that earlier did not lead to better understanding nor a more utilitarian foundation for our students. Seeing how musculoskeletal concepts relate to new learning in other areas, making effective links across the curriculum to build overall understanding may require a certain background that our student did not quite have at the point of their first year course.

Integration of musculoskeletal-related topics is one way to increase mastery. A new integrated curriculum that involved more time in gross anatomy laboratories and more emphasis on orthopedic pathophysiology resulted in higher levels of clinical confidence and cognitive mastery amongst students [15]. Integrating orthopedics, rheumatology, and physical medicine and rehabilitation has been shown to be effective in increasing knowledge and retention of physical examination skills [20]. Interactive small groups are also popular amongst students in learning musculoskeletal medicine [18, 21, 45]. Such a setting may help students by breaking tasks down so that physical examination may be learned first, with exploration of clinical correlates to follow [46]. Despite student satisfaction with small groups, it is not always the case that they lead to better knowledge and understanding [22]. Computer-based instruction is also being explored, with some evidence of higher student satisfaction and skills gained [47, 48], though students prefer computer based learning to be combined with bedside teaching [49].

There are many challenges in musculoskeletal education. Student knowledge may continue to be evaluated using the Freedman and Bernstein survey, though some argue that it is more a test of orthopedic knowledge than knowledge of topics in musculoskeletal medicine. A new physical examination decision-making test has recently been developed that educators can utilize that may more effectively assess student knowledge in musculoskeletal medicine [29]. Further tests that are developed should ideally account for multiple competencies, including physical exam skills in addition to assessments of knowledge and diagnostic acumen.

Conclusions

Given the omnipresent nature of musculoskeletal complaints across medical specialties, a greater emphasis on student preparation in topics in musculoskeletal medicine, with an increased emphasis on spine, appear to be merited. Our findings suggest that in the absence of an early organized clinical exposure to patients with musculoskeletal problems, earlier is not necessarily better when it comes to instruction in musculoskeletal medicine. A more comprehensive reform including routine early exposure to patients with musculoskeletal problems continued into the clinical years may be required to achieve optimum levels of student proficiency.

Acknowledgements

We thank the students of the University of Washington School of Medicine for their participation in this study.

Funding

No funds were received in the preparation of this study.

Availability of data and materials

Though consent to participate in the study was obtained prior to survey completion, consent for publication of survey results was not obtained, as indirect identifiers of students via their survey answers lie within the data set.

Abbreviations

IRB

Institutional Review Board

MCAT

Medical College Admission Test

OSCEs

Objective Structured Clinical Examinations

TBL

Team Based Learning

USMLE

United States Medical Licensing Examination

Authors’ contributions

DK organized the research study, performed the data collection and analysis, and wrote the initial draft of the manuscript. AK participated in study design, data analysis and interpretation. GS participated in the study design and data interpretation, and led the editing of the final manuscript. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This study was approved by the University of Washington Institutional Review Board (IRB application number 44779). All participants in the web-based survey consented to participate in the study.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests; i.e. each author certifies that he has neither commercial nor personal associations that might pose a conflict of interest in connection with the submitted article.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Derek Khorsand, Email: dkhor@uw.edu.

Ansab Khwaja, Email: ansabkhwaja@gmail.com.

Gregory A. Schmale, Email: gschmale@uw.edu

References

  • 1.Rosenblatt RA, Cherkin DC, Schneeweiss R, Hart LG, Greenwald H, Kirkwood CR, et al. The structure and content of family practice: current status and future trends. J Fam Pract. 1982;15(4):681–722. [PubMed] [Google Scholar]
  • 2.Bergman JJ, Rosenblatt RA. After-hours calls: a five-year longitudinal study in a family practice group. J Fam Pract. 1982;15(1):101–106. [PubMed] [Google Scholar]
  • 3.Initiative USBaJ . The burden of musculoskeletal diseases in the United States (BMUS) Rosemont: United States Bone and Joint Initiative; 2014. p. 2014. [Google Scholar]
  • 4.Pinney SJ, Regan WD. Educating medical students about musculoskeletal problems. Are community needs reflected in the curricula of Canadian medical schools? J Bone Joint Surg Am. 2001;83-A(9):1317–1320. [PubMed] [Google Scholar]
  • 5.DiCaprio MR, Covey A, Bernstein J. Curricular requirements for musculoskeletal medicine in American medical schools. J Bone Joint Surg Am. 2003;85-A(3):565–567. doi: 10.2106/00004623-200303000-00027. [DOI] [PubMed] [Google Scholar]
  • 6.Bernstein J, Garcia GH, Guevara JL, Mitchell GW. Progress report: the prevalence of required medical school instruction in musculoskeletal medicine at decade's end. Clin Orthop Relat Res. 2011;469(3):895–897. doi: 10.1007/s11999-010-1477-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bernstein J, Alonso DR, DiCaprio M, Friedlaender GE, Heckman JD, Ludmerer KM. Curricular reform in musculoskeletal medicine: needs, opportunities, and solutions. Clin Orthop Relat Res. 2003;415:302–308. doi: 10.1097/01.blo.0000093922.26658.3c. [DOI] [PubMed] [Google Scholar]
  • 8.Matzkin E, Smith EL, Freccero D, Richardson AB. Adequacy of education in musculoskeletal medicine. J Bone Joint Surg Am. 2005;87(2):310–314. doi: 10.2106/JBJS.D.01779. [DOI] [PubMed] [Google Scholar]
  • 9.Schmale GA. More evidence of educational inadequacies in musculoskeletal medicine. Clin Orthop Relat Res. 2005;437:251–259. doi: 10.1097/01.blo.0000164497.51069.d9. [DOI] [PubMed] [Google Scholar]
  • 10.Day CS, Yeh AC. Evidence of educational inadequacies in region-specific musculoskeletal medicine. Clin Orthop Relat Res. 2008;466(10):2542–2547. doi: 10.1007/s11999-008-0379-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Menon J, Patro DK. Undergraduate orthopedic education: is it adequate? Indian J Orthop. 2009;43(1):82–86. doi: 10.4103/0019-5413.45328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Abou-Raya A, Abou-Raya S. The inadequacies of musculoskeletal education. Clin Rheumatol. 2010;29(10):1121–1126. doi: 10.1007/s10067-010-1527-y. [DOI] [PubMed] [Google Scholar]
  • 13.Day CS, Ho P. Progress of medical school musculoskeletal education in the 21st century. J Am Acad Orthop Surg. 2016;24(11):762–768. doi: 10.5435/JAAOS-D-15-00577. [DOI] [PubMed] [Google Scholar]
  • 14.Clawson DK, Jackson DW, Ostergaard DJ. It's past time to reform the musculoskeletal curriculum. Acad Med. 2001;76(7):709–710. doi: 10.1097/00001888-200107000-00012. [DOI] [PubMed] [Google Scholar]
  • 15.Day CS, Ahn CS, Yeh AC, Tabrizi S. Early assessment of a new integrated preclinical musculoskeletal curriculum at a medical school. Am J Orthop. 2011;40(1):14–18. [PubMed] [Google Scholar]
  • 16.Lynch JR, Gardner GC, Parsons RR. Musculoskeletal workload versus musculoskeletal clinical confidence among primary care physicians in rural practice. Am J Orthop. 2005;34(10):487–491. [PubMed] [Google Scholar]
  • 17.Lynch JR, Schmale GA, Schaad DC, Leopold SS. Important demographic variables impact the musculoskeletal knowledge and confidence of academic primary care physicians. J Bone Joint Surg Am. 2006;88(7):1589–1595. doi: 10.2106/JBJS.E.01365. [DOI] [PubMed] [Google Scholar]
  • 18.Bilderback K, Eggerstedt J, Sadasivan KK, Seelig L, Wolf R, Barton S, et al. Design and implementation of a system-based course in musculoskeletal medicine for medical students. J Bone Joint Surg Am. 2008;90(10):2292–2300. doi: 10.2106/JBJS.G.01676. [DOI] [PubMed] [Google Scholar]
  • 19.Kelly M, Bennett D, Bruce-Brand R, O'Flynn S, Fleming P. One week with the experts: a short course improves musculoskeletal undergraduate medical education. J Bone Joint Surg Am. 2014;96(5):e39. doi: 10.2106/JBJS.M.00325. [DOI] [PubMed] [Google Scholar]
  • 20.Saleh K, Messner R, Axtell S, Harris I, Mahowald ML. Development and evaluation of an integrated musculoskeletal disease course for medical students. J Bone Joint Surg Am. 2004;86-A(8):1653–1658. doi: 10.2106/00004623-200408000-00008. [DOI] [PubMed] [Google Scholar]
  • 21.Costa ML, van Rensburg L, Rushton N. Does teaching style matter? A randomised trial of group discussion versus lectures in orthopaedic undergraduate teaching. Med Educ. 2007;41(2):214–217. doi: 10.1111/j.1365-2929.2006.02677.x. [DOI] [PubMed] [Google Scholar]
  • 22.de Jong Z, van Nies JA, Peters SW, Vink S, Dekker FW, Scherpbier A. Interactive seminars or small group tutorials in preclinical medical education: results of a randomized controlled trial. BMC Med Educ. 2010;10:79. doi: 10.1186/1472-6920-10-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bulstrode C, Gallagher FA, Pilling EL, Furniss D, Proctor RD. A randomised controlled trial comparing two methods of teaching medical students trauma and orthopaedics: traditional lectures versus the "donut round". Surgeon. 2003;1(2):76–80. doi: 10.1016/s1479-666x(03)80119-1. [DOI] [PubMed] [Google Scholar]
  • 24.Raj N, Badcock LJ, Brown GA, Deighton CM, O'Reilly SC. Design and validation of 2 objective structured clinical examination stations to assess core undergraduate examination skills of the hand and knee. J Rheumatol. 2007;34(2):421–424. [PubMed] [Google Scholar]
  • 25.Baker KF, Jandial S, Thompson B, Walker D, Taylor K, Foster HE. Use of structured musculoskeletal examination routines in undergraduate medical education and postgraduate clinical practice - a UK survey. BMC Med Educ. 2016;16(1):277. doi: 10.1186/s12909-016-0799-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Stansfield RB, Diponio L, Craig C, Zeller J, Chadd E, Miller J, et al. Assessing musculoskeletal examination skills and diagnostic reasoning of 4th year medical students using a novel objective structured clinical exam. BMC Med Educ. 2016;16(1):268. doi: 10.1186/s12909-016-0780-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wilson FC. Development of a musculoskeletal organ system curriculum. J Med Educ. 1973;48(10):928–933. doi: 10.1097/00001888-197310000-00006. [DOI] [PubMed] [Google Scholar]
  • 28.Wilson FC, Esther RJ. Development and use of a second-year musculoskeletal organ-system curriculum: a forty-year experience. J Bone Joint Surg Am. 2010;92(11):e14. doi: 10.2106/JBJS.I.01514. [DOI] [PubMed] [Google Scholar]
  • 29.Bishop JY, Awan HM, Rowley DM, Nagel RW. Development and validation of a musculoskeletal physical examination decision-making test for medical students. J Surg Educ. 2013;70(4):451–460. doi: 10.1016/j.jsurg.2013.03.011. [DOI] [PubMed] [Google Scholar]
  • 30.Laskowski ER, Moutvic M, Smith J, Newcomer-Aney K, Showalter CJ. Integration of physical medicine and rehabilitation into a medical school curriculum: musculoskeletal evaluation and rehabilitation. Am J Phys Med Rehabil. 2000;79(6):551–557. doi: 10.1097/00002060-200011000-00014. [DOI] [PubMed] [Google Scholar]
  • 31.Day CS, Yu YR, Yeh AC, Newman LR, Arky R, Roberts DH. Musculoskeletal preclinical medical school education: meeting an underserved need. J Bone Joint Surg Am. 2009;91(3):733–739. doi: 10.2106/JBJS.H.01305. [DOI] [PubMed] [Google Scholar]
  • 32.Bordage G. Conceptual frameworks to illuminate and magnify. Med Educ. 2009;43(4):312–319. doi: 10.1111/j.1365-2923.2009.03295.x. [DOI] [PubMed] [Google Scholar]
  • 33.Michaelsen LK. Teaching excellence: toward the best in the academy. Professional and organizational development network essay series. Ames: POD Network; 1998. [Google Scholar]
  • 34.Parmelee DX, Michaelsen LK. Twelve tips for doing effective team-based learning (TBL) Med Teach. 2010;32(2):118–122. doi: 10.3109/01421590903548562. [DOI] [PubMed] [Google Scholar]
  • 35.US News and World Report Best Graduate Schools. US News and World Report; 2017 [cited 2017 2/23/17]; Top Primary Care Programs]. Available from: http://www.usnews.com/best-graduate-schools/top-medical-schools. Accessed 10 Nov 2017.
  • 36.Freedman KB, Bernstein J. The adequacy of medical school education in musculoskeletal medicine. J Bone Joint Surg Am. 1998;80(10):1421–1427. doi: 10.2106/00004623-199810000-00003. [DOI] [PubMed] [Google Scholar]
  • 37.Freedman KB, Bernstein J. Educational deficiencies in musculoskeletal medicine. J Bone Joint Surg Am. 2002;84-A(4):604–608. doi: 10.2106/00004623-200204000-00015. [DOI] [PubMed] [Google Scholar]
  • 38.Grunfeld R, Banks S, Fox E, Levy BA, Craig C, Black K. An assessment of musculoskeletal knowledge in graduating medical and physician assistant students and implications for musculoskeletal care providers. J Bone Joint Surg Am. 2012;94(4):343–348. doi: 10.2106/JBJS.J.00417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Skelley NW, Tanaka MJ, Skelley LM, LaPorte DM. Medical student musculoskeletal education: an institutional survey. J Bone Joint Surg Am. 2012;94(19):e146(1-7). [DOI] [PubMed]
  • 40.Day CS, Yeh AC, Franko O, Ramirez M, Krupat E. Musculoskeletal medicine: an assessment of the attitudes and knowledge of medical students at Harvard Medical School. Acad Med. 2007;82(5):452–457. doi: 10.1097/ACM.0b013e31803ea860. [DOI] [PubMed] [Google Scholar]
  • 41.Ilieva J, Baron S, Healy NM. On-line surveys in marketing research: pros and cons. Int J Mark Res. 2002;44:361–376. [Google Scholar]
  • 42.Fricker RD. In: Sampling methods for web and E-mail surveys. Fielding NG, editor. London: Sage; 2008. [Google Scholar]
  • 43.Williams SC, Gulihar A, Dias JJ, Harper WM. A new musculoskeletal curriculum: has it made a difference? J Bone Joint Surg Br. 2010;92(1):7–11. doi: 10.1302/0301-620X.92B1.23136. [DOI] [PubMed] [Google Scholar]
  • 44.Day CS, Ahn CS, Yu Y. The addition of an upper-extremity curriculum in medical school education and its assessment. J Hand Surg Eur Vol. 2009;34(6):797–799. doi: 10.1177/1753193409347500. [DOI] [PubMed] [Google Scholar]
  • 45.Vioreanu MH, O'Daly BJ, Shelly MJ, Devitt BM, O'Byrne JM. Design, implementation and prospective evaluation of a new interactive musculoskeletal module for medical students in Ireland. Ir J Med Sci. 2013;182(2):191–199. doi: 10.1007/s11845-012-0855-0. [DOI] [PubMed] [Google Scholar]
  • 46.Monrad SU, Zeller JL, Craig CL, Diponio LA. Musculoskeletal education in US medical schools: lessons from the past and suggestions for the future. Curr Rev Musculoskelet Med. 2011;4(3):91–98. doi: 10.1007/s12178-011-9083-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Vivekananda-Schmidt P, Lewis M, Hassell AB, Group ARCVRCR Cluster randomized controlled trial of the impact of a computer-assisted learning package on the learning of musculoskeletal examination skills by undergraduate medical students. Arthritis Rheum. 2005;53(5):764–771. doi: 10.1002/art.21438. [DOI] [PubMed] [Google Scholar]
  • 48.Modica RF, Thundiyil JG, Chou C, Diab M, Von Scheven E. Teaching musculoskeletal physical diagnosis using a web-based tutorial and pathophysiology-focused cases. Med Educ Online. 2009;14:13. doi: 10.3885/meo.2009.Res00301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Hull P, Chaudry A, Prasthofer A, Pattison G. Optimal sequencing of bedside teaching and computer-based learning: a randomised trial. Med Educ. 2009;43(2):108–112. doi: 10.1111/j.1365-2923.2008.03261.x. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Though consent to participate in the study was obtained prior to survey completion, consent for publication of survey results was not obtained, as indirect identifiers of students via their survey answers lie within the data set.

Articles from BMC Medical Education are provided here courtesy of BMC

RESOURCES