To the Editor,
Patient-reported outcome measures (PROMs) play a crucial role in ensuring representation of the patient perspective during evaluation of the interventions we deliver. We therefore commend the work of Whitebird et al. [14], which investigates barriers to incorporating PROMs in clinical practice.
The use of appropriate, valid, and reliable PROMs can be an extremely powerful tool in assessing the efficacy of interventions. However, as so eloquently described in the adage popularized by a favorite comic superhero, “with great power comes great responsibility.” In today’s era of evidence-based medicine, our clinical practice is guided by outcomes reported in high-quality research studies [6]. Incorrect use or flawed interpretation of PROMs can therefore have a catastrophic “domino effect” on our decision-making and clinical practice [4].
Very broadly speaking, two types of outcomes are used in orthopaedic research: clinician-assessed outcomes such as measurements made using various imaging modalities or objective measures of strength, and patient-reported outcome measures, namely PROMs. The most robust and high-quality research studies make the effort to control for confounding factors and limit sources of bias that may influence the measurements made or the data captured. For example, clinician-assessed outcomes are often controlled so that the clinician assessing the outcome is blind to the specific intervention performed. Because a provider’s knowledge of the intervention used can influence his or her assessment of patients afterward, blinding is considered a key quality-control step in robust research designs, and is considered a marker of higher-quality research in all of the widely used tools that assess quality and risk of bias in studies, including MINORS, ROBINS-I, and The Newcastle Ottawa Scale [11-13]. Essentially, risk of measurement bias is reduced through controlling for the state of mind of the outcome assessors and any underlying conscious or unconscious biases they may hold.
However, blinding to reduce observer bias is more challenging when dealing with PROMs. Although blinding patients to intervention choice may reduce some patient bias, this is difficult in orthopaedic surgery and fails to account for a major source of patient bias: the patient’s own state of mind and the presence or absence of emotional distress. Mental health conditions such as depression and anxiety are common in the general population, and may be more common among patients undergoing orthopaedic surgery [1, 5, 7, 9, 10]. These conditions are associated with symptoms such as low mood, anhedonia, and fatigue, and are therefore by their very nature likely to bias patients toward reporting more pain and poorer function on PROMs [7]. An association between conditions such as depression and anxiety and worse postoperative PROMs has been demonstrated after several orthopaedic interventions [2, 3, 8].
While many studies control for potential confounding factors like patient demographics and physical comorbidities when evaluating differences in PROMs, the potential confounding effect of pre-existing mental health conditions is rarely considered. Of course, it is unreasonable to expect authors to consider every single possible confounding variable, but since PROM responses are so inherently intertwined with patients’ mental states, controlling for pre-existing depression and anxiety are crucial. This may be done through the co-administration of mental health assessment questionnaires such as the Patient Health Questionnaire-9 (PHQ-9) for depression and the Generalized Anxiety Disorder Assessment (GAD-7). The situation is complicated by the fact that underlying musculoskeletal pathology may contribute to patients’ depression/anxiety and be relieved by intervention. It is therefore important that mental health is assessed and controlled alongside both pre- and postoperative PROMs. Failing to control for these factors may lead to invalid research conclusions and less-effective clinical approaches.
Footnotes
(RE: Whitebird RR, Solberg LI, Ziegenfuss JY, et al. What Do Orthopaedists Believe is Needed for Incorporating Patient-reported Outcome Measures into Clinical Care? A Qualitative Study. Clin Orthop Relat Res. 2022;480:680-687.)
Each author certifies that there are no funding or commercial associations (consultancies, stock ownership, equity interest, patent/licensing arrangements, etc.) that might pose a conflict of interest in connection with the submitted article related to the author or any immediate family members.
All ICMJE Conflict of Interest Forms for authors and Clinical Orthopaedics and Related Research® editors and board members are on file with the publication and can be viewed on request.
The opinions expressed are those of the writer, and do not reflect the opinion or policy of Clinical Orthopaedics and Related Research® or The Association of Bone and Joint Surgeons®.
Contributor Information
Zaki Arshad, Email: mza26@cam.ac.uk.
Ibrahim Inzarul Haq, Email: ibrahimhaq@hotmail.com.
References
- 1.Crichlow R, Andres P, Morrison S, Haley S, Vrahas M. Depression in orthopaedic trauma patients. Prevalence and severity. J Bone Joint Surg Am . 2006;88:1927-1933. [DOI] [PubMed] [Google Scholar]
- 2.Cunningham DJ, Steele JR, Allen NB, Nunley JA, Adams SB. The impact of preoperative mental health and depression on outcomes after total ankle arthroplasty. J Bone Joint Surg Am. 2021;103:131-138. [DOI] [PubMed] [Google Scholar]
- 3.Dick AG, Smith C, Bankes MJK, George M. The impact of mental health disorders on outcomes following hip arthroscopy for femoroacetabular impingement syndrome: a systematic review. J Hip Preserv Surg . 2020;7:195-204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gagnier JJ, Johnston BC. Poor quality patient reported outcome measures bias effect estimates in orthopaedic randomized studies. J Clin Epidemiol . 2019;116:36-38. [DOI] [PubMed] [Google Scholar]
- 5.Kumar S, Verma V, Kushwaha U, Calvello Hynes EJ, Arya A, Agarwal A. Prevalence and association of depression in in-patient orthopaedic trauma patients: a single centre study in India. J Clin Orthop Trauma. 2020;11:S573-S577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Leopold SS. Editorial: chance encounters, overdiagnosis, and overtreatment. Clin Orthop Relat Res . 2022;480:1231-1233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Malhi GS, Mann JJ. Depression. Lancet . 2018;392:2299-2312. [DOI] [PubMed] [Google Scholar]
- 8.Rolfson O, Dahlberg LE, Nilsson J-A, Malchau H, Garellick G. Variables determining outcome in total hip replacement surgery. J Bone Joint Surg Br . 2009;91-B:157-161. [DOI] [PubMed] [Google Scholar]
- 9.Shorey S, Ng ED, Wong CHJ. Global prevalence of depression and elevated depressive symptoms among adolescents: a systematic review and meta‐analysis. Br J Clin Psychol . 2022;61:287-305. [DOI] [PubMed] [Google Scholar]
- 10.Sjöberg L, Karlsson B, Atti A-R, Skoog I, Fratiglioni L, Wang H-X. Prevalence of depression: comparisons of different depression definitions in population-based samples of older adults. J Affect Disord. 2017;221:123-131. [DOI] [PubMed] [Google Scholar]
- 11.Slim K, Nini E, Forestier D, Kwiatkowski F, Panis Y, Chipponi J. Methodological index for non-randomized studies (minors): development and validation of a new instrument. ANZ J Surg. 2003;73:712-716. [DOI] [PubMed] [Google Scholar]
- 12.Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wells G, Shea B, O’Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2000. Available at: https://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed June 12, 2023. [Google Scholar]
- 14.Whitebird RR, Solberg LI, Ziegenfuss JY, et al. What do orthopaedists believe is needed for incorporating patient-reported outcome measures into clinical care? A qualitative study. Clin Orthop Relat Res. 2022;480:680-687. [DOI] [PMC free article] [PubMed] [Google Scholar]