Abstract
Web-based physician ratings are increasingly popular but imperfect proxies for clinical competence. Yet they provide valuable information to patients and providers when taken in proper context. Providers need to embrace the reviews and use them to enact positive change in order to improve the quality of our patients’ experience. Patients need to realize the limitations of online ratings, particularly with smaller sample size and be discerning about the reasons behind the review.
Keywords: online reviews, physician ratings, web-based physician rating systems
Introduction
Web-based physician ratings systems are becoming increasingly popular as the internet becomes more ensconced in our culture and crowd sourcing is used to select services.1–3 Yet, despite the rise of online physician reviews, the debate about their utility continues without a clear consensus or a complete understanding of their influences and implications.4 Unfortunately, one of those influences is an increasing physician and patient distrust.5 While many patients seem to appreciate the added information from online reviews, many physicians are skeptical or fearful of their impacts.6 Online reviews can help patients find a particular physician and prepare for future visits with a chosen provider.7 However, many physicians worry that these platforms will hurt their practice if negative reviews are received.8 The differing views between physicians and patients towards these reviews are not surprising but the contrast is stark nonetheless.9
Who is using online reviews?
It has been reported that up to 60% of people use web-based physician rating systems in choosing a physician and that the number of ratings online have been increasing.2 Intuitively, patients who have used platforms in the past will use them in the future.10 Some studies suggested that younger patients have more experience with web-based physician rating systems.8 Younger patients may be savvier with the internet as it becomes an integral part in our culture and upbringing.8,11,12 Younger patients may have increasing awareness with respect to newer technologies and know how to navigate through various platforms as they generally have higher internet consumption compared to the past. Furthermore, more women than men, educated patients, insured patients, and patients with chronic disease/multiple comorbidities use web-based physician rating systems.8,10 Elaborating on these findings, the most important factor in using web-based physician rating systems was health care utilization.8,10 Patients who have multiple comorbidities will require close relationships with physicians and are more likely to use these review platforms since they will have more doctor visits compared to healthier patients. Knowing who uses web-based physician rating systems is useful from a physician’s perspective (Table 1).
Table 1.
Characteristics of patients who use web-based physician rating systems
| Younger (Age <65) Female Educated (College Degree > High School Degree) Insured Patients with chronic disease Patients with disabilities Patients with multiple comorbidities |
How useful are online reviews?
In response to the increase in the number of patients who search the internet for health information, multiple platforms for web-based physician rating systems have been developed.13 Some of these platforms are specific to the field of medicine such as “ratemd.com” or “webmd.com”, while others like “yelp.com” are all-encompassing review websites documenting customer satisfaction. These websites contain various information regarding physician demographics, including licensure/education information, professional/hospital affiliations, years of experience, languages spoken, all in addition to ratings and reviews (Table 2).13 Often, these platforms will provide structured reviews for patients when they provide a rating. All provide an anonymous means to evaluate a physician, ancillary staff, and the entire office experience. These reviews evaluate the physician by criteria such as availability, punctuality, bedside manner, and the perceived clinical care they provide. In addition to actual physician–patient interactions, patient experiences with facility location, costs/billing, and staff characteristics contribute to these ratings (Table 2).14 Many websites provide a breakdown of grading for these various categories as well as a text box to answer freely. This transparency of information is what patients are hoping for when choosing a doctor.5 However, studies have shown reviews are often affected by office wait times, ancillary staff, and bedside manner.11–16 Physicians who have busier practices and are seeing a larger volume of patients may have shorter periods of time to spend with each patient resulting in lower ratings.14–19 However, web-based physician rating systems can be beneficial from a patient’s perspective. It provides an open forum for a patient to offer an evaluation of a physician and their practice. Future studies regarding rating systems from a patient perspective would be beneficial to see what is important in a physician and their practice.
Table 2.
Variables found on various web-based physician rating systems
| General characteristics of physician/practice | Reviewable characteristics by consumer |
|---|---|
| Gender Specialty Area of Expertise/Clinical Interests Conditions Treated Hospital Affiliation Addresses of Offices Phone Number Education Residency Fellowship if Applicable Licenses/Certifications/Professional Affiliations Publications/Awards Languages Spoken Years of Experience Insurance Accepted Background check (probationary status/malpractice claims/sanctions/board actions) |
Availability Punctuality Bedside Manner/Trustworthiness Knowledge/Clinical Competence Communication/Patient Education Time Spent with Physician Ancillary Staff Scheduling Office Environment/Parking/Location Billing/Costs Recommend to Other Patients Ability to Leave General Comments |
Some physicians utilize online ratings as a feedback tool.15 Constructive criticism can identify areas of need in a practice to help better serve patients.5 For example, physicians can introduce quality measures in response to patient reviews. Some physicians have addressed logistical issues in their office, including the way test results were distributed or how incoming mail was handled.12 Others have streamlined their appointment scheduling process in response to patient experiences.15 Some physicians have implemented patient reminders in their office infrastructure and adopted guidelines/treatment pathways in response to reviews.20 All these factors can help the patient experience, especially in someone with chronic diseases/multiple comorbidities who visit physicians more frequently than a healthier patient. Physicians who embrace the consumer mentality to facilitate easier patient access help engender trust which is key in building the doctor–patient relationship.3,4
How accurate are online reviews?
Web-based ratings are an imperfect proxy for clinical competence.17 Many different outcomes have been used including probation, board certification, education, malpractice claims, mortality, infection, and readmission rates.17,21 However, most studies show a weak correlation at best or no correlation at all between web-rating and these outcomes. Physicians will often use these studies to justify their claims that online reviews are lacking.21 A recent study evaluated surgeon-specific outcomes including infections, readmissions, and revision surgery for total knee replacements with ratings on web-based physician rating systems.21 It found no correlation between surgeon outcomes/clinical competence with the online rating suggesting that these ratings are not influenced by physician competence but rather factors such as cost, wait time, and ancillary staff. While physicians assess quality of care by clinical outcomes, patients may perceive quality of care/clinical competence differently and reflect such in web-based ratings.21
Another concern regarding online physician ratings is the sample size. When reviewing these websites, most physicians will only have a handful of reviews despite seeing thousands of patients.18 A recent study identified that most physicians did not have more than 1 review on any of the platforms.14 A small sample size of reviews could introduce a significant bias which is concerning and can negatively affect a physician’s practice.
The ethical implications of anonymous reviews are also troubling.5,13 There is concern that erroneous reviews could be purposely recorded to damage a doctor’s reputation and practice.22 The majority of negative reviews were not associated with actual clinical factors rather issues like parking at the facility, wait time till the appointment, and short physician–patient encounter.14 Physicians cannot respond to these issues on web-based rating platforms without violating patient confidentiality. However, some physicians have responded to these negative reviews in an attempt to clear their name and violated Health Insurance Portability Accountability Act of 1996 (HIPPA) laws in doing so.6 These health care providers responded to various negative reviews and revealed patients’ diagnoses, treatments offered, and other confidential health information pertaining to the patients’ care without their permission. In an attempt to justify their work via web-based physician rating systems, these health care providers ultimately violate HIPPA laws.6 In one instance, a hospital was fined $275,000 by responding to a negative review and violating patient’s privacy.4
Other physicians have been accused of filling out their own reviews or paying for reviews from patients.23 These reviews were noted to have a different narrative than other typical reviews. They included information pertaining to titles held by the physician as well as ancillary services offered by the practice such as on-site laboratory or radiology.14 The anonymous nature of these rating systems provides no screening process of the reviewer. This has led some to question whether these websites should have more thorough review policies, authentication, and enforcement.13,23
Certainly, reviews need to be considered in its context they are written. Ratings may not comment on a physician’s clinical competence or decision making and rather be based solely on practice’s logistical issues. Studies show that most patients use the information as part of the process of evaluating and choosing a physician but it is by no means the only factor they consider.7,24 It will be important that as web-based physician rating systems grow and become more popular, patients should be discerning when reading reviews. Patients will need to assess the style of writing used in the review to ensure it is not a physician-written review for advertisement. Patients will need to use these reviews as a part of their decision of choosing a physician as a review/rating will not entirely depict the quality and skills of a physician.
Is there room for improvement?
In the setting of web-based physician rating systems, one of the major concerns is the anonymous nature of the reviews. These reviews are not risk-adjusted and furthermore do not provide a way for physicians to respond to negative criticism. Creating a platform that has some feedback mechanism for physicians that is HIPPA compliant would provide a way to validate these reviews and prevent fraud (Figure 1).4,19 A physician may be competent and have great clinical outcomes; however, a patient-directed rating system can be biased by factors such as parking at a facility and wait times. As patient care has a wide array of attributes, creating a rating system that balances out clinical outcomes with facility amenities/ancillary staff would be beneficial (Figure 1).5 Physicians can act upon logistical issues to improve their practice while their clinical reputation is not viewed unfavorably by the public.
Figure 1.
Positive versus negative of web-based physician rating systems.4,5,13,23Note: Data from these studies.4,5,13,23
Abbreviation: HIPPA, Health Insurance Portability Accountability Act.
As these review platforms grow over time, it will be interesting to see how regulatory bodies may take these reviews into account. Research on the effect of web-based physician rating platforms will need to expand as well. Future research will need to address potential ways to rate physician decision making and what performance metrics are associated with positive reviews. While there are studies that address objective criteria, it is difficult to assess a physician’s decision making. One study found physicians on probation to have lower ratings on these review platforms.17 Probation was handed down by the state medical board for various infractions and this status was used as a substitute for clinical competency. However, using a more reliable metric may aid assessing physician decision making as not all physicians are on probation. Ultimately, future studies will need to be designed in a longitudinal fashion to assess if web-based physician rating systems reflect quality of care.
Conclusion – are they going away?
Online reviews are only on the rise and are likely here to stay but they have limitations.2,7 They are not best used to identify surgeon skill, decision making, or outcomes.18,21 However, when taken in context, they provide useful information to the health care consumer in evaluating wait times, ease of access, and other factors that have a degree of importance to patients.18,19 These results can be used as a feedback mechanism to improve a health care provider’s practice and help provide better care without compromising any patient-protected health information (Figure 2). As the internet becomes more integral in our lives and online reviews increase, the potential to help shape future review platforms rely on health care providers. Future web-based review platforms will evolve as new forces are introduced that affect society. Recently, social media has become integral in today’s society and may correlate with patient feedback.25 However, its impact on physician reviews is unknown. As other technologies develop in the future, the possibility of these applications being integrated with online physician reviews is indefinite. As health care providers, we should be embracing and helping to improve the reviews so by proxy we are improving our care and gaining patient trust.5,13
Figure 2.
How physicians can use web-based physician rating systems.
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Crequit P, Mansouri G, Benchoufi M, Vivot A, Ravaud P. Mapping of crowdsourcing in health: systematic review. J Med Internet Res. 2018;20(5):e187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Public awareness, perception, and use of online physician rating sites. JAMA. 2014;311(7):734–735. doi: 10.1001/jama.2013.283194 [DOI] [PubMed] [Google Scholar]
- 3.Ranard BL, Ha YP, Meisel ZF, et al. Crowdsourcing–harnessing the masses to advance health and medicine, a systematic review. J Gen Intern Med. 2014;29(1):187–203. doi: 10.1007/s11606-013-2536-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Manary MP, Boulding W, Staelin R, Glickman SW. The patient experience and health outcomes. N Engl J Med. 2013;368(3):201–203. doi: 10.1056/NEJMp1211775 [DOI] [PubMed] [Google Scholar]
- 5.Lee V. Transparency and trust – online patient reviews of physicians. N Engl J Med. 2017;376(3):197–199. doi: 10.1056/NEJMp1610136 [DOI] [PubMed] [Google Scholar]
- 6.Ornstein C. Doctors fire back at bad Yelp reviews – and reveal patients’ information online. The Washington Post. May 2016.
- 7.Burkle CM, Keegan MT. Popularity of internet physician rating sites and their apparent influence on patients‘ choices of physicians. BMC Health Serv Res. 2015;15:416. doi: 10.1186/s12913-015-0718-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Terlutter R, Bidmon S, Röttl J. Who uses physician-rating websites? Differences in sociodemographic variables, psychographic variables, and health status of users and nonusers of physician-rating websites. J Med Internet Res. 2014;16(3):e97. doi: 10.2196/jmir.3145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.McGrath RJ, Priestley JL, Zhou Y, Culligan PJ. The validity of online patient ratings of physicians: analysis of physician peer reviews and patient ratings. Interact J Med Res. 2018;7(1):e8. doi: 10.2196/ijmr.9350 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Emmert M, Meier F, Pisch F, Sander U. Physician choice making and characteristics associated with using physician-rating websites: cross-sectional study. J Med Internet Res. 2013;15(8):e187. doi: 10.2196/jmir.2702 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Olson KE, O’Brien MA, Rogers WA, Charness N. Diffusion of technology: frequency of use for younger and older adults. Ageing Int. 2011;36(1):123–145. doi: 10.1007/s12126-010-9077-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Jones S, Fox S. Generations online in 2009. Center PR, editor Pew Internet and American Life Project; 2009. http://www.pewinternet.org/2009/01/28/generations-online-in-2009/. Accessed October 18, 2018.
- 13.Trehan SK, Daluiski A. Online patient ratings: why they matter and what they mean. J Hand Surg Am. 2016;41(2):316–319. doi: 10.1016/j.jhsa.2015.04.018 [DOI] [PubMed] [Google Scholar]
- 14.Lagu T, Hannon NS, Rothberg MB, Lindenauer PK. Patients‘ evaluations of health care providers in the era of social networking: an analysis of physician-rating websites. J Gen Intern Med. 2010;25(9):942–946. doi: 10.1007/s11606-010-1383-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Emmert M, Meszmer N, Sander U. Do health care providers use online patient ratings to improve the quality of care? Results from an online-based cross-sectional study. J Med Internet Res. 2016;18(9):e254. doi: 10.2196/jmir.5889 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Gao GG, McCullough JS, Agarwal R, Jha AK. A changing landscape of physician quality reporting: analysis of patients‘ online ratings of their physicians over a 5-year period. J Med Internet Res. 2012;14(1):e38. doi: 10.2196/jmir.2003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Murphy GP, Awad MA, Osterberg EC, et al. Web-based physician ratings for California physicians on probation. J Med Internet Res. 2017;19(8):e254. doi: 10.2196/jmir.7488 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Murphy GP, Awad MA, Tresh A, et al. Association of patient volume with online ratings of California urologists. JAMA Surg. 2018;153(7):685–686. doi: 10.1001/jamasurg.2018.0149 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Verhoef LM, Van de Belt TH, Engelen LJ, Schoonhoven L, Kool RB. Social media and rating sites as tools to understanding quality of care: a scoping review. J Med Internet Res. 2014;16(2):e56. doi: 10.2196/jmir.3024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Lamb GC, Smith MA, Weeks WB, Queram C. Publicly reported quality-of-care measures influenced Wisconsin physician groups to improve performance. Health Aff (Millwood). 2013;32(3):536–543. doi: 10.1377/hlthaff.2012.1275 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Trehan SK, Nguyen JT, Marx R, et al. Online patient ratings are not correlated with total knee replacement surgeon-specific outcomes. HSS J. 2018;14(2):177–180. doi: 10.1007/s11420-017-9600-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ziemba JB, Allaf ME, Haldeman D. Consumer preferences and online comparison tools used to select a surgeon. JAMA Surg. 2017;152(4):410–411. doi: 10.1001/jamasurg.2016.4993 [DOI] [PubMed] [Google Scholar]
- 23.Samora JB, Lifchez SD, Blazar PE; American Society for Surgery of the Hand E, Professionalism C. Physician-rating web sites: ethical implications. J Hand Surg Am. 2016;41(1):104 e1–110 e1. doi: 10.1016/j.jhsa.2015.05.034 [DOI] [PubMed] [Google Scholar]
- 24.Patel S, Cain R, Neailey K, Hooberman L. Public awareness, usage, and predictors for the use of doctor rating websites: cross-sectional study in England. J Med Internet Res. 2018;20(7):e243. doi: 10.2196/jmir.9523 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Donnally CJ 3rd, Li DJ, Maguire JA Jr, et al. How social media, training, and demographics influence online reviews across three leading review websites for spine surgeons. Spine J. 2018;18(11):2081–2090. doi: 10.1016/j.spinee.2018.04.023 [DOI] [PubMed] [Google Scholar]


