SUMMARY:
Diagnostic imaging is the most rapidly growing physician service in the Medicare and privately insured population. The growing share of medical costs devoted to imaging procedures has led to increasing concerns among the key federal agencies and private payers. In an attempt to educate health care providers, patients, and families on the importance of making optimal clinical decisions, the American Board of Internal Medicine Foundation organized the Choosing Wisely initiative with strong collaboration from specialty societies representing nearly all medical disciplines. Among 45 tests and treatments listed on the Choosing Wisely Web site, 24 are directly related to imaging. Eleven of the 24 are associated with neuroimaging. The listing of imaging tests in the Choosing Wisely program by multiple medical societies other than the radiology societies acknowledges that appropriate use of medical imaging is a shared responsibility between radiologists and referring physicians. In this article, we highlight why radiologists are uniquely positioned to support the appropriate use of imaging. We review some of the strategies that radiologists can use to help their referring physicians with appropriate ordering of neuroimaging in real-world practice and address some the challenges and pitfalls in implementing patient-centered imaging decision-making and shifting to a value-based focus in radiology.
Starting in the late 1990s, rates of use of diagnostic imaging studies within all modalities have seen a dramatic rise, with average growth rates in the use of CT, MR imaging, and nuclear medicine studies of >10% each year in ambulatory settings between 1995 and 2001.1 Additionally, from 2000 to 2007, the use of imaging studies grew faster than any other physician service among Medicare patients,2 raising concerns about overuse of imaging.3 Diagnostic imaging undoubtedly plays an essential role in the diagnosis and treatment planning of many patients. The increasing use of advanced imaging techniques, however, has substantial financial implications, with approximately $100 billion spent on outpatient imaging alone in 2006, and is a major driving force for increasing governmental health care expenditures and rising insurance premiums faced by employers and individuals.4
The purpose of this article was to highlight the unique role radiologists play in ensuring the appropriate use of imaging studies, particularly neuroimaging. We will review how clinical guidelines can help frame decisions about the appropriate use of neuroimaging studies. We will then review ways in which radiologists can collaborate with clinicians in ensuring appropriate ordering and discuss potential challenges in making the transition to a value-centered practice approach.
Appropriate Neuroimaging Guidelines
Choosing Wisely Campaign.
To heighten awareness of overused diagnostic tests and treatments, the American Board of Internal Medicine launched the Choosing Wisely initiative5 in 2012. As a part of this campaign, 9 leading medical organizations, including the American College of Radiology (ACR) and leadership bodies from various medicine subspecialties, were asked to choose 5 common tests or treatments whose use should be re-evaluated by the ordering physicians. Among 45 tests and procedures listed, half were directly related to imaging.6 Since 2012, other medical societies have joined the original 9 and offered their own lists of overused tests or procedures. According to a recent compilation from Rao and Levin,7 nearly half of this expanded list of overused tests and treatments relates to either diagnostic radiology or cardiac imaging. Furthermore, in an expanded survey of 26 major medical societies, 38 of the 130 (29%) listed overused services targeted imaging, more than any other category.8 Nearly a quarter of the most overused imaging tests related to neuroimaging, which placed second among all subspecialties behind cardiac testing. This finding reflects neurologic symptoms and disorders, both acute and chronic, having such a high prevalence and accounting for a significant proportion of chief symptoms in both emergency and outpatient settings.9,10 Although the Choosing Wisely campaign was inspired primarily from the overuse of diagnostic testing and therapies, it should not be viewed exclusively as an initiative to ration or restrict care to patients. Rather, the primary goal of the campaign is to encourage a more patient-centered care model and “to promote physician and patient conversations about making choices about treatments.”5
Imaging 3.0.
In response to pressure placed on the field as a result of the Choosing Wisely initiative, several radiology societies, including the American Board of Radiology, ACR, and Radiological Society of North America, have made the concept of value and quality-based care, rather than volume-driven care, a pillar of their Imaging 3.0 initiative.11 One of the key components of the value-based Imaging 3.0 campaign is development and refinement of clear, evidenced-based guidelines regarding the appropriateness of different imaging modalities in wide varieties of clinical settings and scenarios among all subspecialties. These encompass a number of tools, including appropriateness criteria, practice guidelines or parameters, and different software solutions to support clinical decision-making and the selection of the most appropriate imaging test in any particular clinical setting.
Imaging Appropriateness: Illustration of Selected Adult and Pediatric Neurologic Conditions
Practice parameters describe recommended conduct of specific imaging tests or image-guided interventions. They are derived from the current literature and the consensus opinion of experts. Practice parameters are not intended to be legal standards of care or conduct and may be modified as determined by individual circumstances and available resources. The ACR, in collaboration with the American Society of Neuroradiology, the Society of NeuroInterventional Surgery, and the Society of Pediatric Radiology, has developed 20 practice parameters and technology standards that pertain to neuroimaging and neurointervention (http://www.acr.org/Quality-Safety/Standards-Guidelines/Practice-Guidelines-by-Technique/Neuroradiology).
Appropriateness criteria are guidelines to assist the referring physicians and other providers in making the most appropriate imaging or treatment decisions for specific clinical conditions. Examples of appropriateness criteria include the ACR Appropriateness Criteria and the Canadian Association of Radiology guidelines. The ACR Appropriateness Criteria include more than 20 separate topics discussing the appropriateness of imaging in adult and pediatric neurologic conditions (http://www.acr.org/Quality-Safety/Standards-Guidelines/Practice-Guidelines-by-Modality/Neuroradiology).
Reviewing all the neuroimaging-related practice parameters and appropriateness criteria and the underlying evidence goes beyond the scope of this article and has been addressed elsewhere.12 Following are examples illustrating selected adult and pediatric neurologic conditions in which the selection of appropriate imaging is often challenging for referring physicians, and in which different rules, guidelines, and practice parameters have been developed by different professional societies and entities to help the referring physician's decision process.
Traumatic Brain Injury.
Traumatic brain injury is a common reason for presentation in emergency settings, with most injuries classified as “mild.”13 Mild traumatic brain injury is typically defined according to clinical criteria such as the Glasgow Coma Scale and other clinical signs and symptoms at the time of presentation.14,15 Several sets of basic clinical criteria, such as the New Orleans Criteria and the Canadian Head CT Rule and clinical guidelines from the American College of Emergency Physicians/Centers for Disease Control and Prevention16 and the ACR Appropriateness Criteria17 detail “high-risk” criteria that warrant evaluation of patients with mild traumatic brain injury with CT of the head, which is the preferred method of evaluation of head trauma (On-line Table 1). Further details on neuroimaging guidelines for patients with traumatic brain injury are provided in a white paper written jointly by the ACR, American Society of Neuroradiology, and American Society of Functional Neuroradiology.18,19
Headache.
Headache is among the most common medical symptoms, both in emergency and outpatient settings.20 Most primary headaches can be evaluated via history and physical examination alone. Neuroimaging is warranted to distinguish primary headaches from secondary causes (On-line Table 1). While guidelines such as the Headache Consortium guidelines in migraine work-up,21 multispecialty consensus on diagnosis and treatment of headache,22 and the ACR Appropriateness Criteria23 offer precise, evidence-based guidelines for headache types such as migraines, vascular origin, and post traumatic, recommendations for some headaches types such as tension are still not well-defined. Indications for neuroimaging are strongly based on clinical history and a detailed physical examination. MR imaging is generally the preferred technique for a change in headache character or chronic headache with new neurologic examination findings (On-line Table 1). Conversely, stable headaches or headaches with stable examination findings or classic migraine patterns should not be evaluated via neuroimaging.
Low Back Pain.
Low back pain is one of the most common reasons for seeking outpatient medical care.24 Given the chronicity of most back pain relative to other presenting neurologic symptoms, duration of symptoms and response to conservative treatment play an important role in imaging strategies, as detailed in a meta-analysis25 and in multiple published guidelines (On-line Table 1).26–28 Specifically, in the absence of “red flag” features, imaging should be reserved for pain lasting >4–6 weeks and not responding to an appropriate trial of conservative therapy. Imaging work-up should be pursued with MR imaging with little-to-no role for plain radiographs in the absence of acute trauma (On-line Table 1).
Syncope.
Although syncope and syncope mimics are common reasons for emergency department visits, the etiology of a syncopal episode can usually be determined from a detailed history and physical examination.29 Imaging is not recommended unless underlying neurologic etiology is suspected in the initial work-up as advocated by the San Francisco Syncope Rule,30 European Society of Cardiology Guidelines,29 and the American Academy of Family Physicians (AAFP) guidelines (On-line Table 1).31
Hearing and Vision Loss.
Hearing and vision loss are common neurologic symptoms, especially in an aging population.32,33 While most of these conditions require further work-up with a proper clinical history and examination, there are settings in which diagnostic imaging may help identify life-threatening or reversible causes from more benign, age-related etiologies. With vision loss, imaging should only be considered for acute vision loss or new concerning vision examination findings as described by the guidelines from the American Academy of Ophthalmology,34 AAFP,35 and ACR (On-line Table 1).36 In the absence of trauma, evaluation is generally performed with MR imaging. According to the American Academy of Otolaryngology–Head and Neck Surgery (AAO-HNS),37 there is a role for imaging in conductive hearing loss, generally evaluated with CT of the temporal bones, and sensorineural hearing loss, generally evaluated with MR imaging. Cases of explained progressive, symmetric conductive or sensorineural hearing loss, which account for most hearing loss referrals, do not warrant imaging evaluation (On-line Table 1).
Other Head and Neck Disorders.
Uncomplicated acute rhinosinusitis and hoarseness are encountered routinely in the ambulatory setting.38 While most of these cases are benign and self-limited, more extensive evaluation with focused diagnostic imaging may be necessary in selected cases. The proper imaging evaluation algorithm for rhinosinusitis follows published guidelines from the Infectious Diseases Society of America,39 AAO-HNS,40 AAFP,41 and ACR (On-line Table 1).42 For cases meeting the clinical criteria of acute or subacute uncomplicated rhinosinusitis, imaging is not to be pursued. CT is recommended only in cases of complicated sinusitis, immunocompromised hosts, or recurrence. In contrast, there is generally a lesser role of imaging in the initial evaluation of hoarseness. In fact, according to guidelines from the AAO-HNS,43 imaging should only be considered after a clinical examination with direct laryngoscopy.
Pediatric Neurologic Conditions.
Although there is some overlap between the frequently encountered neurologic conditions of children and adults, several neurologic symptoms are unique to children. Additionally, work-up and imaging of the common symptoms may differ between children and adults. Because children are also likely to present in the emergency setting, it is imperative that emergency department physicians, in addition to pediatricians, be aware of the appropriateness of imaging pediatric patients. Furthermore, because children are more sensitive to ionizing radiation effects, these patients should be imaged judiciously.
As with adults, mild traumatic brain injury is a common emergency department presentation with potentially devastating sequelae.44 Several sets of criteria such as the Pediatric Emergency Care Applied Research Network rule,45 the Children's Head Injury Algorithm for the Prediction of Important Clinical Events rule,46 the Canadian Assessment of Tomography for Childhood Head Injury rule,47 and the ACR Appropriateness Criteria48 outline high-risk criteria specific to the pediatric population that warrant evaluation with CT (On-line Table 2). Alternatively, pediatric patients with mild traumatic brain injury in the emergency department may have CT substituted if no neurologic symptoms are observed.
Acute rhinosinusitis is another head and neck pathology common to both adults and pediatric patients.49 Indications for imaging pediatric patients have been specifically evaluated in guidelines by the Infectious Diseases Society of America,39 the American Academy of Pediatrics,50 and the ACR51 and are similar to recommendations for adult patients. These indications include any high-risk signs and symptoms as detailed in On-line Table 2.
Last, febrile seizure is a unique entity to pediatric patients.52 According to the guidelines from American Academy of Pediatrics53 and the ACR,54 patients meeting the criteria for simple febrile seizure (lasting <15 minutes and not recurring within 24 hours) should not undergo imaging (On-line Table 2). Complex febrile seizures (prolonged, recurring more than once in 24 hours, or focal) are rarely associated with underlying pathology such as meningitis, encephalitis, or child abuse. Imaging, preferably with MR imaging or CT, may be performed in selected patients with complex febrile seizures when meningitis/encephalitis or underlying trauma is suspected.54–56
Barriers to Implementation
Application of the imaging appropriateness principles discussed above can prove challenging. The most important factors contributing to the referring physicians' inappropriate use of imaging include time constraints and demanding patients.57,58 Many physicians face greater pressure because the fee-for-service payment model, which still dominates US health care, rewards physicians who see patients in bulk. The propensity for shorter patient visits is now ubiquitous in medicine because the primary care physician generates revenue per visit.57 This results in a shorter time for the referring physicians to research appropriate tests, consult a radiologist, or convince a patient that an imaging test is not necessary. Furthermore, there is increased scrutiny of the medical decision-making and displacement of financial risk to the practitioner. Defensive medicine, a term describing alterations in clinical behavior due to the threat of malpractice liability,59 has a disputed impact on ordering practices in the emergency setting.60 Last, a potential barrier to the implementation of clinical decision-support tools, discussed in greater detail in the following section, is the potential for circumventing their use with out-of-network referrals, though this was shown not to be the case in a recent study by Prabhakar et al.61
One of the important obstacles to promoting adoption of resource-conscious neuroimaging ordering habits relates to the difficulty of disseminating the relevant guidelines among the referring physicians. Despite the inclusion of “systems-based practice” as one of the 6 core competencies of the Accreditation Council for Graduate Medical Education, awareness of imaging appropriateness is not being emphasized in residency training. As an illustration, Taragin et al62 administered a survey in which internal medicine residents were asked to choose the appropriate examination for specific clinical situations. Less than 50% of the respondents answered more than half of the 12 questions correctly. A similar study conducted with emergency medicine residents demonstrated no significant improvement in the ability to choose appropriate studies over the course of a 4-year residency.63 Given the lack of emphasis placed on this topic in residency training, physicians are more likely to turn to Google searches than the appropriateness criteria when determining the most appropriate imaging technique for patients.63,64 Although ahead of their peers in other specialties, radiology residents' knowledge of appropriateness guidelines is still incomplete, with residents answering a median of 15 of 20 appropriateness questions correctly in study by Chiunda and Mohammed.65 In a survey by Powell et al,66 while most radiology trainees were familiar with the ACR Appropriateness Criteria, only 14% of residents reported regular inclusion of the Criteria in formal faculty didactics.
Importance of Ordering Wisely and Clinical Decision Support
Beginning in January 2017, the Centers for Medicare and Medicaid Services will require all referring physicians to use some form of Clinical Decision Support technology before ordering advanced imaging examinations for Medicare patients (https://www.cms.gov/Medicare/Demonstration-Projects/DemoProjectsEvalRpts/downloads/RAND_EMID_Report_to_Congress.pdf). This law specifies that the Clinical Decision Support system must use appropriate-use criteria “developed or endorsed by national professional medical specialty societies or other provider-led entities.” Additionally, the criteria used must be scientifically valid and evidence-based.64 Physicians ordering advanced imaging services will be reimbursed only if claims for reimbursement confirm that the appropriate-use criteria were consulted, whether the examination ordered adhered or did not adhere to an acceptable clinical decision-support rating.
Several decision-support tools have been developed to meet this need; examples include Medicalis (https://consult.medicalis.com/) and ACR Select (http://www.acr.org/Quality-Safety/Appropriateness-Criteria/ACR-Select) in the United States. ACR Select is a commercially available tool developed by National Decision Support Company (https://www.linkedin.com/company/national-decision-support-company), which licensed the ACR Appropriateness Criteria and incorporated them into a digitally consumable version that can be integrated into electronic medical records and computerized order systems. Other international radiology organizations such as the Royal College of Radiologists in the United Kingdom (referral guidelines) and the Canadian Association of Radiologists (Diagnostic Imaging Referral Guidelines) have created similar tools and documents to facilitate the appropriate use of imaging. Insurers contract radiology benefit managers to provide authorization for advanced imaging services. These radiology benefit managers are private companies that use their own proprietary algorithms to determine appropriateness. These software solutions can be incorporated into the electronic medical records. Since its adoption, various implemented decision-support tools have led to improvement in appropriateness adherence in numerous settings. For example, Ip et al67 showed a 12% sustained reduction in cross-sectional imaging for the outpatient, while Dunne et al68 showed a 12% sustained reduction in CT pulmonary angiography use in the emergency department after implementation of clinical decision-support systems. Although early data on imaging use with support tools are promising, their effect on clinical outcomes has yet to be fully evaluated.
In what may be the most critical element of the implementation of this mandate, the Centers for Medicare and Medicaid Services released its determination of what constitutes acceptable appropriate-use criteria at the end of 2015.69,70 The Centers for Medicare and Medicaid Services selection of these criteria will have to meet the following measures: 1) Criteria must be developed or endorsed by national professional medical specialty societies or provider-led entities, 2) Criteria must be scientifically valid and evidence-based, and 3) Criteria must be based on published studies that are reviewable by stakeholders.
What Can Radiologists Practically Do to Address the Situation?
This change in culture provides an opportunity for radiologists to guide and support our clinician colleagues during the transition to value-based care. Effectively guiding referring providers toward appropriate imaging use will rely on improving clinicians' knowledge and effective communication among all members involved in the care of patients, which includes radiologists. These goals can be achieved on a clinician-to-radiologist level or as a part of larger clinician-support projects and initiatives.
To effectively influence clinicians' ordering behavior, improving knowledge about imaging appropriateness must be made a top priority. Furthermore, optimal communication between radiologists and referrers is critical because the effective exchange of information can both prevent unnecessary or inappropriate testing and help ensure that patients experience fewer delays in care.71,72 Continued strong bonds between radiologists and clinicians will also allow development of educational and quality-improvement programs in imaging appropriateness. A recent article reported the initiatives undertaken by a progressive group of radiologists, which included Continuing Medical Education programs for referring physicians and midlevel practitioners.30 This group developed a mobile ordering guidelines app for the referrers to use as a reference when ordering imaging examinations. They even provide a communication center that allows the ordering physicians to connect directly with radiologists at any time of day. Interventions like these will be invaluable in changing the ordering patterns that have become ingrained in clinical practice and residency training programs. In some cases, referring clinicians have initiated educational programs within their own departments in an effort to optimize their imaging examination–ordering behavior.73 Similarly, the Kaiser Permanente Colorado branch has tried to use the recommendations of the Choosing Wisely campaign for affordable health care at the management level.74
Any radiologist can engage in a similar effort by participating in the Radiology Support, Communication, and Alignment Network (R-SCAN) project, for which the ACR received one of the 39 health care collaborative network grants of the CMS Transforming Clinical Practice Initiative to support new levels of care coordination and integration as health care payment systems transition from volume-driven to value-based (www.acr.org/rscan). R-SCAN is a Practice Quality Improvement project that focuses on improving imaging use for 11 topics defined in the Choosing Wisely campaign, including the neuroimaging topics discussed individually in the first part of this article. In R-SCAN, radiologists collaborate with their referring clinicians, assess the baseline use of a certain imaging test, implement a series of interventions to improve the use of such test, and finally measure the effect of the interventions on the use rate of this test. R-SCAN program participants are guided by a step-by-step “recipe” and can earn Continuing Medical Education credits and American Board of Radiology approved Maintenance of Certification Part 4 credit and position themselves for success under new payment structures of the Medicare Access and CHIP Reauthorization Act of 2015, which will govern how radiologists are paid in the near future (https://www.congress.gov/bill/114th-congress/house-bill/2).
In addition to improving referring clinicians' knowledge of imaging recommendations, continuing knowledge of imaging appropriateness among radiologists should not be overlooked. To ensure that the next generation of radiologists is ready to guide referring clinicians, this skill should be mastered in residency. Thus, the ACR Appropriateness Criteria have been an increasingly incorporated feature in radiology resident curricula.75 Emerging evidence suggests that the clinicians are changing how they practice in response to the Choosing Wisely campaign. Alterations in radiation therapy practices in patients with breast cancer in response to the Choosing Wisely campaign have been reported recently. Clinical decision-support systems have thus far shown substantial promise in reining in unnecessary imaging examination orders. A 2013 study demonstrated a reduction of >75% in the number of inappropriately ordered imaging studies for evaluation of coronary artery disease when a point-of-order decision support tool was used, with a simultaneous significant increase in the percentage of appropriate studies ordered.76 Sistrom et al77 demonstrated significant reductions in the outpatient volume of CT, sonography, and MR imaging examinations after implementation of a computerized electronic medical record order-entry system with integrated Clinical Decision Support. Finally, a study showed that targeted use of an imaging decision-support system could reduce inappropriate neuroimaging orders, with resultant substantial decreases in use rates of lumbar MR imaging for low back pain, head MR imaging for headache, and sinus CT for sinusitis.78
Conclusions
There is a shift toward more appropriate use of health care resources in medicine, particularly imaging. Despite imaging being a crucial tool for better diagnosis and effective patient management, we have not optimized its use. One of the important reasons for inappropriate imaging referral is increasing financial pressure of the fee-for-service payment model, resulting in insufficient, short patient visits, leaving the referring physicians insufficient time to evaluate patients, research the appropriate imaging study, consult a radiologist, or talk to the patient about the appropriateness of imaging. Additional barriers include demanding patients and fear of poor physician evaluations and medical malpractice. Deficiency of knowledge on when and how to use imaging may also cause inappropriate imaging referrals.
Current campaigns such as Choosing Wisely and Imaging 3.0 raise awareness and encourage a culture of appropriate use of imaging. This coupled with greater physician knowledge and use of the criteria for appropriate imaging can help ensure that each patient gets exactly the imaging he or she needs, to the benefit of both our patients and our health care system. Implementing a practical medical imaging decision-making process is a complex undertaking requiring resource organization at every level of process-referral, scheduling, point-of-care, and follow-up.
Collaborative partnership among radiologists, referring physicians, and payers is critical for this transition, and radiologists can play a very important role. The R-SCAN project provides an opportunity for radiologists to positively influence the appropriate use of imaging and to emphasize their value as integral members of the health care team.
Supplementary Material
ABBREVIATIONS:
- AAFP
American Academy of Family Physicians
- AAO-HNS
Academy of Otolaryngology–Head and Neck Surgery
- ACR
American College of Radiology
- R-SCAN
Radiology Support, Communication, and Alignment Network
Footnotes
Disclosures: Max Wintermark—UNRELATED: Board Membership: GE National Football League Advisory Board.
References
- 1. Bhargavan M, Sunshine JH. Utilization of radiology services in the United States: levels and trends in modalities, regions, and populations. Radiology 2005;234:824–32 10.1148/radiol.2343031536 [DOI] [PubMed] [Google Scholar]
- 2. Iglehart JK. Health insurers and medical-imaging policy: a work in progress. N Engl J Med 2009;360:1030–37 10.1056/NEJMhpr0808703 [DOI] [PubMed] [Google Scholar]
- 3. American Health Insurance Plans. Ensuring Quality through Appropriate Use of Diagnostic Imaging. July 2008. http://ahipcoverage.com/wp-content/uploads/2011/01/QualityAppropriateImaging.pdf. Accessed August 10, 2015.
- 4. Mitchell JM, Lagalia RR. Controlling the escalating use of advanced imaging: the role of radiology benefit management programs. Med Care Res 2009;66:339–51 10.1177/1077558709332055 [DOI] [PubMed] [Google Scholar]
- 5. Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA 2012;307:1801–02 10.1001/jama.2012.476 [DOI] [PubMed] [Google Scholar]
- 6. Rao VM, Levin DC. The overuse of diagnostic imaging and the Choosing Wisely initiative. Ann Intern Med 2012;157:574–76 10.7326/0003-4819-157-8-201210160-00535 [DOI] [PubMed] [Google Scholar]
- 7. Rao VM, Levin DC. The Choosing Wisely initiative of the American Board of Internal Medicine Foundation: what will its impact be on radiology practice? AJR Am J Roentgenol 2014;202:358–61 10.2214/AJR.13.11123 [DOI] [PubMed] [Google Scholar]
- 8. Morden NE, Colla CH, Sequist TD, et al. Choosing wisely–the politics and economics of labeling low-value services. N Engl J Med 2014;370:589–92 10.1056/NEJMp1314965 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Weiss AJ, Wier LM, Stocks C, et al. Overview of emergency department visits in the United States, 2011. HCUP Statistical Brief #174 [Internet]. Rockville, Maryland: Agency for Healthcare Research and Quality; June 2014. http://www.hcup-us.ahrq.gov/reports/statbriefs/sb174-Emergency-Department-Visits-Overview.pdf. [PubMed] [Google Scholar]
- 10. St Sauver JL, Warner DO, Yawn BP, et al. Why patients visit their doctors: assessing the most prevalent conditions in a defined American population. Mayo Clin Proc 2013;88:56–67 10.1016/j.mayocp.2012.08.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Ellenbogen PH. Imaging 3.0: what is it? J Am Coll Radiol 2013;10:229 10.1016/j.jacr.2013.02.011 [DOI] [PubMed] [Google Scholar]
- 12. Medina LS, Sanelli PC, Jarvik JG. Evidence-Based Neuroimaging Diagnosis and Treatment: Improving the Quality of Neuroimaging in Patient Care. New York: Springer-Verlag; 2013 [Google Scholar]
- 13. Rutland-Brown W, Langlois JA, Thomas KE, et al. Incidence of traumatic brain injury in the United States, 2003. J Head Trauma Rehabil 2006;21:544–48 10.1097/00001199-200611000-00009 [DOI] [PubMed] [Google Scholar]
- 14. Kay T. Neuropsychological treatment of mild traumatic brain injury. J Head Trauma Rehabil 1993;8:74–85 [Google Scholar]
- 15. Report to Congress on Mild Traumatic Brain Injury in the United States: Steps to Prevent a Serious Public Health Problem. 2003. http://www.cdc.gov/traumaticbraininjury/pdf/mtbireport-a.pdf. Accessed August 10, 2015.
- 16. Jagoda AS, Bazarian JJ, Bruns JJ, et al. ; American College of Emergency Physicians, Centers for Disease Control and Prevention. Clinical policy: neuroimaging and decisionmaking in adult mild traumatic brain injury in the acute setting. Ann Emerg Med 2008;52:714–48 10.1016/j.annemergmed.2008.08.021 [DOI] [PubMed] [Google Scholar]
- 17. Davis PC, Drayer BP, Anderson RE, et al. Head trauma: American College of Radiology—ACR Appropriateness Criteria. Radiology 2000;215(suppl):507–24 [PubMed] [Google Scholar]
- 18. Wintermark M, Sanelli PC, Anzai Y, et al. ; American College of Radiology Head Injury Institute. Imaging evidence and recommendations for traumatic brain injury: advanced neuro- and neurovascular imaging techniques. AJNR Am J Neuroradiol 2015;36:E1–11 10.3174/ajnr.A4181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Wintermark M, Sanelli PC, Anzai Y, et al. Imaging evidence and recommendations for traumatic brain injury: conventional neuroimaging techniques. J Am Coll Radiol 2015;12:e1–14 10.1016/j.jacr.2014.10.014 [DOI] [PubMed] [Google Scholar]
- 20. Gaini SM, Fiori L, Cesana C, et al. The headache in the emergency department. Neurol Sci 2004;25(suppl 3):S196–201 10.1007/s10072-004-0285-5 [DOI] [PubMed] [Google Scholar]
- 21. Morey SS. Headache Consortium releases guidelines for use of CT or MRI in migraine work-up. Am Fam Physician 2000;62:1699–701 [PubMed] [Google Scholar]
- 22. Silberstein SD. Practice parameter: evidence-based guidelines for migraine headache (an evidence-based review): report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology 2000;55:754–62 10.1212/WNL.55.6.754 [DOI] [PubMed] [Google Scholar]
- 23. Douglas AC, Wippold FJ 2nd, Broderick DF, et al. ACR Appropriateness Criteria Headache. J Am Coll Radiol 2014;11:657–67 10.1016/j.jacr.2014.03.024 [DOI] [PubMed] [Google Scholar]
- 24. Deyo RA, Phillips WR. Low back pain: a primary care challenge. Spine 1996;21:2826–32 10.1097/00007632-199612150-00003 [DOI] [PubMed] [Google Scholar]
- 25. Chou R, Fu R, Carrino JA, et al. Imaging strategies for low-back pain: systematic review and meta-analysis. Lancet 2009;373:463–72 10.1016/S0140-6736(09)60172-0 [DOI] [PubMed] [Google Scholar]
- 26. Chou R, Qaseem A, Owens DK, et al. ; Clinical Guidelines Committee of the American College of Physicians. Diagnostic imaging for low back pain: advice for high-value health care from the American College of Physicians. Ann Intern Med 2011;154:181–89 10.7326/0003-4819-154-3-201102010-00008 [DOI] [PubMed] [Google Scholar]
- 27. Kochen MM, Blozik E, Scherer M, et al. Imaging for low-back pain. Lancet 2009;373:436–37 10.1016/S0140-6736(09)60149-5 [DOI] [PubMed] [Google Scholar]
- 28. Davis PC, Wippold FJ 2nd, Brunberg JA, et al. ACR Appropriateness Criteria on low back pain. J Am Coll Radiol 2009;6:401–07 10.1016/j.jacr.2009.02.008 [DOI] [PubMed] [Google Scholar]
- 29. Moya A, Sutton R, Ammirati F, et al. ; Task Force for the Diagnosis and Management of Syncope; European Society of Cardiology (ESC); European Heart Rhythm Association (EHRA); Heart Failure Association (HFA); Heart Rhythm Society (HRS). Guidelines for the diagnosis and management of syncope (version 2009). Eur Heart J 2009;30:2631–71 10.1093/eurheartj/ehp298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Neeman N, Quinn K, Soni K, et al. Reducing radiology use on an inpatient medical service: choosing wisely. Arch Intern Med 2012;172:1606–08 10.1001/archinternmed.2012.4293 [DOI] [PubMed] [Google Scholar]
- 31. Gauer RL. Evaluation of syncope. Am Fam Physician 2011;84:640–50 [PubMed] [Google Scholar]
- 32. Cruickshanks KJ, Wiley TL, Tweed TS, et al. Prevalence of hearing loss in older adults in Beaver Dam, Wisconsin: the Epidemiology of Hearing Loss Study. Am J Epidemiol 1998;148:879–86 10.1093/oxfordjournals.aje.a009713 [DOI] [PubMed] [Google Scholar]
- 33. Congdon N, O'Colmain B, Klaver CC, et al. ; Eye Diseases Prevalence Research Group. Causes and prevalence of visual impairment among adults in the United States. Arch Ophthalmol 1960 2004;122:477–85 [DOI] [PubMed] [Google Scholar]
- 34. Feder RS, Olsen TW, Prum BE Jr, et al. Comprehensive Adult Medical Eye Evaluation Preferred Practice Pattern(®) Guidelines. Ophthalmology 2016;123:P209–36 10.1016/j.ophtha.2015.10.047 [DOI] [PubMed] [Google Scholar]
- 35. Pelletier AL, Thomas J, Shaw FR. Vision loss in older persons. Am Fam Physician 2009;79:963–70 [PubMed] [Google Scholar]
- 36. Hasso AN, Drayer BP, Anderson RE, et al. Orbits, vision, and visual loss. American College of Radiology. ACR Appropriateness Criteria. Radiology 2000;215(suppl):579–87 [PubMed] [Google Scholar]
- 37. Stachler RJ, Chandrasekhar SS, Archer SM, et al. ; American Academy of Otolaryngology-Head and Neck Surgery. Clinical practice guideline: sudden hearing loss. Otolaryngol Head Neck Surg 2012;146(3 suppl):S1–35 10.1177/0194599812436449 [DOI] [PubMed] [Google Scholar]
- 38. Schappert SM, Burt CW. Ambulatory care visits to physician offices, hospital outpatient departments, and emergency departments: United States, 2001–02. Vital Health Stat 13 2006:1–66 [PubMed] [Google Scholar]
- 39. Chow AW, Benninger MS, Brook I, et al. ; Infectious Diseases Society of America. IDSA clinical practice guideline for acute bacterial rhinosinusitis in children and adults. Clin Infect Dis 2012;54:e72–112 10.1093/cid/cis370 [DOI] [PubMed] [Google Scholar]
- 40. Rosenfeld RM, Piccirillo JF, Chandrasekhar SS, et al. Clinical practice guideline (update): adult sinusitis. Otolaryngol Head Neck Surg 2015;152:S1–39 10.1177/0194599814561600 [DOI] [PubMed] [Google Scholar]
- 41. Huntzinger A. Guidelines for the diagnosis and management of rhinosinusitis in adults. Am Fam Physician 2007;76:1718–24 [Google Scholar]
- 42. Cornelius RS, Martin J, Wippold FJ, et al. ; American College of Radiology. ACR appropriateness criteria sinonasal disease. J Am Coll Radiol 2013;10:241–46 10.1016/j.jacr.2013.01.001 [DOI] [PubMed] [Google Scholar]
- 43. Schwartz SR, Cohen SM, Dailey SH, et al. Clinical practice guideline: hoarseness (dysphonia). Otolaryngol Head Neck Surg 2009;141:S1–31 10.1016/j.otohns.2009.06.744 [DOI] [PubMed] [Google Scholar]
- 44. Schneier AJ, Shields BJ, Hostetler SG, et al. Incidence of pediatric traumatic brain injury and associated hospital resource utilization in the United States. Pediatrics 2006;118:483–92 10.1542/peds.2005-2588 [DOI] [PubMed] [Google Scholar]
- 45. Kuppermann N, Holmes JF, Dayan PS, et al. ; Pediatric Emergency Care Applied Research Network (PECARN). Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. Lancet 2009;374:1160–70 10.1016/S0140-6736(09)61558-0 [DOI] [PubMed] [Google Scholar]
- 46. Dunning J, Daly JP, Lomas JP, et al. ; Children's head injury algorithm for the prediction of important clinical events study group. Derivation of the children's head injury algorithm for the prediction of important clinical events decision rule for head injury in children. Arch Dis Child 2006;91:885–91 10.1136/adc.2005.083980 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Osmond MH, Klassen TP, Wells GA, et al. ; Pediatric Emergency Research Canada (PERC) Head Injury Study Group. CATCH: a clinical decision rule for the use of computed tomography in children with minor head injury. CMAJ 2010;182:341–48 10.1503/cmaj.091421 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Ryan ME, Palasis S, Saigal G, et al. ACR Appropriateness Criteria head trauma–child. J Am Coll Radiol 2014;11:939–47 10.1016/j.jacr.2014.07.017 [DOI] [PubMed] [Google Scholar]
- 49. Sharp HJ, Denman D, Puumala S, et al. Treatment of acute and chronic rhinosinusitis in the United States, 1999–2002. Arch Otolaryngol Head Neck Surg 2007;133:260–65 10.1001/archotol.133.3.260 [DOI] [PubMed] [Google Scholar]
- 50. Wald ER, Applegate KE, Bordley C, et al. ; American Academy of Pediatrics. Clinical practice guideline for the diagnosis and management of acute bacterial sinusitis in children aged 1 to 18 years. Pediatrics 2013;132:e262–80 10.1542/peds.2013-1071 [DOI] [PubMed] [Google Scholar]
- 51. McAlister WH, Parker BR, Kushner DC, et al. Sinusitis in the pediatric population. American College of Radiology. ACR Appropriateness Criteria. Radiology 2000;215(suppl):811–18 [PubMed] [Google Scholar]
- 52. Waruiru C, Appleton R. Febrile seizures: an update. Arch Dis Child 2004;89:751–56 10.1136/adc.2003.028449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Subcommittee on Febrile Seizures, American Academy of Pediatrics. Neurodiagnostic evaluation of the child with a simple febrile seizure. Pediatrics 2011;127:389–94 10.1542/peds.2010-3318 [DOI] [PubMed] [Google Scholar]
- 54. Strain JD, Kushner DC, Babcock DS, et al. Imaging of the pediatric patient with seizures. American College of Radiology. ACR Appropriateness Criteria. Radiology 2000;215(suppl):787–800 [PubMed] [Google Scholar]
- 55. Hesdorffer DC, Chan S, Tian H, et al. Are MRI-detected brain abnormalities associated with febrile seizure type? Epilepsia 2008;49:765–71 10.1111/j.1528-1167.2007.01459.x [DOI] [PubMed] [Google Scholar]
- 56. DiMario FJ. Children presenting with complex febrile seizures do not routinely need computed tomography scanning in the emergency department. Pediatrics 2006;117:528–30 10.1542/peds.2005-2012 [DOI] [PubMed] [Google Scholar]
- 57. Freidson E. Prepaid group practice and the new “demanding patient.” Milbank Mem Fund Q Health Soc 1973;51:473–88 10.2307/3349630 [DOI] [PubMed] [Google Scholar]
- 58. Landon BE, Wilson IB, Cleary PD. A conceptual model of the effects of health care organizations on the quality of medical care. JAMA 1998;279:1377–82 10.1001/jama.279.17.1377 [DOI] [PubMed] [Google Scholar]
- 59. Studdert DM, Mello MM, Sage WM, et al. Defensive medicine among high-risk specialist physicians in a volatile malpractice environment. JAMA 2005;293:2609–17 10.1001/jama.293.21.2609 [DOI] [PubMed] [Google Scholar]
- 60. Waxman DA, Ridgely MS, Heaton P. The effect of malpractice reform on emergency department care. N Engl J Med 2015;372:192 10.1056/NEJMc1413881 [DOI] [PubMed] [Google Scholar]
- 61. Prabhakar AM, Harvey HB, Misono AS, et al. Imaging decision support does not drive out-of-network leakage of referred imaging. J Am Coll Radiol February 19. [Epub ahead of print] 10.1016/j.jacr.2016.01.004 [DOI] [PubMed] [Google Scholar]
- 62. Taragin BH, Feng L, Ruzal-Shapiro C. Online radiology appropriateness survey: results and conclusions from an academic internal medicine residency. Acad Radiol 2003;10:781–85 10.1016/S1076-6332(03)80123-X [DOI] [PubMed] [Google Scholar]
- 63. Dym RJ, Burns J, Taragin BH. Appropriateness of imaging studies ordered by emergency medicine residents: results of an online survey. AJR Am J Roentgenol 2013;201:W619–25 10.2214/AJR.12.10487 [DOI] [PubMed] [Google Scholar]
- 64. Bautista AB, Burgos A, Nickel BJ, et al. ; American College of Radiology Appropriateness. Do clinicians use the American College of Radiology Appropriateness criteria in the management of their patients? AJR Am J Roentgenol 2009;192:1581–85 10.2214/AJR.08.1622 [DOI] [PubMed] [Google Scholar]
- 65. Chiunda AB, Mohammed TL. Knowledge of ACR thoracic imaging Appropriateness Criteria® among trainees: one institution's experience. Acad Radiol 2012;19:635–39 10.1016/j.acra.2012.01.003 [DOI] [PubMed] [Google Scholar]
- 66. Powell DK, Silberzweig JE. The use of ACR Appropriateness Criteria: a survey of radiology residents and program directors. Clin Imaging 2015;39:334–38 10.1016/j.clinimag.2014.10.011 [DOI] [PubMed] [Google Scholar]
- 67. Ip IK, Schneider L, Seltzer S, et al. Impact of provider-led, technology-enabled radiology management program on imaging. Am J Med 2013;126:687–92 10.1016/j.amjmed.2012.11.034 [DOI] [PubMed] [Google Scholar]
- 68. Dunne RM, Ip IK, Abbett S, et al. Effect of evidence-based clinical decision support on the use and yield of CT pulmonary angiographic imaging in hospitalized patients. Radiology 2015;276:167–74 10.1148/radiol.15141208 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69. Protecting Access to Medicare Act of 2014. Pub L No. 113–93, §218, 128 Stat 1040.
- 70. Timbie JW, Hussey PS, Burgette LF, et al. Medicare Imaging Demonstration Final Evaluation. 2014. http://www.rand.org/pubs/research_reports/RR706.html. Accessed August 10, 2015. [PMC free article] [PubMed]
- 71. Gunn AJ, Alabre CI, Bennett SE, et al. Structured feedback from referring physicians: a novel approach to quality improvement in radiology reporting. AJR Am J Roentgenol 2013;201:853–57 10.2214/AJR.12.10450 [DOI] [PubMed] [Google Scholar]
- 72. Teske K. Three ways radiology groups can be more proactive about utilization management. The Advisory Board Company. September 24, 2014. https://www.advisory.com/research/imaging-performance-partnership/the-reading-room/2014/09/three-ways-radiology-groups-can-be-more-proactive-about-utilization-management. Accessed August 10, 2015.
- 73. Choosing Wisely. An initiative of the ABIM Foundation. Choosing Wisely Prompts Kaiser Permanente Branch to Action. February 6, 2014. http://www.choosingwisely.org/resources/updates-from-the-field/choosing-wisely-prompts-kaiser-permanente-branch-to-action/. Accessed March 7, 2016.
- 74. Curry HA, Palladino ML, Jagsi R. Utilization of hypofractionated regimens for treatment of breast cancer in an insured population before and after initiation of ASTRO's “Choosing Wisely” campaign. Int J Radiat Oncol Biol Phys 2014;90:S62 10.1016/j.ijrobp.2014.05.212 [DOI] [Google Scholar]
- 75. Mainiero MB. Incorporating ACR Practice Guidelines, technical standards, and appropriateness criteria into resident education. J Am Coll Radiol 2004;1:277–79 10.1016/j.jacr.2004.01.009 [DOI] [PubMed] [Google Scholar]
- 76. Lin FY, Dunning AM, Narula J, et al. Impact of an automated multimodality point-of-order decision support tool on rates of appropriate testing and clinical decision making for individuals with suspected coronary artery disease: a prospective multicenter study. J Am Coll Cardiol 2013;62:308–16 10.1016/j.jacc.2013.04.059 [DOI] [PubMed] [Google Scholar]
- 77. Sistrom CL, Dang PA, Weilburg JB, et al. Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Radiology 2009;251:147–55 10.1148/radiol.2511081174 [DOI] [PubMed] [Google Scholar]
- 78. Blackmore CC, Medina LS. Evidence-based radiology and the ACR Appropriateness Criteria. J Am Coll Radiol 2006;3:505–09 10.1016/j.jacr.2006.03.003 [DOI] [PubMed] [Google Scholar]
- 79. Smits M, Dippel DWJ, de Haan GG, et al. External validation of the Canadian CT Head Rule and the New Orleans Criteria for CT scanning in patients with minor head injury. JAMA 2005;294:1519–25 10.1001/jama.294.12.1519 [DOI] [PubMed] [Google Scholar]
- 80. Quinn JV, Stiell IG, McDermott DA, et al. Derivation of the San Francisco Syncope Rule to predict patients with short-term serious outcomes. Ann Emerg Med 2004;43:224–32 10.1016/S0196-0644(03)00823-0 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.