Abstract
Objective
The appropriate role for chiropractic in US health care has not been established, but third-party payors and public policy makers must make decisions about the appropriate role for chiropractors in health care systems and for the services that chiropractors provide. Appropriateness studies for chiropractic may inform those decisions. The purpose of this article is to discuss the implications and limitations of appropriateness studies for chiropractic.
Discussion
We reviewed the general context for assessment of the appropriateness and the application of appropriateness studies to chiropractic in particular. We evaluated the implications and limitations for chiropractic of methods of small area analysis and the RAND-UCLA Appropriateness Method. The RAND-UCLA Appropriateness Method has been applied to the evaluation of spinal manipulation. Regional variations in chiropractic utilization have yet to be described through small area analysis, but these methods appear to hold some potential for assessing the appropriateness of chiropractic care. Both small area analysis and the RAND-UCLA method offer limited possibilities for the assessment of chiropractic appropriateness.
Conclusion
Future assessment of the appropriate role for chiropractic in US health care will raise issues beyond the scope of previous appropriateness studies. Studying the appropriate role for chiropractic will require consideration of the clinical discipline in its entirety, rather than individual consideration of specific interventions. A fair assessment of chiropractic appropriateness will require new evidence and perhaps new research methodologies.
Key indexing terms: Chiropractic, Disease management, Utilization, Small area analysis
Introduction
The delivery of health care services in the United States is characterized by geographic variations that cannot be justified scientifically.1 Consequently, many assumptions about the quality of US health care and the appropriateness of health care interventions are being challenged.2 Clinicians and their patients must decide what kind of care is best, whereas health policy decision makers and third-party payors are faced with the considerable challenge of determining the appropriateness of various interventions. The chiropractic profession is the third largest portal-of-entry health profession in the United States (after medicine and dentistry),3,4 but the appropriate role for chiropractic in the United States has not been established. The role of chiropractic has been explored from both a biomedical and a sociological perspective,5-7 but the profession has failed to establish a coherent vision of purpose.6 Amid this context of uncertainty, third-party payors and public policy makers must make decisions about the appropriate role for chiropractors in health care systems and for the clinical services that chiropractors provide. Research on the appropriateness of chiropractic care may help inform their decisions. The purpose of this article is to discuss the implications and limitations of chiropractic-related appropriateness studies.
Discussion
The 1998 editorial in The New England Journal of Medicine posed the question, “What role for chiropractic in health care?”7 Paul Shekelle, author of numerous articles on the appropriateness of health care interventions, considered the question of whether chiropractic should be considered a nonsurgical specialty or an alternative to medicine. Following his review of the evidence, he concluded that chiropractic provides limited benefits for musculoskeletal conditions, but use of chiropractic as a broad-based alternative to medical care is inappropriate. After another decade of chiropractic research activity, that answer may still ring true, but the questions have changed. Nearly 70% of chiropractors reject the characterization of chiropractic as alternative medicine.8 Spinal manipulation, the intervention most commonly used by chiropractors, is now of proven clinical value for treatment of certain conditions.9-16 Despite efforts toward integration, however,17,18 the future role of chiropractic in US health care remains uncertain.6 Since the RAND Corporation studies on the appropriateness of spinal manipulation were published in the 1990s,19-23 the appropriateness of chiropractic care has not been rigorously investigated. However, the RAND studies focused on spinal manipulation, not chiropractic as a whole. Sociological studies of chiropractic describe the profession as a whole health system. This is how the profession is viewed by most chiropractors themselves and by many patients.5,24 If chiropractic is a whole health system, then its appropriateness should be measured not only by the efficacy of a single intervention but by the effectiveness of the entire chiropractic clinical encounter.25 With increasing interest in the integration of medical and nonmedical health professions, it may prove helpful to rigorously assess the appropriateness of general chiropractic care. Decisions about inclusion in integrative clinics and health plans may be made on the basis of professional identity rather than solely on the services provided. The appropriateness of chiropractic care in general is therefore relevant to decisions regarding inclusion of doctors of chiropractic. However, the double standard inherent in this argument must be acknowledged. Published studies on the appropriateness of medical interventions appear to have been grounded on the tacit premise that inclusion of conventional medicine in health care is appropriate. As a nondominant profession in the health care environment, the chiropractic profession is not always afforded the same presumptive status.
Assessment of the appropriateness of health care services
Appropriate care is care that is worth providing and that has a favorable risk-benefit ratio.26 Assessments of appropriateness can inform public policy and third-party reimbursement as well as provider and patient decision making. Research methodologies relevant to the study of appropriateness include small area analysis and the RAND-UCLA Appropriateness Method. Small area analysis techniques allow researchers to describe and map geographic variations in health care utilization, describe patterns in variation, and identify variables that may in part explain the variation.27,28 The RAND-UCLA Appropriateness Method is an established means of assessing the appropriateness of a health care intervention.26 In this method, a literature review is performed to create a list of clinical indications for using a particular procedure. Members of a panel of experts critically review and synthesize the evidence to generate quantitative estimates of the benefits and harms, and independently rate the appropriateness of performing the procedure for each indication. The panel members subsequently meet, discuss areas of disagreement, and again independently rate the indications. A mean appropriateness score for each intervention is then calculated from the collective results.29 Criteria resulting from the application of this method can be used to retrospectively rank the appropriateness of interventions. Appropriateness criteria can be used to inform clinical decision making,30 but are probably more useful for health policy decision making.31
The RAND-UCLA Appropriateness Method was developed in part to help answer questions about appropriateness that were originally raised by studies conducted by John Wennberg. In 1973, Wennberg and Gittelsohn32 published the first in a series of studies that described unexplained geographic variations in medical care. Since then, The Dartmouth Atlas of Health Care Project, using methods of small area analysis that define local health care markets, has examined differences in per capita resource inputs and utilization of various medical and surgical services.27,33,34 This research has uncovered differences in the distribution and use of health care services in 306 hospital referral regions across the United States—health care spending by Medicare enrollees varies by as much as 2.5-fold among regions.35 Many such variations are likely to be inappropriate if they cannot be adequately explained on the basis of differences among regions in illness rates or sociodemographic characteristics.36,37 Geographic variations in medical spending have been found to be due to differences in the number of physician visits (particularly inpatient physician visits), medical procedures, and use of specialty medical services.35 Interestingly, areas of higher medical spending (often referred to as high practice intensity areas) do not appear to have better health care outcomes or higher levels of patient satisfaction.38,39 To explain the geographic variations in medical spending, The Dartmouth Atlas of Health Care classifies health care services into 3 categories of variation:
-
•
Supply-sensitive care (63% of care)
-
•
Effective care (12% of care)
-
•
Preference-sensitive care (25% of care) 40
Supply-sensitive care is governed by the local supply of health care services: the greater the supply, the higher the rate of use. Higher rates of use of supply-sensitive care however may not confer better health outcomes.40 Effective care is appropriate care; it consists of health care services that are proven effective and have a favorable risk-benefit ratio. Failure to treat an eligible patient with effective care represents underuse.40 An example of effective care is surgical fixation of a severe open comminuted tibia fracture in an otherwise healthy patient. Preference-sensitive care includes services for which the pros and cons are subject to interpretation; in these cases, when the best choice of care is not clear-cut, patients should be given the information and support they require to share in the decision making.41 Nonspecific low back pain is an example of a condition that may be subject to preference-sensitive care. In such cases, the choice should be based on the patient's own preferences; but all too often, it is the provider who decides.40
Implications of appropriateness studies for chiropractic
Both small area analysis and the RAND-UCLA Appropriateness Method have implications relevant to the assessment of chiropractic appropriateness, and the RAND method has been applied to the evaluation of spinal manipulation.19-23 As the United States struggles with health care reform, the concept of the appropriateness of medical interventions is receiving attention from policy makers. Officials at the highest levels of the federal government recognize that unwarranted variations in medical utilization and spending are well documented42 and that it may be possible to control ballooning health care costs by correcting the overuse, underuse, and misuse of medical care.43 Within this context, questions about the appropriateness of chiropractic care may also be raised. Decision makers who know that more health care does not necessarily mean better care may ask, “For which patients is chiropractic care appropriate and for what indications and purpose?”
The assessment of appropriateness, whether applied to medicine, chiropractic, or any other clinical discipline or intervention, is a subjective determination that should draw upon objective evidence for effectiveness, safety, and cost. The manner in which clinical decision making occurs also bears upon the appropriateness of care. Without the participation of the patient, the very idea of judging one approach to care as being more appropriate than another might be rightly perceived as high-handed. Decisions about the utilization of health care services must take into account the individualized needs and preferences of the patient and should not be driven by the needs, inclinations, or specialized expertise of the doctor. The sharing of clinical decision-making between doctor and patient is thought to help facilitate the delivery of appropriate care.44,45 Fig 1 illustrates the interplay of 4 principal factors involved in the assessment of appropriateness.
Implications of the RAND-UCLA Appropriateness Method
In a series of studies in the 1990s, the RAND-UCLA Appropriateness Method was applied to the evaluation of spinal manipulation for neck and low back pain.19-23 Two different appropriateness studies were conducted on spinal manipulation for low back pain. The first study convened a multidisciplinary panel, including chiropractic physicians, medical doctors, and an osteopathic physician. Of 1550 indications for spinal manipulation, the panel found 60% to be inappropriate, 30% equivocal, and 7% appropriate.22 The second study convened an all-chiropractic panel, which found that of 1570 indications, 48% were inappropriate, 25% uncertain, and 27% appropriate.21 The authors noted that, “the large number (48%) of indications felt to be inappropriate probably reflects our attempt to make exhaustive the list of potential indications for performing spinal manipulation.”21 In both panels, the indications deemed appropriate included the more common presentations of back pain, whereas the inappropriate indications contained many uncommon presentations. Ratings varied significantly among panel members; chiropractors were more likely to rate clinical indications as appropriate for manipulation than were nonchiropractors.19
A retrospective review of chiropractic office records was subsequently conducted to determine the appropriateness of the use of spinal manipulation for low back pain using the 9-point scale criteria. The study found the use of spinal manipulation to be appropriate in 46% of cases and inappropriate in 29%. The assessment was inconclusive in 25% of cases. For cases in which the patient received chiropractic care but did not receive spinal manipulation, the investigators found that manipulation would have been appropriate in 38%.23 A similar set of appropriateness ratings was developed for manipulation and mobilization of the cervical spine.20
Potential implications of small area analysis
Regional variations in chiropractic utilization have yet to be described through small area analysis. These methods have not been applied to the study of chiropractic appropriateness. However, consideration of the concepts of supply-sensitive care, effective care, and preference-sensitive care may aid the formulation of hypotheses regarding the appropriateness of chiropractic care. Overutilization of supply-sensitive care occurs when care is rendered in proportion to increased availability rather than clinical necessity.36 A 2008 study found evidence of oversupply of chiropractic services in a market of questionable demand in Ontario, Canada.46 Another study that examined the national supply and demand of US chiropractors uncovered a 28% decrease in the national supply of new chiropractic college graduates, whereas national expenditures on chiropractic care grew significantly over the same period.3 Chiropractic care may be supply-sensitive in certain geographic areas.
By contrast, systematic underutilization of effective care occurs when services of proven value for which the benefits outweigh the risks are underused because of lack of support for systematic compliance with treatment guidelines.36 Spinal manipulation is generally considered to be a safe,13,47 effective,10-13,15 and cost-effective 48 treatment of certain spinal pain disorders; and the number of individuals with such spinal pain disorders appears to greatly exceed the current number of chiropractic users.3,49,50 However, many of the studies that have demonstrated the effectiveness of spinal manipulation for spinal pain disorders have not shown outcomes significantly better than other therapies, although patients do often report high levels of satisfaction.47,51,52 Spinal manipulation for certain spinal pain disorders therefore may be considered to fall under the category of preference-sensitive care. The category of variation for a given intervention may depend upon the condition being treated, patient-related variables, and other factors; and considerable overlap between categories may occur for any given procedure.
A conspicuous geographic variation in the delivery of chiropractic care was recently revealed by analysis of the Medicare Chiropractic Services Demonstration, which was intended to evaluate the effects of expanded coverage for chiropractic services.53 Despite reduced costs in 4 of 5 demonstration areas, a budget neutrality analysis found a net increase in overall Medicare payments in demonstration areas as compared with control areas. The increase in payments was due to increased utilization in the Chicago area. This finding suggests the possibility that care delivered in the Chicago demonstration site may have been supply sensitive.
Limitations of appropriateness studies for chiropractic
The RAND-UCLA method addresses the appropriateness of initiating treatment, but not of frequency or duration of treatment, issues of particular relevance to chiropractic care, which is characterized by serial treatments.54 Furthermore, the RAND-UCLA method is intervention and condition based; and therefore, although applicable to the evaluation of an intervention (ie, spinal manipulation) for the care of a disorder (ie, low back pain), it is not designed to evaluate a complex clinical encounter. Therefore, the RAND-UCLA method may be unsuited to evaluate the appropriateness of chiropractic care in general. Chiropractic care includes but is not limited to spinal manipulation, so it would be erroneous to equate the appropriateness of the common domain procedure of spinal manipulation with the appropriateness of chiropractic health care. A typical chiropractic clinical encounter may include (in addition to or instead of spinal manipulation) physical therapy modalities and patient counseling on diet, nutritional supplementation, exercise, and lifestyle modification.55
Methods of small area analysis used to investigate geographic variations in medical care could be applied to the study of chiropractic care. Any analysis of Medicare claims for chiropractic, however, must be interpreted in light of Medicare's restrictive reimbursement policies. Medicare dictates that the primary diagnosis must be a “vertebral subluxation” and the secondary diagnosis must be a related neuromusculoskeletal condition, and the only reimbursable treatment procedure is spinal manipulation. Medicare claims data thus effectively equate chiropractic care with spinal manipulation for neuromusculoskeletal conditions related to spinal dysfunction, and inferences regarding the appropriateness of spinal manipulation may not be generalized to chiropractic in general.
In and of themselves, both small area analysis and the RAND-UCLA method offer limited possibilities for the assessment of chiropractic appropriateness. Small area analysis of Medicare claims offers great potential for descriptive studies and may also be used to help explain variations in chiropractic utilization. For example, geographic variations in the provision of services may be related to variations in state scope of practice laws or patient demographics. However, any attempt to analyze the appropriateness of chiropractic care in general would be limited by Medicare's restrictive inclusion and reimbursement policies. If applied to a less restrictive source of data, techniques of small area analysis might have greater potential; but Medicare claims are currently the single most comprehensive source of clinical data available in the United States. The RAND-UCLA method is similarly limited because it was designed to evaluate interventions, but not a clinical encounter in its entirety. Furthermore, the expert opinion generated by the RAND-UCLA method is probably more applicable to the evaluation of interventions for which there is little evidence, and may be regarded as superfluous if applied to interventions for which systematic reviews and clinical practice guidelines are already available.
Finally, scant evidence is available for assessing the appropriate role for chiropractic care in general as a complex clinical encounter.24 The personalized, patient-centered paradigm of chiropractic care and the wide variation in chiropractic techniques and practice styles present challenges for appropriateness research.54,56,57 It may be necessary to use new methods to evaluate the appropriateness of chiropractic as a whole health system.24,58
Conclusion
The appropriate role for chiropractic in US health care has yet to be determined. This article discussed the relevance of appropriateness studies, methodologies used to assess appropriateness, and identified implications and limitations of those approaches for the evaluation of chiropractic care. The future assessment of the appropriate role for chiropractic in US health care will raise issues beyond the scope of previous appropriateness studies. Studying the appropriate role for chiropractic will require consideration of the clinical discipline in its entirety, rather than individual consideration of specific interventions. A fair assessment will require new evidence, and perhaps new research methodologies, both for generating evidence on quality and for assessing appropriateness based upon that evidence. Future assessments of the role of chiropractic in US health care will inevitably involve political considerations as well as scientific evidence. Whereas chiropractic physicians may have limited control over the former, the profession can exert some control over the latter by guiding the research agenda toward a comprehensive assessment of the benefits of chiropractic care.
Funding sources and potential conflicts of interest
Drs Whedon and Davis are both supported by grants from The National Center for Complementary and Alternative Medicine and The Bernard Osher Foundation. Dr Whedon's grant is titled “Utilization and Safety of Chiropractic Care in Older Adults” (5K01AT005092-02). The views expressed herein do not necessarily represent the views of the National Center for Complementary and Alternative Medicine or of the National Institutes of Health. No conflicts of interest were reported for this study.
References
- 1.The Dartmouth Institute for Health Policy and Clinical Practice Research agenda and findings. Lebanon, NH; 2009. http://dartmouthatlas.org/agenda.shtm [Updated 2009; cited 2009 December 7]; Available from:
- 2.The Center for Health Policy Research at The Dartmouth Institute Changing health care. Lebanon, NH; 2010. http://tdi.dartmouth.edu/centers/health-policy-research/changing-health-care/ [Updated 2010; cited 2010 June 11]; Available from:
- 3.Davis M.A., Davis A., Goertz C. The supply and demand of United States chiropractors from 1996 to 2006: past trends and future ramifications. Association of Chiropractic Colleges and Research Agenda Conference; Las Vegas, NV; 2009. [Google Scholar]
- 4.Smith M., Morschhauser S. NLM Gateway; US National Institutes of Health; Davenport, IA: 1999. Establishing a database of U.S. chiropractic health manpower data: furthering the development of research infrastructure.http://gateway.nlm.nih.gov/MeetingAbstracts/ma?f=102184948.html [Updated 1999; cited 2009 July 20]; 16:426: Available from: [Google Scholar]
- 5.Coulter I.D. Alternative philosophical and investigatory paradigms for chiropractic. J Manipulative Physiol Ther. 1993;16(6):419–425. [PubMed] [Google Scholar]
- 6.Nelson C., Lawrence D., Triano J., Bronfort G., Perle S., Metz R. Chiropractic as spine care: a model for the profession. Chiropr Osteopat. 2005 Jul;13(9):6. doi: 10.1186/1746-1340-13-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Shekelle P.G. What role for chiropractic in health care? N Engl J Med. 1998;339(15):1074–1075. doi: 10.1056/NEJM199810083391509. [DOI] [PubMed] [Google Scholar]
- 8.Redwood D., Hawk C., Cambron J., Vinjamury S.P., Bedard J. Do chiropractors identify with complementary and alternative medicine? Results of a survey. J Altern Complement Med. 2008;14(4):361–368. doi: 10.1089/acm.2007.0766. [DOI] [PubMed] [Google Scholar]
- 9.Assendelft W.J., Morton S.C., Yu E.I., Suttorp M.J., Shekelle P.G. Spinal manipulative therapy for low back pain. Cochrane Database Syst Rev. 2004;(1):CD000447. doi: 10.1002/14651858.CD000447.pub2. [DOI] [PubMed] [Google Scholar]
- 10.Bronfort G., Assendelft W.J., Evans R., Haas M., Bouter L. Efficacy of spinal manipulation for chronic headache: a systematic review. J Manipulative Physiol Ther. 2001;24(7):457–466. [PubMed] [Google Scholar]
- 11.Bronfort G., Haas M., Evans R., Kawchuk G., Dagenais S. Evidence-informed management of chronic low back pain with spinal manipulation and mobilization. Spine J. 2008;8(1):213–225. doi: 10.1016/j.spinee.2007.10.023. [DOI] [PubMed] [Google Scholar]
- 12.Bronfort G., Haas M., Evans R.L., Bouter L.M. Efficacy of spinal manipulation and mobilization for low back pain and neck pain: a systematic review and best evidence synthesis. Spine J. 2004;4(3):335–356. doi: 10.1016/j.spinee.2003.06.002. [DOI] [PubMed] [Google Scholar]
- 13.Chou R., Qaseem A., Snow V., Casey D., Cross J.J., Shekelle P. Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society. Ann Intern Med. 2007;147(7):478–491. doi: 10.7326/0003-4819-147-7-200710020-00006. [DOI] [PubMed] [Google Scholar]
- 14.Ferreira M.L., Ferreira P.H., Latimer J., Herbert R., Maher C.G. Efficacy of spinal manipulative therapy for low back pain of less than three months' duration. J Manipulative Physiol Ther. 2003;26(9):593–601. doi: 10.1016/j.jmpt.2003.08.010. [DOI] [PubMed] [Google Scholar]
- 15.Guzman J., Haldeman S., Carroll L.J., Carragee E.J., Hurwitz E.L., Peloso P. Clinical practice implications of the Bone and Joint Decade 2000-2010 Task Force on Neck Pain and Its Associated Disorders: from concepts and findings to recommendations. Spine. 2008;33(4 Suppl):S199–S213. doi: 10.1097/BRS.0b013e3181644641. [DOI] [PubMed] [Google Scholar]
- 16.Licciardone J.C., Brimhall A.K., King L.N. Osteopathic manipulative treatment for low back pain: a systematic review and meta-analysis of randomized controlled trials. BMC Musculoskelet Disord. 2005;6:43. doi: 10.1186/1471-2474-6-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Branson R.A. Hospital-based chiropractic integration within a large private hospital system in Minnesota: a 10-year example. J Manipulative Physiol Ther. 2009;32(9):740–748. doi: 10.1016/j.jmpt.2009.10.014. [DOI] [PubMed] [Google Scholar]
- 18.Dunn A.S., Green B.N., Gilford S. An analysis of the integration of chiropractic services within the United States military and veterans' health care systems. J Manipulative Physiol Ther. 2009;32(9):749–757. doi: 10.1016/j.jmpt.2009.10.009. [DOI] [PubMed] [Google Scholar]
- 19.Coulter I., Adams A., Shekelle P. Impact of varying panel membership on ratings of appropriateness in consensus panels: a comparison of a multi- and single disciplinary panel. Health Serv Res. 1995;30(4):577–591. [PMC free article] [PubMed] [Google Scholar]
- 20.Coulter I.D., Hurwitz E., Dams A., Meeker W., Hansen D., Mootz R. The appropriateness of spinal manipulation and mobilization of the cervical spine. Rand Corporation; Santa Monica (Calif): 1996. [Google Scholar]
- 21.Shekelle P.G., Adams A., Chassin M., Hurwitz E., Park R., Phillips R. The appropriateness of spinal manipulation for low-back pain. Indications and ratings by an all-chiropractic expert panel. Rand Corporation; Santa Monica (Calif): 1992. [Google Scholar]
- 22.Shekelle PG, Adams AH, Chassin MR, Hurwitz E, Park RE, Phillips RB. The appropriateness of spinal manipulation for low-back pain. Indications and ratings by a multidisciplinary expert panel. Rand Corporation; Santa Monica (Calif): 1992. [Google Scholar]
- 23.Shekelle P.G., Coulter I., Hurwitz E.L., Genovese B., Adams A.H., Mior S.A. Congruence between decisions to initiate chiropractic spinal manipulation for low back pain and appropriateness criteria in North America. Ann Intern Med. 1998;129(1):9–17. doi: 10.7326/0003-4819-129-1-199807010-00003. [DOI] [PubMed] [Google Scholar]
- 24.Coulter I.D., Khorsan R. Is health services research the Holy Grail of complementary and alternative medicine research? Altern Ther Health Med. 2008;14(4):40–45. [PubMed] [Google Scholar]
- 25.Scott J.G., Cohen D., Dicicco-Bloom B., Miller W.L., Stange K.C., Crabtree B.F. Understanding healing relationships in primary care. Ann Fam Med. 2008;6(4):315–322. doi: 10.1370/afm.860. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Shekelle P. The appropriateness method. Med Decis Making. 2004;24(2):228–231. doi: 10.1177/0272989X04264212. [DOI] [PubMed] [Google Scholar]
- 27.Fisher E.S., Wennberg J.E. Health care quality, geographic variations, and the challenge of supply-sensitive care. Perspect Biol Med. 2003;46(1):69–79. doi: 10.1353/pbm.2003.0004. [DOI] [PubMed] [Google Scholar]
- 28.Paul-Shaheen P., Williams D., Clark J. Small area analysis: a review and analysis of the North American literature. J Health Polit Policy Law. 1987;12(4):741–809. doi: 10.1215/03616878-12-4-741. [DOI] [PubMed] [Google Scholar]
- 29.Brook R.H., Chassin M.R., Fink A., Solomon D.H., Kosecoff J., Park R.E. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986;2(1):53–63. doi: 10.1017/s0266462300002774. [DOI] [PubMed] [Google Scholar]
- 30.Shekelle P.G. Are appropriateness criteria ready for use in clinical practice? N Engl J Med. 2001;344(9):677–678. doi: 10.1056/NEJM200103013440912. [DOI] [PubMed] [Google Scholar]
- 31.Shekelle P.G., Kahan J.P., Bernstein S.J., Leape L.L., Kamberg C.J., Park R.E. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med. 1998;338(26):1888–1895. doi: 10.1056/NEJM199806253382607. [DOI] [PubMed] [Google Scholar]
- 32.Wennberg J., Gittelsohn A. Small area variations in health care delivery. Science. 1973;182(117):1102–1108. doi: 10.1126/science.182.4117.1102. [DOI] [PubMed] [Google Scholar]
- 33.Wennberg J.E., Brownlee S., Fisher E.S., Skinner J.S., Weinstein J.M. The Dartmouth Institute for Health Policy and Clinical Practice; Lebanon (NH): 2008. An agenda for change. Improving quality and curbing health care spending: opportunities for the congress and the Obama administration. [PubMed] [Google Scholar]
- 34.Wennberg J.E., Cooper M.M. American Health Association Press; Chicago: 1999. The quality of medical care in the United States: a report on the Medicare program. [PubMed] [Google Scholar]
- 35.Wennberg J.E., Brownlee S., Fisher E.S., Skinner J.S., Weinstein J.M. The Dartmouth Atlas of Health Care; Lebanon, NH: 2009. An agenda for change. Improving quality and curbing health care spending: opportunities for the congress and the Obama administration.http://www.dartmouthatlas.org/topics/agenda_for_change.pdf Available from: [PubMed] [Google Scholar]
- 36.Fisher E.S. Research agenda and findings. 2008. http://www.dartmouthatlas.org/agenda.shtm [Updated 2008; cited 2009 July 21]; Available from:
- 37.Sutherland J.M., Fisher E.S., Skinner J.S. Getting past denial—the high cost of health care in the United States. N Engl J Med. 2009;361(13):1227–1230. doi: 10.1056/NEJMp0907172. [DOI] [PubMed] [Google Scholar]
- 38.Fisher E.S., Wennberg D.E., Stukel T.A., Gottlieb D.J., Lucas F.L., Pinder E.L. The implications of regional variations in Medicare spending. Part 2: health outcomes and satisfaction with care. Ann Intern Med. 2003;138(4):288–298. doi: 10.7326/0003-4819-138-4-200302180-00007. [DOI] [PubMed] [Google Scholar]
- 39.Fisher E.S., Wennberg D.E., Stukel T.A., Gottlieb D.J., Lucas F.L., Pinder E.L. The implications of regional variations in Medicare spending. Part 1: the content, quality, and accessibility of care. Ann Intern Med. 2003;138(4):273–287. doi: 10.7326/0003-4819-138-4-200302180-00006. [DOI] [PubMed] [Google Scholar]
- 40.Wennberg J.E. Evidence-based medicine: vehicle to value and efficiency?. Medical Technology Leadership Forum; 2008 June 6; San Francisco, CA; 2008. [Google Scholar]
- 41.O'Connor A.M., Rostom A., Fiset V., Tetroe J., Entwistle V., Llewellyn-Thomas H. Decision aids for patients facing health treatment or screening decisions: systematic review. BMJ. 1999;319(7212):731–734. doi: 10.1136/bmj.319.7212.731. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Pear R. The New York Times; New York (NY): 2009. Health care spending disparities stir a fight. Available from: http://www.nytimes.com/2009/06/09/us/politics/09health.html. [Google Scholar]
- 43.Orszag P. Before the Committee on Finance, United States Senate; Washington, DC: 2008. The overuse, underuse, and misuse of health care. [Google Scholar]
- 44.Charles C., Gafni A., Whelan T. Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999;49(5):651–661. doi: 10.1016/s0277-9536(99)00145-8. [DOI] [PubMed] [Google Scholar]
- 45.Wennberg J.E., O'Connor A.M., Collins E.D., Weinstein J.N. Extending the P4P agenda, part 1: how Medicare can improve patient decision making and reduce unnecessary care. Health Aff. 2007;26(6):1564–1574. doi: 10.1377/hlthaff.26.6.1564. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Mior S.A., Laporte A. Economic and resource status of the chiropractic profession in Ontario, Canada: a challenge or an opportunity. J Manipulative Physiol Ther. 2008;31(2):104–114. doi: 10.1016/j.jmpt.2007.12.007. [DOI] [PubMed] [Google Scholar]
- 47.Rubinstein S.M., Leboeuf-Yde C., Knol D.L., de Koekkoek T.E., Pfeifle C.E., van Tulder M.W. The benefits outweigh the risks for patients undergoing chiropractic care for neck pain: a prospective, multicenter, cohort study. J Manipulative Physiol Ther. 2007;30(6):408–418. doi: 10.1016/j.jmpt.2007.04.013. [DOI] [PubMed] [Google Scholar]
- 48.Haas M., Sharma R., Stano M. Cost-effectiveness of medical and chiropractic care for acute and chronic low back pain. J Manipulative Physiol Ther. 2005;28(8):555–563. doi: 10.1016/j.jmpt.2005.08.006. [DOI] [PubMed] [Google Scholar]
- 49.Martin B.I., Deyo R.A., Mirza S.K., Turner J.A., Comstock B.A., Hollingworth W. Expenditures and health status among adults with back and neck problems. JAMA. 2008 Feb 13;299(6):656–664. doi: 10.1001/jama.299.6.656. [DOI] [PubMed] [Google Scholar]
- 50.Strine T.W., Hootman J.M. US national prevalence and correlates of low back and neck pain among adults. Arthritis Rheum. 2007;57(4):656–665. doi: 10.1002/art.22684. [DOI] [PubMed] [Google Scholar]
- 51.Hertzman-Miller R.P., Morgenstern H., Hurwitz E.L., Yu F., Adams A.H., Harber P. Comparing the satisfaction of low back pain patients randomized to receive medical or chiropractic care: results from the UCLA low-back pain study. Am J Public Health. 2002;92(10):1628–1633. doi: 10.2105/ajph.92.10.1628. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Lawrence D.J., Meeker W. Chiropractic and CAM utilization: a descriptive review. Chiropr Osteopat. 2007;15(2.) doi: 10.1186/1746-1340-15-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Stason W.B., Ritter G., Shepard D.S., Prottas J., Tompkins C., Martin T.C. Final report: evaluation of the demonstration of expanded coverage of chiropractic services under Medicare. Brandeis University; Waltham (Mass): 2010. [Google Scholar]
- 54.Micozzi M.S. Complementary care: when is it appropriate? Who will provide it? Ann Intern Med. 1998;129(1):65–66. doi: 10.7326/0003-4819-129-1-199807010-00014. [DOI] [PubMed] [Google Scholar]
- 55.American Chiropractic Association . 2010. What is chiropractic?http://www.acatoday.org/level2_css.cfm?T1ID=13&T2ID=61 Arlington, VA: American Chiropractic Association; 2010. [Updated 2010; cited 2010 June 11]; Available from: [Google Scholar]
- 56.Gatterman M.I. A patient-centered paradigm: a model for chiropractic education and research. J Altern Complement Med. 1995;1(4):371–386. doi: 10.1089/acm.1995.1.371. [DOI] [PubMed] [Google Scholar]
- 57.Practice and Policy Guidelines Panel–National Institutes of Health Office of Alternative Medicine Clinical practice guidelines in complementary and alternative medicine. An analysis of opportunities and obstacles. Arch Fam Med. 1997;6(2):149–154. doi: 10.1001/archfami.6.2.149. [DOI] [PubMed] [Google Scholar]
- 58.Goertz C., editor. Practice-based research networks: meeting the challenge of reflecting complementary and integrative medicine clinical practice. North American Research Conference on Complementary and Integrative Medicine Consortium of Academic Health Centers for Integrative Medicine; Minneapolis, MN: 2009. [Google Scholar]