Skip to main content
CMAJ : Canadian Medical Association Journal logoLink to CMAJ : Canadian Medical Association Journal
letter
. 2004 Feb 3;170(3):317.

Drawing policy conclusions from uncontrolled studies

Alexander C Tsai 1
PMCID: PMC331362  PMID: 14757650

Studying a population of adults seen in clinic for biliary colic, Boris Sobolev and associates1 documented an association between longer waiting times and admissions for emergency cholecystectomy.

However, because the patients were not randomly assigned to the waiting list, readers should entertain the possibility that the findings were driven by an association with a so-called “third variable.” For example, the patients who ended up on the waiting list might have been sicker. If so, the observed association between waiting times and emergency admissions was actually driven by an unobserved association between health status and emergency admissions. Sobolev and associates1 acknowledge the possibility of confounding by patient morbidity, and they do attempt rudimentary adjustment for other potential confounding variables. However, even if they had had access to better data on patients' health status, the criticism of potential confounding would remain.

Prior studies, none of which were cited by Sobolev and associates,1 have addressed this problem by means of econometric methodology.2,3,4 Hamilton and colleagues2 used an estimation strategy that accounted for unmeasured health differences and found no effect of waiting times on death rates for patients waiting for hip fracture surgery. Subsequent comparisons of patients with hip fracture in the United States and Canada3,4 arrived at a similar conclusion.

Policy-makers seeking to draw conclusions from the findings of Sobolev and associates1 would be well advised to consider these more sophisticated econometric analyses in their deliberations.

Alexander C. Tsai Case Western Reserve University School of Medicine Cleveland Heights, Ohio

References

  • 1.Sobolev B, Mercer D, Brown P, FitzGerald M, Jalink D, Shaw R. Risk of emergency admission while awaiting elective cholecystectomy. CMAJ 2003 ; 169(7):662-5. [PMC free article] [PubMed]
  • 2.Hamilton BH, Hamilton VH, Mayo NE. What are the costs of queuing for hip fracture surgery in Canada? J Health Econ 1996;15(2):161-85. [DOI] [PubMed]
  • 3.Ho V, Hamilton BH, Roos LL. Multiple approaches to assessing the effects of delays for hip fracture patients in the United States and Canada. Health Serv Res 2000;34(7):1499-518. [PMC free article] [PubMed]
  • 4.Hamilton BH, Ho V, Goldman DP. Queuing for surgery: Is the U.S. or Canada worse off? Rev Econ Stat 2000;82(2):297-308.

Articles from CMAJ : Canadian Medical Association Journal are provided here courtesy of Canadian Medical Association

RESOURCES