Skip to main content
. 2021 Jan 20;2021(1):CD011865. doi: 10.1002/14651858.CD011865.pub2

Young 2007.

Study characteristics
Methods Interrupted time series study
Participants 334 primary health physicians members of the Rochester Individual Practice Association (RIPA)
Interventions Rochester, New York (USA)
Interventions: pay for performance. In 2001, RIPA began the process of establishing a pay‐for‐performance programme as part of its contract with Excellus Health Plan to provide professional services for the approximately 450,000 individuals enrolled in Excellus’ Blue Choice Health Maintenance Organization (HMO) insurance product. Each RIPA primary care physician was eligible for reward payments of up to approximately USD 15,000 depending on his or her relative ranking on a composite performance measure for the diabetes‐related tests and screens.
Control: no explicit information, but may be salary.
RIPA served as an umbrella organisation for its member physicians with responsibilities for contracting with health plans on behalf of its member physicians and developing arrangements by which member physicians were reimbursed for their services.
Years 1999 to 2004, intervention happed in 2002, 3 time points for pre‐/postintervention
Outcomes Quality of health care provision
4 diabetes performance measures: glycated haemoglobin check, urinalysis, lipoprotein density level check, eye exam.
Glycated haemoglobin check: increase in level without significance, but post‐trend did not differ from the pre‐trend
Urinalysis: increase in level without significance, but post‐trend did not differ from the pre‐trend
LDL check: increase in level without significance, but post‐trend did not differ from the pre‐trend
Eye exams: increase in levels (7 percentage point increase after 1 year of intervention, but the increase did not persist), post‐trend did not differ from the pre‐trend
Notes  
Risk of bias
Bias Authors' judgement Support for judgement
Intervention independent of other changes (ITS) Low risk The increase in the eye examination score of intervention programme (Rochester (New York) Individual Practice Association) was contrary to the trends observed in the eye examination scores in Health Employer Data Information System nationally and statewide during this period, which were largely flat from 2000 to 2002. The observed increase thus did not appear to be attributable to a secular trend.
Shape of the intervention effect pre‐specified (ITS) Low risk The point of analysis is clear, the intervention start time: 2002.
Intervention unlikely to affect data collection (ITS) Unclear risk The data used for analysis in this paper were from patient electronic records, which were not influenced by payment reform. However, it is unclear if GPs' recording was changed with the start of the new payment policy.
Knowledge of the allocated interventions adequately prevented (ITS) Low risk Outcomes were objective.
Incomplete outcome data adequately addressed (ITS) Low risk No missing outcome data
Study free from selective outcome reporting (ITS) Low risk All outcomes mentioned in the methods section were reported in the results section.
Other risk of bias (ITS) Low risk The study included physicians who were members of the health plan for all 6 years, and so does not account for the potential selection bias if poorly performing physicians chose not to participate or withdraw.