Table 3.
Results of testing for effects of hub characteristics on completion of performance improvement activities (N = 59 hubsϵ)
| Univariable models | Multivariable models | |||||||
|---|---|---|---|---|---|---|---|---|
| Characteristic | Change in hub score | Change in hub score | ||||||
| By metric | Overall sum (0–30) | By metric | ||||||
| Overall sum (0–30) | Careers (0–10) | IRB (0–10) | Pilots (0–10) | Careers (0–10) | IRB (0–10) | Pilots (0–10) | ||
| Model N | 55 | 55 | 55 | 55 | ||||
| Model Adjusted R2 | 0.17 | 0.16 | 0.20 | 0.21 | ||||
| Basic attributes | ||||||||
| Size£ at start of CMI program (tertiles) | ||||||||
| <$4.56 million (Ref) | – | – | – | – | – | – | – | – |
| $4.56–8.04 million | 2.88 | 0.38 | 0.96 | 1.54* | – | – | – | 1.27* |
| ≥$8.05 million | 1.64 | 0.72 | −0.20 | 1.12 | – | – | – | 1.42* |
| Initial funding cohort (tertiles) | ||||||||
| 2010–2015 | 0.69 | −0.14 | 0.63 | 0.20 | 0.89 | −0.37 | 0.29 | 0.95 |
| 2008–2009 | 4.75** | 1.41* | 1.78* | 1.56** | 6.07*** | 1.61** | 1.90** | 2.05*** |
| 2007 or earlier (Ref) | – | – | – | – | – | – | – | – |
| Previous experience with metric-based performance improvement | ||||||||
| Maturity of performance management system | −0.31 | −0.15 | 0.03 | −0.19 | – | – | – | – |
| Extent of automated data collection | −2.43 | 0.02 | −2.76*** | 0.31 | – | – | −2.16* | 1.73* |
| Extent of data stored in centralized database | −1.57* | −0.52 | −0.58 | −0.47 | – | −0.47 | – | −0.63* |
| Participation in Tufts Implementation Program | ||||||||
| Attendance¥ | ||||||||
| Training (7 sessions) | 1.21 | 0.22 | 0.35 | 0.64** | 1.05 | – | – | 0.66** |
| Coaching (6 sessions) | 2.25** | 0.43 | 1.10** | 0.72* | 2.00 | – | 1.16** | – |
| Coaching metric | ||||||||
| Careers (ref) | – | – | – | – | – | – | – | – |
| IRB | −1.69 | −1.89** | 1.55 | −1.35 | – | −1.87** | 0.77 | – |
| Pilots | −2.46 | −1.26 | −0.29 | −0.91 | – | −0.72 | −0.77 | – |
| Primary coach | ||||||||
| Coach A (Ref) | – | – | – | – | – | – | – | – |
| Coach B | −0.49 | 0.04 | −0.23 | −0.30 | – | – | – | – |
Ref = reference group (indicated by dashes in cell); CMI = Common Metrics Implementation.
*≤0.10; **≤0.05; ***≤0.01.
ϵ
One hub did not respond.
£
CTSA size is defined as total funding from U, T, K, and/or R grants for fiscal year 2015–2016.
¥
Attendance at a training or coaching session is defined as at least one person from the hub attended. Implementation Groups 1 and 2 were offered 7 coaching sessions; Implementation Group 3 was offered 6 coaching sessions.