TABLE 2.
Summary of sensitivity tests for the meta-analysis—random effects analysis (differential treatment effects: MTC vs. Comparison)
| Measurement Sensitivity | Study Sensitivity | ||||
|---|---|---|---|---|---|
| Domain | Original Findings Effect Size Odds Ratioe(p) | Test 1a Effect Size Odds Ratioe (p) | Test 2b Effect Size Odds Ratioe (p) | Test 3c Effect Size Odds Ratioe (p) | Test 4d Effect Size Odds Ratioe (p) |
| column 1 | 2 | 3 | 4 | 5 | 6 |
| Substance use | 0.650 (.043*) | 0.667 (.043*) | 0.673 (.021*) | 0.716 (.065) | 0.666 (.027*) |
| Mental health | 0.679 (.031*) | 0.714 (.061) | 0.685 (.035*) | 0.710 (.042*) | 0.705 (.048*) |
| Crime | 0.662 (.032*) | 0.692 (.048*) | 0.735 (.105) | 0.712 (.052*) | 0.681 (.038*) |
| HIV-risk behaviorf | 1.007 (.974) | - | - | - | - |
| Employment | 0.404 (.000***) | n/a | 0.521 (.000***) | 0.480 (.004**) | 0.495 (.014*) |
| Housing | 0.634 (.030*) | n/a | 0.711 (.104) | 0.676 (.044*) | 0.719 (.102) |
p<0.05;
p<0.01;
p<0.001
Test 1 — The measure showing the largest MTC treatment effect was treated as an outlier and removed in every domain with 2 or more measures (i.e., substance use, mental health, crime).
Test 2 — A measure with limited treatment effect (i.e., half the strength of the average of the observed measures) was added to each study in every domain.
Test 3 — A hypothetical study with no treatment effects was added. This study had the average number of subjects (92 MTC & 51 comparison=143), and the same number of measures for each domain. An odds ratio of 1.00 and the mean standard error from all other studies were assigned to the hypothetical study.
Test 4 — All HIV cases were included.
An odds ratio less than one indicates a greater improvement for clients in the MTC group than in the comparison group.
Sensitivity tests were not conducted on the HIV-risk behavior domain since results for original findings were not significant.