Table 1.
User involvement as moderator in game study effectiveness.
| Outcome | Sample sizea, n |
kb, n |
Hedges’ gc
(95% CI) |
P g | Qd | P Q | I2e, % |
||
| Behavior |
|
|
|
|
|
|
|
||
|
|
Totalf | 317,582 | 24 | 0.216 (0.113 to 0.319) |
<.001 | 408.37 | <.001 | 94 | |
|
|
User involvement (between categories) | 11,684 | 22 |
|
|
6.74 | .03 |
|
|
|
|
User involvement (within categories) |
|
|
|
|
|
|
|
|
|
|
|
No involvement | 3238 | 4 | 0.540 (-0.230 to 1.311) |
.17 | 324.29 | <.001 | 99 |
|
|
|
Involvement only as tester | 430 | 4 | 0.520 (0.150 to 0.890) |
.01 | 10.21 | .02 | 71 |
|
|
|
Involvement as informant or codesigner | 8016 | 14 | 0.075 (0.017 to 0.133) |
.01 | 14.67 | .33 | 11 |
| Behavioral determinants |
|
|
|
|
|
|
|
||
|
|
Totalf | 22,366 | 51 | 0. 317 (0.244 to 0.391) |
<.001 | 219.72 | <.001 | 77 | |
|
|
User involvement (between categories) | 13,000 | 44 |
|
|
3.24 | .20 |
|
|
|
|
User involvement (within categories) |
|
|
|
|
|
|
|
|
|
|
|
No involvement | 4649 | 16 | 0.288 (0.161 to 0.414) |
<.001 | 39.26 | .001 | 62 |
|
|
|
Involvement only as tester | 1335 | 8 | 0.420 (0.278 to 0.562) |
<.001 | 9.97 | .19 | 30 |
|
|
|
Involvement as informant or codesigner | 7016 | 20 | 0.265 (0.170 to 0.361) |
<.001 | 49.37 | <.001 | 62 |
| Self-efficacy |
|
|
|
|
|
|
|
||
|
|
Totalf | 14,564 | 21 | 0.227 (0.130 to 0.324) |
<.001 | 86.14 | <.001 | 77 | |
|
|
User involvement (between categories) | 6398 | 20 |
|
|
7.83 | .02 |
|
|
|
|
User involvement (within categories) |
|
|
|
|
|
|
|
|
|
|
|
No involvement | 1545 | 8 | 0.384 (0.283 to 0.485) |
<.001 | 2.73 | .91 | 0 |
|
|
|
Involvement only as tester | 434 | 3 | 0.305 (-0.044 to 0.654) |
.09 | 6.80 | .03 | 71 |
|
|
|
Involvement as informant or codesigner | 4419 | 9 | 0.171 (0.061 to 0.281) |
.002 | 22.60 | .004 | 65 |
| Clinical outcomes |
|
|
|
|
|
|
|
||
|
|
Totalf | 9488 | 11 | 0. 071 (0.031 to 0.111) |
.001 | 8.08 | .62 | 0 | |
|
|
User involvement (between categories) | 1084 | 7 |
|
|
0.05 | .82 |
|
|
|
|
User involvement (within categories) |
|
|
|
|
|
|
|
|
|
|
|
No involvement | 119 | 2 | -0.036 (-0.402 to 0.330) |
.85 | 0.20 | .66 | 0 |
|
|
|
Involvement only as tester | 384 | 3 | 0.034 (-0.168 to 0.236) |
.74 | 0.63 | .73 | 0 |
|
|
|
Involvement as informant or codesigner | 700 | 4 | -0.001 (-0.217 to 0.216] |
.99 | 5.63 | .13 | 47 |
aCombined participant sample size.
bk: number of studies.
cHedges’ g (random effects).
dCochran’s Q test: homogeneity statistic (mixed effects).
eI2index: inconsistency, a second measure of heterogeneity.
fThe total includes the studies with missing values on the user involvement variable. For measures on behavior, one very large study (n=297,737) was included here, which was not involved in moderator analyses on user involvement, due to missing information.