Table 3.
Effect sizes by cognitive domain: Effects of outcome measures, confidence intervals and prediction intervals
| Cognitive domain | Study | Measure | n | g | Actual/ observed intervals | p | Q | df (Q) | p | I 2 | τ2 | τ | Prediction intervals | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Lower (95%) | Upper (95%) | Lower (95%) | Upper (95%) | ||||||||||||
| Mental status/ general cognitive | |||||||||||||||
| Barban et al. (2016) | MMSE | 106 | 0.111 | −0.271 | 0.493 | 0.569 | |||||||||
| Barnes et al. (2009) | RBANS Total | 36 | 0.374 | −0.272 | 1.020 | 0.256 | |||||||||
| Buschert et al. (2011) | Combined (MMSE + ADAS-Cog) | 22 | 0.387 | −0.514 | 1.288 | 0.400 | |||||||||
| Carretti et al. (2013) | Cattell – CFT | 20 | 0.818 | −0.059 | 1.695 | 0.068 | |||||||||
| Fiatarone Singh et al. (2014) | ADAS-Cog | 22 | −0.057 | −0.626 | 0.512 | 0.844 | |||||||||
| Forster et al. (2011) | Combined (MMSE + ADAS-Cog) | 18 | 0.427 | −0.564 | 1.417 | 0.399 | |||||||||
| Greenaway et al. (2012) | Combined (MMSE + DRS-2) | 40 | 0.508 | −0.109 | 1.126 | 0.107 | |||||||||
| Jean et al. (2010a) | Combined (MMSE + RBMT + DRS-2) | 20 | 0.305 | −0.545 | 1.156 | 0.482 | |||||||||
| Jeong et al. (2016) | Combined (MMSE + ADAS-Cog) | 147 | −0.086 | −0.430 | 0.258 | 0.623 | |||||||||
| Lam et al. (2015) | Combined (CMMSE + ADAS-Cog) | 276 | −0.059 | −0.294 | 0.177 | 0.626 | |||||||||
| Olchik et al. (2013) | RBMT – Screening Score | 30 | 0.132 | −0.567 | 0.830 | 0.712 | |||||||||
| Polito et al. (2015) | Combined (MMSE + MOCA) | 44 | 0.079 | −0.501 | 0.660 | 0.788 | |||||||||
| Rojas et al. (2013) | MMSE | 30 | 0.926 | 0.191 | 1.661 | 0.014 | |||||||||
| Schmitter-Edgecombe et al. (2014) | RBMT-II | 46 | 0.336 | −0.236 | 0.908 | 0.250 | |||||||||
| Tsolaki et al. (2011) | Combined (MMSE + MOCA) | 176 | 0.486 | 0.182 | 0.790 | 0.002 | |||||||||
| Vidovich et al. (2015) | CAMCOG-R | 155 | 0.247 | −0.066 | 0.561 | 0.122 | |||||||||
| Random - Observed (k = 16) | 0.216 | 0.076 | 0.356 | 0.003 | 19.462 | 15 | 0.194 | 22.928 | 0.017 | 0.131 | −0.103 | 0.5349 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.218 | 0.070 | 0.366 | 0.007 | |||||||||||
| Working memory/attention | |||||||||||||||
| Balietti et al. (2016) | Combined (DS-FWD + CSST + Matrices) | 70 | 1.469 | 0.939 | 2.000 | 0.000 | |||||||||
| Barnes et al. (2009) | WMS-III Spatial Span | 36 | 0.663 | 0.006 | 1.321 | 0.048 | |||||||||
| Carretti et al. (2013) | Combined (DS-FWD, BWD, CWMS, VS) | 20 | 0.474 | −0.383 | 1.331 | 0.279 | |||||||||
| Finn and McDonald (2011) | Visual Sustained (RVP) | 16 | 1.056 | 0.060 | 2.052 | 0.038 | |||||||||
| Finn and McDonald (2015) | WMS-IV Spatial Span | 24 | 0.404 | −0.377 | 1.185 | 0.310 | |||||||||
| Gagnon and Belleville (2012) | Combined (TEA + Visual + DS + DA) | 24 | 0.893 | 0.173 | 1.613 | 0.015 | |||||||||
| Giuli et al. (2016) | Combined (DS + CSST + Matrices) | 97 | 0.414 | 0.014 | 0.815 | 0.043 | |||||||||
| Herrera et al. (2012) | Combined (DS-FWD + DS-BWD) | 22 | 2.941 | 1.708 | 4.174 | 0.000 | |||||||||
| Jeong et al. (2016) | Composite Score (DS-FWD + DS-BWD) | 147 | 0.106 | −0.238 | 0.449 | 0.547 | |||||||||
| Mowszowski et al. (2014) | WAIS-III DS Total | 40 | 0.254 | −0.376 | 0.884 | 0.429 | |||||||||
| Polito et al. (2015) | CSST | 44 | 0.031 | −0.550 | 0.611 | 0.918 | |||||||||
| Vidovich (2015) | Combined (DS-FWD + DS-BWD) | 155 | 0.142 | −0.172 | 0.456 | 0.375 | |||||||||
| Random - Observed (k = 12) | 0.614 | 0.285 | 0.943 | 0.000 | 43.068 | 11 | 0.000 | 74.459 | 0.227 | 0.476 | −0.512 | 1.7395 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.627 | 0.176 | 1.078 | 0.011 | |||||||||||
| Speed of information processing | |||||||||||||||
| Buschert et al. (2011) | TMT-A | 22 | −0.327 | −1.140 | 0.486 | 0.431 | |||||||||
| Fiatarone Singh et al. (2014) | SDMT | 22 | −0.272 | −0.844 | 0.299 | 0.350 | |||||||||
| Finn and McDonald (2015) | D-KEFS Number Seq. | 24 | −0.210 | −0.985 | 0.565 | 0.596 | |||||||||
| Gagnon et al. (2012) | TMT-A | 24 | −0.280 | −1.057 | 0.497 | 0.480 | |||||||||
| Valdes et al. (2012) | SOPT | 195 | −1.565 | −1.887 | −1.243 | 0.000 | |||||||||
| Vidovich et al. (2015) | Combined (TMT-A + Symbol Search) | 155 | 0.137 | −0.179 | 0.454 | 0.394 | |||||||||
| Random - Observed (k = 6) | −0.434 | −1.150 | 0.282 | 0.235 | 58.656 | 5 | 0.000 | 91.476 | 0.701 | 0.837 | −2.9702 | 2.1022 | |||
| HKSJ Point Estimate Adjustment (SMD) | −0.441 | −1.085 | 0.203 | 0.139 | |||||||||||
| Language | |||||||||||||||
| Balietti et al. (2016) | Semantic Fluency | 70 | 1.031 | 0.536 | 1.525 | 0.000 | |||||||||
| Fiatarone Singh et al. (2014) | Semantic Fluency | 22 | 0.609 | 0.027 | 1.191 | 0.040 | |||||||||
| Giuli et al. (2016) | Semantic Fluency | 97 | 0.134 | −0.261 | 0.530 | 0.505 | |||||||||
| Lam et al. (2015) | Semantic Fluency | 276 | 0.223 | −0.014 | 0.459 | 0.065 | |||||||||
| Mowszowski et al. (2014) | Semantic Fluency | 40 | 0.380 | −0.252 | 1.013 | 0.239 | |||||||||
| Olchik et al. (2013) | Semantic Fluency | 30 | 0.688 | −0.031 | 1.407 | 0.061 | |||||||||
| Rojas (2013) | Combined (BNT + Semantic Fluency) | 30 | 0.967 | 0.217 | 1.717 | 0.011 | |||||||||
| Random - Observed (k = 7) | 0.511 | 0.231 | 0.790 | 0.000 | 13.457 | 6 | 0.000 | 55.414 | 0.072 | 0.269 | −0.2698 | 1.2918 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.519 | 0.179 | 0.859 | 0.010 | |||||||||||
| Visual-spatial | |||||||||||||||
| Barnes et al. (2009) | RBANS – Figure Copy | 36 | 0.483 | −0.089 | 1.054 | 0.098 | |||||||||
| Tsolaki et al. (2011) | Combined (RCFT–Copy + Clock Drawing) | 176 | 0.374 | 0.072 | 0.676 | 0.015 | |||||||||
| Random - Observed (k = 2) | 0.398 | 0.131 | 0.665 | 0.003 | – | – | – | – | – | – | – | – | |||
| HKSJ Point Estimate Adjustment (SMD) | – | – | – | – | |||||||||||
| Memory – all (verbal and non-verbal – immediate and delay) | |||||||||||||||
| Balietti et al. (2016) | Combined (Story + Word Pairs) | 70 | 2.884 | 2.218 | 3.550 | 0.000 | |||||||||
| Barban et al. (2016) | Memory – List Delay (RAVLT) | 106 | 0.083 | −0.299 | 0.464 | 0.671 | |||||||||
| Barnes et al. (2009) | Memory – Delay (RBANS V + NV) | 36 | 0.611 | −0.044 | 1.266 | 0.068 | |||||||||
| Buschert et al. (2011) | Memory – Story Delay (RBANS) | 22 | 1.276 | 0.385 | 2.167 | 0.005 | |||||||||
| Carretti et al. (2013) | Memory – List Delay | 20 | 0.538 | −0.318 | 1.394 | 0.218 | |||||||||
| Fiatarone Singh et al. (2014) | Combined (List, Story, BVMT-R) | 22 | 0.216 | −0.355 | 0.786 | 0.459 | |||||||||
| Finn and McDonald (2011) | Memory – Delay (PAL + PRM) | 16 | 0.928 | −0.054 | 1.910 | 0.064 | |||||||||
| Finn and McDonald (2015) | Combined (VPA I + VPA II) | 24 | 0.166 | −0.608 | 0.940 | 0.673 | |||||||||
| Giuli et al. (2016) | Combined (Stories Imm + Word Pairs) | 97 | 0.678 | 0.271 | 1.084 | 0.001 | |||||||||
| Hampstead et al. (2012a) | Memory – Visual (Percent Change) | 21 | 1.312 | 0.399 | 2.225 | 0.005 | |||||||||
| Herrera et al. (2012) | Combined (List Delay(s) + Figure Delay) | 22 | 3.158 | 1.778 | 4.537 | 0.000 | |||||||||
| Jean et al. (2010a) | Combined (CVLT-II + Face-Name + RBMT) | 20 | 0.093 | −0.752 | 0.937 | 0.830 | |||||||||
| Jeong et al. (2016) | Memory – Composite (Verbal) | 147 | 0.161 | −0.183 | 0.505 | 0.360 | |||||||||
| Lam et al. (2015) | Memory – List Delay | 276 | 0.190 | −0.046 | 0.426 | 0.115 | |||||||||
| Mowszowski et al. (2014) | Memory – List Delay (RAVLT) | 40 | 0.356 | −0.276 | 0.989 | 0.269 | |||||||||
| Olchik et al. (2013) | Combined (RAVLT + RBMT Story) | 30 | 0.468 | −0.240 | 1.176 | 0.195 | |||||||||
| Rapp et al. (2002) | Combined (Word List, Story, & F-N Visual) | 16 | 0.566 | −0.396 | 1.528 | 0.249 | |||||||||
| Rojas et al. (2013) | Memory – List Delay | 30 | 0.944 | 0.208 | 1.680 | 0.012 | |||||||||
| Schmitter-Edgecombe et al. (2014) | Combined (RBANS V + NV, RBMT-II) | 46 | 0.244 | −0.327 | 0.814 | 0.402 | |||||||||
| Vidovich et al. (2015) | Combined (CVLT-II) | 176 | 0.325 | 0.009 | 0.640 | 0.044 | |||||||||
| Random - Observed (k = 20) | 155 | 0.659 | 0.383 | 0.936 | 0.000 | 90.898 | 19 | 0.000 | 79.098 | 0.277 | 0.526 | −0.4859 | 1.8039 | ||
| HKSJ Point Estimate Adjustment (SMD) | 0.675 | 0.305 | 1.045 | 0.001 | |||||||||||
| Memory - verbal | |||||||||||||||
| Combined (List Delay + Story Recall) | |||||||||||||||
| Balietti et al. (2016) | Combined (Story Delay + Word Pairs) | 70 | 2.824 | 2.165 | 3.483 | 0.000 | |||||||||
| Barban et al. (2016) | RAVLT (Delay) | 106 | 0.083 | −0.299 | 0.464 | 0.671 | |||||||||
| Buschert et al. (2011) | Story Delay (RBANS) | 22 | 1.276 | 0.385 | 2.167 | 0.005 | |||||||||
| Carretti et al. (2013) | List Delay | 20 | 0.538 | −0.318 | 1.394 | 0.218 | |||||||||
| Fiatarone Singh et al. (2014) | Story Delay (WMS-III LM II) | 22 | 0.296 | −0.276 | 0.868 | 0.310 | |||||||||
| Finn and McDonald (2015) | VPA-II | 24 | 0.182 | −0.592 | 0.956 | 0.645 | |||||||||
| Giuli et al. (2016) | Word Pairs | 97 | 0.812 | 0.401 | 1.223 | 0.000 | |||||||||
| Herrera et al. (2012) | Combined (List Delay) | 22 | 4.644 | 3.053 | 6.234 | 0.000 | |||||||||
| Jean et al. (2010a) | CVLT-II List Long Delay | 20 | 0.005 | −0.839 | 0.849 | 0.991 | |||||||||
| Lam et al. (2015) | List Delay | 276 | 0.190 | −0.046 | 0.426 | 0.115 | |||||||||
| Mowszowski et al. (2014) | RAVLT Delay | 40 | 0.356 | −0.276 | 0.989 | 0.269 | |||||||||
| Olchik et al. (2013) | RAVLT Delay | 30 | 0.487 | −0.221 | 1.196 | 0.178 | |||||||||
| Rapp et al. (2002) | Combined (Shopping, Word list + Story) | 16 | 0.654 | −0.309 | 1.617 | 0.183 | |||||||||
| Rojas et al. (2013) | List Delay | 12 | 0.944 | 0.208 | 1.680 | 0.012 | |||||||||
| Vidovich et al. (2015) | CVLT-II List Long Delay | 155 | 0.291 | −0.024 | 0.606 | 0.070 | |||||||||
| Random - Observed (k = 15) | 0.758 | 0.382 | 1.133 | 0.000 | 95.811 | 14 | 0.000 | 85.388 | 0.421 | 0.649 | −0.7034 | 2.2194 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.775 | 0.188 | 1.362 | 0.013 | |||||||||||
| Memory – non-verbal | |||||||||||||||
| Fiatarone Singh et al. (2014) | Form Recall – (BVMT-R) | 22 | 0.254 | −0.317 | 0.825 | 0.383 | |||||||||
| Finn and McDonald (2011) | Combined (PAL + PRM) | 16 | 0.928 | −0.054 | 1.910 | 0.064 | |||||||||
| Hampstead et al. (2012a) | Visual – Percent Change | 21 | 1.312 | 0.399 | 2.225 | 0.005 | |||||||||
| Herrera et al. (2012) | Figure Delay (Rey-O) | 22 | 0.185 | −0.620 | 0.991 | 0.652 | |||||||||
| Rapp et al. (2002) | Non-Verbal - Delay (Face – Name) | 16 | 0.619 | −0.339 | 1.577 | 0.205 | |||||||||
| Random - Observed (k = 5) | 0.570 | 0.160 | 0.980 | 0.006 | 5.082 | 4 | 0.279 | 21.292 | 0.047 | 0.217 | −0.3887 | 1.5287 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.593 | −0.016 | 1.202 | 0.054 | |||||||||||
| Executive functions | |||||||||||||||
| Balietti et al. (2016) | Phonemic Fluency | 70 | 5.266 | 4.278 | 6.254 | 0.000 | |||||||||
| Buschert et al. (2011) | TMT-B | 22 | −0.954 | −1.809 | −0.099 | 0.029 | |||||||||
| Fiatarone Singh et al. (2014) | Combined (FAS, Similarities, Matrices) | 22 | 0.248 | −0.324 | 0.821 | 0.395 | |||||||||
| Finn and McDonald (2011) | Combined (SWM + CANTAB-IED) | 16 | 1.096 | 0.094 | 2.097 | 0.032 | |||||||||
| Finn and McDonald (2015) | D-KEFS N-L Switching | 24 | 0.099 | −0.675 | 0.872 | 0.803 | |||||||||
| Gagnon and Belleville (2012) | Combined (TEAVis Elev + TMT-B) | 24 | 0.129 | −0.663 | 0.921 | 0.749 | |||||||||
| Giuli et al. (2016) | Phonemic Fluency | 97 | 0.943 | 0.527 | 1.360 | 0.000 | |||||||||
| Jeong et al. (2016) | Composite Score | 147 | 0.065 | −0.278 | 0.408 | 0.711 | |||||||||
| Mowszowski et al. (2014) | Combined (FAS + TMT-B) | 40 | 0.170 | −0.462 | 0.802 | 0.598 | |||||||||
| Olchik et al. (2013) | FAS | 30 | 0.270 | −0.431 | 0.971 | 0.450 | |||||||||
| Rojas et al. (2013) | FAS | 30 | 0.663 | −0.053 | 1.380 | 0.069 | |||||||||
| Tsolaki et al. (2011) | FUCAS Planning | 176 | 0.343 | 0.042 | 0.645 | 0.026 | |||||||||
| Vidovich et al. (2015) | Combined (FAS + TMT-B) | 155 | −0.103 | −0.418 | 0.212 | 0.522 | |||||||||
| Random - Observed (k = 13) | 0.575 | 0.093 | 1.056 | 0.019 | 126.40 | 12 | 0.000 | 90.507 | 0.669 | 0.818 | −1.3045 | 2.4545 | |||
| HKSJ Point Estimate Adjustment (SMD) | 0.585 | −0.262 | 1.432 | 0.158 | |||||||||||