Table 3.
Quality of EMA studies assessed by a checklist based on the criteria by Trull and Ebner-Priemer.21
| Articles | Adequate reporting of sampling approacha | Adequate reporting of measurementsb | Adequate reporting of data qualityc | Adequate reporting of study analysisd |
|---|---|---|---|---|
| Ammerman, Olino39 | Partial | Partial | Partial | Complete |
| Andrewes, Hulbert40 | Partial | Complete | Complete | Complete |
| Andrewes, Hulbert44 | Partial | Complete | Complete | Complete |
| Anestis, Silva33 | Partial | Partial | Absent | Partial |
| Armey, Crowther31 | Complete | Complete | Complete | Complete |
| Coifman, Berenson41 | Complete | Complete | Complete | Complete |
| Crowe, Daly54 | Complete | Complete | Absent | Complete |
| Depp, Moore26 | Complete | Complete | Partial | Complete |
| Depp, Moore28 | Partial | Partial | Partial | Complete |
| Fitzpatrick, Kranzler56 | Complete | Partial | Partial | Partial |
| Hadzic, Spangenberg51 | Partial | Complete | Partial | Absent |
| Hallensleben, Glaesmer55 | Partial | Partial | Complete | Partial |
| Hallensleben, Spangenberg48 | Complete | Complete | Partial | Partial |
| Hochard, Ashcroft66 | Partial | Complete | Partial | Partial |
| Hochard, Heym67 | Complete | Complete | Partial | Complete |
| Houben, Claes42 | Complete | Complete | Partial | Absent |
| Hughes, King86 | Complete | Complete | Complete | Complete |
| Humber, Emsley57 | Partial | Partial | Partial | Complete |
| Kleiman, Turner62 | Partial | Complete | Complete | Complete |
| Kranzler, Fehling62 | Complete | Complete | Complete | Complete |
| Lavender, De Young34 | Complete | Complete | Complete | Complete |
| Lavender, Wonderlich35 | Complete | Complete | Complete | Complete |
| Law, Furr47 | Partial | Partial | Partial | Complete |
| Links, Eynan27 | Complete | Complete | Complete | Partial |
| Littlewood, Kyle69 | Complete | Partial | Complete | Complete |
| Muehlenkamp, Engel36 | Partial | Complete | Absent | Partial |
| Nisenbaum, Links87 | Complete | Partial | Partial | Complete |
| Nock, Prinstein29 | Partial | Complete | Complete | Complete |
| Oppenheimer, Silk59 | Complete | Complete | Complete | Partial |
| Palmier-Claus, Taylor50 | Complete | Complete | Partial | Complete |
| Pearson, Pisetsky49 | Complete | Complete | Partial | Partial |
| Santangelo, Koenig60 | Complete | Partial | Partial | Partial |
| Selby, Franklin23 | Complete | Complete | Complete | Complete |
| Selby and Joiner24 | Complete | Complete | Complete | Complete |
| Selby, Nock64 | Complete | Complete | Complete | Partial |
| Snir, Rafaeli46 | Complete | Complete | Partial | Complete |
| Spangenberg, Glaesmer63 | Complete | Complete | Partial | Complete |
| Tian, Yang25 | Partial | Complete | Absent | Complete |
| Turner, Yiu38 | Complete | Complete | Absent | Complete |
| Turner, Cobb37 | Complete | Complete | Partial | Partial |
| Turner, Wakefield22 | Complete | Partial | Complete | Absent |
| Vansteelandt, Houben45 | Complete | Partial | Partial | Partial |
| Victor, Scott43 | Complete | Complete | Partial | Partial |
| Woosley, Lichstein68 | Partial | Partial | Partial | Complete |
| Wright, Hallquist58 | Partial | Complete | Absent | Partial |
| Zaki, Coifman65 | Complete | Complete | Absent | Absent |
| Rizk, Choo52 | Complete | Complete | Absent | Partial |
| Selby, Kranzler30 | Complete | Partial | Complete | Complete |
| Vine, Victor53 | Complete | Partial | Absent | Complete |
| Did not/partially meet criteria, studies (%) | 16 (33%) | 15 (31%) | 30 (61%) | 20 (41%) |
a: explain rationale for the sampling design (e.g., random, event-based), explain rationale for sampling density (e.g., assessments per day) and scheduling (i.e., when the assessments are scheduled), and justify sample size; b: report full text of items, rating time frames (e.g., justify why sampling only certain hours of the day or night is appropriate), and report psychometric properties of items in the current EMA study (between- and within-subject), as well as the origin of the items; c: define valid and missing data (for participants broadly, and specific to individual EMA reports) report descriptive analyses regarding valid data (e.g., mean per person, range, % participants above and below 80% threshold), and describe the procedures used to enhance compliance and participation (e.g., remuneration schedule, participant training); d: Describe levels of analysis (momentary, day, person) explain how time is taken into account in analyses; specify and justify choices of random versus fixed effects in models; describe analytic modeling used as well as statistical software used. Describe the final data set: number of reports (total; person average; group average), days in study and retention rates, and rates of delayed or suspended responding (if applicable).