Table 4.
Summary of adherence metrics (N=24)a.
| Adherence metrics | Values, n (%) | Each reported metric (%), mean (SD) | ||||||
| Trial collected information about app engagement | 23 (96) | N/Ab | ||||||
| Trial collected information about adherence to recommendations (n=8 articles for apps that gave recommendations) | 8 (100) | N/A | ||||||
| Adherence information collected outside of the marketed app (n=23 articles for apps that collected adherence information) | 2 (9) | N/A | ||||||
| Adherence notification sent outside of app (n=3 articles reported sending adherence notifications) | 2 (67) | N/A | ||||||
| Engagement metrics (metric is not measuring prescribed use) | ||||||||
|
|
Initiation | 2 (8) | N/A | |||||
|
|
|
Initial app use, core completion, or activity use [30,33] | 2 (8) | 52 (35) | ||||
|
|
Implementation | 2 (8) | N/A | |||||
|
|
|
Completed sessions, modules, or activities [29,30] | 2 (8) | 20 (22) | ||||
|
|
|
Log-in days [29] | 1 (4) | 23c | ||||
|
|
Persistence | 7 (29) | N/A | |||||
|
|
|
Percentage of participants continuing use at 1 y [31,32,40,41,43,44] | 6 (25) | 52 (12) | ||||
|
|
|
Number of days participants used the app [30] | 1 (4) | 153c | ||||
| Adherence metrics (metric is measuring prescribed use) | ||||||||
|
|
Initiation | 15 (63) | N/A | |||||
|
|
|
Provided at least 20 d of data [40-44] | 5 (21) | 100 (0) | ||||
|
|
|
Initial app use, core completion, or activity use [35,36,38,47-50] | 7 (29) | 98 (4) | ||||
|
|
|
Entered at least 2 period start dates [31,32] | 2 (8) | 100 (0) | ||||
|
|
|
Initiation of video in response to app alert [27] | 1 (4) | 44c | ||||
|
|
Implementation | 16 (67) | N/A | |||||
|
|
|
Completed sessions, modules, or activities [34-36,45,49] | 5 (21) | 88 (16) | ||||
|
|
|
Completed at least 4 sessions and 1 call [37-39] | 3 (13) | 64 (5) | ||||
|
|
|
Completed half of the modules [47,48] | 2 (8) | 76 (13) | ||||
|
|
|
Completed ≥8 core modules [47,48] | 2 (8) | 87 (9) | ||||
|
|
|
Percentage of logged intercourse on red days [43,44] | 2 (8) | 23 (0) | ||||
|
|
|
Percentage of total days intercourse logged on red days (ie, days where the user did not follow app recommendations) [42] | 1 (4) | 2c | ||||
|
|
|
Percentage of perfect use cycles (ie, menstruation cycles where the user followed all trial recommendations) [32,41] | 2 (8) | 17 (10) | ||||
|
|
|
Log-in days [40,43,44] | 3 (13) | 47 (19) | ||||
|
|
Persistence | 4 (17) | N/A | |||||
|
|
|
Participants using the app at week 12 [47,48] | 2 (8) | 4 (17) | ||||
|
|
|
Completed all core modules [38,47,48,50] | 2 (8) | 49 (19) | ||||
|
|
Study reported all prescribed facets of adherence (n=20 studies that prescribed a recommended use of the app) | 9 (45) | N/A | |||||
aThe left-hand columns report what percentage of articles reported adherence or engagement information and what metrics were used by each article. The right-hand columns report the mean and SD for all the articles that reported that metric.
bN/A: not applicable for summary of facets of adherence.
cSD values are not applicable as only 1 article was included.