. Author manuscript; available in PMC: 2021 Aug 25.

Published in final edited form as: J Meas Phys Behav. 2021 Apr 22;4(2):151–162. doi: 10.1123/jmpb.2020-0045

Table 4.

Participant-Level Summaries of Second-Level Agreement for Diary Versus CREA and Diary Versus ProcessingPAL for Classifying Out-of-Bed Wear Time (Study 2; N = 744 Participants)

	Mean (SD) across participants
Statistic	CREA	ProcessingPAL

Binary classification measures
Accuracy	0.95 (0.05)	0.93 (0.07)
Sensitivity	0.97 (0.06)	0.97 (0.08)
Specificity	0.91 (0.1)	0.86 (0.14)
F1 score	0.96 (0.05)	0.95 (0.07)
Kappa	.89 (.11)	.84 (.16)

	Number of participants (%)
	CREA	ProcessingPAL

Participant-level kappa category
Very large (.81–1.0)	641 (86%)	536 (72%)
Large (.61-.80)	82 (11%)	159 (21%)
Moderate (.41-.60)	14 (2%)	34 (5%)
Small (≤.40)	7 (1%)	15 (2%)

Note. Second-level agreement was calculated for each participant, and then summary statistics (mean, SD, and kappa) were computed across participants.