Table 4.
Identification effectiveness on classifier evaluation of deep learning models using various combinations of sensor data from UT-Smoke dataset.
| Sensor | Activity | Recognition Achievement of DL Models Using Sensors Data from UT-Smoke Dataset | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CNN | LSTM | 1D-ResNet-SE | ||||||||
| Accuracy ± SD | F1 ± SD | EER | Accuracy ± SD | F1 ± SD | EER | Accuracy ± SD | F1 ± SD | EER | ||
| Acc. | Smoking | 69.42 (±0.530) | 69.35 (±0.545) | 32.41(±1.17) | 65.47 (±3.885) | 65.00 (±4.409) | 31.26 (±1.12) | 89.06 (±0.560) | 89.04 (±0.577) | 13.49 (±0.87) |
| Eating | 80.85 (±0.523) | 80.64 (±0.602) | 21.22 (±0.70) | 79.92 (±2.653) | 79.81 (±3.136) | 18.35 (±1.26) | 88.33 (±5.448) | 88.20 (±5.608) | 14.60 (±1.29) | |
| Drinking | 66.41 (±1.574) | 65.86 (±1.746) | 33.20 (±1.35) | 66.20 (±2.704) | 65.75 (±3.436) | 43.19 (±1.25) | 84.81 (±1.052) | 84.77 (±1.090) | 15.14 (±1.08) | |
| Inactive | 14.61 (±0.560) | 5.54 (±1.068) | 91.19 (±0.32) | 14.82 (±0.109) | 6.77 (±0.564) | 90.66 (±0.41) | 14.54 (±0.273) | 8.01 (±1.120) | 90.44 (±0.56) | |
| Avg. (all) | 57.82 | 55.35 | 44.51 | 56.60 | 54.33 | 45.87 | 69.19 | 67.53 | 33.42 | |
| Avg. (active) | 72.23 | 71.95 | 28.94 | 70.53 | 70.19 | 30.93 | 87.40 | 87.34 | 14.41 | |
| Gyro. | Smoking | 51.28 (±0.380) | 51.07 (±0.418) | 50.53 (±0.69) | 45.81 (±0.649) | 45.19 (±1.065) | 56.99 (±1.86) | 68.64 (±5.345) | 68.63 (±4.833) | 33.74 (±7.32) |
| Eating | 67.03 (±0.394) | 66.36 (±0.431) | 35.29 (±1.27) | 61.62 (±1.548) | 59.92 (±1.717) | 44.20 (±2.25) | 80.42 (±4.736) | 80.77 (±4.417) | 21.07 (±7.20) | |
| Drinking | 43.00 (±0.657) | 42.67 (±0.515) | 57.71 (±0.54) | 37.09 (±3.286) | 34.79 (±3.426) | 65.06 (±2.30) | 46.40 (±5.949) | 45.72 (±6.773) | 54.97 (±3.14) | |
| Inactive | 11.49 (±0.650) | 7.03 (±0.904) | 92.97 (±0.42) | 15.08 (±0.168) | 4.40 (±0.250) | 91.14 (±0.05) | 13.11 (±0.705) | 7.21 (±0.479) | 90.80 (±0.35) | |
| Avg. (all) | 43.20 | 41.78 | 59.13 | 39.90 | 36.08 | 64.35 | 52.14 | 50.58 | 50.15 | |
| Avg. (active) | 53.77 | 53.37 | 47.84 | 48.17 | 46.63 | 55.42 | 65.15 | 65.04 | 36.59 | |
| Mag. | Smoking | 54.77 (±3.998) | 53.79 (±4.619) | 48.86 (±2.92) | 57.85 (±2.779) | 56.77 (±3.134) | 40.62 (±1.43) | 78.06 (±10.695) | 78.18 (±10.496) | 21.49 (±8.35) |
| Eating | 76.10 (±3.206) | 76.10 (±3.163) | 25.01 (±1.02) | 78.77 (±2.733) | 78.34 (±2.959) | 22.21 (±3.35) | 89.81 (±3.266) | 89.85 (±3.194) | 15.08 (±5.63) | |
| Drinking | 44.09 (±4.993) | 42.58 (±6.440) | 53.45 (±3.64) | 63.66 (±1.984) | 63.69 (±2.074) | 40.68 (±1.62) | 76.82 (±7.711) | 76.92 (±7.568) | 24.07 (±4.91) | |
| Inactive | 15.41 (±0.006) | 4.11 (±0.003) | 90.92 (±0.02) | 14.59 (±0.230) | 8.64 (±1.611) | 90.43 (±0.51) | 14.34 (±0.343) | 8.69 (±1.485) | 89.95 (±0.67) | |
| Avg. (all) | 47.59 | 44.15 | 54.56 | 53.72 | 51.86 | 48.49 | 64.76 | 63.41 | 37.65 | |
| Avg. (active) | 58.32 | 57.49 | 42.44 | 66.76 | 66.27 | 34.50 | 81.56 | 81.65 | 20.21 | |
| Acc.+ Gyro. | Smoking | 71.11 (±0.928) | 70.92 (±1.067) | 29.13 (±0.78) | 69.24 (±2.088) | 69.29 (±2.119) | 9.58 (±1.61) | 91.20 (±0.610) | 91.19 (±0.612) | 9.74 (±1.94) |
| Eating | 83.27 (±0.420) | 83.10 (±0.425) | 17.74 (±1.23) | 84.12 (±2.734) | 84.42 (±2.471) | 15.51 (±0.38) | 91.65 (±1.781) | 91.69 (±1.756) | 8.42 (±1.66) | |
| Drinking | 67.92 (±0.905) | 67.58 (±1.027) | 32.90 (±1.46) | 65.87 (±3.575) | 66.06 (±3.352) | 31.38 (±2.72) | 84.78 (±2.265) | 84.73 (±2.367) | 13.63 (±0.41) | |
| Inactive | 14.21 (±0.829) | 6.77 (±1.379) | 91.48 (±0.34) | 14.61 (±0.352) | 8.01 (±0.966) | 90.96 (±0.11) | 14.14 (±0.608) | 8.47 (±1.316) | 90.24 (±0.65) | |
| Avg. (all) | 59.13 | 57.09 | 42.81 | 58.46 | 56.95 | 36.86 | 70.44 | 69.02 | 30.51 | |
| Avg. (active) | 74.10 | 73.87 | 26.59 | 73.08 | 73.26 | 18.82 | 89.21 | 89.20 | 10.60 | |
| Acc.+Mag. | Smoking | 87.14 (±1.329) | 87.14 (±1.329) | 11.82 (±0.98) | 82.27 (±2.381) | 82.24 (±2.449) | 18.64 (±2.91) | 96.63 (±0.489) | 96.63 (±0.490) | 3.07 (±0.51) |
| Eating | 96.08 (±0.462) | 96.07 (±0.449) | 4.81 (±0.58) | 93.34 (±3.324) | 93.40 (±3.181) | 5.66 (±2.15) | 97.98 (±0.088) | 97.96 (±0.082) | 2.88 (±0.79) | |
| Drinking | 86.80 (±0.974) | 86.90 (±0.906) | 12.66 (±1.00) | 78.65 (±6.253) | 78.69 (±6.262) | 20.23 (±4.56) | 96.47 (±0.237) | 96.46 (±0.245) | 3.41 (±0.36) | |
| Inactive | 15.26 (±0.181) | 4.54 (±0.710) | 90.94 (±0.04) | 14.81 (±0.197) | 7.05 (±0.460) | 89.98 (±0.42) | 14.54 (±0.481) | 8.73 (±0.651) | 8.38 (± 1.82) | |
| Avg. (all) | 71.32 | 90.04 | 30.06 | 67.27 | 84.78 | 33.63 | 76.41 | 74.95 | 4.44 | |
| Avg. (active) | 90.01 | 54.93 | 9.76 | 84.75 | 64.97 | 14.84 | 97.03 | 97.02 | 3.12 | |
| Gyro.+Mag. | Smoking | 60.64 (±1.497) | 60.54 (±1.645) | 40.23 (±3.16) | 61.35 (±2.468) | 60.59 (±2.604) | 38.22 (±4.16) | 86.76 (±3.827) | 86.79 (±3.738) | 17.74 (±4.98) |
| Eating | 81.14 (±1.512) | 81.17 (±1.449) | 20.61 (±1.47) | 81.67 (±1.875) | 81.50 (±1.917) | 20.29 (±1.46) | 87.24 (±4.701) | 87.52 (±4.434) | 7.71 (±1.80) | |
| Drinking | 49.13 (±16.952) | 46.86 (±21.449) | 47.88 (±3.49) | 63.93 (±2.815) | 63.79 (±2.591) | 40.80 (±2.80) | 78.58 (±2.384) | 78.60 (±2.304) | 20.04 (±4.20) | |
| Inactive | 15.10 (±0.577) | 4.61 (±0.967) | 90.91 (±0.01) | 15.01 (±0.206) | 6.34 (±1.098) | 90.63 (±0.23) | 14.43 (±0.162) | 8.56 (±1.152) | 89.93 (±0.45) | |
| Avg. (all) | 51.50 | 48.30 | 49.91 | 68.98 | 53.06 | 47.49 | 66.75 | 65.37 | 33.86 | |
| Avg. (active) | 63.64 | 62.86 | 36.24 | 44.39 | 68.63 | 33.10 | 84.19 | 84.30 | 15.16 | |
| Acc.+Gyro.+Mag. | Smoking | 88.68 (±0.492) | 88.68 (±0.477) | 11.60 (±1.10) | 80.40 (±2.335) | 80.39 (±2.450) | 21.50 (±6.94) | 97.24 (±0.280) | 97.24 (±0.280) | 2.85 (±0.46) |
| Eating | 95.84 (±1.247) | 95.83 (±1.246) | 5.02 (±0.57) | 95.18 (±0.658) | 95.18 (±0.613) | 5.93 (±2.22) | 98.15 (±0.178) | 98.13 (±0.179) | 2.32 (±0.27) | |
| Drinking | 88.16 (±0.916) | 88.27 (±0.888) | 14.15 (±1.65) | 80.18 (±4.504) | 80.36 (±4.613) | 19.53 (±3.39) | 96.54 (±0.511) | 96.54 (±0.496) | 3.39 (±0.22) | |
| Inactive | 15.34 (±0.136) | 4.13 (±0.038) | 90.90 (±0.01) | 14.89 (±0.325) | 8.38 (±1.965) | 90.57 (±0.56) | 14.62 (±0.330) | 9.22 (±1.107) | 89.92 (±0.68) | |
| Avg. (all) | 72.01 | 69.23 | 30.42 | 67.66 | 66.08 | 34.38 | 76.64 | 75.28 | 24.62 | |
| Avg. (active) | 90.89 | 90.93 | 10.26 | 85.25 | 85.31 | 15.65 | 97.31 | 97.30 | 2.85 | |