Skip to main content
. 2015 Jul 23;15(8):17827–17894. doi: 10.3390/s150817827

Table 4.

Reported characteristics of the evaluation tests of the proposals in the literature (NC = not commented in the work).

Ref. Real Life/Emulated Movements Number of Individuals Under test Characteristics of the Individuals (Age, Weight, etc.) Tested Positions of the Android Device No. of Iterated Falls Type of Tested or Emulated Falls Type of Emulated ADLs Performance Metrics Evaluation of Battery or Computing Consumption Coexistence Analysis Used Smartphone Model(s) Version of Android
[53] Not evaluated - - - - - - - - - HTC G1 -
[55] Emulated 6 5 males, 1 female
20–52 years
Waist 144[123] Falls ending with lying and sit-tilted Walk, stand, run, jump, sit Sensitivity, Specificity Not included No HTC Wildfire S A510e Android version 2.3.3.
[61] NC NC NC NC NC NC NC NC Not included No NC Android 2x
[69] Emulated 5 20–30 years
158–169 cm
60–80 kg
User’s pocket NC Abnormal gaits: simulated peg leg, simulated leg length discrepancy Walk Accuracy (to distinguish mobility patterns)
Specificity
Sensitivity
Consumption No iPhone -
[72] Not evaluated - - - - - - - - - - -
[73] Not evaluated - - - - - - - - - NC NC
[76] Emulated 3 24–26 years
164–175 cm
60–66 kg
Waist belt: 67 Forwards (from two positions) backwards, lateral, falling out the bed, slide against a wall NC Sensitivity,
Specificity
Not included No HTC Desire, No
[6] Emulated 1 Height (164 cm) NC 100 NC Lying FP, FN, TP, TN Not included No Pantech IM-A690S 2.3.3 (GingerBread)
[82] Emulated 5 NC Pocket 100 NC Walk, sit, jump, lie Precision, Recall Not included No Nexus One Android 2.0
[94] Emulated in a realistic scenario (retirement home) NC NC Chest NC NC Walk, run, sit Accuracy, Sensitivity,
F-score
Not included No NC NC
[95] Not evaluated - - - - - - - - - NC NC
[99] Emulated 10 Young, male
26.2 ± 3 years
177 ± 5 cm
78.5 ± 5.3 kg
Pocket at the thigh position 600 (including ADL) Some mentioned but not systematically tested Some mentioned but not systematically tested Sensitivity, Specificity Not included No HTC Desire HD NC
[101] Emulated 3 NC Waist (trouser pocket) 120 Forwards, backwards, sideway. Walk, run, stairs walk, sit. Sensitivity, Specificity Consumption No Samsung Galaxy S
Sony Xperia Ray
NC
[103] Emulatedand Real life 15 (emulated)

9 (for 10 days)
8males/7females
Aged 22–50
Waist (belt, placed on the back) 221 Left and right lateral, forwardtrips, and backward slips NC Sensitivity (in the detection of fall type) Not included No Tmobile
G1
Android OS 1.6
[105] Emulated 10 3 Males, 7 females
20–42 years
161–184 cm
54–98 kg
Left and right pocket 48 per subject Forwards, left and right-lateral backwards, syncope, sit on empty chair, falls with strategies to prevent the impact and falls with contact to an obstacle Participants carried a smartphone in their pocket or hand bags for at least one week Sensitivity, Specificity (and their geometric mean) Not included No Samsung Galaxy Mini 2.2
[110] [111] Emulated with both mannequins and real individuals 15 13 males, 2 females
20–30 years
161–190 cm
51–80 kg
Chest, waist, thigh 600 (with a mannequin)600 (humans) Forwards, backwards, lateral Walk, jogging, stand, sit Sensitivity, Specificity Consumption CPU usage No HTC G1 Android 1.6
[112] Not evaluated - - - - - - - - - - -
[113] Real life patients but fall detection not evaluated Only commented race and mean age NC NC NC NC - - - Motorola Droid Smartphone NC
[114] Emulated 18 12 males, 6 females29 ± 8.7 years Waist 216
(3 per individual and type of fall)
Forwards,
backwards, lateral left and lateral right
Sit-to-stand, stand-to-sit, level walk, stairs walk
answer the phone, pick up an object and get up from supine
Sensitivity, Specificity Not included No Google G1 NC
[115] - - - - - - - - - - NC NC
[116] Emulated 10 26.2 ± 3.04 years, 177.6 ± 5.2 cm, 78.3 ± 5.3 kg Thigh (trouser pocket) 600 (including ADLs) NC NC Sensitivity, Specificity Not included No HTC G1-Desire &HD, Samsung i7500, Google Nexus One NC
[118]
[117]
Emulated 5 22–30 years
160–175 cm
Hand, chest and pants pocket 45 Forwards, backwards, and aside Sit, stand, walk, run, stair walk TP, TN, FP, FN,
Sensitivity, Specificity
Not included No Nexus One NC
[119] Emulated 3 Not commented NC 5 per person (p.p.) Forwards, backwards, and lateral falls Walk, sit, squat, stair walk Sensitivity and specificity Not included No NC NC
[120] Emulated NC NC NC 2 sets of 10 and 12 falls Fall on the floor, different types of fall on an armchair Jogging, normal walk, stairs walk, stand-sit-stand, fast walk Analysis focused on detecting the movement type Not included No NC NC
[121] Emulated 1 1 male, 33 years Pocket of the shirt NC NC Lying NC Not included No Samsung
Galaxy SIII
Android
version 4.0.4.
[122] Database and emulated 7 20–60 years
165–177 cm
56–95 kg
Waist 44 (42 ADLs) NC Sit, lie, jump, run, walk, hit the sensor Accuracy, Specificity Not included No HTC Google Nexus One NC
[123] Emulated 4 NC On a wall 50 NC Walk, shake/ raise/move hands, sit, stand up, empty room Precision, FP rate Lined-powerNC Specific device BeagleBoard-XM Android version 2.2.
[124] Emulated 4 NC Chest (pocket) waist, and thigh. 30 per individual NC Walk, sit, stand up and others (not commented) Sensitivity, Specificity Not included No HTC Desire and Tattoo Android 1.6
[125] Emulated 20 12 males, 8 females
BMI in [20, 30.12]
20–50 years
Chest (shirt pocket) 400 falls and 800 ADLs NC Walk, sit down, jumping FP, FN, Sensitivity, Specificity Not included No HTC A3366 Android 2.2
[126]
[127]
Not evaluated - - - - - - - - - Lenovo Le-Phone NC
[128] Emulated 4 3 males, 1 female
20–26
Right thigh pocket, held in hand. 100 Fall on hands, knees, the back, the left and right side of the body Answer the phone, put the phone into the thigh pocket, sit, drop the phone from hand, walk Precision, Recall Not included No Google Nexus S Android 2.2
[129] Emulated 5 Several males
Average age: 25.5
173 ± 5.3 cm
Waist 40 per subject Forwards, backwards, left, and right Walk, jogging, sit down, stand up, stairs walk Sensitivity Not included No Samsung SHW-M110S, Android 2.3.3
[130] Not evaluated(Evaluation limited to set the thresholds) No - - - Dropping the accelerometer from different heights - - Not included No NC NC
[131] Not evaluated - - - - - - - - - NC NC
[132] Emulated NC 155–170 cm50–75 kg Chest/pants pocket, hands (while talking or tapping the phone) 224 Forwards, backwards, aside bed fall (from 5 different initial positions) Jogging, sit, stand, jump Sensitivity, Specificity, TP, TN, FP, FN Not included No Pantech Sky VegaRace Gingerbread 2.3.3
[133] No evaluated - - - - - - SP Battery Lifetime Consumption No
[134] Emulated 10 25–35 years Indifferent (acceleration sensor on the chest) NC Forwards, backwards and lateral directions NC Ratio between TP and total number of activities
Response time
Battery lifetime, Required Memory No HTC 2.3
[136] Emulated NC NC NC 33 NC NC TP Not included No NC NC
[137] Emulated NC NC NC NC NC NC NC Not included No Samsung Galaxy S III NC
[138] Emulated 1 NC NC NC NC Sit up, get out of bed NC Not included No NC NC
[139] Emulated 3 NC NC 114 NC No ADL tested Sensitivity Not included No NC 4.2 Jelly Bean
[140] Real life (ice-skaters) 7 NC Waist 50 NC (210 min of ice-skating) Ice-skating Movements Sensitivity, Specificity, Accuracy Not included No NC NC
[141] Emulated in a treadmill 6 20–22 years
3 males: 171.5 cm,
66.2 kg, 3 females:
161.4 cm, 49.6 kg
Wristwatch 240 Front, back, left, and right falls Series of 50 s moving and static Sensitivity Not included No WIMM Android watch NC
[142] Emulated 1 159 cm Chest (left pocket) NC Backwards Sit down quickly on a chair, lie on bed Sensitivity
Specificity
Average time to complete the detection
Not included No HTC One S NC
[143] Real life (prototype aimed to be tested with actual patients) NC NC NC NC NC NC NC Not included No Samsung Galaxy Mini S5570 2.3.4 or higher
[144] Emulated And real life Emulated:
3 (training phase)
10 (test phase)

Real life:
11
Test phase:
Averages:24 years old,
173 cm
73 kg, Real life:
3 males, 4 females
Waist Training:
5 falls , 7 ADLs
Real life:
No falls
“Simplex” and “complex” into a chair, or falls with grasping the wall Walk , run, stairs walk, sit down,squat, rise Emulated:
Sensitivity,
Specificity,
Real-life:

Only FP
Not included No HTC G3
Smartphone
2.1
[145] Not evaluated - - - - - - - - - NC NC
[146] Emulated 30 (for test)12 (for training) 24.3 ± 2.04 years, 169 ± 4 cm,
63.17 ± 7.37 kg
Chest NC Unexpected slips and trip falls, Seated, sit to stand, squat, squat to stand, get on bed, get up from bed, stairs walk, jogging Sensitivity, Specificity, Lead time Not included No Samsung Galaxy S2i9100 2.3.3
[147] Emulated 20 24–37 Waist 800 (40 per subject) Pushed down, slip, forwards, backwards, aside, from the chair lie down, get up from the bed, sit on chair, get up from the chair, walk, run, stairs walk Sensitivity,Specificity Not included No NC NC
[148] Emulated 10 6 males, 25 ± 5 years, BMI: 23.2 ± 2.7 kg/m2, 4 females: 23 ± 3 years, BMI: 21.5 ± 2.2 kg/m2 Chest (in a band) 200 falls and ADLs Forwards, right-side, backwards, left-side Sit, lie, stand, Lie-to-sit, sit-to-stand, stand-to-sit, walk, stairs walk
run, jump
Confusion matrix of the pattern recognition Not included No Samsung I9023 Nexus S 2.3.6
[149] Emulated 3 NC NC 50 NC Walk, run, sit, jump FP, FN. TP, TN of the different mobility patterns Not included No NC NC
[150] Emulated 8 NC Pocket 127 Forwards, backwards, side fall, hard falls, soft falls Stand, walk,
run, stairs walk, travel in a car,
brake in a car, drop the phone
Recall, Precision Not included No NC NC
[151] Not evaluated - - - - - - - - - NC NC
[152] Not evaluated - - - - - - - - - NC NC
[153]
[154]
Emulated 12 Males and females
20–56 years
155–183 cm
44–72 kg
Pocket (assumed) 20 (52 ADLs) Forwards, backwards, vertical and sideway Walk, jogging, jump, sit down, squat down TP, TN, FP, FN Not included No NC Android 2. 3
[155] Emulated 8 Male.
23 ± 3.45 years
60 ± 7.68 kg
Waist 6 per subject Lateral, back-forward fall Sit down, stand up, walk and turn around, lie down and get up Sensitivity, Specificity Not included No NC NC
[156] Emulated 5 for the training phase and 5 for the tests NC Pocket 50 Not specified Run, walk,sit down, stairs walk, tread, jump and wave the SP Sensitivity,Specificity Battery consumption - Sony Xperia U-series 2.3.7
[157] Emulated 28 for the training phase and 8 for the tests Training: 24 males, 4 females, 22–28 years, 166–184 cm,
59–83 kg.
Tests: 4 males, 8 females, 63–69 years, 151–171 cm, 62–82 kg.
Pocket in a vertical positionand/or hold to the belt (centrally or laterally). 1879 10 types:
backwards, forwards and lateral with diverse different ending position
1671 ADLs
4 types of recoveries from a fall, walk, lying, sitting, bending down, coughing and sneezing,
Sensitivity, Specificity, Accuracy Percentage of battery drain per hour - Samsung GalaxyNexus NC
[158] Not evaluated - - - - - - - - - NC NC
[159] Not evaluated - - - - - - - Time to reduce the battery level from 100% to 80% - HTC one X, Samsung Galaxy Tab 10.1. NC
[160] Not specified NC NC NC NC NC NC Number of false alarms and delay NC No NC NC
[161] Emulated 10 for an offline evaluation, 4 to evaluate the system during several days of real operation 7 males, 3 women
20–42 years old
54–98 kg,
161–184 cm
NC 8000 ADL and 500 falls Forwards, backwards, left and right lateralfalls, syncope, sit on empty chair, falls with an obstacle
and falls with compensation strategies
NC AUC (Area under the ROC curve)
False positive per days
NC No SamsungGalaxy S II/S IV and Mini, HTC Wild Fire NC
[162] Emulated 1 Male in his 20 s Loose front pant pocket, tight front pant pocket 20 (for training) 20 (for testing) Fall while standing, while walking and from the chair Walk, run Accuracy, Precision, Negative Predictive Value NC No Samsung Galaxy S4 GT-I9505

HTC One
NC
[163] Emulated 1 1 young and healthy person Attached to the chest 240 NC Lay down Sensitivity, Specificity, NC No Samsung Galaxy S3 I9300 NC
[164] Emulated 15 6 Male, 9 Females
15–68 years
150–190 cm
Average 70 kg
Waist, pants pocket 375 Forwards, lateral and backwards Jogging, walk, stand up, sit, answer the phone Percentages of false positives and false negatives, ROC curve Consumption (after 6 hours operating) No HTC Desire X, HTC sensation XE Android 2.3.4
[165] Emulated NC NC Waist (external sensor in ankle) 111 (including ADLs) NC Sit, walk, stairs walk TP, TN, FP, FN Sensitivity, Specificity, Accuracy Just the consumption in external sensor assessed No NC NC
[167] Emulated 4 (tests)50 (training phase) 1 Male, 3 Females
28–40 years
160–164 cm
58–69 kg
Belt, shirt pocket, pants pocket 45 (tests)
1000 (falls and ADLs during training)
Training phase:
Forwards, backwards (4 types), side left (4 types), arbitrary.
Training phase:
Run, walk, jump, sit down (4 types), lie down, stand up
Sensitivity, Specificity, Accuracy Consumption No HTC Incredible S, Samsung Galaxy NC
[168] Emulated NC NC Front right area of the body 40 Forwards, backwards, left, and right Stand up, sit, walk, stairs walk, jump, run Sensitivity, Specificity Not included No LG Optimus L9 P768 Android 4.0.4
[169] Just evaluated to set the thresholds - - - - - - - - - NC NC
[170] Just evaluated to set the thresholds - - - - - - - - - Samsung Galaxy Nexus Android 4.0
[171] Emulated NC NC Pocket 100 Fall when running, walking, jumping, standing Sit, walk, stairs walk Sensitivity, Specificity, Accuracy Not included No Not specified Android 4.2.1
[172] Real 54 Elderly participants Waist 6 actual falls - ADLs from users monitored during several months Sensitivity, Specificity, false positive rate Not included No Samsung i555 Android 2.2