Table 2.
Model comparison with MPJPE metric of each landmark with top-down and bottom-up methods on the OpenMonkeyChallenge test set
Method | Eye | Nose | Head | Neck | Shoulder | Elbow | Wrist | Hip | Knee | Ankle | Tail | Mean |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Top-down | ||||||||||||
DeepLabCut | 0.042 | 0.044 | 0.056 | 0.066 | 0.079 | 0.090 | 0.115 | 0.107 | 0.096 | 0.117 | 0.158 | 0.089 |
CPM | 0.022 | 0.024 | 0.048 | 0.060 | 0.077 | 0.093 | 0.112 | 0.081 | 0.075 | 0.087 | 0.118 | 0.074 |
Hourglass | 0.018 | 0.019 | 0.040 | 0.064 | 0.084 | 0.093 | 0.089 | 0.082 | 0.070 | 0.081 | 0.108 | 0.069 |
HRNet-W48 | 0.016 | 0.018 | 0.042 | 0.055 | 0.076 | 0.082 | 0.082 | 0.076 | 0.065 | 0.077 | 0.096 | 0.064 |
HRNet-W32 | 0.017 | 0.020 | 0.042 | 0.059 | 0.078 | 0.086 | 0.089 | 0.082 | 0.066 | 0.080 | 0.102 | 0.067 |
SimpleBaseline (ResNet152) | 0.017 | 0.020 | 0.043 | 0.054 | 0.078 | 0.083 | 0.085 | 0.077 | 0.067 | 0.079 | 0.099 | 0.065 |
SimpleBaseline (ResNet101) | 0.021 | 0.025 | 0.031 | 0.094 | 0.094 | 0.111 | 0.117 | 0.102 | 0.079 | 0.094 | 0.136 | 0.083 |
Bottom-up | ||||||||||||
HigherHRNet-W32 | 0.035 | 0.040 | 0.022 | 0.119 | 0.128 | 0.162 | 0.108 | 0.151 | 0.069 | 0.110 | 0.183 | 0.102 |
HigherHRNet-W48 | 0.023 | 0.034 | 0.034 | 0.109 | 0.122 | 0.126 | 0.098 | 0.124 | 0.086 | 0.100 | 0.161 | 0.092 |
The values represented in bold signify the performance of the best model for a given metric/landmark