Skip to main content
. Author manuscript; available in PMC: 2021 Nov 8.
Published in final edited form as: Proc ACM Int Conf Multimodal Interact. 2020 Oct;2020:156–164. doi: 10.1145/3395035.3425190

Figure 1:

Figure 1:

The graphical representation of our end-to-end pain estimation model. (a) The CNN model trained to learn frame-by-frame spatial features (4096D per frame) and (b) The 2-layer GRU model trained to learn per-video temporal dynamics of facial features. (c) The multivariate regression model to estimate pain intensity scores consistent with the VAS, SEN, AFF, and OPI independently and in combination [19].