Documents
Presentation Slides
MICRO-EXPRESSION RECOGNITION BASED ON VIDEO MOTION MAGNIFICATION AND PRE-TRAINED NEURAL NETWORK
- Citation Author(s):
- Submitted by:
- Mengjiong Bai
- Last updated:
- 15 September 2021 - 7:19am
- Document Type:
- Presentation Slides
- Document Year:
- 2021
- Event:
- Presenters:
- Mengjiong Bai
- Paper Code:
- 3078
- Categories:
- Log in to post comments
This paper investigates the effects of using video motion magnification methods based on amplitude and phase, respectively, to amplify small facial movements. We hypothesise that this approach will assist in the micro-expression recognition task. To this end, we apply the pre-trained VGGFace2 model with its excellent facial feature capturing ability to transfer learn the magnified micro-expression movement, then encode the spatial information and decode the spatial and temporal information by Bi-LSTM model. Moreover, Grad-CAM is utilised to map the model and visually explain the operating mechanism of the spatio-temporal network. Experiments on the SMIC database confirm that the proposed framework significantly improves the micro-expression recognition rate compared to without video magnification (baseline) and other state-of-the-art methods.