Weakly Supervised Continuous Micro-Expression Intensity Estimation Using Temporal Deep Neural Network

Micro-facial expressions are brief and involuntary facial movements that reflect genuine emotional states. While most prior work focuses on classifying discrete micro-expression categories, far fewer studies address the continuous evolution of intensity over time. Progress in this direction is limited by the lack of frame-level intensity labels, which makes fully supervised regression impractical. We propose a unified framework for continuous micro-expression intensity estimation using only weak temporal labels (onset, apex, offset). A simple triangular prior converts sparse temporal landmarks into dense pseudo-intensity trajectories, and a lightweight temporal regression model that combines a ResNet18 encoder with a bidirectional GRU predicts frame-wise intensity directly from image sequences. The method requires no frame-level annotation effort and is applied consistently across datasets through a single preprocessing and temporal alignment pipeline. Experiments on SAMM and CASME II show strong temporal agreement with the pseudo-intensity trajectories. On SAMM, the model reaches a Spearman correlation of 0.9014 and a Kendall correlation of 0.7999, outperforming a frame-wise baseline. On CASME II, it achieves up to 0.9116 and 0.8168, respectively, when trained without the apex-ranking term. Ablation studies confirm that temporal modeling and structured pseudo labels are central to capturing the rise-apex-fall dynamics of micro-facial movements. To our knowledge, this is the first unified approach for continuous micro-expression intensity estimation using only sparse temporal annotations.

Paper

References (15)

05“Dual-stream micro-expression recognition using attention mechanisms,”2021 · IEEE Transactions on Affective Computing
06“Deep multi-task learning for au intensity regression,”2021 · Pattern Recognition
07“Micro-expression recognition based on 3d flow convolution,”2019 · Pattern Recognition Letters
08“Dual temporal scale convolutional network for micro-expression recognition,”2019 · IEEE Transactions on Image Processing
10“Iterative reorganization with weak supervision for object detection,”2018 · Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
12“Spontaneous micro-expression recognition: A challenge for facial expression analysis,”2011 · Proceedings of the IEEE International Conference on Computer Vision

Scroll for more · 3 remaining

Similar papers

© 2026 NYSGPT2525 LLC