Recent skeleton-based action recognition approaches have achieved significant improvement by using convolutional neural networks. These methods usually map skeleton sequences into images, and an end-to-end CNN is adopted for label prediction. In this paper, a novel image mapping method is proposed, named pose change map (PCM), which provides a visual indication of how the similarity between human pose and atoms of pose dictionary changes over time. Then, PCM as well as raw skeleton coordinates are fed into CNN to extract robust and discriminative features for action recognition. Experiments on two challenging datasets NTU RGB+D and UTKinect-Action consistently demonstrate the superiority of our method.
Paper
Full text
Skeleton based action recognition using pose change map and convolutional neural networks
Semantic Scholar · Computer Science · 2019
Abstract
Recent skeleton-based action recognition approaches have achieved significant improvement by using convolutional neural networks. These methods usually map skeleton sequences into images, and an end-to-end CNN is adopted for label prediction. In this paper, a novel image mapping method is proposed, named pose change map (PCM), which provides a visual indication of how the similarity between human pose and atoms of pose dictionary changes over time. Then, PCM as well as raw skeleton coordinates are fed into CNN to extract robust and discriminative features for action recognition. Experiments on two challenging datasets NTU RGB+D and UTKinect-Action consistently demonstrate the superiority of our method.