Masked Face Dataset Generation and Masked Face Recognition

In the post-pandemic era, wearing face masks has posed great challenge to the ordinary face recognition. In the previous study, researchers has applied pretrained VGG16, and ResNet50 to extract features on the elaborate curated existing masked face recognition (MFR) datasets, RMFRD and SMFRD. To make the model more adaptable to the real world situation where the sample size is smaller and the camera environment has greater changes, we created a more challenging masked face dataset ourselves, by selecting 50 identities with 1702 images from Labelled Faces in the Wild (LFW) Dataset, and simulated face masks through key point detection. The another part of our study is to solve the masked face recognition problem, and we chose models by referring to the former state of the art results, instead of directly using pretrained models, we fine tuned the model on our new dataset and use the last linear layer to do the classification directly. Furthermore, we proposed using data augmentation strategy to further increase the test accuracy, and fine tuned a new networks beyond the former study, one of the most SOTA networks, Inception ResNet v1. The best test accuracy on 50 identity MFR has achieved 95%.

Paper

References (12)

06VGG16 was proposed in 2014 by researchers in Oxford[4], and it’s a very elegant and deep CNN and has very good performance on ImageNet benchmarkThere are
07Freeze the weights except the last fc layer and train on the last layer first. Set the maximum trianing epoch to be 2, let the weights of the last layer converges to a decent level
08Unfreeze all the layers and train for maximum 50 epochs
09We used data augmentation strategy which hasn’t been used in the previous study to achieve a higher test accuracy
10We fine-tuned three different model on our dataset to generate better results and do the comparison with traditional face-recognition methods like Eigenface
11We download the pre-trained models and their corresponding weights through torchvision package or facenet-pytorch packages
12Reload the saved bets models and test on the test set. The prediction of the test image corresponds to the unit in the last output layer which has the largest value

Similar papers

© 2026 NYSGPT2525 LLC