An overview of thermal face recognition methods
2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)
https://doi.org/10.23919/MIPRO.2018.8400200Abstract
The popularity of surveillance systems grows as well as a need for better security systems particularly in a bad lighting conditions or at night. The aim of a security system is to collect as many details as possible to enable a better recognition of persons. In this paper, a comparison of representative thermal face recognition methods will be given, emphasizing their strengths and weaknesses. Then, trends in the development of surveillance and security systems will be outlined such as fusion of visible and thermal images and use of convolutional neural networks. Also, existing challenges of thermal facial recognition and its applications in a real world will be pointed out.
FAQs
AI
What explains the success of SIFT descriptors in thermal face recognition?
The study shows that SIFT descriptors outperform other methods, achieving up to 96% recognition accuracy on SWIR images. This indicates their effectiveness in capturing thermal facial features, particularly in varying conditions.
How do thermal face biometrics handle illumination changes during recognition?
Thermal face biometrics demonstrate robustness to illumination changes, operating effectively in dark environments. Studies show that accuracy remains high even under various lighting conditions, unlike traditional visual methods.
What are the limitations of using thermal imaging for face recognition?
Limitations include sensitivity to glass, high noise levels, and decreased accuracy at greater distances. The recognition rate notably drops beyond 90 meters, highlighting distance as a critical factor.
When did significant advancements in thermal face recognition methods occur?
Recent developments have transpired over the last five years, emphasizing deep learning and CNN architectures. For instance, CNN methods have achieved accuracy rates exceeding 98% in structured experiments.
Why is the use of multi-modal approaches important in thermal face recognition?
Multi-modal approaches enhance recognition accuracy by integrating thermal and visible images, addressing individual weaknesses. This integration has led to improved identification rates, with reported success rates reaching 90%.
References (51)
- Le, Chien, and R. Jain. "A survey of biometrics security systems." EEUU. Washington University in St. Louis (2009).
- Gad, Ramadan, et al. "Multi-biometric systems: A state of the art survey and research directions." Int. J. Adv. Comput. Sci. Appl 6.6 (2015): 128-138.
- Gorodnichy, Dmitry O., Eric Granger, and Paolo Radtke. Survey of commercial technologies for face recognition in video. Canada Border Services Agency Ottawa ON Canada, 2014.
- Zheng Wu, Nathan Fuller, Diane Theriault, Margrit Betke, "A Thermal Infrared Video Benchmark for Visual Analysis", in Proceeding of 10th IEEE Workshop on Perception Beyond the Visible Spectrum (PBVS), Columbus, Ohio, USA, 2014.
- Ivašić-Kos, Marina; Iosifidis, Alexandros; Tefas, Anastasios; Pitas, Ioannis. Person De-Identification in Activity Videos, BiForD - Biometrics & forensics & de-identification and privacy protection, Opatija, Hrvatska, MIPRO, 2014. 75-80
- Chris Solomon and Toby Breckon; Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab; John Wiley & Sons, Ltd. 2011
- Bourlai, Thirimachos, and Bojan Cukic. "Multi-spectral face recognition: identification of people in difficult environments." Intelligence and Security Informatics (ISI), 2012 IEEE International Conference on. IEEE, 2012.
- Bhowmik, Mrinal Kanti, et al. "Thermal infrared face recognition- a biometric identification technique for a robust security system." Reviews, refinements and new ideas in face recognition. InTech, 2011.
- Seal, Ayan, et al. "Automated thermal face recognition based on minutiae extraction." International Journal of Computational Intelligence Studies 2.2 (2013): 133-156.
- Hermosilla, Gabriel, et al. "A comparative study of thermal face recognition methods in unconstrained environments." Pattern Recognition 45.7 (2012): 2445-2459.
- Ahonen, Timo, Abdenour Hadid, and Matti Pietikainen. "Face description with local binary patterns: Application to face recognition." IEEE transactions on pattern analysis and machine intelligence 28.12 (2006): 2037-2041.
- Chen, Jie, et al. "WLD: A robust local image descriptor." IEEE transactions on pattern analysis and machine intelligence 32.9 (2010): 1705-1720.
- Chao, Wei-lun. "Gabor wavelet transform and its application." R98942073 (TFA&WT final project) (2010).
- Lowe, David G. "Object recognition from local scale-invariant features." Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Vol. 2. IEEE, 1999.
- Bay, Herbert, Tinne Tuytelaars, and Luc Van Gool. "Surf: Speeded up robust features." European conference on computer vision. Springer, Berlin, Heidelberg, 2006.
- Ghiass, Reza Shoja, et al. "Infrared face recognition: a literature review." Neural Networks (IJCNN), The 2013 International Joint Conference on. IEEE, 2013.
- K. H. Abas and O. Ono, "Thermal physiological moment invariants for face identification." In Proc. Int. Conf. on Signal-Image Technology & Internet-Based Systems, 2010.
- W. Hizem, L. Allano, A. Mellakh, and B. Dorizzi, "Face recognition from synchronised visible and near-infrared images." IET Signal Processing, 2009.
- H.-W. Tzeng, H.-C. Lee, and M.-Y. Chen, "The design of isotherm face recognition technique based on nostril localization." In Proc. Int. Conf. on Sys. Sci. & Eng., 2011.
- M. A. Akhloufi and A. Bendada, "Thermal faceprint: A new thermal face signature extraction for infrared face recognition." Canad. Conf. on Comp. & Robot Vis., 2008.
- K.-A. Toh, "A projection framework for biometric scores fusion." ICARCV, 2010.], and others M. Shao and Y.-H. Wang, "A BEMD based muti-layer face matching: From near infrared to visual images." In Proc. IEEE Int. W'shop on Anal. & Model. of Faces & Gest., 2009
- F. M. Pop, M. Gordan, C. Florea, and A. Vlaicu, "Fusion based approach for thermal and visible face recognition under pose and expresivity variation." RoEduNet, 2010.
- Kakkirala, Krishna Rao, Srinivasa Rao Chalamala, and Santosh Kumar Jami. "Thermal Infrared Face Recognition: A review., 2017
- Akhloufi, Moulay A., and Abdelhakim Bendada. "Infrared face recognition using texture descriptors." Proc. SPIE. Vol. 7661. 2010.
- Selinger, Andrea, and Diego A. Socolinsky. Appearance-based facial recognition using visible and thermal imagery: a comparative study. EQUINOX CORP NEW YORK NY, 2006.
- Méndez, Heydi, et al. "Face recognition with LWIR imagery using local binary patterns." International Conference on Biometrics. Springer, Berlin, Heidelberg, 2009.
- Akhloufi, Moulay A., and Abdelhakim Bendada. "Probabilistic Bayesian framework for infrared face recognition." proc. International Conference on Machine Vision, Image Processing, and Pattern Analysis. 2009.
- Cutler, Ross Garrett. Face recognition using infrared images and eigenfaces. University of Maryland, 1996.
- Xie, Zhihua, and Guodong Liu. "Blood perfusion construction for infrared face recognition based on bio-heat transfer." Bio-medical materials and engineering 24.6 (2014): 2733-2742.
- Valvano, Jonathan W. "Bioheat transfer." Encyclopedia of Medical Devices and Instrumentation (2006).
- Wu, S. Q., et al. "RIFARS: a real-time infrared face recognition system." Proceedings of Asian Biometrics Workshop. Singapore, 2003.
- Seal, Ayan, et al. "Thermal Human face recognition based on Haar wavelet transform and series matching technique." Multimedia Processing, Communication and Computing Applications. Springer, New Delhi, 2013. 155-167.
- Roland Miezianko, Terravic Research Infrared Database, http://vcipl-okstate.org/pbvs/bench/
- Bebis, George, et al. "Face recognition by fusing thermal infrared and visible imagery." Image and Vision Computing 24.7 (2006): 727-742.
- Socolinsky, Diego A., et al. "Illumination invariant face recognition using thermal infrared imagery." Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. Vol. 1. IEEE, 2001.
- Sim, Terence, et al. "Memory-based face recognition for visitor identification." Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on. IEEE, 2000.
- Jafri, Rabia, and Hamid R. Arabnia. "A survey of face recognition techniques." Jips 5.2 (2009): 41-68.
- Arandjelović, Ognjen, Riad Hammoud, and Roberto Cipolla. "Thermal and reflectance based personal identification methodology under variable illumination." Pattern Recognition 43.5 (2010): 1801-1813.
- Zhan Wu, Min Peng and Tong Chen, "Thermal face recognition using convolutional neural network" 2016 International Conference on Optoelectronics and Image Processing (ICOIP), Warsaw, 2016, pp. 6-9.
- Sarfraz, M. Saquib, and Rainer Stiefelhagen. "Deep perceptual mapping for thermal to visible face recognition." arXiv preprint arXiv:1507.02879 (2015).
- M. O. Simón et al., "Improved RGB-D-T based face recognition," IET Biometrics, vol. 5, no. 4, pp. 297-303, 2016.
- Peng, Min, et al. "NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification." Information 7.4 (2016): 61.
- Orji, Chigozie, Evan Hurwitz, and Ali Hasan, "Thermal Imaging Using CNN and KNN Classifiers with FWT, PCA and LDA Algorithms" in Seventh International Conference on Computer Science, Engineering and Information Technology (CCSEIT 2017), 2017, pp. 133-143.
- R. B. Palm,"Prediction as a candidate for learning deep hierarchical models of data," 2012. [Online]. Available: http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id= 6284
- IEEE OTCBVS WS Series Bench; Roland Miezianko, Terravic Research Infrared Database.
- A. Kwásniewska, J. Rumiński, and P. Rad, "Deep features class activation map for thermal face detection and tracking," in Proceedings -2017 10th International Conference on Human System Interactions, HSI 2017, 2017, pp. 41-47.
- C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, Z. Wojna. "Rethinking the Inception Architecture for Computer Vision", The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2818-2826
- P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Image-to-image translation with conditional adversarial networks. In CVPR, 2017
- Zhang, Teng, et al. "TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition." arXiv preprint arXiv:1712.02514 (2017)
- Saxena, Shreyas, and Jakob Verbeek. "Heterogeneous face recognition with CNNs." European Conference on Computer Vision. Springer, Cham, 2016.
- Li, S.Z.; Chu, R.; Liao, S.; Zhang, L. Illumination invariant face recognition using near-infrared images. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29, 627-639.