Academia.eduAcademia.edu

Outline

Extraction of human face features from color images

2019, Intelligent Decision Technologies

https://doi.org/10.3233/IDT-190359

Abstract

Face detection has been widely studied by researchers. However, detection and extraction of human face features is very important as it plays a vital role in variety of applications involving automated face processing. This article focuses on extraction of face parts such as eyes, nose, lips, mustache, and beard on Indian people, for which we have prepared our own face dataset containing variety in faces, from both urban and rural areas. This study focuses on how a detected face part becomes useful in detecting other face parts. We implement our approaches of detecting face parts and evaluate them on our dataset. We exploit YCbCr color model, Viola Jones technique, landmark detection, and level set evolution technique in our approaches of face part detection and extraction. We found that our approaches are effective on extracting face boundary, eyes, nose, and lips and provide comparable results. Keywords: Image processing, facial features, human face boundary extraction, eye extraction, nose and lip extraction, beard and mustache extraction brows, beard, moustache, chin, etc., and then separat-8 ing these portions for further required processing. Ex-9 traction of human face parts plays an important role in 10 human face analysis [2], visual interpretation, and hu-11 man face recognition [3,4]. Face detection has attracted 12 much interest since a long and has progressed drasti-13 cally over past few decades [5-7]; however, detection 14 of human face parts is of prime importance in a wide 15 variety of applications such as computer vision, facial 16 animation, face recognition, facial expression detec-17 tion, face image database management, etc. A human

References (27)

  1. Wu YM, Wang HW, Lu YL, Yen S, Hsiao YT. Facial feature 611 extraction and applications: A review. In: Asian Conference
  2. Kim K. Intelligent immigration control system by using pass- port recognition and face verification. In: International Sym- posium on Neural Networks 2005 May 30 (pp. 147-156).
  3. Springer, Berlin, Heidelberg.
  4. Liu JN, Wang M, Feng B. iBotGuard: An Internet-based intel- ligent robot security system using invariant face recognition against intruder. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 2005 Feb; 35(1): 97-105.
  5. Berbar MA, Kelash HM, Kandeel AA. Faces and facial fea- tures detection in color images. In: Geometric Modeling and Imaging -New Trends 2006; (pp. 209-214). IEEE.
  6. Oravec M, Kristof B, Kolarik M, Pavlovicova J. Extraction of facial features from color images. Radioengineering 2008 Sep 1; 17(3): 115-120.
  7. Mahoor MH, Abdel-Mottaleb M, Ansari AN. Improved ac- tive shape model for facial feature extraction in color images. Journal of Multimedia 2006 Jul; 1(4): 21-28.
  8. Shih FY, Cheng S, Chuang CF, Wang PS. Extracting faces and facial features from color images. International Journal of Pattern Recognition and Artificial Intelligence 2008 May; 22(03): 515-534.
  9. Jain AK. Fundamentals of digital image processing. Engle- wood Cliffs, NJ: Prentice Hall; 1989.
  10. Viola P, Jones MJ. Robust real-time face detection. Interna- tional Journal of Computer Vision 2004 May 1; 57(2): 137- 154.
  11. Khan K, Ahmad N, Ullah K, Din I. Multiclass semantic seg- mentation of faces using CRFs. Turkish Journal of Electri- cal Engineering and Computer Sciences 2017 Jul 30; 25(4): 3164-3174.
  12. Happy SL, Routray A. Automatic facial expression recogni- tion using features of salient facial patches. IEEE transactions on Affective Computing 2015 Jan 1; 6(1): 1-12.
  13. Ranjan R, Patel VM, Chellappa R. Hyperface: A deep multi- task learning framework for face detection, landmark localiza- tion, pose estimation, and gender recognition. IEEE Transac- tions on Pattern Analysis and Machine Intelligence 2019 Jan 1; 41(1): 121-135.
  14. Yang S, Luo P, Loy CC, Tang X. Faceness-net: Face detection through deep facial part responses. IEEE Transactions on Pat- tern Analysis and Machine Intelligence 2018 Aug 1; 40(8): 1845-1859.
  15. Zhang Z, Luo P, Loy CC, Tang X. Learning deep representa- tion for face alignment with auxiliary attributes. IEEE Trans- actions on Pattern Analysis and Machine Intelligence 2016 May 1; 38(5): 918-930.
  16. Boukamcha H, Hallek M, Smach F, Atri M. Automatic land- mark detection and 3D face data extraction. Journal of Com- putational Science 2017 Jul 1; 21: 340-348.
  17. Dhahri R, Belaid S. A new method to detect and remove a beard from 3D human face model. International Journal of Operational Research 2016; 27(1-2): 201-211.
  18. Brahmbhatt NR, Prajapati HB, Dabhi VK. Survey and anal- ysis of extraction of human face features. In: Power and Ad- vanced Computing Technologies (i-PACT), 2017 Innovations in 2017 Apr 21; (pp. 1-8). IEEE.
  19. Solina F, Peer P, Batagelj B, Juvan S, Kovač J. Color-based face detection in the "15 seconds of fame" art installation. In: Mirage, Conf Computer Vision/Computer Graphics Collabo- ration for Model-Based Imaging, Rendering, Image Analysis and Graphical Special Effects 2003 Mar; (pp. 38-47). Inria.
  20. H.B. Prajapati et al. / Extraction of human face features from color images
  21. Huang GB, Mattar M, Lee H, Learned-Miller EG. Learning to [37] Li C, Xu C, Gui C, Fox MD. Level set evolution without re- initialization: A new variational formulation. In: Computer Vision and Pattern Recognition, 2005 CVPR 2005. IEEE Computer Society Conference on 2005 Jun 20; (1, pp. 430- 436). IEEE.
  22. van Huan N, Binh NT, Kim H. Eye feature extraction using K-means clustering for low illumination and iris color vari- ety. In: Control Automation Robotics and Vision (ICARCV), 2010 11th International Conference on 2010 Dec 7; (pp. 633- 637). IEEE.
  23. Vukadinovic D, Pantic M. Fully automatic facial feature point detection using Gabor feature based boosted classifiers. In: Systems, Man and Cybernetics, 2005 IEEE International Con- ference on 2005 Oct 10 (2, pp. 1692-1698). IEEE.
  24. Yin L, Basu A. Nose shape estimation and tracking for model- based coding. In: Acoustics, Speech, and Signal Process- ing, 2001 Proceedings (ICASSP'01). 2001 IEEE International Conference on 2001 (3, pp. 1477-1480). IEEE.
  25. Le TH, Savvides M. A novel shape constrained feature-based active contour model for lips/mouth segmentation in the wild. Pattern Recognition 2016 Jun 1; 54: 23-33.
  26. Le TH, Luu K, Seshadri K, Savvides M. Beard and mustache segmentation using sparse classifiers on self-quotient images. In: Image Processing (ICIP), 2012 19th IEEE International Conference on 2012 Sep 30; (pp. 165-168). IEEE.
  27. Wang JG, Yau WY. Real-time beard detection by combining image decolorization and texture detection with applications to facial gender recognition. In: Computational Intelligence in Biometrics and Identity Management (CIBIM), 2013 IEEE Workshop on 2013 Apr 16; (pp. 58-65). IEEE.