Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Experimental Setup
Database
Experimental Results
Conclusion and Discussion
References
All Topics
Computer Science
Computer Vision

Evaluation of Face Resolution for Expression Analysis

Profile image of ying tianying tian

2004, Computer Vision and Pattern Recognition

https://doi.org/10.1109/CVPR.2004.60
visibility

…

description

7 pages

link

1 file

Abstract

Most automatic facial expression analysis (AFEA) systems attempt to recognize facial expressions from data collected in a highly controlled environment with very high resolution frontal faces ( face regions greater than 200 x 200 pixels ). However, in real environments, the face image is often in lower resolution and with head motion. It is unclear that the performance of AFEA systems for low resolution face images. The general approach to AFEA consists of 3 steps: face acquisition, facial feature extraction, and facial expression recognition. This paper explores the effects of different image resolutions for each step of facial expression analysis. The different approaches are compared for face detection, face data extraction and expression recognition. A total of five different resolutions of the head region are studied (288x384, 144x192, 72x96, 36x48, and 18Xx24) based on a widely used public database . The lower resolution images are down-sampled from the originals.

Related papers

Effects of Different Datasets, Models, Face-parts on Accuracy and Performance of Intelligent Facial Expression Recognition Systems
Subhi R M Zeebaree

International Journal of INTELLIGENT SYSTEMS AND APPLICATIONS IN ENGINEERING, 2024

Facial expression recognition is a crucial area of study in the field of computer vision. Research on nonverbal communication has shown that a significant amount of deliberate information is sent via facial expressions. Facial expression recognition is a crucial field in computer vision that deals with the significant impact of nonverbal communication. Expression recognition has lately been extensively used in the medical and advertising sectors. Difficulties in Facial Emotion Recognition. Facial emotion recognition is a technique that examines facial expressions in static photos and videos to uncover information about an individual's emotional state. The intricacy of facial expressions, the versatile use of the technology in any setting, and the incorporation of emerging technologies like artificial intelligence pose substantial privacy hazards. Facial expressions serve as non-verbal cues, offering indications of human emotions. Deciphering emotional expressions has been a focal point of study in psychology for many years. This study will examine several prior studies that have undertaken comprehensive facial analysis, including both total and partial face recognition, to identify expressions and emotions. The datasets and models used in previous studies, as well as the findings gained, show that employing the whole face yields more accuracy compared to using specific face-parts, which result in lower accuracy ratios. However, emotional identification often does not rely only on the whole face, since it is not always feasible to have the full face available. Contemporary research is now prioritising the identification of facial expressions based on certain facial features. Efficient deep learning algorithms, particularly the CNN algorithm, can do this task.

View PDFchevron_right
Real World Real-Time Automatic Recognition of Facial Expressions
Arun Hampapur

In Proceedings of IEEE …, 2003

Most facial expression analysis systems attempt to recognize facial expressions from data collected in a highly controlled laboratory with very high resolution frontal faces (face regions greater than 200 x 200 pixels) and cannot handle large head motions. In real environments such as smart meetings, a facial expression analysis system must be able to automatically recognize expressions at lower resolution and handle the full range of head motion. This paper describes a real-time system to automatically recognize facial expressions in relatively low resolution face images (around 50x70 to 75x100 pixels). To handle the full range of head motion, we detect the head instead of the face. Then the head pose is estimated based on the detected head. For frontal and near frontal views of the face, the location and shape features are computed for expression recognition. Our system successfully deals with complex real world interactions, as demonstrated on the PETS2003 dataset.

View PDFchevron_right
Contemporary study on Face and Facial Expression Recognition System-A Review
Kaustubh Bhattacharyya

The primary goal of this paper is to make a comparative study on various approaches used to identify the person's face and thereafter recognize their emotion. Among the various techniques implemented, Neural Networks, Hidden Markov Model and Dimensionality reduction techniques have received lot of attention. The face and facial emotion recognition system would require care and efforts in data acquisition, pre-processing, feature extraction, classification and performance evaluation. The main aim of this review paper is to study and compare the well-known techniques used at different stages to recognize the face and its emotion. different gender, race and features. These varieties in the database such as glasses, moustache and beard had enabled the system to learn to differentiate various levels of facial expressions successfully.

View PDFchevron_right
A Review of Facial Expression Recognition
priyanka nathawat

2020

Emotions are very present in our daily life. They are manifested by physiological reactions (palpitations, heat, and acceleration of the pulse), motor reactions (gestural expressions, facial expressions) and changes in the voice. The complexity of emotions was capable to seek attention of various researchers. Differing representations of emotions were then proposed to produce a set of theories. The automation of facial expression detection can then be approached in a variety of ways. We concentrated on the face expression detection. Concerning to this the recognition is based on different visual characteristics of the expression. This paper is dedicated at first to the exhibition of the definition of emotions, followed by the great theories that have emerged in this area. In a second step, we present the methods of extraction of the facial characteristics and the methods of selection. Finally, some databases used for automatic recognition of emotions are presented.

View PDFchevron_right
A Novel Feature Extraction Technique for Facial Expression Recognition, International Journal of Computer Science Issues 10 (1), 9-14
Dr. Mohammad Shahidul Islam

This paper presents a new technique to extract the light invariant local feature for facial expression recognition. It is not only robust to monotonic gray-scale changes caused by light variations but also very simple to perform which makes it possible for analyzing images in challenging real-time settings. The local feature for a pixel is computed by finding the direction of the neighboring of the pixel with the particular rank in term of its gray scale value among all the neighboring pixels. When eight neighboring pixels are considered, ...

View PDFchevron_right
Facial Expression Recognition -A Comprehensive Review
Directorate Research & Innovation

In this paper, we have provided a comprehensive review of modern facial expression recognition system. The history of the technology as well as the current status in terms of accomplishments and challenges has been emphasized. First, we highlighted some modern applications of the technology. The best methods of face detection, an essential component of automatic facial expression system, are also discussed. Facial Action Coding Systems-the cumulative database of research and development of micro expressions within the behavioral science are also enlightened. Then various facial expression databases and the types of recognitions are explained in detail. Finally, we provided the procedures of facial expression recognition from feature extraction to classifications, emphasizing on modern and best approaches. Then the challenges encountered when comparing results with others are highlighted and suggestions to alleviate the problems, provided.

View PDFchevron_right
Web-Based Database for Facial Expression Analysis
Michel Valstar

2005 IEEE International …, 2005

View PDFchevron_right
Facial Expression Analysis
ying tian

Handbook of Face Recognition, 2005

View PDFchevron_right
Impact of the face registration techniques on facial expressions recognition
chaabane Djeraba

Signal Processing: Image Communication, 2018

Recent methodologies for facial expression recognition have been proposed and have obtained good results in near-frontal view. However, these situations do not fairly represent in-the-wild challenges, where expressions are natural and the subject is free of its movement. This is reflected in the accuracy drop of facial expression methods obtained on recent databases. Two challenges (head pose variations and large displacements) in facial expression recognition are studied in this paper. Experiments are proposed in order to quantify the impact of free head movements using representative expression recognition approaches (LBP, LBP-TOP, HOOF). We propose an experimental protocol (SNaP-2DFe) that records, under controlled light, facial expressions with two cameras: one attached on the head and one placed in front of the subject. As in both cameras facial expressions are the same, differences in performances measured on each camera show the impact of head pose variations and large displacements on the underlying recognition approach.

View PDFchevron_right
REVIEW OF FACIAL EXPRESSION RECOGNITION SYSTEM AND USED DATASETS
Editor IJRET

The human face is main part to recognize the individuals as well as provides the important information, current state of user behavior through their different expressions. Therefore, in biometric area of the research, automatically face & face expression recognition attracts researcher's interest. The other areas which use such technique are computer science medicine, psychology etc. Usually face recognition system is consisting of many internal tasks. Face detection is thefirst task of such systems. Due to different variations across the human faces, the process of detecting face becomes complex. But with help of different modeling methods, it becomes possible to recognize the face and hence different face expressions. This paperpresents a literature review over the techniques and methods used for facial expression recognition. Also, different facial expression datasets available for the research or testing of existing methods of facial expression recognition are discussed.

View PDFchevron_right

References (33)

  1. S. Baker and T. Kanade. Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(9):1167 -1183, September 2002.
  2. M. S. Bartlett, B. Braathen, G. Littlewort-Ford, J. Hershey, I. Fasel, T. Marks, E. Smith, T. Sejnowski, and J. R. Movel- lan. Automatic analysis of spontaneous facial behavior: A final project report. Technical Report INC-MPLab-TR- 2001.08, Machine Perception Lab, Institute for Neural Com- putation, University of California, San Diego, San Diego, CA, October 2001.
  3. M. J. Black and Y. Yacoob. Recognizing facial expressions in image sequences using local parameterized models of image motion. International Journal of Computer Vision, 25(1):23-48, October 1997.
  4. L. Brown and Y. li Tian. Comparative study of coarse head pose estimation. In IEEE Workshop on Motion and Video Computing, Orlando FL, Dec. 5-6, 2002.
  5. I. Cohen, N. Sebe, F. G. Cozman, M. C. Cirelo, and T. S. Huang. Coding, analysis, interpretation, and recognition of facial expressions. Journal of Computer Vision and Image Understanding Special Issue on Face recognition, 2003.
  6. J. Cohn, T. Kanade, T. Moriyama, Z. Ambadar, J. Xiao, J. Gao, and H. Imamura. A comparative study of alterna- tive facs coding algorithms. Technical Report CMU-RI-TR- 02-06, Robotics Institute, Carnegie Mellon University, Pitts- burgh, PA, November 2001.
  7. J. F. Cohn, A. J. Zlochower, J. Lien, and T. Kanade. Auto- mated face analysis by feature point tracking has high con- current validity with manual facs coding. Psychophysiology, 36:35-43, 1999.
  8. G. Donato, M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski. Classifying facial actions. IEEE Transaction on Pattern Analysis and Machine Intelligence, 21(10):974-989, Oct. 1999.
  9. P. Ekman and W. Friesen. The Facial Action Coding Sys- tem: A Technique For The Measurement of Facial Move- ment. Consulting Psychologists Press, Inc., San Francisco, CA, 1978.
  10. I. Essa and A. Pentland. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. on Pattern Analysis and Machine Intell., 19(7):757-763, July 1997.
  11. B. Fasel and J. Luttin. Recognition of asymmetric facial action unit activities and intensities. In Proceedings of In- ternational Conference of Pattern Recognition, 2000.
  12. G. L. Ford. Fully automatic coding of basic expressions from video. Technical Report INC-MPLab-TR-2002.03, Machine Perception Lab, Institute for Neural Computa- tion, University of California, San Diego, San Diego, CA, September 2002.
  13. M. Frank and P. Ekman. The ability to detect deceit gener- alizes across different types of high-stake lies. Personality and Social Psychology, 72:1429-1439, 1997.
  14. H. Fujiyoshi and A. Lipton. Real-time human motion anal- ysis by image skeletonization. In proc. of the Workshop on Application of Computer Vision, 1998.
  15. B. Heisele, T. Serre, M. Pontil, and T. Poggio. Component- based face detection. In Proc. IEEE Conf. on Computer Vi- sion and Pattern Recogn. (CVPR), 2001.
  16. T. Kanade, J. Cohn, and Y. Tian. Comprehensive database for facial expression analysis. In Proceedings of Interna- tional Conference on Face and Gesture Recognition, pages 46-53, March, 2000.
  17. S. Z. Li and L. Gu. Real-time multi-view face detection, tracking, pose estimation, alignment, and recognition. In IEEE Conf. on Computer Visioin and Pattern Recognition Demo Summary, 2001.
  18. J.-J. J. Lien, T. Kanade, J. F. Cohn, and C. C. Li. Detection, tracking, and classification of action units in facial expres- sion. Journal of Robotics and Autonomous System, 31:131- 146, 2000.
  19. M. Lyons, S. Akamasku, M. Kamachi, and J. Gyoba. Coding facial expressions with gabor wavelets. In Proceedings of International Conference on Face and Gesture Recognition, 1998.
  20. T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, and M. Imanura. Automatic recognition of eye blink- ing in spontaneously occurring behavior. In Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002), volume 4, pages 78 -81, August 2002.
  21. M. Pantic and L. J. M. Rothkrantz. Expert system for auto- matic analysis of facial expression. Image and Vision Com- puting, 18(11):881-905, 2000.
  22. A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 84- 91, 1994.
  23. H. A. Rowley, S. Baluja, and T. Kanade. Neural network- based face detection. IEEE Transactions On Pattern Analy- sis and Machine intelligence, 20(1):23-38, January 1998.
  24. E. Smith, M. S. Bartlett, and J. Movellan. Computer recog- nition of facial action: A study of co-articulation effects. In Proceedings of 8th Joint Symposium on Neural Computa- tion, May, 2001.
  25. K. K. Sung and T. Poggio. Example-based learning for view- based human face detection. IEEE Transactions On Pat- tern Analysis and Machine intelligence, 20(1):39-51, Jan- uary 1998.
  26. Y. Tian, L. Brown, A. Hampapur, S. Pankanti, A. W. Senior, and R. M. Bolle. Real world real-time automatic recognition of facial expressions. In Proceedings of IEEE workshop on performance evaluation of tracking and surveillance, Graz, Austria, March, 2003.
  27. Y. Tian, T. Kanade, and J. Cohn. Recognizing action units for facial expression analysis. IEEE Trans. on Pattern Anal- ysis and Machine Intell., 23(2):1-19, Feb. 2001.
  28. Y. Tian, T. Kanade, and J. Cohn. Evaluation of gabor- wavelet-based facial action unit recognition in image se- quences of increasing complexity. In Proceedings of the 5th IEEE International Conference on Automatic Face and Ges- ture Recognition (FG'02), DC, May, 2002.
  29. P. Viola and M. Jones. Robust real-time object detection. In International Workshop on Statistical and Computational Theories of Vision -Modeling, Learning, Computing, and Sampling, 2001.
  30. Z. Wen and T. S. Huang. Capturing subtle facial motions in 3d face tracking. In Proc. Of Int. Conf. On Computer Vision, 2003.
  31. J. Xiao, T. Kanade, and J. F. Cohn. Robust full motion recovery of head by dynamic templates and re-registration techniques. In Proceedings of International Conference on Automatic Face and Gesture Recognition, pages 163-169, 2002.
  32. Y. Yacoob and L. Davis. Recognizing human facial expres- sion from long image sequences using optical flow. IEEE Trans. on Pattern Analysis and Machine Intell., 18(6):636- 642, June 1996.
  33. J. Yang, R. Stiefelhagen, U. Meier, and A. Waibel. Real-time face and facial feature tracking and applications. In Proceed- ings of Auditory-Visual Speech Processing (AVSP 98), New South Wales, Australia, 1998.

Related papers

Face Expression Recognition and Analysis: The State of the ArtThe
Will T

The automatic recognition of facial expressions has been an active research topic since the early nineties. There have been several advances in the past few years in terms of face detection and tracking, feature extraction mechanisms and the techniques used for expression classification. This paper surveys some of the published work since 2001 till date. The paper presents a time-line view of the advances made in this field, the applications of automatic face expression recognizers, the characteristics of an ideal system, the databases that have been used and the advances made in terms of their standardization and a detailed summary of the state of the art. The paper also discusses facial parameterization using FACS Action Units (AUs) and MPEG-4 Facial Animation Parameters (FAPs) and the recent advances in face detection, tracking and feature extraction methods. Notes have also been presented on emotions, expressions and facial features, discussion on the six prototypic expressions and the recent studies on expression classifiers. The paper ends with a note on the challenges and the future work. This paper has been written in a tutorial style with the intention of helping students and researchers who are new to this field.

View PDFchevron_right
Framework for reliable, real-time facial expression recognition for low resolution images
Hubert Konik, Saida Bouakaz

Pattern Recognition Letters, 2013

Automatic recognition of facial expressions is a challenging problem specially for low spatial resolution facial images. It has many potential applications in human-computer interactio ns, social robots, deceit detection, interactive video and behavior monitoring. In this study we present a nov el frame work that can recognize facial expressions very efficiently and with high accuracy even for very low resolution facial images. The proposed framework is memory and time efficient as it extracts texture features in a pyramidal fashion only from the perceptual salient regions of the face. We tested the framew ork on different databases, which includes Cohn-Kanade (CK+) posed facial expression database, spontaneous expressions of MMI facial expression database and FG-NET facial expressions and emotions database (FEED) and obtained very good results. Moreover, our proposed framework exceeds state-of-the-art methods for expression recognition on low resolution images.

View PDFchevron_right
MAFER: a Multi-resolution Approach to Facial Expression Recognition
Fabrizio Falchi

2021

Emotions play a central role in the social life of every human being, and their study, which represents a multidisciplinary subject, embraces a great variety of research fields, e.g., from psychology to computer science, among others. Especially concerning the latter, the analysis of facial expressions represents a very active research area due to its relevance to human-computer interaction applications, for example. In such a context, Facial Expression Recognition (FER) is the task of recognizing expressions on human faces. Typically, face images are acquired by cameras that have, by nature, different characteristics, such as the output resolution. Moreover, other circumstances might involve cameras placed far from the observed scene, thus obtaining faces with very low resolutions. It has been already shown in the literature that Deep Learning models applied to face recognition experience a degradation in their performance when tested against multi-resolution scenarios if not prope...

View PDFchevron_right
Evaluation of the Discrimination Power of Features Extracted from 2-D and 3-D Facial Images for Facial Expression Analysis
Ioanna-ourania Stathopoulou

In previous works of ours (1-3), we proposed a neural net- work-based face detection and facial expression analysis sys- tem, which was able to classify three expressions in frontal view face images. In the present work, we examine the possi- bility of classifying these expressions in side view face im- ages. Specifically, we evaluate the extracted facial feature discrimination power of three image acquisition techniques, namely acquisition in (1) frontal view, (2) side view and (3) stereoscopic pairs. Our findings are important in the design of human-computer interaction systems and multimedia interac- tive services.

View PDFchevron_right
A Review: Facial Expression Detection with its Techniques and Application
Manish Dixit

International Journal of Signal Processing, Image Processing and Pattern Recognition, 2016

Facial expression recognition performs a critical role in the human-machine interaction area. The security of information is becoming very significant and difficult. Security cameras are presently common in airports, Offices, University, ATM, Bank and in any locations with a security system. Facial Expression Recognition system is used in security. During the past years recognition of face has received most important attention as one of the most significant image application understanding and analysis. Many algorithms have been implemented on different static and non static conditions (uncontrolled conditions).Static conditions include static and uniform background, identical poses, similar illumination, neutral frontal face .Non static conditions include position, partial occlusion orientation; varying lighting conditions and facial hair, which makes recognition process a complex problem. Facial expression recognition is a example where computer and humans underperforms. It has most importance for the video retrieval and video based management classification. It may be used in behavior psychology and science.

View PDFchevron_right

Related topics

  • Face Detection
  • Facial Expression Analysis
  • Facial Expression Recognition
  • Facial Feature Extraction
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved