Academia.eduAcademia.edu

Outline

Drowsy Driver Detection Through Facial Movement Analysis

Lecture Notes in Computer Science

https://doi.org/10.1007/978-3-540-75773-3_2

Abstract

The advance of computing technology has provided the means for building intelligent vehicle systems. Drowsy driver detection system is one of the potential applications of intelligent vehicle systems. Previous approaches to drowsiness detection primarily make pre-assumptions about the relevant behavior, focusing on blink rate, eye closure, and yawning. Here we employ machine learning to datamine actual human behavior during drowsiness episodes. Automatic classifiers for 30 facial actions from the Facial Action Coding system were developed using machine learning on a separate database of spontaneous expressions. These facial actions include blinking and yawn motions, as well as a number of other facial movements. In addition, head motion was collected through automatic eye tracking and an accelerometer. These measures were passed to learning-based classifiers such as Adaboost and multinomial ridge regression. The system was able to predict sleep and crash episodes during a driving computer game with 96% accuracy within subjects and above 90% accuracy across subjects. This is the highest prediction rate reported to date for detecting real drowsiness. Moreover, the analysis revealed new information about human behavior during drowsy driving.

References (14)

  1. DOT: Intelligent vehicle initiative. United States Department of Transportation. http://www.its.dot.gov/ivi/ivi.htm./
  2. DOT: Saving lives through advanced vehicle safety technology. USA Department of Transportation. http://www.its.dot.gov/ivi/docs/AR2001.pdf.
  3. Takei, Y. Furukawa, Y.: Estimate of driver's fatigue through steering motion. In: Man and Cybernetics, 2005 IEEE International Conference. (Volume: 2, On page(s): 1765-1770 Vol. 2)
  4. Igarashi, K., Takeda, K., Itakura, F., Abut, H.: DSP for In-Vehicle and Mobile Systems. Springer US (2005)
  5. Cobb., W.: Recommendations for the practice of clinical neurophysiology. Elsevier (1983)
  6. Hong, Chung, K.: Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. International Journal of Industrial Ergonomics. (Volume 35, Issue 4, April 2005, Pages 307-320.)
  7. Gu, H., Ji, Q.: An automated face reader for fatigue detection. In: FGR. (2004) 111-116
  8. Zhang, Z., shu Zhang, J.: Driver fatigue detection based intelligent vehicle con- trol. In: ICPR '06: Proceedings of the 18th International Conference on Pattern Recognition, Washington, DC, USA, IEEE Computer Society (2006) 1262-1265
  9. Gu, H., Zhang, Y., Ji, Q.: Task oriented facial behavior recognition with selective sensing. Comput. Vis. Image Underst. 100(3) (2005) 385-415
  10. Bartlett, M., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Au- tomatic recognition of facial actions in spontaneous expressions. Journal of Multi- media. (1(6) p. 22-35.)
  11. Orden, K.F.V., Jung, T.P., Makeig, S.: Combined eye activity measures accurately estimate changes in sustained visual task performance. Biological Psychology (2000 Apr;52(3):221-40)
  12. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Mea- surement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA (1978)
  13. Fasel I., Fortenberry B., M.J.: A generative framework for real-time object detec- tion and classification. Computer Vision and Image Understanding. (98, 2005.)
  14. Kanade, T., Cohn, J., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE International conference on automatic face and gesture recognition (FG'00), Grenoble, France (2000) 46-53