Academia.eduAcademia.edu

Outline

Song Recommendation System Based on Real-Time Facial Expressions

2022, International Journal for Research in Applied Science and Engineering Technology (IJRASET)

https://doi.org/10.22214/IJRASET.2022.47572

Abstract

Traditional methods of playing music according to a person's mood required human interaction. Migrating to computer vision technology will enable the automation of the such system. This article describes the implementation details of a real-time facial feature extraction and emotion recognition system. One way to do this is to compare selected facial features from an image to a face database. Recognizing emotions from images has become one of the active research topics in image processing and applications based on human-computer interaction. The expression on the face is detected using a convolutional neural network (CNN) for classifying human emotions from dynamic facial expressions in real time. The FER dataset is utilized to train the model which contains approximately 30,000 facial RGB images of different expressions. Expression-based music players aim to scan and interpret data and build playlists accordingly. It will suggest a playlist of songs based on your facial expressions. This is an additional feature of the existing feature of a music player.

FAQs

sparkles

AI

What techniques improve facial expression recognition in real-time scenarios?add

The study utilizes CNN for emotion classification and Haar cascade for face detection, improving detection efficiency. Real-time accuracy is reported at 60-70%, compared to 80-90% for static images.

What emotions can the proposed system recognize and respond to?add

The proposed system identifies three emotions: happy, neutral, and sad for music recommendations. This corresponds to the seven universal emotions recognized in the FER2013 dataset.

How does image preprocessing enhance the facial emotion recognition system?add

Preprocessing steps include normalization, grayscale conversion, and resizing to reduce noise and improve computation speed. This prepares input images to yield more accurate and efficient recognition results.

What challenges does the current music recommendation system address?add

The proposed application targets inefficient manual song selection by recommending music based on real-time user emotions. This is aimed at enhancing user experience by aligning playlists with current moods.

What methodologies were applied for emotion detection in the system?add

The methodology combines CNN for emotion classification and SVM for analyzing features of facial expressions. Independent Component Analysis (ICA) was also mentioned for EEG-based emotion detection.

References (13)

  1. Londhe RR and Pawar DV 2012 Analysis of facial expression and recognition based on statistical approach International Journal of Soft Computing and Engineering
  2. Florence, S. Metilda, and M. Uma. "Emotional Detection and Music Recommendation System based on User Facial Expression." IOP Conference Series: Materials Science and Engineering. Vol. 912. No. 6. IOP Publishing, 2020.
  3. Vinay p, Raj p, Bhargav S.K., et al. "Facial Expression Based Music Recommendation System" 2021 International Journal of Advanced Research in Computer and Communication Engineering, DOI: 10.17148/IJARCCE.2021.10682
  4. Zeng Z, Pantic M, Roisman GI and Huang TS 2008 A survey of affect recognition methods Audio, visual, and spontaneous expressions IEEE transactions on pattern analysis and machine intelligence
  5. James, H. Immanuel, et al. "EMOTION BASED MUSIC RECOMMENDATION SYSTEM." EMOTION 6.03(2019).
  6. ParulTambe, YashBagadia, Taher Khalil and Noor UlAin Shaikh 2015 Advanced Music Player with Integrated Face Recognition Mechanism International Journal of Advanced Research in Computer Science and Software Engineering
  7. Hui-Po Wang, Fang-Yu Shih,"Detect and Transmit Emotions in Online Chat using Affective Computing", National Tsing Hua University, Hsin Chu, Taiwan,2020.
  8. Yading Song, Simon Dixon, Marcus Pearce, "EVALUATION OF MUSICAL FEATURES FOR EMOTION CLASSIFICATION", University of London, ISMR, 2012.
  9. Aayush Bhardwaj ; Ankit Gupta ; Pallav Jain ; Asha Rani ; Jyoti Yadav "Classification of human emotions from EEG signals using SVM and LDA Classifiers", 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN)
  10. Rahul Hirve1, Shrigurudev Jagdale2, Rushabh Banthia3, Hilesh Kalal4& K.R. Pathak5, "EmoPlayer: An Emotion Based Music Player", Imperial Journal of Interdisciplinary Research (IJIR) Vol-2, Issue-5, 2016
  11. F. Abdat, C. Maaoui and A. Pruski,"Human-computer interaction using emotion recognition from facial expression", 2011 UKSim 5th European Symposium on Computer Modelling and Simulation
  12. Dubey, M., Singh, P. L., "Automatic Emotion Recognition Using Facial Expression: A Review," International Research Journal of Engineering and Tech nology,2016.
  13. Duncan, Dan, Gautam Shine, and Chris English. "Facial emotion recognition in real time." Computer Science (2016): 1-7