Academia.eduAcademia.edu

Outline

What your Facebook Profile Picture Reveals about your Personality

2017, Proceedings of the 25th ACM international conference on Multimedia

https://doi.org/10.1145/3123266.3123331

Abstract

People spend considerable effort managing the impressions they give others. Social psychologists have shown that people manage these impressions differently depending upon their personality. Facebook and other social media provide a new forum for this fundamental process; hence, understanding people's behaviour on social media could provide interesting insights on their personality. In this paper we investigate automatic personality recognition from Facebook profile pictures. We analyze the effectiveness of four families of visual features and we discuss some human interpretable patterns that explain the personality traits of the individuals. For example, extroverts and agreeable individuals tend to have warm colored pictures and to exhibit many faces in their portraits, mirroring their inclination to socialize; while neurotic ones have a prevalence of pictures of indoor places. Then, we propose a classification approach to automatically recognize personality traits from these visual features. Finally, we compare the performance of our classification approach to the one obtained by human raters and we show that computer-based classifications are significantly more accurate than averaged human-based classifications for Extraversion and Neuroticism.

References (63)

  1. Oya Aran and Daniel Gatica-Perez. 2013. Cross-domain personality prediction: from video blogs to small group meetings. In Proceedings of ICMI. ACM, 127-130.
  2. Ligia Maria Batrinca, Nadia Mana, Bruno Lepri, Fabio Pianesi, and Nicu Sebe. 2011. Please, tell me about yourself: automatic personality assessment using short self-presentations. In Proceedings of the 13th international conference on multimodal interfaces. ACM, 255-262.
  3. J Biel and Daniel Gatica-Perez. 2013. The youtube lens: Crowdsourced personality impressions and audiovisual analysis of vlogs. Multimedia, IEEE Trans. on 15, 1 (2013), 41-55.
  4. Anna Bosch, Andrew Zisserman, and Xavier Muoz. 2007. Image classification using random forests and ferns. In Proceedings of IEEE ICCV. 1-8.
  5. Fabio Celli, Elia Bruni, and Bruno Lepri. 2014. Automatic Personality and In- teraction Style Recognition from Facebook Profile Pictures. In Proceedings of ACM-MM. 1101-1104.
  6. Gokul Chittaranjan, Jan Blom, and Daniel Gatica-Perez. 2013. Mining large-scale smartphone data for personality studies. Personal and Ubiquitous Computing 17, 3 (2013), 433-450.
  7. P.T. Costa and R.R. McCrae. 1985. The NEO Personality Inventory: Manual Form S and Form R. Psychological Assessment Resources. http://books.google.it/books? id=q6oFHAAACAAJ
  8. Marco Cristani, Alessandro Vinciarelli, Cristina Segalin, and Alessandro Perina. 2013. Unveiling the Multimedia Unconscious: Implicit Cognitive Processes and Multimedia Content Analysis. In Proceedings of ACM-MM. 213-222. Brand New Idea paper.
  9. Gabriella Csurka, Christopher Dance, Lixin Fan, Jutta Willamowski, and Cédric Bray. 2004. Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision, ECCV, Vol. 1. Prague, 1-2.
  10. R. Datta, D. Joshi, J. Li, and J. Wang. 2006. Studying Aesthetics in Photographic Images Using a Computational Approach. In Proceedings of ECCV. Vol. 3953. Springer Verlag, 288-301.
  11. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In Proceedings of IEEE CVPR. 248-255.
  12. Sarah Diefenbach and Lara Christoforakos. 2017. The Selfie Paradox: Nobody Seems to Like Them Yet Everyone Has Reasons to Take Them. An Exploration of Psychological Functions of Selfies in Self-Presentation. Frontiers in psychology 8 (2017).
  13. D.C. Evans, S.D. Gosling, and A. Carroll. 2008. What elements of an online social networking profile predict target-rater agreement in personality impressions. In Proceedings of AAAI ICWSM. 45-50.
  14. B. Ferwerda, M. Schedl, and M. Tkalcic. 2016. Using Instagram picture features to predict users' personality. In MultiMedia Modeling, Q. Tian, N. Sebe, G.-J. Qi, B. Huet, R. Hong, and X. Liu (Eds.). Springer International Publishing, 850-861.
  15. D.C. Funder. 2012. Accurate personality judgment. Current Directions in Psycho- logical Science 21, 3 (2012), 1-18.
  16. C.M. Georgescu. 2002. Synergism in low level vision. In Proceedings of ICPR. 150-155.
  17. E. Goffman. 1959. The presentation of self in everyday life. Garden City, NY Double Day.
  18. Jennifer Golbeck, Cristina Robles, Michon Edmondson, and Karen Turner. 2011. Predicting personality from Twitter. In Proceedings of IEEE SocialCom. 149-156.
  19. Jennifer Golbeck, Cristina Robles, and Karen Turner. 2011. Predicting personality with social media. In CHI'11 extended abstracts on human factors in computing systems. ACM, 253-262.
  20. Lewis R Goldberg, John A Johnson, Herbert W Eber, Robert Hogan, Michael C Ashton, C Robert Cloninger, and Harrison G Gough. 2006. The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality 40, 1 (2006), 84-96.
  21. A.L. Gonzales and J.T. Hancock. 2008. Identity shift in computer-mediated environments. Media Psychology 11, 2 (2008), 167-185.
  22. S.D. Gosling, S. Gaddis, and S. Vazire. 2007. Personality impressions based on Facebook profiles. In Proceedings of AAAI ICWSM, Vol. 7. 1-4.
  23. Jeffrey A Hall and Natalie Pennington. 2013. Self-monitoring, honesty, and cue use on Facebook: The relationship with user extraversion and conscientiousness. Computers in Human Behavior 29, 4 (2013), 1556-1564.
  24. Jeffrey A Hall, Natalie Pennington, and Allyn Lueders. 2013. Impression manage- ment and formation on Facebook: A lens model approach. New Media & Society (2013), 1-25.
  25. Dinesh Babu Jayagopi, Hayley Hung, Chuohao Yeo, and Daniel Gatica-Perez. 2009. Modeling dominance in group conversations using nonverbal activity cues. IEEE Transactions on Audio, Speech, and Language Processing 17, 3 (2009), 501-513.
  26. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014).
  27. Jyoti Joshi, Hatice Gunes, and Roland Goecke. 2014. Automatic prediction of perceived traits using visual cues under varied situational context. In Proceedings of IEEE ICPR. 2855-2860.
  28. Michal Kosinski, Yoram Bachrach, Pushmeet Kohli, David Stillwell, and Thore Graepel. 2013. Manifestations of user personality in website choice and behaviour on online social networks. Machine Learning (2013), 1-24.
  29. Michal Kosinski, David Stillwell, and Thore Graepel. 2013. Private traits and attributes are predictable from digital records of human behavior. PNAS 110, 15 (2013), 5802-5805.
  30. K. Krippendorff. 2004. Reliability in Content Analysis. Human Communication Research 30, 3 (2004), 411-433.
  31. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classifi- cation with deep convolutional neural networks. In NIPS. 1097-1105.
  32. Mark R Leary and Ashley Batts Allen. 2011. Personality and Persona: Personality Processes in Self-Presentation. Journal of personality 79, 6 (2011), 1191-1218.
  33. Yann LeCun and Yoshua Bengio. 1995. Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks 3361 (1995), 310.
  34. Bruno Lepri, Ramanathan Subramanian, Kyriaki Kalimeri, Jacopo Staiano, Fabio Pianesi, and Nicu Sebe. 2012. Connecting Meeting Behavior with Extraversion: A Systematic Study. IEEE Transactions on Affective Computing 3, 4 (2012), 443-455.
  35. P. Lovato, A. Perina, N. Sebe, O. Zandonà, A. Montagnini, M. Bicego, and M. Cristani. 2012. Tell me what you like and I'll tell you what you are: discriminating visual preferences on Flickr data. In Proceedings of ACCV, Vol. 7724. 45-56.
  36. David G Lowe. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2 (2004), 91-110.
  37. J. Machajdik and A. Hanbury. 2010. Affective image classification using features inspired by psychology and art theory. In Proceedings of the ACM-MM. 83-92.
  38. K.V. Mardia and P.E. Jupp. 2009. Directional Statistics. Wiley.
  39. Gelareh Mohammadi and Alessandro Vinciarelli. 2012. Automatic personality perception: Prediction of trait attribution based on prosodic features. IEEE Transactions on Affective Computing 3, 3 (2012), 273-284.
  40. Bojan Musil, Andrej Preglej, Tadevſ Ropert, Lucia Klasinc, and Nenad C. Babic. 2017. What Is Seen Is Who You Are: Are Cues in Selfie Pictures Related to Personality Characteristics? Frontiers in Psychology 8 (2017), 82. https://doi.org/ 10.3389/fpsyg.2017.00082
  41. A. Oliva and A. Torralba. 2001. Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope. International Journal of Computer Vision 42, 3 (2001), 145-175.
  42. Fabio Pianesi, Nadia Mana, Alessandro Cappelletti, Bruno Lepri, and Massimo Zancanaro. 2008. Multimodal recognition of personality traits in social interac- tions. In Proceedings of ICMI. 53-60.
  43. Daniele Quercia, Michal Kosinski, David Stillwell, and Jon Crowcroft. 2011. Our Twitter profiles, our selves: Predicting personality with Twitter. In Proceedings of IEEE SocialCom. 180-185.
  44. Daniele Quercia, Diego B Las Casas, Joao Paulo Pesce, David Stillwell, Michal Kosinski, Virgilio Almeida, and Jon Crowcroft. 2012. Facebook and Privacy: The Balancing Act of Personality, Gender, and Relationship Currency.. In Proceedings of AAAI ICWSM.
  45. Beatrice Rammstedt and Oliver P John. 2007. Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of research in Personality 41, 1 (2007), 203-212.
  46. J. Rosenberg and N. Egbert. 2011. Online Impression Management: Personality Traits and Concerns for Secondary Goals as Predictors of Self-Presentation Tactics on Facebook. Journal of Computer-Mediated Communication 17, 1 (2011), 106-116.
  47. H Andrew Schwartz, Johannes C Eichstaedt, Margaret L Kern, Lukasz Dziurzyn- ski, Stephanie M Ramones, Megha Agrawal, Achal Shah, Michal Kosinski, David Stillwell, Martin EP Seligman, et al. 2013. Personality, gender, and age in the language of social media: The open-vocabulary approach. PlOS One 8, 9 (2013), e73791.
  48. Cristina Segalin, Dong Seon Cheng, and Marco Cristani. 2016. Social profiling through image understanding: Personality inference using convolutional neural networks. Computer Vision and Image Understanding (2016).
  49. Crisitina Segalin, Alessandro Perina, Marco Cristani, and Alessandro Vinciarelli. 2017. The pictures we like are our image: continuous mapping of favorite pictures into self-assessed and attributed personality traits. IEEE Transactions on Affective Computing 8, 2 (2017), 268-285.
  50. P Sorokowski, A Sorokowska, A Oleszkiewicz, T Frackowiak, A Huk, and K Pisanski. 2015. Selfie posting behaviors are associated with narcissism among men. Personality and Individual Differences 85 (2015), 123-127.
  51. Jacopo Staiano, Bruno Lepri, Nadav Aharony, Fabio Pianesi, Nicu Sebe, and Alex Pentland. 2012. Friends don't lie: inferring personality traits from social network structure. In Proceedings of Ubicomp. 321-330.
  52. David J Stillwell and Michal Kosinski. 2012. myPersonality project: Example of successful utilization of online social networks for large-scale social research. Proceedings of MobiSys (2012).
  53. H. Tamura, S. Mori, and T. Yamawaki. 1978. Texture features corresponding to visual perception. IEEE Trans. on Systems, Man and Cybernetics 8, 6 (1978), 460-473.
  54. Sharon Tettegah. 2016. Emotions, Technology, and Social Media. Academic Press.
  55. S. Utz. 2010. Show me your friends and I will tell you what type of person you are: How one's profile, number of friends, and type of friends influence impression formation on social network sites. Journal of Computer-Mediated Communication 15, 2 (2010), 314-335.
  56. Brandon Van Der Heide, Jonathan D D'Angelo, and Erin M Schumaker. 2012. The effects of verbal versus photographic self-presentation on impression formation in Facebook. Journal of Communication 62, 1 (2012), 98-116.
  57. S. Vazire and E.N. Carlson. 2011. Others sometimes know us better than we know ourselves. Current Directions in Psychological Science 20, 2 (2011), 104-108.
  58. Simine Vazire and Samuel D Gosling. 2004. e-Perceptions: personality impressions based on personal websites. Journal of Personality and Social Psychology 87, 1 (2004), 123.
  59. Andrea Vedaldi. 2007. An open implementation of the SIFT detector and descrip- tor. (2007).
  60. Alessandro Vinciarelli and Gelareh Mohammadi. 2014. A survey of personality computing. IEEE Transactions on Affective Computing 5, 3 (2014), 273-291.
  61. P. Viola and M. Jones. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings of IEEE CVPR. 511-518.
  62. Yen-Chun Jim Wu, Wei-Hung Chang, and Chih-Hung Yuan. 2014. Do Facebook profile pictures reflect user's personality? Computers in Human Behavior 51 (2014), 880-889.
  63. Wu Youyou, Michal Kosinski, and David Stillwell. 2015. Computer-based person- ality judgments are more accurate than those made by humans. PNAS (2015), 1-5.