Has the Virtualization of the Face Changed Facial Perception? A Study of the Impact of Photo Editing and Augmented Reality on Facial Perception (2303.00612v3)
Abstract: Augmented reality and other photo editing filters are popular methods used to modify faces online. Considering the important role of facial perception in communication, how do we perceive this increasing number of modified faces? In this paper we present the results of six surveys that measure familiarity with different styles of facial filters, perceived strangeness of faces edited with different filters, and ability to discern whether images are filtered. Our results demonstrate that faces modified with more traditional face filters are perceived similarly to unmodified faces, and faces filtered with augmented reality filters are perceived differently from unmodified faces. We discuss possible explanations for these results, including a societal adjustment to traditional photo editing techniques or the inherent differences in the different types of filters. We conclude with a discussion of how to build online spaces more responsibly based on our results.
- Charles C Ballew and Alexander Todorov. 2007. Predicting political elections from rapid and unreflective face judgments. Proceedings of the National Academy of Sciences 104, 46 (2007), 17948–17953. https://doi.org/10.1073/pnas.0705435104
- In-group and Out-group Performance Bias in Facial Retouching Detection. In 2022 IEEE International Joint Conference on Biometrics (IJCB). IEEE, IEEE, Abu Dhabi, United Arab Emirates, 1–10. https://doi.org/10.1109/ISMAR52148.2021.00064
- The influence of Afrocentric facial features in criminal sentencing. Psychological science 15, 10 (2004), 674–679. https://doi.org/10.1111/j.0956-7976.2004.00739.x
- Looking deathworthy: Perceived stereotypicality of Black defendants predicts capital-sentencing outcomes. Psychological science 17, 5 (2006), 383–386. https://doi.org/10.1111/j.1467-9280.2006.01716.x
- Janella Eshiet. 2020. “REAL ME VERSUS SOCIAL MEDIA ME:” FILTERS, SNAPCHAT DYSMORPHIA, AND BEAUTY PERCEPTIONS AMONG YOUNG WOMEN. Master’s thesis. California State University, San Bernardino.
- Mirror, mirror on my phone: Drivers and consequences of selfie editing. Journal of Business Research 133 (2021), 365–375. https://doi.org/10.1016/j.jbusres.2021.05.002
- Fatima M Felisberti and Kristina Musholt. 2014. Self-face perception: Individual differences and discrepancies associated with mental self-face representation, attractiveness and self-esteem. Psychology & Neuroscience 7, 2 (2014), 65–72. https://doi.org/10.3922/j.psns.2014.013
- Ylva Ferstl and Rachel McDonnell. 2018. A perceptual study on the manipulation of facial features for trait portrayal in virtual agents. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. ACM, Sydney NSW Australia, 281–288. https://doi.org/10.1145/3267851.3267891
- Mirror, Mirror on My Phone: Investigating Dimensions of Self-Face Perception Induced by Augmented Reality Filters. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Bari, Italy, 470–478. https://doi.org/10.1109/ISMAR52148.2021.00064
- Rosalind Gill. 2021. Changing the perfect picture: Smartphones, social media and appearance pressures. https://www.city.ac.uk/__data/assets/pdf_file/0005/597209/Parliament-Report-web.pdf
- The distributed human neural system for face perception. Trends in cognitive sciences 4, 6 (2000), 223–233. https://doi.org/10.1016/s1364-6613(00)01482-0
- Elle Hunt. 2019. Faking it: How selfie dysmorphia is driving people to seek surgery. https://www.theguardian.com/lifeandstyle/2019/jan/23/faking-it-how-selfie-dysmorphia-is-driving-people-to-seek-surgery
- Team INDE. 2020. The brief history of social media augmented reality filters - inde - the world leader in augmented reality. https://www.indestry.com/blog/the-brief-history-of-social-media-ar-filters
- ‘What lies behind the filter?’Uncovering the motivations for using augmented reality (AR) face filters on social media and their effect on well-being. Computers in Human Behavior 128 (2022), 107126. https://doi.org/10.1016/j.chb.2021.107126
- Augmented self-The effects of virtual face augmentation on consumers’ self-concept. Journal of Business research 130 (2021), 170–187. https://doi.org/10.1016/j.jbusres.2021.03.026
- Ana Javornik and Marta Pizzetti. 2017. Mirror Mirror on the Wall, Who Is Real of Them All? - the Role of Augmented Self, Expertise and Personalisation in the Experience With Augmented Reality Mirror. ACR North American Advances (2017). https://api.semanticscholar.org/CorpusID:67114806
- Seung-A Annie Jin. 2012. The virtual malleable self and the virtual identity discrepancy model: Investigative frameworks for virtual possible selves and others in avatar-based identity construction and social interaction. Computers in Human Behavior 28, 6 (2012), 2160–2168. https://doi.org/10.1016/j.chb.2012.06.022
- Christine Lavrence and Carolina Cambre. 2020. “Do I Look Like My Selfie?”: Filters and the Digital-Forensic Gaze. Social Media + Society 6, 4 (2020). https://doi.org/10.1177/2056305120955182
- Facial appearance affects voting decisions. Evolution and Human Behavior 28, 1 (2007), 18–27. https://doi.org/10.1016/j.evolhumbehav.2006.09.002
- Predicting first impressions with deep learning. In 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017). IEEE, IEEE, Washington, DC, USA, 518–525. https://doi.org/10.1109/FG.2017.147
- Nikolaas N Oosterhof and Alexander Todorov. 2008. The functional basis of face evaluation. Proceedings of the National Academy of Sciences 105, 32 (2008), 11087–11092. https://doi.org/10.1073/pnas.0805664105
- Structural aspects of face recognition and the other-race effect. Memory & Cognition 22 (1994), 208–224. https://doi.org/10.3758/BF03208892
- Social perception of self-enhanced photographs. Facial Plastic Surgery 38, 03 (2022), 279–284.
- Altman Yuzhu Peng. 2020. Alipay adds “beauty filters” to face-scan payments: a form of patriarchal control over women’s bodies. Feminist Media Studies 20, 4 (2020), 582–585. https://doi.org/10.1080/14680777.2020.1750779
- Overview of the face recognition grand challenge. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), Vol. 1. IEEE, IEEE, San Diego, CA, USA, 947–954. https://doi.org/10.1109/CVPR.2005.268
- FRVT 2006 and ICE 2006 large-scale results. National Institute of Standards and Technology, NISTIR 7408, 1 (2007), 1. https://doi.org/10.1109/TPAMI.2009.59
- Laura Pitcher. 2020. Instagram Filters are Changing the Way We Think About Makeup. https://www.teenvogue.com/story/instagram-filters-makeup
- Impact of face proportions on face attractiveness. Journal of cosmetic dermatology 17, 6 (2018), 954–959. https://doi.org/10.1111/jocd.12783
- Fitting the mind to the world: Face adaptation and attractiveness aftereffects. Psychological science 14, 6 (2003), 558–566. https://doi.org/10.1046/j.0956-7976.2003.psci_1465.x
- Tate Ryan-Mosley. 2021. Beauty filters are changing the way young girls see themselves. https://www.technologyreview.com/2021/04/02/1021635/beauty-filters-young-girls-augmented-reality-social-media/
- Esther Shein. 2021. Filtering for beauty. Commun. ACM 64, 11 (Nov 2021), 17–19. https://doi.org/10.1145/3484997
- Inferences of competence from faces predict election outcomes. Science 308, 5728 (2005), 1623–1626. https://doi.org/10.1126/science.1110589
- Evaluating faces on trustworthiness after minimal time exposure. Social cognition 27, 6 (2009), 813–833. https://doi.org/10.1521/soco.2009.27.6.813
- Janine Willis and Alexander Todorov. 2006. First impressions: Making up your mind after a 100-ms exposure to a face. Psychological science 17, 7 (2006), 592–598. https://doi.org/10.1111/j.1467-9280.2006.01750.x
- Eric Wilson. 2009. Smile and Say ‘No Photoshop’. The New York Times (May 2009). https://www.nytimes.com/2009/05/28/fashion/28RETOUCH.html
- Mark Yi-Cheon Yim and Sun-Young Park. 2019. “I am not satisfied with my body, so I like augmented reality (AR)”: Consumer responses to AR-based product presentations. Journal of Business Research 100 (Jul 2019), 581–589. https://doi.org/10.1016/j.jbusres.2018.10.041