"It Is Hard to Remove from My Eye": Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) Performers (2402.15719v1)
Abstract: Chinese traditional opera (Xiqu) performers often experience skin problems due to the long-term use of heavy-metal-laden face paints. To explore the current skincare challenges encountered by Xiqu performers, we conducted an online survey (N=136) and semi-structured interviews (N=15) as a formative study. We found that incomplete makeup removal is the leading cause of human-induced skin problems, especially the difficulty in removing eye makeup. Therefore, we proposed EyeVis, a prototype that can visualize the residual eye makeup and record the time make-up was worn by Xiqu performers. We conducted a 7-day deployment study (N=12) to evaluate EyeVis. Results indicate that EyeVis helps to increase Xiqu performers' awareness about removing makeup, as well as boosting their confidence and security in skincare. Overall, this work also provides implications for studying the work of people who wear makeup on a daily basis, and helps to promote and preserve the intangible cultural heritage of practitioners.
- Examples-rules guided deep neural network for makeup recommendation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 31.
- Multicomponent optical glasses with high refractive index. Glass and Ceramics 78 (2021), 3–7.
- Onur Asan and Avishek Choudhury. 2021. Research trends in artificial intelligence applications in human factors health care: mapping review. JMIR human factors 8, 2 (2021), e28236.
- China Theater Association. 2019. Current development of professional folk theatre troupes. https://www.chinatheatre.org.cn/jxhd/qgfc/201905/t20190507_444010.html. (Accessed on 07/15/2023).
- Tamara Attard and Everaldo Attard. 2022. Heavy metals in cosmetics. (2022).
- İlke Bahçeci Şimşek and Can Şirolu. 2021. Analysis of surgical outcome after upper eyelid surgery by computer vision algorithm using face and facial landmark detection. Graefe’s Archive for Clinical and Experimental Ophthalmology 259, 10 (2021), 3119–3125.
- Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT ’23). Association for Computing Machinery, New York, NY, USA, 1757–1771. https://doi.org/10.1145/3593013.3594114
- Assessing the value of silicone and hydrocolloid products in stoma care. British journal of nursing 16, 13 (2007), 778–788.
- Ultraviolet germicidal irradiation is effective against SARS-CoV-2 in contaminated makeup powder and lipstick. Journal of Photochemistry and Photobiology 8 (2021), 100072.
- Sylwia Borowska and Malgorzata M Brzóska. 2015. Metals in cosmetics: implications for human health. Journal of applied toxicology 35, 6 (2015), 551–572.
- Gary Bradski. 2000. The openCV library. Dr. Dobb’s Journal: Software Tools for the Professional Programmer 25, 11 (2000), 120–123.
- Marcia S Calkowski. 1991. A day at the Tibetan opera: actualized performance and spectacular discourse. American ethnologist 18, 4 (1991), 643–657.
- Skin characterizations by using contact capacitive imaging and high-resolution ultrasound imaging with machine learning algorithms. Applied Sciences 11, 18 (2021), 8714.
- Exploring a Makeup Support System for Transgender Passing Based on Automatic Gender Recognition. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 568, 13 pages. https://doi.org/10.1145/3411764.3445364
- Hangzhou Yixi Internet Technology Co. 2016. You Look Good Today - Take a photo to measure your skin quality and remove blackheads with scientific skincare. https://c2h4.org/. (Accessed on 08/04/2023).
- Catia Contado and Antonella Pagnoni. 2012. A new strategy for pressed powder eye shadow analysis: allergenic metal ion content and particle size distribution. Science of the total environment 432 (2012), 173–179.
- CVAT.ai Corporation. 2023. Computer Vision Annotation Tool (CVAT). https://doi.org/10.5281/zenodo.8239758
- Stage makeup. Routledge.
- Per-Erik Danielsson. 1980. Euclidean distance mapping. Computer Graphics and image processing 14, 3 (1980), 227–248.
- Reading Face, Reading Health: Exploring Face Reading Technologies for Everyday Health. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300435
- Bonnie Eisenman. 2015. Learning react native: Building native mobile apps with JavaScript. ” O’Reilly Media, Inc.”.
- Lisa Eldridge. 2015. Face paint: The story of makeup. Abrams.
- Eyelid gestures for people with motor impairments. Commun. ACM 65, 1 (2021), 108–115.
- Which eye tracker is right for your research? performance evaluation of several cost variant eye trackers. In Proceedings of the Human Factors and Ergonomics Society annual meeting, Vol. 60. SAGE Publications Sage CA: Los Angeles, CA, 1240–1244.
- Are opera-house artistes afflicted with contact allergy to colophony and cosmetics? Contact Dermatitis 32, 5 (1995), 273–280. https://doi.org/10.1111/j.1600-0536.1995.tb00780.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1600-0536.1995.tb00780.x
- Sean Gillies. 2013. The shapely user manual. URL https://pypi. org/project/Shapely (2013).
- VISIA system: a possible tool in the cosmetic practice. Journal of drugs in dermatology: JDD 13, 11 (2014), 1312–1314.
- Ziyan Guo. 2023. On the Application of Regional Features in Contemporary Dance Drama:–Taking the Dance Drama Shawan Past as an Example. Journal of Education and Educational Research 4, 1 (2023), 62–64.
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.
- Occupational health and the performing arts. Journal of Occupational and Environmental Medicine 59, 9 (2017), 843–858.
- Kasper Hornbæk. 2006. Current practice in measuring usability: Challenges to usability studies and research. International journal of human-computer studies 64, 2 (2006), 79–102.
- A cloud-based intelligent skin and scalp analysis system. In 2018 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1–5.
- EarthTones: Chemical Sensing Powders to Detect and Display Environmental Hazards through Color Variation. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 872–883. https://doi.org/10.1145/3027063.3052754
- DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 16–23.
- Chromoskin: Towards interactive cosmetics using thermochromic pigments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 3703–3706.
- Chemical analysis and risk assessment of prohibited colouring agents in face paint with special regard to CI 15585 (D&C Red No. 9, Pigment Red 53:1). International Journal of Cosmetic Science 37, 2 (2015), 187–195. https://doi.org/10.1111/ics.12181 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/ics.12181
- Segment anything. arXiv preprint arXiv:2304.02643 (2023).
- Allergic contact dermatitis from cosmetics. Dermatology 204, 4 (2002), 334–337.
- CS Lai. 1972. Lead poisoning as an occupational hazard in Chinese opera actors–a case report. Singapore medical journal 13, 2 (1972).
- Construction of an artificial intelligence system in dermatology: Effectiveness and consideration of Chinese Skin Image Database (CSID). Intelligent Medicine 1, 02 (2021), 56–60.
- “It Feels Like Taking a Gamble”: Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 266, 15 pages. https://doi.org/10.1145/3491102.3517490
- BeautyGAN: Instance-Level Facial Makeup Transfer with Deep Generative Adversarial Network. In Proceedings of the 26th ACM International Conference on Multimedia (Seoul, Republic of Korea) (MM ’18). Association for Computing Machinery, New York, NY, USA, 645–653. https://doi.org/10.1145/3240508.3240618
- Hsueh-Fang Liu. 1997. The Art of facial makeup in Chinese opera. (1997).
- Face Recognition on Point Cloud with Cgan-Top for Denoising. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1–5.
- An Intelligent Diagnostic Model for Melasma Based on Deep Learning and Multimode Image Input. Dermatology and Therapy 13, 2 (2023), 569–579.
- Grounding dino: Marrying dino with grounded pre-training for open-set object detection. arXiv preprint arXiv:2303.05499 (2023).
- Camillo Lugaresi and Jiuqiang Tang. 2019. Hadon Nash, Chris Mc-Clanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Guang Yong, Juhyun Lee, et al. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172 4 (2019), 15.
- Yasuhiro Matsumura and Honnavara N Ananthaswamy. 2004. Toxic effects of ultraviolet radiation on the skin. Toxicology and applied pharmacology 195, 3 (2004), 298–308.
- Effects of skin care and makeup under instructions from dermatologists on the quality of life of female patients with acne vulgaris. The Journal of Dermatology 33, 11 (2006), 745–752. https://doi.org/10.1111/j.1346-8138.2006.00174.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1346-8138.2006.00174.x
- Light, including ultraviolet. Journal of autoimmunity 34, 3 (2010), J247–J257.
- A systematic review of global legal regulations on the permissible level of heavy metals in cosmetics with particular emphasis on skin lightening products. Environmental research 170 (2019), 187–193.
- Review of sunscreen and the emergence of non-conventional absorbers and their applications in ultraviolet protection. International journal of cosmetic science 33, 5 (2011), 385–390.
- Remote Skincare Advice System Using Life Logs. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3811–3816. https://doi.org/10.1145/1753846.1754061
- Recent trends of sunscreen cosmetic: An update review. Cosmetics 6, 4 (2019), 64.
- Tam V. Nguyen and Luoqi Liu. 2017. Smart Mirror: Intelligent Makeup Recommendation and Synthesis. In Proceedings of the 25th ACM International Conference on Multimedia (Mountain View, California, USA) (MM ’17). Association for Computing Machinery, New York, NY, USA, 1253–1254. https://doi.org/10.1145/3123266.3127926
- Ayano Nishimura and Itiro Siio. 2014. IMake: Eye Makeup Design Generator. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (Funchal, Portugal) (ACE ’14). Association for Computing Machinery, New York, NY, USA, Article 20, 6 pages. https://doi.org/10.1145/2663806.2663823
- Ministry of Culture (PRC). 2018. A total of 348 local opera genres nationwide. https://www.gov.cn/xinwen/2018-01/02/content_5252331.htm. (Accessed on 07/15/2023).
- Julianne S Oktay. 2012. Grounded theory. Pocket Guide to Social Work Re.
- Michelle E Park and Jonathan H Zippin. 2014. Allergic contact dermatitis to cosmetics. Dermatologic clinics 32, 1 (2014), 1–11.
- Thies Pfeiffer and Cem Memili. 2016. Model-Based Real-Time Visualization of Realistic Three-Dimensional Heat Maps for Mobile Eye Tracking and Eye Tracking in Virtual Reality. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (Charleston, South Carolina) (ETRA ’16). Association for Computing Machinery, New York, NY, USA, 95–102. https://doi.org/10.1145/2857491.2857541
- Jo Riley. 1997. Chinese theatre and the actor in performance. Vol. 3. Cambridge University Press.
- ChAlPred: A web server for prediction of allergenicity of chemical compounds. Computers in Biology and Medicine 136 (2021), 104746.
- A Personalized Visual Aid for Selections of Appearance Building Products with Long-term Effects. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–18.
- Computer-aided diagnosis of psoriasis skin images with HOS, texture and color features: a first comparative study of its kind. Computer methods and programs in biomedicine 126 (2016), 98–109.
- Integrated “generate, make, and test” for formulated products using knowledge graphs. Data Intelligence 3, 3 (2021), 340–375.
- Smart healthcare: making medical care more intelligent. Global Health Journal 3, 3 (2019), 62–65.
- Makeup Creativity Enhancement with an Augmented Reality Face Makeup System. Comput. Entertain. 16, 4, Article 6 (nov 2018), 17 pages. https://doi.org/10.1145/3277452
- Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup Videos. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 108, 16 pages. https://doi.org/10.1145/3411764.3445721
- Jao Hsun Tseng and Po Hsien Lin. 2013. A Comparison of the Use of Painted Faces in the Peking Opera with the Use of Masks in Western Theater. In 2013 International Conference on the Modern Development of Humanities and Social Science. Atlantis Press, 304–308.
- Image-Based Skin Color and Texture Analysis/Synthesis by Extracting Hemoglobin and Melanin Information in the Skin. ACM Trans. Graph. 22, 3 (jul 2003), 770–779. https://doi.org/10.1145/882262.882344
- UNESCO. 2023. Browse the Lists of Intangible Cultural Heritage and the Register of good safeguarding practices - intangible heritage - Culture Sector - UNESCO. https://ich.unesco.org/en/lists. (Accessed on 07/15/2023).
- A Vakunov and D Lagun. 2020. MediaPipe Iris: Real-time Iris Tracking & Depth Estimation. (2020).
- Artificial Intelligence in Cosmetic Dermatology: A Systematic Literature Review. IEEE Access 11 (2023), 71407–71425. https://doi.org/10.1109/ACCESS.2023.3295001
- Heavy metals in face paints: Assessment of the health risks to Chinese opera actors. Science of The Total Environment 724 (2020), 138163.
- Insights into Health Risks of Face Paint Application to Opera Performers: The Release of Heavy Metals and Stage-Light-Induced Production of Reactive Oxygen Species. Environmental Science & Technology 57, 9 (2023), 3703–3712.
- Transcriptomics reveals key regulatory pathways and genes associated with skin diseases induced by face paint usage. Science of The Total Environment 890 (2023), 164374. https://doi.org/10.1016/j.scitotenv.2023.164374
- Cultural-based visual expression: emotional analysis of human face via Peking Opera Painted Faces (POPF). Multimedia Tools and Applications 75 (2016), 11865–11891.
- “Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 697, 18 pages. https://doi.org/10.1145/3411764.3445432
- The Importance Distribution of Drivers’ Facial Expressions Varies over Time!. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21 Adjunct). Association for Computing Machinery, New York, NY, USA, 148–151. https://doi.org/10.1145/3473682.3480283
- Investigation of oil-coloured dermatitis of the facial skin. Journal of Practical Medicine (1999).
- The research on cognition design in Chinese opera mask. In Cross-Cultural Design. Methods, Practice, and Case Studies: 5th International Conference, CCD 2013, Held as Part of HCI International 2013, Las Vegas, NV, USA, July 21-26, 2013, Proceedings, Part I 5. Springer, 493–502.
- Metagenomic sequencing analysis for acne using machine learning methods adapted to single or multiple data. Computational and Mathematical Methods in Medicine 2021 (2021).
- Huajing Xing. 2019. Category innovation for facial cleansing/makeup remover wipes using a holistic sensory and consumer research approach in a business environment. Ph. D. Dissertation.
- OperARtistry: An AR-based Interactive Application to Assist the Learning of Chinese Traditional Opera (Xiqu) Makeup. arXiv:2311.11269 [cs.HC]
- Face2Statistics: user-friendly, low-cost and effective alternative to in-vehicle sensors/monitors for drivers. In International Conference on Human-Computer Interaction. Springer, 289–308.
- BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfer. arXiv preprint arXiv:2212.05855 (2022).
- Development and validation of two artificial intelligence models for diagnosing benign, pigmented facial skin lesions. Skin Research and Technology 27, 1 (2021), 74–79.
- Convolutional neural networks-based method for skin hydration measurements in high resolution MRI. Biomedical Signal Processing and Control 81 (2023), 104491.
- Occupational Melanosis in Peking Opera Actors: A Report of Two Cases. Capital Public Health 12, 4 (2018), 189–190.
- Optimization-based cosmetic formulation: Integration of mechanistic model, surrogate model, and heuristics. AIChE Journal 67, 1 (2021), e17064.
- Hao Zhou and Sudhir P Mudur. 2007. 3D scan-based animation techniques for Chinese opera facial expression documentation. Computers & Graphics 31, 6 (2007), 788–799.