Deceptive, Disruptive, No Big Deal: Japanese People React to Simulated Dark Commercial Patterns (2405.08831v1)
Abstract: Dark patterns and deceptive designs (DPs) are user interface elements that trick people into taking actions that benefit the purveyor. Such designs are widely deployed, with special varieties found in certain nations like Japan that can be traced to global power hierarchies and the local socio-linguistic context of use. In this breaking work, we report on the first user study involving Japanese people (n=30) experiencing a mock shopping website injected with simulated DPs. We found that Alphabet Soup and Misleading Reference Pricing were the most deceptive and least noticeable. Social Proofs, Sneaking in Items, and Untranslation were the least deceptive but Untranslation prevented most from cancelling their account. Mood significantly worsened after experiencing the website. We contribute the first empirical findings on a Japanese consumer base alongside a scalable approach to evaluating user attitudes, perceptions, and behaviours towards DPs in an interactive context. We urge for more human participant research and ideally collaborations with industry to assess real designs in the wild.
- When to ask participants to think aloud: A comparative study of concurrent and retrospective think-aloud methods. International Journal of Human Computer Interaction 6, 3 (2015), 48–64.
- An empirical evaluation of the System Usability Scale. International Journal of Human–Computer Interaction 24, 6 (2008), 574–594. https://doi.org/10.1080/10447310802205776
- Cookie Disclaimers: Impact of Design and Users’ Attitude. In Proceedings of the 17th International Conference on Availability, Reliability and Security (Vienna, Austria) (ARES ’22). ACM, New York, NY, USA, Article 12, 20 pages. https://doi.org/10.1145/3538969.3539008
- This Website Uses Nudging: MTurk Workers’ Behaviour on Cookie Consent Notices. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2, Article 346 (oct 2021), 22 pages. https://doi.org/10.1145/3476087
- Qualitative HCI Research: Going Behind the Scenes. Morgan & Claypool Publishers, Kentfield, CA, USA.
- A 61-million-person experiment in social influence and political mobilization. Nature 489, 7415 (2012), 295–298. https://www.nature.com/articles/nature11421
- Analysing the Influence of Loss-Gain Framing on Data Disclosure Behaviour: A Study on the Use Case of App Permission Requests. In Proceedings of the 2023 European Symposium on Usable Security (Copenhagen, Denmark) (EuroUSEC ’23). ACM, New York, NY, USA, 112–125. https://doi.org/10.1145/3617072.3617108
- “So I sold my soul”: Effects of dark patterns in cookie notices on end-user behavior and perceptions. In Workshop on Usable Security and Privacy (USEC) (San Diego, CA, USA), Vol. 3. HATS, Bloomintgton, IN, USA, 11 pages. https://doi.org/10.14722/usec.2022.23026
- Tales from the dark side: Privacy dark strategies and privacy dark patterns. Proceedings on Privacy Enhancing Technologies 2016, 4 (2016), 237–254. https://doi.org/10.1515/popets-2016-0038
- Margaret M. Bradley and Peter J. Lang. 1994. Measuring emotion: The Self-Assessment Manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (1994), 49–59. https://www.sciencedirect.com/science/article/abs/pii/0005791694900639
- Exiting the cleanroom: On ecological validity and ubiquitous computing. Human–Computer Interaction 23, 1 (2008), 47–99. https://doi.org/10.1080/07370020701851086
- “Are You Still Watching?”: Exploring Unintended User Behaviors and Dark Patterns on Video Streaming Platforms. In Proceedings of the 2022 ACM Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). ACM, New York, NY, USA, 776–791. https://doi.org/10.1145/3532106.3533562
- Gregory Conti and Edward Sobiesk. 2010. Malicious Interface Design: Exploiting the User. In Proceedings of the 19th International Conference on World Wide Web (Raleigh, North Carolina, USA) (WWW ’10). ACM, New York, NY, USA, 271–280. https://doi.org/10.1145/1772690.1772719
- Dena Cox and Anthony D. Cox. 2002. Beyond first impressions: The effects of repeated exposure on consumer liking of visually complex and simple product designs. Journal of the Academy of Marketing Science 30, 2 (2002), 119–130. https://journals.sagepub.com/doi/abs/10.1177/03079459994371
- Lorrie Faith Cranor. 2022. Cookie Monster. Commun. ACM 65, 7 (June 2022), 30–32. https://doi.org/10.1145/3538639
- UI dark datterns and where to find them: A study on mobile applications and user perception. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376600
- #darkpatterns: UX Practitioner Conversations About Ethical Design. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada) (CHI EA ’18). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188553
- Analysis of Dark Pattern-related Tweets from 2010. In 2023 IEEE 8th International Conference on Big Data Analytics (ICBDA). IEEE, Piscataway, NJ, USA, 100–106. https://doi.org/10.1109/ICBDA57405.2023.10104855
- Dark and bright patterns in cookie consent requests. Journal of Digital Social Research 3, 1 (2021), 1–38. https://doi.org/10.33621/jdsr.v3i1.54
- Understanding “Dark” Design Roles in Computing Education. In Proceedings of the 17th ACM Conference on International Computing Education Research (Virtual Event, USA) (ICER 2021). ACM, New York, NY, USA, 225–238. https://doi.org/10.1145/3446871.3469754
- The Dark (Patterns) Side of UX Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada) (CHI ’18). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3174108
- Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23 Companion). ACM, New York, NY, USA, 188–193. https://doi.org/10.1145/3563703.3596635
- Dark Patterns and the Legal Requirements of Consent Banners: An Interaction Criticism Perspective. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA, Article 172, 18 pages. https://doi.org/10.1145/3411764.3445779
- A Comparative Study of Dark Patterns Across Web and Mobile Modalities. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2, Article 377 (oct 2021), 29 pages. https://doi.org/10.1145/3479521
- “Okay, whatever”’: An evaluation of cookie consent interfaces. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). ACM, New York, NY, USA, Article 621, 27 pages. https://doi.org/10.1145/3491102.3501985
- Brignull Harry. 2023. Deceptive Patterns: Exposing the Tricks Tech Companies Use to Control You. Testimonium Ltd, London, UK.
- The priming effect in task design research. Journal of Management 14, 1 (1988), 33–39. https://doi.org/10.1177/014920638801400104
- Fritz Heider. 2013. The Psychology of Interpersonal Relations. Psychology Press, London, UK.
- Linguistic Dead-Ends and Alphabet Soup: Finding Dark Patterns in Japanese Apps. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, New York, NY, USA, Article 3, 13 pages. https://doi.org/10.1145/3544548.3580942
- Gonzalo Iturregui-Gallardo and Jorge Luis Méndez-Ulrich. 2020. Towards the creation of a tactile version of the Self-Assessment Manikin (T-SAM) for the emotional assessment of visually impaired people. International Journal of Disability, Development and Education 67, 6 (2020), 657–674. https://doi.org/10.1080/1034912X.2019.1626007
- Investigating Deceptive Design in GDPR’s Legitimate Interest. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, New York, NY, USA, Article 583, 16 pages. https://doi.org/10.1145/3544548.3580637
- James R Lewis. 2018. The System Usability Scale: Past, present, and future. International Journal of Human–Computer Interaction 34, 7 (2018), 577–590. https://doi.org/10.1080/10447318.2018.1455307
- Jamie Luguri and Lior Jacob Strahilevitz. 2021. Shining a light on dark patterns. Journal of Legal Analysis 13, 1 (2021), 43–109. https://doi.org/10.1093/jla/laaa006
- Towards the Identification of Dark Patterns: An Analysis Based on End-User Reactions. In Proceedings of the 11th Indian Conference on Human-Computer Interaction (Online, India) (IndiaHCI ’20). ACM, New York, NY, USA, 24–33. https://doi.org/10.1145/3429290.3429293
- Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites. Proceedings of the ACM on Human–Computer Interaction 3, CSCW, Article 81 (nov 2019), 32 pages. https://doi.org/10.1145/3359183
- What Makes a Dark Pattern… Dark? Design Attributes, Normative Considerations, and Measurement Methods. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA, Article 360, 18 pages. https://doi.org/10.1145/3411764.3445610
- Iris B. Mauss and Michael D. Robinson. 2009. Measures of emotion: A review. Cognition & Emotion 23, 2 (Feb. 2009), 209–237. https://doi.org/10.1080/02699930802204677
- Dale T. Miller and Michael Ross. 1975. Self-serving biases in the attribution of causality: Fact or fiction? Psychological Bulletin 82, 2 (1975), 213.
- Alberto Monge Roffarello and Luigi De Russis. 2022. Towards Understanding the Dark Patterns That Steal Our Attention. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). ACM, New York, NY, USA, Article 274, 7 pages. https://doi.org/10.1145/3491101.3519829
- Dmitry Nazarov and Yerkebulan Baimukhambetov. 2022. Clustering of Dark Patterns in the User Interfaces of Websites and Online Trading Portals (E-Commerce). Mathematics 10, 18 (2022), 3219. https://doi.org/10.3390/math10183219
- OECD. 2022. Dark commercial patterns. Number 336 in OECD Digital Economy Papers. OECD Publishing, Paris, France. 96 pages. https://doi.org/10.1787/44f5e846-en
- OECD. 2023. Consumer Vulnerability in the Digital Age. Number 355 in OECD Digital Economy Papers. OECD Publishing, Paris, France. 80 pages. https://doi.org/10.1787/4d013cc5-en
- Investigating Visual Countermeasures Against Dark Patterns in User Interfaces. In Proceedings of Mensch Und Computer 2023 (Rapperswil, Switzerland) (MuC ’23). ACM, New York, NY, USA, 161–172. https://doi.org/10.1145/3603555.3603563
- Circumvention by design - Dark patterns in cookie consent for online news outlets. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI ‘20). ACM, New York, NY, USA, Article 19, 12 pages. https://doi.org/10.1145/3419249.3420132
- Human Factors Methods: A Practical Guide for Engineering and Design. CRC Press, Boca Raton, Florida, USA.
- Nicolaos E. Synodinos. 2001. Understanding Japanese consumers: Some important underlying factors. Japanese Psychological Research 43, 4 (Nov. 2001), 235–248. https://doi.org/10.1111/1468-5884.00181
- (Un)Informed Consent: Studying GDPR Consent Notices in the Field. In Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security (London, United Kingdom) (CCS ’19). ACM, New York, NY, USA, 973–990. https://doi.org/10.1145/3319535.3354212
- Retrospective vs. concurrent think-aloud protocols: Testing the usability of an online library catalogue. Behaviour & Information Technology 22, 5 (2003), 339–351. https://doi.org/10.1080/0044929031000
- Christof van Nimwegen and Jesse de Wit. 2022. Shopping in the dark: Effects of platform choice on dark pattern recognition. In International Conference on Human-Computer Interaction. Springer, London, UK, 462–475. https://doi.org/10.1007/978-3-031-05412-9_32
- Dark patterns in online shopping: Of sneaky tricks, perceived annoyance and respective brand trust. In International Conference on Human-Computer Interaction. Springer, London, UK, 143–155. https://link.springer.com/chapter/10.1007/978-3-030-77750-0_10
- Chauncey Wilson. 2014. Interview Techniques for UX Practitioners: A User-Centered Design Method. Morgan Kaufmann, Waltham, MA, USA.
- Dark patterns in e-commerce: A dataset and its baseline evaluations. In 2022 IEEE International Conference on Big Data (Big Data). IEEE, Piscataway, NJ, USA, 3015–3022. https://ieeexplore.ieee.org/document/10020800
- Shigeru Yamanouchi. 2015. エンジニアのための人を対象とする研究計画入門 (Introduction to Human Subjects Research Planning for Engineers). Maruzen, Tokyo, Japan, Chapter 科学的合理性と倫理的妥当性 (Scientific rationality and Ethical Relevance), 74–118.