Probablement, Wahrscheinlich, Likely ? A Cross-Language Study of How People Verbalize Probabilities in Icon Array Visualizations (2207.09608v3)
Abstract: Visualizations today are used across a wide range of languages and cultures. Yet the extent to which language impacts how we reason about data and visualizations remains unclear. In this paper, we explore the intersection of visualization and language through a cross-language study on estimative probability tasks with icon-array visualizations. Across Arabic, English, French, German, and Mandarin, n = 50 participants per language both chose probability expressions - e.g. likely, probable - to describe icon-array visualizations (Vis-to-Expression), and drew icon-array visualizations to match a given expression (Expression-to-Vis). Results suggest that there is no clear one-to-one mapping of probability expressions and associated visual ranges between languages. Several translated expressions fell significantly above or below the range of the corresponding English expressions. Compared to other languages, French and German respondents appear to exhibit high levels of consistency between the visualizations they drew and the words they chose. Participants across languages used similar words when describing scenarios above 80% chance, with more variance in expressions targeting mid-range and lower values. We discuss how these results suggest potential differences in the expressiveness of language as it relates to visualization interpretation and design goals, as well as practical implications for translation efforts and future studies at the intersection of languages, culture, and visualization. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/g5d4r/.
- Let’s Gamble: Uncovering the Impact of Visualization on Risk Perception and Decision-Making. Computing Research Repository (CoRR), abs/1910.09725, 2019.
- S. Barclay et al. Handbook for decisions analysis. 1977.
- Do Cross-Cultural Differences in Visual Attention Patterns Affect Search Efficiency on Websites? In CHI ’21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yokohama, Japan, May 8-13, 2021, pp. 362:1–362:12. ACM, 2021. doi: 10 . 1145/3411764 . 3445519
- Do You Mean What You Say? The Effect of Uncertainty Avoidance on the Interpretation of Probability Expressions-A Comparative Study between Spanish and German. In Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 35. cognitivesciencesociety.org, 2013.
- Communicating Numerical Risk: Human Factors That Aid Understanding in Health Care. Reviews of Human Factors and Ergonomics, 8(1):235–276, 2013. doi: 10 . 1177/1557234X13492980
- The Interpretation of IPCC Probabilistic Statements around the World. Nature Climate Change, 4(6):508–512, 2014. doi: 10 . 1038/nclimate2194
- Consistency in Interpretation of Probabilistic Phrases. Organizational behavior and human decision processes, 36(3):391–405, 1985.
- W. S. Cleveland and R. McGill. Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. Journal of the American statistical association, 79(387):531–554, 1984.
- The Influence of Conservatism and Secrecy on the Interpretation of Verbal Probability Expressions in the Anglo and Latin Cultural Areas. The International Journal of Accounting, 41(3):237–261, 2006.
- T. S. Doupnik and M. Richter. Interpretation of Uncertainty Expressions: a Cross-national Study. Accounting, Organizations and Society, 28(1):15–35, 2003. doi: 10 . 1016/S0361-3682(02)00010-7
- T. S. Doupnik and M. Richter. The Impact of Culture on the Interpretation of “In Context” Verbal Probability Expressions. Journal of International Accounting Research, 3(1):1–20, 2004. doi: 10 . 2308/jiar . 2004 . 3 . 1 . 1
- P. Dragicevic. Fair Statistical Communication in HCI. In Modern statistical methods for HCI, pp. 291–330. Springer, 2016.
- V. Evers. Cross-Cultural Understanding of Metaphors in Interface Design. Proceedings CATAC’98, Cultural Attitudes towards Technology and Communication, pp. 1–11, 1998.
- J. L. Fleiss. Measuring Nominal Scale Agreement among Many Raters. Psychological bulletin, 76(5):378, 1971.
- O. Fuhrman and L. Boroditsky. Cross-Cultural Differences in Mental Representations of Time: Evidence from an Implicit Nonlinguistic Task. Cognitive science, 34(8):1430–1451, 2010.
- Using Icon Arrays to Communicate Medical Risks: Overcoming Low Numeracy. Health Psychology, 28(2):210–216, 2009. doi: 10 . 1037/a0014474
- R. Garcia-Retamero and M. Galesic. Communicating Treatment Risk Reduction to People with Low Numeracy Skills: A Cross-Cultural Comparison. American Journal of Public Health, 99(12):2196–2202, 2009. doi: 10 . 2105/AJPH . 2009 . 160234
- R. Garcia-Retamero and M. Galesic. Who Profits from Visual Aids: Overcoming Challenges in People’s Understanding of Risks. Social Science and Medicine, 70(7):1019–1025, 2010. doi: 10 . 1016/j . socscimed . 2009 . 11 . 031
- Color Naming Across Languages Reflects Color Use. Proceedings of the National Academy of Sciences, 114(40):10785–10790, 2017.
- G. Gigerenzer and U. Hoffrage. How to Improve Bayesian Reasoning without Instruction: Frequency Formats. Psychological Review, 102(4):684–704, 1995. doi: 10 . 1037/0033-295X . 102 . 4 . 684
- R. Henkin and C. Turkay. Words of Estimative Correlation: Studying Verbalizations of Scatterplots. CoRR, abs/1911.12793, 2019.
- When (ish) is my Bus? User-Centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems. Conference on Human Factors in Computing Systems - Proceedings, pp. 5092–5103, 2016. doi: 10 . 1145/2858036 . 2858558
- S. Kent. Words of Estimative Probability. Journal of the American Intelligence Professional, 8(4):49–65, 1964.
- Color Names Across Languages: Salient Colors and Term Translation in Multilingual Color Naming Models. In EuroVis (Short Papers), pp. 31–35, 2019.
- Frames and slants in titles of visualizations on controversial topics. In Proceedings of the 2018 CHI conference on human factors in computing systems, pp. 1–12, 2018.
- High Numerates Count Icons and Low Numerates Process Large Areas in Pictographs: Results of an Eye-Tracking Study. Risk Analysis, 36(8):1599–1614, 2016. doi: 10 . 1111/risa . 12531
- D. Leclercq. J’en Suis Aussi Sûr que Vous, Mais pas avec le Même Pourcentage de Chances, que ce Soit Hors Contexte ou En Contexte. Journal international de Recherche en Education et Formation Evaluer. Journal international de Recherche en Education et Formation, 2(21):89–125, 2016.
- World Color Survey Color Naming Reveals Universal Motifs and their Within-Language Diversity. Proceedings of the National Academy of Sciences of the United States of America, 106(47):19785–19790, 2009. doi: 10 . 1073/pnas . 0910981106
- Reliability and Inter-Rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 2019. doi: 10 . 1145/3359174
- F. Mosteller and C. Youtz. Quantifying Probabilistic Expressions. Statistical Science, 5(1):2–12, 1990. doi: 10 . 1214/ss/1177012242
- Improving Risk Understanding across Ability Levels: Encouraging Active Processing with Dynamic Icon Arrays. Journal of Experimental Psychology: Applied, 21(2):178–194, 2015. doi: 10 . 1037/xap0000045
- Improving Bayesian Reasoning: The Effects of Phrasing, Visualization, and Spatial Ability. IEEE Transactions on Visualization and Computer Graphics, 22(1):529–538, 2016. doi: 10 . 1109/TVCG . 2015 . 2467758
- A Review of Uncertainty Visualization Errors: Working Memory as an Explanatory Theory. The Psychology of Learning and Motivation, p. 275, 2021.
- Uncertainty Visualization. Handbook of Computational Statistics and Data Science, 2020.
- Data is Personal: Attitudes and Perceptions of Data Visualization in Rural Pennsylvania. arXiv, pp. 1–12, 2019.
- Quantitative Meanings of Verbal Probability Expressions. Journal of Applied Psychology, 74(3):433–442, 1989. doi: 10 . 1037/0021-9010 . 74 . 3 . 433
- K. Reinecke and K. Z. Gajos. LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW 2015, Vancouver, BC, Canada, March 14 - 18, 2015, pp. 1364–1378. ACM, 2015. doi: 10 . 1145/2675133 . 2675246
- S. Renooij and C. Witteman. Talking probabilities: Communicating probabilistic information with words and numbers. International Journal of Approximate Reasoning, 22(3):169–194, 1999. doi: 10 . 1016/S0888-613X(99)00027-4
- C. A. Sanne Willems and I. S. Verbal. Variability in the Interpretation of Probability Phrases Used in Dutch News Articles — a Risk for Miscommunication. Orphanet Journal of Rare Diseases, 21(1):1–9, 2020.
- Frequency or Probability? A Qualitative Study of Risk Communication Formats Used in Health Care. Medical Decision Making, 21(6):459–467, 2001.
- Visualizing Uncertainty about the Future. Science, 333(6048):1393–1400, 2011. doi: 10 . 1126/science . 1191181
- How WEIRD is HCI? Extending HCI Principles to Other Countries and Cultures. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, vol. 18, pp. 2425–2428, 2015. doi: 10 . 1145/2702613 . 2702656
- Four Experiments on the Perception of Bar Charts. IEEE transactions on visualization and computer graphics, 20(12):2152–2160, 2014.
- C. Till. Fostering Risk Literacy in Elementary School. International Electronic Journal of Mathematics Education, 9(1-2):85–98, 2014.
- Probability Information in Risk Communication: A Review of the Research Literature. Risk Analysis, 29(2):267–287, 2009. doi: 10 . 1111/j . 1539-6924 . 2008 . 01137 . x
- Measuring the Vague Meanings of Probability Terms. Journal of Experimental Psychology: General, 115(4):348–365, 1986. doi: 10 . 1037/0096-3445 . 115 . 4 . 348
- H. Winschiers-Theophilus and N. J. Bidwell. Toward an Afro-Centric Indigenous HCI Paradigm. International Journal of Human-Computer Interaction, 29(4):243–255, 2013.
- Verbal Probabilities: Very Likely to be Somewhat More Confusing than Numbers. PLoS ONE, 14(4):1–18, 2019. doi: 10 . 1371/journal . pone . 0213522
- Investigating perceptual biases in icon arrays. In CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2022.
- Blocks, Ovals, or People? Icon Type affects Risk perceptions and Recall of Pictographs. Medical Decision Making, 34(4):443–453, 2014. doi: 10 . 1177/0272989X13511706