A Typology of Decision-Making Tasks for Visualization (2404.08812v3)
Abstract: Despite decision-making being a vital goal of data visualization, little work has been done to differentiate decision-making tasks within the field. While visualization task taxonomies and typologies exist, they often focus on more granular analytical tasks that are too low-level to describe large complex decisions, which can make it difficult to reason about and design decision-support tools. In this paper, we contribute a typology of decision-making tasks that were iteratively refined from a list of design goals distilled from a literature review. Our typology is concise and consists of only three tasks: CHOOSE, ACTIVATE, and CREATE. Although decision types originating in other disciplines exist, we provide definitions for these tasks that are suitable for the visualization community. Our proposed typology offers two benefits. First, the ability to compose and hierarchically organize the tasks enables flexible and clear descriptions of decisions with varying levels of complexities. Second, the typology encourages productive discourse between visualization designers and domain experts by abstracting the intricacies of data, thereby promoting clarity and rigorous analysis of decision-making processes. We demonstrate the benefits of our typology through four case studies, and present an evaluation of the typology from semi-structured interviews with experienced members of the visualization community who have contributed to developing or publishing decision support systems for domain experts. Our interviewees used our typology to delineate the decision-making processes supported by their systems, demonstrating its descriptive capacity and effectiveness. Finally, we present preliminary findings on the usefulness of our typology for visualization design.
- Visual analytics decision support environment for epidemic modeling and response evaluation. In 2011 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 191–200, 2011. doi: 10 . 1109/VAST . 2011 . 6102457
- T. Alameldin and M. Shepley. New techniques in the design of healthcare facilities. In Proceedings Visualization ’94, pp. 374–377, 1994. doi: 10 . 1109/VISUAL . 1994 . 346293
- Low-level components of analytic activity in information visualization. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005., pp. 111–117. IEEE, 2005.
- Knowledge precepts for design and evaluation of information visualizations. IEEE Transactions on Visualization and Computer Graphics, 11(4):432–442, 2005.
- N. Andrienko and G. Andrienko. Exploratory analysis of spatial and temporal data: a systematic approach. Springer Science & Business Media, 2006.
- Using treemaps to visualize the analytic hierarchy process. Information Systems Research, 6(4):357–375, 1995.
- Stratos: Using visualization to support decisions in strategic software release planning. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, 10 pages, p. 1479–1488. Association for Computing Machinery, New York, NY, USA, 2015. doi: 10 . 1145/2702123 . 2702426
- Visualization of conflicts and resolutions in a "free flight" scenario. In Proceedings Visualization ’99 (Cat. No.99CB37067), pp. 433–557, 1999. doi: 10 . 1109/VISUAL . 1999 . 809923
- L. Battle and A. Ottley. What do we mean when we say “insight”? a formal synthesis of existing theory. IEEE Transactions on Visualization and Computer Graphics, 2023.
- M. Beaudouin-Lafon. Designing interaction, not interfaces. In Proceedings of the working conference on Advanced visual interfaces, pp. 15–22, 2004.
- Vismon: Facilitating analysis of trade-offs, uncertainty, and sensitivity in fisheries management decision making. In Computer Graphics Forum, vol. 31, pp. 1235–1244. Wiley Online Library, 2012.
- A handbook on multi-attribute decision-making methods. John Wiley & Sons, 2021.
- M. Brehmer and T. Munzner. A multi-level typology of abstract visualization tasks. 19(12):2376–2385. doi: 10 . 1109/TVCG . 2013 . 124
- G. Campitelli and F. Gobet. Herbert simon’s decision-making approach: Investigation of cognitive processes in experts. Review of general psychology, 14(4):354–364, 2010.
- Readings in information visualization: using vision to think. Morgan Kaufmann, 1999.
- Wirevis: Visualization of categorical, time-varying data from financial transactions. In 2007 IEEE symposium on visual analytics science and technology, pp. 155–162. IEEE, 2007.
- Scalable and interactive visual analysis of financial wire transactions for fraud detection. Information visualization, 7(1):63–76, 2008.
- Defining insight for visual analytics. IEEE Computer Graphics and Applications, 29(2):14–17, 2009.
- N. Chinchor and W. A. Pike. The science of analytic reporting. Information Visualization, 8(4):286–293, 2009.
- The attraction effect in information visualization. IEEE transactions on visualization and computer graphics, 23(1):471–480, 2016.
- Testing the Attraction Effect on Two Information Visualization Datasets. PhD thesis, Inria Saclay Ile de France, 2016.
- A task-based taxonomy of cognitive biases for information visualization. IEEE transactions on visualization and computer graphics, 26(2):1413–1432, 2018.
- E. Dimara and J. Stasko. A critical reflection on visualization research: Where do decision making tasks hide? 28(1):1128–1138. doi: 10 . 1109/TVCG . 2021 . 3114813
- The unmet data visualization needs of decision makers within organizations. IEEE Transactions on Visualization and Computer Graphics, 28(12):4101–4112, 2021.
- M. V. Dowling. Semantic Interaction for Symmetrical Analysis and Automated Foraging of Documents and Terms. PhD thesis, Virginia Tech, 2020.
- Urbane: A 3d framework to support data driven decision making in urban development. In 2015 IEEE conference on visual analytics science and technology (VAST), pp. 97–104. IEEE, 2015.
- B. Fischhoff and S. B. Broomell. Judgment and decision making. Annual review of psychology, 71:331–355, 2020.
- B. Fischhoff and A. L. Davis. Communicating scientific uncertainty. 111:13664–13671. doi: 10 . 1073/pnas . 1317504111
- My model is unfair, do people even care? visual design affects trust and perceived bias in machine learning. IEEE Transactions on Visualization and Computer Graphics, 2023.
- Lineup: Visual analysis of multi-attribute rankings. IEEE transactions on visualization and computer graphics, 19(12):2277–2286, 2013.
- Visualizing uncertainty and alternatives in event sequence predictions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI ’19, 12 pages, p. 1–12. Association for Computing Machinery, New York, NY, USA, 2019. doi: 10 . 1145/3290605 . 3300803
- Solving mcdm problems: Process concepts. Journal of Multi-Criteria Decision Analysis, 5(1):3–21, 1996.
- Towards rigorously designed preference visualizations for group decision making. In 2020 IEEE Pacific Visualization Symposium (PacificVis), pp. 181–190. IEEE, 2020.
- Examining limits of small multiples: Frame quantity impacts judgments with line graphs. IEEE Transactions on Visualization and Computer Graphics, 2024.
- Decision theoretic foundations for experiments evaluating human decisions. version: 1.
- Systematic methodological review: developing a framework for a qualitative semi-structured interview guide. Journal of advanced nursing, 72(12):2954–2965, 2016.
- Data transformations and representations for computation and visualization. Information Visualization, 8(4):275–285, 2009.
- Visual analytics: Definition, process, and challenges. Springer, 2008.
- Simple ranking method using reference profiles: incremental elicitation of the preference parameters. 4OR, pp. 1–32, 2022.
- Decision graph embedding for high-resolution manometry diagnosis. IEEE Transactions on Visualization and Computer Graphics, 24(1):873–882, 2017.
- Evaluating preference collection methods for interactive ranking analytics. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–11, 2019.
- Zooids: Building blocks for swarm user interfaces. In Proceedings of the 29th annual symposium on user interface software and technology, pp. 97–109, 2016.
- Formalizing visualization design knowledge as constraints: Actionable and extensible models in draco. IEEE transactions on visualization and computer graphics, 25(1):438–448, 2018.
- T. Munzner. Visualization analysis and design. CRC press, 2014.
- Understanding user behaviour through action sequences: From the usual to the unusual. IEEE Transactions on Visualization and Computer Graphics, 25(9):2838–2852, 2019. doi: 10 . 1109/TVCG . 2018 . 2859969
- Preference elicitation for a ranking method based on multiple reference profiles. 4OR, pp. 1–22, 2022.
- Decoupling judgment and decision making: A tale of two tails. IEEE Transactions on Visualization and Computer Graphics, 2023.
- From information to choice: A critical inquiry into visualization tools for decision making.
- Multiple forecast visualizations (mfvs): Trade-offs in trust and performance in multiple covid-19 forecast visualizations. IEEE transactions on visualization and computer graphics, 29(1):12–22, 2022.
- Impact of covid-19 forecast visualizations on pandemic risk perceptions. Scientific reports, 12(1):2014, 2022.
- Decision making with visualizations: a cognitive framework across disciplines. 3(1):29. doi: 10 . 1186/s41235-018-0120-9
- Weightlifter: Visual weight space exploration for multi-criteria decision making. IEEE transactions on visualization and computer graphics, 23(1):611–620, 2016.
- Sketching uncertainty into simulations. IEEE Transactions on Visualization and Computer Graphics, 18(12):2255–2264, 2012. doi: 10 . 1109/TVCG . 2012 . 261
- Finvis: Applied visual analytics for personal financial planning. In 2009 IEEE Symposium on Visual Analytics Science and Technology, pp. 195–202, 2009. doi: 10 . 1109/VAST . 2009 . 5333920
- Knowledge generation model for visual analytics. IEEE transactions on visualization and computer graphics, 20(12):1604–1613, 2014.
- Rationale visualization for safety and security. In Computer Graphics Forum, vol. 34, pp. 191–200. Wiley Online Library, 2015.
- How “applied” is fifteen years of VAST conference? In 2023 IEEE Visualization and Visual Analytics (VIS), pp. 121–125. IEEE. doi: 10 . 1109/VIS54172 . 2023 . 00033
- H. A. Simon. The new science of management decision. 1960.
- Litevis: integrated visualization for simulation-based decision support in lighting design. IEEE Transactions on Visualization and Computer Graphics, 22(1):290–299, 2015.
- K. Takemura. Behavioral decision theory. Springer, 2021.
- A visual analytics agenda. IEEE computer graphics and applications, 26(1):10–13, 2006.
- Comparative blood flow visualization for cerebral aneurysm treatment assessment. In Computer Graphics Forum, vol. 33, pp. 131–140. Wiley Online Library, 2014.
- Podium: Ranking data using mixed-initiative visual analytics. IEEE transactions on visualization and computer graphics, 24(1):288–297, 2017.
- A survey on ml4vis: Applying machine learning advances to data visualization. IEEE transactions on visualization and computer graphics, 28(12):5134–5153, 2021.
- Umbra: a visual analysis approach for defense construction against inference attacks on sensitive information. IEEE Transactions on Visualization and Computer Graphics, 28(7):2776–2790, 2020.
- Y. Wang and G. Ruhe. The cognitive process of decision making. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 1(2):73–85, 2007.
- C. Ware. Information visualization: perception for design. Morgan Kaufmann, 2019.
- World lines. IEEE Transactions on Visualization and Computer Graphics, 16(6):1458–1467, 2010. doi: 10 . 1109/TVCG . 2010 . 223
- Many plans: Multidimensional ensembles for visual decision support in flood management. In Computer Graphics Forum, vol. 33, pp. 281–290. Wiley Online Library, 2014.
- Many plans: Multidimensional ensembles for visual decision support in flood management. Computer Graphics Forum, 33(3):281–290, 2014. doi: 10 . 1111/cgf . 12384
- Towards better bus networks: A visual analytics approach. IEEE Transactions on Visualization and Computer Graphics, 27(2):817–827, 2021. doi: 10 . 1109/TVCG . 2020 . 3030458
- Homefinder revisited: Finding ideal homes with reachability-centric multi-criteria decision making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2018.
- Ai4vis: Survey on artificial intelligence approaches for data visualization. IEEE Transactions on Visualization and Computer Graphics, 28(12):5049–5070, 2021.
- Toward a deeper understanding of the role of interaction in information visualization. IEEE transactions on visualization and computer graphics, 13(6):1224–1231, 2007.
- Skylens: Visual analysis of skyline on multi-dimensional data. IEEE transactions on visualization and computer graphics, 24(1):246–255, 2017.
- Camelia D. Brumar (4 papers)
- Sam Molnar (1 paper)
- Gabriel Appleby (13 papers)
- Kristi Potter (2 papers)
- Remco Chang (31 papers)