Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Intelligent Canvas: Enabling Design-Like Exploratory Visual Data Analysis with Generative AI through Rapid Prototyping, Iteration and Curation (2402.08812v3)

Published 13 Feb 2024 in cs.HC and cs.AI

Abstract: Complex data analysis inherently seeks unexpected insights through exploratory visual analysis methods, transcending logical, step-by-step processing. However, existing interfaces such as notebooks and dashboards have limitations in exploration and comparison for visual data analysis. Addressing these limitations, we introduce a "design-like" intelligent canvas environment integrating generative AI into data analysis, offering rapid prototyping, iteration, and comparative visualization management. Our dual contributions include the integration of generative AI components into a canvas interface, and empirical findings from a user study (N=10) evaluating the effectiveness of the canvas interface.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. VANDE MOERE Andrew. [n.d.]. The Symbiosis between Design and Information Visualization. ([n. d.]).
  2. Space to Think: Large High-resolution Displays for Sensemaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10). ACM, New York, NY, USA, 55–64. https://doi.org/10.1145/1753326.1753336
  3. Rudolf Arnheim. 2023. Visual thinking. Univ of California Press.
  4. Leilani Battle and Jeffrey Heer. 2019. Characterizing Exploratory Visual Analysis: A Literature Review and Evaluation of Analytic Provenance in Tableau. Computer Graphics Forum 38, 3 (June 2019), 145–159. https://doi.org/10.1111/cgf.13678
  5. Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. ACM, San Francisco CA USA, 1–14. https://doi.org/10.1145/3586183.3606725
  6. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
  7. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs] (June 2020). http://arxiv.org/abs/2005.14165 00030 arXiv: 2005.14165.
  8. VisTrails: visualization meets data management. In Proceedings of the 2006 ACM SIGMOD international conference on Management of data. ACM, Chicago IL USA, 745–747. https://doi.org/10.1145/1142473.1142574
  9. What’s Wrong with Computational Notebooks? Pain Points, Needs, and Design Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–12. https://doi.org/10.1145/3313831.3376729
  10. WHATSNEXT: Guidance-enriched Exploratory Data Analysis with Interactive, Low-Code Notebooks. ([n. d.]).
  11. Evaluating Large Language Models Trained on Code. http://arxiv.org/abs/2107.03374 arXiv:2107.03374 [cs].
  12. The Effect of Parallel Prototyping on Design Performance, Learning, and Self-Efficacy. Technical Report September. Stanford University, Palo Alto, CA.
  13. Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-efficacy. ACM Trans. Comput.-Hum. Interact. 17, 4 (Dec. 2010), 18:1–18:24. https://doi.org/10.1145/1879831.1879836
  14. The efficacy of prototyping under time constraints. ([n. d.]).
  15. Analysis of complex, multidimensional datasets. Drug Discovery Today: Technologies 3, 1 (March 2006), 13–19. https://doi.org/10.1016/j.ddtec.2006.03.010
  16. How Information Visualization Novices Construct Visualizations. IEEE Transactions on Visualization and Computer Graphics 16, 6 (Nov. 2010), 943–952. https://doi.org/10.1109/TVCG.2010.164
  17. Understanding and Supporting Debugging Workflows in Multiverse Analysis. http://arxiv.org/abs/2210.03804 arXiv:2210.03804 [cs].
  18. Causalvis: Visualizations for Causal Inference. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–20. https://doi.org/10.1145/3544548.3581236
  19. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–13. https://doi.org/10.1145/3173574.3173593
  20. Direct Manipulation Interfaces. ([n. d.]).
  21. Challenges in Visual Data Analysis. In Tenth International Conference on Information Visualisation (IV’06). IEEE, London, England, 9–16. https://doi.org/10.1109/IV.2006.31
  22. Strategies of Free-Form Web Curation: Processes of Creative Engagement with Prior Work. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C ’17). ACM, New York, NY, USA, 380–392. https://doi.org/10.1145/3059454.3059471
  23. The Story in the Notebook: Exploratory Data Science using a Literate Programming Tool. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–11. https://doi.org/10.1145/3173574.3173748
  24. An exploratory study of how abundant display space may support data analysis. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, Copenhagen Denmark, 558–567. https://doi.org/10.1145/2399016.2399102
  25. Boba: Authoring and Visualizing Multiverse Analyses. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb. 2021), 1753–1763. https://doi.org/10.1109/TVCG.2020.3028985
  26. Patterns of Free-form Curation: Visual Thinking with Web Content. In Proceedings of the 24th ACM international conference on Multimedia. ACM, Amsterdam The Netherlands, 12–21. https://doi.org/10.1145/2964284.2964303 00030.
  27. Freeform Templates: Combining Freeform Curation with Structured Templates. In Creativity and Cognition. 478–488. https://doi.org/10.1145/3591196.3593337 arXiv:2305.00937 [cs].
  28. A Framework for Visual Information Analysis. ([n. d.]).
  29. J. Nielsen. 1993. Iterative user-interface design. Computer 26, 11 (Nov. 1993), 32–41. https://doi.org/10.1109/2.241424
  30. The Cost Structure of Sensemaking. In Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems (CHI ’93). ACM, New York, NY, USA, 269–276. https://doi.org/10.1145/169059.169209
  31. multiverse: Multiplexing Alternative Data Analyses in R Notebooks. preprint. Open Science Framework. https://doi.org/10.31219/osf.io/yfbwm
  32. Arvind Satyanarayan and Jeffrey Heer. 2014. Lyra: An Interactive Visualization Design Environment. Computer Graphics Forum 33, 3 (June 2014), 351–360. https://doi.org/10.1111/cgf.12391
  33. Provenance for Visualizations: Reproducibility and Beyond. Computing in Science & Engineering 9, 5 (Sept. 2007), 82–89. https://doi.org/10.1109/MCSE.2007.106
  34. Using Visual Representations of Data to Enhance Sensemaking in Data Exploration Tasks. Journal of the Association for Information Systems 10, 7 (July 2009), 533–559. https://doi.org/10.17705/1jais.00204
  35. Romain Vuillemot and Jeremy Boy. 2018. Structuring Visualization Mock-Ups at the Graphical Level by Dividing the Display Space. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan. 2018), 424–434. https://doi.org/10.1109/TVCG.2017.2743998
  36. Stickyland: Breaking the linear presentation of computational notebooks. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
  37. Fork It: Supporting Stateful Alternatives in Computational Notebooks. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–12. https://doi.org/10.1145/3411764.3445527
  38. Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations. IEEE Transactions on Visualization and Computer Graphics 22, 1 (Jan. 2016), 649–658. https://doi.org/10.1109/TVCG.2015.2467191
  39. Voyager 2: Augmenting Visual Analysis with Partial View Specifications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 2648–2659. https://doi.org/10.1145/3025453.3025768
  40. B2: Bridging Code and Interactive Visualization in Computational Notebooks. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM, Virtual Event USA, 152–165. https://doi.org/10.1145/3379337.3415851
  41. Lyra 2: Designing Interactive Visualizations by Demonstration. http://arxiv.org/abs/2008.09576 arXiv:2008.09576 [cs].
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets