DMiner: Dashboard Design Mining and Recommendation (2209.01599v2)
Abstract: Dashboards, which comprise multiple views on a single display, help analyze and communicate multiple perspectives of data simultaneously. However, creating effective and elegant dashboards is challenging since it requires careful and logical arrangement and coordination of multiple visualizations. To solve the problem, we propose a data-driven approach for mining design rules from dashboards and automating dashboard organization. Specifically, we focus on two prominent aspects of the organization: arrangement, which describes the position, size, and layout of each view in the display space; and coordination, which indicates the interaction between pairwise views. We build a new dataset containing 854 dashboards crawled online, and develop feature engineering methods for describing the single views and view-wise relationships in terms of data, encoding, layout, and interactions. Further, we identify design rules among those features and develop a recommender for dashboard design. We demonstrate the usefulness of DMiner through an expert study and a user study. The expert study shows that our extracted design rules are reasonable and conform to the design practice of experts. Moreover, a comparative user study shows that our recommender could help automate dashboard organization and reach human-level performance. In summary, our work offers a promising starting point for design mining visualizations to build recommenders.
- M. Q. Wang Baldonado, A. Woodruff, and A. Kuchinsky, “Guidelines for using multiple views in information visualization,” in Proceedings of the 2000 Working Conference on Advanced Visual Interfaces, 2000, pp. 110–119.
- C. Forsell and J. Johansson, “An heuristic set for evaluation in information visualization,” in Proceedings of the 2010 International Conference on Advanced Visual Interfaces, 2010, p. 199–206.
- R. Sadana and J. Stasko, “Designing multiple coordinated visualizations for tablets,” in Proceedings of the Computer Graphics Forum, vol. 35, no. 3, 2016, pp. 261–270.
- R. Chen, X. Shu, J. Chen, D. Weng, J. Tang, S. Fu, and Y. Wu, “Nebula: a coordinating grammar of graphics,” IEEE Transactions on Visualization and Computer Graphics, 2021 (Early access).
- “Tableau,” https://help.tableau.com/current/pro/desktop/en-us/gettingstarted_overview.htm, [Online; accessed 2022-08-23].
- “Data Visualization | Microsoft Power BI,” https://powerbi.microsoft.com/en-us/, [Online; accessed 2022-08-23].
- A. Wu, Y. Wang, M. Zhou, X. He, H. Zhang, H. Qu, and D. Zhang, “MultiVision: Designing analytical dashboards with deep learning based recommendation,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 1, pp. 162–172, 2021.
- A. Sarikaya, M. Correll, L. Bartram, M. Tory, and D. Fisher, “What do we talk about when we talk about dashboards?” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 682–692, 2018.
- B. Saket, D. Moritz, H. Lin, V. Dibia, C. Demiralp, and J. Heer, “Beyond heuristics: Learning visualization design,” arXiv preprint arXiv:1807.06641, 2018.
- “Github,” https://github.com, [Online; accessed 2022-08-24].
- J. C. Roberts, “State of the art: Coordinated & multiple views in exploratory visualization,” in Proceedings of the 5th International Conference on Coordinated and Multiple Views in Exploratory Visualization, 2007, pp. 61–71.
- B. Bach, E. Freeman, A. Abdul-Rahman, C. Turkay, S. Khan, Y. Fan, and M. Chen, “Dashboard design patterns,” arXiv preprint arXiv:2205.00757, 2022.
- Z. Qu and J. Hullman, “Keeping multiple views consistent: Constraints, validations, and exceptions in visualization authoring,” IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 1, pp. 468–477, 2017.
- R. Langner, U. Kister, and R. Dachselt, “Multiple coordinated views at large displays for multiple users: Empirical findings on user behavior, movements, and distances,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 608–618, 2018.
- M. Sun, A. Namburi, D. Koop, J. Zhao, T. Li, and H. Chung, “Towards systematic design considerations for visualizing cross-view data relationships,” IEEE Transactions on Visualization and Computer Graphics, 2021 (Early access).
- J. Stasko, C. Görg, and Z. Liu, “Jigsaw: supporting investigative analysis through interactive visualization,” Information Visualization, vol. 7, no. 2, pp. 118–132, 2008.
- M. Sun, A. R. Shaikh, H. Alhoori, and J. Zhao, “SightBi: Exploring cross-view data relationships with biclusters,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 1, pp. 54–64, 2021.
- V. Dibia and Ç. Demiralp, “Data2Vis: Automatic generation of data visualizations using sequence-to-sequence recurrent neural networks,” IEEE Computer Graphics and Applications, vol. 39, no. 5, pp. 33–46, 2019.
- K. Hu, M. A. Bakker, S. Li, T. Kraska, and C. Hidalgo, “VizML: A machine learning approach to visualization recommendation,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–12.
- D. Moritz, C. Wang, G. L. Nelson, H. Lin, A. M. Smith, B. Howe, and J. Heer, “Formalizing visualization design knowledge as constraints: Actionable and extensible models in draco,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 438–448, 2018.
- H. Li, Y. Wang, S. Zhang, Y. Song, and H. Qu, “KG4Vis: A knowledge graph-based approach for visualization recommendation,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 1, pp. 195–205, 2021.
- K. Wongsuphasawat, D. Moritz, A. Anand, J. Mackinlay, B. Howe, and J. Heer, “Voyager: Exploratory analysis via faceted browsing of visualization recommendations,” IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 1, pp. 649–658, 2015.
- A. Key, B. Howe, D. Perry, and C. Aragon, “VizDeck: self-organizing dashboards for visual analytics,” in Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, 2012, pp. 681–684.
- A. Srinivasan, S. M. Drucker, A. Endert, and J. Stasko, “Augmenting visualizations with interactive data facts to facilitate interpretation and communication,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 672–681, 2018.
- A. Tundo, C. Castelnovo, M. Mobilio, O. Riganelli, and L. Mariani, “Declarative dashboard generation,” in Proceedings of 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), 2020, pp. 215–218.
- D. Deng, A. Wu, H. Qu, and Y. Wu, “DashBot: Insight-driven dashboard generation based on deep reinforcement learning,” arXiv preprint arXiv:2208.01232, 2022.
- J. Hullman, S. Drucker, N. H. Riche, B. Lee, D. Fisher, and E. Adar, “A deeper understanding of sequence in narrative visualization,” IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 12, pp. 2406–2415, 2013.
- Y. Kim, K. Wongsuphasawat, J. Hullman, and J. Heer, “GraphScape: A model for automated reasoning about visualization similarity and sequencing,” in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017, pp. 2628–2638.
- Y. Wang, Z. Sun, H. Zhang, W. Cui, K. Xu, X. Ma, and D. Zhang, “DataShot: Automatic generation of fact sheets from tabular data,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, pp. 895–905, 2019.
- D. Shi, X. Xu, F. Sun, Y. Shi, and N. Cao, “Calliope: Automatic visual data story generation from a spreadsheet,” IEEE Transactions on Visualization and Computer Graphics, vol. 27, no. 2, pp. 453–463, 2020.
- H. M. Al-maneea and J. C. Roberts, “Towards quantifying multiple view layouts in visualisation as seen from research publications,” in Proceedings of the 2019 IEEE Visualization Conference (VIS), 2019, pp. 121–121.
- X. Chen, W. Zeng, Y. Lin, H. M. Ai-Maneea, J. Roberts, and R. Chang, “Composition and configuration patterns in multiple-view visualizations,” IEEE Transactions on Visualization and Computer Graphics, vol. 27, no. 2, pp. 1514–1524, 2020.
- L. Shao, Z. Chu, X. Chen, Y. Lin, and W. Zeng, “Modeling layout design for multiple-view visualization via bayesian inference,” Journal of Visualization, vol. 24, no. 6, pp. 1237–1252, 2021.
- M. Lu, C. Wang, J. Lanir, N. Zhao, H. Pfister, D. Cohen-Or, and H. Huang, “Exploring Visual Information Flows in Infographics,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1–12.
- L. Bartram and C. Ware, “Filtering and brushing with motion,” Information Visualization, vol. 1, no. 1, pp. 66–79, 2002.
- A. Satyanarayan, D. Moritz, K. Wongsuphasawat, and J. Heer, “Vega-Lite: A grammar of interactive graphics,” IEEE Transactions on Visualization and Computer Graphics, vol. 23, no. 1, pp. 341–350, 2016.
- E. R. Tufte, “The visual display of quantitative information,” The Journal for Healthcare Quality, vol. 7, no. 3, p. 15, 1985.
- J. Roberts, “On encouraging multiple views for visualization,” in Proceedings of the 1998 IEEE Conference on Information Visualization., 1998, pp. 8–14.
- C. North and B. Shneiderman, “Snap-together visualization: a user interface for coordinating visualizations via relational schemata,” in Proceedings of the 2000 Working Conference on Advanced Visual Interfaces, 2000, pp. 128–135.
- A. Wu, W. Tong, H. Li, D. Moritz, Y. Wang, and H. Qu, “ComputableViz: Mathematical operators as a formalism for visualisation processing and analysis,” in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022, pp. 1–15.
- S. Greco, B. Matarazzo, and R. Słowiński, “Decision rule approach,” in Multiple criteria decision analysis. Springer, 2016, pp. 497–552.
- C. Singh, K. Nasseri, Y. S. Tan, T. Tang, and B. Yu, “imodels: a python package for fitting interpretable models,” p. 3192, 2021.
- J. H. Friedman and B. E. Popescu, “Predictive learning via rule ensembles,” The Annals of Applied Statistics, vol. 2, no. 3, pp. 916–954, 2008.
- “Binary vector - Wikipedia,” https://en.wikipedia.org/wiki/Binary_vector, [Online; accessed 2022-08-23].
- Y. Ming, H. Qu, and E. Bertini, “RuleMatrix: Visualizing and understanding classifiers with rules,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 342–352, 2018.
- A. Wu, Y. Wang, X. Shu, D. Moritz, W. Cui, H. Zhang, D. Zhang, and H. Qu, “AI4VIS: Survey on artificial intelligence approaches for data visualization,” IEEE Transactions on Visualization and Computer Graphics, 2021 (Early access).
- M. Vartak, S. Rahman, S. Madden, A. Parameswaran, and N. Polyzotis, “SEEDB: Efficient data-driven visualization recommendations to support visual analytics,” in Proceedings of the VLDB Endowment International Conference on Very Large Data Bases, vol. 8, no. 13. NIH Public Access, 2015, p. 2182.
- R. Ding, S. Han, Y. Xu, H. Zhang, and D. Zhang, “QuickInsights: Quick and automatic discovery of insights from multi-dimensional data,” in Proceedings of the 2019 ACM SIGMOD International Conference on Management of Data, 2019, pp. 317–332.
- B. Shneiderman, “The eyes have it: A task by data type taxonomy for information visualizations,” in The Craft of Information Visualization, 2003, pp. 364–371.
- V. S. Smith, “Data dashboard as evaluation and research communication tool,” New Directions for Evaluation, vol. 2013, no. 140, pp. 21–45, 2013.
- D. Dowding and J. A. Merrill, “The development of heuristics for evaluation of dashboard visualizations,” Applied Clinical Informatics, vol. 9, no. 03, pp. 511–518, 2018.
- S. Lee and D. K. Lee, “What is the proper way to apply the multiple comparison test?” Korean journal of anesthesiology, vol. 71, no. 5, pp. 353–360, 2018.
- Q. Wang, Z. Chen, Y. Wang, and H. Qu, “A Survey on ML4VIS: Applying machinelearning advances to data visualization,” IEEE Transactions on Visualization and Computer Graphics, 2021.
- Y.-R. Cao, X.-H. Li, J.-Y. Pan, and W.-C. Lin, “VisGuide: User-oriented recommendations for data event extraction,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, 2022, pp. 1–13.
- A. Satyanarayan, B. Lee, D. Ren, J. Heer, J. Stasko, J. Thompson, M. Brehmer, and Z. Liu, “Critical reflections on visualization authoring systems,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, pp. 461–471, 2019.