Tensions between Preference and Performance: Designing for Visual Exploration of Multi-frequency Medical Network Data
Abstract: The analysis of complex high-dimensional data is a common task in many domains, resulting in bespoke visual exploration tools. Expectations and practices of domain experts as users do not always align with visualization theory. In this paper, we report on a design study in the medical domain where we developed two high-fidelity prototypes encoding EEG-derived brain network data with different types of visualizations. We evaluate these prototypes regarding effectiveness, efficiency, and preference with two groups: participants with domain knowledge (domain experts in medical research) and those without domain knowledge, both groups having little or no visualization experience. A requirement analysis and study of low-fidelity prototypes revealed a strong preference for a novel and aesthetically pleasing visualization design, as opposed to a design that is considered more optimal based on visualization theory. Our study highlights the pros and cons of both approaches, discussing trade-offs between task-specific measurements and subjective preference. While the aesthetically pleasing and novel low-fidelity prototype was favored, the results of our evaluation show that, in most cases, this was not reflected in participants' performance or subjective preference for the high-fidelity prototypes.
- B. Shneiderman, “The eyes have it: a task by data type taxonomy for information visualizations,” in Proceedings 1996 IEEE Symposium on Visual Languages, 1996, pp. 336–343.
- A. Burns, C. Lee, R. Chawla, E. Peck, and N. Mahyar, “Who do we mean when we talk about visualization novices?” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, ser. CHI ’23. New York, NY, USA: Association for Computing Machinery, 2023.
- F. Barollo, M. Hassan, H. Petersen, I. Rigoni, C. Ramon, P. Gargiulo, and A. Fratini, “Cortical pathways during postural control: New insights from functional eeg source connectivity,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 30, pp. 72–84, 2022.
- M. Carboni, P. De Stefano, B. J. Vorderwülbecke, S. Tourbier, E. Mullier, M. Rubega, S. Momjian, K. Schaller, P. Hagmann, M. Seeck, C. M. Michel, P. van Mierlo, and S. Vulliemoz, “Abnormal directed connectivity of resting state networks in focal epilepsy,” NeuroImage: Clinical, vol. 27, p. 102336, 2020.
- J. Royer, B. C. Bernhardt, S. Larivière, E. Gleichgerrcht, B. J. Vorderwülbecke, S. Vulliémoz, and L. Bonilha, “Epilepsy and brain network hubs,” Epilepsia, vol. 63, no. 3, pp. 537–550, 2022.
- P. van Mierlo, Y. Höller, N. K. Focke, and S. Vulliemoz, “Network perspectives on epilepsy using eeg/meg source connectivity,” Frontiers in Neurology, vol. 10, 2019.
- R. S. Desikan, F. Ségonne, B. Fischl, B. T. Quinn, B. C. Dickerson, D. Blacker, R. L. Buckner, A. M. Dale, R. P. Maguire, B. T. Hyman, M. S. Albert, and R. J. Killiany, “An automated labeling system for subdividing the human cerebral cortex on mri scans into gyral based regions of interest,” NeuroImage, vol. 31, no. 3, pp. 968–980, 2006.
- P. Hagmann, L. Cammoun, X. Gigandet, R. Meuli, C. J. Honey, V. J. Wedeen, and O. Sporns, “Mapping the structural core of human cerebral cortex,” PLOS Biology, vol. 6, no. 7, pp. 1–15, 07 2008.
- I. Rigoni, J. Rue Queralt, K. Glomb, M. Preti, N. Roehri, S. Tourbier, L. Spinelli, M. Seeck, D. Van De Ville, P. Hagmann, and S. Vulliemoz, “Structure-function coupling increases during interictal spikes in temporal lobe epilepsy: a graph signal processing study,” Clinical Neurophysiology, 2023.
- M. X. Cohen, “Where does eeg come from and what does it mean?” Trends in Neurosciences, vol. 40, no. 4, pp. 208–218, 2017.
- M. Rubinov and O. Sporns, “Complex network measures of brain connectivity: Uses and interpretations,” NeuroImage, vol. 52, no. 3, pp. 1059–1069, 2010, computational Models of the Brain.
- R. Bender and S. Lange, “Adjusting for multiple testing—when and how?” Journal of Clinical Epidemiology, vol. 54, no. 4, pp. 343–349, 2001.
- W. S. Cleveland and R. McGill, “Graphical perception: Theory, experimentation, and application to the development of graphical methods,” Journal of the American Statistical Association, vol. 79, no. 387, pp. 531–554, 1984.
- J. Mackinlay, “Automating the design of graphical presentations of relational information,” ACM Trans. Graph., vol. 5, no. 2, p. 110–141, apr 1986.
- J. Heer and M. Bostock, “Crowdsourcing graphical perception: Using mechanical turk to assess visualization design,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI ’10. New York, NY, USA: Association for Computing Machinery, 2010, p. 203–212.
- G. J. Quadri and P. Rosen, “A survey of perception-based visualization studies by task,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 12, pp. 5026–5048, 2022.
- R. Amar, J. Eagan, and J. Stasko, “Low-level components of analytic activity in information visualization,” in IEEE Symposium on Information Visualization, 2005. INFOVIS 2005., 2005, pp. 111–117.
- J. Talbot, V. Setlur, and A. Anand, “Four experiments on the perception of bar charts,” IEEE Transactions on Visualization and Computer Graphics, vol. 20, no. 12, pp. 2152–2160, 2014.
- C. Nothelfer and S. Franconeri, “Measures of the benefit of direct encoding of data deltas for data pair relation perception,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, pp. 311–320, 2020.
- A. Srinivasan, M. Brehmer, B. Lee, and S. M. Drucker, “What’s the difference? evaluating variations of multi-series bar charts for visual comparison tasks,” in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ser. CHI ’18. New York, NY, USA: Association for Computing Machinery, 2018, p. 1–12.
- C. C. Gramazio, K. B. Schloss, and D. H. Laidlaw, “The relation between visualization size, grouping, and user performance,” IEEE Transactions on Visualization and Computer Graphics, vol. 20, no. 12, pp. 1953–1962, 2014.
- M. Waldner, A. Diehl, D. Gračanin, R. Splechtna, C. Delrieux, and K. Matković, “A comparison of radial and linear charts for visualizing daily patterns,” IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 1, pp. 1033–1042, 2020.
- S. Diehl, F. Beck, and M. Burch, “Uncovering strengths and weaknesses of radial visualizations—an empirical approach,” IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 6, pp. 935–942, 2010.
- D. A. Szafir, “Modeling color difference for visualization design,” IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 1, pp. 392–401, 2018.
- D. Borland and R. M. Taylor Ii, “Rainbow color map (still) considered harmful,” IEEE Computer Graphics and Applications, vol. 27, no. 2, pp. 14–17, 2007.
- K. Reda, “Rainbow colormaps: What are they good and bad for?” IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 12, pp. 5496–5510, 2023.
- I. M. Gołbiowska and A. Çöltekin, “Rainbow dash: Intuitiveness, interpretability and memorability of the rainbow color scheme in visualization,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 7, pp. 2722–2733, 2022.
- K. Reda, P. Nalawade, and K. Ansah-Koi, “Graphical perception of continuous quantitative maps: The effects of spatial frequency and colormap design,” in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ser. CHI ’18. New York, NY, USA: Association for Computing Machinery, 2018, p. 1–12.
- R. M. Karim, O.-H. Kwon, C. Park, and K. Lee, “A study of colormaps in network visualization,” Applied Sciences, vol. 9, no. 20, 2019.
- C. C. Gramazio, D. H. Laidlaw, and K. B. Schloss, “Colorgorical: Creating discriminable and preferable color palettes for information visualization,” IEEE Transactions on Visualization and Computer Graphics, vol. 23, no. 1, pp. 521–530, 2017.
- M. Harrower and C. A. Brewer, “Colorbrewer.org: An online tool for selecting colour schemes for maps,” The Cartographic Journal, vol. 40, no. 1, pp. 27–37, 2003.
- M. Tory and T. Moller, “Human factors in visualization research,” IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 1, pp. 72–84, 2004.
- E. Lee-Robbins and E. Adar, “Affective learning objectives for communicative visualizations,” IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 1, pp. 1–11, 2023.
- A. V. Pandey, A. Manivannan, O. Nov, M. Satterthwaite, and E. Bertini, “The persuasive power of data visualization,” IEEE Transactions on Visualization and Computer Graphics, vol. 20, no. 12, pp. 2211–2220, 2014.
- A. Lau and A. Vande Moere, “Towards a model of information aesthetics in information visualization,” in 2007 11th International Conference Information Visualization (IV ’07), 2007, pp. 87–92.
- D. Filonik and D. Baur, “Measuring aesthetics for information visualization,” in 2009 13th International Conference Information Visualisation, 2009, pp. 579–584.
- A. V. Moere and H. Purchase, “On the role of design in information visualization,” Information Visualization, vol. 10, no. 4, pp. 356–371, 2011.
- T. He, P. Isenberg, R. Dachselt, and T. Isenberg, “Beauvis: A validated scale for measuring the aesthetic pleasure of visual representations,” IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 1, pp. 363–373, 2023.
- A. Dasgupta, J.-Y. Lee, R. Wilson, R. A. Lafrance, N. Cramer, K. Cook, and S. Payne, “Familiarity vs trust: A comparative study of domain scientists’ trust in visual analytics and conventional analysis methods,” IEEE Transactions on Visualization and Computer Graphics, vol. 23, no. 1, pp. 271–280, 2017.
- D. Slayback, S. Abdali, J. Brooks, W. D. Hairston, and P. Groves, “Novel methods for eeg visualization and visualization,” in 2018 IEEE International Symposium on Circuits and Systems (ISCAS), 2018, pp. 1–5.
- M. ten Caat, N. M. Maurits, and J. B. Roerdink, “Design and evaluation of tiled parallel coordinate visualization of multichannel eeg data,” IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 1, pp. 70–79, 2007.
- ——, “Data-driven visualization and group analysis of multichannel eeg coherence with functional units,” IEEE Transactions on Visualization and Computer Graphics, vol. 14, no. 4, pp. 756–771, 2008.
- D. P. Wulandari, Y. K. Suprapto, A. I. Juniani, T. F. Elyantono, S. W. Purnami, and W. R. Islamiyah, “Visualization of epilepsy patient’s brain condition based on spectral analysis of eeg signals using topographic mapping,” in 2018 International Conference on Computer Engineering, Network and Intelligent Multimedia (CENIM), 2018, pp. 7–13.
- Z. Fang, L. Yao, and Z. Qian, “Research on multi-parameter visualization technology of brain function based on eeg,” in 2019 International Conference on Medical Imaging Physics and Engineering (ICMIPE), 2019, pp. 1–4.
- M. Gavrilescu and F. Ungureanu, “Enhanced three-dimensional visualization of eeg signals,” in 2015 E-Health and Bioengineering Conference (EHB), 2015, pp. 1–4.
- T. Mullen, C. Kothe, Y. M. Chi, A. Ojeda, T. Kerth, S. Makeig, G. Cauwenberghs, and T.-P. Jung, “Real-time modeling and 3d visualization of source dynamics and connectivity using wearable eeg,” in 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2013, pp. 2184–2187.
- K. R. Christopher, A. Kapur, D. A. Carnegie, and G. M. Grimshaw, “Implementing 3d visualizations of eeg signals in artistic applications,” in 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013), 2013, pp. 364–369.
- V. C. Pezoulas, A. Athanasiou, G. Nolte, M. Zervakis, A. Fratini, D. I. Fotiadis, and M. A. Klados, “Fclab: An eeglab module for performing functional connectivity analysis on single-subject eeg data,” in 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), 2018, pp. 96–99.
- M. Sedlmair, M. Meyer, and T. Munzner, “Design study methodology: Reflections from the trenches and the stacks,” IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 12, pp. 2431–2440, 2012.
- E. Kerzner, S. Goodwin, J. Dykes, S. Jones, and M. Meyer, “A framework for creative visualization-opportunities workshops,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, pp. 748–758, 2019.
- C. Knoll, A. Cetin, T. Möller, and M. Meyer, “Extending recommendations for creative visualization-opportunities workshops,” in 2020 IEEE Workshop on Evaluation and Beyond - Methodological Approaches to Visualization (BELIV), 2020, pp. 81–88.
- M. Bostock, V. Ogievetsky, and J. Heer, “D³ data-driven documents,” IEEE Transactions on Visualization and Computer Graphics, vol. 17, no. 12, pp. 2301–2309, 2011.
- J. Brooke, “SUS: A ’quick’ and ’dirty’ usability scale,” in Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland, Eds. Taylor and Francis, 1996, pp. 189–194.
- A. Bangor, P. T. Kortum, and J. T. Miller, “An empirical evaluation of the system usability scale,” International Journal of Human–Computer Interaction, vol. 24, no. 6, pp. 574–594, 2008.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.