Can Nuanced Language Lead to More Actionable Insights? Exploring the Role of Generative AI in Analytical Narrative Structure (2405.02763v1)
Abstract: Relevant language describing trends in data can be useful for generating summaries to help with readers' takeaways. However, the language employed in these often template-generated summaries tends to be simple, ranging from describing simple statistical information (e.g., extrema and trends) without additional context and richer language to provide actionable insights. Recent advances in LLMs have shown promising capabilities in capturing subtle nuances in language when describing information. This workshop paper specifically explores how LLMs can provide more actionable insights when describing trends by focusing on three dimensions of analytical narrative structure: semantic, rhetorical, and pragmatic. Building on prior research that examines visual and linguistic signatures for univariate line charts, we examine how LLMs can further leverage the semantic dimension of analytical narratives using quantified semantics to describe shapes in trends as people intuitively view them. These semantic descriptions help convey insights in a way that leads to a pragmatic outcome, i.e., a call to action, persuasion, warning vs. alert, and situational awareness. Finally, we identify rhetorical implications for how well these generated narratives align with the perceived shape of the data, thereby empowering users to make informed decisions and take meaningful actions based on these data insights.
- 2024. IBM Watson Analytics. http://www.ibm.com/analytics/watson-analytics.
- 2024. ThoughtSpot. http://www.thoughtspot.com.
- Statsmonkey: Automatic Generation of Narrative from Data. In Computational Models of Narrative: Papers from the 2010 AAAI Fall Symposium. Computational Models of Narrative: Papers from the 2010 AAAI Fall Symposium ; Conference date: 01-01-2010.
- Dennis Bromley and Vidya Setlur. 2023. What Is the Difference Between a Mountain and a Molehill? Quantifying Semantic Labeling of Visual Features in Line Charts. IEEE Transactions on Visualization and Computer Graphics (2023).
- Readings in Information Visualization: Using Vision To Think. Morgan Kaufmann.
- Analyza: Exploring Data with Conversation. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI 2017). 493–504.
- Representing and Querying Line Graphs in Natural Language: The iGraph System. In Smart Graphics, 6th International Symposium, SG 2006, Vancouver, Canada, July 23-25, 2006, Proceedings (Lecture Notes in Computer Science, Vol. 4073), Andreas Butz, Brian D. Fisher, Antonio Krüger, and Patrick Olivier (Eds.). Springer, 248–253. https://doi.org/10.1007/11795018_25
- Mathematical Capabilities of ChatGPT. arXiv:2301.13867 [cs.LG]
- DataTone: Managing Ambiguity in Natural Language Interfaces for Data Visualization. In Proceedings of the 28th Annual ACM Symposium on User Interface Software Technology (UIST 2015). ACM, New York, NY, USA, 489–500.
- G. Goodnight. 2014. Rhetoric, Communication, and Information. POROI: An Interdisciplinary Journal of Rhetorical Analysis and Invention DOI: 10.13008/2151-2957.1185 (01 2014), Article 4. https://doi.org/10.13008/2151-2957.1185
- H. P. Grice. 1975. Logic and Conversation. In The Logic of Grammar, Donald Davidson and Gilbert Harman (Eds.). 64–75.
- Chart Question Answering: State of the Art and Future Directions. Computer Graphics Forum 41, 3 (2022), 555–572. https://doi.org/10.1111/cgf.14573
- Applying Pragmatics Principles for Interaction with Visual Analytics. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2017), 309–318.
- K. Hyland. 1998. Hedging in Scientific Research Articles. John Benjamins Publishing Company. https://books.google.com/books?id=VP-DQgAACAAJ
- G. Lakoff. 1973. Hedges: A Study in Meaning Criteria and the Logic of Fuzzy Concepts. University of Chicago Press. https://books.google.com/books?id=H8XbygAACAAJ
- More Than Telling a Story: Transforming Data into Visually Shared Stories. IEEE Computer Graphics and Applications 35, 5 (2015), 84–90.
- OpenAI. 2023. GPT-4 Technical Report. arXiv (2023), 2303–08774.
- Klaus P. Schneider and Anne Barron (Eds.). 2014. Pragmatics of Discourse. De Gruyter Mouton, Berlin, München, Boston. https://doi.org/doi:10.1515/9783110214406
- Edward Segel and Jeffrey Heer. 2010. Narrative Visualization: Telling Stories with Data. IEEE Transactions on Visualization and Computer Graphics 16, 6 (2010), 1139–1148.
- Eviza: A Natural Language Interface for Visual Analysis. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST 2016). ACM, New York, NY, USA, 365–377.
- Olio: A Semantic Search Interface for Data Repositories. In Proceedings of the 36th Annual ACM Symposium on User Interface Software Technology (San Francisco, California) (UIST 2023). ACM, New York, NY, USA. https://doi.org/10.1145/3586183.3606806
- Arjun Srinivasan and John Stasko. 2018. Orko: Facilitating Multimodal Interaction for Visual Exploration and Analysis of Networks. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 511–521.
- B. Yu and C. T. Silva. 2020. FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow System. IEEE Transactions on Visualization and Computer Graphics 26, 01 (jan 2020), 1–11. https://doi.org/10.1109/TVCG.2019.2934668