Inclusive Design Insights from a Preliminary Image-Based Conversational Search Systems Evaluation (2403.19899v1)
Abstract: The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system, juxtaposing it against its text-based and mixed counterparts. A diverse participant cohort ensures a broad evaluation spectrum. Advanced tools facilitate emotion analysis, capturing user sentiments during interactions, while structured feedback sessions offer qualitative insights. Results indicate that while the text-based system minimizes user confusion, the image-based system presents challenges in direct information interpretation. However, the mixed system achieves the highest engagement, suggesting an optimal blend of visual and textual information. Notably, the potential of these systems, especially the image-based modality, to assist individuals with intellectual disabilities is highlighted. The study concludes that the Image-Based Conversational Search System, though challenging in some aspects, holds promise, especially when integrated into a mixed system, offering both clarity and engagement.
- P. P. Ray, Chatgpt: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope, Internet of Things and Cyber-Physical Systems (2023).
- New and emerging aac technology supports for children with complex communication needs and their communication partners: State of the science and future research directions, Augmentative and Alternative Communication 35 (2019) 26–41.
- Applying information foraging theory to understand user interaction with content-based image retrieval, in: Proceedings of the third symposium on Information interaction in context, 2010, pp. 135–144.
- An exploratory study on a reinforcement learning prototype for multimodal image retrieval using a conversational search interface, Knowledge 2 (2022) 116–138.
- M. B. Hoy, Alexa, siri, cortana, and more: an introduction to voice assistants, Medical reference services quarterly 37 (2018) 81–88.
- How do people interact in conversational speech-only search tasks: A preliminary analysis, in: Proceedings of the 2017 conference on conference human information interaction and retrieval, 2017, pp. 325–328.
- Informing the design of spoken conversational search: Perspective paper, in: Proceedings of the 2018 conference on human information interaction & retrieval, 2018, pp. 32–41.
- Assessing the utility of the system usability scale for evaluating voice-based user interfaces, in: Proceedings of the Sixth International Symposium of Chinese CHI, 2018, pp. 11–15.
- Searchbots: User engagement with chatbots during collaborative search, in: Proceedings of the 2018 conference on human information interaction & retrieval, 2018, pp. 52–61.
- Embedding search into a conversational platform to support collaborative search, in: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval, 2019, pp. 15–23.
- Toward voice query clarification, in: The 41st international acm sigir conference on research & development in information retrieval, 2018, pp. 1257–1260.
- D. Paolieri, A. Marful, Norms for a pictographic system: the aragonese portal of augmentative/alternative communication (arasaac) system, Frontiers in psychology 9 (2018) 2538.
- The design and implementation of xiaoice, an empathetic social chatbot, Computational Linguistics 46 (2020) 53–93.
- R. W. White, R. Ma, Improving search engines via large-scale physiological sensing, in: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017, pp. 881–884.
- No clicks, no problem: using cursor movements to understand and improve search, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011). URL: https://api.semanticscholar.org/CorpusID:882269.
- Galvanic skin response (gsr) as an index of cognitive load, in: CHI’07 extended abstracts on Human factors in computing systems, 2007, pp. 2651–2656.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.