User Experience In Dataset Search (2403.15861v2)
Abstract: This research investigates User Experience (UX) issues in dataset search, targeting Google Dataset Search and data.europa.eu. It focuses on 6 areas within UX: Initial Interaction, Search Process, Dataset Exploration, Filtering and Sorting, Dataset Actions, and Assistance and Feedback. The evaluation method combines 'The Pandemic Puzzle' user task, think-aloud methods, and demographic and post-task questionnaires. 29 strengths and 63 weaknesses were collected from 19 participants involved in roles within technology firm or academia. While certain insights are specific to particular platforms, most are derived from features commonly observed in dataset search platforms across a variety of fields, implying that our findings are broadly applicable. Observations from commonly found features in dataset search platforms across various fields have led to the development of 10 new design prototypes. Unlike literature retrieval, dataset retrieval involves a significant focus on metadata accessibility and quality, each element of which can impact decision-making. To address issues like reading fatigue from metadata presentation, inefficient methods for results searching, filtering, and selection, along with other unresolved user-centric issues on current platforms. These prototypes concentrate on enhancing metadata-related features. They include a redesigned homepage, an improved search bar, better sorting options, an enhanced search result display, a metadata comparison tool, and a navigation guide. Our aim is to improve usability for a wide range of users, including both developers and researchers.
- 2023. Coblis — Colour Blindness Simulator. https://www.color-blindness.com/coblis-color-blindness-simulator/. Accessed: 2023-12-01.
- 2024. Schema.org. https://schema.org/ Accessed: 2024-01-06.
- Google dataset search by the numbers. In International Semantic Web Conference. Springer, 667–682.
- Petra M Boynton and Trisha Greenhalgh. 2004. Selecting, designing, and developing your questionnaire. Bmj 328, 7451 (2004), 1312–1315.
- Google Dataset Search: Building a search engine for datasets in an open Web ecosystem. In The World Wide Web Conference. 1365–1375.
- Dataset search: a survey. The VLDB Journal 29, 1 (2020), 251–272.
- Elizabeth Charters. 2003. The use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Education Journal 12, 2 (2003).
- Search engines: Information retrieval in practice. Vol. 520. Addison-Wesley Reading.
- David Ellis. 1989. A behavioural approach to information retrieval system design. Journal of documentation 45, 3 (1989), 171–212.
- Navigating the data lake with datamaran: Automatically extracting structure from log datasets. In Proceedings of the 2018 International Conference on Management of Data. 943–958.
- Personalised information retrieval: survey and classification. User Modeling and User-Adapted Interaction 23 (2013), 381–443.
- Financing the web of data with delayed-answer auctions. In Proceedings of the 2018 World Wide Web Conference. 1033–1042.
- Yongqi Gu. 2014. To code or not to code: Dilemmas in analysing think-aloud protocols in learning strategies research. System 43 (2014), 74–81.
- Characterising dataset search—An analysis of search logs and data requests. Journal of Web Semantics 55 (2019), 37–55.
- Diane Kelly et al. 2009. Methods for evaluating interactive information retrieval systems with users. Foundations and Trends® in Information Retrieval 3, 1–2 (2009), 1–224.
- Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework. In Proceedings of the 2015 international conference on the theory of information retrieval. 101–110.
- Dagmar Kern and Brigitte Mathiak. 2015. Are there any differences in data set retrieval compared to well-known literature retrieval?. In Research and Advanced Technology for Digital Libraries: 19th International Conference on Theory and Practice of Digital Libraries, TPDL 2015, Poznań, Poland, September 14-18, 2015, Proceedings 19. Springer, 197–208.
- James R Lewis. 2014. Usability: lessons learned… and yet to be learned. International Journal of Human-Computer Interaction 30, 9 (2014), 663–684.
- Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41–46.
- Viktor Mayer-Schönberger and Kenneth Cukier. 2013. Big data: A revolution that will transform how we live, work, and think. Houghton Mifflin Harcourt.
- A survey on data collection for machine learning: a big data-ai integration perspective. IEEE Transactions on Knowledge and Data Engineering 33, 4 (2019), 1328–1347.
- A comparison of concurrent and retrospective verbal protocol analysis. The American journal of psychology 113 (2000), 3.
- Data Integration: The Current Status and the Way Forward. IEEE Data Eng. Bull. 41, 2 (2018), 3–9.
- Mike Thelwall and Kayvan Kousha. 2016. Figshare: a universal repository for academic resource sharing? Online Information Review 40, 3 (2016), 333–346.
- Ryen W White. 2014. Belief dynamics in web search. Journal of the Association for Information Science and Technology 65, 11 (2014), 2165–2178.