Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Lifelogging As An Extreme Form of Personal Information Management -- What Lessons To Learn (2401.05767v1)

Published 11 Jan 2024 in cs.IR and cs.HC

Abstract: Personal data includes the digital footprints that we leave behind as part of our everyday activities, both online and offline in the real world. It includes data we collect ourselves, such as from wearables, as well as the data collected by others about our online behaviour and activities. Sometimes we are able to use the personal data we ourselves collect, in order to examine some parts of our lives but for the most part, our personal data is leveraged by third parties including internet companies, for services like targeted advertising and recommendations. Lifelogging is a form of extreme personal data gathering and in this article we present an overview of the tools used to manage access to lifelogs as demonstrated at the most recent of the annual Lifelog Search Challenge benchmarking workshops. Here, experimental systems are showcased in live, real time information seeking tasks by real users. This overview of these systems' capabilities show the range of possibilities for accessing our own personal data which may, in time, become more easily available as consumer-level services.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. Memento 3.0: An enhanced lifelog search engine for LSC’23. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 41–46. Association for Computing Machinery, New York, NY, USA, 2023.
  2. An interactive lifelog search engine for LSC 2018. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge, pages 30–32, New York, NY, USA, 2018. Association for Computing Machinery.
  3. Exploring the basis and boundary conditions of SenseCam-facilitated recollection. Memory, 19(7):758–767, 2011.
  4. G. Bell. A personal digital store. Commun. ACM, 44(1):86–91, Jan 2001.
  5. The use of a wearable camera, SenseCam, as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A preliminary report. Neuropsychological Rehabilitation, 17(4-5):582–601, 2007.
  6. Data as asset? the measurement, governance, and valuation of digital personal data by big tech. Big Data & Society, 8(1):20539517211017308, 2021.
  7. Classification of Everyday Living Version 1.0, 2019.
  8. Imagenet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pages 248–255. IEEE, 2009.
  9. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018.
  10. M. Dogariu and B. Ionescu. Multimedia Lab @ ImageCLEF 2018 Lifelog Moment Retrieval Task. In CLEF (Working Notes), page 13, 2018.
  11. Experiences of aiding autobiographical memory using the SenseCam. Human–Computer Interaction, 27(1-2):151–174, 2012.
  12. Can wearable cameras be used to validate school-aged children’s lifestyle behaviours? Children, 6(2):20, 2019.
  13. Personal Data Stores (PDS): A Review. Sensors, 23(3), 2023.
  14. Lifelogging: Personal big data. Foundations and Trends in Information Retrieval, 8(1):1–125, 2014.
  15. Remembering through lifelogging: A survey of human memory augmentation. Pervasive and Mobile Computing, 27:14–26, 2016.
  16. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 770–778, 2016.
  17. Personal information management systems: a user-centric privacy utopia? Published in Internet Policy Review (18 December 2020), 9(4):1–25, 2020.
  18. SOLID and PeaaS: Your Phone as a Store for Personal Data. In Current Trends in Web Engineering: ICWE 2020 International Workshops, KDWEB, Sem4Tra, and WoT4H, Helsinki, Finland, June 9–12, 2020, Revised Selected Papers 20, pages 5–10. Springer, 2020.
  19. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data, 7(3):535–547, 2019.
  20. Exquisitor at the lifelog search challenge 2021: Relationships between semantic classifiers. In Proceedings of the 4th Annual on Lifelog Search Challenge, pages 3–6. Association for Computing Machinery, New York, NY, USA, 2021.
  21. The trials and tribulations of working with structured data: A study on information seeking behaviour. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, page 1277–1289, New York, NY, USA, 2017. Association for Computing Machinery.
  22. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. arXiv:1602.07332 [cs], Feb. 2016. arXiv: 1602.07332.
  23. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 2012.
  24. The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale. International Journal of Computer Vision, 128(7):1956–1981, 2020.
  25. Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33:9459–9474, 2020.
  26. Task, information seeking intentions, and user behavior: Toward a multi-level understanding of web search. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval, pages 123–132, 2019.
  27. Enhanced SOMHunter for known-item search in lifelog data. In Proceedings of the 4th Annual on Lifelog Search Challenge, pages 71–73. Association for Computing Machinery, New York, NY, USA, 2021.
  28. D. Lupton. Self-tracking, health and medicine, 2017.
  29. Recognition of activities of daily living with egocentric vision: A review. Sensors, 16(1):72, 2016.
  30. E-LifeSeeker: An interactive lifelog search engine for lsc’23. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 13–17. Association for Computing Machinery, New York, NY, USA, 2023.
  31. A two-level lifelog search engine at the LSC 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge, pages 19–23, 2019.
  32. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning, pages 8748–8763. PMLR, 2021.
  33. Multi-Mode Clustering for Graph-Based Lifelog Retrieval. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 36–40. Association for Computing Machinery, New York, NY, USA, 2023.
  34. K. Schoeffmann. LifeXplore at the Lifelog Search Challenge 2023. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 53–58. Association for Computing Machinery, New York, NY, USA, 2023.
  35. Children’s everyday exposure to food marketing: an objective analysis using wearable cameras. International Journal of Behavioral Nutrition and Physical Activity, 14:1–11, 2017.
  36. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  37. The best of both worlds: Lifelog retrieval with a desktop-virtual reality hybrid system. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 65–68. Association for Computing Machinery, New York, NY, USA, 2023.
  38. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1–9, 2015.
  39. TimelineQA: A benchmark for question answering over timelines. In A. Rogers, J. Boyd-Graber, and N. Okazaki, editors, Findings of the Association for Computational Linguistics: ACL 2023, pages 77–91, Toronto, Canada, July 2023. Association for Computational Linguistics.
  40. An exploration into the benefits of the CLIP model for lifelog retrieval. In Proceedings of the 19th International Conference on Content-based Multimedia Indexing, pages 15–22, 2022.
  41. MyEachtra: Event-based interactive lifelog retrieval system for lsc’23. In Proceedings of the 6th Annual ACM Lifelog Search Challenge, pages 24–29. Association for Computing Machinery, New York, NY, USA, 2023.
  42. Comparing interactive retrieval approaches at the Lifelog Search Challenge 2021. IEEE Access, 11:30982–30995, 2023.
  43. E-Myscéal: Embedding-based interactive lifelog retrieval system for lsc’22. In Proceedings of the 5th Annual on Lifelog Search Challenge, LSC ’22, page 32–37, New York, NY, USA, 2022. Association for Computing Machinery.
  44. VAISL: Visual-aware identification of semantic locations in lifelog. In International Conference on Multimedia Modeling, pages 659–670. Springer, 2023.
  45. Lifelog moment retrieval with visual concept fusion and text-based query expansion. In CLEF (Working Notes), 2018.
  46. L. Tuovinen and A. F. Smeaton. Privacy-aware sharing and collaborative analysis of personal wellness data: Process model, domain ontology, software system and user trial. Plos ONE, 17(4):e0265997, 2022.
  47. D. Vrandečić and M. Krötzsch. Wikidata: a free collaborative knowledgebase. Communications of the ACM, 57(10):78–85, 2014.
  48. The use of a wearable camera to explore daily functioning of older adults living with persistent pain: Methodological reflections and recommendations. Journal of Rehabilitation and Assistive Technologies Engineering, 5:2055668318765411, 2018.
  49. Learning deep features for scene recognition using places database. Advances in Neural Information Processing Systems, 27, 2014.
  50. A baseline search engine for personal life archives. In Proceedings of the 2nd Workshop on Lifelogging Tools and Applications, LTA ’17, pages 21–24, New York, NY, USA, 2017. Association for Computing Machinery.
  51. The use of wearable cameras in assessing children’s dietary intake and behaviours in China. Appetite, 139:1–7, 2019.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Ly-Duyen Tran (1 paper)
  2. Cathal Gurrin (11 papers)
  3. Alan F. Smeaton (85 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets