Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

NMF-Based Analysis of Mobile Eye-Tracking Data (2404.03417v1)

Published 4 Apr 2024 in cs.CV

Abstract: The depiction of scanpaths from mobile eye-tracking recordings by thumbnails from the stimulus allows the application of visual computing to detect areas of interest in an unsupervised way. We suggest using nonnegative matrix factorization (NMF) to identify such areas in stimuli. For a user-defined integer k, NMF produces an explainable decomposition into k components, each consisting of a spatial representation associated with a temporal indicator. In the context of multiple eye-tracking recordings, this leads to k spatial representations, where the temporal indicator highlights the appearance within recordings. The choice of k provides an opportunity to control the refinement of the decomposition, i.e., the number of areas to detect. We combine our NMF-based approach with visualization techniques to enable an exploratory analysis of multiple recordings. Finally, we demonstrate the usefulness of our approach with mobile eye-tracking data of an art gallery.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. Algorithms and Applications for Approximate Nonnegative Matrix Factorization. Computational Statistics and Data Analysis 52, 1 (Sept. 2007), 155–173. https://doi.org/10.1016/j.csda.2006.11.006
  2. Visualization of Eye Tracking Data: A Taxonomy and Survey. Computer Graphics Forum 36, 8 (Feb. 2017), 260–284. https://doi.org/10.1111/cgf.13079
  3. Deep Semantic Gaze Embedding and Scanpath Comparison for Expertise Classification During OPT Viewing. In Proceedings of the ACM Symposium on Eye Tracking Research & Applications (ETRA ’20). Article 18, 10 pages. https://doi.org/10.1145/3379155.3391320
  4. An Exemplar-Based NMF Approach to Audio Event Detection. In Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. https://doi.org/10.1109/waspaa.2013.6701847
  5. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770–778. https://doi.org/10.1109/cvpr.2016.90
  6. Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP Oxford.
  7. Joint Image Clustering and Labeling by Matrix Factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence 38, 7 (July 2016), 1411–1424. https://doi.org/10.1109/tpami.2015.2487982
  8. Dataset for NMF-based Analysis of Mobile Eye-Tracking Data. DaRUS, Data Repository of the University of Stuttgart (2024). https://doi.org/10.18419/darus-4023
  9. A Spiral into the Mind: Gaze Spiral Visualization for Mobile Eye Tracking. Proceedings of the ACM on Computer Graphics and Interactive Techniques 5, 2 (May 2022), 1–16. https://doi.org/10.1145/3530795
  10. Two-Photon Calcium Imaging of the Medial Prefrontal Cortex and Hippocampus Without Cortical Invasion. eLife 6, e26839 (Sept. 2017). https://doi.org/10.7554/elife.26839
  11. Clustered Eye Movement Similarity Matrices. In Proceedings of the ACM Symposium on Eye Tracking Research & Applications (ETRA ’19). Article 82, 9 pages. https://doi.org/10.1145/3317958.3319811
  12. Task Classification Model for Visual Fixation, Exploration, and Search. In Proceedings of the Symposium on Eye Tracking Research & Applications (ETRA ’19). Article 65, 4 pages. https://doi.org/10.1145/3314111.3323073
  13. Kuno Kurzhals. 2021. Image-Based Projection Labeling for Mobile Eye Tracking. In Proceedings of the ACM Symposium on Eye Tracking Research & Applications (ETRA ’21). Article 4, 12 pages. https://doi.org/10.1145/3448017.3457382
  14. Gaze Stripes: Image-Based Visualization of Eye Tracking Data. IEEE Transactions on Visualization and Computer Graphics 22, 1 (Jan. 2016), 1005–1014. https://doi.org/10.1109/TVCG.2015.2468091
  15. Daniel D. Lee and H. Sebastian Seung. 1999. Learning the Parts of Objects by Non-Negative Matrix Factorization. Nature 401, 6755 (Oct. 1999), 788–791. https://doi.org/10.1038/44565
  16. David G Lowe. 1999. Object Recognition from Local Scale-Invariant Features. In Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV ’99, Vol. 2). 1150–1157. https://doi.org/10.1109/ICCV.1999.790410
  17. Tom Lyche. 2020. Numerical Linear Algebra and Matrix Factorizations. Springer Nature.
  18. Pentti Paatero and Unto Tapper. 1994. Positive Matrix Factorization: A Non‐Negative Factor Model with Optimal Utilization of Error Estimates of Data Values. Environmetrics 5, 2 (June 1994), 111–126. https://doi.org/10.1002/env.3170050203
  19. Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World Environments. Computer Graphics Forum 42, 3 (June 2023), 385–396. https://doi.org/10.1111/cgf.14838
  20. Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data. Neuron 89, 2 (Jan. 2016), 285–299. https://doi.org/10.1016/j.neuron.2015.11.037
  21. Scalability in Visualization. IEEE Transactions on Visualization and Computer Graphics (2022). https://doi.org/10.1109/TVCG.2022.3231230 Early access paper.
  22. Fixation Detection for Head-Mounted Eye Tracking Based on Visual Similarity of Gaze Targets. In Proceedings of the ACM Symposium on Eye Tracking Research & Applications (ETRA ’18). Article 23, 9 pages. https://doi.org/10.1145/3204493.3204538
  23. A High-Level Description and Performance Evaluation of Pupil Invisible. https://doi.org/10.48550/arXiv.2009.00508 arXiv:2009.00508 [cs.CV]
  24. Stephen A. Vavasis. 2010. On the Complexity of Nonnegative Matrix Factorization. SIAM Journal on Optimization 20, 3 (Jan. 2010), 1364–1377. https://doi.org/10.1137/070709967
  25. Adaptive Method for Nonsmooth Nonnegative Matrix Factorization. IEEE Transactions on Neural Networks and Learning Systems 28, 4 (April 2017), 948–960. https://doi.org/10.1109/tnnls.2016.2517096
  26. Non-Negative Matrix Factorization With Dual Constraints for Image Clustering. IEEE Transactions on Systems, Man, and Cybernetics: Systems 50, 7 (July 2020), 2524–2533. https://doi.org/10.1109/tsmc.2018.2820084
  27. Visual Tracking via Constrained Incremental Non-negative Matrix Factorization. IEEE Signal Processing Letters 22, 9 (Sept. 2015), 1350–1353. https://doi.org/10.1109/lsp.2015.2404856
  28. Visual Gaze Labeling for Augmented Reality Studies. Computer Graphics Forum 42, 3 (June 2023), 373–384. https://doi.org/10.1111/cgf.14837

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets