Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards immersive generosity: The need for a novel framework to explore large audiovisual archives through embodied experiences in immersive environments (2310.06349v1)

Published 10 Oct 2023 in cs.DL

Abstract: This article proposes an innovative framework to explore large audiovisual archives using Immersive Environments to place users inside a dataset and create an embodied experience. It starts by outlining the need for such a novel interface to meet the needs of archival scholars and the GLAM sector, and discusses issues in the current modes of access, mostly restrained to traditional information retrieval systems based on metadata. The paper presents the concept of ``generous interfaces" as a preliminary approach to address these issues, and argues some of the key reasons why employing Immersive Visual Storytelling might benefit such frameworks. The theory of embodiment is leveraged to justify this claim, showing how a more embodied understanding of a collection can result in a stronger engagement for the public. By placing users as actors in the experience rather than mere spectators, the emergence of narrative is driven by their interactions, with benefits in terms of engagement with the public and understanding of the cultural component. The framework we propose is applied to two existing installations to analyze them in-depth and critique them, highlighting the key directions to pursue for further development.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (67)
  1. Lorin W Anderson and David R Krathwohl “A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives” Longman, 2001
  2. “Towards a Narrative Theory of Virtual Reality” In Virtual Reality 7.1, 2003
  3. Marcia J Bates “What is Browsing Really? A Model Drawing from Behavioural Science Research” In Information Research - an International Electronic Journal 12.4 University of Sheffield, 2007
  4. Jill Bennett “T_Visionarium : A user’s guide” University of New South Wales Press Ltd, 2008
  5. “Spaces Speak, Are You Listening? Experiencing Aural Architecture” MIT press, 2009
  6. Benjamin Samuel Bloom “Taxonomy of Educational Objectives: The Classification of Educational Goals” In Cognitive domain Longman, 1956
  7. Neil C.M. Brown, Timothy S. Barker and Dennis Del Favero “Performing Digital Aesthetics: The Framework for a Theory of the Formation of Interactive Narratives” In Leonardo 44.3, 2011, pp. 212–219
  8. Jerome Bruner “Acts of Meaning” Harvard University Press, 1990
  9. Dagmar Brunow “Curating Access to Audiovisual Heritage: Cultural Memory and Diversity in European Film Archives” In Image [&] Narrative 18.1 Open Humanities Press, 2017, pp. 97–110
  10. Shan-Ju Chang and Ronald E Rice “Browsing: A Multidimensional Framework” In Annual Review of Information Science and Technology (ARIST) 28 ERIC, 1993, pp. 231–76
  11. Peter Dalsgaard and Lone Koefoed Hansen “Performing Perception—Staging Aesthetics of Interaction” In ACM Transactions on Computer-Human Interaction (TOCHI) 15.3 ACM New York, NY, USA, 2008, pp. 1–33
  12. Antonio R. Damasio “Looking for Spinoza: Joy, Sorrow, and the Feeling Brain” Houghton Mifflin Harcourt, 2003
  13. Antonio R. Damasio “Self Comes to Mind: Constructing the Conscious” In Brain, 2010
  14. John Dewey “Democracy and Education: An Introduction to the Philosophy of Education” LondonNew York, Free Press Macmillan, 1966
  15. John Dewey “The Later Works of John Dewey, Volume 1, 1925-1953: 1925, Experience and Nature” Carbondale: Southern Illinois University Press, 1981
  16. Marian Dörk, Sheelagh Carpendale and Carey Williamson “The Information Flaneur: A Fresh Look at Information Seeking” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011, pp. 1215–1224
  17. Paul Dourish “Seeking a Foundation for Context-Aware Computing” In Human–Computer Interaction 16.2-4 Taylor & Francis, 2001, pp. 229–241
  18. Johanna Drucker “Performative Materiality and Theoretical Approaches to Interface” In DHQ: Digital Humanities Quarterly 007.1, 2013
  19. Johanna Drucker “Graphesis: Visual Forms of Knowledge Production” Harvard University Press Cambridge, MA, 2014
  20. ENUMERATE “Survey Report on Digitisation in European Cultural Heritage Institutions 2014”, 2014 URL: http://www.enumerate.eu/fileadmin/ENUMERATE/documents/ENUMERATE-Digitisation-Survey-2014.pdf
  21. Giovanna Fossati “Found Footage Filmmaking, Film Archiving and New Participatory Platforms” In Found Footage. Cinema Exposed. Amsterdam: Amsterdam University Press/EYE Film Institute Netherlands, 2012, pp. 177–184
  22. Shaun Gallagher “How the Body Shapes the Mind” Clarendon Press, 2006
  23. “Previews and Overviews in Digital Libraries: Designing Surrogates to Support Visual Information Seeking” In Journal of the American Society for Information Science 51.4, 2000, pp. 380–393
  24. Erkki Huhtamo “Illusions in Motion: Media Archaeology of the Moving Panorama and Related Spectacles” MIT Press, 2013
  25. Mark Johnson “The Meaning of the Body: Aesthetics of Human Understanding” University of Chicago Press, 2007
  26. Mark Johnson “What Makes a Body?” In The Journal of Speculative Philosophy 22.3, 2008, pp. 159–169
  27. Mark Johnson “Embodied Understanding” In Frontiers in Psychology 6 Frontiers, 2015, pp. 875
  28. “Data Transformations and Representations for Computation and Visualization” In Information Visualization 8.4 SAGE Publications Sage UK: London, England, 2009, pp. 275–285
  29. Sarah Kenderdine “Somatic Solidarity, Magical Realism and Animating Popular Gods: Place-Hampi ”where intensities are felt”” In 2007 11th International Conference Information Visualization (IV ’07), 2007, pp. 402–408 DOI: 10.1109/IV.2007.103
  30. Sarah Kenderdine “Embodiment, Entanglement, and Immersion in Digital Cultural Heritage” In A New Companion to Digital Humanities John Wiley & Sons, Ltd, 2015, pp. 22–41 DOI: 10.1002/9781118680605.ch2
  31. Sarah Kenderdine “Experimental Museology: Immersive Visualisation and Cultural (Big) Data” In Experimental Museology, 2021, pp. 15
  32. Sarah Kenderdine, Ingrid Mason and Lily Hibberd “Computational Archives for Experimental Museology” In International Conference on Emerging Technologies and the Digital Transformation of Museums and Heritage Sites, 2021, pp. 3–18 Springer
  33. Sarah Kenderdine, Jeffrey Shaw and Tobias Gremmler “Cultural Data Sculpting: Omnidirectional Visualization for Cultural Datasets” In Knowledge Visualization Currents: From Text to Art to Culture London: Springer, 2013, pp. 199–220
  34. David R Krathwohl “A Revision of Bloom’s Taxonomy: An Overview” In Theory into practice 41.4 Taylor & Francis, 2002, pp. 212–218
  35. Richard Kurin “Safeguarding Intangible Cultural Heritage in the 2003 UNESCO Convention: a critical appraisal” In Museum International 56.1-2, 2004, pp. 66–77
  36. “CAVE: Making Collective Virtual Narrative: Best Paper Award” In Leonardo 52.4 MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info …, 2019, pp. 349–356
  37. Federico Lenzerini “Intangible Cultural Heritage: The Living Culture of Peoples” In European Journal of International Law 22.1, 2011, pp. 101–120 DOI: 10.1093/ejil/chr006
  38. Joan Llobera, Kristopher J Blom and Mel Slater “Telling Stories within Immersive Virtual Environments” In Leonardo 46.5 MIT Press, 2013, pp. 471–476
  39. “Exploring Requirements for Online Art Collections” In Proceedings of the American Society for Information Science and Technology 50.1 Wiley Online Library, 2013, pp. 1–4
  40. “Exploring Digitised Moving Image Collections: The SEMIA Project, Visual Analysis and the Turn to Abstraction” In DHQ: Digital Humanities Quarterly, 2020
  41. Helen McCorry “Museums, the Web and the Serendipity Facilitator” In MDA Information, 2001, pp. 133–135
  42. “AVIE: a Versatile Multi-User Stereo 360° Interactive VR Theatre” Association for Computing Machinery, 2007
  43. Maurice Merleau-Ponty “Phenomenology of Perception” Routledge, 2013
  44. Slavko Milekic “Towards Tangible Virtualities: Tangialities” ERIC, 2002
  45. Franco Moretti “Distant Reading” Verso Books, 2013
  46. “Data-Based Art, Algorithmic Poetry: Geert Mul in Conversation with Eef Masson” In TMG Journal for Media History 21.2 Netherlands Institute for SoundVision, 2018
  47. “Data-driven Research for Film History: Exploring the Jean Desmet Collection” In Moving Image: The Journal of the Association of Moving Image Archivists 16.1 JSTOR, 2016, pp. 82–105
  48. Jean Piaget “To Understand is to Invent: The Future of Education”, 1973
  49. Robert M. Pirsig “Zen and the Art of Motorcycle Maintenance” William MorrowCompany, 1974
  50. Cambridge University Press “Definition of serendipity from the Cambridge Advanced Learner’s Dictionary and Thesaurus”, 2021 URL: https://dictionary.cambridge.org/dictionary/english/serendipity
  51. Ronald E Rice, Maureen McCreadie and Shan-Ju L Chang “Accessing and Browsing Information and Communication” MIT Press, 2001
  52. “Surprise Machines: Revealing Harvard Art Museums’ Image Collection” In Information Design Journal, forthcoming
  53. Katja Rogers, Uta Hinrichs and Aaron Quigley “It doesn’t Compare to Being There: In-situ vs. Remote Exploration of Museum Collections”, 2014
  54. RTSArchives “Le nouveau site RTSarchives”, 2018 URL: https://www.rts.ch/archives/5919889-le-nouveau-site-rtsarchives.html
  55. G Scagnetti “Visual Epistemology for Design in Complex Systems, lecture at Tecnológica de Monterrey: Academic leaders’ program”, 2011
  56. Maxine Sheets-Johnstone “The primacy of Movement” John Benjamins Publishing, 2011
  57. “Information Visualisation Methods and Techniques: State-of-the-art and Future Directions” In Journal of Industrial Information Integration 16 Elsevier, 2019, pp. 100–102
  58. Ben Shneiderman “The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations” In The Craft of Information Visualization Morgan Kaufmann, 2003, pp. 364–371
  59. “A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments” In Presence: Teleoperators and Virtual Environments 6.6, 1997, pp. 603–616 DOI: 10.1162/pres.1997.6.6.603
  60. Daniel N Stern “The Interpersonal World of the Infant: A View from Psychoanalysis and Developmental Psychology” Routledge, 2018
  61. Robert J Sternberg and Sareh Karami “An 8P Theoretical Framework for Understanding Creativity and Theories of Creativity” In The Journal of Creative Behavior 56.1 Wiley Online Library, 2022, pp. 55–78
  62. Jonathan Steuer “Defining Virtual Reality: Dimensions Determining Telepresence” In Journal of communication 42.4 Wiley Online Library, 1992, pp. 73–93
  63. Elaine G Toms “Serendipitous Information Retrieval” In DELOS, 2000
  64. Mitchell Whitelaw “Generous Interfaces for Digital Cultural Collections” In DHQ: Digital Humanities Quarterly, 2015
  65. “Visualization of Cultural Heritage Collection Data: State of the Art and Future Challenges” In IEEE Transactions on Visualization and Computer Graphics 25.6, 2019, pp. 2311–2330 DOI: 10.1109/TVCG.2018.2830759
  66. R. Wright “The Future of Television Archives - Digital Preservation Coalition”, 2017 URL: https://www.dpconline.org/blog/wdpd/the-future-of-television-archives
  67. Tom Ziemke, Jordan Zlatev and Roslyn M Frank “Body, Language, and Mind” Walter de Gruyter, 2007
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Giacomo Alliata (2 papers)
  2. Sarah Kenderdine (2 papers)
  3. Lily Hibberd (1 paper)
  4. Ingrid Mason (1 paper)
Citations (1)

Summary

We haven't generated a summary for this paper yet.