Towards immersive generosity: The need for a novel framework to explore large audiovisual archives through embodied experiences in immersive environments (2310.06349v1)
Abstract: This article proposes an innovative framework to explore large audiovisual archives using Immersive Environments to place users inside a dataset and create an embodied experience. It starts by outlining the need for such a novel interface to meet the needs of archival scholars and the GLAM sector, and discusses issues in the current modes of access, mostly restrained to traditional information retrieval systems based on metadata. The paper presents the concept of ``generous interfaces" as a preliminary approach to address these issues, and argues some of the key reasons why employing Immersive Visual Storytelling might benefit such frameworks. The theory of embodiment is leveraged to justify this claim, showing how a more embodied understanding of a collection can result in a stronger engagement for the public. By placing users as actors in the experience rather than mere spectators, the emergence of narrative is driven by their interactions, with benefits in terms of engagement with the public and understanding of the cultural component. The framework we propose is applied to two existing installations to analyze them in-depth and critique them, highlighting the key directions to pursue for further development.
- Lorin W Anderson and David R Krathwohl “A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives” Longman, 2001
- “Towards a Narrative Theory of Virtual Reality” In Virtual Reality 7.1, 2003
- Marcia J Bates “What is Browsing Really? A Model Drawing from Behavioural Science Research” In Information Research - an International Electronic Journal 12.4 University of Sheffield, 2007
- Jill Bennett “T_Visionarium : A user’s guide” University of New South Wales Press Ltd, 2008
- “Spaces Speak, Are You Listening? Experiencing Aural Architecture” MIT press, 2009
- Benjamin Samuel Bloom “Taxonomy of Educational Objectives: The Classification of Educational Goals” In Cognitive domain Longman, 1956
- Neil C.M. Brown, Timothy S. Barker and Dennis Del Favero “Performing Digital Aesthetics: The Framework for a Theory of the Formation of Interactive Narratives” In Leonardo 44.3, 2011, pp. 212–219
- Jerome Bruner “Acts of Meaning” Harvard University Press, 1990
- Dagmar Brunow “Curating Access to Audiovisual Heritage: Cultural Memory and Diversity in European Film Archives” In Image [&] Narrative 18.1 Open Humanities Press, 2017, pp. 97–110
- Shan-Ju Chang and Ronald E Rice “Browsing: A Multidimensional Framework” In Annual Review of Information Science and Technology (ARIST) 28 ERIC, 1993, pp. 231–76
- Peter Dalsgaard and Lone Koefoed Hansen “Performing Perception—Staging Aesthetics of Interaction” In ACM Transactions on Computer-Human Interaction (TOCHI) 15.3 ACM New York, NY, USA, 2008, pp. 1–33
- Antonio R. Damasio “Looking for Spinoza: Joy, Sorrow, and the Feeling Brain” Houghton Mifflin Harcourt, 2003
- Antonio R. Damasio “Self Comes to Mind: Constructing the Conscious” In Brain, 2010
- John Dewey “Democracy and Education: An Introduction to the Philosophy of Education” LondonNew York, Free Press Macmillan, 1966
- John Dewey “The Later Works of John Dewey, Volume 1, 1925-1953: 1925, Experience and Nature” Carbondale: Southern Illinois University Press, 1981
- Marian Dörk, Sheelagh Carpendale and Carey Williamson “The Information Flaneur: A Fresh Look at Information Seeking” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011, pp. 1215–1224
- Paul Dourish “Seeking a Foundation for Context-Aware Computing” In Human–Computer Interaction 16.2-4 Taylor & Francis, 2001, pp. 229–241
- Johanna Drucker “Performative Materiality and Theoretical Approaches to Interface” In DHQ: Digital Humanities Quarterly 007.1, 2013
- Johanna Drucker “Graphesis: Visual Forms of Knowledge Production” Harvard University Press Cambridge, MA, 2014
- ENUMERATE “Survey Report on Digitisation in European Cultural Heritage Institutions 2014”, 2014 URL: http://www.enumerate.eu/fileadmin/ENUMERATE/documents/ENUMERATE-Digitisation-Survey-2014.pdf
- Giovanna Fossati “Found Footage Filmmaking, Film Archiving and New Participatory Platforms” In Found Footage. Cinema Exposed. Amsterdam: Amsterdam University Press/EYE Film Institute Netherlands, 2012, pp. 177–184
- Shaun Gallagher “How the Body Shapes the Mind” Clarendon Press, 2006
- “Previews and Overviews in Digital Libraries: Designing Surrogates to Support Visual Information Seeking” In Journal of the American Society for Information Science 51.4, 2000, pp. 380–393
- Erkki Huhtamo “Illusions in Motion: Media Archaeology of the Moving Panorama and Related Spectacles” MIT Press, 2013
- Mark Johnson “The Meaning of the Body: Aesthetics of Human Understanding” University of Chicago Press, 2007
- Mark Johnson “What Makes a Body?” In The Journal of Speculative Philosophy 22.3, 2008, pp. 159–169
- Mark Johnson “Embodied Understanding” In Frontiers in Psychology 6 Frontiers, 2015, pp. 875
- “Data Transformations and Representations for Computation and Visualization” In Information Visualization 8.4 SAGE Publications Sage UK: London, England, 2009, pp. 275–285
- Sarah Kenderdine “Somatic Solidarity, Magical Realism and Animating Popular Gods: Place-Hampi ”where intensities are felt”” In 2007 11th International Conference Information Visualization (IV ’07), 2007, pp. 402–408 DOI: 10.1109/IV.2007.103
- Sarah Kenderdine “Embodiment, Entanglement, and Immersion in Digital Cultural Heritage” In A New Companion to Digital Humanities John Wiley & Sons, Ltd, 2015, pp. 22–41 DOI: 10.1002/9781118680605.ch2
- Sarah Kenderdine “Experimental Museology: Immersive Visualisation and Cultural (Big) Data” In Experimental Museology, 2021, pp. 15
- Sarah Kenderdine, Ingrid Mason and Lily Hibberd “Computational Archives for Experimental Museology” In International Conference on Emerging Technologies and the Digital Transformation of Museums and Heritage Sites, 2021, pp. 3–18 Springer
- Sarah Kenderdine, Jeffrey Shaw and Tobias Gremmler “Cultural Data Sculpting: Omnidirectional Visualization for Cultural Datasets” In Knowledge Visualization Currents: From Text to Art to Culture London: Springer, 2013, pp. 199–220
- David R Krathwohl “A Revision of Bloom’s Taxonomy: An Overview” In Theory into practice 41.4 Taylor & Francis, 2002, pp. 212–218
- Richard Kurin “Safeguarding Intangible Cultural Heritage in the 2003 UNESCO Convention: a critical appraisal” In Museum International 56.1-2, 2004, pp. 66–77
- “CAVE: Making Collective Virtual Narrative: Best Paper Award” In Leonardo 52.4 MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info …, 2019, pp. 349–356
- Federico Lenzerini “Intangible Cultural Heritage: The Living Culture of Peoples” In European Journal of International Law 22.1, 2011, pp. 101–120 DOI: 10.1093/ejil/chr006
- Joan Llobera, Kristopher J Blom and Mel Slater “Telling Stories within Immersive Virtual Environments” In Leonardo 46.5 MIT Press, 2013, pp. 471–476
- “Exploring Requirements for Online Art Collections” In Proceedings of the American Society for Information Science and Technology 50.1 Wiley Online Library, 2013, pp. 1–4
- “Exploring Digitised Moving Image Collections: The SEMIA Project, Visual Analysis and the Turn to Abstraction” In DHQ: Digital Humanities Quarterly, 2020
- Helen McCorry “Museums, the Web and the Serendipity Facilitator” In MDA Information, 2001, pp. 133–135
- “AVIE: a Versatile Multi-User Stereo 360° Interactive VR Theatre” Association for Computing Machinery, 2007
- Maurice Merleau-Ponty “Phenomenology of Perception” Routledge, 2013
- Slavko Milekic “Towards Tangible Virtualities: Tangialities” ERIC, 2002
- Franco Moretti “Distant Reading” Verso Books, 2013
- “Data-Based Art, Algorithmic Poetry: Geert Mul in Conversation with Eef Masson” In TMG Journal for Media History 21.2 Netherlands Institute for SoundVision, 2018
- “Data-driven Research for Film History: Exploring the Jean Desmet Collection” In Moving Image: The Journal of the Association of Moving Image Archivists 16.1 JSTOR, 2016, pp. 82–105
- Jean Piaget “To Understand is to Invent: The Future of Education”, 1973
- Robert M. Pirsig “Zen and the Art of Motorcycle Maintenance” William MorrowCompany, 1974
- Cambridge University Press “Definition of serendipity from the Cambridge Advanced Learner’s Dictionary and Thesaurus”, 2021 URL: https://dictionary.cambridge.org/dictionary/english/serendipity
- Ronald E Rice, Maureen McCreadie and Shan-Ju L Chang “Accessing and Browsing Information and Communication” MIT Press, 2001
- “Surprise Machines: Revealing Harvard Art Museums’ Image Collection” In Information Design Journal, forthcoming
- Katja Rogers, Uta Hinrichs and Aaron Quigley “It doesn’t Compare to Being There: In-situ vs. Remote Exploration of Museum Collections”, 2014
- RTSArchives “Le nouveau site RTSarchives”, 2018 URL: https://www.rts.ch/archives/5919889-le-nouveau-site-rtsarchives.html
- G Scagnetti “Visual Epistemology for Design in Complex Systems, lecture at Tecnológica de Monterrey: Academic leaders’ program”, 2011
- Maxine Sheets-Johnstone “The primacy of Movement” John Benjamins Publishing, 2011
- “Information Visualisation Methods and Techniques: State-of-the-art and Future Directions” In Journal of Industrial Information Integration 16 Elsevier, 2019, pp. 100–102
- Ben Shneiderman “The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations” In The Craft of Information Visualization Morgan Kaufmann, 2003, pp. 364–371
- “A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments” In Presence: Teleoperators and Virtual Environments 6.6, 1997, pp. 603–616 DOI: 10.1162/pres.1997.6.6.603
- Daniel N Stern “The Interpersonal World of the Infant: A View from Psychoanalysis and Developmental Psychology” Routledge, 2018
- Robert J Sternberg and Sareh Karami “An 8P Theoretical Framework for Understanding Creativity and Theories of Creativity” In The Journal of Creative Behavior 56.1 Wiley Online Library, 2022, pp. 55–78
- Jonathan Steuer “Defining Virtual Reality: Dimensions Determining Telepresence” In Journal of communication 42.4 Wiley Online Library, 1992, pp. 73–93
- Elaine G Toms “Serendipitous Information Retrieval” In DELOS, 2000
- Mitchell Whitelaw “Generous Interfaces for Digital Cultural Collections” In DHQ: Digital Humanities Quarterly, 2015
- “Visualization of Cultural Heritage Collection Data: State of the Art and Future Challenges” In IEEE Transactions on Visualization and Computer Graphics 25.6, 2019, pp. 2311–2330 DOI: 10.1109/TVCG.2018.2830759
- R. Wright “The Future of Television Archives - Digital Preservation Coalition”, 2017 URL: https://www.dpconline.org/blog/wdpd/the-future-of-television-archives
- Tom Ziemke, Jordan Zlatev and Roslyn M Frank “Body, Language, and Mind” Walter de Gruyter, 2007
- Giacomo Alliata (2 papers)
- Sarah Kenderdine (2 papers)
- Lily Hibberd (1 paper)
- Ingrid Mason (1 paper)