AI Art Curation: Re-imagining the city of Helsinki in occasion of its Biennial (2306.03753v4)
Abstract: Art curatorial practice is characterized by the presentation of an art collection in a knowledgeable way. Machine processes are characterized by their capacity to manage and analyze large amounts of data. This paper envisages AI curation and audience interaction to explore the implications of contemporary machine learning models for the curatorial world. This project was developed for the occasion of the 2023 Helsinki Art Biennial, entitled New Directions May Emerge. We use the Helsinki Art Museum (HAM) collection to re-imagine the city of Helsinki through the lens of machine perception. We use visual-textual models to place indoor artworks in public spaces, assigning fictional coordinates based on similarity scores. We transform the space that each artwork inhabits in the city by generating synthetic 360 art panoramas. We guide the generation estimating depth values from 360 panoramas at each artwork location, and machine-generated prompts of the artworks. The result of this project is an AI curation that places the artworks in their imagined physical space, blurring the lines of artwork, context, and machine perception. The work is virtually presented as a web-based installation on this link http://newlyformedcity.net/, where users can navigate an alternative version of the city while exploring and interacting with its cultural heritage at scale.
- Primitivism and Postcolonialism in the Arts. MLN 118, 4 (2003), 974–988.
- Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD ’16). ACM, New York, NY, USA, 785–794. https://doi.org/10.1145/2939672.2939785
- Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning 20, 3 (1995), 273–297.
- Audrey B Davis. 1980. A museum curator. Public Hist. 2, 4 (July 1980), 97–99.
- Ball*-tree: Efficient spatial indexing for constrained nearest-neighbor search in metric spaces. (Nov. 2015). arXiv:1511.00628 [cs.DB]
- A Flexer. [n. d.]. Discovering X Degrees of Keyword Separation in a Fine Arts Collection.
- A Flexer. 2021. Computational Filling of Curatorial Gaps in a Fine Arts Exhibition. In Proceedings of the 12th International Conference on Computational Creativity (ICCC ’21.
- Gabriella Giannachi. [n. d.]. Into the Space of the Digital Museum. In Moving Spaces, Enacting Dance, Performance, and the Digital in the Museum. https://edizionicafoscari.unive.it/en/edizioni4/libri/978-88-6969-535-3/into-the-space-of-the-digital-museum.. Accessed: 2023-4-26.
- Nathalie Heinich and Michael Pollak. 1989. Du conservateur de musée à l’auteur d’expositions : l’invention d’une position singulière. Sociol. Trav. 31, 1 (1989), 29–49.
- Tin Kam Ho. 1995. Random decision forests. In Proceedings of 3rd international conference on document analysis and recognition, Vol. 1. IEEE, 278–282.
- Anna Laura Jones. 1993. Exploding canons: The anthropology of museums. Annu. Rev. Anthropol. 22, 1 (Oct. 1993), 201–220.
- P Kompatsiaris. 2017. The Politics of Contemporary Art Biennials: Spectacles of Critique, Theory and Art. Routledge Advances in Art and Visual Studies. Routledge, New York.
- Joasia Krysa. 2014. Can Machines Curate. Digital Art: Fractures, Proliferative Preservation and Affective Dimension.
- Stuart Lloyd. 1982. Least squares quantization in PCM. IEEE transactions on information theory 28, 2 (1982), 129–137.
- ChatGPT and a new academic reality: Artificial intelligence-written research papers and the ethics of the large language models in scholarly publishing. (March 2023). arXiv:2303.13367 [cs.CL]
- Impact of Digital Twins and metaverse on cities: History, current situation, and application perspectives. Appl. Sci. (Basel) 12, 24 (Dec. 2022), 12820.
- L Manovich. 2017. Automating aesthetics: Artificial intelligence and image culture. Flash Art International 316 (2017), 1–10.
- Darío Negueruela Del Castillo. 2017. The City of Extended Emotions.
- Alex H Poole. 2016. The conceptual landscape of digital curation. J. Doc. 72, 5 (Sept. 2016), 961–986.
- Learning transferable visual models from natural language supervision. (Feb. 2021). arXiv:2103.00020 [cs.CV]
- Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE Trans. Pattern Anal. Mach. Intell. 44, 3 (March 2022), 1623–1637.
- High-resolution image synthesis with latent diffusion models. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (New Orleans, LA, USA). IEEE.
- I Sample. 2023. Science journals ban listing of ChatGPT as co-author on papers. The Guardian. St Martin’s Press.
- ESRGAN: Enhanced super-resolution generative adversarial networks. In Lecture Notes in Computer Science. Springer International Publishing, Cham, 63–79.
- Lvmin Zhang and Maneesh Agrawala. 2023. Adding conditional control to text-to-image diffusion models. (Feb. 2023). arXiv:2302.05543 [cs.CV]
- Exploring AI ethics of ChatGPT: A diagnostic analysis. (2023).