Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Exploring AI-assisted Ideation and Prototyping for Choreography (2402.13123v1)

Published 20 Feb 2024 in cs.HC

Abstract: Choreography creation is a multimodal endeavor, demanding cognitive abilities to develop creative ideas and technical expertise to convert choreographic ideas into physical dance movements. Previous endeavors have sought to reduce the complexities in the choreography creation process in both dimensions. Among them, non-AI-based systems have focused on reinforcing cognitive activities by helping analyze and understand dance movements and augmenting physical capabilities by enhancing body expressivity. On the other hand, AI-based methods have helped the creation of novel choreographic materials with generative AI algorithms. The choreography creation process is constrained by time and requires a rich set of resources to stimulate novel ideas, but the need for iterative prototyping and reduced physical dependence have not been adequately addressed by prior research. Recognizing these challenges and the research gap, we present an innovative AI-based choreography-support system. Our goal is to facilitate rapid ideation by utilizing a generative AI model that can produce diverse and novel dance sequences. The system is designed to support iterative digital dance prototyping through an interactive web-based user interface that enables the editing and modification of generated motion. We evaluated our system by inviting six choreographers to analyze its limitations and benefits and present the evaluation results along with potential directions for future work.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Adobe. 2024. Mixamo. Adobe. https://www.mixamo.com/#/
  2. Julie Akerly. 2015. Embodied Flow in Experiential Media Systems: A Study of the Dancer’s Lived Experience in a Responsive Audio System. In Proceedings of the 2nd International Workshop on Movement and Computing (Vancouver, British Columbia, Canada) (MOCO ’15). Association for Computing Machinery, New York, NY, USA, 9–16. https://doi.org/10.1145/2790994.2790997
  3. Movement Qualities as Interaction Modality. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS ’12). Association for Computing Machinery, New York, NY, USA, 761–769. https://doi.org/10.1145/2317956.2318071
  4. Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models. ACM Trans. Graph. 42, 4, Article 44 (jul 2023), 20 pages. https://doi.org/10.1145/3592458
  5. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
  6. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association, Apple Valley, NM, USA.
  7. Composition of multiple figure sequences for dance and animation. In New Advances in Computer Graphics: Proceedings of CG International’89. Springer, Springer-Verlag, Berlin, Heidelberg, 245–255.
  8. Moment by Moment: Creating Movement Sketches with Camera Stillframes. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (Glasgow, United Kingdom) (C&C ’15). Association for Computing Machinery, New York, NY, USA, 131–140. https://doi.org/10.1145/2757226.2757237
  9. Sketching Movement: Designing Creativity Tools for in-Situ, Whole-Body Authorship. In Proceedings of the 2nd International Workshop on Movement and Computing (Vancouver, British Columbia, Canada) (MOCO ’15). Association for Computing Machinery, New York, NY, USA, 68–75. https://doi.org/10.1145/2790994.2791007
  10. Everybody dance now. In Proceedings of the IEEE/CVF international conference on computer vision. IEEE, New York, NY, USA, 5933–5942.
  11. How Do Choreographers Craft Dance? Designing for a Choreographer-Technology Partnership. In Proceedings of the 3rd International Symposium on Movement and Computing (Thessaloniki, GA, Greece) (MOCO ’16). Association for Computing Machinery, New York, NY, USA, Article 20, 8 pages. https://doi.org/10.1145/2948910.2948941
  12. Knotation: exploring and documenting choreographic processes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.
  13. Dancing With Drones: Crafting Novel Artistic Expressions Through Intercorporeality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300847
  14. Seeing, Sensing and Recognizing Laban Movement Qualities. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4009–4020. https://doi.org/10.1145/3025453.3025530
  15. Petra Gemeinboeck and Rob Saunders. 2017. Movement Matters: How a Robot Becomes Body. In Proceedings of the 4th International Conference on Movement Computing (London, United Kingdom) (MOCO ’17). Association for Computing Machinery, New York, NY, USA, Article 8, 8 pages. https://doi.org/10.1145/3077981.3078035
  16. Tm2d: Bimodality driven 3d dance generation via music-text integration. In Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE, New York, NY, USA, 9942–9952.
  17. Generating Diverse and Natural 3D Human Motions From Text. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New York, NY, USA, 5152–5161.
  18. Leva Janauskaitundefined and George Palamas. 2019. Establishing Dialogues Between Movement and Atmospheric Ambiances. In Proceedings of the 6th International Conference on Movement and Computing (Tempe, AZ, USA) (MOCO ’19). Association for Computing Machinery, New York, NY, USA, Article 28, 11 pages. https://doi.org/10.1145/3347122.3359602
  19. Elizabeth Jochum and Jeroen Derks. 2019. Tonight We Improvise! Real-Time Tracking for Human-Robot Improvisational Dance. In Proceedings of the 6th International Conference on Movement and Computing (Tempe, AZ, USA) (MOCO ’19). Association for Computing Machinery, New York, NY, USA, Article 7, 11 pages. https://doi.org/10.1145/3347122.3347129
  20. Andrew Johnston. 2015. Conceptualising Interaction in Live Performance: Reflections on ’Encoded’. In Proceedings of the 2nd International Workshop on Movement and Computing (Vancouver, British Columbia, Canada) (MOCO ’15). Association for Computing Machinery, New York, NY, USA, 60–67. https://doi.org/10.1145/2790994.2791003
  21. Reinterpreting Schlemmer’s Triadic Ballet: interactive costume for unthinkable movements. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.
  22. Choreographic methods for creating novel, high quality dance. In Proceedings, DESFORM 5th international workshop on design & semantics & form. DeSForM, Northumbria University, 188–195.
  23. Vibe: Video inference for human body pose and shape estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. IEEE, New York, NY, USA, 5253–5263.
  24. Nathan Kogan. 2002. Careers in the performing arts: A psychological perspective. Communication Research Journal 14, 1 (2002), 1–16.
  25. Live dance performance investigating the feminine cyborg metaphor with a motion-activated wearable robot. In Proceedings of the 2020 ACM/IEEE international conference on human-robot interaction. Association for Computing Machinery, New York, NY, USA, 243–251.
  26. AI Choreographer: Music Conditioned 3D Dance Generation With AIST++. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, New York, NY, USA, 13401–13412.
  27. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 34, 6 (Oct. 2015), 248:1–248:16.
  28. Paul H Mason. 2012. Music, dance and the total art work: choreomusicology in theory and practice. Research in dance education 13, 1 (2012), 5–24.
  29. The Delay mirror: A technological innovation specific to the dance studio. In Proceedings of the 4th International Conference on Movement Computing. Association for Computing Machinery, New York, NY, USA, 1–6.
  30. Nvidia. 2024. Omniverse Audio2Face. Nvidia. https://www.nvidia.com/en-us/omniverse/apps/audio2face/
  31. Information capacity of full-body movements. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 1289–1298.
  32. Python. 2024. HTTP servers. Python. https://docs.python.org/3/library/http.server.html
  33. Single Motion Diffusion. arXiv:2302.05905 [cs.CV]
  34. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning. PMLR, Pittsburgh, PA, USA, 8748–8763.
  35. Choreomorphy: A whole-body interaction experience for dance improvisation and visual experimentation. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces. Association for Computing Machinery, New York, NY, USA, 1–9.
  36. The choreographer’s notebook: a video annotation system for dancers and choreographers. In Proceedings of the 8th ACM Conference on Creativity and Cognition. Association for Computing Machinery, New York, NY, USA, 197–206.
  37. Choreographic cognition: The time-course and phenomenology of creating a dance. Pragmatics & Cognition 11, 2 (2003), 297–326.
  38. Moving with and without music: scaling and lapsing in time in the performance of contemporary dance. Music Perception 26, 5 (2009), 451–464.
  39. Human Motion Diffusion Model. arXiv:2209.14916 [cs.CV]
  40. Three.js. 2024. JavaScript 3D Library. https://github.com/mrdoob/three.js.
  41. Motionma: motion modelling and analysis by demonstration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1309–1318.
  42. Music-to-Dance Generation with Multiple Conformer. In Proceedings of the 2022 International Conference on Multimedia Retrieval (Newark, NJ, USA) (ICMR ’22). Association for Computing Machinery, New York, NY, USA, 34–38. https://doi.org/10.1145/3512527.3531430
  43. A deep emulator for secondary motion of 3d characters. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, New York, NY, USA, 5932–5940.
  44. Dance and choreography in HCI: a two-decade retrospective. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–14.
  45. Here and Now: Creating Improvisational Dance Movements with a Mixed Reality Mirror. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 183, 16 pages. https://doi.org/10.1145/3544548.3580666
  46. Music2Dance: DanceNet for Music-Driven Dance Generation. ACM Trans. Multimedia Comput. Commun. Appl. 18, 2, Article 65 (feb 2022), 21 pages. https://doi.org/10.1145/3485664
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets