MoodSmith: Enabling Mood-Consistent Multimedia for AI-Generated Advocacy Campaigns (2403.12356v1)
Abstract: Emotion is vital to information and message processing, playing a key role in attitude formation. Consequently, creating a mood that evokes an emotional response is essential to any compelling piece of outreach communication. Many nonprofits and charities, despite having established messages, face challenges in creating advocacy campaign videos for social media. It requires significant creative and cognitive efforts to ensure that videos achieve the desired mood across multiple dimensions: script, visuals, and audio. We introduce MoodSmith, an AI-powered system that helps users explore mood possibilities for their message and create advocacy campaigns that are mood-consistent across dimensions. To achieve this, MoodSmith uses emotive language and plotlines for scripts, artistic style and color palette for visuals, and positivity and energy for audio. Our studies show that MoodSmith can effectively achieve a variety of moods, and the produced videos are consistent across media dimensions.
- Paul H Barrett. 2016. The Works of Charles Darwin: Vol 23: The Expression of the Emotions in Man and Animals. Routledge.
- E. Cavender. 2023. Why is everyone on TikTok obsessed with slideshows? https://mashable.com/article/tiktok-photo-mode-day-in-the-life Accessed: 2023-04.
- TaleBrush: Sketching stories with generative pretrained language models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19.
- James Price Dillard and Robin L Nabi. 2006. The persuasive influence of emotion in cancer prevention and detection messages. Journal of communication 56, suppl_1 (2006), S123–S139.
- James Price Dillard and Eugenia Peck. 2000. Affect and persuasion: Emotional responses to public service announcements. Communication research 27, 4 (2000), 461–495.
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.
- Patrick Colm Hogan. 2011. Affective narratology: The emotional structure of stories. U of Nebraska Press.
- Punam Anand Keller. 1999. Converting the unconverted: the effect of inclination and opportunity to discount health-related fear appeals. Journal of Applied Psychology 84, 3 (1999), 403.
- May AI? Design ideation with cooperative contextual bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
- Promoting public health messages: Should we move beyond fear-evoking appeals in road safety? Qualitative health research 17, 1 (2007), 61–74.
- Novice-AI music co-creation via AI-steering tools for deep generative models. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.
- Co-writing screenplays and theatre scripts with language models: Evaluation by industry professionals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–34.
- OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774Â [cs.CL]
- Anglekindling: Supporting journalistic angle ideation with large language models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
- William H Phillips. 2009. Film: an introduction. Macmillan.
- The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 (2005), 715–734.
- High-Resolution Image Synthesis with Latent Diffusion Models. arXiv:2112.10752Â [cs.CV]
- Steve Rubin and Maneesh Agrawala. 2014. Generating emotionally relevant musical scores for audio stories. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 439–448.
- EmoG: supporting the sketching of emotional expressions for storyboarding. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
- ReelFramer: Human-AI Co-Creation for News-to-Video Translation. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1–20.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.