Contextualizing Internet Memes Across Social Media Platforms (2311.11157v2)
Abstract: Internet memes have emerged as a novel format for communication and expressing ideas on the web. Their fluidity and creative nature are reflected in their widespread use, often across platforms and occasionally for unethical or harmful purposes. While computational work has already analyzed their high-level virality over time and developed specialized classifiers for hate speech detection, there have been no efforts to date that aim to holistically track, identify, and map internet memes posted on social media. To bridge this gap, we investigate whether internet memes across social media platforms can be contextualized by using a semantic repository of knowledge, namely, a knowledge graph. We collect thousands of potential internet meme posts from two social media platforms, namely Reddit and Discord, and develop an extract-transform-load procedure to create a data lake with candidate meme posts. By using vision transformer-based similarity, we match these candidates against the memes cataloged in IMKG -- a recently released knowledge graph of internet memes. We leverage this grounding to highlight the potential of our proposed framework to study the prevalence of memes on different platforms, map them to IMKG, and provide context about memes on social media.
- A multimodal memes classification: A survey and open research issues. In Innovations in Smart Cities Applications Volume 4: The Proceedings of the 5th International Conference on Smart City Applications. Springer, 1451–1466.
- Flamingo: a visual language model for few-shot learning. Advances in Neural Information Processing Systems 35 (2022), 23716–23736.
- Dank or not? Analyzing and predicting the popularity of memes on Reddit. Applied Network Science 6, 1 (2021), 1–24.
- Mathematical models of fads explain the temporal dynamics of internet memes. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7. 22–30.
- W Lance Bennett. 2003. The internet and global activism. Contesting media power: Alternative media in a networked world. Oxford: Rowman & Littlefield (2003), 17–37.
- Jan Blommaert and Piia Varis. 2015. Conviviality and collectives on social media: Virality, memes, and new social structures. Multilingual Margins: A journal of multilingualism from the periphery 2, 1 (2015), 31–31.
- Cody Buntain and Jennifer Golbeck. 2014. Identifying Social Roles in Reddit Using Network Structure. In Proceedings of the 23rd International Conference on World Wide Web (Seoul, Korea) (WWW ’14 Companion). Association for Computing Machinery, New York, NY, USA, 615–620. https://doi.org/10.1145/2567948.2579231
- Prompting for multimodal hateful meme classification. arXiv preprint arXiv:2302.04156 (2023).
- When vision transformers outperform resnets without pre-training or strong data augmentations. arXiv preprint arXiv:2106.01548 (2021).
- Yuyang Chen and Feng Pan. 2022. Multimodal detection of hateful memes by applying a vision-language pre-training model. Plos one 17, 9 (2022), e0274300.
- Detecting hate speech in multi-modal memes. arXiv preprint arXiv:2012.14891 (2020).
- Patrick Davison. 2012. The language of internet memes. The social media reader (2012), 120–134.
- Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248–255.
- Arturo Deza and Devi Parikh. 2015. Understanding image virality. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1818–1826.
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv:2010.11929 [cs.CV]
- Exposing influence campaigns in the age of LLMs: a behavioral-based AI approach to detecting state-sponsored trolls. EPJ Data Science 12, 1 (2023), 46.
- Tabitha Fairchild. 2020. It’s funny because it’s true: The transmission of explicit and implicit racism in internet memes. (2020).
- SemEval-2022 Task 5: Multimedia automatic misogyny identification. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022). 533–549.
- Summer Harlow et al. 2013. It was a” Facebook revolution”: Exploring the meme-like spread of narratives during the Egyptian protests. Revista de comunicación 12, 1 (2013), 59–82.
- Billion-scale similarity search with GPUs. IEEE Transactions on Big Data 7, 3 (2019), 535–547.
- Anya Kamenetz. 2018. Right-Wing Hate Groups Are Recruiting Video Gamers. https://www.npr.org/2018/11/05/660642531/right-wing-hate-groups-are-recruiting-video-gamers Accessed: 2023-08-16.
- The hateful memes challenge: Detecting hate speech in multimodal memes. Advances in neural information processing systems 33 (2020), 2611–2624.
- The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes. arXiv:2005.04790 [cs.AI]
- Do Millennials read books or blogs? Introducing a media usage typology of the internet generation. Journal of Consumer Marketing 29, 2 (2012), 114–124.
- Memes in the wild: Assessing the generalizability of the hateful memes challenge dataset. arXiv preprint arXiv:2107.04313 (2021).
- MemeGraphs: Linking Memes to Knowledge Graphs. arXiv preprint arXiv:2305.18391 (2023).
- Dissecting the meme magic: Understanding indicators of virality in image memes. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–24.
- Measurement and control of geo-location privacy on Twitter. Online social networks and media 17 (2020), 100078.
- Social influence (deep) learning for human behavior prediction. In Complex Networks IX: Proceedings of the 9th Conference on Complex Networks CompleNet 2018 9. Springer, 261–269.
- Down the bot hole: Actionable insights from a one-year analysis of bot activity on Twitter. First Monday (2021).
- Social media against society. The Internet and the 2020 Campaign 2021 (2021), 1.
- Gabriele Marino. 2015. Semiotics of spreadability: A systematic approach to Internet memes and virality. (2015).
- Adrienne Massanari. 2017. #Gamergate and The Fappening: How Reddit’s algorithm, governance, and culture support toxic technocultures. New Media & Society 19, 3 (2017), 329–346. https://doi.org/10.1177/1461444815608807 arXiv:https://doi.org/10.1177/1461444815608807
- Christian Mathis. 2017. Data lakes. Datenbank-Spektrum 17, 3 (2017), 289–293.
- Adam J Mills. 2012. Virality in social media: the SPIN framework. Journal of public affairs 12, 2 (2012), 162–169.
- Hip and trendy: Characterizing emerging trends on Twitter. Journal of the American Society for Information Science and Technology 62, 5 (2011), 902–918.
- Joshua Troy Nieubuurt. 2021. Internet Memes: Leaflet Propaganda of the Digital Age. In Frontiers in Communication. https://api.semanticscholar.org/CorpusID:231607158
- Keiron O’Shea and Ryan Nash. 2015. An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458 (2015).
- Sung Kyun Park. 2020. Understanding usage of memes over social medias through semantics: A survey. In 2020 IEEE 14th International Conference on Semantic Computing (ICSC). IEEE, 387–392.
- On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning. In 2023 IEEE Symposium on Security and Privacy (SP). IEEE Computer Society, Los Alamitos, CA, USA, 293–310. https://doi.org/10.1109/SP46215.2023.10179315
- Amazon Web Services. 2023a. AWS CloudWatch. https://aws.amazon.com/cloudwatch/ Accessed: 2023-08-16.
- Amazon Web Services. 2023b. AWS Lambda. https://aws.amazon.com/lambda/ Accessed: 2023-08-16.
- Amazon Web Services. 2023c. AWS S3. https://aws.amazon.com/s3/ Accessed: 2023-08-16.
- Victoria Sherratt. 2022. Towards Contextually Sensitive Analysis of Memes: Meme Genealogy and Knowledge Base. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence (IJCAI-22), Vienna, Austria. 5871–5872.
- Evolution of reddit: from the front page of the internet to a self-referential community?. In Proceedings of the 23rd international conference on world wide web. 517–522.
- Flava: A foundational language and vision alignment model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 15638–15650.
- Multimodal meme dataset (MultiOFF) for identifying offensive content in image and text. In Proceedings of the second workshop on trolling, aggression and cyberbullying. 32–41.
- Viriya Taecharungroj and Pitchganut Nueangjamnong. 2014. The effect of humour on virality: The study of Internet memes on social media. In 7th International Forum on Public Relations and Advertising Media Impacts on Culture and Social Communication. Bangkok, August.
- Viriya Taecharungroj and Pitchanut Nueangjamnong. 2015. Humour 2.0: Styles and types of humour and virality of memes on Facebook. Journal of Creative Communications 10, 3 (2015), 288–302.
- Multimodal and explainable internet meme classification. NeSy (2023).
- IMKG: The Internet Meme Knowledge Graph. In The Semantic Web: 20th International Conference, ESWC 2023, Hersonissos, Crete, Greece, May 28–June 1, 2023, Proceedings (Hersonissos, Greece). Springer-Verlag, Berlin, Heidelberg, 354–371. https://doi.org/10.1007/978-3-031-33455-9_21
- Oren Tsur and Ari Rappoport. 2015. Don’t let me be# misunderstood: Linguistically motivated algorithm for predicting the popularity of textual memes. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 9. 426–435.
- Camilla Vásquez. 2019. Language, creativity and humour online. Routledge.
- Panos Vassiliadis. 2009. A survey of extract–transform–load technology. International Journal of Data Warehousing and Mining (IJDWM) 5, 3 (2009), 1–27.
- Attention is all you need. Advances in neural information processing systems 30 (2017).
- Denny Vrandečić and Markus Krötzsch. 2014. Wikidata: a free collaborative knowledgebase. Commun. ACM 57, 10 (2014), 78–85.
- Lin Wang and Brendan C Wood. 2011. An epidemiological approach to model the viral propagation of memes. Applied Mathematical Modelling 35, 11 (2011), 5442–5447.
- Competition among memes in a world with limited attention. Scientific reports 2, 1 (2012), 335.
- Predicting successful memes using network and community structure. In Proceedings of the international AAAI conference on web and social media, Vol. 8. 535–544.
- Visual Transformers: Token-based Image Representation and Processing for Computer Vision. arXiv:2006.03677 [cs.CV]
- On the origins of memes by means of fringe web communities. In Proceedings of the internet measurement conference 2018. 188–202.
- Saurav Joshi (3 papers)
- Filip Ilievski (53 papers)
- Luca Luceri (52 papers)