GPT Store Mining and Analysis (2405.10210v1)
Abstract: As a pivotal extension of the renowned ChatGPT, the GPT Store serves as a dynamic marketplace for various Generative Pre-trained Transformer (GPT) models, shaping the frontier of conversational AI. This paper presents an in-depth measurement study of the GPT Store, with a focus on the categorization of GPTs by topic, factors influencing GPT popularity, and the potential security risks. Our investigation starts with assessing the categorization of GPTs in the GPT Store, analyzing how they are organized by topics, and evaluating the effectiveness of the classification system. We then examine the factors that affect the popularity of specific GPTs, looking into user preferences, algorithmic influences, and market trends. Finally, the study delves into the security risks of the GPT Store, identifying potential threats and evaluating the robustness of existing security measures. This study offers a detailed overview of the GPT Store's current state, shedding light on its operational dynamics and user interaction patterns. Our findings aim to enhance understanding of the GPT ecosystem, providing valuable insights for future research, development, and policy-making in generative AI.
- AdIntelli. 2024. AdIntelli. https://adintelli.ai/.
- Same app, different app stores: A comparative study. In 2017 IEEE/ACM 4th International Conference on Mobile Software Engineering and Systems (MOBILESoft). IEEE, 79–90.
- Apple. 2024. Apple App Store. https://apps.apple.com/sg/genre/ios/id36.
- Ofir Balassiano and David Nir Orlovsky. 2024. OpenAI Custom GPTs: What You Need to Worry About. https://www.paloaltonetworks.com/blog/prisma-cloud/openai-custom-gpts-security/.
- Rachelle Blair-Frasier. 2024. Security leaders discuss ChatGPT DDoS attack. https://www.securitymagazine.com/articles/100130-security-leaders-discuss-chatgpt-ddos-attack.
- Matt Burgess. 2023. OpenAI’s Custom Chatbots Are Leaking Their Secrets. https://www.wired.com/story/openai-custom-chatbots-gpts-prompt-injection-attacks/.
- Rishi Chandy and Haijie Gu. 2012. Identifying spam in the iOS app store. In Proceedings of the 2nd Joint WICOW/AIRWeb Workshop on Web Quality. 56–59.
- Torbjorn Flensted. 2024. GPT Store Optimization - How to Rank in the OpenAI Store. https://seo.ai/blog/gpt-store-optimization.
- Why people hate your app: Making sense of user feedback in a mobile app store. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 1276–1284.
- Google. 2024. Google Play. https://play.google.com/store/app.
- gptsapp.io. 2024. GPTs APP. https://gptsapp.io/.
- GPTStore.AI. 2024. GPTStore.AI. https://gptstore.ai/gpts.
- App store mining and analysis: MSR for app stores. In 2012 9th IEEE working conference on mining software repositories (MSR). IEEE, 108–111.
- GPTs Hunter. 2024. GPTs Hunter. https://www.gptshunter.com/.
- Smartphone and tablet application (app) life cycle characterization via Apple app store rank. Data and Information Management 4, 1 (2020), 44–67.
- A survey of app store analysis for software engineering. IEEE transactions on software engineering 43, 9 (2016), 817–847.
- OpenAI. 2023. Introducing GPTs. https://openai.com/blog/introducing-gpts.
- OpenAI. 2024a. GPT Store. https://chat.openai.com/gpts.
- OpenAI. 2024b. Introducing the GPT Store. https://openai.com/blog/introducing-the-gpt-store.
- OpenAI. 2024c. Usage policies. https://openai.com/policies/usage-policies.
- OWASP. 2023. OWASP Top 10 for LLM Applications. https://LLMtop10.com.
- Pulsr. 2024. Spamming new chats to boost ranking. https://community.openai.com/t/spamming-new-chats-to-boost-ranking/689632.
- A First Look at GPT Apps: Landscape and Vulnerability. arXiv preprint arXiv:2402.15105 (2024).
- LLM App Store Analysis: A Vision and Roadmap. arXiv preprint arXiv:2404.12737 (2024).