Inception Attacks: Immersive Hijacking in Virtual Reality Systems (2403.05721v2)
Abstract: Today's virtual reality (VR) systems provide immersive interactions that seamlessly connect users with online services and one another. However, these immersive interfaces also introduce new vulnerabilities, making it easier for users to fall prey to new attacks. In this work, we introduce the immersive hijacking attack, where a remote attacker takes control of a user's interaction with their VR system, by trapping them inside a malicious app that masquerades as the full VR interface. Once trapped, all of the user's interactions with apps, services and other users can be recorded and modified without their knowledge. This not only allows traditional privacy attacks but also introduces new interaction attacks, where two VR users encounter vastly different immersive experiences during their interaction. We present our implementation of the immersive hijacking attack on Meta Quest headsets and conduct IRB-approved user studies that validate its efficacy and stealthiness. Finally, we examine effectiveness and tradeoffs of various potential defenses, and propose a multifaceted defense pipeline.
- 2024. Public APIs. https://github.com/public-apis/public-apis
- Anjuna. 2023. Secure Enclaves: The Powerful Way to Make Data Secure by Default. https://www.anjuna.io/resources/what-is-a-secure-enclave
- Apple. 2024. Vision Pro. https://www.apple.com/apple-vision-pro/
- AstricStore. 2024. App Launcher. https://assetstore.unity.com/packages/tools/integration/app-launcher-20454
- Harry Baker. 2021. SideQuest for Oculus Quest: Everything You Need To Know. https://www.uploadvr.com/everything-you-need-to-know-sidequest
- Man-in-the-middle attack in wireless and computer networking — A review. In Proc. of ICACCA.
- Uses of Virtual Reality for Communication in Financial Services: A Case Study on Comparing Different Telepresence Interfaces: Virtual Reality Compared to Video Conferencing. LNNS (2019).
- Immersive Virtual Reality Attacks and the Human Joystick. IEEE Trans. Dependable Secure Comput. 18, 2 (2021), 550–562.
- Exploring User Reactions and Mental Models Towards Perceptual Manipulation Attacks in Mixed Reality. In Proc. of USENIX Security.
- A Survey of Man In The Middle Attacks. IEEE Commun. Surv. Tutor 18, 3 (2016), 2027–2051.
- Paulo Costa. 2024. ADB Proxy. https://github.com/paulo-raca/adb-proxy
- Player Counter. 2024. VRChat Player Count And Statistics 2023. https://playercounter.com/vrchat/
- Android Developers. 2024a. Build web apps in WebView. https://developer.android.com/develop/ui/views/layout/webapps/webview
- Android Developers. 2024b. Connect to the network. https://developer.android.com/develop/connectivity/network-ops/connecting
- Android Developers. 2024c. Sending the user to another app. https://developer.android.com/training/basics/intents/sending
- POSTER: ReAvatar: Virtual Reality De-anonymization Attack Through Correlating Movement Signatures. In Proc. of CCS.
- Adeel Faruki et al. 2019. Virtual reality as an adjunct to anesthesia in the operating room. Trials 20 (2019), 782.
- flirtual. 2024. The first VR dating app. https://flirtu.al
- The Most Dangerous Code in the World: Validating SSL Certificates in Non-Browser Software. In Proc. of CCS.
- Hidden Reality: Caution, Your Hand Gesture Inputs in the Immersive Virtual World are Visible to All!. In Proc. of USENIX Security.
- Developing Secure Services for IoT with OP-TEE: A First Look at Performance and Usability. In Proc. of DAIS.
- Saulius Griškėnas. 2023. Secure enclaves: The key to data security. https://nordvpn.com/blog/secure-enclave/
- IBM. 2024. What is an application programming interface (API)? https://www.ibm.com/topics/api
- MIT Technology Review Insights. 2023. Augmenting the realities of work. https://www.technologyreview.com/2023/11/29/1083726/augmenting-the-realities-of-work/
- Lasse Jensen and Flemming Konradsen. 2018. A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies 23 (07 2018), 1–15.
- kiraio moe. 2024. Remove Unity Splash Screen. https://github.com/kiraio-moe/remove-unity-splash-screen
- Katleho Limakatso. 2023. How Virtual and Augmented Reality Are Changing Healthcare. https://healthnews.com/news/virtual-and-augmented-reality-boom-in-healthcare/
- I Know What You Enter on Gear VR. In Proc. of IEEE CNS.
- HoloLogger: Keystroke Inference on Mixed Reality Head Mounted Displays. In Proc. of IEEE VR.
- A Holistic Approach for Trustworthy Distributed Systems with WebAssembly and TEEs. In Proc. of OPODIS.
- Meta. 2024a. Build Immersive Audio Experiences with Audio SDK. https://developer.oculus.com/blog/build-immersive-audio-experiences-meta-quest-sdk/
- Meta. 2024b. Expand your world with Meta Quest. https://www.meta.com/quest/
- Meta. 2024c. Meta Quest Browser. https://www.meta.com/experiences/1916519981771802/
- Meta. 2024d. Meta Quest for Business. https://forwork.meta.com/quest/business-subscription/
- Meta. 2024e. Tracked keyboards for Meta Quest. https://www.meta.com/help/quest/articles/headsets-and-accessories/meta-quest-accessories/tracked-keyboards-meta-quest/
- Meta. 2024f. WHY CREATE IN VR?: Increase the pace of innovation. https://forwork.meta.com/vr-creativity-design
- Frozen Mist. 2024. FMETP STREAM. https://frozenmist.com/docs/apis/fmetp-stream/
- Monado. 2024. Monado - OpenXR Runtime. https://monado.dev
- SoK: Data Privacy in Virtual Reality. Proc. of PETS 2024, 1 (2024), 21–40.
- Exploring the Privacy Risks of Adversarial VR Game Design. Proc. of PETS 2023, 4 (2023), 238–256.
- Nmap. 2024. NMAP.ORG. https://nmap.org
- Why Eve and Mallory Still Love Android: Revisiting TLS (In)Security in Android Applications. In Proc. of USENIX Security.
- OpenHMD. 2024. Welcome to OpenHMD.net. http://www.openhmd.net
- Thierry Pul. 2024. How to Easily Sideload a VR App (.apk) to Pico Headsets. https://headjack.io/knowledge-base/how-to-sideload-a-vr-app-to-pico-headsets/
- Meta Quest. 2024. Interaction SDK Overview. https://developer.oculus.com/documentation/unity/unity-isdk-interaction-sdk-overview/
- A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education 147 (2020), 103778.
- Exploiting Out-of-band Motion Sensor Data to De-anonymize Virtual Reality Users. CoRR abs/2301.09041 (2023).
- Joachim Schuster. 2024. Check the computer’s RSA key fingerprint. https://joachimschuster.de/posts/debug-on-device-rsa-fingerprint/
- Apple Platform Security. 2021. Secure Enclave. https://support.apple.com/guide/security/secure-enclave-sec59b0b31ff/1/web/1
- Maliheh Shirvanian and Nitesh Saxena. 2014. Wiretapping via Mimicry: Short Voice Imitation Man-in-the-Middle Attacks on Crypto Phones. In Proc. of CCS.
- SideQuest. 2022. SideQuest Turns 3: New Features & 2.2 Million Monthly Active Users. https://www.uploadvr.com/sidequest-turns-3-sponsored/
- SideQuest. 2024. Custom Home. https://sidequestvr.com/apps/customhome/0/rating
- Bill Siwicki. 2023. What the metaverse and virtual reality can contribute to healthcare. https://www.healthcareitnews.com/news/what-metaverse-and-virtual-reality-can-contribute-healthcare
- Going through the motions: AR/VR keylogging from user head motions. In Proc. of USENIX Security.
- A Billion Open Interfaces for Eve and Mallory: MitM, DoS, and Tracking Attacks on iOS and macOS Through Apple Wireless Direct Link. In Proc. of USENIX Security.
- Maki Sugimoto. 2022. Cloud XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) and 5G Mobile Communication System for Medical Image-Guided Holographic Surgery and Telemedicine. 381–387.
- The Dark Side of Perceptual Manipulations in Virtual Reality. In Proc. of CHI.
- Unity. 2024a. Real-Time Development Platform. https://unity.com
- Unity. 2024b. Unity UI: Unity User Interface. https://docs.unity3d.com/Packages/[email protected]/manual/index.html
- Verizon. 2023. 2023 Mobile Security Index white paper. (11 2023).
- VIVE. 2024. Installing APK files on the headset. https://www.vive.com/us/support/focus3/category_howto/installing-apk-on-headset.html
- Rise of the Metaverse’s Immersive Virtual Reality Malware and the Man-in-the-Room Attack & Defenses. Computers & Security (09 2022).
- VRChat. 2024. Create, Share, Play. https://hello.vrchat.com
- VRVOYAGING. 2022. How to use a custom home environment in VR. https://www.vrvoyaging.com/how-to-use-a-custom-home-environment-in-vr
- Vuplex. 2024. 3D WebView: the ultimate cross-platform web browser for Unity. https://developer.vuplex.com/webview/overview
- Effect of Frame Rate on User Experience, Performance, and Simulator Sickness in Virtual Reality. IEEE Trans. Vis. Comput. Graph. 29, 5 (2023), 2478–2488.
- Wikipedia. 2024a. HTC Vive. https://en.wikipedia.org/wiki/HTC_Vive
- Wikipedia. 2024b. Oculus Rift. https://en.wikipedia.org/wiki/Oculus_Rift
- Wikipedia. 2024c. Sideloading. https://en.wikipedia.org/wiki/Sideloading
- Can Virtual Reality Protect Users from Keystroke Inference Attacks?
- Zelle. 2024. How to send money with Zelle. https://www.zellepay.com
- Tianfang Zhang et al. 2023. FaceReader: Unobtrusively Mining Vital Signs and Vital Sign Embedded Sensitive Info via AR/VR Motion Sensors. In Proc. of CCS.
- ZIMPERIUM. 2024. Sideloading. https://www.zimperium.com/glossary/sideloading/
- Zhuolin Yang (18 papers)
- Cathy Yuanchen Li (3 papers)
- Arman Bhalla (1 paper)
- Ben Y. Zhao (49 papers)
- Haitao Zheng (50 papers)