Papers
Topics
Authors
Recent
Search
2000 character limit reached

MetaTrading: An Immersion-Aware Model Trading Framework for Vehicular Metaverse Services

Published 25 Oct 2024 in cs.LG, cs.CR, and cs.GT | (2410.19665v2)

Abstract: Timely updating of Internet of Things (IoT) data is crucial for immersive vehicular metaverse services. However, challenges such as latency caused by massive data transmissions, privacy risks associated with user data, and computational burdens on metaverse service providers (MSPs) hinder continuous collection of high-quality data. To address these issues, we propose an immersion-aware model trading framework that facilitates data provision for services while ensuring privacy through federated learning (FL). Specifically, we first develop a novel multi-dimensional metric, the immersion of model (IoM), which assesses model value comprehensively by considering freshness and accuracy of learning models, as well as the amount and potential value of raw data used for training. Then, we design an incentive mechanism to incentivize metaverse users (MUs) to contribute high-value models under resource constraints. The trading interactions between MSPs and MUs are modeled as an equilibrium problem with equilibrium constraints (EPEC) to analyze and balance their costs and gains, where MSPs as leaders determine rewards, while MUs as followers optimize resource allocation. Furthermore, considering dynamic network conditions and privacy concerns, we formulate the reward decisions of MSPs as a multi-agent Markov decision process. To solve this, we develop a fully distributed dynamic reward algorithm based on deep reinforcement learning, without accessing any private information about MUs and other MSPs. Experimental results demonstrate that the proposed framework outperforms state-of-the-art benchmarks, achieving improvements in IoM of 38.3% and 37.2%, and reductions in training time to reach the target accuracy of 43.5% and 49.8%, on average, for the MNIST and GTSRB datasets, respectively.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Y. Wang, Z. Su, N. Zhang, R. Xing, D. Liu, T. H. Luan, and X. Shen, “A survey on metaverse: Fundamentals, security, and privacy,” IEEE Communications Surveys & Tutorials, vol. 25, no. 1, pp. 319–352, First Quarter 2023.
  2. M. Maier, A. Ebrahimzadeh, S. Rostami, and A. Beniiche, “The Internet of no things: Making the internet disappear and see the invisible,” IEEE Commun. Mag., vol. 58, no. 11, pp. 76–82, Nov. 2020.
  3. Y. Ma, Z. Wang, H. Yang, and L. Yang, “Artificial intelligence applications in the development of autonomous vehicles: A survey,” IEEE/CAA J. Autom. Sinica, vol. 7, no. 2, pp. 315–329, Mar. 2020.
  4. L. Liu, H. Li, and M. Gruteser, “Edge assisted real-time object detection for mobile augmented reality,” in Proc. 25th Annu. Int. Conf. Mobile Comput. Netw., Los Cabos, Mexico, Aug. 2019, pp. 1–16.
  5. J. N. Njoku, C. I. Nwakanma, G. C. Amaizu, and D.-S. Kim, “Prospects and challenges of metaverse application in data-driven intelligent transportation systems,” IET Intelligent Transport Systems, vol. 17, no. 1, pp. 1–21, Jan. 2023.
  6. R. D. Yates, Y. Sun, D. R. Brown, S. K. Kaul, E. Modiano, and S. Ulukus, “Age of information: An introduction and survey,” IEEE J. Sel. Areas Commun., vol. 39, no. 5, pp. 1183–1210, May. 2021.
  7. M. Jia and W. Liang, “Delay-sensitive multiplayer augmented reality game planning in mobile edge computing,” in Proc. 21st ACM Int. Conf. Model. Anal. Simul. Wireless Mobile Syst., Montreal, QC, Canada, Oct. 2018, pp. 147–154.
  8. J. A. De Guzman, K. Thilakarathna, and A. Seneviratne, “Security and privacy approaches in mixed reality: A literature survey,” ACM Comput. Surv., vol. 52, no. 110, pp. 1–37, Oct. 2019.
  9. N. H. Tran, W. Bao, A. Zomaya, M. N. Nguyen, and C. S. Hong, “Federated learning over wireless networks: Optimization model design and analysis,” in Proc. IEEE Conf. Comput. Commun., Paris, France, May. 2019, pp. 1387–1395.
  10. N. Raveendran, H. Zhang, L. Song, L.-C. Wang, C. S. Hong, and Z. Han, “Pricing and resource allocation optimization for IoT fog computing and NFV: An EPEC and matching based perspective,” IEEE Trans. Mobile Comput., vol. 21, no. 4, pp. 1349–1361, Sep. 2020.
  11. M. Xu, D. Niyato, J. Kang, Z. Xiong, C. Miao, and D. I. Kim, “Wireless edge-empowered metaverse: A learning-based incentive mechanism for virtual reality,” in Proc. IEEE Int. Conf. Commun. (ICC), Seoul, South Korea, May. 2022, pp. 5220–5225.
  12. W. Sun, P. Wang, N. Xu, G. Wang, and Y. Zhang, “Dynamic digital twin and distributed incentives for resource allocation in aerial-assisted internet of vehicles,” IEEE Internet of Things Journal, vol. 9, no. 8, pp. 5839–5852, Apr. 2022.
  13. Y. Jiang, J. Kang, D. Niyato, X. Ge, Z. Xiong, C. Miao, and X. Shen, “Reliable distributed computing for metaverse: A hierarchical game-theoretic approach,” IEEE Transactions on Vehicular Technology, vol. 72, no. 1, pp. 1084–1100, Jan. 2023.
  14. Y. Han, D. Niyato, C. Leung, D. I. Kim, K. Zhu, S. Feng, X. Shen, and C. Miao, “A dynamic hierarchical framework for iot-assisted digital twin synchronization in the metaverse,” IEEE Internet of Things Journal, vol. 10, no. 1, pp. 268–284, Jan. 2023.
  15. X. Lin, J. Wu, J. Li, W. Yang, and M. Guizani, “Stochastic digital-twin service demand with edge response: An incentive-based congestion control approach,” IEEE Trans. Mobile Comput., vol. 22, no. 4, pp. 2402–2416, Apr. 2023.
  16. C. T. Nguyen, D. T. Hoang, D. N. Nguyen, and E. Dutkiewicz, “Metachain: A novel blockchain-based framework for metaverse applications,” in Proc. IEEE 95th Veh. Technol. Conf. (VTC-Spring), Helsinki, Finland, Jun. 2022.
  17. V. Cozzolino, L. Tonetto, N. Mohan, A. Y. Ding, and J. Ott, “Nimbus: Towards latency-energy efficient task offloading for ar services,” IEEE Transactions on Cloud Computing, vol. 11, no. 2, pp. 1530–1545, Apr. 2023.
  18. D. Chen, L. J. Xie, B. Kim, L. Wang, C. S. Hong, L.-C. Wang, and Z. Han, “Federated learning based mobile edge computing for augmented reality applications,” in International Conference on Computing, Networking and Communications (ICNC), Big Island, HI, Feb. 2020, pp. 767–773.
  19. W. Y. B. Lim, Z. Xiong, D. Niyato, X. Cao, C. Miao, S. Sun, and Q. Yang, “Realizing the metaverse with edge intelligence: A match made in heaven,” IEEE Wireless Commun., vol. 30, no. 4, pp. 64–71, Aug. 2023.
  20. Y. Lu, X. Huang, K. Zhang, S. Maharjan, and Y. Zhang, “Communication-efficient federated learning for digital twin edge networks in industrial IoT,” IEEE Transactions on Industrial Informatics, vol. 17, no. 8, pp. 5709–5718, Aug. 2021.
  21. W. Y. B. Lim, N. C. Luong, D. T. Hoang, Y. Jiao, Y.-C. Liang, Q. Yang, D. Niyato, and C. Miao, “Federated learning in mobile edge networks: A comprehensive survey,” IEEE Communications Surveys & Tutorials, vol. 22, no. 3, pp. 2031–2063, Third Quarter 2020.
  22. L. Gao, H. Fu, L. Li, Y. Chen, M. Xu, and C.-Z. Xu, “FedDC: Federated learning with non-iid data via local drift decoupling and correction,” in Proc. of CVPR, New Orleans, LA, Jun. 2022, pp. 10 112–10 121.
  23. E. Najm, R. Yates, and E. Soljanin, “Status updates through m/g/1/1 queues with HARQ,” in Proc. of ISIT, Aachen, Germany, Jun. 2017, pp. 131–135.
  24. Y. Zhan, P. Li, Z. Qu, D. Zeng, and S. Guo, “A learning-based incentive mechanism for federated learning,” IEEE Internet of Things Journal, vol. 7, no. 7, pp. 6360–6368, Jan. 2020.
  25. S. Jiang and J. Wu, “A reward response game in the federated learning system,” in Proc. of MASS, Virtual Conference, Oct. 2021, pp. 127–135.
  26. X. Lin, J. Wu, J. Li, X. Zheng, and G. Li, “Friend-as-learner: Socially-driven trustworthy and efficient wireless federated edge learning,” IEEE Trans. Mobile Comput., vol. 22, no. 1, pp. 269–283, Jan. 2021.
  27. D. Yang, G. Xue, X. Fang, and J. Tang, “Incentive mechanisms for crowdsensing: Crowdsourcing with smartphones,” IEEE/ACM Trans. Netw., vol. 24, no. 3, pp. 1732–1744, Jun. 2016.
  28. W. Y. B. Lim, Z. Xiong, J. Kang, D. Niyato, C. Leung, C. Miao, and X. Shen, “When information freshness meets service latency in federated learning: A task-aware incentive scheme for smart industries,” IEEE Transactions on Industrial Informatics, vol. 18, no. 1, pp. 457–466, Jan. 2022.
  29. B. S. Mordukhovich, “Equilibrium problems with equilibrium constraints via multiobjective optimization,” Optimization Methods and Software, vol. 19, no. 5, pp. 479–492, Oct. 2004.
  30. H. Shah-Mansouri, V. W. Wong, and J. Huang, “An incentive framework for mobile data offloading market under price competition,” IEEE Trans. Mobile Comput., vol. 16, no. 11, pp. 2983–2999, Nov. 2017.
  31. F. Liu, X. Dong, J. Yu, Y. Hua, Q. Li, and Z. Ren, “Distributed nash equilibrium seeking of n𝑛nitalic_n-coalition noncooperative games with application to uav swarms,” IEEE Transactions on Network Science and Engineering, vol. 9, no. 4, pp. 2392–2405, Aug. 2022.
  32. D. Guo, L. Tang, X. Zhang, and Y.-C. Liang, “Joint optimization of handover control and power allocation based on multi-agent deep reinforcement learning,” IEEE Trans. Veh. Tech., vol. 69, no. 11, pp. 13 124–13 138, Nov. 2020.
  33. Y. Zhan, C. H. Liu, Y. Zhao, J. Zhang, and J. Tang, “Free market of multi-leader multi-follower mobile crowdsensing: An incentive mechanism design by deep reinforcement learning,” IEEE Trans. Mobile Comput., vol. 19, no. 10, pp. 2316–2329, Oct. 2020.
  34. J. Ji, K. Zhu, and L. Cai, “Trajectory and communication design for cache- enabled uavs in cellular networks: A deep reinforcement learning approach,” IEEE Trans. Mobile Comput., vol. 22, no. 10, pp. 6190–6204, Oct. 2023.
  35. M. Samir, C. Assi, S. Sharafeddine, and A. Ghrayeb, “Online altitude control and scheduling policy for minimizing aoi in UAV-assisted IoT wireless networks,” IEEE Trans. Mobile Comput., vol. 21, no. 7, pp. 2493–2505, Jul. 2022.
  36. D. Toshniwal, S. Loya, A. Khot, and Y. Marda, “Optimized detection and classification on gtrsb: Advancing traffic sign recognition with convolutional neural networks,” arXiv preprint arXiv:2403.08283, Mar. 2024.
  37. G. Lampropoulos, E. Keramopoulos, and K. Diamantaras, “Enhancing the functionality of augmented reality using deep learning, semantic web and knowledge graphs: A review,” Visual Informatics, vol. 4, no. 1, pp. 32–42, Mar. 2020.
  38. S. Jošilo and G. Dán, “Wireless and computing resource allocation for selfish computation offloading in edge computing,” in Proc. IEEE Conf. Comput. Commun., Paris, France, May. 2019, pp. 2467–2475.
  39. S. Kojima, K. Maruta, Y. Feng, C.-J. Ahn, and V. Tarokh, “CNN-based joint snr and doppler shift classification using spectrogram images for adaptive modulation and coding,” IEEE Trans. Commun., vol. 69, no. 8, pp. 5152–5167, Aug. 2021.
  40. H. Zeng, T. Zhou, Y. Guo, Z. Cai, and F. Liu, “Fedcav: contribution-aware model aggregation on distributed heterogeneous data in federated learning,” in Proc. of ICPP, Lemont, IL, Aug. 2021, pp. 1–10.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.