Fuzzy Q-Learning-Based Opportunistic Communication for MEC-Enhanced Vehicular Crowdsensing
Abstract: This study focuses on MEC-enhanced, vehicle-based crowdsensing systems that rely on devices installed on automobiles. We investigate an opportunistic communication paradigm in which devices can transmit measured data directly to a crowdsensing server over a 4G communication channel or to nearby devices or so-called Road Side Units positioned along the road via Wi-Fi. We tackle a new problem that is how to reduce the cost of 4G while preserving the latency. We propose an offloading strategy that combines a reinforcement learning technique known as Q-learning with Fuzzy logic to accomplish the purpose. Q-learning assists devices in learning to decide the communication channel. Meanwhile, Fuzzy logic is used to optimize the reward function in Q-learning. The experiment results show that our offloading method significantly cuts down around 30-40% of the 4G communication cost while keeping the latency of 99% packets below the required threshold.
- A survey of mobile crowdsensing techniques: A critical component for the internet of things. ACM Trans. Cyber-Phys. Syst., 2(3), June 2018.
- Parkgauge: Gauging the occupancy of parking garages with crowdsensed parking characteristics. In 2016 17th IEEE International Conference on Mobile Data Management (MDM), volume 1, pages 92–101, 2016.
- Post: Exploiting dynamic sociality for mobile advertising in vehicular networks. IEEE Transactions on Parallel and Distributed Systems, 27(6):1770–1782, 2016.
- Secure incentives for commercial ad dissemination in vehicular networks. IEEE Transactions on Vehicular Technology, 61(6):2715–2728, 2012.
- A survey on mobile crowdsensing systems: Challenges, solutions, and opportunities. IEEE Communications Surveys Tutorials, 21(3):2419–2465, 2019.
- A mobile edge-based crowdsensing framework for heterogeneous iot. IEEE Access, 8:207524–207536, 2020.
- Joint network selection and traffic allocation in multi-access edge computing-based vehicular crowdsensing. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pages 1184–1189, 2020.
- Privacy-preserving online task allocation in edge-computing-enabled massive crowdsensing. IEEE Internet of Things Journal, 6(5):7773–7787, 2019.
- Quality-Aware Sparse Data Collection in MEC-Enhanced Mobile Crowdsensing Systems. IEEE Transactions on Computational Social Systems, 6(5):1051–1062, 2019.
- Social-Aware Incentive Mechanism for Vehicular Crowdsensing by Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, 22(4):2314–2325, 2021.
- A probabilistic model for the deployment of human-enabled edge computing in massive sensing scenarios. IEEE Internet of Things Journal, 7(3):2421–2431, 2020.
- Crowd-sensing assisted vehicular distributed computing for hd map update. In ICC 2021 - IEEE International Conference on Communications, pages 1–6, 2021.
- Efficient data uploading for mobile crowdsensing via team collaborating and matching. IEEE Transactions on Green Communications and Networking, pages 1–1, 2021.
- Collaborative data delivery for smart city-oriented mobile crowdsensing systems. In 2018 IEEE Global Communications Conference (GLOBECOM), pages 1–6, 2018.
- Data offloading for mobile crowdsensing in opportunistic social networks. In 2019 IEEE Global Communications Conference (GLOBECOM), pages 1–6, 2019.
- Energy-efficient offloading for mobile edge computing in 5g heterogeneous networks. IEEE Access, 4:5896–5907, 2016.
- Minimum-cost offloading for collaborative task execution of mec-assisted platooning. Sensors, 19(4), 2019.
- Task offloading based on lyapunov optimization for mec-assisted vehicular platooning networks. Sensors, 19(22), 2019.
- Federated offloading scheme to minimize latency in mec-enabled vehicular networks. In 2018 IEEE Globecom Workshops (GC Wkshps), pages 1–6, 2018.
- Joint computation offloading and urllc resource allocation for collaborative mec assisted cellular-v2x networks. IEEE Access, 8:24914–24926, 2020.
- Computation offloading and resource allocation for cloud assisted mobile edge computing in vehicular networks. IEEE Transactions on Vehicular Technology, 68(8):7944–7956, 2019.
- Three-tier capacity and traffic allocation for core, edges, and devices for mobile edge computing. IEEE Transactions on Network and Service Management, 15(3):923–933, 2018.
- Modeling and minimizing latency in three-tier v2x networks. In 2020 IEEE Global Communications Conference, pages 1–6, 2020.
- Q-learning-based opportunistic communication for real-time mobile air quality monitoring systems. In 2021 IEEE International Performance, Computing, and Communications Conference (IPCCC), pages 1–7, 2021.
- Lotfi A Zadeh. Fuzzy logic. Computer, 21(4):83–93, 1988.
- Opportunistic communication simulator. https://github.com/AIoT-Lab-BKAI/Fuzzy-Q-learning-based-Opportunistic-Communication, 04 2022.
- Design and evaluation of a metropolitan area multitier wireless ad hoc network architecture. 2003 Proceedings Fifth IEEE Workshop on Mobile Computing Systems and Applications, pages 32–43, 2003.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.