Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
173 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Efficient Compressed Ratio Estimation Using Online Sequential Learning for Edge Computing (2211.04284v3)

Published 8 Nov 2022 in cs.LG

Abstract: Owing to the widespread adoption of the Internet of Things, a vast amount of sensor information is being acquired in real time. Accordingly, the communication cost of data from edge devices is increasing. Compressed sensing (CS), a data compression method that can be used on edge devices, has been attracting attention as a method to reduce communication costs. In CS, estimating the appropriate compression ratio is important. There is a method to adaptively estimate the compression ratio for the acquired data using reinforcement learning (RL). However, the computational costs associated with existing RL methods that can be utilized on edges are often high. In this study, we developed an efficient RL method for edge devices, referred to as the actor--critic online sequential extreme learning machine (AC-OSELM), and a system to compress data by estimating an appropriate compression ratio on the edge using AC-OSELM. The performance of the proposed method in estimating the compression ratio is evaluated by comparing it with other RL methods for edge devices. The experimental results indicate that AC-OSELM demonstrated the same or better compression performance and faster compression ratio estimation than the existing methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, “Edge computing: Vision and challenges,” IEEE internet of things journal, vol. 3, no. 5, pp. 637–646, 2016.
  2. D. L. Donoho, “Compressed sensing,” IEEE Transactions on information theory, vol. 52, no. 4, pp. 1289–1306, 2006.
  3. M. Sekine and S. Ikada, “Lacsle: Lightweight and adaptive compressed sensing based on deep learning for edge devices,” in 2019 IEEE Global Communications Conference (GLOBECOM).   IEEE, 2019, pp. 1–7.
  4. V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, “Playing atari with deep reinforcement learning,” arXiv preprint arXiv:1312.5602, 2013.
  5. N.-Y. Liang, G.-B. Huang, P. Saratchandran, and N. Sundararajan, “A fast and accurate online sequential learning algorithm for feedforward networks,” IEEE Transactions on neural networks, vol. 17, no. 6, pp. 1411–1423, 2006.
  6. H. Watanabe, M. Tsukada, and H. Matsutani, “An fpga-based on-device reinforcement learning approach using online sequential learning,” in 2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).   IEEE, 2021, pp. 96–103.
  7. V. R. Konda and J. N. Tsitsiklis, “Actor-critic algorithms,” in Advances in neural information processing systems.   Citeseer, 2000, pp. 1008–1014.
  8. D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, “Deterministic policy gradient algorithms,” in International conference on machine learning.   PMLR, 2014, pp. 387–395.
  9. S. Di and F. Cappello, “Fast error-bounded lossy hpc data compression with sz,” in 2016 ieee international parallel and distributed processing symposium (ipdps).   IEEE, 2016, pp. 730–739.
  10. J. Azar, A. Makhoul, M. Barhamgi, and R. Couturier, “An energy efficient iot data compression approach for edge machine learning,” Future Generation Computer Systems, vol. 96, pp. 168–175, 2019.
  11. L. Li, G. Wen, Z. Wang, and Y. Yang, “Efficient and secure image communication system based on compressed sensing for iot monitoring applications,” IEEE Transactions on Multimedia, vol. 22, no. 1, pp. 82–95, 2019.
  12. S. Li, L. Da Xu, and X. Wang, “Compressed sensing signal and data acquisition in wireless sensor networks and internet of things,” IEEE Transactions on Industrial Informatics, vol. 9, no. 4, pp. 2177–2186, 2012.
  13. J. V. Frances-Villora, A. Rosado-Muñoz, M. Bataller-Mompean, J. Barrios-Aviles, and J. F. Guerrero-Martinez, “Moving learning machine towards fast real-time applications: A high-speed fpga-based implementation of the os-elm training algorithm,” Electronics, vol. 7, no. 11, p. 308, 2018.
  14. A. Papageorgiou, B. Cheng, and E. Kovacs, “Real-time data reduction at the network edge of internet-of-things systems,” in 2015 11th international conference on network and service management (CNSM).   IEEE, 2015, pp. 284–291.
  15. A. Badanidiyuru, B. Mirzasoleiman, A. Karbasi, and A. Krause, “Streaming submodular maximization: Massive data summarization on the fly,” in Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014, pp. 671–680.
  16. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1-3, pp. 489–501, 2006.
  17. C. Wilson, A. Riccardi, and E. Minisci, “A novel update mechanism for q-networks based on extreme learning machines,” in 2020 International Joint Conference on Neural Networks (IJCNN).   IEEE, 2020, pp. 1–7.
  18. R. Furfaro, A. Scorsoglio, R. Linares, and M. Massari, “Adaptive generalized zem-zev feedback guidance for planetary landing via a deep reinforcement learning approach,” Acta Astronautica, vol. 171, pp. 156–171, 2020.
  19. Y. LeCun and C. Cortes, “MNIST handwritten digit database,” http://yann.lecun.com/exdb/mnist/, 2010.
  20. T. Clanuwat, M. Bober-Irizar, A. Kitamoto, A. Lamb, K. Yamamoto, and D. Ha, “Deep learning for classical japanese literature,” arXiv preprint arXiv:1812.01718, 2018.
  21. “Raspberry PI 3 Model B,” Available online:https://www.raspberrypi.org/products/raspberry-pi-3-model-b/, (accessed on 03/15/2023).
  22. S. Mitchell, M. OSullivan, and I. Dunning, “Pulp: a linear programming toolkit for python,” The University of Auckland, Auckland, New Zealand, vol. 65, 2011.
  23. “MacBook Air with M1 chip - Apple,” Available online:https://www.apple.com/macbook-air-m1/, (accessed on 03/15/2023).
  24. S. Xu, S. Zeng, and J. Romberg, “Fast compressive sensing recovery using generative models with structured latent variables,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2019, pp. 2967–2971.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now