Wavelet Dynamic Selection Network for Inertial Sensor Signal Enhancement
Abstract: As attitude and motion sensing components, inertial sensors are widely used in various portable devices. But the severe errors of inertial sensors restrain their function, especially the trajectory recovery and semantic recognition. As a mainstream signal processing method, wavelet is hailed as the mathematical microscope of signal due to the plentiful and diverse wavelet basis functions. However, complicated noise types and application scenarios of inertial sensors make selecting wavelet basis perplexing. To this end, we propose a wavelet dynamic selection network (WDSNet), which intelligently selects the appropriate wavelet basis for variable inertial signals. In addition, existing deep learning architectures excel at extracting features from input data but neglect to learn the characteristics of target categories, which is essential to enhance the category awareness capability, thereby improving the selection of wavelet basis. Therefore, we propose a category representation mechanism (CRM), which enables the network to extract and represent category features without increasing trainable parameters. Furthermore, CRM transforms the common fully connected network into category representations, which provide closer supervision to the feature extractor than the far and trivial one-hot classification labels. We call this process of imposing interpretability on a network and using it to supervise the feature extractor the feature supervision mechanism, and its effectiveness is demonstrated experimentally and theoretically in this paper. The enhanced inertial signal can perform impracticable tasks with regard to the original signal, such as trajectory reconstruction. Both quantitative and visual results show that WDSNet outperforms the existing methods. Remarkably, WDSNet, as a weakly-supervised method, achieves the state-of-the-art performance of all the compared fully-supervised methods.
- Optimization of an Inertial Sensor De-Noising Method using a Hybrid Deep Learning Algorithm. In 2022 Conference of Russian Young Researchers in Electrical and Electronic Engineering (ElConRus), 1335–1340. IEEE.
- Denoising IMU Gyroscopes With Deep Learning for Open-Loop Attitude Estimation. IEEE Robotics and Automation Letters, 5(3): 4796–4803.
- The EuRoC micro aerial vehicle datasets. The International Journal of Robotics Research, 35(10): 1157–1163.
- nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 11621–11631.
- A survey of full-body motion reconstruction in immersive virtual reality applications. IEEE transactions on visualization and computer graphics, 26(10): 3089–3108.
- Ionet: Learning to cure the curse of drift in inertial odometry. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32.
- Deep-learning-based pedestrian inertial navigation: Methods, data set, and on-device inference. IEEE Internet of Things Journal, 7(5): 4431–4441.
- Towards improved inertial navigation by reducing errors using deep learning methodology. Applied Sciences, 12(7): 3645.
- Expert-novice classification of mobile game player using smartphone inertial sensors. Expert Systems with Applications, 174: 114700.
- Data-driven denoising of stationary accelerometer signals. Measurement, 113218.
- AbolDeepIO: A novel deep inertial odometry network for autonomous vehicles. IEEE Transactions on Intelligent Transportation Systems, 21(5): 1941–1950.
- OriNet: Robust 3-D orientation estimation with a single particular IMU. IEEE Robotics and Automation Letters, 5(2): 399–406.
- AQUALOC: An underwater dataset for visual–inertial–pressure localization. The International Journal of Robotics Research, 38(14): 1549–1559.
- Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight. Science Robotics, 7(67): eabl6259.
- Human activity recognition using magnetic induction-based motion signals and deep recurrent neural networks. Nature communications, 11(1): 1551.
- Proximity Human-Robot Interaction Using Pointing Gestures and a Wrist-mounted IMU. In 2019 International Conference on Robotics and Automation (ICRA), 8084–8091.
- Hybrid deep recurrent neural networks for noise reduction of MEMS-IMU with static and dynamic conditions. Micromachines, 12(2): 214.
- Noise Reduction for MEMS gyroscope signal: A novel method combining ACMP with adaptive multiscale SG filter based on AMA. Sensors, 19(20): 4382.
- Ronin: Robust neural inertial navigation in the wild: Benchmark, evaluations, & new methods. In 2020 IEEE International Conference on Robotics and Automation (ICRA), 3146–3152. IEEE.
- The apolloscape open dataset for autonomous driving and its application. IEEE transactions on pattern analysis and machine intelligence, 42(10): 2702–2719.
- Attitude Estimation using Iterative Indirect Kalman with Neural Network for Inertial Sensors. IEEE Transactions on Instrumentation and Measurement.
- Inertial Sensing Meets Machine Learning: Opportunity or Challenge? IEEE Transactions on Intelligent Transportation Systems, 23(8): 9995–10011.
- A wearable motion capture device able to detect dynamic motion of human limbs. Nature communications, 11(1): 5615.
- Tlio: Tight learned inertial odometry. IEEE Robotics and Automation Letters, 5(4): 5653–5660.
- Denoising method of MEMS gyroscope based on interval empirical mode decomposition. Mathematical Problems in Engineering, 2020: 1–12.
- End-to-end optimized versatile image compression with wavelet-like transform. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(3): 1247–1263.
- Estimation of IMU and MARG orientation using a gradient descent algorithm. In 2011 IEEE international conference on rehabilitation robotics, 1–7. IEEE.
- Multiple trajectory prediction of moving agents with memory augmented networks. IEEE Transactions on Pattern Analysis and Machine Intelligence.
- Drop tower tests of Taiji-1 inertial sensor substitute. npj Microgravity, 7(1): 25.
- Wearable inertial sensors for fall risk assessment and prediction in older adults: A systematic review and meta-analysis. IEEE transactions on neural systems and rehabilitation engineering, 26(3): 573–582.
- Using inertial sensors to automatically detect and segment activities of daily living in people with Parkinson’s disease. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(1): 197–204.
- Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology, 109(3): 395–417.
- Vins-mono: A robust and versatile monocular visual-inertial state estimator. IEEE Transactions on Robotics, 34(4): 1004–1020.
- Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges. Information Fusion, 80: 241–265.
- Inertial Navigation on Extremely Resource-Constrained Platforms: Methods, Opportunities and Challenges. In 2023 IEEE/ION Position, Location and Navigation Symposium (PLANS), 708–723. IEEE.
- Tinyodom: Hardware-aware efficient neural inertial navigation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(2): 1–32.
- Equivariant wavelets: Fast rotation and translation invariant wavelet scattering transforms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(2): 1716–1731.
- Shaeffer, D. K. 2013. MEMS inertial sensors: A tutorial overview. IEEE Communications Magazine, 51(4): 100–109.
- Unsupervised deep visual-inertial odometry with online error correction for RGB-D imagery. IEEE transactions on pattern analysis and machine intelligence, 42(10): 2478–2493.
- Long-term visual localization revisited. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(4): 2074–2088.
- Deep learning for fall risk assessment with inertial sensors: Utilizing domain knowledge in spatio-temporal gait parameters. IEEE journal of biomedical and health informatics, 24(7): 1994–2005.
- Adaptive Skewness Kurtosis Neural Network : Enabling Communication Between Neural Nodes Within a Layer. In International Conference on Neural Information Processing.
- Arbitrary Spatial Trajectory Reconstruction Based on a Single Inertial Sensor. IEEE Sensors Journal, 23(9): 10009–10022.
- Handwriting Recognition under Natural Writing Habits based on A Low-cost Inertial Sensor. IEEE Sensors Journal, 1–1.
- RIANN—A robust neural network outperforms attitude estimation filters. Ai, 2(3): 444–463.
- Predicting the Noise Covariance With a Multitask Learning Model for Kalman Filter-Based GNSS/INS Integrated Navigation. IEEE Transactions on Instrumentation and Measurement, 70: 1–13.
- A survey of the research status of pedestrian dead reckoning systems based on inertial sensors. International Journal of Automation and Computing, 16: 65–83.
- Multivariate Extension of Matrix-Based Rényi’s α𝛼\alphaitalic_α-Order Entropy Functional. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(11): 2960–2966.
- Understanding Convolutional Neural Networks With Information Theory: An Initial Exploration. IEEE Transactions on Neural Networks and Learning Systems, 32(1): 435–442.
- A simple self-supervised imu denoising method for inertial aided navigation. IEEE Robotics and Automation Letters, 8(2): 944–950.
- NavNet: AUV navigation through deep sequential learning. IEEE Access, 8: 59845–59861.
- Multi-sensor integrated navigation/positioning systems using data fusion: From analytics-based to learning-based approaches. Information Fusion, 95: 62–90.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.