Deep Learning for Inertial Sensor Alignment
Abstract: Accurate alignment of a fixed mobile device equipped with inertial sensors inside a moving vehicle is important for navigation, activity recognition, and other applications. Accurate estimation of the device mounting angle is required to rotate the inertial measurement from the sensor frame to the moving platform frame to standardize measurements and improve the performance of the target task. In this work, a data-driven approach using deep neural networks (DNNs) is proposed to learn the yaw mounting angle of a smartphone equipped with an inertial measurement unit (IMU) and strapped to a car. The proposed model uses only the accelerometer and gyroscope readings from an IMU as input and, in contrast to existing solutions, does not require global position inputs from global navigation satellite systems (GNSS). To train the model in a supervised manner, IMU data is collected for training and validation with the sensor mounted at a known yaw mounting angle, and a range of ground truth labels is generated by applying a random rotation in a bounded range to the measurements. The trained model is tested on data with real rotations showing similar performance as with synthetic rotations. The trained model is deployed on an Android device and evaluated in real-time to test the accuracy of the estimated yaw mounting angle. The model is shown to find the mounting angle at an accuracy of 8 degrees within 5 seconds, and 4 degrees within 27 seconds. An experiment is conducted to compare the proposed model with an existing off-the-shelf solution.
- G. Dissanayake, S. Sukkarieh, E. Nebot, and H. Durrant-Whyte, “The aiding of a low-cost strapdown inertial measurement unit using vehicle model constraints for land vehicle applications,” IEEE transactions on robotics and automation, vol. 17, no. 5, pp. 731–747, 2001.
- M. Freydin and B. Or, “Learning car speed using inertial sensors for dead reckoning navigation,” IEEE Sensors Letters, vol. 6, no. 9, pp. 1–4, 2022.
- T. Seel, J. Raisch, and T. Schauer, “Imu-based joint angle measurement for gait analysis,” Sensors, vol. 14, no. 4, pp. 6891–6909, 2014.
- R. Jain and V. B. Semwal, “A novel feature extraction method for preimpact fall detection system using deep learning and wearable sensors,” IEEE Sensors Journal, vol. 22, no. 23, pp. 22 943–22 951, 2022.
- S. Ashry, T. Ogawa, and W. Gomaa, “Charm-deep: Continuous human activity recognition model based on deep neural network using imu sensors of smartwatch,” IEEE Sensors Journal, vol. 20, no. 15, pp. 8757–8770, 2020.
- N. Gaud, M. Rathore, and U. Suman, “Human gait analysis and activity recognition: A review,” in 2023 IEEE Guwahati Subsection Conference (GCON), 2023, pp. 1–6.
- V. B. Semwal, N. Gaud, P. Lalwani, V. Bijalwan, and A. K. Alok, “Pattern identification of different human joints for different human walking styles using inertial measurement unit (imu) sensor,” Artificial Intelligence Review, vol. 55, no. 2, pp. 1149–1169, 2022.
- A. Kashevnik, I. Lashkov, A. Ponomarev, N. Teslya, and A. Gurtov, “Cloud-based driver monitoring system using a smartphone,” IEEE Sensors Journal, vol. 20, no. 12, pp. 6701–6715, 2020.
- Y. Peng, N. Kondo, T. Fujiura, T. Suzuki, Wulandari, H. Yoshioka, and E. Itoyama, “Classification of multiple cattle behavior patterns using a recurrent neural network with long short-term memory and inertial measurement units,” Computers and Electronics in Agriculture, vol. 157, pp. 247–253, 2019.
- S. Hong, M. H. Lee, H.-H. Chun, S.-H. Kwon, and J. L. Speyer, “Experimental study on the estimation of lever arm in gps/ins,” IEEE Transactions on vehicular technology, vol. 55, no. 2, pp. 431–448, 2006.
- X. Niu and S. Han, “Improving the performance of portable navigation devices by using partial imu based gps/ins integration technology,” in Proceedings of the 21st International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS 2008), 2008, pp. 2130–2136.
- Z. F. Syed, P. Aggarwal, X. Niu, and N. El-Sheimy, “Civilian vehicle navigation: Required alignment of the inertial sensors for acceptable navigation accuracies,” IEEE Transactions on Vehicular Technology, vol. 57, no. 6, pp. 3402–3412, 2008.
- R. C. McKown, “Mounting angle calibration for an in-vehicle accelerometer device,” Mar. 21 2017, uS Patent 9,599,633.
- E. Vinande, P. Axelrad, and D. Akos, “Mounting-angle estimation for personal navigation devices,” IEEE Transactions on Vehicular Technology, vol. 59, no. 3, pp. 1129–1138, 2009.
- H. A. Pham, M. M. Menzel, S. K. P. Chow, and X. Tu, “Detecting mount angle of mobile device in vehicle using motion sensors,” Sep. 20 2016, uS Patent 9,448,250.
- J. Cheng, G. Yuan, M. Zhou, S. Gao, C. Liu, H. Duan, and Q. Zeng, “Accessibility analysis and modeling for iov in an urban scene,” IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4246–4256, 2020.
- Y. Wu, C. Goodall, and N. El-Sheimy, “Self-calibration for imu/odometer land navigation: Simulation and test results,” in Proceedings of the 2010 International Technical Meeting of The Institute of Navigation, 2010, pp. 839–849.
- Y. Lu, L. Xiong, X. Xia, L. Gao, and Z. Yu, “Vehicle heading angle and imu heading mounting angle improvement leveraging gnss course angle,” Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, p. 09544070221106833, 2022.
- Q. Chen, Q. Zhang, and X. Niu, “Estimate the pitch and heading mounting angles of the imu for land vehicular gnss/ins integrated system,” IEEE transactions on intelligent transportation systems, vol. 22, no. 10, pp. 6503–6515, 2020.
- Q. Zhang, Y. Hu, S. Li, T. Zhang, and X. Niu, “Mounting parameter estimation from velocity vector observations for land vehicle navigation,” IEEE Transactions on Industrial Electronics, vol. 69, no. 4, pp. 4234–4244, 2021.
- E. Bassetti, A. Luciani, and E. Panizzi, “Ml-based re-orientation of smartphone-collected car motion data,” Procedia Computer Science, vol. 198, pp. 237–242, 2022.
- Q. Chen, X. Niu, J. Kuang, and J. Liu, “Imu mounting angle calibration for pipeline surveying apparatus,” IEEE Transactions on Instrumentation and Measurement, vol. 69, no. 4, pp. 1765–1774, 2019.
- H. Yan, Q. Shan, and Y. Furukawa, “RIDI: Robust IMU double integration,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 621–636.
- S. Herath, H. Yan, and Y. Furukawa, “Ronin: Robust neural inertial navigation in the wild: Benchmark, evaluations, & new methods,” in 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 3146–3152.
- M. Brossard and S. Bonnabel, “Learning wheel odometry and imu errors for localization,” in 2019 International Conference on Robotics and Automation (ICRA). IEEE, 2019, pp. 291–297.
- B. Or and I. Klein, “Learning vehicle trajectory uncertainty,” Engineering Applications of Artificial Intelligence, vol. 122, p. 106101, 2023.
- J. Liu and G. Guo, “Vehicle localization during gps outages with extended kalman filter and deep learning,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–10, 2021.
- B. Or and I. Klein, “A Hybrid Model and Learning-Based Adaptive Navigation Filter,” IEEE Transactions on Instrumentation and Measurement, pp. 1–1, 2022.
- B. Candan and H. E. Soken, “Robust attitude estimation using imu-only measurements,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–9, 2021.
- K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV), December 2015.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” Proceedings of the 3rd International Conference on Learning Representations, 2015.
- E. Brookner, “Tracking and kalman filtering made easy,” 1998.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.