FlightPatchNet: Multi-Scale Patch Network with Differential Coding for Flight Trajectory Prediction (2405.16200v2)
Abstract: Accurate multi-step flight trajectory prediction plays an important role in Air Traffic Control, which can ensure the safety of air transportation. Two main issues limit the flight trajectory prediction performance of existing works. The first issue is the negative impact on prediction accuracy caused by the significant differences in data range. The second issue is that real-world flight trajectories involve underlying temporal dependencies, and existing methods fail to reveal the hidden complex temporal variations and only extract features from one single time scale. To address the above issues, we propose FlightPatchNet, a multi-scale patch network with differential coding for flight trajectory prediction. Specifically, FlightPatchNet first utilizes the differential coding to encode the original values of longitude and latitude into first-order differences and generates embeddings for all variables at each time step. Then, a global temporal attention is introduced to explore the dependencies between different time steps. To fully explore the diverse temporal patterns in flight trajectories, a multi-scale patch network is delicately designed to serve as the backbone. The multi-scale patch network exploits stacked patch mixer blocks to capture inter- and intra-patch dependencies under different time scales, and further integrates multi-scale temporal features across different scales and variables. Finally, FlightPatchNet ensembles multiple predictors to make direct multi-step prediction. Extensive experiments on ADS-B datasets demonstrate that our model outperforms the competitive baselines.
- Traffic flow prediction for road transportation networks with limited traffic data. IEEE Transactions on Intelligent Transportation Systems, 16(2):653–662, 2015.
- Deep learning based short-term air traffic flow prediction considering temporal–spatial correlation. Aerospace Science and Technology, 93:105–113, 2019.
- A deep gaussian process-based flight trajectory prediction approach and its application on conflict detection. Algorithms, 13(11):293, 2020.
- A hybrid machine learning model for short-term estimated time of arrival prediction in terminal manoeuvring area. Transportation Research Part C: Emerging Technologies, 95:280–294, 2018.
- A real-time atc safety monitoring framework using a deep learning approach. IEEE Transactions on Intelligent Transportation Systems, 21(11):4572–4581, 2020.
- 4-d flight trajectory prediction with constrained lstm network. IEEE Transactions on Intelligent Transportation Systems, 22(11):7242–7255, 2021.
- Long-term prediction of vehicle trajectory based on a deep neural network. In 2017 International Conference on Information and Communication Technology Convergence (ICTC), pages 725–727. IEEE, 2017.
- Long term trajectory prediction based on advanced guidance law recognition. In 2017 IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace), pages 456–461. IEEE, 2017.
- Medium-term prediction of urban traffic states using probability tree. In 2016 35th Chinese Control Conference (CCC), pages 9246–9251. IEEE, 2016.
- Short/medium-term prediction for the aviation emissions in the en route airspace considering the fluctuation in air traffic demand. Transportation Research Part D: Transport and Environment, 48:46–62, 2016.
- A short-term traffic flow forecasting method based on markov chain and grey verhulst model. In 2017 6th Data Driven Control and Learning Systems (DDCLS), pages 606–610. IEEE, 2017.
- A unified spatio-temporal model for short-term traffic flow prediction. IEEE Transactions on Intelligent Transportation Systems, 20(9):3212–3223, 2018.
- Application of unscented kalman filter for flying target tracking. In 2013 International Conference on Information Science and Cloud Computing, pages 61–66, 2013.
- Flight trajectory prediction enabled by time-frequency wavelet transform. Nature Communications, 14(1):5258, 2023.
- Flightbert: Binary encoding representation for flight trajectory prediction. IEEE Transactions on Intelligent Transportation Systems, 24(2):1828–1842, 2023.
- Flightbert++: A non-autoregressive multi-horizon flight trajectory prediction framework. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 127–134, 2024.
- A bi-lstm and autoencoder based framework for multi-step flight trajectory prediction. In 2023 8th International Conference on Control and Robotics Engineering (ICCRE), pages 44–50. IEEE, 2023.
- A hybrid cnn-lstm model for aircraft 4d trajectory prediction. IEEE Access, 8:134668–134680, 2020.
- Lstm-based flight trajectory prediction. In 2018 International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2018.
- Adaptive algorithm to improve trajectory prediction accuracy of climbing aircraft. Journal of Guidance, Control, and Dynamics, 36(1):15–24, 2013.
- Multiphase optimal control framework for commercial aircraft four-dimensional flight-planning problems. Journal of Aircraft, 52(1):274–286, 2015.
- Implementation of a trajectory prediction function for trajectory based operations. In AIAA Atmospheric Flight Mechanics Conference, page 2198, 2014.
- 4d trajectory prediction of aircraft taxiing based on fitting velocity profile. In Aeronautical Computing Technique, volume 45, pages 1–12. 2015.
- Prediction of 4d trajectory based on basic flight models. Journal of southwest jiaotong university, 44(2):295–300, 2009.
- A trajectory prediction method based on aircraft motion model and grey theory. In 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), pages 1523–1527, 2016.
- Taobo Wang. 4d flight trajectory prediction model based on improved kalman filter. Journal of Computer Applications, 34(6), 2014.
- Simulation study of algorithms for aircraft trajectory prediction based on ads-b technology. In 2008 Asia Simulation Conference-7th International Conference on System Simulation and Scientific Computing, pages 322–327. IEEE, 2008.
- Flight-mode-based aircraft conflict detection using a residual-mean interacting multiple model algorithm. In AIAA guidance, navigation, and control conference and exhibit, page 5340, 2003.
- Survey of maneuvering target tracking. part v. multiple-model methods. IEEE Transactions on aerospace and electronic systems, 41(4):1255–1321, 2005.
- Bayesian spatio-temporal graph transformer network (b-star) for multi-aircraft trajectory prediction. Knowledge-Based Systems, 249, 2022.
- Multi-aircraft trajectory collaborative prediction based on social long short-term memory network. Aerospace, 8(4), 2021.
- Ground-based 4d trajectory prediction using bi-directional lstm networks. Applied Intelligence, 52(14):16417–16434, 2022.
- Attention is all you need. In Neural Information Processing Systems, 2017.
- Layer normalization. arXiv preprint arXiv:1607.06450, 2016.
- An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations, 2021.
- A time series is worth 64 words: Long-term forecasting with transformers. In International Conference on Learning Representations, 2023.
- Tsmixer: An all-mlp architecture for time series forecasting. Transactions on Machine Learning Research, 2023.
- Are transformers effective for time series forecasting? In Proceedings of the AAAI conference on artificial intelligence, volume 37, pages 11121–11128, 2023.
- itransformer: Inverted transformers are effective for time series forecasting. In The Twelfth International Conference on Learning Representations, 2023.
- Adam: a method for stochastic optimization. In The Second International Conference on Learning Representations, 2014.