Energy-Guided Data Sampling for Traffic Prediction with Mini Training Datasets (2403.18710v2)
Abstract: Recent endeavors aimed at forecasting future traffic flow states through deep learning encounter various challenges and yield diverse outcomes. A notable obstacle arises from the substantial data requirements of deep learning models, a resource often scarce in traffic flow systems. Despite the abundance of domain knowledge concerning traffic flow dynamics, prevailing deep learning methodologies frequently fail to fully exploit it. To address these issues, we propose an innovative solution that merges Convolutional Neural Networks (CNNs) with Long Short-Term Memory (LSTM) architecture to enhance the prediction of traffic flow dynamics. A key revelation of our research is the feasibility of sampling training data for large traffic systems from simulations conducted on smaller traffic systems. This insight suggests the potential for referencing a macroscopic-level distribution to inform the sampling of microscopic data. Such sampling is facilitated by the observed scale invariance in the normalized energy distribution of the statistical mechanics model, thereby streamlining the data generation process for large-scale traffic systems. Our simulations demonstrate promising agreement between predicted and actual traffic flow dynamics, underscoring the efficacy of our proposed approach.
- What is a macrostate?: Subjective observations and objective dynamics. arXiv preprint cond-mat/0303625, 2001.
- Quantifying self-organization with optimal predictors. Physical review letters, 93(11), sep 2004.
- Lc-rnn: A deep learning model for traffic speed prediction. In IJCAI, pages 3470–3476, 2018.
- Traffic prediction using time-space diagram: A convolutional neural network approach. Transportation Research Record, page 0361198119841291, 2019.
- Predicting causal effects in large-scale systems from observational data. Nature Methods, 7(4):247–248, apr 2010.
- Proactive drive failure prediction for large scale storage systems. In IEEE Symposium on Mass Storage Systems and Technologies, 2013.
- J. G. Charney. ON A PHYSICAL BASIS FOR NUMERICAL PREDICTION OF LARGE-SCALE MOTIONS IN THE ATMOSPHERE. Journal of Meteorology, 6(6):372–385, 2002.
- New types of deep neural network learning for speech recognition and related applications: An overview. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 8599–8603. IEEE, 2013.
- Sequence to sequence learning with neural networks. In Advances in neural information processing systems, pages 3104–3112, 2014.
- Deep learning. nature, 521(7553):436, 2015.
- Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587):484–489, jan 2016.
- Traffic prediction for agent route planning. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 5103 LNCS, pages 692–701, 2008.
- Pheromone model: Application to traffic congestion prediction. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 3910 LNAI, pages 182–196, 2006.
- Real-time road traffic forecasting using regime-switching space-time models and adaptive LASSO. Applied Stochastic Models in Business and Industry, 28(4):297–315, jul 2012.
- Real-time road traffic prediction with spatio-temporal correlations. Transportation Research Part C: Emerging Technologies, 19(4):606–616, aug 2011.
- A cellular automaton model for freeway traffic. Journal de physique I, 2(12):2221–2229, 1992.
- Statistical mechanics-inspired framework for studying the effects of mixed traffic flows on highway congestion. In 2014 American Control Conference, pages 5402–5407. IEEE, 2014.
- Face recognition: A convolutional neural-network approach. IEEE transactions on neural networks, 8(1):98–113, 1997.
- Long short-term memory recurrent neural network architectures for large scale acoustic modeling. In Fifteenth annual conference of the international speech communication association, 2014.
- Dynamic time series prediction of future traffic conditions, October 12 2010. US Patent 7,813,870.
- Tracking and predicting a network traffic process. International Journal of Forecasting, 13(1):51–61, 1997.
- Dynamic prediction of traffic volume through kalman filtering theory. Transportation Research Part B: Methodological, 18(1):1–11, 1984.
- Wei-Hua Lin. A gaussian maximum likelihood formulation for short-term forecasting of traffic flow. In ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No. 01TH8585), pages 150–155. IEEE, 2001.
- Carlos F Daganzo. The cell transmission model, part ii: network traffic. Transportation Research Part B: Methodological, 29(2):79–93, 1995.
- Paul I Richards. Shock waves on the highway. Operations research, 4(1):42–51, 1956.
- Urban traffic flow prediction using a fuzzy-neural approach. Transportation Research Part C: Emerging Technologies, 10(2):85–98, 2002.
- Use of sequential learning for short-term traffic flow forecasting. Transportation Research Part C: Emerging Technologies, 9(5):319–336, 2001.
- A bayesian network approach to traffic flow forecasting. IEEE Transactions on intelligent transportation systems, 7(1):124–132, 2006.
- Self-control of traffic lights and vehicle flows in urban road networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(04):P04019, 2008.
- Observability variation in emergent dynamics: A study using krylov subspace-based model order reduction. In 2020 American Control Conference (ACC), pages 3461–3466. IEEE, 2020.
- Examining the observability of emergent behavior as a function of reduced model order. In 2018 annual American control conference (ACC), pages 6218–6223. IEEE, 2018.
- A low rank dynamic mode decomposition model for short-term traffic flow prediction. IEEE Transactions on Intelligent Transportation Systems, 22(10):6547–6560, 2020.
- A novel grey prediction model based on tensor higher-order singular value decomposition and its application in short-term traffic flow. Engineering Applications of Artificial Intelligence, 126:107068, 2023.
- Zhaohui Yang. Macroscopic Observability of Emergent Behaviors in Multi-Scale Models of Traffic Flow. PhD thesis, University of Massachusetts Lowell, 2022.
- Multi-scale traffic flow modeling: A renormalization group approach. arXiv preprint arXiv:2403.13779, 2024.
- Renormalization group approach to cellular automata-based multi-scale modeling of traffic flow. In International Conference on Complex Systems, pages 17–27. Springer, 2020.
- Traffic prediction using real-world transportation data, March 15 2016. US Patent 9,286,793.
- Traffic flow prediction with big data: a deep learning approach. IEEE Transactions on Intelligent Transportation Systems, 16(2):865–873, 2014.
- Learning the dynamics of arterial traffic from probe data using a dynamic bayesian network. IEEE Transactions on Intelligent Transportation Systems, 13(4):1679–1693, 2012.
- Recurrent neural network based language model. In Eleventh annual conference of the international speech communication association, 2010.
- Lstm network: a deep learning approach for short-term traffic forecast. IET Intelligent Transport Systems, 11(2):68–75, 2017.
- Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
- Nonlinear follow-the-leader models of traffic flow. Operations research, 9(4):545–567, 1961.
- Phenomenological Study of Dynamical Model of Traffic Flow. J. Phys. I France, 5:1389–1399, 1993.
- On kinetic waves, ii . a theory of traffic flow on long crowded roads. 1955.
- Carlos F. Daganzo. Fundamentals of Transportation and Traffic Operations. Emerald Group Publishing Limited, sep 2016.
- Probabilistic Description of Traffic Breakdowns Caused by On-ramp Flow. Physical review. E, Statistical, nonlinear, and soft matter physics, 65(6 Pt 2), jun 2004.
- I Prigogine and C F Andrews. A Boltzmann-like Approach for Traffic Flow. Operations Research, 8:789–797, 1957.
- Stochastic description of traffic flow. Journal of Statistical Physics, 133(6):1083–1105, 2008.
- Dimensional sentiment analysis using a regional cnn-lstm model. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 225–230, 2016.
- Short-term traffic flow prediction with conv-lstm. In 2017 9th International Conference on Wireless Communications and Signal Processing (WCSP), pages 1–6. IEEE, 2017.