Papers
Topics
Authors
Recent
Search
2000 character limit reached

Transportation Marketplace Rate Forecast Using Signature Transform

Published 10 Jan 2024 in cs.LG and stat.AP | (2401.04857v3)

Abstract: Freight transportation marketplace rates are typically challenging to forecast accurately. In this work, we have developed a novel statistical technique based on signature transforms and have built a predictive and adaptive model to forecast these marketplace rates. Our technique is based on two key elements of the signature transform: one being its universal nonlinearity property, which linearizes the feature space and hence translates the forecasting problem into linear regression, and the other being the signature kernel, which allows for comparing computationally efficiently similarities between time series data. Combined, it allows for efficient feature generation and precise identification of seasonality and regime switching in the forecasting process. An algorithm based on our technique has been deployed by Amazon trucking operations, with far superior forecast accuracy and better interpretability versus commercially available industry models, even during the COVID-19 pandemic and the Ukraine conflict. Furthermore, our technique is able to capture the influence of business cycles and the heterogeneity of the marketplace, improving prediction accuracy by more than fivefold, with an estimated annualized saving of \$50MM.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Imanol Perez Arribas. Derivatives pricing using signature payoffs. arXiv preprint arXiv:1809.09466, 2018.
  2. Least squares after model selection in high-dimensional sparse models. Bernoulli, 19(2):521–547, 2013.
  3. Reproducing Kernel Hilbert Spaces in Probability and Statistics. Springer Science & Business Media, 2011.
  4. Deep signature transforms. In Proceedings of the 33rd International Conference on Neural Information Processing Systems, pages 3105–3115, 2019.
  5. Kuo-Tsai Chen. Iterated integrals and exponential homomorphism. Proceedings of the London Mathematical Society, s3-4(1):502–512, 1954.
  6. Kuo-Tsai Chen. Integration of paths, geometric invariants and a generalized baker-hausdorff formula. Annals of Mathematics, 65(1):163–178, 1957.
  7. Optimal two-step prediction in regression. Electronic Journal of Statistics, 11(1):2519–2546, 2017.
  8. Characteristic functions of measures on geometric rough paths. Annals of Probability, 44(6):4049–4082, 2016.
  9. Signature moments to characterize laws of stochastic processes. Journal of Machine Learning Research, 23(176):1–42, 2022.
  10. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555, 2014.
  11. A course on rough paths. Springer, 2020.
  12. Multidimensional stochastic processes as rough paths: theory and applications, volume 120. Cambridge University Press, 2010.
  13. Everette S Gardner Jr. Exponential smoothing: The state of the art—part ii. International journal of forecasting, 22(4):637–666, 2006.
  14. A kernel two-sample test. Journal of Machine Learning Research, 13(1):723–773, 2012.
  15. Uniqueness for the signature of a path of bounded variation and the reduced path group. Annals of Mathematics, pages 109–167, 2010.
  16. James D Hamilton. A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica: Journal of the econometric society, pages 357–384, 1989.
  17. Optimal execution with rough path signatures. SIAM Journal on Financial Mathematics, 11(2):470–493, 2020.
  18. Signatory: differentiable computations of the signature and logsignature transforms, on both cpu and gpu. In International Conference on Learning Representations, 2020.
  19. Kernels for sequentially ordered data. Journal of Machine Learning Research, 20(31):1–45, 2019.
  20. Short-term traffic flow prediction using seasonal arima model with limited input data. European Transport Research Review, 7(3):1–9, 2015.
  21. Lpsnet: a novel log path signature feature based hand gesture recognition framework. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 631–639, 2017.
  22. A feature set for streams and an application to high-frequency financial tick data. In Proceedings of the 2014 International Conference on Big Data Science and Computing, pages 1–8, 2014.
  23. Numerical method for model-free pricing of exotic derivatives in discrete time using rough path signatures. Applied Mathematical Finance, 26(6):583–597, 2019.
  24. Differential equations driven by rough paths. Springer, 2007.
  25. A generalised signature method for multivariate time series feature extraction. arXiv preprint arXiv:2006.00873, 2020.
  26. Arima models. Time series analysis and its applications: with R examples, pages 75–163, 2017.
  27. Kernel distribution embeddings: Universal kernels, characteristic kernels and kernel metrics on distributions. Journal of Machine Learning Research, 19(1):1708–1736, 2018.
  28. Hilbert space embeddings and metrics on probability measures. The Journal of Machine Learning Research, 11:1517–1561, 2010.
  29. James W Taylor. Smooth transition exponential smoothing. Journal of Forecasting, 23(6):385–404, 2004.
  30. Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267–288, 1996.
  31. Learning spatial-semantic context with fully convolutional recurrent network for online handwritten chinese text recognition. IEEE transactions on pattern analysis and machine intelligence, 40(8):1903–1917, 2017.
  32. Chinese character-level writer identification using path signature feature, dropstroke and deep cnn. In 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pages 546–550. IEEE, 2015.
  33. A review of recurrent neural networks: Lstm cells and network architectures. Neural computation, 31(7):1235–1270, 2019.
  34. On model selection consistency of lasso. The Journal of Machine Learning Research, 7:2541–2563, 2006.
  35. Hui Zou. The adaptive lasso and its oracle properties. Journal of the American statistical association, 101(476):1418–1429, 2006.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.