Conditional Sig-Wasserstein GANs for Time Series Generation (2006.05421v2)
Abstract: Generative adversarial networks (GANs) have been extremely successful in generating samples, from seemingly high dimensional probability measures. However, these methods struggle to capture the temporal dependence of joint probability distributions induced by time-series data. Furthermore, long time-series data streams hugely increase the dimension of the target space, which may render generative modelling infeasible. To overcome these challenges, motivated by the autoregressive models in econometric, we are interested in the conditional distribution of future time series given the past information. We propose the generic conditional Sig-WGAN framework by integrating Wasserstein-GANs (WGANs) with mathematically principled and efficient path feature extraction called the signature of a path. The signature of a path is a graded sequence of statistics that provides a universal description for a stream of data, and its expected value characterises the law of the time-series model. In particular, we develop the conditional Sig-$W_1$ metric, that captures the conditional joint law of time series models, and use it as a discriminator. The signature feature space enables the explicit representation of the proposed discriminators which alleviates the need for expensive training. We validate our method on both synthetic and empirical dataset and observe that our method consistently and significantly outperforms state-of-the-art benchmarks with respect to measures of similarity and predictive ability.
- Generating synthetic data in finance: opportunities, challenges and pitfalls. 2020.
- Privacy and synthetic datasets. Stan. Tech. L. Rev., 22:1, 2019.
- Horatio Boedihardjo and Xi Geng. The uniqueness of signature problem in the non-markov setting. arXiv preprint arXiv:1401.6165, 2014.
- The expected signature of brownian motion stopped on the boundary of a circle has finite radius of convergence. Bulletin of the London Mathematical Society, 53(1):285–299, 2021.
- A data-driven market simulator for small data environments. Available at SSRN 3632431, 2020.
- A primer on the signature method in machine learning. arXiv preprint arXiv:1603.03788, 2016.
- Signature moments to characterize laws of stochastic processes. The Journal of Machine Learning Research, 23(1):7928–7969, 2022.
- Characteristic functions of measures on geometric rough paths. The Annals of Probability, 44(6):4049–4082, 2016.
- A generative adversarial network approach to calibration of local stochastic volatility models. Risks, 8(4):101, 2020.
- The limit points of (optimistic) gradient descent in min-max optimization. arXiv preprint arXiv:1807.03907, 2018.
- Training gans with optimism. arXiv preprint arXiv:1711.00141, 2017.
- Adversarial audio synthesis. In ICLR, 2019.
- Richard M Dudley. Real analysis and probability. wadsworth & brooks. Cole, Pacific Groves, California, 1989.
- Gansynth: Adversarial neural audio synthesis. ArXiv, abs/1902.08710, 2019.
- Real-valued (medical) time series generation with recurrent conditional gans, 2017.
- Gans may have no nash equilibria. arXiv preprint arXiv:2002.09124, 2020.
- Thomas Fawcett. Problems in stochastic analysis: Connections between rough paths and non-commutative harmonic analysis. PhD thesis, University of Oxford, 2002.
- Adeline Fermanian. Functional linear regression with truncated signatures. Journal of Multivariate Analysis, page 105031, 2022.
- Time series simulation by conditional generative adversarial net. arXiv preprint arXiv:1904.11419, 2019.
- Sample complexity of sinkhorn divergences. arXiv preprint arXiv:1810.02733, 2018.
- Robust pricing and hedging via neural sdes. Available at SSRN 3646241, 2020.
- Improved training of wasserstein gans. arXiv preprint arXiv:1704.00028, 2017.
- Uniqueness for the signature of a path of bounded variation and the reduced path group. Annals of Mathematics,, 171(1):109–167, 2010.
- Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE international conference on computer vision, pages 1026–1034, 2015.
- Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
- Oxford-man institute’s realized library, version 0.3, 2009.
- Gans trained by a two time-scale update rule converge to a local nash equilibrium. In Advances in neural information processing systems, pages 6626–6637, 2017.
- Real-valued (medical) time series generation with recurrent conditional gans. 2018.
- Brownian motion. Springer, 1998.
- Deep signature transforms. In Advances in Neural Information Processing Systems, pages 3099–3109, 2019.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- A continuous-time garch process driven by a lévy process: stationarity and second-order behaviour. Journal of Applied Probability, pages 601–622, 2004.
- If you like it, gan it. probabilistic multivariate times series forecast with gan. arXiv preprint arXiv:2005.01181, 2020.
- Generative adversarial networks for financial trading strategies fine-tuning and combination. arXiv preprint arXiv:1901.01751, 2019.
- Learning from the past, predicting the statistics for the future, learning an evolving system. arXiv preprint arXiv:1309.0260, 2013.
- Expected signature of stopped Brownian motion on d-dimensional C2,αsuperscript𝐶2𝛼{C}^{2,\alpha}italic_C start_POSTSUPERSCRIPT 2 , italic_α end_POSTSUPERSCRIPT-domains has finite radius of convergence everywhere: 2≤d≤82𝑑82\leq d\leq 82 ≤ italic_d ≤ 8. Journal of Functional Analysis, 282(12):109447, 2022.
- Generative moment matching networks. In International Conference on Machine Learning, pages 1718–1727, 2015.
- On gradient descent ascent for nonconvex-concave minimax problems. In International Conference on Machine Learning, pages 6083–6093. PMLR, 2020.
- Neural sde: Stabilizing neural ode networks with stochastic noise. arXiv preprint arXiv:1906.02355, 2019.
- Are gans created equal? a large-scale study. arXiv preprint arXiv:1711.10337, 2017.
- Expected signature of brownian motion up to the first exit time from a bounded domain. The Annals of Probability, 43(5):2729–2762, 2015.
- Differential equations driven by rough paths. Springer, 2007.
- On finding local nash equilibria (and only local nash equilibria) in zero-sum games. arXiv preprint arXiv:1901.00838, 2019.
- Cycles in adversarial regularized learning. In Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2703–2717. SIAM, 2018.
- Which training methods for gans do actually converge? In International Conference on Machine learning (ICML), pages 3481–3490. PMLR, 2018.
- On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In Advances in neural information processing systems, pages 841–848, 2002.
- Sig-wasserstein gans for time series generation. accepted by 2nd ACM International Conference on AI in Finance, 2021.
- Riccardo Passeggeri. On the signature and cubature of the fractional brownian motion for h¿12. Stochastic Processes and their Applications, 130(3):1226–1257, 2020. ISSN 0304-4149. doi: https://doi.org/10.1016/j.spa.2019.04.013. URL https://www.sciencedirect.com/science/article/pii/S0304414919302844.
- Conditional generative moment-matching networks. In Advances in Neural Information Processing Systems, pages 2928–2936, 2016.
- Ruey S Tsay. Analysis of financial time series, volume 543. John wiley & sons, 2005.
- Generating high-fidelity synthetic patient data for assessing machine learning healthcare software. NPJ digital medicine, 3(1):1–13, 2020.
- Deep hedging: Learning to simulate equity option markets. SSRN Electronic Journal, 2019. ISSN 1556-5068. doi: 10.2139/ssrn.3470756. URL http://dx.doi.org/10.2139/ssrn.3470756.
- Quant gans: deep generation of financial time series. Quantitative Finance, pages 1–22, 2020.
- Learning spatial-semantic context with fully convolutional recurrent network for online handwritten chinese text recognition. IEEE transactions on pattern analysis and machine intelligence, 40(8):1903–1917, 2017.
- Leveraging the path signature for skeleton-based human action recognition. arXiv preprint arXiv:1707.03993, 2017.
- Time-series generative adversarial networks. In Advances in Neural Information Processing Systems, pages 5509–5519, 2019.
- Shujian Liao (5 papers)
- Hao Ni (43 papers)
- Lukasz Szpruch (58 papers)
- Magnus Wiese (10 papers)
- Marc Sabate-Vidales (6 papers)
- Baoren Xiao (3 papers)