Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Time Weaver: A Conditional Time Series Generation Model (2403.02682v1)

Published 5 Mar 2024 in cs.LG and eess.SP

Abstract: Imagine generating a city's electricity demand pattern based on weather, the presence of an electric vehicle, and location, which could be used for capacity planning during a winter freeze. Such real-world time series are often enriched with paired heterogeneous contextual metadata (weather, location, etc.). Current approaches to time series generation often ignore this paired metadata, and its heterogeneity poses several practical challenges in adapting existing conditional generation approaches from the image, audio, and video domains to the time series domain. To address this gap, we introduce Time Weaver, a novel diffusion-based model that leverages the heterogeneous metadata in the form of categorical, continuous, and even time-variant variables to significantly improve time series generation. Additionally, we show that naive extensions of standard evaluation metrics from the image to the time series domain are insufficient. These metrics do not penalize conditional generation approaches for their poor specificity in reproducing the metadata-specific features in the generated time series. Thus, we innovate a novel evaluation metric that accurately captures the specificity of conditional generation and the realism of the generated time series. We show that Time Weaver outperforms state-of-the-art benchmarks, such as Generative Adversarial Networks (GANs), by up to 27% in downstream classification tasks on real-world energy, medical, air quality, and traffic data sets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. Synthesizing adversarial visual scenarios for model-based robotic control. In 6th Annual Conference on Robot Learning, 2022.
  2. Diffusion-based time series imputation and forecasting with structured state space models. Transactions on Machine Learning Research, 2022. ISSN 2835-8856. URL https://openreview.net/forum?id=hHiIbk7ApW.
  3. Diffusion-based conditional ecg generation with structured state space models. Computers in Biology and Medicine, pp.  107115, 2023.
  4. A methodology for validating diversity in synthetic time series generation. MethodsX, 8:101459, 2021. ISSN 2215-0161. doi: https://doi.org/10.1016/j.mex.2021.101459. URL https://www.sciencedirect.com/science/article/pii/S2215016121002521.
  5. Evaluation metrics for conditional image generation. International Journal of Computer Vision, 129:1712 – 1731, 2020. URL https://api.semanticscholar.org/CorpusID:216553817.
  6. Chen, H. Challenges and corresponding solutions of generative adversarial networks (gans): A survey study. Journal of Physics: Conference Series, 1827(1):012066, mar 2021. doi: 10.1088/1742-6596/1827/1/012066. URL https://dx.doi.org/10.1088/1742-6596/1827/1/012066.
  7. Wavegrad: Estimating gradients for waveform generation. In International Conference on Learning Representations, 2020.
  8. Chen, S. Beijing Multi-Site Air-Quality Data. UCI Machine Learning Repository, 2019. DOI: https://doi.org/10.24432/C5RK5G.
  9. On the evaluation of conditional GANs. arXiv preprint arXiv:1907.08175, 2019.
  10. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780–8794, 2021.
  11. Ccgan: Continuous conditional generative adversarial networks for image generation. In International conference on learning representations, 2020.
  12. Adversarial audio synthesis. In ICLR, 2019.
  13. Saits: Self-attention-based imputation for time series. Expert Systems with Applications, 219:119619, June 2023. ISSN 0957-4174. doi: 10.1016/j.eswa.2023.119619. URL http://dx.doi.org/10.1016/j.eswa.2023.119619.
  14. Real-valued (medical) time series generation with recurrent conditional gans, 2017.
  15. Fréchet, M. Sur la distance de deux lois de probabilité. Annales de l’ISUP, VI(3):183–198, 1957. URL https://hal.science/hal-04093677.
  16. Improving robustness using generated data. In Ranzato, M., Beygelzimer, A., Dauphin, Y. N., Liang, P., and Vaughan, J. W. (eds.), Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, pp.  4218–4233, 2021. URL https://proceedings.neurips.cc/paper/2021/hash/21ca6d0cf2f25c4dbb35d8dc0b679c3f-Abstract.html.
  17. Efficiently modeling long sequences with structured state spaces. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=uYLFoz1vlAC.
  18. Identity mappings in deep residual networks. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV 14, pp.  630–645. Springer, 2016.
  19. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, pp.  6629–6640, Red Hook, NY, USA, 2017. Curran Associates Inc. ISBN 9781510860964.
  20. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020.
  21. Video diffusion models. arXiv:2204.03458, 2022.
  22. Hogue, J. Metro Interstate Traffic Volume. UCI Machine Learning Repository, 2019. DOI: https://doi.org/10.24432/C5X60B.
  23. Multimodal unsupervised image-to-image translation. In Proceedings of the European Conference on Computer Vision (ECCV), pp.  172–189, 2018.
  24. Psa-gan: Progressive self attention gans for synthetic time series. In International Conference on Learning Representations, 2021.
  25. Pate-gan: Generating synthetic data with differential privacy guarantees. In International Conference on Learning Representations, 2018. URL https://api.semanticscholar.org/CorpusID:53342261.
  26. Diffwave: A versatile diffusion model for audio synthesis. In 9th International Conference on Learning Representations, ICLR 2021, 2021.
  27. Tts-gan: A transformer-based time-series generative adversarial network. In Conference on Artificial Intelligence in Medicine in Europe, 2022. URL https://api.semanticscholar.org/CorpusID:246634793.
  28. Using gans for sharing networked time series data: Challenges, initial promise, and open questions. In Proceedings of the ACM Internet Measurement Conference, IMC ’20, pp.  464–483, New York, NY, USA, 2020. Association for Computing Machinery. ISBN 9781450381383. doi: 10.1145/3419394.3423643. URL https://doi.org/10.1145/3419394.3423643.
  29. An improved evaluation framework for generative adversarial networks. arXiv preprint arXiv:1803.07474, 2018.
  30. Repaint: Inpainting using denoising diffusion probabilistic models. In CVPR, pp.  11451–11461. IEEE, 2022.
  31. cgans with projection discriminator. arXiv preprint arXiv:1802.05637, 2018.
  32. Murray, N. PfaGAN: An aesthetics-conditional GAN for generating photographic fine art. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pp.  0–0, 2019.
  33. Conditional image synthesis with auxiliary classifier gans. In International conference on machine learning, pp.  2642–2651. PMLR, 2017.
  34. Fréchet chemnet distance: a metric for generative models for molecules in drug discovery. Journal of chemical information and modeling, 58(9):1736–1741, 2018.
  35. Learning transferable visual models from natural language supervision, 2021.
  36. Hierarchical text-conditional image generation with clip latents, 2022.
  37. Stress testing electrical grids: Generative adversarial networks for load scenario generation. Energy and AI, 9:100177, 2022. ISSN 2666-5468. doi: https://doi.org/10.1016/j.egyai.2022.100177. URL https://www.sciencedirect.com/science/article/pii/S2666546822000295.
  38. High-resolution image synthesis with latent diffusion models, 2021.
  39. Palette: Image-to-image diffusion models. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications, 2021.
  40. Progressive distillation for fast sampling of diffusion models. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=TIdIXIpzhoI.
  41. Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning, pp.  2256–2265. PMLR, 2015.
  42. Conditional frechet inception distance, 2022.
  43. Generative modeling by estimating gradients of the data distribution. Advances in Neural Information Processing Systems, 32, 2019.
  44. Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations, 2021.
  45. Rethinking the inception architecture for computer vision. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.  2818–2826, 2015.
  46. Csdi: Conditional score-based diffusion models for probabilistic time series imputation. Advances in Neural Information Processing Systems, 34:24804–24816, 2021.
  47. Deepfake electrocardiograms using generative adversarial networks are the beginning of the end for privacy issues in medicine. Scientific Reports, 11(1):21896, 2021. doi: 10.1038/s41598-021-01295-2. URL https://doi.org/10.1038/s41598-021-01295-2.
  48. Trindade, A. Electricity Load Diagrams. UCI Machine Learning Repository, 2015. DOI: https://doi.org/10.24432/C58C86.
  49. Towards accurate generative models of video: A new metric & challenges. arXiv preprint arXiv:1812.01717, 2018.
  50. Ptb-xl, a large publicly available electrocardiography dataset. Scientific data, 7(1):154, 2020.
  51. Large-scale contrastive language-audio pretraining with feature fusion and keyword-to-caption augmentation. In IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, 2023.
  52. Time-series generative adversarial networks. In Wallach, H., Larochelle, H., Beygelzimer, A., d'Alché-Buc, F., Fox, E., and Garnett, R. (eds.), Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019. URL https://proceedings.neurips.cc/paper_files/paper/2019/file/c9efe5f26cd17ba6216bbe2a7d26d490-Paper.pdf.
  53. Anonymization through data synthesis using generative adversarial networks (ads-gan). IEEE Journal of Biomedical and Health Informatics, PP:1–1, 03 2020. doi: 10.1109/JBHI.2020.2980262.
  54. Multimodal contrastive training for visual representation learning. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.  6991–7000, 2021. URL https://api.semanticscholar.org/CorpusID:233407906.
  55. Contrastive learning of medical visual representations from paired images and text. In Lipton, Z., Ranganath, R., Sendak, M., Sjoding, M., and Yeung, S. (eds.), Proceedings of the 7th Machine Learning for Healthcare Conference, volume 182 of Proceedings of Machine Learning Research, pp.  2–25. PMLR, 05–06 Aug 2022. URL https://proceedings.mlr.press/v182/zhang22a.html.
  56. Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pp.  11106–11115, 2021.
Citations (9)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com