Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
120 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Imputation with Inter-Series Information from Prototypes for Irregular Sampled Time Series (2401.07249v1)

Published 14 Jan 2024 in cs.LG

Abstract: Irregularly sampled time series are ubiquitous, presenting significant challenges for analysis due to missing values. Despite existing methods address imputation, they predominantly focus on leveraging intra-series information, neglecting the potential benefits that inter-series information could provide, such as reducing uncertainty and memorization effect. To bridge this gap, we propose PRIME, a Prototype Recurrent Imputation ModEl, which integrates both intra-series and inter-series information for imputing missing values in irregularly sampled time series. Our framework comprises a prototype memory module for learning inter-series information, a bidirectional gated recurrent unit utilizing prototype information for imputation, and an attentive prototypical refinement module for adjusting imputations. We conducted extensive experiments on three datasets, and the results underscore PRIME's superiority over the state-of-the-art models by up to 26% relative improvement on mean square error.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. A closer look at memorization in deep networks. In International Conference on Machine Learning, pages 233–242. PMLR, 2017.
  2. Bidirectional recurrent neural networks as generative models. Advances in neural information processing systems, 28, 2015.
  3. Brits: Bidirectional recurrent imputation for time series. Advances in Neural Information Processing Systems, 31, 2018.
  4. Recurrent neural networks for multivariate time series with missing values. Scientific Reports, 8(1):1–12, 2018.
  5. This looks like that: deep learning for interpretable image recognition. arXiv preprint arXiv:1806.10574, 2018.
  6. Neural ordinary differential equations. Advances in Neural Information Processing Systems, 31, 2018.
  7. Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. Advances in Neural Information Processing Systems, 29, 2016.
  8. David F Crouse. On implementing 2d rectangular assignment algorithms. IEEE Transactions on Aerospace and Electronic Systems, 52(4):1679–1696, 2016.
  9. A prototypical triplet loss for cover detection. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 3797–3801. IEEE, 2020.
  10. Saits: Self-attention-based imputation for time series. arXiv preprint arXiv:2202.08516, 2022.
  11. Gp-vae: Deep probabilistic time series imputation. In International Conference on Artificial Intelligence and Statistics, pages 1651–1661. PMLR, 2020.
  12. Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals. Circulation, 101(23):e215–e220, 2000.
  13. Generative adversarial networks. Communications of the ACM, 63(11):139–144, 2020.
  14. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415, 2016.
  15. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data, 7(3):535–547, 2019.
  16. Recurrent neural networks with missing information imputation for medical examination data prediction. In 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), pages 317–323. IEEE, 2017.
  17. Dynammo: Mining and summarization of coevolving sequences with missing values. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 507–516, 2009.
  18. Single imputation methods. Statistical Analysis with Missing Data, pages 59–74, 2002.
  19. Naomi: Non-autoregressive multiresolution sequence imputation. Advances in Neural Information Processing Systems, 32, 2019.
  20. E2gan: End-to-end generative adversarial network for multivariate time series imputation. In Proceedings of the 28th international joint conference on artificial intelligence, pages 3094–3100. AAAI Press Palo Alto, CA, USA, 2019.
  21. Adversarial joint-learning recurrent neural network for incomplete time series classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
  22. Generative semi-supervised learning for multivariate time series imputation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 8983–8991, 2021.
  23. Imputation of missing values in time series with lagged correlations. In 2014 IEEE International Conference on Data Mining Workshop, pages 753–762. IEEE, 2014.
  24. Early prediction of sepsis from clinical data: the physionet/computing in cardiology challenge 2019. In 2019 Computing in Cardiology (CinC), pages Page–1. IEEE, 2019.
  25. Latent ordinary differential equations for irregularly-sampled time series. Advances in Neural Information Processing Systems, 32, 2019.
  26. fancyimpute: An imputation library for python, 2016.
  27. Spectrum: Spectral analysis of unevenly spaced paleoclimatic time series. Computers & Geosciences, 23(9):929–945, 1997.
  28. Interpolation-prediction networks for irregularly sampled time series. In International Conference on Learning Representations, 2018.
  29. Multi-time attention networks for irregularly sampled time series. International Conference on Learning Representations, 2021.
  30. Heteroscedastic temporal variational autoencoder for irregularly sampled time series. International Conference on Learning Representations, 2022.
  31. Prototypical networks for few-shot learning. arXiv preprint arXiv:1703.05175, 2017.
  32. An introduction to the kalman filter. 1995.
  33. Continuous imputation of missing values in streams of pattern-determining time series. 2017.
  34. Multi-directional recurrent neural networks: A novel method for estimating missing data. In Time series workshop in international conference on machine learning, 2017.
  35. Temporal regularized matrix factorization for high-dimensional time series prediction. Advances in Neural Information Processing Systems, 29, 2016.
  36. A transformer-based framework for multivariate time series representation learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 2114–2124, 2021.
  37. Tapnet: Multivariate time series classification with attentional prototypical network. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 6845–6852, 2020.
  38. Missing value imputation for mixed data via gaussian copula. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 636–646, 2020.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now