Functional Principal Component Analysis for Extrapolating Multi-stream Longitudinal Data (1903.03871v1)
Abstract: The advance of modern sensor technologies enables collection of multi-stream longitudinal data where multiple signals from different units are collected in real-time. In this article, we present a non-parametric approach to predict the evolution of multi-stream longitudinal data for an in-service unit through borrowing strength from other historical units. Our approach first decomposes each stream into a linear combination of eigenfunctions and their corresponding functional principal component (FPC) scores. A Gaussian process prior for the FPC scores is then established based on a functional semi-metric that measures similarities between streams of historical units and the in-service unit. Finally, an empirical Bayesian updating strategy is derived to update the established prior using real-time stream data obtained from the in-service unit. Experiments on synthetic and real world data show that the proposed framework outperforms state-of-the-art approaches and can effectively account for heterogeneity as well as achieve high predictive accuracy.
- Computationally efficient convolved multiple output gaussian processes. Journal of Machine Learning Research, 12(May):1459–1500, 2011.
- Principal components analysis of sampled functions. Psychometrika, 51(2):285–311, 1986.
- Kernel-based functional principal components. Statistics & probability letters, 48(4):335–345, 2000.
- A wearable sweat pH and body temperature sensor platform for health, fitness, and wellness applications. In Sensors and Microsystems, volume 268, pp. 431–434. Springer, 2014.
- Principal modes of variation for processe with continuous sample curves. Technometrics, 28(4):329–337, 1986.
- Multilevel functional principal component analysis. The Annals of Applied Statistics, 3(1):458–488, 2009.
- Local Polynomial Modelling and Its Applications. Chapman and Hall, London, 1996.
- An adaptive functional regression-based prognostic model for applications with missing data. Reliability Engineering & System Safety, 133:266–274, 2015.
- Scalable prognostic models for large-scale condition monitoring applications. IISE Transactions, 49(7):698–710, 2017a.
- Multistream sensor fusion-based prognostics model for systems with single failure modes. Reliability Engineering & System Safety, 159:322–331, 2017b.
- Prognostic degradation models for computing and updating residual life distributions in a time-varying environment. IEEE Transactions on Reliability, 57(4):539–550, 2008.
- Residual-life distributions from component degradation signals: A bayesian approach. IIE Transactions, 37(6):543–557, 2005.
- Corrected confidence bands for functional data using principal components. Biometrics, 69(1):41–51, 2013.
- refund: Regression with Functional Data, 2018. URL https://CRAN.R-project.org/package=refund. R package version 0.1-17.
- Design and implementation of a smart home system using multisensor data fusion technology. Sensors, 17(7):1631, 2017.
- Functional principal components analysis via penalized rank one approximation. Electronic Journal of Statistics, 2:678–695, 2008.
- Inference for density families using functional principal component analysis. Journal of the American Statistical Association, 96(454):519–532, 2001.
- Remaining useful life prediction based on the mixed effects model with mixture prior distribution. IISE Transactions, 49(7):682–697, 2017.
- Nonparametric modeling and prognosis of condition monitoring signals using multivariate gaussian convolution processes. Technometrics, 60(4):484–496, 2018.
- Minimizing negative transfer of knowledge in multivariate gaussian processes: A scalable and regularized approach, 2019.
- A data-level fusion model for developing composite health indices for degradation modeling and prognostic analysis. IEEE Transactions on Automation Science and Engineering, 10(3):652–664, 2013.
- User’s guide for the commercial modular aero-propulsion system simulation (C-MAPSS). Technical report, National Aeronautics and Space Administration (NASA), Cleveland, OH, 2012.
- Infinitime: Multi-sensor wearable bracelet with human body harvesting. Sustainable Computing: Informatics and Systems, 11:38–49, 2016.
- Reliability meets big data: opportunities and challenges. Quality Engineering, 26(1):102–116, 2014.
- A geometric approach to maximum likelihood estimation of the functional principal components from sparse longitudinal data. Journal of Computational and Graphical Statistics, 18(4):995–1015, 2009.
- Functional Data Analysis. Springer, NY, 2nd edition, 2005.
- Rao, C. R. Some statistical methods for comparison of growth curves. Biometrics, 14:1–17, 1958.
- Gaussian Processes for Machine Learning. The MIT Press, MA, 2005.
- Rizopoulos, D. Dynamic predictions and prospective accuracy in joint models for longitudinal and time-to-event data. Biometrics, 67(3):819–829, 2011.
- Experimental battery monitoring system design for electric vehicle applications. In 2018 IEEE International Conference on Industrial Electronics for Sustainable Energy Systems (IESES), pp. 38–43. IEEE, 2018.
- Chained gaussian processes. In Artificial Intelligence and Statistics, pp. 1431–1440, 2016.
- PHM08 challenge data set, 2008. URL https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/.
- Damage propagation modeling for aircraft engine run-to-failure simulation. In International Conference on Prognostics and Health Management, pp. 1–9, Denvor, CO, 2008.
- Remaining useful life estimation based on a nonlinear diffusion degradation process. IEEE Transactions on Reliability, 61(1):50–67, 2012.
- A wiener-process-based degradation model with a recursive filter algorithm for remaining useful life estimation. Mechanical Systems and Signal Processing, 35(1):219–237, 2013.
- Silverman, B. Smoothed functional principal components analysis by choice of norm. The Annals of Statistics, 24(1):1–24, 1996.
- Evaluation and comparison of mixed effects model based prognosis for hard failure. IEEE Transactions on Reliability, 62(2):379–394, 2013.
- Statistical degradation modeling and prognostics of multiple sensor signals via data fusion: A composite health index approach. IISE Transactions, 50(10):853–867, 2018.
- Functional data analysis. Annual Review of Statistics and Its Application, 3:257–295, 2016.
- Fast covariance estimation for high-dimensional functional data. Statistics and Computing, 26(1-2):409–421, 2016.
- Fast covariance estimation for sparse functional data. Statistics and Computing, 28(3):511–522, 2018.
- Functional data analysis for sparse longitudinal data. Journal of the American Statistical Association, 100(470):577–590, 2005.
- Degradation modeling and monitoring of truncated degradation signals. IIE Transactions, 44(9):793–803, 2012.
- Degradation modeling applied to residual lifetime prediction using functional data analysis. The Annals of Applied Statistics, 5(2B):1586–1610, 2011.