Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Sample Splitting and Assessing Goodness-of-fit of Time Series (2403.07158v1)

Published 11 Mar 2024 in stat.ME

Abstract: A fundamental and often final step in time series modeling is to assess the quality of fit of a proposed model to the data. Since the underlying distribution of the innovations that generate a model is often not prescribed, goodness-of-fit tests typically take the form of testing the fitted residuals for serial independence. However, these fitted residuals are inherently dependent since they are based on the same parameter estimates and thus standard tests of serial independence, such as those based on the autocorrelation function (ACF) or distance correlation function (ADCF) of the fitted residuals need to be adjusted. The sample splitting procedure in Pfister et al.~(2018) is one such fix for the case of models for independent data, but fails to work in the dependent setting. In this paper sample splitting is leveraged in the time series setting to perform tests of serial dependence of fitted residuals using the ACF and ADCF. Here the first $f_n$ of the data points are used to estimate the parameters of the model and then using these parameter estimates, the last $l_n$ of the data points are used to compute the estimated residuals. Tests for serial independence are then based on these $l_n$ residuals. As long as the overlap between the $f_n$ and $l_n$ data splits is asymptotically 1/2, the ACF and ADCF tests of serial independence tests often have the same limit distributions as though the underlying residuals are indeed iid. In particular if the first half of the data is used to estimate the parameters and the estimated residuals are computed for the entire data set based on these parameter estimates, then the ACF and ADCF can have the same limit distributions as though the residuals were iid. This procedure ameliorates the need for adjustment in the construction of confidence bounds for both the ACF and ADCF in goodness-of-fit testing.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (18)
  1. On Turán type inequalities for modified Bessel functions. Proc. Amer. Math. Soc., 141(2):523–532, 2013. ISSN 0002-9939. doi: 10.1090/S0002-9939-2012-11325-5. URL https://doi.org/10.1090/S0002-9939-2012-11325-5.
  2. Asymptotics for GARCH squared residual correlations. Econometric Theory, 19(4):515–540, 2003a. ISSN 0266-4666,1469-4360. doi: 10.1017/S0266466603194017. URL https://doi.org/10.1017/S0266466603194017.
  3. GARCH processes: structure and estimation. Bernoulli, 9(2):201 – 227, 2003b. doi: 10.3150/bj/1068128975. URL https://doi.org/10.3150/bj/1068128975.
  4. Patrick Billingsley. Probability and measure. Wiley Series in Probability and Mathematical Statistics. John Wiley & Sons, Inc., New York, third edition, 1995. ISBN 0-471-00710-2. A Wiley-Interscience Publication.
  5. Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association, 65(332):1509–1526, 1970. ISSN 01621459. URL http://www.jstor.org/stable/2284333.
  6. Time series: theory and methods. Springer Series in Statistics. Springer-Verlag, New York, second edition, 1991. ISBN 0-387-97429-6. doi: 10.1007/978-1-4419-0320-4. URL https://doi.org/10.1007/978-1-4419-0320-4.
  7. Applications of distance correlation to time series. Bernoulli, 24(4A):3087–3116, 2018. ISSN 1350-7265. doi: 10.3150/17-BEJ955. URL https://doi.org/10.3150/17-BEJ955.
  8. J. Durbin. Distribution theory for tests based on the sample distribution function. Society for Industrial and Applied Mathematics, 1973. ISBN 0-89871-007-3, 978-0-89871-007-6. doi: 10.1137/1.9781611970586. URL https://epubs.siam.org/doi/abs/10.1137/1.9781611970586.
  9. J. Durbin. Kolmogorov-smirnov tests when parameters are estimated. In Peter Gaenssler and Pál Révész, editors, Empirical Distributions and Processes, pages 33–44, Berlin, Heidelberg, 1976. Springer Berlin Heidelberg. ISBN 978-3-540-37515-9. doi: 10.1007/BFb0096877. URL https://doi.org/10.1007/BFb0096877.
  10. Robert E. Gaunt. A simple proof of the characteristic function of Student’s t𝑡titalic_t-distribution. Comm. Statist. Theory Methods, 50(14):3380–3383, 2021. ISSN 0361-0926. doi: 10.1080/03610926.2019.1702695. URL https://doi.org/10.1080/03610926.2019.1702695.
  11. High moment partial sum processes of residuals in GARCH models and their applications. Ann. Statist., 33(5):2395–2422, 2005. ISSN 0090-5364,2168-8966. doi: 10.1214/009053605000000534. URL https://doi.org/10.1214/009053605000000534.
  12. On a measure of lack of fit in time series models. Biometrika, 65(2):297–303, 08 1978. ISSN 0006-3444. doi: 10.1093/biomet/65.2.297. URL https://doi.org/10.1093/biomet/65.2.297.
  13. Kernel-based tests for joint independence. Journal of the Royal Statistical Society. Series B (Statistical Methodology), 80(1):5–31, 2018. ISSN 13697412, 14679868. URL http://www.jstor.org/stable/44681792.
  14. Stochastic orders. Springer Series in Statistics. Springer, New York, 2007. ISBN 978-0-387-32915-4; 0-387-32915-3. doi: 10.1007/978-0-387-34675-5. URL https://doi.org/10.1007/978-0-387-34675-5.
  15. Michael A Stephens. On the half-sample method for goodness-of-fit. Journal of the Royal Statistical Society: Series B (Methodological), 40(1):64–70, 1978. doi: https://doi.org/10.1111/j.2517-6161.1978.tb01649.x. URL https://rss.onlinelibrary.wiley.com/doi/abs/10.1111/j.2517-6161.1978.tb01649.x.
  16. Michael A Stephens. Tests based on edf statistics. In Ralph B. D’Agostino and Michael A. Stephens, editors, Goodness-of-fit techniques, volume 68 of Stat., Textb. Monogr., pages 97–194. Marcel Dekker, 1986.
  17. Measuring and testing dependence by correlation of distances. Ann. Statist., 35(6):2769–2794, 2007. ISSN 0090-5364. doi: 10.1214/009053607000000505. URL https://doi.org/10.1214/009053607000000505.
  18. Goodness-of-fit testing for time series models via distance covariance. Journal of Econometrics, 227(1):4–24, 2022. ISSN 0304-4076. doi: 10.1016/j.jeconom.2020.05.008. URL https://doi.org/10.1016/j.jeconom.2020.05.008.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com