Papers
Topics
Authors
Recent
Search
2000 character limit reached

On the use of the cumulant generating function for inference on time series

Published 19 Mar 2024 in stat.ME and stat.CO | (2403.12714v1)

Abstract: We introduce innovative inference procedures for analyzing time series data. Our methodology enables density approximation and composite hypothesis testing based on Whittle's estimator, a widely applied M-estimator in the frequency domain. Its core feature involves the (general Legendre transform of the) cumulant generating function of the Whittle likelihood score, as obtained using an approximated distribution of the periodogram ordinates. We present a testing algorithm that significantly expands the applicability of the state-of-the-art saddlepoint test, while maintaining the numerical accuracy of the saddlepoint approximation. Additionally, we demonstrate connections between our findings and three other prevalent frequency domain approaches: the bootstrap, empirical likelihood, and exponential tilting. Numerical examples using both simulated and real data illustrate the advantages and accuracy of our methodology.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (61)
  1. Valid edgeworth expansions for the whittle maximum likelihood estimator for stationary long-memory gaussian time series. Econometric Theory, 21(04):710–734.
  2. The tourism forecasting competition. International Journal of Forecasting, 27(3):822–844.
  3. Barndorff-Nielsen, O. (1983). On a formula for the distribution of the maximum likelihood estimator. Biometrika, 70(2):343–365.
  4. Bence, J. R. (1995). Analysis of short time series: correcting for autocorrelation. Ecology, 76:628–639.
  5. Beran, J. (1993). Fitting long-memory models by generalized linear regression. Biometrika, 80(4):817–822.
  6. Long-memory processes. Springer.
  7. Robust Wasserstein profile inference and applications to machine learning. Journal of Applied Probability, 56(3):830–857.
  8. Bloomfield, P. (1973). An exponential model for the spectrum of a scalar time series. Biometrika, 60(2):217–226.
  9. Bloomfield, P. (2004). Fourier analysis of time series: an introduction. John Wiley & Sons.
  10. Applied Asymptotics: Case Studies in Small-Sample Statistics. Cambridge University Press.
  11. Brillinger, D. R. (2001). Time series: data analysis and theory, volume 36. SIAM.
  12. Butler, R. W. (2007). Saddlepoint approximations with applications. Cambridge University Press.
  13. Simulation-assisted saddlepoint approximation. Journal of Statistical Computation and Simulation, 78(8):731–745.
  14. Dahlhaus, R. (1988). Small sample effects in time series analysis: a new asymptotic theory and a new estimate. Annals of Statistics, 16:808–841.
  15. A frequency domain bootstrap for ratio statistics in time series analysis. Annals of Statistics, 24(5):1934–1963.
  16. Daniels, H. E. (1954). Saddlepoint approximations in statistics. Annals of Mathematical Statistics, 25:631–650.
  17. Daniels, H. E. (1956). The approximate distribution of serial correlation coefficients. Biometrika, 43(1/2):169–185.
  18. Saddlepoint approximations in resampling methods. Biometrika, 75(3):417–431.
  19. Durbin, J. (1980). Approximations for densities of sufficient estimators. Biometrika, 67(2):311–333.
  20. An extended empirical saddlepoint approximation for intractable likelihoods. Electronic Journal of Statistics, 12(1):1544–1578.
  21. Relative errors for bootstrap approximations of the serial correlation coefficient. Annals of Statistics, 41(2):1035–1053.
  22. Small Sample Asymptotics. IMS, Lecture notes-monograph series.
  23. On bootstrapping kernel spectral estimates. The Annals of Statistics, 20(1):121–145.
  24. The empirical saddlepoint estimator. Electronic Journal of Statistics, 16(1):3672–3694.
  25. A frequency selective filter for short-length time series. Computational economics, 25(1-2):75–102.
  26. Information theoretic approaches to inference in moment condition models. Econometrica, 66:333–357.
  27. Jensen, J. L. (1995). Saddlepoint Approximations. Oxford University Press.
  28. Saddlepoint approximations for spatial panel data models. Journal of the American Statistical Association, 118(542):1164–1175.
  29. Saddlepoint approximations for marginal and conditional probabilities of transformed variables. The Annals of Statistics, 22(3):1115–1132.
  30. Kakizawa, Y. (2013). Frequency domain generalized empirical likelihood method. Journal of Time Series Analysis, 34(6):691–716.
  31. An information-theoretic alternative to generalized method of moments estimation. Econometrica, 65(4):861–874.
  32. Kolassa, J. (2006). Series approximation methods in statistics, volume 88. Springer Verlag.
  33. Saddlepoint approximations for short and long memory time series: A frequency domain approach. Journal of Econometrics, 213(2):578–592.
  34. On some connections between Esscher’s tilting, saddlepoint approximations, and optimal transportation: A statistical perspective. Statistical Science, 38(1):30–51.
  35. Lahiri, S. (2003). A necessary and sufficient condition for asymptotic independence of discrete Fourier transforms under short-and long-range dependence. The Annals of Statistics, 31(2):613–641.
  36. Three examples of accurate likelihood inference. The American Statistician, 64:131–139.
  37. The m3-competition: results, conclusions and implications. International journal of forecasting, 16(4):451–476.
  38. Marsh, P. (2011). Saddlepoint and estimated saddlepoint approximations for optimal unit root tests. Econometric Theory, 27(5):1026–1047.
  39. Robust estimation of time series with corrupted spectrum. Working paper.
  40. Monti, A. C. (1997). Empirical likelihood confidence regions in time series models. Biometrika, 84(2):395–405.
  41. On the relationship between empirical likelihood and empirical saddlepoint approximation for multivariate m-estimators. Biometrika, 80(2):329–338.
  42. Mudelsee, M. (2010). Climate time series analysis: classical statistical and bootstrap methods, volume 42. Springer.
  43. Trends and random walks in macroeconmic time series: some evidence and implications. Journal of Monetary Economics, 10(2):139–162.
  44. Phillips, P. (1978). Edgeworth and saddlepoint approximations in the first-order noncircular autoregression. Biometrika, 65:91–98.
  45. Monte Carlo Statistical Methods. Springer New York, NY.
  46. Saddlepoint approximations and tests based on multivariate M-estimates. The Annals of Statistics, 31(4):1154–1169.
  47. Robinson, P. M. (1995). Log-periodogram regression of time series with long range dependence. The annals of Statistics, 23(3):1048–1072.
  48. Robinson, P. M. (2003). Time series with long memory. Advanced Texts in Econometrics.
  49. Empirical saddlepoint approximations for multivariate m-estimators. Journal of the Royal Statistical Society. Series B (Methodological), 56:313–326.
  50. Sowell, F. (1992). Modeling long-run behavior with the fractional ARIMA models. Journal of Monetary Economics, 29(2):277–302.
  51. Jackknifed whittle estimators. Statistica Sinica, 22(3):1287.
  52. Tukey, J. W. (1968). An introduction to the calculations of numerical spectrum analysis. In Harris, B., editor, Advanced seminar on spectral analysis of time series, pages 25–46. Wiley, New York.
  53. van der Vaart, A. (1998). Asymptotic Statistics. Cambridge Series in Statistical and Probabilistic Mathematics.
  54. Villani, C. (2009). Optimal transport: old and new, volume 338. Springer Science & Business Media.
  55. Wang, S. (1992). Tail probability approximations in the first-order noncircular autoregression. Biometrika, 79:431–434.
  56. Modelling persistence in annual Australia point rainfall. Hydrology and Earth System Sciences, 7(2):197–211.
  57. Whittle, P. (1953). Estimation and information in stationary time series. Arkiv för Matematik, 2(5):423–434.
  58. Saddlepoint approximations to the cdf of some statistics with nonnormal limit distributions. Journal of the American Statistical Association, 88(422):680–686.
  59. Young, G. A. (2009). Routes to higher-order accuracy in parametric inference. Australian & New Zealand Journal of Statistics, 51(2):115–126.
  60. Extracting climate memory using fractional integrated statistical model: A new perspective on climate prediction. Scientific Reports, 4(1):6577.
  61. Enso-like interdecadal variability: 1900–93. Journal of Climate, 10(5):1004 – 1020.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.

Sign Up for Free