Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 175 tok/s
Gemini 2.5 Pro 52 tok/s Pro
GPT-5 Medium 36 tok/s Pro
GPT-5 High 38 tok/s Pro
GPT-4o 92 tok/s Pro
Kimi K2 218 tok/s Pro
GPT OSS 120B 442 tok/s Pro
Claude Sonnet 4.5 38 tok/s Pro
2000 character limit reached

Adaptive Robust Confidence Intervals (2410.22647v2)

Published 30 Oct 2024 in math.ST, stat.ME, and stat.TH

Abstract: This paper studies the construction of adaptive confidence intervals under Huber's contamination model when the contamination proportion is unknown. For the robust confidence interval of a Gaussian mean, we show that the optimal length of an adaptive interval must be exponentially wider than that of a non-adaptive one. An optimal construction is achieved through simultaneous uncertainty quantification of quantiles at all levels. The results are further extended beyond the Gaussian location model by addressing a general family of robust hypothesis testing. In contrast to adaptive robust estimation, our findings reveal that the optimal length of an adaptive robust confidence interval critically depends on the distribution's shape.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (98)
  1. Computationally efficient robust sparse estimation in high dimensions. In Conference on Learning Theory, pages 169–212. PMLR.
  2. A discriminative framework for clustering via similarity functions. In Proceedings of the Fortieth Annual ACM Symposium on Theory of Computing, pages 671–680.
  3. Baraud, Y. (2004). Confidence balls in gaussian regression. The Annals of statistics, 32(2):528–551.
  4. On a variance dependent dvoretzky-kiefer-wolfowitz inequality. arXiv preprint arXiv:2308.04757.
  5. Confidence regions and minimax rates in outlier-robust estimation on the probability simplex. Electronic Journal of Statistics, 14(2):2653–2677.
  6. Beran, R. (1977). Robust location estimates. The Annals of Statistics, 5(3):431–444.
  7. Minimax m-estimation under adversarial contamination. In International Conference on Machine Learning, pages 1906–1924. PMLR.
  8. Bickel, P. J. (1965). On some robust estimates of location. The Annals of Mathematical Statistics, 36(3):847–858.
  9. Birgé, L. (1979). Sur un théoreme de minimax et son application aux tests. Univ. de Paris-Sud, Dép. de Mathématique.
  10. Adaptive confidence sets in l2superscript𝑙2l^{2}italic_l start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT. Probability Theory and Related Fields, 156(3):889–919.
  11. Confidence intervals for high-dimensional linear regression: Minimax rates and adaptivity. The Annals of Statistics, 45(2):615–646.
  12. Adaptive confidence bands for nonparametric regression functions. Journal of the American Statistical Association, 109(507):1054–1070.
  13. An adaptation theory for nonparametric confidence intervals. The Annals of Statistics, 32(5):1805–1840.
  14. Adaptive confidence balls. The Annals of Statistics, 34(1):202–228.
  15. Adaptive confidence intervals for regression functions under shape constraints. The Annals of Statistics, 41(272):722–750.
  16. The full landscape of robust mean testing: Sharp separations between oblivious and adaptive contamination. In 2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS), pages 2159–2168. IEEE.
  17. Carpentier, A. (2013). Honest and adaptive confidence sets in lpsubscript𝑙𝑝l_{p}italic_l start_POSTSUBSCRIPT italic_p end_POSTSUBSCRIPT. Electronic Journal of Statistics, 7:2875–2923.
  18. Adaptive confidence sets for matrix completion. Bernoulli, 24(4A):2429–2460.
  19. On signal detection and confidence sets for low rank inference problems. Electronic journal of statistics, 9(2):2675–2688.
  20. Catoni, O. (2012). Challenging the empirical mean and empirical variance: a deviation study. In Annales de l’IHP Probabilités et statistiques, volume 48, pages 1148–1185.
  21. A general decision theory for Huber’s ϵitalic-ϵ\epsilonitalic_ϵ-contamination model. Electronic Journal of Statistics, 10(2):3752–3774.
  22. Robust covariance and scatter matrix estimation under Huber’s contamination model. The Annals of Statistics, 46(5):1932–1960.
  23. High-dimensional robust mean estimation in nearly-linear time. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2755–2771. SIAM.
  24. Faster algorithms for high-dimensional robust covariance estimation. In Conference on Learning Theory, pages 727–757. PMLR.
  25. Fast mean estimation with sub-gaussian rates. In Conference on Learning Theory, pages 786–806. PMLR.
  26. Algorithms for heavy-tailed statistics: Regression, covariance estimation, and beyond. In Proceedings of the 52nd Annual ACM Symposium on Theory of Computing, pages 601–609.
  27. Anti-concentration and honest, adaptive confidence bands. The Annals of Statistics, 42(5):1787.
  28. Collins, J. R. (1976). Robust estimation of a location parameter in the presence of asymmetry. The Annals of Statistics, 4(1):68–85.
  29. Robust estimation of location. Journal of the American Statistical Association, 62(318):353–389.
  30. All-in-one robust estimator of the gaussian mean. The Annals of Statistics, 50(2):1193–1219.
  31. Robust sub-gaussian estimation of a mean vector in nearly linear time. The Annals of Statistics, 50(1):511–536.
  32. Robustly learning any clusterable mixture of gaussians. arXiv preprint arXiv:2005.06417.
  33. Robust estimators in high dimensions without the computational intractability. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pages 655–664. IEEE.
  34. Near-optimal algorithms for gaussians with Huber contamination: Mean estimation and linear regression. Advances in Neural Information Processing Systems, 36:43384–43422.
  35. The sample complexity of robust covariance testing. In Conference on Learning Theory, pages 1511–1521. PMLR.
  36. Algorithmic high-dimensional robust statistics. Cambridge university press.
  37. Statistical query lower bounds for robust estimation of high-dimensional gaussians and gaussian mixtures. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 73–84. IEEE.
  38. Efficient algorithms and lower bounds for robust linear regression. In Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 2745–2754. SIAM.
  39. Dümbgen, L. (2003). Optimal confidence bands for shape-restricted curves. Bernoulli, 9(3):423–449.
  40. Durrett, R. (2019). Probability: theory and examples, volume 49. Cambridge university press.
  41. An introduction to the bootstrap. Chapman and Hall/CRC.
  42. On robust regression with high-dimensional predictors. Proceedings of the National Academy of Sciences, 110(36):14557–14562.
  43. Gao, C. (2020). Robust regression via mutivariate regression depth. Bernoulli, 26(2):1139–1170.
  44. Adaptive confidence bands. The Annals of Statistics, 36(1):875–905.
  45. Confidence bands in density estimation. The Annals of Statistics, 38(2):1122–1170.
  46. Mathematical foundations of infinite-dimensional statistical models, volume 40. Cambridge university press.
  47. Beyond catoni: Sharper rates for heavy-tailed and robust mean estimation. In The Thirty Seventh Annual Conference on Learning Theory, pages 2232–2269. PMLR.
  48. Hall, P. (2013). The bootstrap and Edgeworth expansion. Springer Science & Business Media.
  49. Hampel, F. R. (1968). Contributions to the theory of robust estimation. University of California, Berkeley.
  50. Robust Statistics: The Approach Based on Influence Functions. John Wiley & Sons.
  51. On adaptive inference and confidence bands. The Annals of Statistics, 39(5):2383–2409.
  52. Robust and heavy-tailed mean estimation made simple, via regret minimization. Advances in Neural Information Processing Systems, 33:11902–11912.
  53. Hopkins, S. B. (2020). Mean estimation with sub-gaussian rates in polynomial time. The Annals of Statistics, 48(2):1193–1213.
  54. Mixture models, robustness, and sum of squares proofs. In Proceedings of the 50th Annual ACM Symposium on Theory of Computing, pages 1021–1034.
  55. Huber, P. J. (1964). Robust estimation of a location parameter. The Annals of Mathematical Statistics, 35(1):73–101.
  56. Huber, P. J. (1965). A robust version of the probability ratio test. The Annals of Mathematical Statistics, 36(6):1753–1758.
  57. Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, volume 1, pages 221–233. Berkeley, CA: University of California Press.
  58. Huber, P. J. (1968). Robust confidence limits. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete, 10(4):269–278.
  59. Huber, P. J. (1973). Robust regression: Asymptotics, conjectures and monte carlo. The Annals of Statistics, 1(5):799–821.
  60. Robust statistics. Wiley Series in Probability and Statistics.
  61. Robust estimation algorithms don’t need to know the corruption level. arXiv preprint arXiv:2202.05453.
  62. Continuous univariate distributions, volume 2, volume 289. John wiley & sons.
  63. Nonparametric confidence set estimation. Mathematical Methods of Statistics, 12(4):410–428.
  64. The hulc: confidence regions from convex hulls. Journal of the Royal Statistical Society Series B: Statistical Methodology, 86(3):586–622.
  65. Agnostic estimation of mean and covariance. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pages 665–674. IEEE.
  66. LeCam, L. (1973). Convergence of estimates under dimensionality restrictions. The Annals of Statistics, 1(1):38–53.
  67. Optimal sub-gaussian mean estimation in ℝℝ\mathbb{R}blackboard_R. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 672–683. IEEE.
  68. Lepskii, O. (1991). On a problem of adaptive estimation in gaussian white noise. Theory of Probability & Its Applications, 35(3):454–466.
  69. Lepskii, O. (1992). Asymptotically minimax adaptive estimation. i: Upper bounds. optimally adaptive estimates. Theory of Probability & Its Applications, 36(4):682–697.
  70. Lepskii, O. (1993). Asymptotically minimax adaptive estimation. ii. schemes without optimal adaptation: Adaptive estimators. Theory of Probability & Its Applications, 37(3):433–448.
  71. Loh, P.-L. (2017). Statistical consistency and asymptotic normality for high-dimensional robust m-estimators. The Annals of Statistics, 45(2):866.
  72. Low, M. G. (1997). On nonparametric confidence intervals. The Annals of Statistics, 25(6):2547–2554.
  73. Robust multivariate mean estimation: the optimality of trimmed mean. The Annals of Statistics, 49(1):393–410.
  74. Massart, P. (1990). The tight constant in the dvoretzky-kiefer-wolfowitz inequality. The Annals of Probability, 18(3):1269–1283.
  75. Statistically optimal robust mean and covariance estimation for anisotropic gaussians. arXiv preprint arXiv:2301.09024.
  76. Minsker, S. (2018). Sub-gaussian estimators of the mean of a random matrix with heavy-tailed entries. The Annals of Statistics, 46(6A):2871–2903.
  77. Robust and efficient mean estimation: an approach based on the properties of self-normalized sums. Electronic Journal of Statistics, 15(2):6036–6070.
  78. Nadarajah, S. (2005). A generalized normal distribution. Journal of Applied statistics, 32(7):685–694.
  79. Neyman, J. (1937). Outline of a theory of statistical estimation based on the classical theory of probability. Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences, 236(767):333–380.
  80. A sharp adaptive confidence ball for self-similar functions. Stochastic Processes and their Applications, 126(12):3913–3934.
  81. Confidence sets in sparse regression. The Annals of Statistics, 41(6):2852–2876.
  82. Robust universal inference. arXiv preprint arXiv:2307.04034.
  83. Large sample confidence regions based on subsamples under minimal assumptions. The Annals of Statistics, 22(4):2031–2050.
  84. Information theory: From coding to learning. Cambridge university press.
  85. Portnoy, S. (1985). Asymptotic behavior of m𝑚mitalic_m estimators of p𝑝pitalic_p regression parameters when p2/nsuperscript𝑝2𝑛p^{2}/nitalic_p start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT / italic_n is large; ii. normal approximation. The Annals of Statistics, 13(4):1403–1417.
  86. Robust estimation via robust gradient estimation. Journal of the Royal Statistical Society Series B: Statistical Methodology, 82(3):601–627.
  87. Reeve, H. W. (2024). A short proof of the dvoretzky–kiefer–wolfowitz–massart inequality. arXiv preprint arXiv:2403.16651.
  88. Adaptive nonparametric confidence sets. The Annals of statistics, 34(1):229–253.
  89. Adaptive huber regression. Journal of the American Statistical Association, 115(529):254–265.
  90. Frequentist coverage of adaptive nonparametric bayesian credible sets. The Annals of Statistics, 43(4):1391–1428.
  91. Tsybakov, A. B. (2009). Introduction to nonparametric estimation, 2009. Springer Series in Statistis.
  92. Tukey, J. W. (1975). Mathematics and the picturing of data. In Proceedings of the International Congress of Mathematicians, volume 2, pages 523–531. Vancouver.
  93. Adaptive posterior contraction rates for the horseshoe. Electronic Journal of Statistics, 11(2):3196–3225.
  94. Wahba, G. (1983). Bayesian “confidence intervals" for the cross-validated smoothing spline. Journal of the Royal Statistical Society: Series B (Methodological), 45(1):133–150.
  95. Huber-robust confidence sequences. In International Conference on Artificial Intelligence and Statistics, pages 9662–9679. PMLR.
  96. Universal inference. Proceedings of the National Academy of Sciences, 117(29):16880–16890.
  97. Asymptotic behavior of m-estimators for the linear model. The Annals of Statistics, 7(2):258–268.
  98. Robust estimation via generalized quasi-gradients. Information and Inference: A Journal of the IMA, 11(2):581–636.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Authors (2)

  1. Yuetian Luo
  2. Chao Gao
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 tweet and received 2 likes.

Upgrade to Pro to view all of the tweets about this paper:

Start a free 7-day Pro trial