Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
GPT-4o
Gemini 2.5 Pro Pro
o3 Pro
GPT-4.1 Pro
DeepSeek R1 via Azure Pro
2000 character limit reached

Transfer Learning for Functional Mean Estimation: Phase Transition and Adaptive Algorithms (2401.12331v2)

Published 22 Jan 2024 in math.ST and stat.TH

Abstract: This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source distributions are available. The paper considers both common and independent designs and establishes the minimax rates of convergence for both designs. The results reveal an interesting phase transition phenomenon under the two designs and demonstrate the benefits of utilizing the source samples in the low sampling frequency regime. For practical applications, this paper proposes novel data-driven adaptive algorithms that attain the optimal rates of convergence within a logarithmic factor simultaneously over a large collection of parameter spaces. The theoretical findings are complemented by a simulation study that further supports the effectiveness of the proposed algorithms

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Assouad, P. (1983). Densité et dimension. Annales de l’Institut Fourier, 33(3):233–282.
  2. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2):123–140.
  3. Transfer Learning for Contextual Multi-armed Bandits. Technical report.
  4. Prediction in functional linear regression. The Annals of Statistics, 34(5):2159–2179.
  5. Supplement to “Transfer Learning for Functional Mean Estimation: Phase Transition and Adaptive Algorithms”.
  6. Transfer learning for nonparametric regression: Non-asymptotic minimax analysis and adaptive procedure. Technical report.
  7. Transfer learning for nonparametric classification: Minimax rate and adaptive classifier. Annals of Statistics, 49(1):100–128.
  8. Nonparametric covariance function estimation for functional and longitudinal data. Technical report.
  9. Optimal estimation of the mean function based on discretely sampled functional data: Phase transition. The Annals of Statistics, 39(5):2330–2355.
  10. Minimax and Adaptive Prediction for Functional Linear Regression. Journal of the American Statistical Association, 107(499):1201–1216.
  11. Transfer learning for music classification and regression tasks. Technical report.
  12. Degras, D. (2017). Simultaneous confidence bands for the mean of functional data. WIREs Computational Statistics, 9(3):e1397.
  13. Geodesic flow kernel for unsupervised domain adaptation. In 2012 IEEE Conference on Computer Vision and Pattern Recognition, pages 2066–2073.
  14. Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 7304–7308.
  15. Trends in COVID-19 prevalence and mortality: A year in review. Physica D: Nonlinear Phenomena, 425:132968.
  16. Smoothing dynamic positron emission tomography time courses using functional principal components. NeuroImage, 47(1):184–193.
  17. Robust optimal estimation of location from discretely sampled functional data. Scandinavian Journal of Statistics.
  18. The COVID-19 Global Pandemic: Implications for People With Schizophrenia and Related Disorders. Schizophrenia Bulletin, 46(4):752–757.
  19. Marginal Singularity, and the Benefits of Labels in Covariate-Shift. In Proceedings of the 31st Conference On Learning Theory, pages 1882–1886. PMLR.
  20. Classification using functional data analysis for temporal gene expression data. Bioinformatics, 22(1):68–76.
  21. Transfer Learning for High-Dimensional Linear Regression: Prediction, Estimation and Minimax Optimality. Journal of the Royal Statistical Society Series B: Statistical Methodology, 84(1):149–173.
  22. Transfer Learning in Large-Scale Gaussian Graphical Models with False Discovery Rate Control. Journal of the American Statistical Association, 0(0):1–13.
  23. Estimation and Inference for High-Dimensional Generalized Linear Models with Knowledge Transfer. Journal of the American Statistical Association, 0(0):1–12.
  24. A functional data-analytic approach to the classification of species according to their spatial dispersion. Application to a marine macrobenthic community from the Bay of Morlaix (Western English Channel). Journal of Applied Statistics, 32(8):831–840.
  25. Normalizing temporal patterns to analyze sit-to-stand movements by using registration of functional data. Journal of Biomechanics, 39(13):2526–2534.
  26. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345–1359.
  27. Classification of gene functions using support vector machine for time-course gene expression data. Computational Statistics & Data Analysis, 52(5):2578–2587.
  28. A Two Sample Distribution-Free Test for Functional Data with Application to a Diffusion Tensor Imaging Study of Multiple Sclerosis. Journal of the Royal Statistical Society. Series C, Applied statistics, 65(3):395–414.
  29. Applied Functional Data Analysis: Methods and Case Studies. Springer Series in Statistics. Springer, New York, NY.
  30. Adaptive transfer learning. The Annals of Statistics, 49(6):3618–3649.
  31. Estimating the Mean and Covariance Structure Nonparametrically When the Data are Curves. Journal of the Royal Statistical Society: Series B (Methodological), 53(1):233–243.
  32. Optimal classification for time-course gene expression data using functional data analysis. Computational Biology and Chemistry, 32(6):426–432.
  33. Modeling Functional Data With Spatially Heterogeneous Shape Characteristics. Biometrics, 68(2):331–343.
  34. Transfer Learning Under High-Dimensional Generalized Linear Models. Journal of the American Statistical Association, 0(0):1–14.
  35. Adversarial Discriminative Domain Adaptation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2962–2971.
  36. Wainwright, M. J. (2019). High-Dimensional Statistics: A Non-Asymptotic Viewpoint. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge.
  37. Functional data analysis. Annual Review of Statistics and Its Application, 3(1):257–295.
  38. Functional data analysis for longitudinal data with informative observation times. Biometrics.
  39. A survey of transfer learning. Journal of Big Data, 3(1):9.
  40. Functional embedding for the classification of gene expression profiles. Bioinformatics, 26(4):509–517.
  41. A reproducing kernel Hilbert space approach to functional linear regression. The Annals of Statistics, 38(6):3412–3444.
  42. Efficient Estimation of the Nonparametric Mean and Covariance Functions for Longitudinal and Sparse Functional Data. Journal of the American Statistical Association, 113(524):1550–1564.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Follow-up Questions

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets