2000 character limit reached
On the Impact of Random Node Sampling on Adaptive Diffusion Networks
Published 26 Mar 2024 in eess.SP | (2403.17323v1)
Abstract: In this paper, we analyze the effects of random sampling on adaptive diffusion networks. These networks consist in a collection of nodes that can measure and process data, and that can communicate with each other to pursue a common goal of estimating an unknown system. In particular, we consider in our theoretical analysis the diffusion least-mean-squares algorithm in a scenario in which the nodes are randomly sampled. Hence, each node may or may not adapt its local estimate at a certain iteration. Our model shows that, if the nodes cooperate, a reduction in the sampling probability leads to a slight decrease in the steady-state Network Mean-Square Deviation (NMSD), assuming that the environment is stationary and that all other parameters of the algorithm are kept fixed. Furthermore, under certain circumstances, this can also ensure the stability of the algorithm in situations in which it would otherwise be unstable. Although counter-intuitive, our findings are backed by simulation results, which match the theoretical curves well.
- A. H. Sayed, Adaptation, Learning, and Optimization over Networks, vol. 7, Foundations and Trends in Machine Learning, now Publishers Inc., Hanover, MA, 2014.
- A. H. Sayed, “Diffusion adaptation over networks,” in Academic Press Library in Signal Processing: array and statistical signal processing, R. Chellapa and S. Theodoridis, Eds., vol. 3, chapter 9, pp. 323–456. Academic Press, 2014.
- A. H. Sayed, “Adaptive networks,” Proc. IEEE, vol. 102, no. 4, pp. 460–497, Apr. 2014.
- “Diffusion least-mean squares over adaptive networks: Formulation and performance analysis,” IEEE Trans. Signal Process., vol. 56, no. 7, pp. 3122–3136, Jun. 2008.
- “Diffusion LMS strategies for distributed estimation,” IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1035–1048, Oct. 2009.
- “Diffusion recursive least-squares for distributed estimation over adaptive networks,” IEEE Trans. Signal Process., vol. 56, no. 5, pp. 1865–1877, Apr. 2008.
- L. Li and J. A. Chambers, “Distributed adaptive estimation based on the APA algorithm over diffusion networks with changing topology,” in Proc. IEEE SSP, 2009, pp. 757–760.
- “Adaptive diffusion schemes for heterogeneous networks.,” IEEE Trans. Signal Process., vol. 65, pp. 5661–5674, Nov. 2017.
- “Distributed diffusion adaptation over graph signals,” in Proc. IEEE ICASSP, 2018, pp. 4129–4133.
- “A preconditioned graph diffusion lms for adaptive graph signal processing,” in Proc. EUSIPCO, 2018, pp. 111–115.
- “Bio-inspired decentralized radio access based on swarming mechanisms over adaptive networks,” IEEE Trans. Signal Process., vol. 61, no. 12, pp. 3183–3197, Apr. 2013.
- “Distributed adaptive incremental strategies: Formulation and performance analysis,” in Proc. IEEE ICASSP, 2006, vol. III, pp. 584–587.
- “Incremental adaptive strategies over distributed networks,” IEEE Trans. Signal Process., vol. 55, pp. 4064 –4077, Aug. 2007.
- “Consensus filters for sensor networks and distributed sensor fusion,” in Proc. IEEE Conf. Decision Control (CDC), 2005, pp. 6698–6703.
- “Dynamic consensus on mobile networks,” in IFAC World Congress, 2005, pp. 1–6.
- “Multitask diffusion adaptation over networks,” IEEE Trans. Signal Process., vol. 62, no. 16, pp. 4129–4144, Jun. 2014.
- “Diffusion LMS over multitask networks,” IEEE Trans. Signal Process., vol. 63, no. 11, pp. 2733–2748, Mar. 2015.
- “Distributed diffusion-based LMS for node-specific adaptive parameter estimation,” IEEE Trans. Signal Process., vol. 63, no. 13, pp. 3448–3460, 2015.
- “Performance of clustered multitask diffusion LMS suffering from inter-node communication delays,” IEEE Trans. Circuits Syst. II Express Briefs, Jan. 2021.
- “Diffusion adaptation over networks with kernel least-mean-square,” in Proc. IEEE Int. Workshop on Comput. Adv. in Multi-Sensor Adaptive Process. (CAMSAP), 2015, pp. 217–220.
- “A diffusion kernel LMS algorithm for nonlinear adaptive networks,” in Proc. IEEE ICASSP, 2016, pp. 4164–4168.
- “Distributed adaptive learning with multiple kernels in diffusion networks,” IEEE Trans. Signal Process., vol. 66, no. 21, pp. 5505–5519, Aug. 2018.
- “A random Fourier features perspective of KAFs with application to distributed learning over networks,” in Adaptive Learning Methods for Nonlinear System Modeling, pp. 149–172. Elsevier, 2018.
- “Distributed adaptive learning of graph signals,” IEEE Trans. Signal Process., vol. 65, no. 16, pp. 4193–4208, May 2017.
- “Distributed recursive least squares strategies for adaptive reconstruction of graph signals,” in Proc. EUSIPCO, 2017, pp. 2289–2293.
- “A low-cost algorithm for adaptive sampling and censoring in diffusion networks,” IEEE Trans. Signal Process., vol. 69, pp. 58–72, Nov. 2020.
- “Adaptive graph signal processing: Algorithms and optimal sampling strategies,” IEEE Trans. Signal Process., vol. 66, no. 13, pp. 3584–3598, Jul. 2018.
- “An adaptive algorithm for sampling over diffusion networks with dynamic parameter tuning and change detection mechanisms,” Digit. Signal Process., vol. 127, pp. 103587, Jul. 2022.
- “On the influence of informed agents on learning and adaptation over networks,” IEEE Trans. Signal Process., vol. 61, no. 6, pp. 1339–1356, Nov. 2012.
- “Online learning and adaptation over networks: More information is not necessarily better,” in IEEE Inf. Theory Appl. Workshop (ITA), 2013, pp. 1–8.
- “Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior,” IEEE Signal Process. Mag., vol. 30, no. 3, pp. 155–171, Apr. 2013.
- “Asynchronous adaptation and learning over networks – part I: Modeling and stability analysis,” IEEE Trans. Signal Process., vol. 63, no. 4, pp. 811–826, Dec. 2014.
- “Asynchronous adaptation and learning over networks – part II: Performance analysis,” IEEE Trans. Signal Process., vol. 63, no. 4, pp. 827–842, Dec. 2014.
- “Asynchronous adaptation and learning over networks – part III: Comparison analysis,” IEEE Trans. Signal Process., vol. 63, no. 4, pp. 843–858, Dec. 2014.
- A. H. Sayed, Adaptive Filters, John Wiley & Sons, NJ, 2008.
- S. Haykin, Adaptive Filter Theory, Pearson, Upper Saddle River, 5th edition, 2014.
- “Adaptive filters,” in Signal Processing Theory and Machine Learning, P. S. R Diniz, Ed., chapter 12, pp. 717–868. Academic Press, 2024.
- “Diffusion adaptive networks with changing topologies,” in Proc. IEEE ICASSP, 2008, pp. 3285–3288.
- L. Lu and H. Zhao, “Diffusion leaky LMS algorithm: Analysis and implementation,” Signal Process., vol. 140, pp. 77–86, Nov. 2017.
- “Distributed parameter estimation with selective cooperation,” in Proc. IEEE ICASSP, 2009, pp. 2849–2852.
- “Diffusion least-mean squares with adaptive combiners: Formulation and performance analysis,” IEEE Trans. Signal Process., vol. 58, no. 9, pp. 4795–4810, Jun. 2010.
- “A strategy for adjusting combination weights over adaptive networks,” in Proc. IEEE ICASSP, 2013, pp. 4579–4583.
- “Optimal combination rules for adaptation and learning over networks,” in Proc. IEEE Int. Workshop on Comput. Adv. in Multi-Sensor Adaptive Process. (CAMSAP), 2011, pp. 317–320.
- C. D. Meyer, Matrix analysis and applied linear algebra, vol. 2, Siam, 2000.
- “Convergence in multiagent coordination, consensus, and flocking,” in Proc. IEEE Conf. Decision Control (CDC), 2005, pp. 2996–3000.
- “Data-reserved periodic diffusion LMS with low communication cost over networks,” IEEE Access, vol. 6, pp. 54636–54650, Sep. 2018.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.