Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Causal Influence in Federated Edge Inference (2405.01260v1)

Published 2 May 2024 in cs.LG, cs.MA, cs.SY, eess.SP, and eess.SY

Abstract: In this paper, we consider a setting where heterogeneous agents with connectivity are performing inference using unlabeled streaming data. Observed data are only partially informative about the target variable of interest. In order to overcome the uncertainty, agents cooperate with each other by exchanging their local inferences with and through a fusion center. To evaluate how each agent influences the overall decision, we adopt a causal framework in order to distinguish the actual influence of agents from mere correlations within the decision-making process. Various scenarios reflecting different agent participation patterns and fusion center policies are investigated. We derive expressions to quantify the causal impact of each agent on the joint decision, which could be beneficial for anticipating and addressing atypical scenarios, such as adversarial attacks or system malfunctions. We validate our theoretical results with numerical simulations and a real-world application of multi-camera crowd counting.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. A. H. Sayed, “Adaptation, learning, and optimization over networks,” Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311–801, July 2014.
  2. M. Kayaalp and A. H. Sayed, “Causal influences over social learning networks,” arXiv:2307.09575, July 2023.
  3. M. Kayaalp, Y. İnan, V. Koivunen, E. Telatar, and A. H. Sayed, “On the fusion strategies for federated decision making,” in Proc. IEEE Statistical Signal Processing Workshop (SSP), Hanoi, Vietnam, July 2023, pp. 270–274. [Online]. Available: arXiv:2303.06109
  4. T. Chavdarova, P. Baqué, A. Maksai, S. Bouquet, C. Jose, L. Lettry, F. Fleuret, P. Fua, and L. V. Gool, “WILDTRACK: A multi-camera hd dataset for dense unscripted pedestrian detection,” in Proc. IEEE/CVF CVPR, Salt Lake City, UT, June 2018, pp. 5030–5039.
  5. L. S. Shapley, “A value for n-person games,” in Contributions to the Theory of Games (AM-28), Volume II.   Princeton University Press, 1953, pp. 307–318.
  6. F. Dablander and M. Hinne, “Node centrality measures are a poor substitute for causal inference,” Scientific Reports, vol. 9, no. 1, p. 6846, 2019.
  7. V. Shumovskaia, M. Kayaalp, M. Cemri, and A. H. Sayed, “Discovering influencers in opinion formation over social graphs,” IEEE Open Journal of Signal Processing, vol. 4, pp. 188–207, 2023.
  8. B. Schölkopf, F. Locatello, S. Bauer, N. R. Ke, N. Kalchbrenner, A. Goyal, and Y. Bengio, “Toward causal representation learning,” Proc. IEEE, vol. 109, no. 5, pp. 612–634, 2021.
  9. A. Jadbabaie, P. Molavi, A. Sandroni, and A. Tahbaz-Salehi, “Non-Bayesian social learning,” Games and Economic Behavior, vol. 76, no. 1, pp. 210–225, 2012.
  10. X. Zhao and A. H. Sayed, “Learning over social networks via diffusion adaptation,” in Proc. Asilomar Conference on Signals, Systems and Computers, Pacific Grove, 2012, pp. 709–713.
  11. A. Nedić, A. Olshevsky, and C. A. Uribe, “Fast convergence rates for distributed non-Bayesian learning,” IEEE Transactions on Automatic Control, vol. 62, no. 11, pp. 5538–5553, 2017.
  12. A. Lalitha, T. Javidi, and A. D. Sarwate, “Social learning and distributed hypothesis testing,” IEEE Transactions on Information Theory, vol. 64, no. 9, pp. 6161–6179, 2018.
  13. V. Bordignon, V. Matta, and A. H. Sayed, “Adaptive social learning,” IEEE Transactions on Information Theory, vol. 67, no. 9, pp. 6053–6081, 2021.
  14. J. Shaska and U. Mitra, “Type-sensitive social learning,” in Proc. IEEE International Conference on Communications, 2023, pp. 4634–4639.
  15. M. Kayaalp, Y. Inan, E. Telatar, and A. H. Sayed, “On the arithmetic and geometric fusion of beliefs for distributed inference,” IEEE Transactions on Automatic Control, vol. 69, no. 4, pp. 2265–2280, 2024.
  16. I. Hoballah and P. Varshney, “Distributed Bayesian signal detection,” IEEE Transactions on Information Theory, vol. 35, no. 5, pp. 995–1000, 1989.
  17. J. N. Tsitsiklis, “Decentralized detection by a large number of sensors,” Mathematics of Control, Signals and Systems, vol. 1, no. 2, pp. 167–182, 1988.
  18. ——, “Decentralized detection,” in In Advances in Statistical Signal Processing.   JAI Press, 1993, pp. 297–344.
  19. Q. Zou, S. Zheng, and A. H. Sayed, “Cooperative sensing via sequential detection,” IEEE Transactions on Signal Processing, vol. 58, no. 12, pp. 6266–6283, 2010.
  20. D. Bajovic, D. Jakovetic, J. M. Moura, J. Xavier, and B. Sinopoli, “Large deviations performance of consensus+ innovations distributed detection with non-Gaussian observations,” IEEE Transactions on Signal Processing, vol. 60, no. 11, pp. 5987–6002, 2012.
  21. T. Li, X. Wang, Y. Liang, and Q. Pan, “On arithmetic average fusion and its application for distributed multi-bernoulli multitarget tracking,” IEEE Transactions on Signal Processing, vol. 68, pp. 2883–2896, 2020.
  22. Y. Inan, M. Kayaalp, A. H. Sayed, and E. Telatar, “A fundamental limit of distributed hypothesis testing under memoryless quantization,” in Proc. IEEE International Conference on Communications (ICC), 2022, pp. 4824–4829.
  23. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y. Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. AISTATS, vol. 54, April 2017, pp. 1273–1282.
  24. T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated learning: Challenges, methods, and future directions,” IEEE Signal Processing Magazine, vol. 37, no. 3, pp. 50–60, 2020.
  25. P. Kairouz, H. B. McMahan et al., “Advances and open problems in federated learning,” Foundations and Trends® in Machine Learning, vol. 14, no. 1–2, pp. 1–210, 2021.
  26. E. Rizk, S. Vlaski, and A. H. Sayed, “Federated learning under importance sampling,” IEEE Transactions on Signal Processing, vol. 70, pp. 5381–5396, 2022.
  27. K. Ozkara, A. M. Girgis, D. Data, and S. Diggavi, “A statistical framework for personalized federated learning and estimation: Theory, algorithms, and privacy,” in Proc. ICLR, 2023, pp. 1–37.
  28. A. M. Elbir, B. Soner, S. Çöleri, D. Gündüz, and M. Bennis, “Federated learning in vehicular networks,” in Proc. IEEE International Mediterranean Conference on Communications and Networking (MeditCom).   IEEE, 2022, pp. 72–77.
  29. W. Liu, M. Salzmann, and P. Fua, “Context-aware crowd counting,” in Proc. IEEE/CVF CVPR, Long Beach, CA, June 2019.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now