Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Federated Learning of Socially Appropriate Agent Behaviours in Simulated Home Environments (2403.07586v1)

Published 12 Mar 2024 in cs.LG, cs.AI, cs.CY, and cs.RO

Abstract: As social robots become increasingly integrated into daily life, ensuring their behaviours align with social norms is crucial. For their widespread open-world application, it is important to explore Federated Learning (FL) settings where individual robots can learn about their unique environments while also learning from each others' experiences. In this paper, we present a novel FL benchmark that evaluates different strategies, using multi-label regression objectives, where each client individually learns to predict the social appropriateness of different robot actions while also sharing their learning with others. Furthermore, splitting the training data by different contexts such that each client incrementally learns across contexts, we present a novel Federated Continual Learning (FCL) benchmark that adapts FL-based methods to use state-of-the-art Continual Learning (CL) methods to continually learn socially appropriate agent behaviours under different contextual settings. Federated Averaging (FedAvg) of weights emerges as a robust FL strategy while rehearsal-based FCL enables incrementally learning the social appropriateness of robot actions, across contextual splits.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Memory Aware Synapses: Learning What (not) to Forget. In Proceedings of the European Conference on Computer Vision (ECCV). 139–154.
  2. Ali Ayub and Alan R. Wagner. 2020. What Am I Allowed to Do Here?: Online Learning of Context-Specific Norms by Pepper. In Social Robotics, Alan R. Wagner, David Feil-Seifer, Kerstin S. Haring, Silvia Rossi, Thomas Williams, Hongsheng He, and Shuzhi Sam Ge (Eds.). Springer International Publishing, 220–231.
  3. Pearson correlation coefficient. In Noise reduction in speech processing. Springer, 37–40.
  4. Zhiyuan Chen and Bing Liu. 2018. Lifelong Machine Learning. Springer International Publishing, Cham.
  5. Continual Learning for Affective Robotics: Why, What and How?. In 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 425–431.
  6. Effects of (in) accurate empathy and situational valence on attitudes towards robots. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 141–142.
  7. Principles and guidelines for evaluating social robot navigation algorithms. arXiv preprint arXiv:2306.16740 (2023).
  8. Learning socially appropriate robot approaching behavior toward groups using deep reinforcement learning. In 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 1–8.
  9. Luke Guerdan and Hatice Gunes. 2023. Federated Continual Learning for Socially Aware Robotics. In 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). 1522–1529.
  10. Embracing Change: Continual Learning in Deep Neural Networks. Trends in Cognitive Sciences 24, 12 (Dec. 2020), 1028–1040.
  11. Distilling the Knowledge in a Neural Network. In NIPS Deep Learning and Representation Learning Workshop.
  12. Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselines. In NeurIPS Continual learning Workshop.
  13. A Survey on Federated Learning for Resource-Constrained IoT Devices. IEEE Internet of Things Journal 9, 1 (2022), 1–24.
  14. Federated Learning Algorithm Based on Knowledge Distillation. 2020 International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 163–167.
  15. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences 114, 13 (2017), 3521–3526.
  16. Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges. Information Fusion 58 (2020), 52–68.
  17. Federated Optimization in Heterogeneous Networks. In Proceedings of Machine Learning and Systems, I. Dhillon, D. Papailiopoulos, and V. Sze (Eds.), Vol. 2. 429–450.
  18. On the Convergence of FedAvg on Non-IID Data. In International Conference on Learning Representations.
  19. FedBN: Federated Learning on Non-IID Features via Local Batch Normalization. In International Conference on Learning Representations.
  20. Generative Feature Replay For Class-Incremental Learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE.
  21. SocNav1: A Dataset to Benchmark and Learn Social Navigation Conventions. Data 5, 1 (2020).
  22. Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 54), Aarti Singh and Jerry Zhu (Eds.). PMLR, 1273–1282.
  23. Learning Socially Appropriate Robo-Waiter Behaviours through Real-Time User Feedback. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction (HRI) (Sapporo, Hokkaido, Japan) (HRI ’22). IEEE Press, 541–550.
  24. Continual Lifelong Learning with Neural Networks: A review. Neural Networks 113 (2019), 54–71.
  25. Open-World Machine Learning: Applications, Challenges, and Opportunities. ACM Comput. Surv. 55, 10, Article 205 (feb 2023), 37 pages.
  26. Adaptive Federated Optimization. In International Conference on Learning Representations.
  27. Progress & Compress: A scalable framework for continual learning. In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 80), Jennifer Dy and Andreas Krause (Eds.). PMLR, Stockholmsmässan, Stockholm Sweden, 4528–4537.
  28. Latent Generative Replay for Resource-Efficient Continual Learning of Facial Expressions. In 17th IEEE International Conference on Automatic Face and Gesture Recognition (FG). 1–8.
  29. Mind Your Manners! A Dataset and a Continual Learning Approach for Assessing Social Appropriateness of Robot Actions. Frontiers in Robotics and AI 9 (2022).
  30. Federated Continual Learning with Weighted Inter-client Transfer. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 12073–12086.
  31. Continual Learning Through Synaptic Intelligence, In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia). Proceedings of machine learning research 70, 3987–3995.
  32. A survey on federated learning. Knowledge-Based Systems 216 (2021), 106775.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets