Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Blinder: End-to-end Privacy Protection in Sensing Systems via Personalized Federated Learning (2209.12046v3)

Published 24 Sep 2022 in cs.LG and cs.CR

Abstract: This paper proposes a sensor data anonymization model that is trained on decentralized data and strikes a desirable trade-off between data utility and privacy, even in heterogeneous settings where the sensor data have different underlying distributions. Our anonymization model, dubbed Blinder, is based on a variational autoencoder and one or multiple discriminator networks trained in an adversarial fashion. We use the model-agnostic meta-learning framework to adapt the anonymization model trained via federated learning to each user's data distribution. We evaluate Blinder under different settings and show that it provides end-to-end privacy protection on two IMU datasets at the cost of increasing privacy loss by up to 4.00% and decreasing data utility by up to 4.24%, compared to the state-of-the-art anonymization model trained on centralized data. We also showcase Blinder's ability to anonymize the radio frequency sensing modality. Our experiments confirm that Blinder can obscure multiple private attributes at once, and has sufficiently low power consumption and computational overhead for it to be deployed on edge devices and smartphones to perform real-time anonymization of sensor data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (80)
  1. 2021 [Online]. ObscureNet Implementation. https://github.com/sustainable-computing/ObscureNet. Accessed in 2021.
  2. 2022 [Online]. Advanced Python Scheduler. https://github.com/agronholm/apscheduler. Accessed in 2022.
  3. 2023 [Online]. Anonymization Autoencoder Implementation. https://github.com/mmalekzadeh/motion-sense. Accessed in 2023.
  4. 2023 [Online]. BalanceFL Implementation. https://github.com/sxontheway/BalanceFL. Accessed in 2023.
  5. Martin Abadi et al. 2016. Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC conference on computer and communications security. 308–318.
  6. Maruan Al-Shedivat et al. 2021. On data efficiency of meta-learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 1369–1377.
  7. Ranya Aloufi et al. 2020. Privacy-preserving voice analysis via disentangled representations. In Proceedings of the ACM SIGSAC Conference on Cloud Computing Security Workshop. 1–14.
  8. Omid Aramoon et al. 2021. Meta Federated Learning. arXiv preprint arXiv:2102.05561 (2021).
  9. Manoj Ghuhan Arivazhagan et al. 2019. Federated learning with personalization layers. arXiv preprint arXiv:1912.00818 (2019).
  10. Sébastien M R Arnold et al. 2020. learn2learn: A Library for Meta-Learning Research. arXiv preprint arXiv:2008.12284 (2020).
  11. A dataset for Wi-Fi-based human activity recognition in line-of-sight and non-line-of-sight indoor environments. Data in Brief 33 (2020), 106534.
  12. Adversarially learned representations for information obfuscation and inference. In International Conference on Machine Learning. PMLR, 614–623.
  13. PerFED-GAN: Personalized federated learning via generative adversarial networks. IEEE Internet of Things Journal (2022).
  14. Charikleia Chatzaki et al. 2016. Human daily activity and fall recognition using a smartphone’s acceleration sensor. In International Conference on Information and Communication Technologies for Ageing Well and e-Health. Springer, 100–118.
  15. Nitesh V Chawla et al. 2002. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research 16 (2002), 321–357.
  16. Fei Chen et al. 2018. Federated meta-learning with fast convergence and efficient communication. arXiv preprint arXiv:1802.07876 (2018).
  17. Mingzhe Chen et al. 2020. A joint learning and communications framework for federated learning over wireless networks. IEEE Transactions on Wireless Communications 20, 1 (2020), 269–283.
  18. Zhe Chen et al. 2021. MoVi-Fi: motion-robust vital signs waveform recovery via deep interpreted RF sensing. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 392–405.
  19. François Chollet et al. 2015. Keras. https://keras.io.
  20. Edward J Chou et al. 2020. Privacy-preserving phishing web page classification via fully homomorphic encryption. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2792–2796.
  21. Liam Collins et al. 2021. Exploiting shared representations for personalized federated learning. In International Conference on Machine Learning. PMLR, 2089–2099.
  22. Adaptive personalized federated learning. arXiv preprint arXiv:2003.13461 (2020).
  23. C4. 5, class imbalance, and cost sensitivity: why under-sampling beats over-sampling. In Workshop on learning from imbalanced datasets II, Vol. 11. 1–8.
  24. Self-balancing federated learning with global imbalanced data in mobile systems. IEEE Transactions on Parallel and Distributed Systems 32, 1 (2020), 59–71.
  25. Cynthia Dwork et al. 2006. Our data, ourselves: Privacy via distributed noise generation. In Annual International Conference on the Theory and Applications of Cryptographic Techniques. Springer, 486–503.
  26. Alireza Fallah et al. 2020. Personalized federated learning with theoretical guarantees: A model-agnostic meta-learning approach. Advances in Neural Information Processing Systems 33 (2020), 3557–3568.
  27. Chenyou Fan and Ping Liu. 2020. Federated generative adversarial learning. In Pattern Recognition and Computer Vision: Third Chinese Conference, PRCV 2020, Nanjing, China, October 16–18, 2020, Proceedings, Part III 3. Springer, 3–15.
  28. Chelsea Finn et al. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning. PMLR, 1126–1135.
  29. Enrique Garcia-Ceja et al. 2018. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing 51 (2018), 1–26.
  30. Ran Gilad-Bachrach et al. 2016. Cryptonets: Applying neural networks to encrypted data with high throughput and accuracy. In International Conference on Machine Learning. PMLR, 201–210.
  31. Oded Goldreich. 1998. Secure multi-party computation. Manuscript. Preliminary version 78 (1998).
  32. Oded Goldreich. 2009. Foundations of cryptography: volume 2, basic applications. Cambridge University Press.
  33. How to Play ANY Mental Game. In Proceedings of the Nineteenth Annual ACM Symposium on Theory of Computing (STOC ’87). ACM, 218–229.
  34. Omid Hajihassani et al. 2022. Anonymizing Sensor Data on the Edge: A Representation Learning and Transformation Approach. Transactions on Internet of Things 3, 1 (2022).
  35. Omid Hajihassnai et al. 2021. ObscureNet: Learning Attribute-invariant Latent Representation for Anonymizing Sensor Data. In Proceedings of the International Conference on Internet-of-Things Design and Implementation. 40–52.
  36. Jihun Hamm. 2017. Minimax filter: Learning to preserve privacy from inference attacks. The Journal of Machine Learning Research 18, 1 (2017), 4704–4734.
  37. Md-gan: Multi-discriminator generative adversarial networks for distributed datasets. In 2019 IEEE international parallel and distributed processing symposium (IPDPS). IEEE, 866–877.
  38. Nathalie Japkowicz and Shaju Stephen. 2002. The class imbalance problem: A systematic study. Intelligent data analysis 6, 5 (2002), 429–449.
  39. Yihan Jiang et al. 2019. Improving federated learning personalization via model agnostic meta learning. arXiv preprint arXiv:1909.12488 (2019).
  40. Sai Praneeth Karimireddy et al. 2020. Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning. PMLR, 5132–5143.
  41. Mikhail Khodak et al. 2019. Adaptive gradient-based meta-learning methods. Advances in Neural Information Processing Systems 32 (2019).
  42. Durk P Kingma et al. 2014. Semi-supervised learning with deep generative models. Advances in Neural Information Processing Systems 27 (2014).
  43. Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
  44. Keith Kirkpatrick. 2021. Monetizing Your Personal Data. Commun. ACM 65, 1 (dec 2021), 17–19.
  45. Lyudmyla F Kozachenko and Nikolai N Leonenko. 1987. Sample estimate of the entropy of a random vector. Problemy Peredachi Informatsii 23, 2 (1987), 9–16.
  46. Jacob Kröger. 2018. Unexpected inferences from sensor data: a hidden privacy threat in the internet of things. In IFIP International Internet of Things Conference. Springer, 147–159.
  47. Remedies for severe class imbalance. Applied predictive modeling (2013), 419–443.
  48. Yann LeCun et al. 2015. Deep learning. Nature 521, 7553 (2015), 436–444.
  49. Ang Li et al. 2020a. TIPRDC: task-independent privacy-respecting data crowdsourcing framework for deep learning with anonymized intermediate representations. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 824–832.
  50. Ang Li et al. 2021a. DeepObfuscator: Obfuscating Intermediate Representations with Privacy-Preserving Adversarial Learning on Smartphones. In Proceedings of the International Conference on Internet-of-Things Design and Implementation. 28–39.
  51. Ang Li et al. 2021b. Hermes: an efficient federated learning framework for heterogeneous mobile clients. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 420–437.
  52. Tian Li et al. 2020b. Federated learning: Challenges, methods, and future directions. IEEE Signal Processing Magazine 37, 3 (2020), 50–60.
  53. Tian Li et al. 2020c. Federated optimization in heterogeneous networks. Proceedings of Machine Learning and Systems 2 (2020), 429–450.
  54. Ifl-gan: Improved federated learning generative adversarial network with maximum mean discrepancy model aggregation. IEEE Transactions on Neural Networks and Learning Systems (2022).
  55. Xiling Li et al. 2021c. Privacy-preserving feature selection with secure multiparty computation. In International Conference on Machine Learning. PMLR, 6326–6336.
  56. Changchang Liu et al. 2016. Dependence Makes You Vulnberable: Differential Privacy Under Dependent Tuples. In The 23rd Annual Network and Distributed System Security Symposium. 1–15.
  57. Sicong Liu et al. 2019. Privacy adversarial network: representation learning for mobile data privacy. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1–18.
  58. Zhihan Lv and Francesco Piccialli. 2021. The security of medical data on internet based on differential privacy technology. ACM Transactions on Internet Technology 21, 3 (2021), 1–18.
  59. Mohammad Malekzadeh et al. 2019. Mobile sensor data anonymization. In Proceedings of the international conference on internet of things design and implementation. 49–58.
  60. Brendan McMahan et al. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273–1282.
  61. Fan Mo et al. 2021. PPFL: privacy-preserving federated learning with trusted execution environments. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services. 94–108.
  62. Alex Nichol et al. 2018. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999 (2018).
  63. Adam Paszke et al. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024–8035.
  64. Kurt Plarre et al. 2011. Continuous inference of psychological stress from sensory measurements collected in the natural environment. In Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks. IEEE, 97–108.
  65. Jean Louis Raisaro et al. 2018. Protecting privacy and security of genomic data in i2b2 with homomorphic encryption and differential privacy. IEEE/ACM Transactions on Computational Biology and Bioinformatics 15, 5 (2018), 1413–1426.
  66. Nisarg Raval et al. 2019. Olympus: Sensor Privacy through Utility Aware Obfuscation. Proc. Priv. Enhancing Technol. 2019, 1 (2019), 5–25.
  67. BalanceFL: Addressing class imbalance in long-tail federated learning. In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 271–284.
  68. Jinhyun So et al. 2021. CodedPrivateML: A fast and privacy-preserving framework for distributed machine learning. IEEE Journal on Selected Areas in Information Theory 2, 1 (2021), 441–451.
  69. Personalized federated learning with moreau envelopes. Advances in Neural Information Processing Systems 33 (2020), 21394–21405.
  70. Cory Thoma et al. 2012. Secure multiparty computation based privacy preserving smart metering system. In 2012 North American Power Symposium (NAPS). IEEE, 1–6.
  71. Michael E Tipping and Christopher M Bishop. 1999. Mixtures of probabilistic principal component analyzers. Neural computation 11, 2 (1999), 443–482.
  72. Stacey Truex et al. 2019. A hybrid approach to privacy-preserving federated learning. In Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security. 1–11.
  73. Jianyu Wang et al. 2020. Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in Neural Information Processing Systems 33 (2020), 7611–7623.
  74. Addressing class imbalance in federated learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 10165–10173.
  75. Runhua Xu et al. 2019. HybridAlpha: An efficient approach for privacy-preserving federated learning. In Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security. 13–23.
  76. Yilin Yang et al. 2021. Secure Coded Computation for Efficient Distributed Learning in Mobile IoT. In 18th Annual International Conference on Sensing, Communication, and Networking. IEEE, 1–9.
  77. Shuochao Yao et al. 2017. DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 351–360.
  78. Fedsens: A federated learning approach for smart health sensing with class imbalance in resource constrained edge computing. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1–10.
  79. Lide Zhang et al. 2010. Accurate online power estimation and automatic battery behavior based power model generation for smartphones. In Proceedings of the Eighth IEEE/ACM/IFIP international conference on Hardware/software codesign and system synthesis. 105–114.
  80. Trade-offs and guarantees of adversarial representation learning for information obfuscation. Advances in Neural Information Processing Systems 33 (2020), 9485–9496.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Xin Yang (314 papers)
  2. Omid Ardakanian (16 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now