CCBNet: Confidential Collaborative Bayesian Networks Inference (2405.15055v1)
Abstract: Effective large-scale process optimization in manufacturing industries requires close cooperation between different human expert parties who encode their knowledge of related domains as Bayesian network models. For instance, Bayesian networks for domains such as lithography equipment, processes, and auxiliary tools must be conjointly used to effectively identify process optimizations in the semiconductor industry. However, business confidentiality across domains hinders such collaboration, and encourages alternatives to centralized inference. We propose CCBNet, the first Confidentiality-preserving Collaborative Bayesian Network inference framework. CCBNet leverages secret sharing to securely perform analysis on the combined knowledge of party models by joining two novel subprotocols: (i) CABN, which augments probability distributions for features across parties by modeling them into secret shares of their normalized combination; and (ii) SAVE, which aggregates party inference result shares through distributed variable elimination. We extensively evaluate CCBNet via 9 public Bayesian networks. Our results show that CCBNet achieves predictive quality that is similar to the ones of centralized methods while preserving model confidentiality. We further demonstrate that CCBNet scales to challenging manufacturing use cases that involve 16-128 parties in large networks of 223-1003 features, and decreases, on average, computational overhead by 23%, while communicating 71k values per request. Finally, we showcase possible attacks and mitigations for partially reconstructing party networks in the two subprotocols.
- Fed-cd: Federated causal discovery from interventional and observational data, 2022. URL https://arxiv.org/abs/2211.03846.
- Combining experts’ causal judgments. Artificial Intelligence, 288:103355, 2020. ISSN 0004-3702. https://doi.org/10.1016/j.artint.2020.103355. URL https://www.sciencedirect.com/science/article/pii/S0004370220301065.
- D. Beaver. Efficient multiparty protocols using circuit randomization. In J. Feigenbaum, editor, Advances in Cryptology — CRYPTO ’91, pages 420–432, Berlin, Heidelberg, 1992. Springer Berlin Heidelberg. ISBN 978-3-540-46766-3.
- Functional encryption: Definitions and challenges. In Y. Ishai, editor, Theory of Cryptography, pages 253–273, Berlin, Heidelberg, 2011. Springer Berlin Heidelberg. ISBN 978-3-642-19571-6.
- T. Campbell and J. P. How. Approximate decentralized bayesian inference, 2014.
- Homomorphic encryption for arithmetic of approximate numbers. In T. Takagi and T. Peyrin, editors, Advances in Cryptology – ASIACRYPT 2017, pages 409–437, Cham, 2017. Springer International Publishing. ISBN 978-3-319-70694-8.
- Finding community structure in very large networks. Physical Review E, 70(6), dec 2004. 10.1103/physreve.70.066111. URL https://doi.org/10.1103%2Fphysreve.70.066111.
- Secure Multiparty Computation and Secret Sharing. Cambridge University Press, 2015. 10.1017/CBO9781107337756.
- Learning bayesian networks: approaches and issues. The knowledge engineering review, 26(2):99–157, 2011.
- E. De Cristofaro and G. Tsudik. Practical private set intersection protocols with linear complexity. In R. Sion, editor, Financial Cryptography and Data Security, pages 143–159, Berlin, Heidelberg, 2010. Springer Berlin Heidelberg.
- J. Del Sagrado and S. Moral. Qualitative combination of bayesian networks. International Journal of Intelligent Systems, 18(2):237–249, 2003. https://doi.org/10.1002/int.10086. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/int.10086.
- A novel method for combining bayesian networks, theoretical analysis, and its applications. Pattern Recognition, 47(5):2057–2069, 2014. ISSN 0031-3203. https://doi.org/10.1016/j.patcog.2013.12.005. URL https://www.sciencedirect.com/science/article/pii/S0031320313005232.
- Feddag: Federated dag structure learning, 2021. URL https://arxiv.org/abs/2112.03555.
- Decentralized approximate bayesian inference for distributed sensor network. Proceedings of the AAAI Conference on Artificial Intelligence, 30(1), Feb. 2016. 10.1609/aaai.v30i1.10201. URL https://ojs.aaai.org/index.php/AAAI/article/view/10201.
- O. Goldreich. Foundations of cryptography – a primer. Foundations and Trends® in Theoretical Computer Science, 1(1):1–116, 2005. ISSN 1551-305X. 10.1561/0400000001. URL http://dx.doi.org/10.1561/0400000001.
- Towards privacy-aware causal structure learning in federated setting, 2022. URL https://arxiv.org/abs/2211.06919.
- D. Kales. Secret sharing. URL https://www.iaik.tugraz.at/wp-content/uploads/teaching/mfc/secret_sharing.pdf.
- Blind justice: Fairness with encrypted sensitive attributes. In J. Dy and A. Krause, editors, Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 2630–2639. PMLR, 10–15 Jul 2018. URL https://proceedings.mlr.press/v80/kilbertus18a.html.
- H.-C. Kim and Z. Ghahramani. Bayesian classifier combination. In N. D. Lawrence and M. Girolami, editors, Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics, volume 22 of Proceedings of Machine Learning Research, pages 619–627, La Palma, Canary Islands, 2012. PMLR. URL https://proceedings.mlr.press/v22/kim12.html.
- D. Koller and N. Friedman. Probabilistic graphical models: principles and techniques. MIT press, 2009.
- S. Z. Li. Markov random field modeling in image analysis. Springer Science & Business Media, 2009.
- Performance evaluation of a manufacturing process under uncertainty using bayesian networks. Journal of Cleaner Production, 113:947–959, 2016. ISSN 0959-6526. https://doi.org/10.1016/j.jclepro.2015.12.003. URL https://www.sciencedirect.com/science/article/pii/S0959652615018144.
- I. Ng and K. Zhang. Towards federated bayesian network structure learning with continuous optimization, 2021. URL https://arxiv.org/abs/2110.09356.
- A multi-agent systems approach to distributed bayesian information fusion. Information Fusion, 11(3):267–282, 2010. ISSN 1566-2535. https://doi.org/10.1016/j.inffus.2009.09.007. URL https://www.sciencedirect.com/science/article/pii/S1566253509000864. Agent-Based Information Fusion.
- J. Pearl. Causality. Cambridge University Press, 2 edition, 2009. 10.1017/CBO9780511803161.
- S. J. Russell. Artificial intelligence a modern approach. Pearson Education, Inc., 2010.
- M. Scutari and J.-B. Denis. Bayesian networks: with examples in R. CRC press, 2021.
- T. A. Stephenson. An introduction to bayesian network theory and usage. Technical report, Idiap, 2000.
- Distributed bayesian networks for user modeling. In T. Reeves and S. Yamashita, editors, Proceedings of E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2006, pages 292–299, Honolulu, Hawaii, USA, 10 2006. Association for the Advancement of Computing in Education (AACE). URL https://www.learntechlib.org/p/23699.
- Vertibayes: Learning bayesian network parameters from vertically partitioned data with missing values, 2022. URL https://arxiv.org/abs/2210.17228.
- W.-T. Yang. An Integrated Physics-Informed Process Control Framework and Its Applications to Semiconductor Manufacturing. Theses, Université de Lyon, Jan. 2020. URL https://theses.hal.science/tel-03461289.
- Methods & apparatus for obtaining diagnostic information, methods & apparatus for controlling an industrial process, Feb 2018.
Collections
Sign up for free to add this paper to one or more collections.