SLPerf: a Unified Framework for Benchmarking Split Learning
Abstract: Data privacy concerns has made centralized training of data, which is scattered across silos, infeasible, leading to the need for collaborative learning frameworks. To address that, two prominent frameworks emerged, i.e., federated learning (FL) and split learning (SL). While FL has established various benchmark frameworks and research libraries,SL currently lacks a unified library despite its diversity in terms of label sharing, model aggregation, and cut layer choice. This lack of standardization makes comparing SL paradigms difficult. To address this, we propose SLPerf, a unified research framework and open research library for SL, and conduct extensive experiments on four widely-used datasets under both IID and Non-IID data settings. Our contributions include a comprehensive survey of recently proposed SL paradigms, a detailed benchmark comparison of different SL paradigms in different situations, and rich engineering take-away messages and research insights for improving SL paradigms. SLPerf can facilitate SL algorithm development and fair performance comparisons. The code is available at https://github.com/Rainysponge/Split-learning-Attacks .
- Can we use split learning on 1d CNN models for privacy preserving training? CoRR, abs/2003.12365, 2020.
- Relational graph neural networks for fraud detection in a super-app environment. CoRR, abs/2107.13673, 2021.
- Alessandro and Mantelero. The eu proposal for a general data protection regulation and the roots of the ’right to be forgotten’. Computer law & security report, 29(3):229–235, 2013.
- Visual transformer meets cutmix for improved accuracy, communication efficiency, and data privacy in split learning. arXiv e-prints, 2022.
- Flower: A friendly federated learning research framework. CoRR, abs/2007.14390, 2020.
- LEAF: A benchmark for federated settings. CoRR, abs/1812.01097, 2018.
- Communication and computation reduction for split learning using asynchronous training. CoRR, abs/2107.09786, 2021.
- An-Yeu (Andy)Wu Cheng-Yen Hsieh, Yu-Chuan Chuang. C3-sl: Circular convolution-based batch-wise compression for communication-efficient split learning. CoRR, abs/2207.12397, 2022.
- The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications, 23(3):187–200, 2000.
- Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems, 2(2):396–404, 1990.
- Accurate, large minibatch SGD: training imagenet in 1 hour. CoRR, abs/1706.02677, 2017.
- Distributed learning of deep neural network over multiple agents. CoRR, abs/1810.06060, 2018.
- Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, 2016.
- Fedml: A research library and benchmark for federated machine learning. CoRR, abs/2007.13518, 2020.
- C3-SL: circular convolution-based batch-wise compression for communication-efficient split learning. CoRR, abs/2207.12397, 2022.
- Patient clustering improves efficiency of federated machine learning to predict mortality and hospital stay time using distributed electronic medical records. Journal of Biomedical Informatics, 99:103291, 2019.
- J. Jeon and J. Kim. Privacy-sensitive parallel split learning. In 2020 International Conference on Information Networking (ICOIN), 2020.
- R. Kohavi. Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid. Proc of Kdd, 1997.
- Federated learning: Strategies for improving communication efficiency. CoRR, abs/1610.05492, 2016.
- Imagenet classification with deep convolutional neural networks. Commun. ACM, 60(6):84–90, may 2017.
- Detecting cancer metastases on gigapixel pathology images. CoRR, abs/1703.02442, 2017.
- Energy Efficient User Scheduling for Hybrid Split and Federated Learning in Wireless UAV Networks. IEEE Communications Society, United States, 2022.
- Federated learning of deep networks using model averaging. CoRR, abs/1602.05629, 2016.
- Locfedmix-sl: Localize, federate, and mix for improved scalability, convergence, and latency in split learning. In Proceedings of the ACM Web Conference 2022, WWW ’22, page 3347–3357, New York, NY, USA, 2022. Association for Computing Machinery.
- Server-side local gradient averaging and learning rate acceleration for scalable split learning. CoRR, abs/2112.05929, 2021.
- Federated split vision transformer for covid-19cxr diagnosis using task-agnostic training, 2021.
- Plate and A. T. Holographic reduced representations. Neural Networks, IEEE Transactions on, 1995.
- Split learning for collaborative deep learning in healthcare. CoRR, abs/1912.12115, 2019.
- A generic framework for privacy preserving deep learning. CoRR, abs/1811.04017, 2018.
- Deep ehr: A survey of recent advances in deep learning techniques for electronic health record (ehr) analysis. IEEE Journal of Biomedical and Health Informatics, 22(5):1589–1604, 2018.
- Splitfed: When federated learning meets split learning. CoRR, abs/2004.12088, 2020.
- Federated or split? a performance and privacy analysis of hybrid split and federated learning architectures. In 2021 IEEE 14th International Conference on Cloud Computing (CLOUD), pages 250–260, 2021.
- No peek: A survey of private distributed deep learning. CoRR, abs/1812.03288, 2018.
- Random feature nullification for adversary resistant deep architecture. CoRR, abs/1610.01239, 2016.
- Split learning over wireless networks: Parallel design and resource management. arXiv e-prints, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper.
