Guard-GBDT: Secure Vertical GBDT Framework
- Guard-GBDT is a secure vertical federated learning system where two parties jointly train GBDT models without revealing raw features, labels, or gradients.
- The framework eliminates expensive MPC operations like division and sigmoid evaluation by using lookup-table approximations driven by function secret sharing.
- It achieves significant speedups and reduced communication compared to SiGBDT and HEP-XGB, while maintaining simulation-based security with minimal accuracy loss.
Searching arXiv for the primary Guard-GBDT paper and closely related vertical secure GBDT work. Search query: Guard-GBDT vertical GBDT MPC SiGBDT HEP-XGB Guard-GBDT is a two-party secure training framework for gradient boosting decision trees (GBDT) over vertically partitioned data. It is designed for the setting in which two parties hold disjoint feature subsets for the same samples, one party holds the labels, and both parties wish to train a single GBDT model without revealing raw features, labels, gradients, thresholds, or sample assignments. Its defining technical move is to eliminate the principal MPC bottlenecks in vertical GBDT training—division and sigmoid evaluation—by replacing them with lookup-table approximations driven by function secret sharing, while separately reducing bandwidth through a compression-aware gradient aggregation protocol. In the reported implementation, these choices yield up to speedup over SiGBDT and up to over HEP-XGB on LAN, up to and on WAN, with accuracy comparable to plaintext XGBoost and SiGBDT within approximately to (Song et al., 28 Jul 2025).
1. Problem setting and baseline GBDT formulation
Guard-GBDT operates in vertical federated learning. Two parties, denoted and , hold column-wise partitions of a dataset with the same samples. owns the labels 0, while both parties contribute features to a jointly trained GBDT. For a selected split, the corresponding feature index and threshold are revealed only to the party that owns that feature; the other party learns nothing about the split contents. Gradient statistics, split decisions, and leaf weights are computed privately (Song et al., 28 Jul 2025).
The learning objective follows standard histogram-based GBDT for binary classification with logistic loss. Let 1 be the current ensemble score and 2 the probability, where
3
For sample 4 with label 5, the gradient and Hessian are
6
In MPC, Guard-GBDT uses fixed-point encoding over the ring 7, with 8, typically 9 and fractional precision 0 (Song et al., 28 Jul 2025).
At a tree node with sample set 1, and for a candidate split producing 2 and 3, the aggregated statistics are
4
5
The standard XGBoost split gain is
6
and the leaf weight is
7
These formulas identify the core difficulty: split evaluation requires three divisions, leaf estimation requires another division, and logistic training requires secure sigmoid computation (Song et al., 28 Jul 2025).
2. Threat model, leakage profile, and cryptographic architecture
Guard-GBDT assumes a static, semi-honest PPT adversary corrupting one party. The protocol uses a preprocessing model with a secure third party (STP) that generates input-independent randomness offline. There is no collusion between 8 and 9, and the STP learns no inputs or outputs (Song et al., 28 Jul 2025).
Its security target is simulation-based security for the individual sub-protocols and for the composed training workflow. Leakage is explicitly limited to the tree structure, including which party owns the split at each node and the public tree topology. Feature values, labels, gradients, thresholds, and per-sample assignments remain secret. When a split is chosen, only the owner learns the corresponding feature and threshold and performs the local comparison needed to update membership for the child nodes (Song et al., 28 Jul 2025).
The online cryptographic stack is intentionally narrow. Linear arithmetic is performed with 2-out-of-2 additive secret sharing (ASS), with Beaver triples for secure multiplication. Non-linear comparisons use function secret sharing (FSS), specifically DCF-based less-than evaluation. No homomorphic encryption, fully homomorphic encryption, or garbled circuits are used online. The paper situates its protocol libraries in relation to ABY for ASS and to Orca/FSS-style mixed-mode fixed-point secure computation (Song et al., 28 Jul 2025).
This privacy model is narrower than full identifier anonymity. Guard-GBDT addresses privacy of features, labels, gradients, thresholds, and sample assignments in a vertically aligned two-party setting. By contrast, later anonymous two-party GBDT work studies the stronger problem of hiding identifiers, intersection membership, intersection cardinality, and alignment in split data, using dual circuit-PSI, OPPRF, and RLWE-based aggregation (Chenyu et al., 26 May 2026). This distinction matters because “privacy-preserving vertical GBDT” does not by itself imply ID-hiding.
3. Division- and sigmoid-free approximations
The central algorithmic contribution of Guard-GBDT is the removal of MPC-unfriendly division and sigmoid evaluation through segment-wise lookup tables. For sigmoid approximation, the input domain is quantized into 0 segments over 1, exploiting saturation outside that range. With
2
the table stores
3
A piecewise-constant approximation 4 is then selected via private less-than tests. If 5, the reconstruction formula is
6
The online phase requires one communication round and 7 bits, with no exponentiation or division inside MPC. Offline memory is approximately 8 bits. With 9 and 0, the implemented LUT is 1 bytes per table (Song et al., 28 Jul 2025).
Leaf weights are approximated by a related LUT construction on 2, but division is avoided by rewriting the comparison. Instead of testing 3, Guard-GBDT evaluates
4
with DCF-based less-than. If 5 and 6, then
7
where 8. This yields an approximate Newton step without secure division (Song et al., 28 Jul 2025).
Guard-GBDT also replaces the standard split gain with a division-free surrogate that preserves candidate ordering. Let 9 and define
0
Then the surrogate gain is
1
The stated rationale is monotonicity: for
2
the sign of 3 is determined by 4, so the function is strictly monotone in 5 on each side of 6. Because the parent term 7 is constant for a fixed node, ranking by the original gain is equivalent to ranking by a monotone transformation of the numerator terms, and 8 preserves order among candidates. The paper reports a proof of this claim in its appendix (Song et al., 28 Jul 2025).
A common misconception is that privacy-preserving GBDT requires exact secure implementations of every non-linearity in the plaintext algorithm. Guard-GBDT directly contradicts that premise: it introduces controlled approximation error in sigmoid and leaf weights, while keeping the ordering of split candidates intact through the surrogate gain. The reported empirical deviation from plaintext XGBoost is only 9 to 0 across the evaluated datasets (Song et al., 28 Jul 2025).
4. Compression-aware aggregation and end-to-end protocol flow
A second bottleneck in prior vertical secure GBDT systems is data inflation during gradient aggregation. Guard-GBDT exploits the fact that 1, so only the sign and fractional part carry information. Rather than masking every gradient with a full 2-bit share, its aggregation protocol 3 masks into a compact ring with 4. Preprocessing generates masks 5, 6, together with auxiliary values 7, 8, and 9, all secret-shared to the parties (Song et al., 28 Jul 2025).
Online, each party exchanges only a masked indicator bit and a compact masked gradient:
0
After reconstructing 1 and 2, the parties upcast to the 3-bit ring and compute 4 exactly, using the preprocessed masks and local arithmetic. The key bandwidth effect is explicit: compared with full 5-bit masking, the exchange saves 6 bits per gradient element. Accuracy is unchanged because the upcast preserves exact arithmetic over 7, and the paper states that security is unchanged as well (Song et al., 28 Jul 2025).
The full protocol has a clear offline–online decomposition. Offline, the STP generates Beaver triples, DCF keys for the sigmoid LUT, leaf-weight LUT, and Argmax, compact masks for 8, and the LUT tables themselves. Online, training proceeds tree by tree. First, the current ensemble score is computed by secret-shared inference over the already built trees, using the path vector method. Then 9 is computed from the sigmoid LUT, followed by
0
For each feature 1 and bin threshold 2, the owner locally tests against 3, produces a secret-shared test indicator, derives left and right membership vectors, aggregates 4 with 5, evaluates the division-free gain, and participates in a secure Argmax over all 6 candidates. The split owner is then identified by opening a comparison bit on the feature index; only the owner opens the winning feature and threshold and updates the sample space for the children. At leaves, the protocol aggregates 7 and computes the approximated leaf weight through the LUT (Song et al., 28 Jul 2025).
The round complexity per node drops to 8, in contrast to the 9 or 0 expressions reported for the previous systems to which Guard-GBDT is compared (Song et al., 28 Jul 2025).
5. Empirical performance and comparison with prior frameworks
The implementation is a PyTorch prototype with 1, 2, FSS security parameter 3, and lookup segment count 4, which the paper reports as empirically best. Evaluation uses five real-world datasets—Breast Cancer 5, Credit 6, Phishing 7, Skin 8, and Covertype 9—under simulated LAN with RTT 00 ms and 01 Gbps, and simulated WAN with RTT 02 ms and 03 Mbps (Song et al., 28 Jul 2025).
| Framework | Cryptographic mechanism | Stated bottleneck |
|---|---|---|
| HEP-XGB | Paillier PHE + ASS | 2048-bit ciphertext inflation; Goldschmidt division; rough sigmoid approximation |
| SiGBDT | ASS + FSS | Taylor/exp and division; 04-bit masking of gradients and Hessians |
| Guard-GBDT | ASS + FSS | LUT-based sigmoid and leaf weights; division-free gain; compact masking with 05 |
Accuracy is reported across tree depths 06 and tree counts 07. Guard-GBDT matches SiGBDT and plaintext XGBoost within 08 to 09 and is consistently better than HEP-XGB. Representative examples given in the paper are Breast Cancer at 10, where Guard-GBDT achieves 11 versus SiGBDT 12 and HEP-XGB 13, and Phishing at 14, where it achieves 15 versus 16 and 17. On Skin and Covertype, the reported accuracy is 18 across settings and is insensitive to segmentation 19, whereas smaller datasets stabilize for 20 to 21 (Song et al., 28 Jul 2025).
The microbenchmarks isolate the algorithmic changes. For input size 22, the division-free gain is reported as 23 to 24 faster than SiGBDT and HEP-XGB in LAN, and 25 to 26 in WAN. Gradient aggregation yields 27 and 28 speedups over SiGBDT and HEP-XGB in LAN, and 29 and 30 in WAN (Song et al., 28 Jul 2025).
In end-to-end training for one tree, Guard-GBDT is up to 31 faster than SiGBDT and up to 32 faster than HEP-XGB on LAN; on WAN, the reported maxima are 33 and 34. The communication reduction is also explicit: on Breast Cancer, Guard-GBDT uses 35 MB, which is 36 less than SiGBDT and 37 less than HEP-XGB; on Covertype, the savings are 38 and 39, respectively. For training 40 trees, the LAN speedups reach 41 versus SiGBDT and 42 versus HEP-XGB on Breast Cancer, while WAN results include 43 and 44 on the same dataset. The paper also reports 45 GB communication for Breast Cancer in the 46-tree setting, which is 47 less than SiGBDT and 48 less than HEP-XGB (Song et al., 28 Jul 2025).
Synthetic scalability results show similar trends. For one tree with 49k, 50, 51, 52, Guard-GBDT is 53 and 54 faster than SiGBDT and HEP-XGB; for 55k, the factors become 56 and 57; for 58, they are 59 and 60. Communication reductions at the baseline configuration are reported as 61 versus SiGBDT and 62 versus HEP-XGB, with larger reductions at larger scales (Song et al., 28 Jul 2025).
6. Security guarantees, limitations, and relation to adjacent work
The paper gives formal security statements for the LUT-based sigmoid protocol, the LUT-based leaf-weight protocol, and 63, under the assumption that ASS arithmetic and FSS DCF are secure. By sequential composition, the full training protocol inherits simulation-based security in the semi-honest model. The compression step does not weaken the masking guarantee: the stated adversarial success probability for guessing masked values remains 64, the same as standard masking of the informative sign and fractional bits (Song et al., 28 Jul 2025).
The framework also has explicit limits. It is a two-party system in its primary form. Its experimental focus is binary classification with logistic loss. The paper states that regression with MSE is simpler in MPC because 65 and no sigmoid or division is needed, while multi-class learning would require multi-sigmoid or softmax approximations and is left for future work. DCF key size grows linearly with the number of segments, so the segment count cannot be increased without cost; the reported experiments indicate that 66 suffices in practice. The use of an STP is restricted to input-independent randomness generation, and the paper notes that this role can be instantiated by generic 2PC or multi-party OT to avoid trust if needed (Song et al., 28 Jul 2025).
Several neighboring lines of work illuminate what Guard-GBDT does and does not solve. Anonymous two-party GBDT addresses hidden identifiers and hidden alignment rather than the aligned vertical setting assumed here (Chenyu et al., 26 May 2026). FairGBM studies fairness-constrained GBDT training via a proxy-Lagrangian dual ascent framework, targeting criteria such as demographic parity, equality of opportunity, predictive equality, and equalized odds rather than cryptographic privacy (Cruz et al., 2022). Separate work on backdoor attacks against GBDT and DNN models in insurance shows that tabular GBDT systems can remain vulnerable to training-time poisoning even when predictive performance is preserved, especially in some regression settings (Kühlem et al., 2024). A plausible implication is that efficient secure vertical training, identifier anonymity, fairness constraints, and robustness against poisoning are complementary rather than interchangeable design goals.
Within that broader landscape, Guard-GBDT is most precisely understood as an efficiency-oriented privacy-preserving vertical GBDT framework. Its contribution is not merely to accelerate prior MPC constructions, but to change the algebra of secure training so that the dominant non-linear operations are replaced by FSS-driven lookup selections and the dominant communication pattern is replaced by compact exact masking.