---
title: 'Guard-GBDT: Secure Vertical GBDT Framework'
url: https://www.emergentmind.com/topics/guard-gbdt
type: topic
---

# Guard-GBDT: Secure Vertical GBDT Framework

Searching arXiv for the primary Guard-GBDT paper and closely related vertical secure GBDT work.
Search query: Guard-GBDT vertical GBDT MPC SiGBDT HEP-XGB
Guard-GBDT is a two-party secure training framework for gradient boosting decision trees (GBDT) over vertically partitioned data. It is designed for the setting in which two parties hold disjoint feature subsets for the same samples, one party holds the labels, and both parties wish to train a single GBDT model without revealing raw features, labels, gradients, thresholds, or sample assignments. Its defining technical move is to eliminate the principal MPC bottlenecks in vertical GBDT training—division and sigmoid evaluation—by replacing them with lookup-table approximations driven by function secret sharing, while separately reducing bandwidth through a compression-aware gradient aggregation protocol. In the reported implementation, these choices yield up to $2.71\times$ speedup over SiGBDT and up to $12.21\times$ over HEP-XGB on LAN, up to $2.7\times$ and $8.2\times$ on WAN, with accuracy comparable to plaintext XGBoost and SiGBDT within approximately $\pm1\%$ to $\pm2\%$ [2507.20688].

## 1. Problem setting and baseline GBDT formulation

Guard-GBDT operates in vertical federated learning. Two parties, denoted $P_0$ and $P_1$, hold column-wise partitions of a dataset with the same $N$ samples. $P_1$ owns the labels $y$, while both parties contribute features to a jointly trained GBDT. For a selected split, the corresponding feature index and threshold are revealed only to the party that owns that feature; the other party learns nothing about the split contents. Gradient statistics, split decisions, and leaf weights are computed privately [2507.20688].

The learning objective follows standard histogram-based GBDT for binary classification with logistic loss. Let $f(x)$ be the current ensemble score and $p=\sigma(f(x))$ the probability, where
$$
\sigma(x)=\frac{1}{1+e^{-x}}.
$$
For sample $i$ with label $y_i\in\{0,1\}$, the gradient and Hessian are
$$
g_i = y_i - p_i,\qquad h_i = p_i(1-p_i).
$$
In MPC, Guard-GBDT uses fixed-point encoding over the ring $\mathbb{Z}_{2^\ell}$, with $g_i,h_i\in[-1,1]$, typically $\ell=64$ and fractional precision $\ell_f=16$ [2507.20688].

At a tree node with sample set $X$, and for a candidate split producing $X_L$ and $X_R$, the aggregated statistics are
$$
G_X=\sum_{i\in X} g_i,\quad H_X=\sum_{i\in X} h_i,
$$
$$
G_L=\sum_{i\in X_L} g_i,\quad H_L=\sum_{i\in X_L} h_i,\qquad
G_R=\sum_{i\in X_R} g_i,\quad H_R=\sum_{i\in X_R} h_i.
$$
The standard XGBoost split gain is
$$
\mathrm{Gain}=\frac{1}{2}\left(\frac{G_L^2}{H_L+\gamma}+\frac{G_R^2}{H_R+\gamma}-\frac{G_X^2}{H_X+\gamma}\right),
$$
and the leaf weight is
$$
w = -\frac{G_{\text{leaf}}}{H_{\text{leaf}}+\gamma}.
$$
These formulas identify the core difficulty: split evaluation requires three divisions, leaf estimation requires another division, and logistic training requires secure sigmoid computation [2507.20688].

## 2. Threat model, leakage profile, and cryptographic architecture

Guard-GBDT assumes a static, semi-honest PPT adversary corrupting one party. The protocol uses a preprocessing model with a secure third party (STP) that generates input-independent randomness offline. There is no collusion between $P_0$ and $P_1$, and the STP learns no inputs or outputs [2507.20688].

Its security target is simulation-based security for the individual sub-protocols and for the composed training workflow. Leakage is explicitly limited to the tree structure, including which party owns the split at each node and the public tree topology. Feature values, labels, gradients, thresholds, and per-sample assignments remain secret. When a split is chosen, only the owner learns the corresponding feature and threshold and performs the local comparison needed to update membership for the child nodes [2507.20688].

The online cryptographic stack is intentionally narrow. Linear arithmetic is performed with 2-out-of-2 additive secret sharing (ASS), with Beaver triples for secure multiplication. Non-linear comparisons use function secret sharing (FSS), specifically DCF-based less-than evaluation. No homomorphic encryption, fully homomorphic encryption, or garbled circuits are used online. The paper situates its protocol libraries in relation to ABY for ASS and to Orca/FSS-style mixed-mode fixed-point secure computation [2507.20688].

This privacy model is narrower than full identifier anonymity. Guard-GBDT addresses privacy of features, labels, gradients, thresholds, and sample assignments in a vertically aligned two-party setting. By contrast, later anonymous two-party GBDT work studies the stronger problem of hiding identifiers, intersection membership, intersection cardinality, and alignment in split data, using dual circuit-PSI, OPPRF, and RLWE-based aggregation [2605.26903]. This distinction matters because “privacy-preserving vertical GBDT” does not by itself imply ID-hiding.

## 3. Division- and sigmoid-free approximations

The central algorithmic contribution of Guard-GBDT is the removal of MPC-unfriendly division and sigmoid evaluation through segment-wise lookup tables. For sigmoid approximation, the input domain is quantized into $n$ segments over $[-5,5]$, exploiting saturation outside that range. With
$$
\omega_i = -5 + \frac{10i}{n},\qquad i=0,\dots,n,
$$
the table stores
$$
\mathrm{LUT}_\delta^n[i] = \sigma(\omega_i).
$$
A piecewise-constant approximation $\delta'(x)$ is then selected via private less-than tests. If $\beta_i=[x<\omega_i]$, the reconstruction formula is
$$
\langle \delta'(x)\rangle = \delta(\omega_0) + \sum_{i=1}^{n} \langle \beta_i\rangle \big(\delta(\omega_i)-\delta(\omega_{i-1})\big).
$$
The online phase requires one communication round and $n\ell$ bits, with no exponentiation or division inside MPC. Offline memory is approximately $(n+1)\ell$ bits. With $n=12$ and $\ell=64$, the implemented LUT is $96$ bytes per table [2507.20688].

Leaf weights are approximated by a related LUT construction on $[-5,5]$, but division is avoided by rewriting the comparison. Instead of testing $-(G_X/H_X)<\omega_i'$, Guard-GBDT evaluates
$$
-G_X - H_X\omega_i' < 0
$$
with DCF-based less-than. If $\omega_i'=-5+10i/n$ and $\mathrm{LUT}_w^n[i]=\omega_i'$, then
$$
\langle w'\rangle = \omega_0' + \sum_{i=1}^{n} \langle \beta_i\rangle (\omega_i' - \omega_{i-1}'),
$$
where $\beta_i=[-G_X-H_X\omega_i' < 0]$. This yields an approximate Newton step without secure division [2507.20688].

Guard-GBDT also replaces the standard split gain with a division-free surrogate that preserves candidate ordering. Let $H_X=H_L+H_R$ and define
$$
G^*=(H_R+\gamma)G_L^2 + (H_L+\gamma)G_R^2.
$$
Then the surrogate gain is
$$
\mathcal{G}'=
\begin{cases}
G^*, & \text{if } 2H_L < H_X,\\
-G^*, & \text{if } 2H_L \ge H_X.
\end{cases}
$$
The stated rationale is monotonicity: for
$$
f(H_L,H_R)=\frac{1}{(H_L+\gamma)(H_R+\gamma)},
$$
the sign of $\partial f/\partial H_L$ is determined by $H_X-2H_L$, so the function is strictly monotone in $H_L$ on each side of $H_X/2$. Because the parent term $G_X^2/(H_X+\gamma)$ is constant for a fixed node, ranking by the original gain is equivalent to ranking by a monotone transformation of the numerator terms, and $\mathcal{G}'$ preserves order among candidates. The paper reports a proof of this claim in its appendix [2507.20688].

A common misconception is that privacy-preserving GBDT requires exact secure implementations of every non-linearity in the plaintext algorithm. Guard-GBDT directly contradicts that premise: it introduces controlled approximation error in sigmoid and leaf weights, while keeping the ordering of split candidates intact through the surrogate gain. The reported empirical deviation from plaintext XGBoost is only $\pm1\%$ to $\pm2\%$ across the evaluated datasets [2507.20688].

## 4. Compression-aware aggregation and end-to-end protocol flow

A second bottleneck in prior vertical secure GBDT systems is data inflation during gradient aggregation. Guard-GBDT exploits the fact that $g_i,h_i\in[-1,1]$, so only the sign and fractional part carry information. Rather than masking every gradient with a full $\ell$-bit share, its aggregation protocol $\Pi_{\mathrm{Agg}}$ masks into a compact ring with $\ell'=\ell_f+2$. Preprocessing generates masks $r_{s_i}\in\mathbb{Z}_2$, $r_{g_i}\in\mathbb{Z}_{2^{\ell'}}$, together with auxiliary values $u_i=r_{s_i}\cdot r_{g_i}$, $v_i=r_{g_i}\gg (\ell'-1)$, and $m_i=r_{s_i}\cdot v_i$, all secret-shared to the parties [2507.20688].

Online, each party exchanges only a masked indicator bit and a compact masked gradient:
$$
[\hat{s}_i] = [s_i]\oplus \langle r_{s_i}\rangle,\qquad
\langle \hat{g}_i'\rangle^{\ell'} = (\langle g_i\rangle + \langle r_{g_i}\rangle)\bmod 2^{\ell'}.
$$
After reconstructing $\hat{s}_i$ and $\hat{g}_i'$, the parties upcast to the $\ell$-bit ring and compute $\langle s_i\cdot g_i\rangle$ exactly, using the preprocessed masks and local arithmetic. The key bandwidth effect is explicit: compared with full $\ell$-bit masking, the exchange saves $\ell-\ell_f-2$ bits per gradient element. Accuracy is unchanged because the upcast preserves exact arithmetic over $\mathbb{Z}_{2^\ell}$, and the paper states that security is unchanged as well [2507.20688].

The full protocol has a clear offline–online decomposition. Offline, the STP generates Beaver triples, DCF keys for the sigmoid LUT, leaf-weight LUT, and Argmax, compact masks for $\Pi_{\mathrm{Agg}}$, and the LUT tables themselves. Online, training proceeds tree by tree. First, the current ensemble score is computed by secret-shared inference over the already built trees, using the path vector method. Then $p_i=\delta'(f_i)$ is computed from the sigmoid LUT, followed by
$$
g_i = y_i-p_i,\qquad h_i=p_i(1-p_i).
$$
For each feature $z$ and bin threshold $u$, the owner locally tests against $\mathrm{Bucket}[z,u]$, produces a secret-shared test indicator, derives left and right membership vectors, aggregates $(G_L,H_L,G_R,H_R)$ with $\Pi_{\mathrm{Agg}}$, evaluates the division-free gain, and participates in a secure Argmax over all $(z,u)$ candidates. The split owner is then identified by opening a comparison bit on the feature index; only the owner opens the winning feature and threshold and updates the sample space for the children. At leaves, the protocol aggregates $(G_{\text{leaf}},H_{\text{leaf}})$ and computes the approximated leaf weight through the LUT [2507.20688].

The round complexity per node drops to $O(F+\log(BF))$, in contrast to the $O(F\ell^2+\log(BF))$ or $O(F\ell^2+\log(BF\ell))$ expressions reported for the previous systems to which Guard-GBDT is compared [2507.20688].

## 5. Empirical performance and comparison with prior frameworks

The implementation is a PyTorch prototype with $\ell=64$, $\ell_f=16$, FSS security parameter $\lambda=128$, and lookup segment count $n=12$, which the paper reports as empirically best. Evaluation uses five real-world datasets—Breast Cancer $(699\times 9)$, Credit $(45{,}211\times 16)$, Phishing $(11{,}055\times 67)$, Skin $(245{,}057\times 3)$, and Covertype $(581{,}012\times 54)$—under simulated LAN with RTT $0.2$ ms and $1$ Gbps, and simulated WAN with RTT $40$ ms and $100$ Mbps [2507.20688].

| Framework | Cryptographic mechanism | Stated bottleneck |
|---|---|---|
| HEP-XGB | Paillier PHE + ASS | 2048-bit ciphertext inflation; Goldschmidt division; rough sigmoid approximation |
| SiGBDT | ASS + FSS | Taylor/exp and division; $\ell$-bit masking of gradients and Hessians |
| Guard-GBDT | ASS + FSS | LUT-based sigmoid and leaf weights; division-free gain; compact masking with $\ell'=\ell_f+2$ |

Accuracy is reported across tree depths $D\in\{4,8,16,32\}$ and tree counts $T\in\{5,10,15,20\}$. Guard-GBDT matches SiGBDT and plaintext XGBoost within $\pm1\%$ to $\pm2\%$ and is consistently better than HEP-XGB. Representative examples given in the paper are Breast Cancer at $D=4$, where Guard-GBDT achieves $94.74\%$ versus SiGBDT $93.86\%$ and HEP-XGB $87.72\%$, and Phishing at $D=8$, where it achieves $90.00\%$ versus $89.91\%$ and $81.12\%$. On Skin and Covertype, the reported accuracy is $100\%$ across settings and is insensitive to segmentation $n$, whereas smaller datasets stabilize for $n\ge 10$ to $12$ [2507.20688].

The microbenchmarks isolate the algorithmic changes. For input size $10^5$, the division-free gain is reported as $788\times$ to $1000\times$ faster than SiGBDT and HEP-XGB in LAN, and $814\times$ to $905\times$ in WAN. Gradient aggregation yields $2.0\times$ and $65.8\times$ speedups over SiGBDT and HEP-XGB in LAN, and $3.0\times$ and $164.4\times$ in WAN [2507.20688].

In end-to-end training for one tree, Guard-GBDT is up to $2.71\times$ faster than SiGBDT and up to $12.21\times$ faster than HEP-XGB on LAN; on WAN, the reported maxima are $2.7\times$ and $8.2\times$. The communication reduction is also explicit: on Breast Cancer, Guard-GBDT uses $14$ MB, which is $2.5\times$ less than SiGBDT and $9.07\times$ less than HEP-XGB; on Covertype, the savings are $3.5\times$ and $5.86\times$, respectively. For training $10$ trees, the LAN speedups reach $2.75\times$ versus SiGBDT and $12.36\times$ versus HEP-XGB on Breast Cancer, while WAN results include $4.46\times$ and $7.79\times$ on the same dataset. The paper also reports $0.1$ GB communication for Breast Cancer in the $10$-tree setting, which is $4\times$ less than SiGBDT and $13\times$ less than HEP-XGB [2507.20688].

Synthetic scalability results show similar trends. For one tree with $N=10$k, $F=10$, $B=8$, $D=4$, Guard-GBDT is $1.88\times$ and $14.02\times$ faster than SiGBDT and HEP-XGB; for $N=50$k, the factors become $2.22\times$ and $9.34\times$; for $D=5$, they are $2.3\times$ and $18.7\times$. Communication reductions at the baseline configuration are reported as $4.43\times$ versus SiGBDT and $8.04\times$ versus HEP-XGB, with larger reductions at larger scales [2507.20688].

## 6. Security guarantees, limitations, and relation to adjacent work

The paper gives formal security statements for the LUT-based sigmoid protocol, the LUT-based leaf-weight protocol, and $\Pi_{\mathrm{Agg}}$, under the assumption that ASS arithmetic and FSS DCF are secure. By sequential composition, the full training protocol inherits simulation-based security in the semi-honest model. The compression step does not weaken the masking guarantee: the stated adversarial success probability for guessing masked values remains $1/2^{\ell_f+1}$, the same as standard masking of the informative sign and fractional bits [2507.20688].

The framework also has explicit limits. It is a two-party system in its primary form. Its experimental focus is binary classification with logistic loss. The paper states that regression with MSE is simpler in MPC because $h_i=1$ and no sigmoid or division is needed, while multi-class learning would require multi-sigmoid or softmax approximations and is left for future work. DCF key size grows linearly with the number of segments, so the segment count cannot be increased without cost; the reported experiments indicate that $n=12$ suffices in practice. The use of an STP is restricted to input-independent randomness generation, and the paper notes that this role can be instantiated by generic 2PC or multi-party OT to avoid trust if needed [2507.20688].

Several neighboring lines of work illuminate what Guard-GBDT does and does not solve. Anonymous two-party GBDT addresses hidden identifiers and hidden alignment rather than the aligned vertical setting assumed here [2605.26903]. FairGBM studies fairness-constrained GBDT training via a proxy-Lagrangian dual ascent framework, targeting criteria such as demographic parity, equality of opportunity, predictive equality, and equalized odds rather than cryptographic privacy [2209.07850]. Separate work on backdoor attacks against GBDT and DNN models in insurance shows that tabular GBDT systems can remain vulnerable to training-time poisoning even when predictive performance is preserved, especially in some regression settings [2412.08366]. A plausible implication is that efficient secure vertical training, identifier anonymity, fairness constraints, and robustness against poisoning are complementary rather than interchangeable design goals.

Within that broader landscape, Guard-GBDT is most precisely understood as an efficiency-oriented privacy-preserving vertical GBDT framework. Its contribution is not merely to accelerate prior MPC constructions, but to change the algebra of secure training so that the dominant non-linear operations are replaced by FSS-driven lookup selections and the dominant communication pattern is replaced by compact exact masking.

Source: https://www.emergentmind.com/topics/guard-gbdt