--- title: 'Depth-Pushing Loss: A Cross-Domain Perspective' url: https://www.emergentmind.com/topics/depth-pushing-loss type: topic --- # Depth-Pushing Loss: A Cross-Domain Perspective Searching arXiv for the cited papers to ground the article in current records. arXiv search: "Improved Point Transformation Methods For Self-Supervised Depth Prediction" Depth-Pushing Loss denotes a family of training objectives that impose explicit directional pressure on estimates involving depth, depth ordering, depth-of-field, or depth-conditioned supervision. In the literature surveyed here, the expression is not a single standardized loss with a single formula; rather, it describes a recurring design pattern in which optimization is biased away from geometrically invalid, structurally ambiguous, defocused, or under-supervised depth states. Representative instances include the negative depth loss for self-supervised monocular depth prediction, asymmetric foreground/background losses for depth completion at occlusion boundaries, decision-level focus-property constraints for multi-focus photoacoustic microscopy, multi-scale correlation losses for sparse-view 3D Gaussian Splatting, depth-weighted supervision for object detection, and risk-based “loss depths” in statistical learning [2102.09142; 2104.02253; 2506.03181; 2505.22279; 2602.05730; 2507.08518]. ## 1. Scope and recurring structure A common feature of depth-pushing objectives is that they do not merely regularize outputs toward smoothness or metric agreement. Instead, they encode a preferred direction in the error landscape. In geometric settings, that direction may be “toward positive transformed depth” or “toward the correct side of an occlusion boundary.” In imaging settings, it may be “toward all-in-focus fusion across depth.” In detection, it may be “toward greater learning pressure on distant objects.” In statistical depth, it becomes “toward greater centrality with respect to a distribution.” | Paper | Domain | Depth-pushing mechanism | |---|---|---| | [2102.09142] | Self-supervised monocular depth prediction | Negative depth loss on in-frame, negative-depth projections | | [2104.02253] | Depth completion | ALE/RALE asymmetric losses for twin-surface extrapolation | | [2506.03181] | OR-PAM multi-focus fusion | Decision-level focus property perceptual loss | | [2505.22279] | Sparse-view 3DGS | Cascade Pearson Correlation Loss | | [2602.05730] | Object detection | Depth-Based Loss Weighting and Loss Stratification | | [2507.08518] | Statistical data depth | Loss depths as minimum classification risk | This diversity is consequential. A frequent misconception is to treat Depth-Pushing Loss as a canonical module analogous to a standard photometric loss or a standard contrastive loss. The surveyed work suggests the opposite: the term is best understood as an umbrella description for objectives that encode a depth-aware optimization bias, with substantially different semantics across subfields. ## 2. Geometric barrier losses in self-supervised depth prediction In self-supervised monocular depth estimation from stereo or egomotion pairs, the depth-pushing mechanism is explicit. The method in "Improved Point Transformation Methods For Self-Supervised Depth Prediction" defines a target-frame pixel \(u=(u,v)\) with homogeneous coordinates \(\tilde u=[u,v,1]^T\), intrinsics \(K\), predicted depth \(d_t(u)\), and relative pose \(T_{t\rightarrow s}=(R,t)\). The transformation pipeline is \[ X_t(u)=d_t(u)K^{-1}\tilde u,\quad X_s(u)=RX_t(u)+t,\quad z_s(u)=e_3^T X_s(u), \] followed by projection \[ \tilde u_s(u)=\pi(KX_s(u)),\qquad \pi([x,y,z]^T)=[x/z,y/z]^T. \] Negative transformed depth corresponds to points that end up behind the source camera. The paper operationalizes the in-frame negative-depth set as \[ \mathcal N \triangleq \{(i,j)\mid d_{i,j}<0 \wedge 0\le i\sqrt{p_2/p_1}, \] while the expected RALE is minimized at the background depth \(d_2\) if \[ \gamma>\sqrt{p_1/p_2}. \] This establishes a precise sense in which asymmetry implements a depth-pushing estimator: it biases ambiguous predictions toward opposite sides of a step discontinuity rather than toward the average. Supervision is multi-scale: \[ L_{total}=\sum_{s\in S}\omega_s L_s, \] with \[ L_s=\frac{1}{|M^s|}\sum_{x\in M^s}\Big[ L_{ALE}(D_f^s(x)-d_t^s(x);\gamma)+ L_{RALE}(D_b^s(x)-d_t^s(x);\gamma)+ |\sigma^s(x)D_f^s(x)+(1-\sigma^s(x))D_b^s(x)-d_t^s(x)| \Big]. \] The KITTI schedule uses three phases over \(30\) epochs: epochs \(1\)–\(10\), \(\omega_1=\omega_2=\omega_3=1\); epochs \(11\)–\(20\), \(\omega_2=\omega_3=0.1\), \(\omega_1=1\); epochs \(21\)–\(30\), \(\omega_2=\omega_3=0\), \(\omega_1=1\). The reported good compromise is \(\gamma=2.0\). Empirically, the method improves boundary-sensitive error measures. On KITTI test/validation, TWISE reports MAE \(195.58/193.40\), iMAE \(0.82/0.81\), RMSE \(840.20/879.40\), and iRMSE \(2.08/2.19\). An ablation on the MultiStack backbone shows TWISE with MAE \(201.3\), RMSE \(927.6\), TMAE \(134.1\), and TRMSE \(240.1\), compared with L1 at MAE \(211.0\), RMSE \(950.0\), TMAE \(138.6\), and TRMSE \(246.0\). The learned fusion variable is also essential: using only \(D_f\) gives MAE \(306.9\), only \(D_b\) gives \(295.4\), simple averaging gives \(220.7\), learned \(\sigma\) without color gives \(222.4\), and learned \(\sigma\) with color gives the best MAE \(193.4\) [2104.02253]. ## 4. Depth-of-field extension as focus-property pushing In optical-resolution photoacoustic microscopy, the depth-pushing idea shifts from metric depth prediction to depth-of-field extension. "Dc-EEMF: Pushing depth-of-field limit of photoacoustic microscopy via decision-level constrained learning" frames multi-focus fusion as the construction of an all-in-focus image from two source images \(S1\) and \(S2\) acquired at different focal planes. The method, Dc-EEMF, is a lightweight Siamese CNN with feature extraction, artifact-resistant channel-wise spatial frequency fusion, and feature reconstruction. The depth-pushing component is the decision-level focus property perceptual loss \(L_{dFPP}\), which compares the fused image’s focus properties against ground-truth focus property maps using a dual-input U-Net. The total objective is \[ L_{total}=L_{dFPP}+\alpha_1L_{per}+\alpha_2L_{SSIM}+\alpha_3L_{FFL}, \] with \(\alpha_1=0.2\), \(\alpha_2=1\), and \(\alpha_3=8\). The perceptual term is \[ L_{per}=\|\phi_j(I_{fused})-\phi_j(I_{GT})\|_2, \] with VGG19 features from layers \(j\in[2nd,7th,12th,21st,30th]\). The structural term is \[ L_{SSIM}=1-SSIM_{fused,GT}, \] and the focal frequency term is \[ L_{FFL}=\frac{1}{WH}\sum_{u=1}^{W}\sum_{v=1}^{H}\omega(u,v)\left|F_{fused}(u,v)-F_{GT}(u,v)\right|^2. \] The role of \(L_{dFPP}\) is decision-level rather than pixel-level: for each source \(S_i\), the pair \((I_{fused},I_{S_i})\) is fed to a dual-input U-Net, and an MSE is computed between the predicted focus property map and the corresponding ground-truth focus property map. This encourages the fused image to inherit the correct in-focus regions from each source, thereby pushing depth-of-field. The feature fusion rule uses channel-wise spatial frequency, aggregated over an \(11\times 11\) window to resist artifact contamination near boundaries. The binary decision tensor is \[ D_{1:C}(x,y)= \begin{cases} 1,& \text{if }SF_{S1,1:C}(x,y)\ge SF_{S2,1:C}(x,y),\\ 0,& \text{otherwise,} \end{cases} \] and the fused feature map is \[ F_{fused,1:C}=F_{S1,1:C}\cdot D_{1:C}+F_{S2,1:C}\cdot (1-D_{1:C}). \] This rule favors sharper channel-wise features while suppressing misalignment artifacts. The reported quantitative and practical characteristics are unusually explicit. The U-Net for focus-property detection reaches mean IoU \(0.983\), with minor misclassifications near boundaries. Dc-EEMF is trained end-to-end in PyTorch 1.11.0 using Adam with \(\beta_1=0.9\), \(\beta_2=0.99\), \(\epsilon=10^{-8}\), learning rate \(1e^{-3}\) with \(0.9\) decay every \(5\) epochs, batch size \(16\), and \(120\) epochs, without post-processing. The model is lightweight at approximately \(0.24\) million parameters and processes \(128\times128\) inputs in approximately \(29.7\) ms on an NVIDIA 2080Ti. On in vivo mouse brain data, fusing \(S1\) at \(Z=0\,\mu m\) and \(S2\) at \(Z=500\,\mu m\) computationally pushes DoF to approximately \(560\,\mu m\) while preserving acceptable transverse resolution; junction density and vessel density both increase significantly, with Mann-Whitney U Test values \(U=30, p=0.0172\) and \(U=32, p=0.0065\), respectively [2506.03181]. ## 5. Multi-scale geometry pushing in rendering and distant-object supervision In sparse-view novel view synthesis, the depth-pushing objective can act directly on rendered geometry. "Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss" introduces Hierarchical Depth-Guided Splatting (HDGS) and its Cascade Pearson Correlation Loss (CPCL). Let \(D_r\) be rendered depth from the current 3DGS model and \(D_m\) the monocular depth from DPT. A depth pyramid is constructed by average pooling, and each level is partitioned into non-overlapping patches. For patch \(k\) at level \(l\), centered vectors \(A_k^{(l)}\) and \(B_k^{(l)}\) are formed, and the patch correlation is \[ \rho_{l,k}=\frac{A_k^{(l)}\cdot B_k^{(l)}}{S_{A,k}^{(l)}S_{B,k}^{(l)}}, \] with \(S_{A,k}^{(l)}=\|A_k^{(l)}\|_2+\epsilon\) and \(S_{B,k}^{(l)}=\|B_k^{(l)}\|_2+\epsilon\). Per-level correlation is \(\rho_l=\frac{1}{K_l}\sum_k \rho_{l,k}\), and the loss is \[ L_{CPCL}=\sum_{l=0}^{L-1} w_l(1-\rho_l), \] with uniform weights \(w_l=1/L\). Because Pearson correlation is scale- and shift-invariant, CPCL aligns depth structure without requiring metric scale agreement between \(D_r\) and \(D_m\). Through the rendered depth \[ D_r(x)=\sum_j w_j(x)z_j, \] its gradients act on splat positions, covariances, and opacities, pushing geometry toward monocular depth structure rather than raw absolute depth values. HDGS integrates CPCL with normalized L2 terms in local and global modes, using \(w_p=0.1\), \(w_{l2}=0.9\), \(w_{local}=0.7\), \(w_{global}=0.3\), and \(\lambda_{depth}=5\times 10^{-3}\). Under a \(3\)-view sparse protocol, the reported results are PSNR \(20.91\), SSIM \(0.735\), LPIPS \(0.180\) on LLFF and PSNR \(21.45\), SSIM \(0.874\), LPIPS \(0.108\) on DTU; the best patch-scale configuration is \(4+8+16\), while adding \(32\) slightly hurts performance [2505.22279]. A different but related mechanism appears in object detection. "Depth as Prior Knowledge for Object Detection" does not name a Depth-Pushing Loss explicitly; the closest components are Depth-Based Loss Weighting (DLW) and Depth-Based Loss Stratification (DLS). DLW defines a monotone depth-dependent weight \[ w_i=1+\alpha\cdot \exp(d_{i,norm}), \] with recommended \(\alpha=1.0\), and uses it in \[ \mathcal L^{total}_{DLW}=\frac{1}{N_b}\sum_{i=1}^{N_b} w(d_i)\cdot(\mathcal L_i^{cls}+\mathcal L_i^{box}), \] leaving negatives unweighted for stability. DLS instead splits supervision into close and distant strata using a split factor \(\beta\), and forms \[ \mathcal L^{total}_{DLS} =\lambda_{close}(\mathcal L_{close}^{cls}+\mathcal L_{close}^{box}) +\lambda_{distant}(\mathcal L_{distant}^{cls}+\mathcal L_{distant}^{box}). \] The defaults are \(\beta=0.5\), \(\lambda_{close}=1.0\), and \(\lambda_{distant}=2.0\); for KITTI, the reported setting is \(\beta=0.75\) and \(\lambda_{distant}=5\). The inference-stage complement is Depth-Aware Confidence Thresholding (DCT), which adapts decision thresholds as a function of depth. This framework is motivated by a heteroscedastic model in which \(\mathrm{Var}[\mathcal L\mid d]\) grows quadratically with distance, biasing uniform SGD toward nearby objects. On KITTI with YOLOv11, baseline small-object mAP\(_S\) \(31.0\%\) rises to \(33.3\%\) with DLW and \(34.4\%\) with DLS, while mAR\(_S\) improves from \(38.1\%\) to \(40.0\%\) and \(41.2\%\). Across four benchmarks and two detectors, the abstract reports gains of up to \(+9\%\) mAP\(_S\) and \(+7\%\) mAR\(_S\), with inference recovery rates as high as \(95{:}1\) true versus false detections [2602.05730]. ## 6. Risk-based loss depths, limitations, and terminological heterogeneity The broadest formalization appears in "Data Depth as a Risk," where depth no longer denotes scene geometry but statistical centrality. For a point \(z\in\mathbb R^d\) and distribution \(Q\), the paper recalls the halfspace depth \[ D_H(z\mid Q)=\inf_{u\in \mathbb S^{d-1}} P(\langle u,X\rangle \ge \langle u,z\rangle),\qquad X\sim Q, \] and shows that it can be written as a minimum classification risk under an artificial labeling \[ \Lambda(Q,z)=\tfrac12 Q\otimes \delta_{+1}+\tfrac12 \delta_z\otimes \delta_{-1}. \] For linear classifiers and \(0\)–\(1\) loss, the theorem states \[ D_H(z\mid Q)=\inf_{f\in Lin^*} E_{(x,y)\sim \Lambda(Q,z)}\big[2L_{0-1}(f(x),y)\big]. \] This leads to a family of loss depths \[ D_{\ell,\mathcal H}(z\mid Q) =\inf_{f\in \mathcal H} \left[ \tfrac12 E_{x\sim Q}\ell(+1,f(x)) +\tfrac12 \ell(-1,f(z)) \right], \] with empirical counterpart \[ D_{\ell,\mathcal H}(z\mid X) =\inf_{f\in \mathcal H} \left[ \tfrac{1}{2n}\sum_{i=1}^n \ell(+1,f(x_i)) +\tfrac12 \ell(-1,f(z)) \right]. \] From this perspective, a depth-pushing loss is simply the negative of a regularized loss depth, so maximizing “depth” means making a target point harder to separate from the data distribution. The paper gives \(O_Q(n^{-1/2})\) convergence rates for logistic-regression depth and regularized kernel SVM depth, and emphasizes that classifier simplicity is essential: if \(\mathcal H\) is too expressive, depth can collapse toward zero [2507.08518]. This statistical formulation clarifies an important terminological issue. In several of the vision papers discussed above, the label “Depth-Pushing Loss” is interpretive rather than author-specified: the OR-PAM paper states that it does not name a specific “Depth-Pushing Loss,” and the object-detection paper likewise states that it does not name one explicitly, though it identifies DLW and DLS as the closest mechanisms. A plausible implication is that the term is presently best treated as a cross-domain analytical category rather than a fixed named primitive [2506.03181; 2602.05730]. The limitations reported across the literature are correspondingly task-specific. In self-supervised depth prediction, severe pose errors could temporarily create true negative-depth projections for otherwise valid geometry, though the loss is applied only to in-frame projections and is argued to be appropriate for KITTI stereo and egomotion [2102.09142]. In twin-surface depth completion, KITTI ground truth is noisy near boundaries, so RMSE may worsen even when geometry is sharper, and fusion quality drops without RGB cues [2104.02253]. In OR-PAM, residual focus-map misclassifications remain near boundaries despite MIoU \(0.983\) [2506.03181]. In sparse-view splatting, large local monocular-depth mistakes can push geometry in the wrong direction [2505.22279]. In detection, overemphasizing distant objects can trade off against large-object performance, and DCT can inflate extra detections if validation-derived thresholds do not generalize [2602.05730]. In loss-depth theory, per-point optimization cost and classifier-class selection remain central practical concerns [2507.08518]. Taken together, these works support a precise but non-unified understanding: a Depth-Pushing Loss is any objective that introduces a depth-aware directional bias into optimization, whether by penalizing behind-camera projections, separating foreground and background hypotheses, enforcing focus-consistent fusion across depth, aligning rendered and monocular depth structure, upweighting distant supervision, or maximizing statistical centrality under a loss-defined depth notion. Source: https://www.emergentmind.com/topics/depth-pushing-loss