Papers
Topics
Authors
Recent
Search
2000 character limit reached

EquiDexFlow: SE(3) Dexterous Grasp Generation

Updated 6 July 2026
  • EquiDexFlow is a SE(3)-equivariant generative model for dexterous grasp synthesis that jointly predicts wrist pose, joint angles, contacts, normals, and forces from object point clouds.
  • It integrates a VN-DGCNN encoder, SE(3) flow matching, and projection operators to enforce contact placement and friction compliance by design, removing the need for downstream force validation.
  • Empirical results show near-zero friction violations and precise equivariance, with hardware experiments demonstrating reliable cross-embodiment retargeting for diverse grasping tasks.

Searching arXiv for the cited EquiDexFlow paper and closely related entries to ground the article in current arXiv records. EquiDexFlow is an SE(3)-equivariant flow-matching framework for dexterous grasp generation that conditions on an object point cloud and jointly predicts wrist pose, hand joint angles, fingertip contacts, surface normals, and contact forces (Enwerem et al., 10 Jun 2026). Its distinguishing property is that contact placement and friction compliance are enforced by construction: contacts are projected onto the object surface, and forces are projected into the Coulomb friction cone, so grasp synthesis is not deferred to a downstream force-validation stage (Enwerem et al., 10 Jun 2026). In the paper record, the name “EquiDexFlow” refers specifically to “Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows” (Enwerem et al., 10 Jun 2026). This distinguishes it from the unrelated method “DexFlow,” which concerns dexterous hand pose retargeting and interaction modeling rather than contact-grounded equivariant grasp generation (Lin et al., 2 May 2025).

1. Problem formulation and conceptual scope

EquiDexFlow addresses the problem of generating a dexterous grasp for a multi-fingered hand directly from an object point cloud P\mathcal{P}, with the output represented as the conditional distribution

pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),

where TwSE(3)T_w \in SE(3) is the wrist pose, qhRDq_h \in \mathbb{R}^D is the joint configuration, C={pi}i=1MC=\{p_i\}_{i=1}^M are fingertip contact positions, N={ni}i=1MN=\{n_i\}_{i=1}^M are contact surface normals, and F={fi}i=1MF=\{f_i\}_{i=1}^M are contact forces (Enwerem et al., 10 Jun 2026). In the reported setting, the model is trained for a D=16D=16-DoF, MM-fingered hand, specifically the Allegro Hand (Enwerem et al., 10 Jun 2026).

The paper’s stated motivation is that many learned dexterous grasp generators separate geometry from physics: a pose generator produces a hand configuration, and a downstream optimizer or validator checks whether the grasp satisfies frictional and wrench-balance constraints (Enwerem et al., 10 Jun 2026). The paper argues that this decoupling is insufficient because a kinematically plausible grasp may still be physically invalid, with contacts off-surface, penetrating the object, or generating forces outside the Coulomb friction cone (Enwerem et al., 10 Jun 2026). EquiDexFlow therefore treats contact geometry and force feasibility as co-equal outputs of the generative model rather than as post-hoc corrections.

A central theoretical commitment is end-to-end SE(3) equivariance: if the input object undergoes a rigid transform, the synthesized grasp should co-rotate and co-translate in a corresponding manner (Enwerem et al., 10 Jun 2026). The paper formalizes this with the statement that for any rigid transform ASE(3)A \in SE(3),

pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),0

where pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),1 (Enwerem et al., 10 Jun 2026). This formulation places EquiDexFlow within the broader line of equivariant generative modeling, but its novelty in the supplied record lies in combining equivariance with contact-grounded and friction-feasible dexterous grasp synthesis.

2. Architecture and generative factorization

The architecture is described as having five principal components: an SE(3)-equivariant point-cloud encoder, an SE(3) flow-matching wrist-pose generator, a conditional hand-joint flow decoder, a contact decoder, and a normal decoder plus force decoder with friction-cone projection (Enwerem et al., 10 Jun 2026). The overall factorization is given as

pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),2

Here pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),3 denotes the encoded object feature, pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),4 the learned SE(3) flow map for wrist pose, pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),5 a conditional normalizing flow over joint angles, pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),6 the contact decoder, pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),7 the normal decoder, and pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),8 the projection into the Coulomb friction cone (Enwerem et al., 10 Jun 2026).

The point-cloud encoder is a Vector-Neuron DGCNN (VN-DGCNN), which preserves features as 3-vectors rather than scalar channels and produces a global object feature

pθ(Tw,qh,C,N,FP),p_\theta(T_w, q_h, C, N, F \mid \mathcal{P}),9

(Enwerem et al., 10 Jun 2026). Its equivariance is stated as

TwSE(3)T_w \in SE(3)0

which supplies the rotationally structured conditioning used by later components (Enwerem et al., 10 Jun 2026).

Wrist-pose generation is performed with flow matching on the Lie group TwSE(3)T_w \in SE(3)1. For a rigid motion TwSE(3)T_w \in SE(3)2, the group action is

TwSE(3)T_w \in SE(3)3

and the interpolation is geodesic: TwSE(3)T_w \in SE(3)4 The training objective for this component is

TwSE(3)T_w \in SE(3)5

and inference integrates the ODE with a Munthe-Kaas RK4 solver (Enwerem et al., 10 Jun 2026). The paper’s use of a Lie-group integrator is significant because it preserves the group structure numerically rather than approximating it in Euclidean coordinates.

Joint-angle generation is handled by a conditional Real-NVP normalizing flow for TwSE(3)T_w \in SE(3)6, conditioned on rotation-invariant features TwSE(3)T_w \in SE(3)7 and the wrist pose TwSE(3)T_w \in SE(3)8 (Enwerem et al., 10 Jun 2026). The reported loss is

TwSE(3)T_w \in SE(3)9

The paper presents this probabilistic decoder as a response to the many-to-one nature of dexterous kinematics, where multiple joint assignments can realize the same wrist placement (Enwerem et al., 10 Jun 2026).

3. Contact grounding, force construction, and physics-aware losses

A defining feature of EquiDexFlow is that contacts and forces are not merely predicted; they are projected into physically admissible sets (Enwerem et al., 10 Jun 2026). The contact decoder outputs one contact per finger, anchored to the predicted wrist translation, and then projects each raw contact qhRDq_h \in \mathbb{R}^D0 onto the object surface using a differentiable soft nearest-neighbor rule: qhRDq_h \in \mathbb{R}^D1 where qhRDq_h \in \mathbb{R}^D2 are surface points and qhRDq_h \in \mathbb{R}^D3 is a small temperature (Enwerem et al., 10 Jun 2026). The stated effect is that contacts lie on the object surface by construction.

The force decoder predicts raw forces qhRDq_h \in \mathbb{R}^D4, which are decomposed in the local contact frame defined by the learned normal qhRDq_h \in \mathbb{R}^D5: qhRDq_h \in \mathbb{R}^D6 The final projected force is

qhRDq_h \in \mathbb{R}^D7

which guarantees

qhRDq_h \in \mathbb{R}^D8

Accordingly, every predicted force lies inside the Coulomb friction cone (Enwerem et al., 10 Jun 2026). The paper explicitly emphasizes that this guarantee results from geometric projection rather than from a penalty alone.

Although physical feasibility is structurally enforced, the model is also trained with explicit physics losses. The wrench residual is

qhRDq_h \in \mathbb{R}^D9

and the corresponding loss is

C={pi}i=1MC=\{p_i\}_{i=1}^M0

The friction loss is

C={pi}i=1MC=\{p_i\}_{i=1}^M1

A collision loss C={pi}i=1MC=\{p_i\}_{i=1}^M2 is also included (Enwerem et al., 10 Jun 2026). The paper notes that C={pi}i=1MC=\{p_i\}_{i=1}^M3 is usually near zero because of the cone projection, but it is retained during training. This suggests a dual role for the loss stack: structural feasibility provides hard validity, while the losses shape the distribution toward low-wrench-residual solutions.

The coupling among outputs is central to the method description. Contacts influence normals, normals define the friction cone, contacts condition the force decoder, and force gradients flow back through contacts and normals (Enwerem et al., 10 Jun 2026). A plausible implication is that EquiDexFlow should be interpreted less as a set of parallel prediction heads and more as a structured grasp representation in which geometry and statics are co-parameterized.

4. Equivariance theorem and empirical verification

The paper gives a compositional argument for end-to-end SE(3) equivariance (Enwerem et al., 10 Jun 2026). First, the VN-DGCNN encoder is C={pi}i=1MC=\{p_i\}_{i=1}^M4-equivariant, with

C={pi}i=1MC=\{p_i\}_{i=1}^M5

Second, the SE(3) flow backbone is defined so that the flow map commutes with rigid motion: C={pi}i=1MC=\{p_i\}_{i=1}^M6 Third, the contact and normal decoders are VN-based and therefore co-rotate: C={pi}i=1MC=\{p_i\}_{i=1}^M7 Fourth, force equivariance is obtained by predicting local coefficients in the contact frame and reconstructing Cartesian force as

C={pi}i=1MC=\{p_i\}_{i=1}^M8

If C={pi}i=1MC=\{p_i\}_{i=1}^M9 is invariant and N={ni}i=1MN=\{n_i\}_{i=1}^M0 co-rotates, then

N={ni}i=1MN=\{n_i\}_{i=1}^M1

Finally, the test-time IK refinement is stated to preserve equivariance because it is formulated in a frame-invariant way (Enwerem et al., 10 Jun 2026).

The paper also isolates a notable nuance: the joint vector N={ni}i=1MN=\{n_i\}_{i=1}^M2 is treated as invariant under rigid transforms (Enwerem et al., 10 Jun 2026). The justification given is that the conditional flow depends only on invariant features, and the empirical test reports exactly zero joint deviation across rotations, up to floating-point effects (Enwerem et al., 10 Jun 2026). For readers accustomed to equivariant kinematics, this is an important distinction: the hand’s extrinsic pose is equivariant, whereas the intrinsic articulation is invariant.

Empirical verification is reported over 200 rotations (Enwerem et al., 10 Jun 2026). The wrist rotation residual stays below N={ni}i=1MN=\{n_i\}_{i=1}^M3, the translation residual remains below N={ni}i=1MN=\{n_i\}_{i=1}^M4 mm, and the maximum joint deviation is identically zero (Enwerem et al., 10 Jun 2026). These are presented as direct numerical confirmation of the theorem. In the paper’s framing, equivariance is therefore not only an architectural prior but an evaluated property.

5. Data generation, training corpus, and reported quantitative results

The training corpus is synthesized with FRoGGeR, described as a Drake-based grasp synthesizer that samples wrist poses, solves inverse kinematics, optimizes for worst-case wrench resistance, enforces surface contact, joint limits, self-collision, and object-collision constraints, and certifies force closure (Enwerem et al., 10 Jun 2026). The dataset is built for the 16-DoF Allegro Hand, comprising 4 fingers with 4 revolute joints per finger (Enwerem et al., 10 Jun 2026).

The object set covers 81 rigid objects: 49 EGAD objects, 28 YCB objects, and 4 primitives—box, cube, cylinder, and sphere (Enwerem et al., 10 Jun 2026). The generation procedure produces 100 candidate grasps per object, yielding 8,100 force-closure-certified grasps with a split of 6,480 train, 809 validation, and 811 test (Enwerem et al., 10 Jun 2026). Each grasp record contains a 512-point object cloud, wrist pose in the object frame, the 16-DoF joint vector, per-fingertip contacts, per-fingertip normals, per-contact forces, contact-frame coefficients, object mass and center of mass, friction coefficient, and a success flag (Enwerem et al., 10 Jun 2026). During training, random N={ni}i=1MN=\{n_i\}_{i=1}^M5 augmentation is applied to the point cloud and the entire grasp structure (Enwerem et al., 10 Jun 2026).

The evaluation protocol includes contact fidelity, force fidelity, physics score, and equivariance metrics (Enwerem et al., 10 Jun 2026). The listed measures are mean contact position error, fraction within 1 cm, force magnitude error, force direction error, friction violation rate (FVR), composite ranking score N={ni}i=1MN=\{n_i\}_{i=1}^M6, Top-1 and Top-3 score, wrench residual N={ni}i=1MN=\{n_i\}_{i=1}^M7, wrist rotation residual, wrist translation residual, and maximum joint deviation over rotations (Enwerem et al., 10 Jun 2026).

The paper reports four variants: PoseOnly, ContactOnly, GeomOnly, and Full (Enwerem et al., 10 Jun 2026). On the 811-grasp test set, the quantitative comparison is as follows.

Method FVR (%) Wrench Res (Nm)
PoseOnly 0.0 1.29
ContactOnly 0.0 1.36
GeomOnly 0.0 1.58
Full 0.0 0.46

In the full table, PoseOnly has Contact Err N={ni}i=1MN=\{n_i\}_{i=1}^M8, Force Err N={ni}i=1MN=\{n_i\}_{i=1}^M9, Top-1 Score F={fi}i=1MF=\{f_i\}_{i=1}^M0, and Top-3 Score F={fi}i=1MF=\{f_i\}_{i=1}^M1; ContactOnly has Contact Err F={fi}i=1MF=\{f_i\}_{i=1}^M2, Force Err F={fi}i=1MF=\{f_i\}_{i=1}^M3, Top-1 Score F={fi}i=1MF=\{f_i\}_{i=1}^M4, and Top-3 Score F={fi}i=1MF=\{f_i\}_{i=1}^M5; GeomOnly has Contact Err F={fi}i=1MF=\{f_i\}_{i=1}^M6, Force Err F={fi}i=1MF=\{f_i\}_{i=1}^M7, Top-1 Score F={fi}i=1MF=\{f_i\}_{i=1}^M8, and Top-3 Score F={fi}i=1MF=\{f_i\}_{i=1}^M9; and Full has Contact Err D=16D=160, Force Err D=16D=161, Top-1 Score D=16D=162, and Top-3 Score D=16D=163 (Enwerem et al., 10 Jun 2026). The Full model is reported as achieving the best composite score and the lowest wrench residual, while all variants have zero friction violations because the cone projection enforces friction feasibility by construction (Enwerem et al., 10 Jun 2026).

The supplied record further states that the Full model significantly outperforms every ablation under a Holm-corrected Wilcoxon signed-rank test with D=16D=164 (Enwerem et al., 10 Jun 2026). When the friction-cone projection is removed at test time from the Full checkpoint, Top-1 score drops from D=16D=165 to D=16D=166, Top-3 score drops from D=16D=167 to D=16D=168, and FVR rises to 100% (Enwerem et al., 10 Jun 2026). This result is the clearest quantitative evidence in the paper that the geometric projection is not incidental but structurally necessary.

The same section reports diversity and coverage for D=16D=169 samples per object: Full achieves C@1 = 100% and C@8 = 100%, and has the tightest contact spread among the full family (Enwerem et al., 10 Jun 2026). This suggests that the model is not restricted to a single grasp mode while still maintaining tight physical consistency.

6. Cross-embodiment retargeting and hardware execution

Although the model is trained on the Allegro Hand, the hardware experiments are conducted with a LEAP Hand mounted on a ZArm 6-DoF manipulator (Enwerem et al., 10 Jun 2026). Because Allegro and LEAP differ in kinematics and link lengths, direct joint copying is not used; instead, EquiDexFlow retargets decoded fingertip contacts to LEAP using per-finger inverse kinematics while preserving the predicted wrist pose (Enwerem et al., 10 Jun 2026).

The reported comparison shows that naïve joint-space copying produces fingertip errors of 29–54 mm, whereas per-finger IK reduces this to 5–13 mm (Enwerem et al., 10 Jun 2026). The paper then introduces a hardware-feasible refinement that solves, finger by finger,

MM0

subject to

MM1

The stated parameters are that each joint is kept at least 5% inside its actuator envelope and MM2 (Enwerem et al., 10 Jun 2026). The goal is to avoid near-saturation configurations while preserving fingertip targets with sub-millimeter drift.

For objects where thumb joints were initially close to saturation, joint clearance increased from near 0% to 7–19%, while fingertip drift remained below 0.39 mm in the worst case (Enwerem et al., 10 Jun 2026). The paper also notes that arm-side joints are refined with an IK projection so the arm stays reachable and within workspace constraints (Enwerem et al., 10 Jun 2026). This stage is important because it links the generative model’s contact-level representation to actuator-feasible hardware execution.

The physical system consists of a ZArm 6-DoF manipulator, a LEAP Hand, and a ZED 2i stereo camera that provides a single-shot object pose (Enwerem et al., 10 Jun 2026). The tested objects are cube, box primitive, potted meat can, mustard bottle, cylinder primitive, and tennis ball (Enwerem et al., 10 Jun 2026). The execution protocol is open-loop and consists of pre-grasp, approach, close, lift, and a 3-second hold (Enwerem et al., 10 Jun 2026). According to the reported results, all four asymmetric objects succeeded at both the canonical pose and a MM3 rotated pose, and the two symmetric objects succeeded at their canonical pose, yielding 10 successful open-loop trials across the six hardware objects (Enwerem et al., 10 Jun 2026).

These experiments are presented as evidence that the model’s equivariance is operational rather than merely formal. A plausible implication is that the method’s rigid-motion consistency materially reduces the need for pose-specific retraining or hand-tuned regrasping logic when object orientation changes.

7. Terminological boundaries, relation to DexFlow, and significance

The supplied records contain two similarly named but distinct methods: EquiDexFlow and DexFlow (Enwerem et al., 10 Jun 2026, Lin et al., 2 May 2025). DexFlow is described as “A Unified Approach for Dexterous Hand Pose Retargeting and Interaction,” with a three-stage sequential framework involving unified preprocessing and hand-model alignment, global retargeting via GN_CRS2_LM, temporal refinement with differential loss and sliding-window optimization, and contact-map extraction with finger-level grasp refinement (Lin et al., 2 May 2025). It addresses human-to-robot retargeting from MANO hand motion and object data and reports results such as 292K frames over 50 YCB objects (Lin et al., 2 May 2025). The supplied text explicitly states that “EquiDexFlow does not appear to be a distinct term in this paper” and that any such use in relation to DexFlow would be a misnaming (Lin et al., 2 May 2025).

This distinction matters because EquiDexFlow is not a retargeting pipeline. It is a contact-grounded generative model whose primary object is the conditional distribution of grasp pose, articulation, contacts, normals, and forces from an object point cloud (Enwerem et al., 10 Jun 2026). DexFlow, by contrast, begins from human hand motion and optimizes robot-hand trajectories and hand-object interactions (Lin et al., 2 May 2025). The overlap between the names is therefore lexical rather than methodological.

Within the supplied data, EquiDexFlow’s significance lies in unifying five elements that are often treated separately: SE(3)-equivariant generation, joint prediction of pose and contact-force structure, surface and friction feasibility by construction, physics-aware ranking, and cross-embodiment retargeting to hardware (Enwerem et al., 10 Jun 2026). The paper’s main empirical claims are that it attains zero friction violations, the best composite score, the lowest wrench residual among its ablations, wrist equivariance residuals below MM4, exactly zero joint deviation over 200 rotations, and successful open-loop hardware grasps under object rotation (Enwerem et al., 10 Jun 2026).

A common misconception would be to interpret the method as merely adding a friction penalty to a standard pose generator. The record does not support that reading. The paper repeatedly emphasizes that contact and friction validity arise from projection operators embedded in the generative pathway, with the sharpest evidence being the 100% friction-violation rate observed when cone projection is removed at test time (Enwerem et al., 10 Jun 2026). Another misconception would be to identify EquiDexFlow with DexFlow; the supplied text explicitly rejects that equivalence (Lin et al., 2 May 2025).

Taken together, the provided sources position EquiDexFlow as a physically grounded dexterous grasp generator rather than a generic grasp-pose predictor. Its core claim is not simply that it predicts where a hand should be placed, but that it predicts a grasp as a coupled geometric and mechanical object—wrist pose, articulation, contacts, normals, and forces—that transforms consistently under rigid motion and remains executable after retargeting to a different hand embodiment (Enwerem et al., 10 Jun 2026).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to EquiDexFlow.