EquiContact: SE(3) Manipulation Framework

• EquiContact is a hierarchical framework that leverages SE(3) equivariance to enable robust, contact-rich robotic manipulation.
• It integrates a high-level global vision planner (Diff-EDF) with a low-level compliant visuomotor policy (G-CompACT) to achieve precise peg-in-hole insertions.
• The framework demonstrates superior spatial generalization and compliance compared to traditional methods, ensuring success even under out-of-distribution conditions.

Searching arXiv for the target paper and closely related work to ground the article. arxiv_search(query="^^^^^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^^^^^"Hierarchical SE(3) Vision-to-Force Equivariant Policy\"", max_results=5, sort_by="submittedDate") EquiContact is a hierarchical imitation-learning framework for contact-rich robotic manipulation that is designed to generalize across unseen spatial configurations by making the perception-to-force-control pipeline PRESERVED_PLACEHOLDER_^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^-equivariant. It is formulated around peg-in-hole manipulation with $1\mathrm{mm}$ clearance, where coarse global pose estimation is insufficient and robust success depends on combining global vision, localized reactive control, force feedback, and compliance. The framework consists of a high-level vision planner, Diffusion Equivariant Descriptor Field (Diff-EDF), and a low-level compliant visuomotor policy, Geometric Compliant ACT (G-CompACT), with geometric admittance control providing compliant execution (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

1. Conceptual scope and problem setting

EquiContact addresses contact-rich manipulation rather than free-space reaching. In the peg-in-hole setting studied, the hole clearance is only $1\mathrm{mm}$, while the high-level vision module produces approximate pose estimates with roughly $5$–$15\mathrm{mm}$ translation error and up to tens of degrees of orientation error. This mismatch motivates a hierarchical design in which global perception supplies a coarse reference frame and local control performs the fine alignment and insertion (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The framework is organized around three stated principles: compliance, localized policies, and induced equivariance. Compliance is needed because contact events during insertion cannot be handled reliably by purely kinematic tracking. Localized policies are used because body-frame observations and actions can remain invariant under global task transformations. Induced equivariance is obtained by anchoring the local policy on a globally estimated reference frame so that world-frame behavior transforms consistently when the task configuration is translated or rotated (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

A plausible implication is that EquiContact is less a single network architecture than a geometric systems design for contact-rich visuomotor control. This suggests that its main novelty lies in how perception, local sensing, action parameterization, and compliant control are coordinated, rather than in end-to-end monolithic policy learning.

2. Hierarchical architecture

EquiContact is composed of two modules. The high-level planner is Diff-EDF, which uses global point-cloud observations from external RGB-D cameras to estimate an approximate reference pose $g_{EDF}$ for the task object. The low-level controller is G-CompACT, which uses localized observations—Geometrically Consistent Error Vectors, force-torque readings, and wrist-mounted RGB images—to predict relative end-effector actions and compliance gains (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The high-level planner is written as

$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$

where $O^{scene}$ is the scene point cloud and $O^{grasp}$ is the gripper point cloud expressed in the end-effector frame (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). Diff-EDF is used only for coarse localization. The paper is explicit that its accuracy is insufficient for direct insertion in a $1\mathrm{mm}$-clearance task, so its output is used as a local reference frame for the low-level policy rather than as a final control target (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The low-level policy is written as

$1\mathrm{mm}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^

with chunked output

$1\mathrm{mm}$1

Thus each action chunk contains relative poses in $1\mathrm{mm}$2 and translational and rotational admittance gains (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The temporal composition rule is

$1\mathrm{mm}$3

so actions are defined in the end-effector frame and converted into spatial commands by composition with the current pose $1\mathrm{mm}$4 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This action parameterization is central to the framework’s equivariance argument.

3. Geometric state representation and localized sensing

A core object in EquiContact is the Geometrically Consistent Error Vector, denoted $1\mathrm{mm}$5. It is defined by

$1\mathrm{mm}$6

where $1\mathrm{mm}$7 is the current end-effector pose and $1\mathrm{mm}$8 is the reference pose predicted by Diff-EDF (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The translational component is a body-frame position error, and the rotational component is a body-frame orientation error. The paper emphasizes that $1\mathrm{mm}$9 is left-invariant: $1\mathrm{mm}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ for $1\mathrm{mm}$1 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This left invariance is one of the exact geometric ingredients from which the equivariance of the full pipeline is built.

Localized sensing is equally important. The low-level policy uses force-torque readings $1\mathrm{mm}$2 in the end-effector frame and two wrist-mounted RGB cameras $1\mathrm{mm}$3 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). Because both signals are end-effector-centered, global rigid transformations of the task do not directly alter their representation. The paper states an explicit assumption of left-invariant visual features: $1\mathrm{mm}$4 where $1\mathrm{mm}$5 is the wrist-image feature (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The paper also notes that this visual invariance is not enforced exactly by architecture or loss. Instead, it is induced approximately by the local perspective of the wrist cameras, the workspace design, and data support. This suggests that the geometric invariance of $1\mathrm{mm}$6 and body-frame force is exact by construction, whereas the visual component is only approximate in practice.

4. Compliance and geometric admittance control

EquiContact does not directly map observations to low-level torques. Instead, G-CompACT predicts desired relative poses and compliance gains, which are executed through a geometric admittance controller based on geometric impedance control (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The desired end-effector dynamics are

$1\mathrm{mm}$7

where $1\mathrm{mm}$8 is a symmetric positive-definite desired inertia matrix, $1\mathrm{mm}$9 is a symmetric positive-definite damping matrix, $5$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ is the body-frame end-effector velocity, and $5$1 is the external wrench in the end-effector frame (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The elastic wrench is

$5$2

with symmetric positive translational and rotational stiffness matrices $5$3 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The discrete-time controller is

$5$4

The controller runs at $5$5 in ROS2 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The policy outputs temporary gains $5$6 in the desired end-effector frame, and for the peg-in-hole tasks considered, diagonal matrices suffice (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This is a deliberate simplification relative to CompACT, where more general gain representations required full matrices and Cholesky factorization.

The experimental comparison shows that compliance is not merely an auxiliary refinement. ACT without geometric admittance control succeeds on only $5$7 in-distribution insertion trials, while ACT with geometric admittance control reaches $5$8 on the same setting (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This indicates that contact-rich insertion is not solved by equivariance alone; compliant execution is essential.

5. Equivariance structure

The paper’s central formal claim is that the EquiContact pipeline is $5$9-equivariant from perception to force control under two assumptions: left-equivariance of Diff-EDF and left-invariance of wrist-image features (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The left-equivariance assumption for Diff-EDF is

$15\mathrm{mm}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^

where $15\mathrm{mm}$1 is the point cloud of the target object (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

Under the left-invariant feature assumption for wrist vision and the left invariance of $15\mathrm{mm}$2 and $15\mathrm{mm}$3, the paper states:

$15\mathrm{mm}$4

This is Proposition 1, labeled “Left-invariance of G-CompACT” (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The low-level policy is therefore invariant in its local frame.

The world-frame desired pose remains equivariant because the invariant local action is composed with the transformed current pose. The paper states:

$15\mathrm{mm}$5

This is Corollary 1, labeled “$15\mathrm{mm}$6 left equivariance of G-CompACT” (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

For the full pipeline, the policy $15\mathrm{mm}$7 mapping current pose, reference pose, and force to elastic wrench is shown to satisfy a spatial-frame wrench equivariance law: $15\mathrm{mm}$8 This elevates the result beyond pose-command equivariance to equivariance of interaction wrench behavior (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

A plausible implication is that the framework operationalizes equivariance through coordinate design, signal localization, and composition rules, rather than requiring every learned module to be an exactly equivariant neural operator.

6. Training regime and data support

The two components are trained separately. Diff-EDF is trained from $15\mathrm{mm}$9 demonstrations total: $g_{EDF}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ on a flat platform and $g_{EDF}$1 on a tilted platform, with translational and rotational randomization and visual distractors (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). G-CompACT is trained from $g_{EDF}$2 teleoperated insertion demonstrations collected on a fixed platform with known hole location (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

Teleoperation uses a SpaceMouse for motion commands and keyboard switching among four predefined gain modes. Data is logged at $g_{EDF}$3, while teleoperation and robot control run at $g_{EDF}$4 (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The paper states that training follows the standard imitation-learning pipeline for ACT. It does not provide the full CVAE objective, optimizer details, or Diff-EDF diffusion loss (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

A key training intervention is reference-pose noise injection for G-CompACT, because at inference the reference comes from imperfect Diff-EDF predictions. The noisy reference is defined by

$g_{EDF}$5

with

$g_{EDF}$6

Thus training includes $g_{EDF}$7 translational and $g_{EDF}$8 rotational perturbations on the reference frame (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

When the visual-invariance assumption broke down more severely, the paper augmented the data with $g_{EDF}$9 demonstrations containing visual distractors on the flat platform and $g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ demonstrations on a $g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$1 tilted platform (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This suggests that induced equivariance in the visual channel depends materially on the support of the demonstration set.

7. Empirical performance

The main real-world benchmark is peg-in-hole insertion under translated and tilted out-of-distribution platform configurations (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The comparison includes ACT without geometric admittance control, ACT with geometric admittance control, CompACT, and EquiContact.

The reported results are summarized below.

Method	Setting	Success
ACT w/o GAC	Flat Platform (In-Dist.)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$2
ACT w/ GAC	Flat Platform (In-Dist.)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$3
CompACT	Flat Platform (In-Dist.)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$4
CompACT	Flat Platform (OOD)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$5
EquiContact	Flat Platform (OOD)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$6
EquiContact	Tilted Platform ($g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$7, OOD)	$g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$8

These results show three distinct phenomena. First, compliance is decisive for insertion, since ACT without GAC fails frequently while ACT with GAC succeeds in-distribution. Second, world-frame compliant imitation does not generalize spatially, since CompACT drops from $g_{EDF} = f_{\theta_1}(O^{scene}, O^{grasp}),$9 in-distribution to $O^{scene}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ out-of-distribution. Third, EquiContact preserves high performance under translated and tilted OOD configurations, consistent with the framework’s equivariance claims (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

For the full pick-and-place pipeline, EquiContact achieves $O^{scene}$1 on flat-platform OOD trials and $O^{scene}$2 on $O^{scene}$3-tilted OOD trials (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The paper attributes the small degradation on the tilted case to error propagation across sequential stages, specifically one pick failure and one place failure (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

The force-profile comparison further shows that CompACT yields lower contact forces than ACT with fixed gains, supporting the benefit of learned compliance modulation via force feedback (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

8. Failure modes and limitations

The framework’s theoretical equivariance depends on assumptions that are not fully guaranteed in learned perception. The most important fragile component is the left-invariance of wrist-image features (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The paper reports degradation in the presence of visual distractors and larger tilt angles.

Using ground-truth reference frames and the base dataset, EquiContact achieves $O^{scene}$4 under visual distractors and $O^{scene}$5 on a $O^{scene}$6-tilted platform. After augmenting the data, these improve to $O^{scene}$7 and $O^{scene}$8, respectively (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). This indicates that the visual channel does not inherit the same exact invariance as the geometric channels and requires data support to remain robust.

The paper also states several design assumptions. The peg is assumed upright. Right-equivariance is avoided by enforcing a consistent grasp orientation, because arbitrary transformations of the peg relative to the gripper caused slippage and would require continuous estimation of the object pose relative to the gripper (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). External RGB-D cameras with calibrated extrinsics, wrist RGB cameras, and an end-effector force-torque sensor are assumed available (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

Diff-EDF is not real-time, which is one reason the reactive low-level layer is necessary (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The system is hierarchical and modular rather than jointly end-to-end trained. A plausible implication is that EquiContact trades architectural simplicity for stronger geometric structure and clearer functional decomposition.

9. Relation to adjacent contact-centric work

EquiContact belongs to a line of work that treats contact as a structured signal rather than a purely latent nuisance. In robotic loco-manipulation, "OmniContact: Chaining Meta-Skills via Contact Flow for Generalizable Humanoid Loco-Manipulation" introduces Contact Flow as a compact representation consisting of key body trajectories and time-series binary contact signals, emphasizing explicit contact structure for compositional control (&&&4^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&). The two systems differ substantially in setting and mechanism: OmniContact is aimed at long-horizon humanoid loco-manipulation and does not use explicit equivariant modeling, whereas EquiContact is centered on $O^{scene}$9-equivariant spatial generalization in contact-rich manipulation (&&&4^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&, &&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

This suggests a broader methodological split within contact-centric learning. One branch uses explicit contact representations for planning and skill composition, while another—exemplified by EquiContact—uses group-structured geometry, local sensing, and compliant control to make contact behavior spatially transferable.

1^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^. Significance

EquiContact’s main contribution is the claim that robust spatial generalization in contact-rich manipulation can be achieved from a small number of demonstrations by structuring the entire pipeline around $O^{grasp}$^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^ geometry. The framework does not rely on exact pose estimation for insertion, nor on world-frame visuomotor mappings that must be relearned at each spatial configuration. Instead, it combines a coarse equivariant global planner, a localized low-level policy, body-frame force sensing, relative action composition, and compliant geometric control into a unified policy whose behavior transforms consistently across rigid scene transformations (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).

For contact-rich assembly, the framework provides an explicit recipe: estimate a global reference frame coarsely, represent local error geometrically in the end-effector frame, sense contact locally, output end-effector-frame relative actions and gains, and execute them through compliant control. The empirical results on out-of-distribution peg-in-hole insertion and pick-and-place indicate that this recipe can outperform world-frame imitation baselines by a large margin under limited-data conditions (&&&^^^^1EquiContact (Seo et al., 15 Jul 2025) OR \1^^^^&&&).