---
title: 'CrossFormer: 3D Pose Transformer'
url: https://www.emergentmind.com/topics/crossformer-9d269193-9908-4d62-b75c-b73352fed00b
type: topic
---

# CrossFormer: 3D Pose Transformer

Searching arXiv for the target paper and closely related context papers.
arXiv search query: 2203.13387 CrossFormer Cross Spatio-Temporal Transformer for 3D Human Pose Estimation PoseFormer human pose transformer
CrossFormer is a transformer-based model for 3D human pose estimation introduced in "CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimation" [2203.13387]. It is situated within a line of work that treats 3D human pose estimation as a problem of encoding geometric dependencies between body parts and enforcing kinematic constraints, while also responding to the observation that, although transformers encode long-range dependencies between joints in spatial and temporal domains effectively, locality in vision transformers still requires improvement [2203.13387].

## 1. Research setting and motivation

In the formulation associated with CrossFormer, 3D human pose estimation is approached through the geometric dependencies of body parts and the enforcement of kinematic constraints [2203.13387]. The immediate methodological background is the adoption of transformers for modeling long-range dependencies between joints across both spatial and temporal domains [2203.13387]. Within that context, CrossFormer is motivated by a specific limitation: studies had already noted the need to improve the locality of vision transformers even when their long-range modeling was strong [2203.13387].

This positioning is important because it places CrossFormer at the intersection of two demands that are often in tension in pose estimation. One is global dependency modeling over joints and frames; the other is local sensitivity to subtle changes in joint behavior across time. The paper’s abstract frames CrossFormer as an attempt to reconcile these two requirements rather than to discard either of them [2203.13387].

## 2. Core architectural claim

CrossFormer is described as a "novel pose estimation Transformer" that features rich representations of body joints that are critical for capturing subtle changes across frames, identified in the abstract as "inter-feature representation" [2203.13387]. The model’s defining claim is therefore not merely that it applies a transformer to pose sequences, but that it aims to enrich how body-joint information is represented before and during spatio-temporal interaction [2203.13387].

The available description ties this representational goal directly to the problem of fine-grained temporal variation. This suggests that the model’s intended advantage lies not only in recovering coarse articulated structure, but also in preserving motion-sensitive cues that may be weakened when spatial and temporal dependencies are modeled only in a broadly global fashion.

## 3. Interaction modules and dependency structure

The abstract identifies two novel interaction modules: **Cross-Joint Interaction** and **Cross-Frame Interaction** [2203.13387]. Through these modules, the model is said to explicitly encode the local and global dependencies between body joints [2203.13387].

This characterization is the central technical statement available for the method. It indicates that CrossFormer is organized around explicit interaction mechanisms rather than a generic transformer stack alone. The naming also implies a decomposition of the pose-estimation problem into interactions across joints and interactions across frames. A plausible implication is that the model treats spatial and temporal coupling as structurally important and not merely as emergent behavior of standard self-attention. However, the supplied description does not provide the equations, layer ordering, or ablation details needed to specify how Cross-Joint Interaction and Cross-Frame Interaction are instantiated internally.

## 4. Reported empirical standing

CrossFormer is reported to achieve state-of-the-art performance on two popular 3D human pose estimation datasets, **Human3.6** and **MPI-INF-3DHP** [2203.13387]. The abstract further states that the method boosts performance by **0.9%** and **0.3%**, compared to the closest counterpart, **PoseFormer**, using the detected 2D poses and ground-truth settings respectively [2203.13387].

These results are presented as the empirical validation of the model’s design. In that framing, the claimed gains are tied specifically to the use of richer joint representations and the two interaction modules. Because the abstract reports improvements under both detected-2D-pose and ground-truth settings, the stated contribution is not restricted to a single evaluation condition.

## 5. Position within the broader “Crossformer” nomenclature

The name **CrossFormer** is not unique within arXiv literature, and disambiguation is necessary. In computer vision, "CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attention" denotes a cross-scale vision transformer built around cross-scale embedding and long-short distance attention [2108.00154]. In robot learning, "Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation" uses **CrossFormer** for a decoder-only cross-embodied policy trained across 20 robot embodiments [2408.11812]. In document understanding, "CrossFormer: Cross-Segment Semantic Fusion for Document Segmentation" uses the name for a text semantic segmentation model with a cross-segment fusion module [2503.23671].

The term is also used in multivariate time-series forecasting. Later comparative and application papers describe **Crossformer** as a model centered on dimension-segment-wise embedding, two-stage attention, and hierarchical encoder-decoder structure for multivariate forecasting tasks [2502.09683][2505.08821]. Consequently, the 3D pose-estimation CrossFormer [2203.13387] should be treated as a distinct model in a distinct application domain, despite the nominal overlap.

## 6. Documentation boundaries and unresolved specifics

The presently available description of the 3D pose-estimation CrossFormer establishes the model’s objective, its two named modules, and its reported dataset-level gains, but it does not supply the full method section, equations, architecture diagrams, loss specification, or ablation results. In particular, the available text does not detail the internal formulation of Cross-Joint Interaction or Cross-Frame Interaction beyond their stated role in encoding local and global dependencies between body joints.

As a result, CrossFormer can be characterized reliably at the level of research motivation, declared architectural principles, and reported empirical claims, but not at the level of implementation mechanics. For that reason, the model is best understood, on the basis of the present record, as a spatio-temporal transformer for 3D human pose estimation whose defining contribution is the explicit incorporation of joint- and frame-level interaction modules to improve body-joint representation and locality-aware dependency modeling [2203.13387].

Source: https://www.emergentmind.com/topics/crossformer-9d269193-9908-4d62-b75c-b73352fed00b