---
title: 'SEG-Parking: Offline RL for Autonomous Parking'
url: https://www.emergentmind.com/topics/seg-parking
type: topic
---

# SEG-Parking: Offline RL for Autonomous Parking

SEG-Parking is an end-to-end offline reinforcement learning framework for autonomous parking designed for unstructured environments and interaction-rich scenarios, especially those involving an opposite vehicle (OV). Its reported formulation combines a specialized parking dataset, a goal-conditioned state encoder that maps fused perception information into a compact latent space, and an offline RL policy trained with a conservative regularizer that penalizes out-of-distribution actions. In closed-loop experiments in the high-fidelity CARLA simulator, the framework is reported to achieve the highest success rate among the compared baselines while maintaining robust generalization to out-of-distribution parking scenarios [2509.13956].

## 1. Problem setting and conceptual basis

SEG-Parking is positioned within a line of autonomous parking research concerned with unstructured environments, narrow maneuvering spaces, and dynamic interactions. The central difficulty is not merely geometric parking-slot entry, but interaction-aware decision making under clutter, restricted maneuver envelopes, and distribution shift between training and deployment conditions. The framework explicitly targets scenarios both without OV interference and with OV interactions, including cases in which the ego vehicle must yield or wait [2509.13956].

The work departs from planner-centric parking pipelines that first compute a maneuver and then refine it. For example, “Segmented Trajectory Optimization for Autonomous Parking in Unstructured Environments” preserves the maneuver phases of a high-level planner such as Hybrid A*, refines the initial path by SQP, allows curvature discontinuities at switching points, and reports convergence in two iterations with total computation times below \(10\) ms in the studied scenarios [2504.05041]. “Improving RRT for Automated Parking in Real-world Scenarios” instead uses a two-stage system consisting of a geometric in-slot planner and an enhanced RRT-based out-of-slot planner, reporting a \(21\%\) parking path cost reduction and a \(79.5\%\) computation-time reduction relative to its baseline, together with physical validation on a Porsche Cayenne [2310.08267]. SEG-Parking addresses the same operational domain, but replaces explicit online search and trajectory refinement with an offline-learned policy [2509.13956].

A common misconception is that “end-to-end” parking systems necessarily operate on raw image streams. In SEG-Parking, the policy is end-to-end in the sense of learning a direct mapping from a fused parking state representation to control actions, but the state itself is structured and engineered rather than purely raw-visual [2509.13956]. This distinction is important for interpreting both its strengths and its scope.

## 2. Scenario design, dataset, and task formulation

The training and evaluation data are constructed in CARLA simulator, specifically in Town04\_Opt, with a focus on the central parking lot. The reported target slots are \(\{S_{15}, S_{16}\}\) for in-distribution evaluation and \(\{S_{11}, S_{12}\}\) for out-of-distribution generalization. For each scenario type, \(100\) episodes are collected. The ego vehicle starts at the west side of the lot, the OV—when present—starts at the east side, and all non-target slots are filled with static obstacles represented as parked vehicles [2509.13956].

| Scenario type | OV condition | Intended interaction pattern |
|---|---|---|
| Type i | Only EV, no OV interference | Basic parking |
| Type ii | OV present, low priority | OV yields to EV |
| Type iii | OV present, high priority | EV must yield or wait |

Expert data are generated by a Hybrid A* planner combined with a finite-horizon LQR controller. To diversify the action distribution, the collection process adds \(\epsilon\)-greedy noise injection with \(\epsilon = 0.2\). Each transition records \((s_t, a_t, r_t, s_{t+1}, \mathbb{I}\{\text{parked}\})\) [2509.13956].

The state \(s_t\) is composed of three main elements. The first is an obstacle distance sequence \(D_t\), defined as the last \(K\) LiDAR-derived vectors of obstacle distances, intended to capture short-term environment history. The second is a target pose \(p_t\), namely the vehicle’s current position and orientation relative to the goal slot, represented as \((\Delta x, \Delta y, \Delta \psi)\). The third is ego motion \(m_t\), comprising instantaneous velocity and acceleration. The action \(a_t\) is a discretized 3-tuple of acceleration, steering angle, and gear, with \(N_1 = 11\) acceleration bins, \(N_2 = 11\) steering bins, and \(N_3 = 2\) gear states for forward and reverse [2509.13956].

This formulation makes the parking task goal-conditioned from the outset. It also makes interaction structure explicit: the learning problem is not restricted to static-slot alignment, but includes negotiation with an approaching opposite vehicle through the dataset design itself [2509.13956].

## 3. Goal-conditioned representation and policy architecture

The representational core of SEG-Parking is a goal-conditioned state encoder (GSE). Its purpose is to fuse spatial obstacle information, short temporal context, and goal-relative geometry into a compact latent variable \(z_t\) suitable for policy learning [2509.13956].

The temporal branch first differentiates \(D_t\) to obtain \(\Delta D_t\), thereby emphasizing change in the obstacle-distance history. The differentiated sequence is then processed by an MLP and an LSTM to produce a temporal feature \(F_{\text{temp}}\). In parallel, the spatial branch processes the current distance vector \(d_t\) with another MLP to obtain \(F_{\text{spat}}\). A goal branch maps the relative target pose \(p_t\) through a feedforward projection to form \(F_{\text{goal}}\) [2509.13956].

Goal conditioning is implemented through multi-head cross-attention:
\[
\mathrm{MHCA}\!\left(F_{\text{goal}}, [F_{\text{temp}}, F_{\text{spat}}]\right),
\]
with \(F_{\text{goal}}\) serving as the query and the concatenated temporal and spatial features serving as memory. The output is the latent state \(z_t\), described as a goal-conditioned, context-integrated, compact representation [2509.13956].

The policy network \(\pi(z_t, m_t)\) is an MLP with ReLU nonlinearities and a final \(\tanh\) layer, producing the action prediction \(\hat a_t\). Value estimation is performed by twin Q-networks \(Q_1\) and \(Q_2(z_t, m_t, a_t)\), also implemented as MLPs. The twin-critic design is used to reduce overestimation bias during offline RL [2509.13956].

Architecturally, SEG-Parking therefore remains structured even while being described as end-to-end. The encoder imposes a decomposition into temporal, spatial, and goal branches, and the policy is learned over a compact latent space rather than over full trajectory optimization variables. This suggests a compromise between pure representation learning and classical modular parking pipelines [2509.13956].

## 4. Learning pipeline and objective functions

Training proceeds in two stages: behavior-cloning pretraining of the encoder, followed by offline RL fine-tuning with conservative regularization. In the pretraining stage, an action head \(f\) is attached to the encoder \(\phi\), and the model is trained using the behavior-cloning objective
\[
\min_\phi\; \mathbb{E}_{(s,a)\sim\mathcal{D}}\left[\left\lVert f\bigl(\phi(s)\bigr)-a\right\rVert_2\right].
\]
The encoder is not frozen afterward; it continues to be fine-tuned during RL optimization [2509.13956].

The offline RL stage uses twin-critic temporal-difference learning. The reported TD objective is
\[
\min\; \mathbb{E}_{(s,a,r,s')\sim\mathcal{D}}\left[\left(Q(s,a)-\left(r+\gamma \min_{j=1,2}Q_j(s',\Pi(s'))\right)\right)^2\right],
\]
where \(\Pi(s')\) denotes the nearest discrete action to \(\pi(s')\) under a Wolpertinger-style projection, which is required because the policy output is mapped back into the discretized action space [2509.13956].

The distinctive component is the conservative regularizer:
\[
+\alpha\Bigg(
\mathbb{E}_{s\sim\mathcal{D}}\left[\tau \log \sum_{a'} \exp(Q(s,a')/\tau)\right]
-
\mathbb{E}_{(s,a)\sim\mathcal{D}}\left[Q(s,a)\right]
\Bigg).
\]
Here, \(\alpha\) controls regularization strength and \(\tau\) controls the softness of the log-sum-exp term. The effect is to penalize Q-value inflation on actions that are not well supported by the offline dataset, thereby discouraging risky out-of-distribution actions at deployment [2509.13956].

Policy improvement is then expressed as
\[
\max\; \mathbb{E}_{s\sim\mathcal{D}}\left[\min_{j=1,2}Q_j(s,\pi(s))\right].
\]

The reward is decomposed as
\[
r = r_g + r_p + r_c + r_u.
\]
The term \(r_g\) is a terminal goal bonus when the vehicle is parked within the prescribed tolerances. The term \(r_p\) is an exponentially decaying progress reward as distance to the goal decreases. The term \(r_c\) penalizes collisions. The term \(r_u\) penalizes unsafe behavior when the agent’s action deviates too far from expert action, specifically when \(\|a_t-a^*\|_2 > \epsilon_a\) [2509.13956].

A second misconception is that offline RL in parking is equivalent to imitation learning on a fixed log. SEG-Parking is not limited to supervised action regression. It first learns a behavior prior through BC, but subsequently optimizes a value-based objective with explicit conservatism and policy improvement over the offline support [2509.13956].

## 5. Closed-loop evaluation and reported performance

The implementation is reported on Ubuntu 22.04 with an NVIDIA A100 GPU. Encoder pretraining runs for \(20\) epochs, and RL fine-tuning runs for \(80\) epochs with batch size \(256\) and the Adam optimizer. The listed hyperparameters include \(\gamma = 0.95\), \(\alpha = 1.0\), and \(\tau = 1.0\) [2509.13956].

The baselines are SAC, SAC-\(N\), Behavior Cloning, and TD3-BC. Evaluation uses TSR (Target Success Rate), TFR (Target Failure Rate), CR (Collision Rate), TR (Timeout Rate), and, for non-collision and non-timeout completions, APE (Average Position Error), AOE (Average Orientation Error), and APT (Average Parking Time) [2509.13956].

In the in-distribution slots, SEG-Parking is reported with TSR values in the range \(92\%\)–\(98\%\), CR in the range \(0\%\)–\(4\%\), average position error around \(0.5\) m, average orientation error around \(8^\circ\), and average parking time around \(26\)–\(41\) s. Over the same set of experiments, BC is reported at \(60\%\)–\(67\%\) TSR with \(20\%\)–\(23\%\) collision, TD3-BC at \(73\%\)–\(85\%\) TSR, and SAC-\(N\) at \(38\%\)–\(46\%\) TSR with more aggressive behavior [2509.13956].

The out-of-distribution results are the most consequential. On unseen slots, SEG-Parking is reported to maintain TSR in the range \(92\%\)–\(98\%\) with collision rates of \(2\%\)–\(8\%\). By contrast, BC drops to \(2\%\)–\(6\%\) TSR with \(94\%\)–\(98\%\) collision, TD3-BC reaches only \(19\%\)–\(40\%\) TSR with \(58\%\)–\(81\%\) collision, and SAC-\(N\) degrades to \(17\%\)–\(58\%\) TSR with \(19\%\)–\(81\%\) collision [2509.13956].

The reported closed-loop visualizations further show interaction-aware behavior. In the described type-iii setting, the ego vehicle waits for the OV when required and proceeds smoothly into the slot once permitted. This matters because the framework’s claimed generalization is not limited to slot geometry; it extends to tactical interaction behavior learned from the offline dataset [2509.13956].

## 6. Relation to adjacent parking paradigms and current limits

SEG-Parking belongs to a broader shift from modular parking stacks toward learned planning and control, but it differs materially from several neighboring lines of work. “Automated Parking Trajectory Generation Using Deep Reinforcement Learning” formulates parking as an MDP with continuous steering and throttle and trains a Soft Actor-Critic policy in Gazebo; it reports high success rates, robust handling of dynamic obstacles, and faster or comparable planning times than Hybrid A* across three cases, but its method is online DRL rather than offline conservative RL [2504.21071]. “ParkingWorld” uses correction-in-the-loop sample-efficient RL in a 3D Gaussian Splatting simulator and reports PSR \(88.0\%\) in simulation and \(80.0\%\) in real-world experiments, emphasizing human corrective interventions and sim-to-real transfer [2605.25029]. “ParkingTransformer” introduces an LLM-enhanced end-to-end planner with multi-view perception, 3D positional encoding, and fixed-window history, and reports a driving score of \(61.32\) in CARLA and an average real-world success rate of \(88.70\%\) [2606.17082]. “MultiPark” takes a multimodal imitation-learning route using next-segment prediction, factorized parking queries, and outcome-oriented losses, reporting a \(78.9\%\) success rate, \(17.5\%\) collision rate on the HP5 dataset, and approximately \(59\) ms per plan on production-car hardware [2508.11537].

Within that landscape, SEG-Parking is distinguished by three features: a parking-specific offline dataset with explicit OV interaction regimes, a goal-conditioned latent encoder over structured parking state, and conservative Q-regularization to suppress unsupported actions [2509.13956]. A related misconception is that all learned parking systems solve the same problem with interchangeable representations. In fact, SEG-Parking does not use raw multi-view images, dense BEV trajectory queries, or multimodal segment decoders; it uses LiDAR-derived obstacle-distance histories, relative goal pose, and ego motion [2509.13956].

Its present limitations are also clear from the reported setup. The dataset is constructed in CARLA Town04\_Opt around one central parking lot, the target slots are explicitly enumerated, the action space is discretized, and the experiments are closed-loop simulations rather than physical-vehicle trials [2509.13956]. This suggests that the framework’s main contribution lies in showing that conservative offline RL can remain both high-performing and interaction-aware under controlled parking distribution shifts, rather than in establishing full real-world deployment readiness.

Source: https://www.emergentmind.com/topics/seg-parking