Split DeepJSCC: Modular Neural JSCC Patterns
- Split DeepJSCC is a modular design pattern that introduces a deliberate split in the end-to-end DeepJSCC pipeline, enhancing integration with existing wireless systems.
- It preserves the advantages of joint source-channel coding while enabling adaptive split inference, hybrid communication, and bit-level interfaces under practical constraints.
- Practical evaluations show improved compression, performance, and noise robustness across varying SNR levels and computational budgets.
Searching arXiv for papers on Split DeepJSCC and closely related DeepJSCC variants. Split DeepJSCC denotes a family of neural joint source-channel coding designs in which a conventional end-to-end DeepJSCC pipeline is deliberately partitioned by an explicit interface or split point rather than optimized as a single monolithic source-to-channel mapping. In the literature summarized here, the term appears in at least three closely related senses: as split inference for collaborative intelligence, where an intermediate feature tensor is transmitted from device to edge server using a learned JSCC module; as a hybrid communication architecture, where DeepJSCC is used only on a vulnerable wireless segment and conventional digital transmission is used afterward; and as a decoupled framework with a bit-level interface between source and channel coding to improve compatibility with existing layered wireless networks. Across these variants, the common principle is that DeepJSCC’s graceful degradation and task-aware representation learning are retained, while the communication system is made more modular, deployable, or adaptive under practical constraints such as varying signal-to-noise ratio (SNR), finite computation budgets, multi-hop relaying, or interoperability with separate network entities (Waqas et al., 12 Jun 2025, Kong et al., 17 Jul 2025).
1. Concept and scope
Split DeepJSCC is best understood against standard DeepJSCC. In conventional DeepJSCC, the source encoder and channel encoder are trained end-to-end as one neural system, so that the transmitter maps an image directly to channel symbols and the receiver maps noisy channel outputs back to the image. This yields strong semantic performance and graceful adaptation to channel quality, but it is difficult to integrate into existing layered wireless networks because source and channel coding are tightly coupled (Kong et al., 17 Jul 2025). DeepJSCC itself is part of the broader JSCC framework, in which an encoder–channel–decoder chain is optimized jointly rather than by strict source/channel separation; this approach is particularly advantageous in finite blocklength, latency-limited, and channel-uncertain regimes, where it can avoid cliff and levelling-off effects and provide smoother degradation under channel variation (Gündüz et al., 2024).
Within that broader family, Split DeepJSCC introduces an internal boundary. The location and meaning of that boundary differ by application. In collaborative intelligence and split inference, the boundary is an intermediate feature tensor generated by a deep network on a mobile or IoT device, then compressed and transmitted over a wireless channel to a server that completes the downstream task (Wang et al., 2021, Waqas et al., 12 Jun 2025). In hybrid multi-hop communication, the boundary is a relay node: the first hop uses analog DeepJSCC, while later hops use digital forwarding to avoid noise accumulation (Bian et al., 2023). In interface-based semantic communication, the boundary is a prescribed or learned bit-level contract between source coding and channel coding, allowing separate design while preserving semantic fidelity and channel adaptability (Kong et al., 17 Jul 2025).
A plausible implication is that “Split DeepJSCC” is not a single architecture but a design pattern: it preserves joint source-channel awareness while introducing a structured interface at the point where practical systems require modularity.
2. Split inference and collaborative intelligence
A clear early instance appears in collaborative intelligence for multi-task vision. “Deep Joint Source-Channel Coding for Multi-Task Network” proposes a feature-fusion multi-task network, FFMNet, for joint object detection and semantic segmentation, then splits the model into two parts that run on a mobile device and an edge server respectively (Wang et al., 2021). The split occurs at the intermediate feature . The mobile device runs the early feature extraction part up to , a JSCC encoder compresses that feature for transmission over an AWGN channel, and the edge server reconstructs the feature and executes the remaining parsing and task heads. The transmitted object is therefore not the original image, but the intermediate feature tensor at the split point (Wang et al., 2021).
This architecture is explicitly motivated by the inadequacy of conventional multi-task learning networks for collaborative intelligence. Standard single-end networks are unsuitable when part of the model must run on a mobile device and the rest on an edge server, because intermediate features can be large, and prior feature-compression methods based on HEVC, PNG, JPEG, or similar coding do not explicitly account for channel noise and thus degrade sharply when the wireless link is imperfect (Wang et al., 2021). The split DeepJSCC-style design replaces separate compression and channel coding with a learned JSCC encoder/decoder trained through the noisy channel model.
The FFMNet system reports that the whole model achieves compression for the intermediate feature and a performance loss within on both tasks. The paper gives the specific comparison: the original model attains $40.8$ mAP and $44.6$ mIoU, while the compressed version attains $39.4$ mAP and $43.1$ mIoU, corresponding to losses of in mAP and 0 in mIoU (Wang et al., 2021). It further states that the separate source/channel coding baseline can only achieve about 1 compression at similar performance, whereas the learned JSCC achieves 2, and that the deep JSCC approach outperforms the separate pipeline substantially and avoids the cliff effect (Wang et al., 2021).
This split-inference interpretation remains central in later work. “SNR and Resource Adaptive Deep JSCC for Distributed IoT Image Classification” treats a split-network DNN-based JSCC scheme as one in which early feature extraction runs on the edge device, an intermediate feature representation is compressed and transmitted over the channel, and the remaining inference layers run at the server (Waqas et al., 12 Jun 2025). The authors state that this paper is a direct extension of the Split DeepJSCC idea to a more practical distributed IoT setting, with varying wireless channel quality and local device resources (Waqas et al., 12 Jun 2025).
3. Distributed CNN formulation and adaptive split selection
In the distributed IoT formulation, the system consists of a CNN with a total of 3 blocks, split after 4 blocks. The first 5 blocks execute on the IoT device, and the remaining 6 blocks execute on the server. The split point is not just “where to offload,” but also where the learned feature tensor is turned into a latent vector for wireless transmission (Waqas et al., 12 Jun 2025).
The forward path is specified as follows: input image 7; normalization to 8; local processing through the first 9 CNN blocks at the IoT device; JSCC projection of the resulting feature map into a latent vector 0; wireless transmission over an AWGN channel; reconstruction of the feature map 1 at the server; execution of the remaining CNN blocks at the server; and final classification using global average pooling and a logit layer (Waqas et al., 12 Jun 2025). Each CNN block is a convolution followed by batch normalization and PReLU: 2
3
with
4
After the 5-th block, the feature map is projected into a latent vector,
6
the server receives
7
where 8, and reconstructs the feature map by
9
Unlike end-to-end DeepJSCC that transmits the compressed latent for the whole task, this formulation transmits only the intermediate representation at the split point, making it a distributed JSCC inference system (Waqas et al., 12 Jun 2025).
A central point of the paper is that the best split point depends not only on channel SNR but also on the IoT device’s computation budget. The architecture is therefore adapted by optimizing the split point 0, the number of filters 1, the kernel size 2, and the latent space dimension 3, under the constrained problem
4
subject to
5
and
6
where
7
The FLOPs cost at the IoT device is modeled as the sum of the FLOPs of the first 8 convolutional layers plus the projection to latent space: 9
$40.8$0
$40.8$1
The paper reports that the selected number of local layers increases monotonically with available FLOPs, and the optimal architecture changes with SNR as well (Waqas et al., 12 Jun 2025).
This redefines the split as a jointly communication-and-architecture-dependent quantity rather than a static placement decision. A low-SNR link may favor a different latent dimensionality or deeper local feature extraction than a high-SNR link, while a tight FLOPs budget may force an earlier split (Waqas et al., 12 Jun 2025).
4. Optimization, training, and robustness mechanisms
The main mechanism used to search the adaptive architecture space in the IoT setting is the Learning-Assisted Intelligent Genetic Algorithm (LAIGA), which extends split DeepJSCC beyond a fixed split-layer design. Each candidate architecture is represented by
$40.8$2
encoding filter count, kernel size, latent dimension, and split point (Waqas et al., 12 Jun 2025). A crucial rule is that any candidate violating the computational budget is immediately rejected; if
$40.8$3
the fitness is set to
$40.8$4
so infeasible configurations are effectively removed from the search (Waqas et al., 12 Jun 2025).
To avoid exhaustive simulation, the paper builds an offline dataset $40.8$5 by simulating a manageable subset of configurations across several SNR values, storing both FLOPs and classification accuracy. Two Random Forest regressors are trained,
$40.8$6
$40.8$7
and are used to predict FLOPs and accuracy for unseen configurations (Waqas et al., 12 Jun 2025). The fitness score is
$40.8$8
with
$40.8$9
This encourages configurations that use about $44.6$0 of the available FLOPs rather than wasting budget. The GA proceeds via tournament selection, uniform crossover, and mutation: $44.6$1 The final chosen configuration is the one with the highest predicted accuracy, and in case of ties, the one with the smallest FLOPs gap (Waqas et al., 12 Jun 2025).
The multi-task collaborative-intelligence system uses a different training decomposition but the same split-learning logic. There, training proceeds in three steps: train FFMNet alone with
$44.6$2
attach the JSCC encoder/decoder at the split point and train them while keeping FFMNet fixed using the loss
$44.6$3
and finally fine-tune the whole system end-to-end using $44.6$4 (Wang et al., 2021).
Both lines of work emphasize robustness through noise-aware training. In the multi-task system, the channel is modeled as AWGN,
$44.6$5
with
$44.6$6
and average transmit power constraint
$44.6$7
with $44.6$8. Models are trained with $44.6$9 dB, 0 dB, and 1 dB, and the paper finds that training at 2 dB gives the best trade-off across test SNRs (Wang et al., 2021). In the IoT image-classification system, the latent noise variance is tied to SNR through
3
Because the transmitted signal is a learned latent representation rather than a conventional source-coded bitstream, the method is described as inheriting the robustness properties of DeepJSCC, especially under low SNR (Waqas et al., 12 Jun 2025).
5. Hybrid and interface-based variants
Another major interpretation of Split DeepJSCC appears in multi-hop communication. “A Hybrid Joint Source-Channel Coding Scheme for Mobile Multi-hop Networks” proposes a split architecture matched to a realistic topology in which the first hop from the mobile user to the first relay is potentially weak and time-varying, while subsequent hops inside the mobile core network are stable and of high quality (Bian et al., 2023). The key idea is to use analog neural joint source-channel coding only where it is needed most, on the unreliable first hop, and then switch to conventional digital transmission after the first relay to prevent the progressive noise accumulation that hurts fully analog schemes (Bian et al., 2023).
The source node encodes an image 4 into a complex-valued channel input 5 using a DeepJSCC encoder 6, subject to
7
The first hop is AWGN,
8
with 9 (Bian et al., 2023). At the first relay, a DeepJSCC decoder reconstructs an image-shaped tensor
$39.4$0
and a hyperprior-based learned image codec converts $39.4$1 into a bitstream $39.4$2, which is forwarded digitally through the core network. The split point is therefore exactly the first relay: everything before $39.4$3 is treated as DeepJSCC, and everything after $39.4$4 is treated as a conventional digital pipeline (Bian et al., 2023).
The digital compression stage uses a nonlinear analysis transform $39.4$5 and hyper-analysis transform $39.4$6, with arithmetic coding producing
$39.4$7
The overall hybrid loss introduces a rate-distortion tradeoff,
$39.4$8
with
$39.4$9
This formulation contrasts with the fully analog baseline, for which the effective SNR over multiple hops is
$43.1$0
making explicit why analog relaying degrades as hop count grows (Bian et al., 2023).
A different kind of split is introduced by the learning-based interface framework. In “Learning-Based Interface for Semantic Communication with Bit Importance Awareness,” Split DeepJSCC is described as a decoupled JSCC framework with a bit-level interface between the source code and the channel code (Kong et al., 17 Jul 2025). The source node performs source coding and outputs a bitstream, the wireless access node performs channel coding over the wireless hop, and the interface specifies the reliability level of different bit positions at the output of the source code. The paper states that Split DeepJSCC “introduces a multi-level reliability binary interface,” enables separate design of source and channel codes, and preserves the advantages of JSCC while being compatible with existing networks (Kong et al., 17 Jul 2025).
This interface is implemented using an array of binary symmetric channels with bit-flipping probabilities $43.1$1. The transmitted image $43.1$2 is mapped to a source bitstream $43.1$3, then to channel symbols $43.1$4, with channel bandwidth ratio
$43.1$5
The bit-level interface is modeled by
$43.1$6
Lower $43.1$7 means a more important bit, higher $43.1$8 means a less important bit. To prevent collapse to an error-free interface, the training adds
$43.1$9
The first-stage objective becomes
0
and non-differentiable sampling and rounding are handled by the Straight-Through Estimator (Kong et al., 17 Jul 2025).
This paper treats the prescribed Split DeepJSCC interface as a baseline, then replaces it with a trainable interface whose learned bit-flipping probabilities encode bit importance. The resulting Importance-Aware Net uses the transformed interface values 1 as an attention-like signal in the channel mapper and demapper, enabling dynamical adaptation to diverse channel bandwidth ratios and time-varying channel conditions (Kong et al., 17 Jul 2025).
6. Performance, practical implications, and limitations
The distributed IoT extension reports that the proposed framework outperforms fixed-split architectures and existing SNR-adaptive methods, especially under low SNR and limited computational resources. Specifically, it achieves a 2 increase in classification accuracy as compared to an existing JSCC-based SNR-adaptive multilayer framework at an SNR as low as 3 dB across a range of available computational budget from 4M to 5M FLOPs at the IoT device (Waqas et al., 12 Jun 2025). The experiments use PyTorch on an NVIDIA RTX A2000 GPU using CIFAR-10, with a discrete search space 6, 7, 8, 9, and SNR sampled from
00
The baselines are a fixed split-point architecture from prior work, ADJSCC-l, and LAIGA-N, the non-SNR-adaptive version of the proposed approach (Waqas et al., 12 Jun 2025).
The hybrid multi-hop system reports that with one hop all methods are similar at about 01 dB PSNR; with more hops, analog schemes degrade due to noise accumulation; the proposed JSC drops to around 02 dB after the first lossy compression, then remains essentially flat as hop count increases; for more than 03 hops, the proposed method outperforms both DeepJSCC-AF and DeepJSCC-PF; and against the fully digital baseline in a fair comparison, it achieves 04 dB versus 05 dB for digital, while using fewer bits at the first relay in the tested setup (Bian et al., 2023). These findings support the claim that analog DeepJSCC on the weak first hop avoids the cliff effect, while digital transmission after the first relay avoids noise accumulation in the core network (Bian et al., 2023).
The interface-based extension reports that the proposed learning-based interface outperforms Split DeepJSCC across all tested datasets, under both AWGN and Rayleigh fading, and achieves larger gains at higher channel bandwidth ratios. The evaluations use CIFAR-10, CIFAR-100, SVHN, and ImageNet32, with CBRs 06, 07, 08, and 09, and PSNR as the primary metric (Kong et al., 17 Jul 2025). The paper further reports that under Rayleigh fading, removing the Interface Attention Module can even make the system fall below Split DeepJSCC at high SNR, while the full proposed model performs best across all SNRs (Kong et al., 17 Jul 2025). This suggests that the learned interface-derived importance information is functionally significant rather than merely descriptive.
The literature also identifies limitations. In the IoT architecture-search system, the method relies on offline-simulated training data for the surrogate models, so the quality of LAIGA depends on how representative that dataset is; the demonstration is on image classification, although the authors expect the idea to generalize to speech and video tasks (Waqas et al., 12 Jun 2025). In the broader DeepJSCC literature, practical barriers include integration into legacy networks, compatibility with existing modulation and coding hardware, difficulty of combining with ARQ and CRC-style retransmission protocols, and security concerns because analog-like mappings may leak source information to eavesdroppers (Gündüz et al., 2024). The interface-based Split DeepJSCC line addresses some of these issues by restoring a bit-level contract between source and channel layers, while the hybrid multi-hop line addresses them by using DeepJSCC only where its graceful degradation is most valuable (Kong et al., 17 Jul 2025, Bian et al., 2023).
Taken together, these results support a consistent interpretation: Split DeepJSCC is a modularization strategy for DeepJSCC, used when a fully end-to-end analog-style neural transceiver is either computationally impractical, architecturally incompatible with existing systems, or suboptimal over part of the network. The modularity is not identical to classical source/channel separation, because task fidelity, semantic structure, or channel robustness remain jointly optimized around the split. This suggests that the main research significance of Split DeepJSCC lies not in abandoning DeepJSCC’s end-to-end principles, but in introducing structured interfaces that preserve those principles under practical system constraints (Gündüz et al., 2024).