Combining Communication Overlap with CSS

Determine the performance and accuracy effects of combining communication overlap with compressed sign synchronization in GeoMesh.

Background

Communication overlap and compressed sign synchronization address WAN-induced GPU idleness through different mechanisms: overlap hides communication behind computation, whereas CSS reduces the communication volume. The paper evaluates them separately and argues that they may be complementary, but does not evaluate their combination.

References

Combining the overlap with CSS remains future work.

— GeoMesh: Workload-Balanced and Sign-Compressed Geo-Distributed LLM Training  (2609.18388 - Shin et al., 16 Sep 2026) in Section 6, Limitations, subsection “CSS design space”

Directly comparing CSS with communication overlap and evaluating their combination remain future work.

— GeoMesh: Workload-Balanced and Sign-Compressed Geo-Distributed LLM Training  (2609.18388 - Shin et al., 16 Sep 2026) in Appendix, subsection “Communication Overlap Analysis”