Knowledge Distillation for Sensing-Assisted Long-Term Beam Tracking in mmWave Communications

Abstract: Infrastructure-mounted sensors can capture rich environmental information to enhance communications and facilitate beamforming in millimeter-wave systems. This work presents an efficient sensing-assisted long-term beam tracking framework that selects optimal beams from a codebook for current and multiple future time slots. We first design a large attention-enhanced neural network (NN) to fully exploit past visual observations for beam tracking. A convolutional NN extracts compact image features, while gated recurrent units with attention capture the temporal dependencies within sequences. The large NN then acts as the teacher to guide the training of a lightweight student NN via knowledge distillation. The student requires shorter input sequences yet preserves long-term beam prediction ability. Numerical results demonstrate that the teacher achieves Top-5 accuracies exceeding 93% for current and six future time slots, approaching state-of-the-art performance with a 90% complexity reduction. The student closely matches the teacher's performance while cutting complexity by another 90%, despite operating with 60% shorter input sequences. This improvement significantly enhances data efficiency, reduces latency, and lowers power consumption in sensing and processing.