Mixed-Timescale Differential Coding for Downlink Model Broadcast in Wireless Federated Learning
In wireless federated learning, the server needs to periodically broadcast the global model to all devices. To optimize resource usage, this broadcast can be compressed using differential coding, reducing the frequency of full model transmissions and instead sending differential updates. However, devices may occasionally miss a differential update due to fading and interference, preventing them from reconstructing the original model. Consequently, the device must wait for the next full model broadcast, forcing it to work with an outdated model or halt the learning process. To improve efficiency, we propose a mixed-timescale differential coding scheme, where the model is broadcast at three timescales: 1) a full model with a long timescale, 2) a first-level differential model with an intermediate timescale, and 3) a second-level differential model with a fast timescale. This design ensures that if a device misses a second-level update, it only waits for the next first-level differential update, which is more frequent than the full model broadcast. This effectively reduces model staleness. Additionally, we propose an age-aware scheduling policy to address decoding failures, prioritizing devices with fresher models during uplink aggregation. Simulations show that our methods outperform baseline and state-of-the-art approaches, delivering superior learning performance with similar communication resources.
Paper
References (45)
Scroll for more · 33 remaining