🤖 AI 资讯

· · ↗
← 返回列表

FedHQ: Hybrid Runtime Quantization for Federated Learning

arXiv cs.LG2026-10-28 04:00:00微调蒸馏,联邦学习,招聘HR,论文原文 ↗

arXiv:2505.11982v2 Announce Type: replace

Abstract: Federated Learning (FL) must balance training efficiency and model accuracy across heterogeneous clients. Post-training quantization (PTQ) avoids the extra computation of quantization-aware training (QAT), but can incur greater accuracy loss. We propose FedHQ, a hybrid quantization framework that assigns PTQ or QAT according to clients' hardware and data characteristics. Hardware-based speed estimates and local data-distribution indicators guide coarse-grained global initialization, followed by fine-grained training-based adjustment of selected client strategies. Experiments on three image-classification datasets show that FedHQ achieves up to 2.47x training speedup over FedAQT and up to 11.15 percentage points higher accuracy than FedFQ.