Abstract: Data-free knowledge distillation (DFKD) aims to transfer the knowledge from a large teacher network to a lightweight student network without accessing the original training data. However, ...