Faster Knowledge Distillation Using Uncertainty-Aware Mixup
Author(s): Tata Ganesh Originally published on Towards AI. Photo by Jaredd Craig on Unsplash In this article, we will review the paper titled “Computation-Efficient Knowledge Distillation via Uncertainty-Aware Mixup” [1], which aims to reduce the computational cost associated with distilling the knowledge …