知识蒸馏目的:
需要关注的是上图的:
attention transfer
channel-wise knowledge distillation for dense prediction
ppt来源于:【精读AI论文】知识蒸馏_哔哩哔哩_bilibili