Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation -- A Geometric Perspective on Feature-Based Distillation -- Knowledge Distillation Across Vision and Language -- Knowledge Distillation in Granular Fuzzy Models by Solving Fuzzy Relation Equations -- Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications -- Self-Distillation with the New Paradigm in Multi-Task Learning -- Knowledge Distillation for Autonomous Intelligent Unmanned System.