https://isprs-annals.copernicus.org/articles/V-2-2020/997/2020/
ISPRS-Annals - GENERALIZED KNOWLEDGE DISTILLATION FOR MULTI-SENSOR REMOTE SENSING CLASSIFICATION:...
isprs annalsknowledge distillationmulti sensorremote sensinggeneralized
https://scholars.duke.edu/publication/1530610
Scholars@Duke publication: Reinforced Iterative Knowledge Distillation for Cross-Lingual Named...
knowledge distillationscholarsdukepublicationreinforced
https://www.microsoft.com/en-us/research/publication/towards-understanding-ensemble-knowledge-distillation-and-self-distillation-in-deep-learning/
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning -...
Jan 10, 2021 - We formally study how Ensemble of deep learning models can improve test accuracy, and how the superior performance of ensemble can be distilled into a single...
towards understandingknowledge distillationensembleselfdeep
https://arxiv.org/html/2407.13147v1
DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection
knowledge distillationdualfeaturemaskingstage
https://campus-fryslan.studenttheses.ub.rug.nl/537/
Assessing Knowledge-Distillation Based Compression of Whisper Model for Frisian ASR - Studenttheses...
knowledge distillation
https://c4dt.epfl.ch/project/arno/
ARNO: Adversarial robustness via Knowledge Distillation - C4DT
May 3, 2024 - State-of-the-art architectures for modulation recognition are typically based on deep learning models. However, recently these models have been shown to be...
adversarial robustnessknowledge distillationarnovia
https://research.google/pubs/speculative-knowledge-distillation-bridging-the-teacher-student-gap-through-interleaved-sampling/
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling
knowledge distillationthe teacherspeculativebridging
https://publica.fraunhofer.de/entities/publication/7bc3ee9f-6d1e-4cad-9b53-aefba5cba82f
Knowledge-Distillation-Based Label Smoothing for Fine-Grained Open-Set Vehicle Recognition
Fine-grained vehicle classification describes the task of estimating the make and the model of a vehicle based on an image. It provides a useful tool for...
knowledge distillation
https://pubmed.ncbi.nlm.nih.gov/35692896/
Knowledge distillation with ensembles of convolutional neural networks for medical image...
convolutional neural networksknowledge distillationfor medicalensembles
https://www-rali.iro.umontreal.ca/rali/?q=fr/node/1624
Knowledge Distillation with Noisy Labels for Natural Language Understanding | RALI
knowledge distillationfor naturallanguage understandingnoisylabels
https://arxiv.org/abs/2601.01484
[2601.01484] SGD-Based Knowledge Distillation with Bayesian Teachers: Theory and Guidelines
Abstract page for arXiv paper 2601.01484: SGD-Based Knowledge Distillation with Bayesian Teachers: Theory and Guidelines
knowledge distillation
https://research.monash.edu/en/publications/block-wisely-supervised-neural-architecture-search-with-knowledge/
Block-wisely supervised Neural Architecture Search with knowledge distillation - Monash University
neural architecture searchknowledge distillationblockwiselysupervised
https://rit.rakuten.com/publications/2022/online-knowledge-distillation-for-multi-task-learning/?tag=automated-product-catalog&language=ja
Online Knowledge Distillation for Multi-Task Learning | Publications | Rakuten Institute of...
Our Japanese publications in computer science and AI, including Machine Learning, Deep Learning, Data Science, Computer Vision and Natural Language Processing.
knowledge distillationmulti tasklearning publicationsonline
https://arxiv.org/abs/2307.05201
[2307.05201] The Staged Knowledge Distillation in Video Classification: Harmonizing Student...
Abstract page for arXiv paper 2307.05201: The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly...
knowledge distillationin videostaged
https://arxiv.org/abs/2204.00895
[2204.00895] Class-Incremental Learning by Knowledge Distillation with Adaptive Feature...
Abstract page for arXiv paper 2204.00895: Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation
incremental learningknowledge distillationclass
https://dev.to/rikinptl/cross-modal-knowledge-distillation-for-precision-oncology-clinical-workflows-in-hybrid-3h5n
Cross-Modal Knowledge Distillation for precision oncology clinical workflows in hybrid...
During my research into AI-driven oncology diagnostics, I encountered a persistent challenge that changed my approach to medical AI systems. While working with...
knowledge distillationprecision oncologyclinical workflowscrossmodal
https://arxiv.org/abs/2306.08909
[2306.08909] Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation...
Abstract page for arXiv paper 2306.08909: Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models
bridging the gap
https://amslaurea.unibo.it/id/eprint/24178/
Improvements to knowledge distillation of deep neural networks - AMS Tesi di Laurea - AlmaDL -...
deep neural networks
https://arxiv.org/abs/2010.10090
[2010.10090] Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and...
Abstract page for arXiv paper 2010.10090: Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher