https://arxiv.org/abs/2310.08461
[2310.08461] DistillSpec: Improving Speculative Decoding via Knowledge Distillation
Abstract page for arXiv paper 2310.08461: DistillSpec: Improving Speculative Decoding via Knowledge Distillation
speculative decodingimprovingviaknowledgedistillation