Robuta

https://arxiv.org/abs/2310.08461 [2310.08461] DistillSpec: Improving Speculative Decoding via Knowledge Distillation Abstract page for arXiv paper 2310.08461: DistillSpec: Improving Speculative Decoding via Knowledge Distillation speculative decoding improving via knowledge distillation https://research.google/pubs/distillspec-improving-speculative-decoding-via-knowledge-distillation/ DistillSpec: Improving speculative decoding via knowledge distillation speculative decoding improving via knowledge distillation