https://openreview.net/forum?id=ukDi9JyaL3
MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language...
Speculative decoding significantly accelerates language model inference by enabling a lightweight draft model to propose multiple tokens that a larger target...