https://openreview.net/forum?id=BhE1AvOT7s
ImportanceWeighted Multi-Draft Speculative Sampling | OpenReview
We consider multi-draft speculative sampling, where the proposal sequences are sampled independently from the same underlying draft model. At each step, a...
multidraftspeculativesamplingopenreview