Fail Fast, Win Big: Rethinking the Drafting Strategy in Speculative Decoding via Diffusion LLMs

This repository contains the source code implementation of the paper Fail Fast, Win Big: Rethinking the Drafting Strategy in Speculative Decoding via Diffusion LLMs.

Getting Started

Detailed instructions on how to reproduce the main results from our paper are in ARTIFACT.md.

failfast_icml_rebuttal