MMFlash decodes faster than EAGLE-3 by up to 195.4%, its authors report
AI-generated summary The authors of a new paper report that the MMFlash framework achieves a decoding speedup advantage over EAGLE-3 of up to 195.4 percent. The paper addresses speculative decoding for vision-language models and utilizes a token-level metric based on KL divergence.