iCreatAI News
Skip to content
MarkTechPost· Asif Razzaq·· 18 days agoAI score58

Polymathic AI and Princeton Researchers Release FlashMap, a Flow Map Drafter for 6.14x Faster LLM Decoding

Polymathic AI and Princeton Researchers Release FlashMap, a Flow Map Drafter for 6.14x Faster LLM Decoding

AI summary

Researchers from Polymathic AI, Princeton University, USC ISI, NYU and the Flatiron Institute released FlashMap, a speculative decoding drafter that uses a continuous flow map to draft a full 16-token block in one forward pass, keeping tokens in the block consistent with each other. On Qwen3-8B the team reports up to 6.14x lossless speedup on GSM8K, and says 1-step FlashMap is the fastest drafter tested on every Qwen3-8B task at both temperatures 0 and 1. Drafter weights for Qwen3-8B and Qwen3-4B are on Hugging Face with vLLM and SGLang plugins.

Source: MarkTechPost · marktechpost.com