DeepSeek's DSpark: The Speculative Decoding Breakthrough Quietly Powering Those Price Cuts
DeepSeek has published DSpark, a paper detailing a refined approach to speculative decoding — the inference acceleration technique where a small 'draft' model proposes tokens that a larger target model then verifies in parallel. The core innovation tackles one of the most pers…