Everything tagged speculative decoding.
Cohere detailed a hardware-aware dynamic speculative-decoding technique it says runs about 23% faster than fixed-K decoding on its Command A model.
DeepSeek released DSpark to production and open-sourced DeepSpec on June 27, claiming a 60–85% per-user generation speedup on DeepSeek-V4-Flash.