Livestream on speeding up local LLMs with speculative decoding set for October 19
Hugging Face shared the event; one speaker points beginners to Llama for automatic speculative decoding.
TLDR
Hugging Face shared a livestream about using speculative decoding to speed up local LLMs. One speaker said it was set for Monday, October 19, and suggested Llama for beginners who aren't interested in learning the technique. Llama's site says its app automatically enables speculative decoding for models that support it.
Combined views
1.1K
1 Source, first seen ago
