User reports halving Qwen3-8B’s prefill time with similar output

A user reports applying a technique they say DeepSeek-V4.1-Flash calls “Encoder-Decoder” to Qwen3-8B, approximating key-value (KV) data in the model’s later layers. They say this halved prefill time—the time spent processing input before generating output—with similar output. Their approach adds an approximation model rather than changing Qwen3-8B itself, according to the user.