shinboson outlines shared-operator approach to language model quantization
The proposed approach flexibly combines operators the creator identifies across many existing quantization methods.
TLDR
shinboson outlined a way to quantize language models by combining components they see repeated across many existing methods. The creator claims the approach could be more efficient, but their written post supplies no measurements or comparison baseline. In a quote-post, teortaxesTex asked how fast it runs without reporting a test result.
Combined views
2.2K
3 Sources, first seen ago
