Report
Tencent researchers release STEPQuant on Hugging Face
HuggingPapers says the quantization framework matches FP32 accuracy with 6-bit states, cutting total serving memory by up to 68.7%.
TLDR
HuggingPapers says Tencent researchers released STEPQuant on Hugging Face, describing it as a spatial-temporal post-training quantization framework for Delta-rule recurrent states. It says 6-bit states match FP32 accuracy while cutting total serving memory by up to 68.7%.
Combined views
3.5K
2 Sources, first seen ago
