Announcement
Unsloth UD3 dynamic quants made for Ornith's new 122B release
A developer says the UD-Q2_K_XL variant is 44.5GB, versus 249GB for BF16.
TLDR
A developer says they made Unsloth UD3 dynamic quants for Ornith's new 122B release. They report that the 44.5GB UD-Q2_K_XL variant is 82% smaller than BF16 at 249GB, while retaining around 84% top-1% for WikiText general and roughly 89% for chat.
Combined views
4.2K
3 Sources, first seen ago
