Modal Adds Interactive Explorer For Low-Precision Float Formats
โโ0โโ
another page for the @modal LLMEng Almanac: an explorer for low-precision floats, from bf16 to fp4
modal.com
/llm-almanac/quant-formats/
3:58 PM ยท May 18, 2026 ยท 3.3K Views
(which is fair, floating point "numbers" don't have any structure an algebraist would respect)
each number gets its own URL, so you can share your favorite numbers with your fellow quant fp enjoyers here's one of mine: 0x8 in fp4. fp4 has only 16 values, and one of them is used to represent -0, a number my algebra teacher told me did not exist https://modal.com/llm-almanac/quant-formats/0x8
3:58 PM ยท May 18, 2026 ยท 450 Views
3:58 PM ยท May 18, 2026 ยท 331 Views