Extropic introduces Z1T, transformer-like models for Z1 hardware
Extropic claims up to 140x energy efficiency gains over GPUs for its new models, designed for sparse probabilistic hardware such as Z1.
TLDR
Extropic announced Z1T on September 4, describing it as its first family of transformer-like models built for sparse probabilistic hardware such as Z1. The company claims up to 140x energy efficiency gains over GPUs and says the work reveals a new scaling law for sparse transformers.
Combined views
217
1 Source, first seen ago