Husky is said to run one model on Mac and iPhone without Wi-Fi
A post describes Husky as a model-specific inference engine. A follow-up says its Metal kernels are tailored to the Woof model, with the goal of beating Apple's MLX.
TLDR
The posts describe Husky as a runtime for one model, rather than many, and say it runs on Mac and iPhone even without Wi-Fi. The author says they wrote model-shaped Metal “megakernels” to beat Apple's MLX. Because Husky knows Woof's shapes ahead of time, they say each matrix uses one kernel to combine normalization, 4-bit unpacking and multiplication in a single pass.
Combined views
—
5 Sources, first seen ago
— likes— comments— saves— reposts
