QVAC

@qvac

Infinite intelligence. Local. Any Hardware. Peer-to-Peer Hyper Swarm. No cloud. No compromise. QVAC is the decentralized AI platform for humans and machines.

following
followers

Fast Metal kernels in llama.cpp now cover all 26 Mac GPU weight formats

The contributor says the latest PR added 16 formats, including BF16 and MXFP4, to the 10 covered earlier.

2 Sources, 17d ago, first seen 17d ago

New Metal kernels for speculative decoding land in llama.cpp

Qvac says the Apple Silicon update makes speculative decoding up to 3.4 times faster than plain decoding on an M3 Ultra.

4 Sources, 20d ago, updated 20d ago

Featured in

Fast Metal kernels in llama.cpp now cover all 26 Mac GPU weight formats

New Metal kernels for speculative decoding land in llama.cpp

Featured in

Fast Metal kernels in llama.cpp now cover all 26 Mac GPU weight formats

New Metal kernels for speculative decoding land in llama.cpp