AITrying to run an extremely wide model locally
A post pairs a video with a caption about running a model described as “a massive mixture of shallow experts.”
TLDR
A user shared a video, writing: “When you try to locally run an extremely WIDE model that's a massive mixture of shallow experts.”
Combined views
18K
1 Source, first seen 1d ago
155 likes
Trying to run an extremely wide model locally
A post pairs a video with a caption about running a model described as “a massive mixture of shallow experts.”
TLDR
A user shared a video, writing: “When you try to locally run an extremely WIDE model that's a massive mixture of shallow experts.”