@Manish_m09
Multimodal AI Product Leadership. I work on multimodal AI models pre-training and post-training | Ex-Datadog, Airbnb, AWS, Microsoft Views are my own.
AI
A reply says attention-gate weight decay was added over concerns the model wasn't using early layers enough, while PDL was disabled in QuACK grouped GEMMs because of hangs.
