Wightman Releases NaFlexViT CLIP Test Model

Ross Wightman, creator of the timm PyTorch library, posted that he pushed a new test model from recent OpenCLIP trial runs. He states it is the first of its kind, trained with both patch size jitter in the FlexiViT style and sequence length jitter in the NaFlex style. The small NaFLexViT CLIP model was trained on CC12M. Wightman compared it against a version using a fixed patch size with variable sequence length. The post references additional recent work but provides no further details.