Wightman Explains OpenCLIP ModernText and ModernBERT Differences

Ross Wightman, creator of the timm PyTorch library, responded publicly to a question about recent OpenCLIP work. The query asked for differences between the native ModernText encoder and supported pretrained ModernBERT models available through Transformers. He stated that both are driven by similar goals. The native implementation provides additional configuration options and simpler customization, while the Transformers integration supplies solid pretrained models. The exchange appears among visible replies tied to his post.