Sentence Transformers v6.0 Adds MultiVectorEncoder Support
The release treats ColBERT-style late interaction models as a first-class model type for training, inference, and interpretation.
TLDR
Tomaarsen announced the release of Sentence Transformers v6.0. The update adds MultiVectorEncoder as a native model type that supports ColBERT-style late interaction models. These models now sit alongside dense, sparse, and reranker types for training, inference, and interpretation. Hugging Face retweeted the post. Several researchers quoted the thread, including staff from Weaviate and LightOn, noting that the change makes it simpler to train multi-vector models and that projects such as PyLate now build directly on the library.
Sentence Transformers v6.0 Adds MultiVectorEncoder Support
The release treats ColBERT-style late interaction models as a first-class model type for training, inference, and interpretation.
