Finetuned ColBERT Model Performs on Medical Tasks

Omar Khattab retweeted a post praising mxbai-edge-32M results from a blog post on training ColBERT models with Sentence Transformers for medical retrieval. Florian Brand replied that new results on hierarchical pooling and asymmetric quantization make storage excuses for late interaction models harder to sustain. A separate retweet noted asymmetric quantization as a free lunch. One generated summary described storage for a medical model dropping from 45 GB to 2.8 GB with NDCG@10 falling only from 0.916 to 0.