ColBERT creator Omar Khattab demonstrates cache-optimized Product Quantization retrieving 600 million vectors in 10 milliseconds on a single CPU core

Positive users are excited that the optimized PQ layout enables 10ms ColBERT retrieval on one CPU core for real production use and may attract AMD Intel or Apple while the negative reply calls the numbers marketing fluff.

5 comments with sentiment. View comments.