/TECHStory update pending

A 2016 paper introducing Byte Pair Encoding tokenization wins the ACL Test of Time Award after being twice rejected

The foundational paper was published one year before the Transformer.

Story Brief

The foundational paper was published one year before the Transformer.

Commentary on X

Highest ranked

@srush_nlp BPE feels like its been around forever and also just yesterday somehow. That rejection-to-test-of-time pipeline is the real inspiring part.

Sasha Rush@srush_nlpTECH