NextTerm-440M Model Beats Larger LLMs on Sequence Completion Tasks

Announcing NextTerm-440M, a pre-trained foundation model on 14B tokes of augmented OEIS data, for academic research. It beats much larger pretrained LLMs on a variety of sequence completion tasks, and serves as a base to study in-context learning, OOD generalization, etc.