11h agoTilde releases Wall Attention, a RoPE-free attention mechanism that generalizes 4,000-token models to over 200,000 tokens without retrainingThe mechanism outperformed traditional RoPE and FoX in benchmarks.SentimentSentimentPos100%Neg0%Users praised Tilde Research's Wall Attention launch for enabling RoPE-free long-context models, calling the work neat and a banger.2 comments with sentiment. View comments.