Reactions from ranked influencers
3 posts
One thing that kind of annoys me and I hope is solved soon is cheap and accurate long context. After testing GPT-5.6 Sol and Terra over the last few weeks, it's clear anthropic destroys everyone at long context coherence, and maybe cost(?). OpenAI charges I believe 2x for >350K ctx, but no point going there anyways, the models are complete failures at that point. I regularly use opus and fable at 800K+ and they feel as coherent and high quality as at 25K context. I havent thoroughly tested many other models at such lengths but really we are a long way in the general space it feels like outside of claude's at handling this well or cheaply. What ever happened to Magic .dev's 100M token contexts? Did this all just not work out
@Teknium When do you feel like you need this? I never think about context length
@charliermarsh Every time I turn on gpt sub instead of anthropic api