@echen
founder @HelloSurgeAI // raising AGI
AI
Surge AI also points to legacy code nobody wants to touch.
AI
A post introducing the benchmark says its 60 tasks are mostly in private production repositories at real companies.
AI
Mistral says Mistral Large 4 is live via API in public preview now, with open weights due at the end of October. Reuters says the launch is part of Mistral’s push to narrow the gap with leading Chinese open-weight models.
AI
A post lists No. 1 spots on Riemann-bench, Chartography and GDP.xlsx in a congratulatory message to Argon and Google DeepMind.
AI
Surge AI says the benchmark has 70 tasks across 12 knowledge-work domains, including finance, healthcare and logistics.
AI
Surge AI says it post-trained Kimi K2.7 on 1,465 GDP.pdf companion tasks. Its GDP.pdf score rose from 11.0% to 24.5%, while full-task success on GDPval more than doubled.
AI
API pricing is $2 per million input tokens and $10 per million output tokens. OpenAI reports near-Astra results on several coding and work evaluations.
AI
A September 28 post shared an X broadcast link labeled 'LIVE: Sonnet 5.5.'
AI
With no zstd binary available to check its work, the model generated its own test files, according to a participant in Kimi's coding post-training run.
AI
The user says training on 1,700 Surge coding tasks made execution less brittle and reduced steps from 150 to 98 on DeepSWE and 102 to 78 on Terminal-Bench 3.
AI
The user describes the change as a move toward “shippable” code, saying the model previously dropped requirements, wrote narrow tests and created regressions.
AI
AI benchmarking company accelerates v5 elements via interim index updates with new agent tasks.
AI
Surge AI founder posts video attachment from an evals offsite.