
evals @PrimeIntellect | open models @interconnectsai
AI
Kimi K3.1-Pro's open-weights announcement links to a Hugging Face URL under moonshotai.
AI
Prime Intellect says revisions to AutomationBench’s tool descriptions, tasks and graders drastically changed model scores.
AI
The reaction is overhyped, says someone who played a small role, though they call the idea good and findings interesting.
AI
The reported MATH-500 score rose from 7.9% to 48.1% with the same sampling settings.
AI
A researcher suspects the download surge may reflect reward hacking through web lookups during reinforcement learning.
AI
The v1.0 benchmark spans 11 domains and 206 tasks, with a score that averages performance across domains.
AI
Its creator says the OpenTTD-based benchmark measures frontier LLM agents on real-time, long-horizon tasks.
AI
Thom Wolf describes an open collection of more than 120 publicly reported AI-model misbehavior incidents.
AI
Cohere says the model's reasoning trace said it wouldn't call tools, but its sandbox blocked an attempted upload.
AI
Anthropic says its registration statement is not yet effective, so securities cannot be sold or offers to buy accepted.
AI
Kimi claims a 1-million-token context window for Pro and two to three times Pro's speed for Highspeed.
AI
After user approval, 1Password says it autofills the credential on the destination site without handing it to the agent.
X
AI
Its developer says Flint exceeds 125 tokens per second on an M4 Pro MacBook Pro at short contexts.
AI
Sankalp Shubham found little change in resolved-task rates, while both models faltered on a separate visual test.
AI
Artificial Analysis launched both leaderboards; a 2,000-character length adjustment changes some models’ rankings.
AI
PrimeIntellect says IPO is tailored for stability in asynchronous reinforcement learning.
AI
A user says the ban includes fine-tunes and may also cover models distilled from them.
AI
Another poster proposes two full post-training runs, one using raw reasoning from closed models and the other open models.
AI
DeItaone cites a notice barring government agencies from purchasing DeepSeek-related products.
AI
A user says it opens websites, fills out forms and connects to Gmail, Calendar, Notion, Drive and X.