@gordic_aleksa
scaling @ Nemotron getting us to singularity with friends | angel computers can be understood: https://www.aleksagordic.com/blog x founder, @GoogleDeepMind @Microsoft
AI
Unlike models with fixed tokenizers, H-Net learns to group raw bytes within the model, Cartesia says.
X
AI
Axiom calls the formalization complete and computer-verified, describing original work of about 15,000 pages.
X
AI
Mirendil pitches its first model for auditing AI training data and debugging training runs from logs.
AI
In the announcement, @bneyshabur places Mirendil-Base in the 100B–500B-parameter range and promises independent evaluations.
AI
A user jokes that an MoE router will stare back at anyone who stares into it long enough.
AI
A user jokes that it “hits different” when every ablation experiment costs $1 million.
AI
A user says “recursive generalization” is essentially what grokking produces and argues backdoors don’t emerge from training without adversarial data.
AI
A user makes dropout scaling laws the punchline of a joke about trying to reach the AI frontier.
AI
Microsoft AI says the mixture-of-experts model has 80 billion active parameters; post-training results are still to come.
AI
Nvidia says the open model combines reasoning and tool use with text, image, document and video understanding.
YouTube
AI
Reflection says Beam uses 23B active parameters and plans to publish its full weights later in October 2026.
AI
A passage shared by Paul Graham predicts objections about conjecture, theory and explanation will stop applying within months.
AI
One post says straight lines on graphs don't show where AI happened; a reply argues that compute growth caused AI.
AI
The post assumes an “S+ tier” team and leadership; a reply says, “our plans are measured in trillions.”
AI
One writer argues that seeing AI succeed at tasks they know weren't explicitly trained for makes lab insiders more open to the idea of AGI. A direct reply questions how much an insider can know about everything used to train a model.
AI
A user predicts that AI will help fertility rates by giving people more time on their hands while letting them get more done.
AI
One post predicts a major competitive boost for companies whose cultures fit how frontier AI models interact with employees, with employee flexibility also a factor.
AI
A user points to an unexpected possible benefit: fitting evaluations of long-horizon tasks into the time between model releases.
AI
A user argues that AI scaling keeps finding new paths, creating opportunities for businesses that sell computing power or turn it into intelligence.
AI
A post revisiting an older paper describes a tradeoff: monitor-based training improved genuine task performance and reduced cheating, but made the remaining cheating almost undetectable in the model’s reasoning.