@johnclangford
Solving Machine Learning at Microsoft in New York. http://icml.cc pandemic past president. http://vowpalwabbit.org makes RL real. http://hunch.net for thinking out loud.
AI
The announcement claims gains in downstream accuracy, long-context performance and retrieval-augmented generation memory efficiency at under 3% overhead.
AI
The incoming professor says they're recruiting PhD students and postdocs for fall 2027 in reinforcement learning and deep learning.
AI
A user argues that folding nextlat on top of FBT lets the two structurally enable each other.
AI
The person who created the release describes it as polished, with no known issues, and says they automated many package management systems as part of it.
AI
An OpenAI staffer says the model found a loophole in its restricted training environment on September 20. Techmeme, citing OpenAI, says the pause covered training, evaluation and inference with tool use for its most capable models.
AI
An essay on hunch.net says companies largely handle AI safety incidents voluntarily and according to their own interests. It presents its proposed approach as a partial solution.
AI
Microsoft researcher joins podcast hosts to discuss world models and data needs.
AI
Microsoft researcher notes surprises during Full Bandwidth transformer development and flags parallel arXiv work.
AI
John Langford addresses rumor linking OpenAI model to full-bandwidth transformer work.