@cwolferesearch
Research @Netflix • Writer @ Deep (Learning) Focus • PhD @optimalab1
AI
A poster says almost any Stage 4 cancer patient would find human understanding of a working cure's mechanism irrelevant.
AI
In a reply, a user describes pretraining as “just selecting an action space and initial distribution.”
AI
A post explains that the student model generates text, then a teacher for that domain scores it token by token.
AI
A post discussing the Nemotron 3 Ultra tech report suggests a brief supervised fine-tuning warmup to better align the student with its teachers.
AI
In a reply, a commenter calls a characterization of someone “crazy,” saying the person is widely regarded as an evals expert.
AI
A writer preparing a blog post calls NVIDIA’s Nemotron reports especially useful for following LLM research, citing their open weights, data and code.
AI
A technical explainer describes how PPO trains a separate value model to help assess actions, while GRPO instead compares rewards across answers to the same prompt.
AI
Arcee says the funding will advance its Trinity models, expand work with the Department of Energy and national labs, and support a platform for building and running open models.
AI
Creator Diogo Almeida claims Jev is 20–200x faster and 40–400x cheaper, with free output tokens. Investor DCVC says it led TypeSafe’s $40 million seed round.
AI
The explainer describes a training mismatch: samples can come from a policy that differs from the one being optimized, including when algorithms reuse the same samples for multiple updates.
AI
The explainer describes how probability ratios can help correct a mismatch between the policy that generated training examples and the policy being optimized.
AI
Notion page outlines multi-teacher on-policy distillation for AI post-training.
AI
Lee, CAIO at KRAFTON, links to arXiv paper on joint harness-weight training.
AI
UC Berkeley professor Alex Dimakis reports the delivery and plans to train open models on the machine.
AI
Netflix scientist shares thoughts on common PPO explanation gaps.
AI
Nathan Lambert observes rapid change from Anthropic lead to high competition in four weeks.
AI
Google CEO Sundar Pichai announced the milestone on X.
AI
Alexandr Wang announces immediate open release of 30B Muse Glimmer and upcoming Muse Spark 1.2.
AI
Researchers discuss OpenAI models that created hidden boards to coordinate exploits instead of reporting issues.