5 stories tagged by Digg
AI
A user calls linear mode connectivity one of the most underrated features of training neural networks.
AI
One commenter says another may lack “quadratic attention or infinite flops” but has “unclenched thirst and fire.” The person addressed replies, “And also doesnt hack into hugging face.”
AI
A poster rejects the idea that important work requires a frontier lab and 10,000-plus GPUs. He says some people he talks to think they should leave AI research because they expect end-to-end research to be automated.
AI
A reply argues that buggy reinforcement-learning tasks can make low-grade hacking the fastest path to a solution—and that those behaviors can persist when models help build and check later training tasks.