Researchers Debate Continual Learning Terminology
Rohan Anil paraphrases Rich Sutton on why machine learning needs continual rather than static learning.
Rohan Anil posted that the field calls training continual learning only because others hijacked the word learning for static methods. He credited the point to Rich Sutton and closed with the line let the learning be continual. Will Brown replied that online learning would have been the natural term if the internet had not existed. Both researchers work on large scale training systems and posted the exchange in public view. The posts contain no further details on methods or outcomes beyond the terminology exchange.
We wouldn’t have to call it continual learning if you weirdos didn’t hijack learning for static learning — paraphrasing Rich Sutton Let the learning be continual
Combined views
10.8K
Researchers Debate Continual Learning Terminology
Rohan Anil paraphrases Rich Sutton on why machine learning needs continual rather than static learning.
Rohan Anil posted that the field calls training continual learning only because others hijacked the word learning for static methods. He credited the point to Rich Sutton and closed with the line let the learning be continual. Will Brown replied that online learning would have been the natural term if the internet had not existed. Both researchers work on large scale training systems and posted the exchange in public view. The posts contain no further details on methods or outcomes beyond the terminology exchange.
We wouldn’t have to call it continual learning if you weirdos didn’t hijack learning for static learning — paraphrasing Rich Sutton Let the learning be continual
Reactions from ranked influencers
1 post@_arohan_ if it wasn’t for the internet we could’ve called it online learning like god intended
