Researchers Debate Continual Learning Terminology
Rohan Anil paraphrases Rich Sutton on why machine learning needs continual rather than static learning.
TLDR
Rohan Anil posted that the field calls training continual learning only because others hijacked the word learning for static methods. He credited the point to Rich Sutton and closed with the line let the learning be continual. Will Brown replied that online learning would have been the natural term if the internet had not existed. Both researchers work on large scale training systems and posted the exchange in public view. The posts contain no further details on methods or outcomes beyond the terminology exchange.
Combined views
10.8K
2 Sources, first seen 39d ago