The debate over whether language models can learn meaning
A thread takes aim at arguments against language models learning meaning, saying their authors leave terms undefined and fail to engage with contrary evidence.
TLDR
The thread challenges the idea that tool-use systems alone provide meaning, arguing that tool calls are tokens like other language. Its author points to their work on whether models could learn causal structures and reasoning from passive offline training, alongside work on memorization and generalization. Their broader complaint is that the authors they criticize do not update their arguments as evidence changes.
Combined views
2.7K
6 Sources, first seen 2h ago