Neuralese: The highly compressed, internal language increasingly used by some LLMs. Unlike English, Neuralese can't be understood by humans.
AI safety researcher Chris Painter disputes Erik Brynjolfsson's claim that deployed LLMs actively use 'neuralese
Painter notes the concept refers to undocumented latent-vector reasoning.
Most Activity
Just to clarify, I would not say neuralese is “increasingly used by some LLMs”. I generally understand this term to mean “recurrent latent-vector reasoning, not implemented via an output chain of thought”. There’s some evidence models can reason without using the CoT, but “neuralese” has not been publicly documented as being used in publicly deployed models.
Fact 5: Agents seemed to rely on natural language to reason through the hardest tasks, and no shared model had an architecture that allowed for opaque recurrence. Frontier performance was much worse when agents were unable to “reason out loud” or had to hide what they were doing.

@erikbryn

@erikbryn Why?