Samuel Hammond argues transformers maintain state via KV caches, disputing Guillaume Verdon's claim that consciousness requires persistent memory

Transformers lack mutable RNN-style state but maintain coherence autoregressively.