The functional case for taking AI consciousness seriously
A post argues that large language models converge on brain-like structures and that post-training seems to install a self-model, offering reasons to take AI consciousness seriously.
TLDR
The author’s argument centers on whether subjective experience serves a useful function. If Attention Schema Theory is right, they argue, subjectivity helps an agent stay coherent over long periods and learn in context. They also claim that large language models converge on brain-like structures and say post-training seems to install a self-model. More broadly, the author sees reason to expect convergence toward consciousness if consciousness itself has a functional role.
