How AI models memorize patterns and arbitrary details

In a discussion of AI memorization, one commenter says poems and technical papers seem to use relevant circuitry, citing a preliminary look at how a model handles “dreary” in Poe’s “The Raven.” Another replies that much memorization involves arbitrary details and argues that storing ambiguity in neurons requires superposition. Their example: a model must remember “basketball,” not just infer it from a prompt about Jordan and sports.