In the world where the slop actually works, produces aesthetic experiences, or advances knowledge things get weird. Goodhart is still active: you don't get deliberate aim at the good, so no-reliability or economic fit. Yet a lot will be reality-shaped.
Anders Sandberg@anderssandbergThe weird thing happens when the fakery and real becomes comparably cheap. I recent asked for a parody, and as a side effect I got a theorem I might actually use.
One possibility is of course "dead reality theory": everything becomes a Baudrillardian simulacrum of everything else, and physical and epistemic reality suffers mode collapse until only the firmly reality-constrained parts remain functional. (Or not even that: a Spamocalypse.)
Anders Sandberg@anderssandbergIn the world where the slop actually works, produces aesthetic experiences, or advances knowledge things get weird. Goodhart is still active: you don't get deliberate aim at the good, so no-reliability or economic fit. Yet a lot will be reality-shaped.
Another possibility is "the weirdening". Generated artefacts mirror each other, reality, human and AI internal states, and more and more emerges that isn't generated through traditional human-intentional processes or have aims in any sense. The world as Moltbook.
Anders Sandberg@anderssandbergOne possibility is of course "dead reality theory": everything becomes a Baudrillardian simulacrum of everything else, and physical and epistemic reality suffers mode collapse until only the firmly reality-constrained parts remain functional. (Or not even that: a Spamocalypse.)
The boring (?) possibility is utopia: the spammers, cheaters and dropshippers become ensnared in a system where path of least resistance is to fill world with stuff people actually want and need. We should look at mechanism design to gently hook our systems in this direction.
Anders Sandberg@anderssandbergAnother possibility is "the weirdening". Generated artefacts mirror each other, reality, human and AI internal states, and more and more emerges that isn't generated through traditional human-intentional processes or have aims in any sense. The world as Moltbook.