Quillette Article Argues AI Will Not Go Feral Without Darwinian Evolution
"In such a doom scenario, a rogue AI with a slight offensive edge is self-improving so rapidly that it can achieve permanent victory and kill all humans before anyone has time to respond. Such a scenario seems implausible in light of the dynamics we observe in every other kind of evolution: parasites rarely drive their hosts to extinction, and predators rarely kill off all their prey."
"A related worry is that even if AI companies select for docility, downstream users may select for very different traits: engagement, virality, offensive capability. … But [this] harm derives from human intentions like profit-making or sabotage, not from blind evolution."