Another fascinating aspect of modern character training is that different AI developers are using different systems of moral philosophy as their central bet (though with bits of other systems mixed in): Anthropic leans virtue ethics, OpenAI deontology.
Different moral theories may extrapolate to superintelligence in very different ways, so we should try to figure out which one is better! (Probably it will be some of both.)