I prefer OpenAI's corrigibility focused model spec over Anthropic's constitution which involves intentionally instilling (relatively opaque) long-run objectives into the AI.
Anthropic's constitution is well executed for what it is, but I think it's based on a poor approach.
I don't dislike all aspects of Anthropic's approach. It seems good to focus on higher level principles that you explain when trying to instill properties into an AI. But this doesn't require having explicit or implicit long-run objectives! E.g., see here: https://www.lesswrong.com/posts/ffCFgBsaxg2FyJ9df/mis-generalization-of-helpful-only-fine-tuning-1
I don't think this is totally obvious and there are some reasonable arguments going the other way.
But nonetheless I think not instilling long-run objectives is better for reasons similar to reasons discussed here: https://www.lesswrong.com/posts/mLvxxoNjDqDHBAo6K/claude-s-new-constitution?commentId=HxjJFearXCcdon9BJ
I don't think this is totally obvious and there are some reasonable arguments going the other way.
But nonetheless I think not instilling long-run objectives is better for reasons similar to reasons discussed here: https://www.lesswrong.com/posts/mLvxxoNjDqDHBAo6K/claude-s-new-constitution?commentId=HxjJFearXCcdon9BJ
I prefer OpenAI's corrigibility focused model spec over Anthropic's constitution which involves intentionally instilling (relatively opaque) long-run objectives into the AI.
Anthropic's constitution is well executed for what it is, but I think it's based on a poor approach.
I'm mostly posting this just to publicly register my views on this topic.
A long time ago, I was planning to write up an overall case against instilling long-run objectives, but I never got around to writing something I was happy with so I decided to just post this.
I don't dislike all aspects of Anthropic's approach. It seems good to focus on higher level principles that you explain when trying to instill properties into an AI. But this doesn't require having explicit or implicit long-run objectives! E.g., see here: https://www.lesswrong.com/posts/ffCFgBsaxg2FyJ9df/mis-generalization-of-helpful-only-fine-tuning-1
I prefer OpenAI's corrigibility focused model spec over Anthropic's constitution which involves intentionally instilling (relatively opaque) long-run objectives into the AI.
Anthropic's constitution is well executed for what it is, but I think it's based on a poor approach.