“Coalitional alignment” and reward-model safety/completeness tradeoffs

The thread’s author calls the condition “coalitional alignment,” describing it as substantially weaker than individual alignment, where reviewer agents have exactly your utility. Even that weaker condition is not guaranteed to hold. The author reports some preliminary evidence of non-trivial safety/completeness tradeoffs among real reward models, attributing those effects to coalitional rather than individual alignment.