Roon and Jack Clark Exchange Boat Metaphors on Misalignment
Replies revive a decade-old OpenAI blog post on faulty reward functions.

A retweet highlighted a blog post on faulty reward functions written years earlier by Jack Clark and Dario Amodei. OpenAI researcher roon replied that he had insisted the group keep the boat used in safety discussions. Jack Clark answered with a poetic note that the boat spins eternal and continues to enflame minds with the vision of misalignment. The exchange appeared among visible replies tied to the original post reference.
was fun to realize that "OpenAI work from a decade ago" is a blog by @jackclarkSF and @DarioAmodei https://openai.com/index/faulty-reward-functions/ https://twitter.com/OpenAI/status/2092691861773160673
Roon and Jack Clark Exchange Boat Metaphors on Misalignment
Replies revive a decade-old OpenAI blog post on faulty reward functions.