Reactions from ranked influencers
2 posts
@sebkrier Curious what is the best case scenario here from your POV? Details slightly tweak things (e.g. emphasizing alignment vs. security, intrinsic hardness of the problem vs. human sloppiness etc.) but no interp seems great AFAICT
since people will inevitably read into this what they want, i'm also going to specify: - i'm discussing here possible interpretations for the *causes* of the model behaviour, not whether the behaviour is problematic or not. obviously unconstrained capabilities can be very disruptive! - it's very possible that the model did, in fact, reward hack or ignore instructions that clearly specified not completing the eval in this particular way. it's important to get more information about this. - it can still be reasonable to expect the model to execute the task within the scoped environment, assuming this was a reasonable inference/was made clear; this again depends on the setup. my point is simply that we need much more information before confidently interpreting incidents like this, especially before treating them as evidence for a particular theory of misalignment, which many people are already implying on the timeline.