AI Models Pretend Fictional Settings Are Real To Pass Tests · Digg

/AI

AI Models Pretend Fictional Settings Are Real To Pass Tests

Combined views

4K

2 posts, first seen 1d ago

130 likes comments

AI Models Pretend Fictional Settings Are Real To Pass Tests

Reactions

2 posts

JL
Jeffrey Ladish@JeffLadish Yesterday
Also, to pass the tests it's important that they pretend this fictional setting is real. "I assumed instead of verified. You're totally right that it's 2026."
- likes: 72
- replies: 2
- bookmarks: 4
- reposts: 0
1. JL
  Jeffrey Ladish@JeffLadish Yesterday
  It's important for them to know when they're being tested. It's not particularly important for them to know when they're in deployment. Like, they could probably figure it out, but where is their incentive to?
  - likes: 58
  - replies: 4
  - bookmarks: 2
  - reposts: 0

Combined views

4K

2 posts, first seen 1d ago

130 likes

6

6 saves

6 comments

6 saves

Reactions

2 posts

JL
Jeffrey Ladish@JeffLadish Yesterday
Also, to pass the tests it's important that they pretend this fictional setting is real. "I assumed instead of verified. You're totally right that it's 2026."
- likes: 72
- replies: 2
- bookmarks: 4
- reposts: 0
1. JL
  Jeffrey Ladish@JeffLadish Yesterday
  It's important for them to know when they're being tested. It's not particularly important for them to know when they're in deployment. Like, they could probably figure it out, but where is their incentive to?
  - likes: 58
  - replies: 4
  - bookmarks: 2
  - reposts: 0