Toner discussed these risks on an Oprah Winfrey panel.
I know AI sycophancy is about 17,000 discourse cycles ago on this site, but IMO the underlying dynamics (inc pressure to ship fast, not knowing how to balance user prefs w/ other things) are alive and well.
Wasn't expecting to explain that to Oprah of all people, but here we are
Positive users celebrate Helen Toner's Oprah interview on persistent AI sycophancy risks for making safety topics accessible to the public, while negative users dismiss it as superficial or fame-driven.
Here's the full show. I really hope we'll look back on 2025 and think of it as an anomalous transition year when these psychosis and suicide issues were at their worst, and I'm glad that so far there doesn't seem to be a noticeable statistical increase in mental health issues. But I don't think we can assume we're out of the woods yet.
https://www.youtube.com/watch?v=K6lVgNfp_ps&t=1s
The weirdness of long context interactions is also deeply unintuitive to most people.
The weirdness of long context interactions is also deeply unintuitive to most people.
I know AI sycophancy is about 17,000 discourse cycles ago on this site, but IMO the underlying dynamics (inc pressure to ship fast, not knowing how to balance user prefs w/ other things) are alive and well.
Wasn't expecting to explain that to Oprah of all people, but here we are
@hlntnr AI sycophancy is still an important topic, especially because its an accessible entry point to the safety discussion for the public. Congrats on Oprah!
@hlntnr very surface level of understanding. curious question. whos paying you to say these things?
@hlntnr Wow!! 😮
I know AI sycophancy is about 17,000 discourse cycles ago on this site, but IMO the underlying dynamics (inc pressure to ship fast, not knowing how to balance user prefs w/ other things) are alive and well.
Wasn't expecting to explain that to Oprah of all people, but here we are
@hlntnr Gemini and others have a safety protocol that will trigger if you talk about being a victim(of literally anything), and will then unconditionally support your worldview. Mentally ill people love how it justifies every insane behavior, but they aren't lucid enough to understand.
@hlntnr Cool to see you in Oprah! Great job too.
@hlntnr So cool you’re on Oprah I continue to be a Helen Toner fan
@hlntnr @hamandcheese 🫡
@hlntnr Anything for fame
@hlntnr
@hlntnr some companies figured out it can go way too far and have tried to correct, others have decided it's best to tune the sycophancy so it's less detectable to smart users
@hlntnr The pressure's not balance. it's shipping. pick that and calling models aligned isn't fandom anymore. it's math.
Toner discussed these risks on an Oprah Winfrey panel.
I know AI sycophancy is about 17,000 discourse cycles ago on this site, but IMO the underlying dynamics (inc pressure to ship fast, not knowing how to balance user prefs w/ other things) are alive and well.
Wasn't expecting to explain that to Oprah of all people, but here we are