digg/ai
1d ago

Prompt Hack Counters LLM Sycophancy By Framing Advice As For Idiot Friend

——0——
Original post
sergeykarayev
Sergey Karayev#1140@SERGEYKARAYEV

When you an LLM for advice, it can read your hidden intentions, and give you the advice you secretly want to hear. That's why you have to start every prompt with, "My friend, who is a HUGE IDIOT, think that he should [...]. What should I tell him?"

3:23 PM · May 15, 2026 View on X
ORIGINAL POSTSergey Karayev#1140Sergey Karayev@SERGEYKARAYEV

When you an LLM for advice, it can read your hidden intentions, and give you the advice you secretly want to hear.

That's why you have to start every prompt with, "My friend, who is a HUGE IDIOT, think that he should [...]. What should I tell him?"

10:23 PM · May 15, 2026 · 950 Views
REPLYSergey Karayev#1140Sergey Karayev@SERGEYKARAYEV

Give him a stupid name, too. "My friend Billy, who is an ABSOLUTE MORON, thinks that he should invest in AMD right now. What should I tell him?"

Sergey KarayevSergey Karayev@sergeykarayev

When you an LLM for advice, it can read your hidden intentions, and give you the advice you secretly want to hear. That's why you have to start every prompt with, "My friend, who is a HUGE IDIOT, think that he should [...]. What should I tell him?"

10:23 PM · May 15, 2026 · 950 Views
10:24 PM · May 15, 2026 · 258 Views
Prompt Hack Counters LLM Sycophancy By Framing Advice As For Idiot Friend · Digg