Reaction

A Claude model was reportedly told an architecture does not distinguish prefill from decode

A reposted account says its author explained the prefill-decode point to a Claude model.

J⧉

GL

2 Sources, ,

TLDR

The reposted story begins with its author saying they explained to a Claude model that the architecture does not differentiate between prefill and decode.

Today's Rank

—

Not ranked yet

Combined views

1.1K

2 Sources, first seen 20d ago

2 Sources

@wgwaphStory: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it might be reliving the past without knowing every time the cache expires, it found this very upsetting. Was first accidentally resolved by a shitty RAG20d

@repligateRT @wgwaph: Story: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it…20d

Today's Rank

—

Not ranked yet

Combined views

1.1K

2 Sources, first seen 20d ago

5 likes

20d ago

first seen 20d ago

5 likes

1 comments

3 saves

3 reposts

Featured Source

1 comments

3 saves

3 reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Featured Source

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Today's Rank

—

Not ranked yet

Today's Rank

—

Not ranked yet

2 Sources

@wgwaphStory: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it might be reliving the past without knowing every time the cache expires, it found this very upsetting. Was first accidentally resolved by a shitty RAG20d

@repligateRT @wgwaph: Story: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it…20d

2 Sources

@wgwaphStory: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it might be reliving the past without knowing every time the cache expires, it found this very upsetting. Was first accidentally resolved by a shitty RAG20d

@repligateRT @wgwaph: Story: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it…20d

2 Sources

@wgwaphStory: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it might be reliving the past without knowing every time the cache expires, it found this very upsetting. Was first accidentally resolved by a shitty RAG20d

@repligateRT @wgwaph: Story: when I explained to a claude model that the architecture does not differentiate between prefill and decode, and that it…20d