A post invokes “the slow death of scaling”

“On the slow death of scaling,” reads a brief comment accompanying a quoted post.

SH

AK

3 Sources, 39d ago, first seen 39d ago

TLDR

One post offers a terse, skeptical take on scaling, describing it with the phrase “On the slow death of scaling.”

Today's Rank

—

Not ranked yet

Combined views

489

3 Sources, first seen 39d ago

likes

3 Sources

@MLStreetTalkRT @sarahookr: On the slow death of scaling.39d

@BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃39d

@sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.38d

Today's Rank

—

Not ranked yet

Combined views

489

3 Sources, first seen 39d ago

2 likes

2

1 reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Today's Rank

—

Not ranked yet

Today's Rank

—

Not ranked yet

3 Sources

@MLStreetTalkRT @sarahookr: On the slow death of scaling.39d

@BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃39d

@sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.38d

3 Sources

@MLStreetTalkRT @sarahookr: On the slow death of scaling.39d

@BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃39d

@sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.38d

3 Sources

@MLStreetTalkRT @sarahookr: On the slow death of scaling.39d

@BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃39d

@sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.38d