Reaction

Parameters described as quadratic

In a reply, a commenter asks whether the discussion is about parameters and says they’re quadratic.

NN

SB

2 Sources, 1h ago, first seen 1h ago

TLDR

A commenter asks whether others are talking about parameters, then says, “Those are quadratic.”

Today's Rank

—

Not ranked yet

Combined views

142

2 Sources, first seen 1h ago

1 comments

2 Sources

@NeelNanda5@BlancheMinerva @afg9000 @OrionJohnston We're talking about parameters, right? Those are quadratic1h

@BlancheMinerva@NeelNanda5 @OrionJohnston I guess it depends on where / how you think about adding the additional neurons. I was imagining adding a neuron as adding 2 d_model parameters. In some regimes that comes out quadratic but in others (e.g., adding an additional layer to the model) it doesn’t.1h

Today's Rank

—

Not ranked yet

Combined views

142

2 Sources, first seen 1h ago

1 comments

2 saves

Featured Source

NN Neel Nanda@NeelNanda5 6:00 PM · Oct 16, 2026
246TECH
@BlancheMinerva @afg9000 @OrionJohnston We're talking about parameters, right? Those are quadratic

2 saves

Sentiment

Positive——Negative

Summary

Not enough discussion yet.