/Tech6h ago

Technologist Questions Steps Saved Metric And Data Scaling Assumptions In AI

3403710.6K
Original post
Susan Zhang@suchenzang

i guess i'm questioning two things:

% steps saved as a good metric (doesn't control for fixed amount of data)

and whether there's meaningful problems to tackle where data can't be scaled (if so, should either scale data or reconsider if its a good gradient descent problem to tackle with a compute advantage)

1:00 PM · Apr 28, 2026 · 6.5K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
Posts from X
Most Activity
Most Activity
RETWEETS1
Susan Zhang@suchenzang

@tkukurin @QuanquanGu there's also an implicit confounder above wrt time, since training time != training steps

43dViews 4.1KLikes 10Bookmarks 2