/Tech3h ago

DiffusionGemma Generates Code At Over 1000 Tokens Per Second

425648.4K
Nate Keating
Brendan O'Donoghue#755
Sentiment
Sentiment building, check back later.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS150REPLIES1
loreii@loreii

@Nate_Keating Which HW?

2hViews 150
Nate Keating@Nate_Keating

@loreii H100. You can get this speed or faster on 1xH100, fp8, bsz=1

Let's see how fast it runs in a few weeks :)

2hViews 81