It's one thing to see peak inference tok/s on @ArtificialAnlys
It's a completely different thing to have this sustained across real world usage.
@OpenRouter is the best place to see this rn, and... at least for now, @CoreWeave / @wandb is the fastest GLM you can get 👀⚡
Users express pride in Weights & Biases staying top 5 on AA because it leads OpenRouter GLM throughput at 92 tokens per second.
No Digg Deeper questions have been answered for this story yet.
We're still pretty much in the top 5 on AA btw 🔥
It's one thing to see peak inference tok/s on @ArtificialAnlys
It's a completely different thing to have this sustained across real world usage.
@OpenRouter is the best place to see this rn, and... at least for now, @CoreWeave / @wandb is the fastest GLM you can get 👀⚡