AIIs 500 tokens per second per user the new slow for AI?
A post argues that AI speed can trump intelligence in some domains once the intelligence is good enough.
TLDR
A post makes the case that speed improves AI products and, in some domains, can matter more than intelligence once it is good enough. It asks whether 500 tokens per second per user is “the new slow.”
Combined views
7K
1 Source, first seen 12h ago
51 likes
Is 500 tokens per second per user the new slow for AI?
A post argues that AI speed can trump intelligence in some domains once the intelligence is good enough.
TLDR
A post makes the case that speed improves AI products and, in some domains, can matter more than intelligence once it is good enough. It asks whether 500 tokens per second per user is “the new slow.”