Jev’s claimed speed and cost gains in a tweet-classifying Chrome extension
The extension’s creator says Jev is 6× faster and about 40× cheaper on the classification task than the fastest/cheapest LLM they could find.
TLDR
To check whether their “For You” feed was overly focused on one topic, a developer added Jev to their tweet-classifying Chrome extension. They previously used Cerebras and the fastest LLMs they could find. On this task, they say Jev is 6× faster and about 40× cheaper than the fastest/cheapest LLM they found. They shared the project on GitHub for others to try.
Combined views
1.7K
1 Source, first seen ago