• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Generic GPU clusters versus DeepSeek's inference prices

    The user points to a large SSD storage cluster as one design detail: caching could fall back to disk, which they say could let cached tokens last 24-plus hours.

    DA
    1 Source, 17d ago, first seen 17d ago

    TLDR

    A user says every GPU cluster they've found has a fairly generic setup, which they suspect reflects a desire to support many workloads without overspecializing. They argue this prevents others from matching DeepSeek's inference prices—the cost of running AI models—and say they'll need to build their own cluster. In a reply, they describe using a large SSD storage cluster so caching can fall back to disk, potentially allowing cached tokens to last 24-plus hours.

    Combined views

    10.8K

    1 Source, first seen 17d ago

    Combined views

    10.8K

    1 Source, first seen 17d ago

    267 likes
    267 likes
    15 comments
    12 saves
    1 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    15 comments
    12 saves
    1 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @thdxrone specific detail is providing a large ssd storage cluster. this allows for caching to fall back to disk which means cache tokens could last for 24+ hours

    1 Source

    @thdxrone specific detail is providing a large ssd storage cluster. this allows for caching to fall back to disk which means cache tokens could last for 24+ hours