• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    AI lab economics: GPU margins, growth and R&D costs

    One post argues that AI labs’ margins from running software on GPUs should be assessed separately from R&D spending, then weighed against growth costs and competition.

    DA
    1 Source, 15d ago, first seen 15d ago

    TLDR

    A post proposes judging AI labs first on whether they can buy GPUs, run software and sell it profitably. It points to a reported 80% margin as worth examining on its own, then asks whether giving 20% to channel partners such as AWS and Google would be worth the extra capacity and demand. Separately, the author argues that raising money for faster R&D may be worthwhile in a competitive market. Open questions include whether training costs eventually plateau and how long margins remain defensible. Despite those uncertainties, the author sees a plausible path to making the economics work.

    Combined views

    25.1K

    1 Source, first seen 15d ago

    Combined views

    25.1K

    1 Source, first seen 15d ago

    368 likes
    368 likes
    27 comments
    92 saves
    13 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    27 comments
    92 saves
    13 reposts

    1 Source

    @thdxrhow you should look at ai lab economics: can you acquire GPUs and run some software on them and sell it at a profit? how much cheaper does it get at scale? how much can you charge while still growing rapidly? the number here (the reported 80%) is worth understanding in isolation then you can ask is it worth eating some of this margin to grow faster? if we give 20% to channel partners like aws and google is that worth the additional capacity and demand? now separately, there's the question of R&D you could simply take the profits from above and use that as your budget and break even but it's a very competitive space and it's probably worth raising money to go way faster than you naturally could do training costs go up infinitely forever? or does it plateau where additional dollars don't move the needle if that's the case then you have to see when the GPU (and associated products) business will catch up. can you make a reasonable projection of that? remaining questions are how long can you defend that margin? is the market big enough that there's always room for an iphone even though android wins on market share? maybe you can't defend 80% but maybe 60% is fine obviously a lot of questions to get right but given enough smart people working on it every day, it's not unreasonable to see it working out too many people so certain it doesn't without even understanding these basics

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @thdxrhow you should look at ai lab economics: can you acquire GPUs and run some software on them and sell it at a profit? how much cheaper does it get at scale? how much can you charge while still growing rapidly? the number here (the reported 80%) is worth understanding in isolation then you can ask is it worth eating some of this margin to grow faster? if we give 20% to channel partners like aws and google is that worth the additional capacity and demand? now separately, there's the question of R&D you could simply take the profits from above and use that as your budget and break even but it's a very competitive space and it's probably worth raising money to go way faster than you naturally could do training costs go up infinitely forever? or does it plateau where additional dollars don't move the needle if that's the case then you have to see when the GPU (and associated products) business will catch up. can you make a reasonable projection of that? remaining questions are how long can you defend that margin? is the market big enough that there's always room for an iphone even though android wins on market share? maybe you can't defend 80% but maybe 60% is fine obviously a lot of questions to get right but given enough smart people working on it every day, it's not unreasonable to see it working out too many people so certain it doesn't without even understanding these basics
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet