• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Report

    A challenge to assumptions about Chinese AI model prices and US company spending

    A post cites @ArtificialAnlys's finding that US models cost less per task at almost every intelligence level, though Chinese models might be cheaper per token.

    Séb KrierSK
    Martin Chorzempa 马永哲MC
    2 Sources, ,

    TLDR

    A post argues that two common AI cost assumptions are outdated. It cites @ArtificialAnlys for a finding that US models cost less per task at almost every intelligence level, even if Chinese models might cost less per token. Citing @arakharazian, it says US companies' AI use is rising while costs are leveling off, alongside better cost-capability choices and deals driven by competition between Anthropic and OpenAI.

    Combined views

    15.5K

    2 Sources, first seen 2h ago

    Combined views

    15.5K

    2 Sources, first seen 2h ago

    88 likes
    2h ago
    first seen 2h ago
    88 likes
    5 comments
    48 saves
    34 reposts
    5 comments
    48 saves
    34 reposts
    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    2 Sources

    Martin Chorzempa 马永哲@ChorzempaMartinTwo charts showing extremely important, widely held AI assumptions are outdated: Assumption 1: Chinese models are cheaper & more efficient. In fact, at almost every level of intelligence @ArtificialAnlys finds US models cheaper per task. Chinese models might be cheaper per token, but US models tend to be MORE efficient with tokens. Everyone seizes on papers from Chinese labs with architectural improvements for efficiency and assumes US labs are undisciplined. But ask yourself what OpenAI/Anthropic/Google have behind the scenes that would cut down on their #1 cost. And then add that they have more efficient chips. Should not be surprising that US labs can undercut! You can't undercut free, though, as anyone can download CN open weight models and use w/o paying the labs anything. BUT unless you have your own compute (few firms do), the days of firms running Chinese models for the cost of compute are numbered or over because Chinese AI labs are reportedly asking for 30% cut from cloud providers serving their models. This is likely main way these models are accessed, and the costs are going to be passed on. Assumption 2) US company spending on AI is spiraling out of control. @arakharazian finds that companies are getting better at picking the right cost/capabilities tradeoffs and getting better deals from competition between Anthropic and OpenAI. Use continues to rise, but at a cost that is leveling out. Controlling cost will put less pressure on firms to move to Chinese models, esp if they aren't cheaper anymore!2h
    Séb Krier@sebkrierRT @ChorzempaMartin: Two charts showing extremely important, widely held AI assumptions are outdated: Assumption 1: Chinese models are che…2h

    2 Sources

    Martin Chorzempa 马永哲@ChorzempaMartinTwo charts showing extremely important, widely held AI assumptions are outdated: Assumption 1: Chinese models are cheaper & more efficient. In fact, at almost every level of intelligence @ArtificialAnlys finds US models cheaper per task. Chinese models might be cheaper per token, but US models tend to be MORE efficient with tokens. Everyone seizes on papers from Chinese labs with architectural improvements for efficiency and assumes US labs are undisciplined. But ask yourself what OpenAI/Anthropic/Google have behind the scenes that would cut down on their #1 cost. And then add that they have more efficient chips. Should not be surprising that US labs can undercut! You can't undercut free, though, as anyone can download CN open weight models and use w/o paying the labs anything. BUT unless you have your own compute (few firms do), the days of firms running Chinese models for the cost of compute are numbered or over because Chinese AI labs are reportedly asking for 30% cut from cloud providers serving their models. This is likely main way these models are accessed, and the costs are going to be passed on. Assumption 2) US company spending on AI is spiraling out of control. @arakharazian finds that companies are getting better at picking the right cost/capabilities tradeoffs and getting better deals from competition between Anthropic and OpenAI. Use continues to rise, but at a cost that is leveling out. Controlling cost will put less pressure on firms to move to Chinese models, esp if they aren't cheaper anymore!2h
    Séb Krier@sebkrierRT @ChorzempaMartin: Two charts showing extremely important, widely held AI assumptions are outdated: Assumption 1: Chinese models are che…2h