• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Google Cloud and Inferact partner to expand TPU support in vLLM

    Inferact says all work from the collaboration will be open source. A new community program will give open-source contributors shared TPU capacity and review and design help from its core vLLM maintainers.

    SE
    WK
    2 Sources, ,

    TLDR

    Inferact announced a partnership with Google Cloud to make TPU a “first-class citizen” in vLLM, a model-serving engine. Inferact says the teams will share an engineering roadmap covering production serving features, optimized kernels and a native PyTorch path through TorchTPU. They aim to support frontier models on release day. The announcement also includes a community program offering shared TPU capacity to open-source contributors, plus review and design help from Inferact’s core vLLM maintainers. Inferact says everything the collaboration produces will be open source.

    Combined views

    1.4K

    2 Sources, first seen 16d ago

    Combined views

    1.4K

    2 Sources, first seen 16d ago

    29 reposts
    16d ago
    first seen 16d ago
    29 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    2 Sources

    @SemiAnalysis_RT @inferact: @googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project. This partne…
    @woosuk_kRT @inferact: @googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project. This partne…

    2 Sources

    @SemiAnalysis_RT @inferact: @googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project. This partne…
    @woosuk_kRT @inferact: @googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project. This partne…