Google Cloud and Inferact partner to expand TPU support in vLLM
Inferact says the collaboration’s output will be open source, with a community program offering contributors shared TPU capacity and help from its core vLLM maintainers.
TLDR
Inferact announced a partnership with Google Cloud to make TPU a first-class platform in vLLM, an engine for serving AI models. The shared roadmap includes production-serving features, optimized kernels and a native PyTorch path through TorchTPU. The teams are working toward day-zero support for frontier model releases. Inferact also announced a community program offering open-source contributors shared TPU capacity, plus review and design help from its core vLLM maintainers. It says everything the collaboration produces will be open source.
Combined views
80.6K
1 Source, first seen 16d ago