• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Astral Open Sources GPU Wheel Build Pipelines

    Astral addresses CUDA and PyTorch wheel distribution gaps by pre-building and indexing packages.

    LB
    FI
    CM
    17 Sources, 62d ago, first seen 62d ago

    TLDR

    Charlie Marsh of Astral detailed how CUDA and PyTorch wheels require expansive build matrices covering CPU architecture, Python, PyTorch, and CUDA versions. PyPI supports only one CUDA version per wheel, forcing workarounds such as separate indexes or GitHub hosting. Astral created consistent build pipelines that patch metadata to prevent version mismatches, pre-built wheels for packages including FlashAttention, DeepSpeed, vLLM, and causal_conv1d, and published them on standards-compliant indexes. The pipelines and wheels are now open sourced for community use.

    Combined views

    59.4K

    17 Sources, first seen 62d ago

    Combined views

    59.4K

    17 Sources, first seen 62d ago

    1.2K likes
    1.2K likes
    34 comments
    413 saves
    85 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source
    34 comments
    413 saves
    85 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    17 Sources

    @charliermarshAt Astral, we created pre-built wheels for popular GPU-enabled packages (like FlashAttention and DeepSpeed) and distributed them on standards-complaint Python indexes. Today we're open sourcing our build pipelines and making those wheels available to all.
    @finbarrtimbers@charliermarsh @josh_wills Bless you Charlie
    @xeophon@charliermarsh Yoooooooooo 🫪🫪🫪🫪🫪🫪🫪
    @giffmana@charliermarsh Amazing!
    @marktenenholtz@charliermarsh 🐐

    17 Sources

    @charliermarshAt Astral, we created pre-built wheels for popular GPU-enabled packages (like FlashAttention and DeepSpeed) and distributed them on standards-complaint Python indexes. Today we're open sourcing our build pipelines and making those wheels available to all.
    @finbarrtimbers@charliermarsh @josh_wills Bless you Charlie
    @xeophon@charliermarsh Yoooooooooo 🫪🫪🫪🫪🫪🫪🫪
    @giffmana@charliermarsh Amazing!
    @marktenenholtz@charliermarsh 🐐