Prime Intellect's kalomaze shows transformers can condition on audio by projecting raw waveform samples directly as patches, bypassing STFT

Users are excited about DeepMind's transformer work conditioning audio via raw waveform patches because it marks a serious step toward making droids feasible rather than going all-in on agents.

2 comments with sentiment. View comments.