GPT-Live-1 (Astra, medium) reportedly averages 1.34 seconds to first audio on Big Bench Audio
ArtificialAnlys reports averages of 1.24 seconds for GPT-Live-1 (Sol, low) and 0.70 seconds for Grok Voice Think Fast 2.0 High on the same test. Sol ranks third in conversational preference, while Astra ranks fourth.
TLDR
ArtificialAnlys reports these average times to first audio on Big Bench Audio: GPT-Live-1 (Astra, medium), 1.34 seconds; GPT-Live-1 (Sol, low), 1.24; Grok Voice Think Fast 2.0 High, 0.70; and GPT-Realtime-2.1 High, 1.21.
For conversational preference, it reports Sol in third place at 1,053 Elo and Astra in fourth at 1,048, with task success rates of 90.9% and 87.4%, respectively. Sol has higher point estimates on both measures, but their confidence intervals overlap.
The reported leaders differ by measure: Gemini 3.1 Flash Live Minimal leads conversational preference at 1,096 Elo with 74.6% task success, while Grok Voice Think Fast 2.0 High leads task success at 94.6% with 1,011 Elo.
Combined views
1.2K
1 Source, first seen 16d ago