Report
Video-Index released as an 840-item benchmark for video understanding
The researchers say they screened 505,518 question-answer pairs from 112 benchmarks to build an audited pool.
TLDR
The Video-Index researchers say they audited 115 video benchmarks for shortcuts, then screened 505,518 question-answer pairs from 112 of them. They released 840 items from 76 sources across four capability groups. On 35 benchmarks, they report, attackers that never saw a frame approached full-video accuracy.
Combined views
39
1 Source, first seen ago
