ViTeX-Bench debuts as a benchmark for editing text in videos

The creators of ViTeX-Bench say it evaluates video text edits for text correctness, consistency across frames and whether the rest of the scene stays unchanged. The release includes 13 metrics, evaluations of eight baseline models and an open-source reference model. They say their study found that models can preserve a scene yet fail to edit its text, or get the text right while introducing flicker.