Patch-token heatmaps may not reliably explain vision transformers

A user describes a paper as showing that patch-token heatmaps used to explain vision transformers are not fixed properties of the models. The user says they can highlight an object, the background or nothing, depending on training data and sometimes the random seed, and calls for more critical explainability research.