Preprint Shows ESM-2 And ESM-3 Capture Mostly The Same Protein Biology

NEW preprint: Sparse autoencoders were trained on ESM-2 (650M, seq-only) and ESM-3 (1.4B, multimodal) to ask a simple question -- when two protein language models look at the same protein, do they "see" the same biology? Answer: Yes, mostly