/AI6h ago

ESMC Preprint Updates OpenFold3 Results After MSA Bugfix

--0--
Original postAnshul Kundaje#1650
Zeming Lin@ebetica

ESMC paper patch notes (June 4, 2026) are up: - major bugfix found for OpenFold3 results - minor bugfixes in protein ligand evaluations - one more BLI plot - misc typos

Roshan Rao@proteinrosh

Our paper on ESMC, ESMFold2, and mechanistic interpretability for proteins is up on @biorxivpreprint!

We've made a few changes since the initial version went online last week.

1. We found an issue in the way we provided MSAs to OpenFold3. This led us to report lower performance of OpenFold3 on some benchmarks. This issue does not affect any of the other models evaluated.

2. We updated how we report results on Runs N' Poses to more closely match the original paper (counting only ligands with valid SuCOS similarity score). We also add a bar plot to the supplement that stratifies performance by similarity. This mostly changes the absolute values of the pass rate, not the relative performance of models.

3. Added some more BLI data to the supplement.

4. Added some missing citations, fixed typos, etc.

Check out the preprint here: https://www.biorxiv.org/content/10.64898/2026.06.03.729735v1

3:37 PM · Jun 4, 2026 · 2.7K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
-
Views
-
Comments
-
Reposts
-
Bookmarks
Expand data
Posts from X
Most Activity
Most Activity
RETWEETS6
Roshan Rao@proteinrosh

Our paper on ESMC, ESMFold2, and mechanistic interpretability for proteins is up on @biorxivpreprint!

We've made a few changes since the initial version went online last week.

1. We found an issue in the way we provided MSAs to OpenFold3. This led us to report lower performance of OpenFold3 on some benchmarks. This issue does not affect any of the other models evaluated.

2. We updated how we report results on Runs N' Poses to more closely match the original paper (counting only ligands with valid SuCOS similarity score). We also add a bar plot to the supplement that stratifies performance by similarity. This mostly changes the absolute values of the pass rate, not the relative performance of models.

3. Added some more BLI data to the supplement.

4. Added some missing citations, fixed typos, etc.

Check out the preprint here: https://www.biorxiv.org/content/10.64898/2026.06.03.729735v1

7hViews 6.6KLikes 95Bookmarks 37