GEPA Optimization Raises Molmo Prompt Performance on Microscopy Images
Researcher reports relative gain from 0.159 to 0.353 but absolute scores stay low.
TLDR
Lillyguisnet posted that a GEPA-optimized prompt for Molmo lifted performance from 0.159 to 0.353 on microscopy images, described as a 122% increase. Omar Khattab retweeted the observation. The original post noted that perfect agreement would reach 1.0 and that the scores remain far from usable. The author suggested the results may reflect a Molmo limitation with microscopy rather than a prompt issue.
Combined views
2.8K
2 Sources, first seen ago
Sources
LI 
lillyguisnet@lillyguisnetA Molmo prompt optimized by GEPA increased performance by 122%! Small caveat: The performance increased from 0.159 with the naive prompt to 0.353 with the optimized prompt... but perfect agreement would be 1.0!! We're still very far from a usable program here. Starting to…
- likes: 16
- replies: 1
- bookmarks: 3
- reposts: 5