So far Fable continues to be humbled by my mother of all benchmarks: reimplement MS word's "simple markup" tracked changes in @every Proof Editor writing app without breaking collaboration. Not quite at ASI yet.
Seth Lazar says AI coding agent Fable fails his benchmark to replicate Microsoft Word's tracked changes in collaborative editors
Lazar says the failure shows models remain far from superintelligence.
Users dislike Fable AI's attempt to reimplement Word tracked changes in its proof editor because the feature leads to laggy and buggy collaboration like Google Docs and MS Word.
Most Activity
@sethlazar @every Unless it turns out that *is* actually necessary for RSI! You never know --- they might have nerfed that capability
So far Fable continues to be humbled by my mother of all benchmarks: reimplement MS word's "simple markup" tracked changes in @every Proof Editor writing app without breaking collaboration. Not quite at ASI yet.

I really hate tracked changes in google docs! And whenever I try to collaborate with someone on MS word it just gets so laggy and buggy (and also there's always a problem getting them access). But unfortunately even with ultra code on and a Mac Studio to play with, fable is flailing so far...

@sethlazar @every Please keep us updated with how you go with this!
Right now I'm using Roughdraft to approximate those sorts of tracked changes and also comments, and it's good, but I still haven't gotten the perfect solution that's just like say Google Docs or Word

@das_brat @every haha Typora is my go-to, some nice new features recently

@sethlazar @every Random Q: what's your favorite markdown editor? :) my office is still Office, but I'm going to commit soon.

@sethlazar @every I'll have a look! Thanks!