Builder Shares Method To Scale AI Coding By Auditing Decisions
Reactions from ranked influencers
2 posts
I think I finally figured out how to use AI at scale of course, the fact Fable is good is part of it. but I also changed how I work, and it all comes down to one key realization: you don't need to audit the code, but you NEED to audit the *choices* it made. if you just do that, things will work out, and you'll never lose a codebase to chaos. with Fable at least, the following seems to hold: if I give it a good decision: Fable implements it PERFECTLY if I let it decide instead: Fable may make some bad choices that's how I see Fable: as a perfect execution machine capable of converting good decisions into good codebases, no matter how large. given a concrete plan, it lands its implementation. but when anything is underspecified, it can, and will, make bad choices. that's what you must audit. "while working on this, which choices did you make that you're not confident of? list all." then, you just review that. not the git diff, not 1000's of lines of code. just the choices it made along the way. below is a fresh example. overnight, I asked Fable to fix an issue related to MatMul parallelizing worse than expected. it tracked the culprit with perfection, and landed a solution that DID work. but the solution was not general. it just doubled a buffer, which coincidently fixed the program at hands, but the underlying issue was still present. when it completed the job, it declared success. if I just merged it blindly, the issue would still be dormant. that's the main mistake one can do with AI. instead, I asked it to spell out all decisions it made, spotted the bad one, corrected its course, and now the codebase is clean, correct and the issue is gone for good I really think that if you do that religiously - i.e., NEVER merge without this "which decisions you made?" audit - you can go VERY far without ever reading a single line of code. at least on Bend, this is working incredibly well. despite heavy use of AI to implement an ungodly amount of features I could never dream of, the codebase is still in a superb state, with no signs of degradation fresh example below ↓