Verifiability Boosts Trust And Delight In AI Analytics And Coding Tools
The easier something is to verify, the more delightful it is to use. For example, with coding agents, the ones that show you videos in screenshots, like Cursor and Devin, are really delightful because it takes away much of the verifiability burden from the human.
I think there are ways to make other products or tools more verifiable.
Hamel Husain@HamelHusainIf you can’t eval a thing easily it’s a product smell What you need from an analytics AI is proof that the number can be trusted. This means verifying quantities used against trusted reports, dashboards, prior analysis, etc to ensure numbers are consistent to both earn trust and help with verifiability Data analysis should ideally be put into a notebook to allow folks to verify (and edit) the work in-situ to reduce friction This is all stuff a good data scientist would do behind the scenes before producing any number! Which is why it’s important to involve domain experts when automating a thing with AI It’s frustrating whenever I see “Business analyst AI” that is presented to the user as something that can one-shot business questions. It represents a fundamental misunderstanding of what data analysis is.