ALTER founder David Manheim says claims that AI can write unbreakable software through formal verification remain unproven

@davidmanheim @teortaxesTex @davidad @AmmannNora This is the kind of thing that I definitely expect to hear about loudly if it does become possible. There's strong incentives to be loud about it.

@davidmanheim @teortaxesTex @TheZvi @davidad IMO models are clearly getting very good at using formal methods tools -- but there's still important missing steps indeed. E.g. we don't always have the formal semantics against which it would be (most) meaningful to verify given properties; and..

@davidmanheim @teortaxesTex @TheZvi @davidad developing the specs you'd want to verify is bottlenecked on human expert time.