Anecdote: An industry lab engineer is using LLMs to formally verify concurrency code faster than writing traditional test suites

@kirancodes the wild part isn't speed, it's that tests sample interleavings while a proof covers them. concurrency is exactly where "passed the tests" was always a polite lie. the model didn't get faster, it changed what counts as evidence

i wasn’t able to make it to this sadly but yeah in the past *two weeks* i’ve conducted a formally verified development of … every idea i ever had in my three years as one of mina’s founding architects, using all the stuff i learned working on sel4/l4v: http://github.com/emberian/dregg

these models are insanely powerful.

@kirancodes not sure faster is the right thing to celebrate for concurrency though race conditions are timing-dependent and i've seen code pass formal checks then still blow up under real load. did the engineer say anything about the false negative rate or was the win purely on throughput?

@kirancodes If the substrate is correctly stated, strictly typed and proved, the tests... are... the substrate.