Finite automata as graphical models for exact constrained decoding in diffusion LLMs

Stefano Ermon says his student developed an approach that treats finite automata as graphical models to enable exact constrained decoding for diffusion LLMs. He credits it with big improvements on function calling and JevBench and says the work is set to appear at NeurIPS.