Training an autoregressive model to mimic Monte Carlo tree search

One commenter asks if an autoregressive model could mimic Monte Carlo tree search by training on traces of its nodes. A reply says yes, but calls the approach “super inefficient,” comparing it to teaching a language model arithmetic when it could call a tool. The first commenter thinks chain-of-thought does something similar and agrees the efficiency is “horrible.”