Sasha Rush warns researchers may overinterpret single-sample token rollouts, while Periodic Labs' Rishabh Agarwal defends their memory benefits

@srush_nlp Single-sample as in a single sampled token per rollout (instead of topk logprobs)? My guess is that it's ease of implementation and lower memory requirements (e.g, Tinker only supports the single sample OPD version).