Google DeepMind's Cristian Garcia proposes adapting Leela Chess Zero's distributed training for LLMs, but consumer GPU RAM limits models over 7B

wondering if leela chess-style distributed training could be suitible for OSS LLM post training

leela had a lot of impact in the chess world (until stockfish adopted neural nets by distilling leela)

is there anything like this yet?