RWKV-7 G1g is here: the world's best pure RNN LLM, and a competitive LLM in general. Try https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2 for bsz16 7B inference. G1h in June 🙂 p.s. const 15000+tps decoding on single 5090: https://github.com/BlinkDL/Albatross