Reaction
A minimalist PPO pitch: PufferLib, maybe RNNs, and no asymmetric actor-critic setup
A user argues that PufferLib PPO is all you need and calls for a maximum of 1 million parameters.
TLDR
A user says PPO is all you need, then specifies PufferLib PPO in a reply. They reject asymmetric actor-critic setups, tentatively suggest RNNs, and call for a maximum of 1 million parameters.
Combined views
3.9K
2 Sources, first seen ago
likes