Announcement
Reinforcement learning is claimed to help AI models access knowledge learned during pretraining
Researchers behind an EMNLP oral paper say reinforcement learning helps models navigate their stored knowledge more effectively.
TLDR
The researchers say reinforcement learning helps models draw on knowledge gained during pretraining, including information that instruction-tuned models previously could not access.
Combined views
7.1K
3 Sources, first seen 2h ago
77 likes
