Loading activity…
@mrtnm
MTS @Recursive_SI
AI
Tinker says async RL staleness and numerical mismatch can cause off-policy runs to suddenly collapse.
AI
A post introducing the method argues that each training step pulls the trainer toward the sampler, causing drift to accumulate.
