Jiajun Zhou Thomas

New sampling method stabilizes low-precision RL for LLMs

Researchers have developed Adaptive Importance Sampling (AIS) to address the training instability caused by using low-precision rollouts in reinforcement learning for large language models. This technique dynamically ad…