ExplainerOne Score Is All You Get: GRPO From Scratch, With a Lava-Hopping Robot
GRPO replaces PPO's learned value critic with a group-relative baseline—sampling G runs per prompt and normalizing rewards by the group's mean and standard deviation—eliminating a second model of comp…