Banger paper from Tencent on environment evolution. Environment supply is becoming the main limit on agent RL. So this is worth a read. (bookmark it) Agent RL needs a steady supply of environments hard enough to teach something new. Recent methods build them from the weaknesses an agent shows during its own rollouts. That approach has two problems. The environments inherit the agent's blind spots, so they generalize poorly. And as the agent improves it exposes fewer weaknesses to build…