Contact Gap Survey: Physical AI for Dexterous Manipulation
By Chandrakant Bothe, Parag Chourasia
Proposes ERPO (Environment-Regularized Policy Optimization), which replaces action-side Policy-KL with a query-side Query-KL term bounding distribution shift over training prompts, breaking the stability-exploration trade-off in LLM RL.