Overview
Addresses reward design challenges in robotic manipulation via principled progress modeling.
Core Technique
General Reward Model:
# Hop-based progress: normalized by task span
progress = model.predict_progress(observation, task_span)
# Multi-view fusion
fused_progress = aggregate_views([view1, view2, view3])
# Policy-Invariant Reward Shaping
reward = outcome_reward + policy_invariant_shaping(fused_progress)
Performance
- 92.8% task completion accuracy
- 95% success within 150 interactions
- Theoretically grounded reward shaping
References
- Step-wise progress discretization
- Multi-view observation fusion
- Policy-Invariant Reward Shaping