Overview of the proposed ReWeight framework.
Overview of the proposed ReWeight framework.
RoboTwin 2.0 — VLA Post-Training: ReWeight selectively retrieves and weights egocentric human demonstrations for post-training, consistently outperforming both Robot-Only training and Mixed Data (Random) human-robot data mixing across eight simulation tasks. The results show that relevant and fine-grained weighted human experience is more effective than indiscriminately adding human demonstrations.
Below are videos of Robot-Only, Mixed Data (Random), and ReWeight (Ours) on real-world manipulation tasks. (Videos are sped up by 2x.)
Real-world evaluation across four physical robot manipulation tasks. The task-level and average success rates show that ReWeight (Ours), which selectively retrieves and weights human demonstrations, consistently outperforms Robot-Only and Mixed Data (Random).
We further evaluate robustness under varying illumination and visual distractors, comparing Robot-Only, Mixed Data (Random), and ReWeight (Ours) under each setting.
| Tasks | Methods | Lighting | Distractors | Total |
|---|---|---|---|---|
| Stack Bowls | Robot-Only | 2/10 | 2/10 | 4/20 |
| Mixed Data (Random) | 4/10 | 2/10 | 6/20 | |
| ReWeight (Ours) | 7/10 | 5/10 | 12/20 | |
| Place Teddy in the Drawer | Robot-Only | 3/10 | 5/10 | 8/20 |
| Mixed Data (Random) | 6/10 | 4/10 | 10/20 | |
| ReWeight (Ours) | 5/10 | 5/10 | 10/20 | |
| Place Fruits Basket | Robot-Only | 5/10 | 4/10 | 9/20 |
| Mixed Data (Random) | 5/10 | 7/10 | 12/20 | |
| ReWeight (Ours) | 7/10 | 9/10 | 16/20 | |
| Press Stapler | Robot-Only | 2/10 | 0/10 | 2/20 |
| Mixed Data (Random) | 3/10 | 2/10 | 5/20 | |
| ReWeight (Ours) | 5/10 | 5/10 | 10/20 |