On Agentic Manipulation Policies
The authors present AMP1, a reference harness in which a generalist AI model commands the manipulator directly and adapts its actions as the task unfolds, running unchanged across single-arm, bimanual, and mobile manipulation. On the RoboLab-120 benchmark, AMP1 reaches an 85.6% success rate zero-shot with no demonstrations or task-specific training, compared to 49.2% and 42.9% for leading VLA and WAM policies. In real-world trials spanning twelve tasks and three robot instances, the agent succeeds zero-shot in 104 of 108 trials, reducing failure rates by 20x and 15x relative to strong VLA and WAM baselines. The basic harness supplies no grasping, pushing, or placing skills; the agent develops its own strategies, such as searching for hidden objects, using objects as tools, and calibrating its cameras. With the addition of a persistent memory store, an augmented harness lowers the failure rate on RoboDojo bimanual manipulation tasks by 4.6x relative to zero-shot deployment.
展开解读与证据
The authors present AMP1, a reference harness in which a generalist AI model commands the manipulator directly and adapts its actions as the task unfolds, running unchanged across single-arm, bimanual, and mobile manipulation. On the RoboLab-120 benchmark, AMP1 reaches an 85.6% success rate zero-shot with no demonstrations or task-specific training, compared to 49.2% and 42.9% for leading VLA and WAM policies. In real-world trials spanning twelve tasks and three robot instances, the agent succeeds zero-shot in 104 of 108 trials, reducing failure rates by 20x and 15x relative to strong VLA and WAM baselines. The basic harness supplies no grasping, pushing, or placing skills; the agent develops its own strategies, such as searching for hidden objects, using objects as tools, and calibrating its cameras. With the addition of a persistent memory store, an augmented harness lowers the failure rate on RoboDojo bimanual manipulation tasks by 4.6x relative to zero-shot deployment.
为什么值得关注
The analysis suggests that agentic manipulation policies are substantially more general and robust than specialist manipulation policies, providing a promising foundation for robot manipulation.
研究问题
Recent work on robot manipulation has focused on specialist policies trained on demonstrations, such as vision-language-action models (VLAs) and world-action models (WAMs).
方法原理
The authors present AMP1, a reference harness in which a generalist AI model commands the manipulator directly and adapts its actions as the task unfolds, running unchanged across single-arm, bimanual, and mobile manipulation.
结果与证据
On the RoboLab-120 benchmark, AMP1 reaches an 85.6% success rate zero-shot with no demonstrations or task-specific training, compared to 49.2% and 42.9% for leading VLA and WAM policies. In real-world trials spanning twelve tasks and three robot instances, the agent succeeds zero-shot in 104 of 108 trials, reducing failure rates by 20x and 15x relative to strong VLA and WAM baselines. The basic harness supplies no grasping, pushing, or placing skills; the agent develops its own strategies, such as searching for hidden objects, using objects as tools, and calibrating its cameras. With the addition of a persistent memory store, an augmented harness lowers the failure rate on RoboDojo bimanual manipulation tasks by 4.6x relative to zero-shot deployment.
阅读边界
依据本次返回的正文节选整理,未核验未返回的章节、附录或独立复现。
评论 · —
昵称自填。评论会展示给其他读者,请勿填写私人信息。
正在读取评论…