runway的praxis-1用视频ai控制机器人
runway发布开源praxis-1,一种使用视频训练控制机器人的模型,在测试中表现出色。这可能会通过减少对昂贵数据集的需求来改变机器人技术。
runway has released its robot model praxis-1 with open weights and source code under apache 2.0 license. praxis-1 is trained on videos and robot data, processing camera images, text instructions, and position data to calculate matching robot movements. it achieved a 46.2 percent success rate on nvidia's robilab-120 leaderboard, ranking fifth overall and first among world action models. praxis-1 also outperformed flux 3 action in tests on a real franka robot arm, succeeding 88 times out of 100 attempts. this release could change robotics by reducing the need for expensive robot-specific datasets.