runway的praxis-1用視頻ai控制機器人
runway發布開源praxis-1,一種使用視頻訓練控制機器人的模型,在測試中表現出色。這可能會通過減少對昂貴數據集的需求來改變機器人技術。
runway has released its robot model praxis-1 with open weights and source code under apache 2.0 license. praxis-1 is trained on videos and robot data, processing camera images, text instructions, and position data to calculate matching robot movements. it achieved a 46.2 percent success rate on nvidia's robilab-120 leaderboard, ranking fifth overall and first among world action models. praxis-1 also outperformed flux 3 action in tests on a real franka robot arm, succeeding 88 times out of 100 attempts. this release could change robotics by reducing the need for expensive robot-specific datasets.