Runway's Praxis-1 controls robots with video AI
runway releases open-source praxis-1, a robot model that uses video training to control robots, with promising results in tests. this could change robotics by reducing need for expensive datasets.
runway has released its robot model praxis-1 with open weights and source code under apache 2.0 license. praxis-1 is trained on videos and robot data, processing camera images, text instructions, and position data to calculate matching robot movements. it achieved a 46.2 percent success rate on nvidia's robilab-120 leaderboard, ranking fifth overall and first among world action models. praxis-1 also outperformed flux 3 action in tests on a real franka robot arm, succeeding 88 times out of 100 attempts. this release could change robotics by reducing the need for expensive robot-specific datasets.