Bytedance、Kimi K3を超えるべく10Tパラメータのモデルを訓練中
Bytedanceは10兆パラメータのモデルを訓練しており、MoonshotのKimi K3をはるかに凌駕する規模で、米中AI軍拡競争における激しい新たな最前線を示唆している。
bytedance is pretraining a massive ai model with up to 10 trillion parameters, according to financial times sources, which would triple the capacity of china's current largest model, moonshot's kimi k3. the project utilizes a 2,000-person team called seed, with founder zhang yiming explicitly setting a goal for world-leading model capabilities over the long term. insiders claim the company has avoided distillation for over a year to ensure higher training quality and originality. this initiative places bytedance in direct competition with top us labs like anthropic and xai, which are reportedly developing models of similar scale on massive gpu clusters.