hugging face 發布 olmo-core 3，用於可擴展的混合專家模型訓練

hugging face has released olmo-core 3, a major update to its framework for developing large language models. the new system features a redesigned open mixture-of-experts training infrastructure, allowing for scalable training into the trillion-parameter range. olmo-core 3 uses techniques such as expert parallelism, pipeline parallelism, and a distributed optimizer to distribute large models across gpu clusters efficiently. in benchmarks, the system showed a significant increase in throughput, processing 52,000 tokens per second per gpu. this upgrade aims to reduce the computational costs and energy use associated with training large ai models, making advanced model development more accessible to researchers and smaller labs.