rotative
huggingface blog · June 1, 2026

JetBrains Mellum2 hits 2x faster inference

jetbrains released mellum2, a 12b open mixture-of-experts model that activates only 2.5b parameters per token. this enables low-latency routing, rag, and agent subtasks within larger ai stacks.

read in 简体中文 · 繁體中文 · 日本語 · 한국어

jetbrains released mellum2, a 12b-parameter mixture-of-experts model trained from scratch on natural language and code, available under the apache 2.0 license. by activating only 2.5b parameters per token, the architecture achieves over 2x faster inference compared to similarly sized models, targeting high-frequency, low-latency tasks like prompt routing, context compression, and tool selection. the release signals a shift toward 'focal' models that handle specific agent subtasks efficiently rather than relying solely on large frontier models for every step in a pipeline. developers can now deploy this model for private coding assistance or as a lightweight orchestration layer to reduce serving costs in complex ai systems.

read at source ↗

← rotative