微软发布决策模型,挑战TypeSafe的主导地位
微软发布了其决策模型microsoft-decision-1.1,广泛应用于azure,竞争typesafe的jev模型家族,后者主导了使用。
microsoft has released its decision model, microsoft-decision-1.1, for wide use on azure, immediately. this model is designed for fast and cheap decision-making in production environments, competing with typesafe's jev family of models. typesafe's jev has dominated usage, handling over 1.5 billion queries last week. decision models are a type of llm that don't produce output tokens but instead make quick decisions between preset options. microsoft's model is the result of carefully balancing cost, latency, intelligence, and calibration. startups like sqwish are also working on decision models, focusing on customization and post-training tools.