微軟發布決策模型,挑戰TypeSafe的主導地位
微軟發布了其決策模型microsoft-decision-1.1,廣泛應用於azure,競爭typesafe的jev模型家族,後者主導了使用。
microsoft has released its decision model, microsoft-decision-1.1, for wide use on azure, immediately. this model is designed for fast and cheap decision-making in production environments, competing with typesafe's jev family of models. typesafe's jev has dominated usage, handling over 1.5 billion queries last week. decision models are a type of llm that don't produce output tokens but instead make quick decisions between preset options. microsoft's model is the result of carefully balancing cost, latency, intelligence, and calibration. startups like sqwish are also working on decision models, focusing on customization and post-training tools.