法国初创公司 ZML 发布免费推理服务器以打破 Nvidia 锁定
zml 发布了 llmd，一款支持 amd、google、apple 和 intel 芯片的免费推理服务器，旨在挑战供应商锁定并降低 ai 成本。
zml released llmd, a free inference server designed to optimize open-source large language models across a diverse range of hardware, including amd, google tpu, apple metal, and intel arc. founded by steeve morin and backed by yann lecun, the french startup targets the inefficiency of vendor lock-in, allowing companies to maximize chip performance and reduce soaring ai inference costs. although free initially, the proprietary software competes with established players like baseten and projects like vllm by offering broad hardware compatibility and co-design capabilities with silicon manufacturers.