法國初創公司 ZML 發布免費推理伺服器以打破 Nvidia 鎖定
zml 發布了 llmd，一款支援 amd、google、apple 和 intel 晶片的免費推理伺服器，旨在挑戰供應商鎖定並降低 ai 成本。
zml released llmd, a free inference server designed to optimize open-source large language models across a diverse range of hardware, including amd, google tpu, apple metal, and intel arc. founded by steeve morin and backed by yann lecun, the french startup targets the inefficiency of vendor lock-in, allowing companies to maximize chip performance and reduce soaring ai inference costs. although free initially, the proprietary software competes with established players like baseten and projects like vllm by offering broad hardware compatibility and co-design capabilities with silicon manufacturers.