프랑스 스타트업 ZML, Nvidia 종속을 끝낼 무료 추론 서버 출시
zml은 amd, google, apple, intel 칩을 지원하는 무료 추론 서버 llmd를 출시하여 벤더 종속에 도전하고 ai 비용을 줄이고자 합니다.
zml released llmd, a free inference server designed to optimize open-source large language models across a diverse range of hardware, including amd, google tpu, apple metal, and intel arc. founded by steeve morin and backed by yann lecun, the french startup targets the inefficiency of vendor lock-in, allowing companies to maximize chip performance and reduce soaring ai inference costs. although free initially, the proprietary software competes with established players like baseten and projects like vllm by offering broad hardware compatibility and co-design capabilities with silicon manufacturers.