Deploy private LLMs in seconds with HF's new vLLM one-liner
hugging face released `hf jobs run`, letting developers deploy private, openai-compatible vllm servers instantly on its infrastructure, changing how fast teams can test and eval custom models.
hugging face released a native command to deploy vllm servers on its infrastructure, allowing users to spin up private, openai-compatible llm endpoints instantly. by running `hf jobs run` with the official vllm-openai image and hardware flags like `--flavor a10g-large`, developers can serve models such as qwen3-4b behind a gated, token-protected public url. the solution uses vllm's high-performance inference engine and is billed per-second (e.g., $1.50/hour for a10g-large), targeting use cases like model evals, batch generation, and testing where managed endpoints are overkill. this democratizes access to high-performance inference for developers who lack the gpu capacity or devops bandwidth to host models themselves.