Serving

Vllm

Definition

vLLM (Virtual Large Language Model) is an open-source library designed to accelerate LLM …