vLLM

vllm · Machine learning, LLMs and agents · tool

Also known as: vllm.

Part of: Model serving

The lesson for this

• Serving open-weight LLMs with vLLM and SGLang

Pathways that reach it

• MLOps / ML platform engineer