vLLM - Read the Docs Community

Navigation

Signed in as: AnonymousUser

Settings Log out

Help

Support Docs Getting started Status

Sign up

Log in

vLLM project

vLLM

EN

Related projects

vLLM - Production Stack

vLLM - Production Stack

production-stack

Repository

https://github.com/vllm-project/production-stack.git

Documentation

English

vLLM - LLM Compressor

vLLM - LLM Compressor

vllm-llm-compressor

Repository

https://github.com/vllm-project/llm-compressor.git

Documentation

English

vllm-omni project

vllm-omni project

vllm-omni

vllm-omni

Repository

vllm-project/vllm-omni

Documentation

English

vllm-gaudi project

vllm-gaudi project

vllm-gaudi

vllm-gaudi

Repository

vllm-project/vllm-gaudi

Documentation

English

vLLM - Recipes project

vLLM - Recipes project

vLLM - Recipes

vllm-recipes

Repository

vllm-project/recipes

Documentation

English

vLLM - GuideLLM

vLLM - GuideLLM

vllm-guidellm

Repository

https://github.com/vllm-project/guidellm

Documentation

English

vLLM - Speculators

vLLM - Speculators

vllm-speculators

Repository

https://github.com/vllm-project/speculators

Documentation

English

vLLM - TPU Inference

vLLM - TPU Inference

vllm-tpu-inference

Repository

https://github.com/vllm-project/tpu-inference.git

Documentation

English

vllm-ascend project

vllm-ascend project

vllm-ascend

vllm-ascend

Repository

vllm-project/vllm-ascend

Documentation

English

vllm-ascend-cn project

vllm-ascend-cn project

vllm-ascend-cn

vllm-ascend-cn

Repository

vllm-project/vllm-ascend

Documentation

Simplified Chinese

vllm-spyre

vllm-spyre

Repository

https://github.com/vllm-project/vllm-spyre

Documentation

English

vllm-project-metal project

vllm-project-metal

vllm-project-metal project

vllm-project-metal

vllm-project-metal

Repository

vllm-project/vllm-metal

Documentation

English

vime project

vime project

vime

vime

Repository

vllm-project/vime

Documentation

English

Maintainers

Repository

vllm-project/vllm

Versions 69 Builds 180880

Version v0.8.2 / Builds / #27623708

Started

Duration

Tag v0.8.2


                      
                        (9c5c81b0daa6fd86e5d7b3f1465a6261e6d3cd54)

Output Raw log Debug

Wrap output

There was an error with this build

Loading

Stay updated

Blog Newsletter Status

Learn more

Documentation Getting started guide Configure your project

Services

Pricing Features Advertise with Us Privacy Policy Terms of Service

About us

Company Team Contributing

Tools

Sphinx MkDocs Jupyter Book

Version

2026.06.09

Language

English

Catalan

català

English

English

Spanish

español

Brazilian Portuguese

Português Brasileiro

Norwegian Bokmal

norsk (bokmål)

French

français

Russian

Русский

German

Deutsch

Galician

galego

Vietnamese

Tiếng Việt

Simplified Chinese

简体中文

Traditional Chinese

繁體中文

Japanese

日本語

Ukrainian

Українська

Italian

italiano

Korean

한국어

Copyright 2026, Read the Docs, Inc & contributors

Sponsored by

Cloud Computing