vLLM
High-throughput inference server with PagedAttention
Linux + NVIDIA GPU primary; AMD ROCm + CPU also supportedApache 2.0
High-throughput inference server with PagedAttention
Editor-curated slugs that route to this platform’s coverage. Reader-voted tags live below.
Be the first to tag this page. A tag becomes publicly visible once it reaches the community vote threshold.
Loading edit history…
vLLM is the production-leaning local server — PagedAttention for memory efficiency, continuous batching for high throughput, OpenAI-compatible REST API. Common pairing with on-prem deployments serving a small team's chatbot or coding assistant.
Posts to your status feed
Pick the closest match below, edit the body, and post. Your report carries the #vllm tag automatically so it surfaces here + in the trending-tags rail.
All systems normal
No community reports inside the window.
No reports for vLLM in the last 2 hours. All clear.