vLLM
A high-throughput and memory-efficient inference and serving engine for LLMs
Add this badge to your site
Run or build vLLM? Paste this where your reviews or press logos go. It links to this review and always shows the current score and review date. Every tool we score 7.0 or higher can use it. It is free, and it does not change a score.
Need a launch video for vLLM? We make 45 to 90 second explainers from $79. See the explainer service
Our verdict
A solid, actively developed project. This assessment is derived from GitHub's own repository metrics on 2026-08-24, not from hands-on testing.
vLLM’s own description: “A high-throughput and memory-efficient inference and serving engine for LLMs.” It is built in Python. It has 96,717 stars and 3,275 contributors, and it was pushed to within the last few weeks. The Apache-2.0 licence puts no real constraint on commercial use. The most recent tagged release is v0.33.0rc3, from 2026-11-02. The open-issue backlog is large for the project’s size, at 7,014. Figures come from the GitHub API on 2026-11-11 and refresh weekly.
Reviewed by AI Review Rating from GitHub API data How we score
Repository
- Licence
- Apache-2.0
- Language
- Python
- Last push
- 2026-11-16
Releases
-
v0.33.0rc3v0.33.0 -
v0.32.0v0.32.0 -
v0.31.0v0.31.0 -
v0.30.0v0.30.0 -
v0.29.0v0.29.0 -
v0.28.0v0.28.0
Pros and cons
Pros
Cons
Pricing
| Tier | Monthly | Includes | Seats |
|---|---|---|---|
| Open source (Apache-2.0) | Free | Free to use; you pay only for your own GPU compute | 1 |
Trends
Price points are recorded when a price moves, not on a schedule, so a flat run means the price held. Release cadence comes from GitHub releases. A series appears only once we have watched it for long enough to have more than one observation.
Changelog
On video
What users actually say
- vLLM Production Stack or LLM-d Reddit · 2026
- Inside vLLM: Anatomy of a High-Throughput LLM Inference … Reddit · 2025
- Benchmarking Disaggregated Prefill/Decode in vLLM Serving with NIXL Reddit · N/A
- LLM Inference Benchmarking - genAI-perf and vLLM Reddit · 2026
- Run Pytorch, vLLM, and CUDA on CPU-only environments with remote GPU kernel execution Reddit · N/A
We link to discussions rather than reproducing them. Opinions belong to their authors.
User reviews
No one has reviewed vLLM here yet. Reviews are moderated before they appear, and our own score is editorial and separate from user ratings, though once reviews land they do lift it.
Used vLLM? Review it.
Sign in to rate it. One account, one review per tool, so the score means something.
Requiring an account is how we keep this page free of drive-by spam. We never sell your address.
vLLM alternatives
Side by side
Articles on vLLM
All articles
Best Open Source LLM Serving Stacks in 2026: Hugging Face Archived TGI and Named Its Replacements, and One Identical Model Bills $0.17 or $0.95 per Million Output Tokens Depending on Who Runs It
Hugging Face archived text-generation-inference, the stack Google still ranks fourth for this query, and its README now points at vLLM…
Self-Hosting an LLM in 2026: A Small Team Needs 675 Tokens a Second, Nonstop, Before a $244.80 GPU Beats a $0.14 API
A $244.80 a month RTX 4090 on Runpod Community Cloud only beats Together AI Llama 3 8B Instruct Lite above…
Open Source Alternatives to Paid AI Tools in 2026: $560.50 a Month Off a Small Team’s Bill, and the Three Licences That Decide If You Can
A small team on Zapier, Pinecone, Algolia, Datadog, 5 ChatGPT seats and ElevenLabs pays $560.50 a month, $6,726 a year,…
Questions
Is vLLM free?
Yes. vLLM is released under the Apache-2.0 licence (github.com/vllm-project/vllm, read 2026-11-06).
How much does vLLM cost?
The software is free; your cost is the GPU hardware or cloud compute you run it on. No paid vLLM plan is listed (read 2026-11-06).
Is vLLM open source?
Yes. vLLM is a public repository released under Apache-2.0. You can self-host or inspect the source directly.
How is vLLM scored here?
vLLM scores 7.5 out of 10. That comes from a desk review of public evidence, which is capped at 8.5 out of 10: public pricing, documentation, maintenance signals and how much we could actually verify. Affiliate relationships are excluded from scoring entirely. The full rubric is published on our methodology page.