vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

8.9 Our editorial score, no user reviews yet Open source

Our verdict

A solid, actively developed project. This assessment is derived from GitHub's own repository metrics on 2026-08-24, not from hands-on testing.

A high-throughput and memory-efficient inference and serving engine for LLMs. The project is written primarily in Python, released under Apache-2.0, and has 89,894 stars and 21,123 forks on GitHub. 3,275 contributors have committed to it, and the most recent push was 2026-08-24. The latest tagged release is v0.27.1 (2026-08-11). Figures come from the GitHub API on 2026-08-24 and are refreshed daily; the score below weighs adoption, maintenance, release discipline, contributor breadth, licence clarity and issue hygiene.

RepositoryGitHub API, refreshed daily

89.9kStars

21.1kForks

600Watching

3.3kContributors

7kOpen issues

Licence: Apache-2.0
Language: Python
Last push: 2026-08-24

View on GitHub

Releases

v0.27.1 2026-08-11 v0.27.1
v0.27.0 2026-08-10 v0.27.0
v0.26.0 2026-07-27 v0.26.0
v0.25.1 2026-07-14 v0.25.1
v0.25.0 2026-07-11 v0.25.0
v0.24.0 2026-06-29 v0.24.0

Pros and cons

Pros

Cons

User reviews

No user reviews yet.

Be the first to review vLLM

vLLM alternatives

Transformers 🤗 Transformers: the model-definition framework for state-of-the-art machine learning… 9.4 Ultralytics Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation,… 9.1 Context7 Context7 Platform — Up-to-date code documentation for LLMs and… 9 MoneyPrinterTurbo Generate HD short videos from a topic or keyword… 9 AutoGPT AutoGPT is the vision of accessible AI for everyone,… 8.8 DeerFlow An open-source long-horizon SuperAgent harness that researches, codes, and… 8.7

Side by side

Tool	Our score	From	Free tier
vLLM this page	8.9	—	Yes
Transformers	9.4	—	Yes
Ultralytics	9.1	—	Yes
Context7	9	—	Yes
MoneyPrinterTurbo	9	—	Yes
AutoGPT	8.8	—	Yes
DeerFlow	8.7	—	Yes

LLM Infrastructure Model Training Open source