Daily
vllm
vllm-project
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 95k↑ +128⑂ 24k
- Rank
- #15
- On board
- 2 days · first seen 10-20
- Move
- Steady
Repository panorama
from public APIs, independent of our rankingsHealth
activity, response time, maintainers- Last push
- 3h ago
- Issue response
- 32h
- Contributors
- 57
- Release cadence
- v0.1.7
median over 100 closed
top: 920 commits
median 13d apart
Commit rhythmweekly commits, last 26 weeks
4493 in 13w, more than the 13 before
Ecosystem
who uses it, what it depends on- Dependent repos
- 8.9k
- npm downloads
- 14
- Depends on
- 0
plus 901 packages
vllm · last week
PyPI · 2 manifests
Community
Hacker News- vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention295 pts · 42 cm
- Nano-vLLM: How a vLLM-style inference engine works271 pts · 27 cm
- Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA205 pts · 18 cm
- Life of an inference request (vLLM V1): How LLMs are served efficiently at scale175 pts · 21 cm
- Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025)151 pts · 10 cm
Apache-2.0Pythongptllmpytorchmodel-servingtransformerllm-servinginferencellama