Author: vLLM Team
License: Apache 2.0
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Can't find the visual you need? Build your own here
Downloads over time
Top versions
Downloads by Python version over time
Top contributors
Downloads by system over time
Related packages
Downloads by country
File types by installer
Package | Downloads | Stars |
---|---|---|
Package | Downloads 5.1M | Stars 9.6K |
Package | Downloads 3.3M | Stars 7K |
Package | Downloads 1.5M | Stars 2.1K |
Package | Downloads 1M | Stars 46 |
Package | Downloads 702K | Stars 12K |
Package | Downloads 418K | Stars 0 |
Package | Downloads 239K | Stars 6.6K |
Package | Downloads 229K | Stars 66 |
Package | Downloads 222K | Stars 9.6K |