Starstruk Logo MarkStarstruk
vllm-project

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Starred 6 months ago
Python
Apache-2.0
vllm.ai
Created:02/09/2023
Updated:today at 3:37 AM
Last push:today at 3:45 AM
Topics (20)
amd
blackwell
cuda
deepseek
deepseek-v3
gpt
gpt-oss
inference
kimi
llama
llm
llm-serving

AI Analysis

Loading AI analysis...

Stats

Stars

Starred by users

91.4K

Forks

Repository forks

22.0K

Watchers

Watching this repo

91.4K

Issues & Pull Requests

Open Issues

Needs attention

7,787

Pull Requests

Open

~

Quick Browse

🌳Branches🏷️Tags🎯Milestones📦Releases

Repository

VisibilityPublic
CreatedFeb 9, 2023
Size~

Releases

0 releases totalView all