vLLM

36Following96Top Followers39.0KTotal Followers

BIO

A high-throughput and memory-efficient inference and serving engine for LLMs. Join http://slack.vllm.ai to discuss together with the community!

@vllm_project

Top followers

#23

Sasha Rush

@srush_nlp

Researcher at Cursor https://www.youtube.com/@srush_nlp

#30

Jim Fan

@DrJimFan

NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.