Announcement
Decision 2.0 is out for vLLM Semantic Router
The vLLM project says its open models range from 0.6B to 27B and answer 64 questions about a request in one forward pass.
TLDR
The vLLM project announced Decision 2.0 for vLLM Semantic Router. It says the open models range from 0.6B to 27B, answer 64 questions about a request in one forward pass, are Apache-2.0 licensed and load with Transformers.
Combined views
12.9K
2 Sources, first seen ago
likes