Pinned Loading

1. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 8.1k 769

2. DeepLink-org/vllm-deepinfer DeepLink-org/vllm-deepinfer Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 2

3. router router Public

   Forked from caikun-pjlab/router

   A high-performance and light-weight router for vLLM large scale deployment

   Rust

4. caikun-pjlab/router caikun-pjlab/router Public

   Forked from vllm-project/router

   A high-performance and light-weight router for vLLM large scale deployment

   Rust 1