LLMServe

Popular repositories Loading

1. DistServe DistServe Public

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook 838 99

2. SwiftTransformer SwiftTransformer Public

   High performance Transformer implementation in C++.

   C++ 162 20

3. dLoRA-artifact dLoRA-artifact Public

   Jupyter Notebook 32 8

4. FastServe FastServe Public

   Jupyter Notebook 31 5

5. hydraserve hydraserve Public

   Python 21 5

6. WarmServe WarmServe Public

   WarmServe is a multi-LLM serving system that prewarms models according to workload predictions.

   Python 5