Pinned Loading

1. vllm-project/vllm-metal vllm-project/vllm-metal Public

   Community maintained hardware plugin for vLLM on Apple Silicon

   Python 1.8k 265

2. SiliconBench SiliconBench Public

   This repository includes code and materials for the paper "SiliconBench: Speed, Memory, and Fidelity for LLM Serving on Unified-Memory Desktops"

   HTML 7 1

3. vllm-project/speculators vllm-project/speculators Public

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python 852 232

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 92.6k 22.6k

5. whack-a-mole-local-llm whack-a-mole-local-llm Public

   Play whack-a-mole using local llm (vllm-metal or vllm dgx-spark)

   JavaScript

6. eBay/spec_dec eBay/spec_dec Public

   Python 19 1