Popular repositories Loading

1. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

2. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   C++

3. vllm-nv-st vllm-nv-st Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. deepspark deepspark Public

   Forked from brandonmmusic-max/deepspark

   DeepSeek-V4-Flash + DSpark speculative decoding on the b12x vLLM fork (SM120 / RTX PRO 6000 Blackwell): full llm_decode_bench results, launch config, 300W power constraints, and caveats (incl. why …

   Python

5. vllm-dsv4-sm120 vllm-dsv4-sm120 Public

   Forked from qu0b/vllm-dsv4-sm120

   Run DeepSeek-V4-Flash on vLLM v0.23.0 on SM120 (RTX PRO 6000 / Blackwell, cc 12.0) — SM120 sparse-MLA forward-port of lucifer1004's work onto stock vLLM. ~120-133 tok/s, 1M context, MTP-2, tool-cal…

   Python