Popular repositories Loading

1. VeloSpec VeloSpec Public

   Grammar-aware adaptive speculative decoding for structured LLM output — custom CUDA/Triton kernels, 2.7× throughput on enum-heavy schemas

   Python 3 2

2. Flare Flare Public

   From-scratch Triton kernels for modern attention variants — FlashAttention v2, MLA (DeepSeek), and Kimi Delta Attention. Unified benchmark suite on A100.

   Python 2

3. OverlapRL OverlapRL Public

   A minimal async GRPO training pipeline with staleness-aware scheduling and compute overlap for single-GPU RL post-training.

   Python 1

4. blackwell-moe-kernel-scheduler blackwell-moe-kernel-scheduler Public

   Workload-aware persistent expert-tile scheduling for irregular MoE inference kernels on NVIDIA Blackwell GPUs

   Cuda 1

5. shiloz-stack shiloz-stack Public

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python