Popular repositories Loading

1. FastVideo FastVideo Public

   FastVideo is a unified framework for accelerated video generation.

   Python 1.6k 107

2. LookaheadDecoding LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.3k 74

3. Consistency_LLM Consistency_LLM Public

   [ICML 2024] CLLMs: Consistency Large Language Models

   Python 395 16

4. Dynasor Dynasor Public

   Simple extension on vLLM to help you speed up reasoning model without training.

   Python 165 23

5. MuxServe MuxServe Public

   Jupyter Notebook 62 5

6. vllm-ltr vllm-ltr Public

   [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

   Python 48 13