Popular repositories Loading

1. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from xlite-dev/Awesome-LLM-Inference

   📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

2. Awesome-Efficient-LLM Awesome-Efficient-LLM Public

   Forked from horseee/Awesome-Efficient-LLM

   A curated list for Efficient Large Language Models

   Python

3. OSBRtest OSBRtest Public

   Bud runtime is a very opinionated End to End compound AI lifecycle management platform. The platform is intended to be the foundational layer for any organisation irrespective of its size and skill…

4. Oidc.Server Oidc.Server Public

   Forked from Abblix/Oidc.Server

   Flexible OpenID Connect and OAuth 2.0 server-side implementation for modern ASP.NET projects

   C#

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python