Popular repositories Loading

1. exllamav2 exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 4.2k 313

2. exui exui Public

   Web UI for ExLlamaV2

   JavaScript 495 47

3. exllamav3 exllamav3 Public

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python 371 27