whl

Kernel Library Wheel for SGLang

Installation

For Ampere and Hopper (CUDA 12.1, CUDA 12.4, CUDA 12.6, CUDA 12.8):

pip3 install sgl-kernel

For Blackwell (CUDA 12.8):

# use v0.2.1 as an example
pip3 install https://github.com/sgl-project/whl/releases/download/v0.2.1/sgl_kernel-0.2.1+cu128-cp39-abi3-manylinux2014_x86_64.whl

For Blackwell GB200 (CUDA 12.8):

# use v0.2.1 as an example
pip3 install https://github.com/sgl-project/whl/releases/download/v0.2.1/sgl_kernel-0.2.1+cu128-cp39-abi3-manylinux2014_aarch64.whl