Skip to content

@vectorch-ai Vectorch

Change the repository type filter

All

    Repositories list

    14 repositories

    • whl

      Public
      repository to host python whl package.
      HTML
      •0•0•0•0•Updated Mar 2, 2025Mar 2, 2025

    • ScaleLLM

      Public
      A high-performance inference system for large language models, designed for production environments.
      performancegpumodelproductioncudaefficiencyinferencetransformerllamaspeculative
      C++
      •
      Apache License 2.0
      •32•418•33•8•Updated Mar 2, 2025Mar 2, 2025

    • 3FS

      Public
      A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
      C++
      •
      MIT License
      •599•0•0•0•Updated Feb 28, 2025Feb 28, 2025

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •236•0•0•0•Updated Feb 27, 2025Feb 27, 2025

    • FlashMLA

      Public
      C++
      •
      MIT License
      •754•0•0•0•Updated Feb 26, 2025Feb 26, 2025

    • vcpkg

      Public
      C++ Library Manager for Windows, Linux, and MacOS
      CMake
      •
      MIT License
      •6.7k•0•0•0•Updated Feb 24, 2025Feb 24, 2025

    • LLMBench

      Public
      A library for validating and benchmarking LLMs inference.
      Python
      •
      Apache License 2.0
      •1•4•1•0•Updated Jun 18, 2024Jun 18, 2024

    • discussions

      Public
      0•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • chatbot-ui

      Public
      An open source ChatGPT UI.
      TypeScript
      •
      MIT License
      •8.4k•0•0•0•Updated May 20, 2024May 20, 2024

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.5k•0•0•0•Updated Oct 15, 2023Oct 15, 2023

    • tokenizers

      Public
      💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
      Rust
      •
      Apache License 2.0
      •847•0•0•0•Updated Aug 4, 2023Aug 4, 2023

    • xformers

      Public
      Hackable and optimized Transformers building blocks, supporting a composable construction.
      Python
      •
      Other
      •648•0•0•0•Updated Aug 1, 2023Aug 1, 2023

    • FasterTransformer

      Public
      Transformer related optimization, including BERT, GPT
      C++
      •
      Apache License 2.0
      •900•0•0•0•Updated Jul 28, 2023Jul 28, 2023

    • ByteTransformer

      Public
      optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
      C++
      •
      Apache License 2.0
      •39•0•0•0•Updated Jul 24, 2023Jul 24, 2023