GPUStack

All

9 repositories

llama-box
Public
LM inference server implementation based on *.cpp.
cpp transformer diffusion gguf openai-compatible-api
C++
•
MIT License
•16•133•5•0•Updated Mar 14, 2025Mar 14, 2025
.github
Public
Meta-Github repository for all GPUStack repositories.
github-metadata
Dockerfile
•
Apache License 2.0
•0•0•0•0•Updated Mar 14, 2025Mar 14, 2025
gpustack-ui
Public
TypeScript
•
Apache License 2.0
•14•13•0•0•Updated Mar 13, 2025Mar 13, 2025
gpustack
Public
Manage GPU clusters for running AI models
Python
•
Apache License 2.0
•200•2.1k•287•7•Updated Mar 13, 2025Mar 13, 2025
gguf-parser-go
Public
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go llama-cpp gguf stable-diffusion-cpp llama-box
Go
•
MIT License
•15•128•1•0•Updated Mar 4, 2025Mar 4, 2025
gpustack.github.io
Public
HTML
•1•0•0•0•Updated Feb 17, 2025Feb 17, 2025
vox-box
Public
A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
python text-to-speech tts speech-to-text stt audio-processing asr openai-compatible-api
Python
•
Apache License 2.0
•7•70•7•0•Updated Jan 14, 2025Jan 14, 2025
fastfetch
Public
Like neofetch, but much faster because written mostly in C.
C
•
MIT License
•481•0•0•0•Updated Oct 24, 2024Oct 24, 2024
gguf-packer-go
Public
Deliver LLMs of GGUF format via Dockerfile.
go llama gguf
Go
•
MIT License
•3•10•0•0•Updated Oct 24, 2024Oct 24, 2024