OpenSparseLLMs

All

4 repositories

Skip-DiT
Public
✈️ Accelerating Vision Diffusion Transformers with Skip Branches.
Python
•
Apache License 2.0
•0•57•0•0•Updated Dec 12, 2024Dec 12, 2024
LLaMA-MoE-v2
Public
🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
sparsity moe attention llama fine-tuning sft mixture-of-experts instruction-tuning llama3
Python
•
Apache License 2.0
•8•63•1•1•Updated Dec 3, 2024Dec 3, 2024
Open-Pandora
Public
Open-Pandora: On-the-fly Control Video Generation
video-controls video-generation
Python
•2•31•2•0•Updated Nov 28, 2024Nov 28, 2024
CLIP-MoE
Public
CLIP-MoE: Mixture of Experts for CLIP
moe clip mixture-of-experts openai-clip lvlm
Python
•0•23•0•0•Updated Oct 10, 2024Oct 10, 2024