transformers

Transformers

A sub-repository about Transformers, one the most powerful deep generative models in recent years since 2017, pushed forward to AIGC owing to the occurrence of LLMs

Table fo Contents

• Vanilla Transformers Some resources about the vanilla Transformer model used in NLP field
• Improved Transformers Some resources about the works to improve the structure of vanilla Transformer model
• ViT Some resources about the Vision in Transformers used in CV field
• Theory Some resources about the theory researchs on Transformers, especiall attention mechanism
• Survey Some resources about the surveys of Transformers
• LLMs The sub-repo to share the literature about Transformer-based Large Language Models (LLMs)