This repo includes codes for the paper PermuteFormer: Efficient Relative Position Encoding for Long Sequences. Directory long_range_arena is for experiments on the dataset Long-Range Arena. Directory language_model is for experiments on the dataset WikiText-103.
forked from cpcp1998/PermuteFormer
-
Notifications
You must be signed in to change notification settings - Fork 0
MariGaS/PermuteFormer
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Code for the paper PermuteFormer
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 99.1%
- Shell 0.9%