-
Notifications
You must be signed in to change notification settings - Fork 8
Pull requests: pytorch-labs/tokenizers
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Add python sentencepiece tokenizer
CLA Signed
This label is managed by the Meta Open Source bot.
#88
opened Jun 26, 2025 by
jackzhxng
Loading…
Fix CQS signal performance-faster-string-find in fbcode/pytorch/tokenizers/src
CLA Signed
This label is managed by the Meta Open Source bot.
fb-exported
#86
opened Jun 25, 2025 by
facebook-github-bot
Loading…
Make pretokenizer optional in hf tokenizer
CLA Signed
This label is managed by the Meta Open Source bot.
Fix CQS signal. Id] 10393698 -- performance-faster-string-find in fbcode/pytorch/tokenizers/src
CLA Signed
This label is managed by the Meta Open Source bot.
fb-exported
#76
opened May 20, 2025 by
facebook-github-bot
Loading…
Fix CQS signal. Id] 10393698 -- performance-faster-string-find in fbcode/pytorch/tokenizers/src
CLA Signed
This label is managed by the Meta Open Source bot.
fb-exported
#44
opened Apr 14, 2025 by
facebook-github-bot
Loading…
Fix CQS signal. Id] 9250181 -- readability-redundant-string-init in fbcode/pytorch/tokenizers/src
CLA Signed
This label is managed by the Meta Open Source bot.
fb-exported
#43
opened Apr 10, 2025 by
facebook-github-bot
Loading…
ProTip!
Adding no:label will show everything without a label.