Skip to content

Issues: pytorch/torchtune

Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
v0.7.0 tracker
#2538 opened Mar 30, 2025 by joecummings
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

276 Open 665 Closed
276 Open 665 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

v0.7.0 tracker
#2538 opened Mar 30, 2025 by joecummings
"Missing LoRA key from adapter state dict" when attempting to resume LoRA training from adapter checkpoint
#2537 opened Mar 30, 2025 by prvnsmpth
@felipemello1
5
Test tokenizer.decode()
#2529 opened Mar 26, 2025 by Darktex
2
How to separately load a local llama8B and a self-trained LoRA adapter during distillation?
#2520 opened Mar 21, 2025 by whale2133
1
Use foreach compilable scale/grad / clip_grad best practice Things we should be doing but aren't enhancement New feature or request
#2517 opened Mar 19, 2025 by IvanKobzarev
@IvanKobzarev
Add torch.compile to optimizer.step() best practice Things we should be doing but aren't enhancement New feature or request
#2516 opened Mar 19, 2025 by IvanKobzarev
1
Unnecessarily scaling gradients when gradient_accumulation_steps is 1 best practice Things we should be doing but aren't enhancement New feature or request
#2515 opened Mar 19, 2025 by shunting314
1
[Model] Support for Mistral Small 3.1
#2508 opened Mar 17, 2025 by maximegmd
2
Can we decouple the data preprocssing/tokenization step from the fine-tuning phase?
#2497 opened Mar 13, 2025 by Electronic-Waste
3
cross-attention in llama 3.2 vision has is_causal=False
#2493 opened Mar 13, 2025 by mmehdig
3
Consolidate tok_encode logic between _LLMEvalWrapper and _VLMEvalWrapper
#2488 opened Mar 12, 2025 by pbontrager
@joecummings
1
Gemma3
#2484 opened Mar 12, 2025 by krammnic
2
recursive_reshard best practice Things we should be doing but aren't bug Something isn't working
#2483 opened Mar 12, 2025 by caiqi
1
5
Add add_end_token to the Qwen Models bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2481 opened Mar 11, 2025 by pbontrager
1
Add add_end_token to Phi tokenizers bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2480 opened Mar 11, 2025 by pbontrager
Add add_end_token to Mistral tokenizer bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2479 opened Mar 11, 2025 by pbontrager
3
Add add_end_token to the Gemma Tokenizer bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2478 opened Mar 11, 2025 by pbontrager
MPS memory leak bug Something isn't working triage review This issue should be discussed in weekly review
#2473 opened Mar 10, 2025 by SalmanMohammadi
4
Option to clip logprobs rlhf.get_batch_log_probs
#2470 opened Mar 9, 2025 by krammnic
4
Chunked GRPO loss enhancement New feature or request
#2469 opened Mar 9, 2025 by SalmanMohammadi
@SalmanMohammadi
1
Chunked DPO loss enhancement New feature or request
#2468 opened Mar 9, 2025 by SalmanMohammadi
@SalmanMohammadi
3
Will support multi-turn conversations? enhancement New feature or request triage review This issue should be discussed in weekly review
#2463 opened Mar 6, 2025 by dz1iang
3
No chat template in evaluation community help wanted We would love the community's help completing this issue enhancement New feature or request
#2459 opened Mar 5, 2025 by xueyan-lii
3
Bring in DSV3 from torchtitan enhancement New feature or request
#2457 opened Mar 4, 2025 by EugenHotaj
3
[Question]: activation offload won't work for torch version < 2.5 discussion Start a discussion enhancement New feature or request
#2456 opened Mar 4, 2025 by Irvingwangjr
10
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.