Skip to content

Pull requests: pytorch/torchtune

New pull request New
89 Open 1,629 Closed
89 Open 1,629 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Enable loss parallel, Ungate FP8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2782 opened Jun 3, 2025 by nathan-az Loading…
1 of 13 tasks
1
Ungate FP8 + TP CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2781 opened Jun 3, 2025 by nathan-az Loading…
3 of 13 tasks
1
Full lora recipy simplification CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2780 opened Jun 2, 2025 by Andrei-Aksionov • Draft
1
Fix typing in _grad_scaler.py for nightly compatibility CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2778 opened Jun 2, 2025 by nathan-az Loading…
2 of 13 tasks
4
[NOT FOR REVIEW] Full knowledge distillation recipe TP + FP8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2767 opened May 28, 2025 by krammnic • Draft
13 tasks
2
[VERY WIP] DSV3 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2764 opened May 27, 2025 by SalmanMohammadi • Draft
1 of 7 tasks
2
Add LRScheduler.state_dict() to checkpoints CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2762 opened May 23, 2025 by omkar-334 Loading…
2 of 13 tasks
1
4
[WIP][DEBUG] llama4 debugging CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2756 opened May 21, 2025 by IvanKobzarev Loading…
2
[llama4] use grouped_mm in moe for sm90 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2755 opened May 21, 2025 by IvanKobzarev Loading…
22
Add async checkpointing for KD distributed and lora dpo distributed CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2754 opened May 21, 2025 by ankitageorge Loading…
1 of 8 tasks
1
Fixing counting number of batches for accumulation through epoch CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2745 opened May 17, 2025 by wesbz Loading…
7 of 13 tasks
4
Add feature ligerceloss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2741 opened May 16, 2025 by mananchawla2005 Loading…
7 of 9 tasks
1
41
validate checkpoint is consistent with meta_to_tune flag CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
#2736 opened May 15, 2025 by lijia19 Loading…
6
[WIP][Don't Review] Ray updates CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2724 opened May 12, 2025 by pbontrager • Draft
13 tasks
1
[WIP] HuggingFaceModelTokenizer CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2723 opened May 12, 2025 by krammnic Loading…
2 of 13 tasks
28
Log config only on rank zero at torchtune/recipes/full_finetune_distributed.py CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2711 opened May 9, 2025 by kabir2505 Loading…
7 tasks
11
[not to land] Tiny Llama4 debug model, activation offloading repro CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2708 opened May 8, 2025 by ebsmothers • Draft
2
Fix compile optimizer when using an LR scheduler CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2681 opened May 7, 2025 by intervitens Loading…
4 of 13 tasks
5
Enable async checkpointing for distributed recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2660 opened May 2, 2025 by ankitageorge Loading…
8 tasks
1
WIP-DEBUG-PROFILE torch.compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2644 opened Apr 28, 2025 by IvanKobzarev Loading…
2
[DO NOT REVIEW] Handle duplicates in activations offloading CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2628 opened Apr 22, 2025 by janeyx99 • Draft
13 tasks
1
BIG DPO [Add FP8 support, 2D parallelism, async checkpointing] CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2621 opened Apr 21, 2025 by joecummings • Draft
13 tasks
1
🐛 [Multi-node Full Fine Tuning Example] Fix file path references and disable fused optimizer
#2575 opened Apr 10, 2025 by brianlechthaler Loading…
3
Eval chat template CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2574 opened Apr 9, 2025 by krammnic Loading…
2 of 13 tasks
3
[WIP - do not review] packing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2548 opened Apr 2, 2025 by felipemello1 • Draft
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.