[IMPORTANT] The future of torchtune

[ebsmothers]

Dear Tune Community,

We started torchtune in late 2023 with the goal of increasing the accessibility of finetuning in a world where cloud GPUs were prohibitively expensive for many ML practitioners. Thanks to over 150 amazing contributors, today we have 21 recipes spanning the whole post-training stack from SFT to RLHF to QAT.

During this time the AI landscape has rapidly evolved, with ever-increasing scale, an emphasis on agents, and a reinforcement learning renaissance. We have heard your requests on these fronts loud and clear, and in line with our mission at PyTorch to democratize state-of-the-art AI, we are developing a new product - in a new repo - that captures this evolution of torchtune. The product will provide a simple native PyTorch solution for end-to-end post-training with scale as a first-class citizen, while bringing over what you loved from torchtune (hackable recipes, minimal abstraction, strong integrations across the ecosystem). This is an exciting opportunity and we expect to have more to share in the upcoming weeks.

As a result of this new strategy, we are stopping active development on torchtune, effective immediately. We remain committed to supporting our partners and the community to provide a smooth transition. Concretely, this means:

• Torchtune will continue to receive critical bug fixes and security patches during 2025
• Discord and Github issues will remain open for support
• No new features will be added to the library
• We would love to keep working with you to assist with a smooth transition and build this new solution together!

If you have any questions or concerns, please reach out on Discord or comment here. Thank you all for your support and all that you've done to build this LLM post-training community with us.

From all of us on the torchtune team,
@joecummings @ebsmothers @pbontrager @felipemello1 @RdoubleA @kartikayk @rohan-varma

Our heartfelt thanks to our many contributors, including
@SalmanMohammadi @krammnic @daniellepintz @andrewor14 @SLR722 @ankitageorge @svekars @NicolasHug @gokulavasan @janeyx99 @jerryzh168 @thomasjpfan @Ankur-singh @acisseJZhong @calvinpelletier @mirceamironenco @weifengpy @nathan-az @solitude-alive @songhappy @Optimox @RedTachyon @lindawangg @lucylq @hardikjshah @msaroufim @yechenzhi @mreso @IvanKobzarev @tcapelle @gau-nernst @tambulkar @bogdansalyp @albert-inflection

[init27]

Thanks team for all the monumental effort and the gift of Tune. Excited for what's next!

[iqiancheng]

👍 Excited to know what the next WIP project will be called?

[fuji2021]

Thanks for torchtune! What's the new repo called?

[felipemello1]

We hope to share the name in the coming weeks :)

[vadimkantorov]

For torchtune itself, are there any components that could be worthy of upstreaming to core pytorch or unify with torchtitan?

Maybe the generation loop? RoPE module? Checkpointer? OffloadActivations hook?