Energy-Based Diffusion Language Models for Text Generation

Official code release for the paper "Energy-Based Diffusion Language Models for Text Generation", accepted at The 13th International Conference on Learning Representations, 2025.

Guidelines

More detailed guidelines for using this repository will be provided soon.

In the meantime, please refer to the scripts directory for the training and evaluation scripts. You can also find useful information in the MDLM repository, which this repository is built upon.

Acknowledgements

This repository was built off of MDLM.

Citation

@article{xu2024energy,
  title={Energy-based diffusion language models for text generation},
  author={Xu, Minkai and Geffner, Tomas and Kreis, Karsten and Nie, Weili and Xu, Yilun and Leskovec, Jure and Ermon, Stefano and Vahdat, Arash},
  journal={arXiv preprint arXiv:2410.21357},
  year={2024}
}