Skip to content

Make other optimizers available e.g. prodigy #191

Description

@jan-forest

Currently, we use AdamW as PyTorch optimizer. Users may benefit from usage of other optimizers. In particular, Prodigy https://github.com/konstmish/prodigy might be a good addition since it does not require learning rate optimization.

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions