Skip to content

[graph_trainer] Chunked CE loss doesn't work in graph trainer #3117

@yiming0416

Description

@yiming0416

Chunked CE loss was landed in #2937 and turned on by default. However, graph trainer hit tracing issues (https://github.com/pytorch/torchtitan/actions/runs/25014595498/job/73258965789).

We disabled chunked CE loss in graph trainer in #3115, but it should be supported and turned on.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions