This is related to the fact that scale-config needs to be in the repo when ALI is steup at repo level. PRs: https://github.com/pytorch/pytorch/pull/127538 https://github.com/pytorch/pytorch-canary/pull/217 https://github.com/pytorch/test-infra/pull/5281