Skip to content

why not set same seed for all ranks? #1437

Answered by rwightman
Fei-Wang asked this question in Q&A
Discussion options

You must be logged in to vote

@Fei-Wang so that each rank augments data differently for train pipeline ... except where you need them to be the same (ie distributed sampler), where they use their own random gen...

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by Fei-Wang
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants