hparams search/sweep - your ideas and "best practices".

[orilifs]

Hey :)

First, thank you Ross for this amazing repo.

Second, I'm curious as to what you (users of this repo) have found to be useful when doing hparams search using the TIMM repo please?

Now ofcourse this question is boradly stupid since there are so many different models in this repo that no one technique can work for them all, but at this point I do not want to narrow the discussion (if any such discussion will happen to begin with).

So I think a useful answer could be in the format of: "for <model_x> I found that <technique/paper/code/repo> works best"

thanks :)