Error while runing image_test.py

[jezabel-garcia]

Hi!
I was having a look at the test functions of the datasets module to try to create my own task & dataset, and I get an error while running image_test.py
ValueError: Dataset imagenet2012_16 with split train doesn't appear to be preprocessed? Please run dataset creation.

I have checked the ase.py but it is not clear to me how to run the dataset creation.
Thanks

[lukemetz]

Hello!

At the moment, the resized imagenet datasets (such as this dataset -- 16x16 imagenet) needs to be preprocessed.

The script to do this is currently written as a beam pipeline, though it is incomplete as it is missing the runner / job launcher, as well as docs to tell folks what to run it with and how. https://github.com/google/learned_optimization/blob/main/learned_optimization/tasks/datasets/beam/make_resized_image_beam.py

Sorry about this!

For now, I would recommend skipping this test by either commenting it out or using something like skipTest.

I will add to my todo list to auto skip the tests with difficult to generate data such as this.