snapshots and logs are too large

[kaiyiliu-strala]

Snapshots and logs are too large to upload to metal ci repo. We should compress them prior to upload.

[SamYuan1990]

are those log snapshots and logs are necessary, is there any parts we can ignore or just need for debug usage?
so that we can reduce the size of log and snapshots?

[rootfs]

per meeting 11/19: use github artifact to store the prometheus database snapshot, instead of merging to the repo. The artifact limit is 2GB

[SamYuan1990]

it seems folder with path docs/validation/* takes about 8MB for each day, and same for other path as daily-validation, etc. or as an estimate, we need 10MB for a single round of validation, we can have 200 sample keep on github artifact.
Took a month for 30 day, about 6 sample per day.

@rootfs, @KaiyiLiu1234, let's figure out a mapping, as
folder, github action file, and naming conventions on artifact to make this issue more specific.
and in which case, we need keep the result as a github commit and push back to the repo?

[SamYuan1990]

.github/workflows/equinix_metal_model_server_action_flow.yml
.github/workflows/equinix_metal_flow.yml
.github/workflows/validator_compose.yml
util/validation_regression_check.py

and markdown files may impact.