[Test only] Remove the model cache#725

QiliangCui wants to merge 2 commits intomainvllm-project/tpu-inference:mainfrom

cuiq-fix-ci-no-cachevllm-project/tpu-inference:cuiq-fix-ci-no-cacheCopy head branch name to clipboard