TinyCLIP, Inference with auto inheritance

[giginho83]

Hi, I'm testing some models from TinyCLIP, great work. I would like to know how can I make inference with models with auto inheritance using open clip format. Thanks in advance.

[wkcn]

Hi @giginho83 , thanks for your attention to our work!

You can refer to the evaluation script: https://github.com/microsoft/Cream/blob/main/TinyCLIP/docs/EVALUATION.md#for-auto-weight-inference-checkpoint

I may update the inference code for auto inheritance.

[wkcn]

Hi @giginho83 , I have uploaded the example for the inference with auto inheritance in PR #223 .

Before the code is merged into the main branch, you can try this repo: https://github.com/wkcn/Cream/tree/tinyclip_inference_auto_weight_inheritance/TinyCLIP

cd TinyCLIP
python3 inference.py

The model with auto inheritance TinyCLIP-auto-ViT-45M-32-Text-18M will be executed.

[giginho83]

Thank you very much for the support, it's working