v2.2-hf-tgi-3.0.1-pt-2.4.0-inf-gpu-py311
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
These images are built to be used only on AWS SageMaker
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:2.4.0-tgi3.0.1-gpu-py311-cu124-ubuntu22.04-v2.2
sha256:9f6007ca1658a46ed320985e7c8633890cda8d65fac12850a6b06d094ce7ce57
All tags:
2.4.0-tgi3.0.1-gpu-py311-cu124-ubuntu22.04-v2.2-2025-03-06-18-12-13
2.4-tgi3.0-gpu-py311-cu124-ubuntu22.04-v2
2.4-gpu-py311-cu124-ubuntu22.04-v2
2.4-tgi3.0-gpu-py311-cu124-ubuntu22.04
2.4.0-tgi3.0.1-gpu-py311-cu124-ubuntu22.04
2.4.0-tgi3.0.1-gpu-py311-cu124-ubuntu22.04-v2.2
2.4.0-gpu-py311-cu124-ubuntu22.04
Important Packages:
| pip packages | apt|deb packages |
|---|---|
| PyYAML==6.0.2 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| cffi==1.17.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| cloudpickle==3.1.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
| datasets==2.21.0 | |
| filelock==3.16.1 | |
| numpy==1.26.4 | |
| packaging==24.1 | |
| pandas==2.2.3 | |
| pillow==11.0.0 | |
| protobuf==4.25.5 | |
| py-cpuinfo==9.0.0 | |
| regex==2024.9.11 | |
| requests==2.32.3 | |
| scipy==1.13.1 | |
| sentencepiece==0.2.0 | |
| setuptools==75.2.0 | |
| tokenizers==0.20.3 | |
| torch==2.4.0 | |
| transformers==4.46.3 | |
| wrapt==1.16.0 |