Skip to content

Commit d6a402a

Browse files
authored
[djl] patch release for 0.32.0 LMI DLC, update available_images.md (#4610)
1 parent d984c86 commit d6a402a

File tree

2 files changed

+5
-17
lines changed

2 files changed

+5
-17
lines changed

available_images.md

+1
Original file line numberDiff line numberDiff line change
@@ -192,6 +192,7 @@ Starting LMI V10 (0.28.0), we are changing the name from LMI DeepSpeed DLC to LM
192192

193193
| Framework | Job Type | Accelerator | Python Version Options | Example URL |
194194
|-----------------------------------------------------------------------------------------------------------------------------|-----------|-------------|------------------------|-------------------------------------------------------------------------------------------|
195+
| DJLServing 0.32.0 with LMI Dist 13.0.0, vLLM 0.7.1, HuggingFace Transformers 4.45.2, and HuggingFace Accelerate 1.0.1 | inference | GPU | 3.11 (py311) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.32.0-lmi14.0.0-cu126 |
195196
| DJLServing 0.31.0 with LMI Dist 13.0.0, vLLM 0.6.3.post1, HuggingFace Transformers 4.45.2, and HuggingFace Accelerate 1.0.1 | inference | GPU | 3.11 (py311) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.31.0-lmi13.0.0-cu124 |
196197
| DJLServing 0.30.0 with LMI Dist 12.0.0, vLLM 0.6.2, HuggingFace Transformers 4.45.2, and HuggingFace Accelerate 1.0.1 | inference | GPU | 3.10 (py310) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.30.0-lmi12.0.0-cu124 |
197198
| DJLServing 0.30.0 with TensorRT-LLM 0.12.0, HuggingFace Transformers 4.44.2, and HuggingFace Accelerate 0.33.0 | inference | GPU | 3.10 (py310) | 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.30.0-tensorrtllm0.12.0-cu125 |

release_images_inference.yml

+4-17
Original file line numberDiff line numberDiff line change
@@ -122,14 +122,14 @@ release_images:
122122
force_release: False
123123
10:
124124
framework: "djl"
125-
version: "0.29.0"
125+
version: "0.32.0"
126126
arch_type: "x86"
127127
inference:
128128
device_types: [ "gpu" ]
129-
python_versions: [ "py310" ]
129+
python_versions: [ "py312" ]
130130
os_version: "ubuntu22.04"
131-
lmi_version: "11.0.0"
132-
cuda_version: "cu124"
131+
lmi_version: "14.0.0"
132+
cuda_version: "cu126"
133133
example: False
134134
disable_sm_tag: True
135135
force_release: False
@@ -170,16 +170,3 @@ release_images:
170170
example: False
171171
disable_sm_tag: False
172172
force_release: False
173-
14:
174-
framework: "djl"
175-
version: "0.32.0"
176-
arch_type: "x86"
177-
inference:
178-
device_types: [ "gpu" ]
179-
python_versions: [ "py312" ]
180-
os_version: "ubuntu22.04"
181-
lmi_version: "14.0.0"
182-
cuda_version: "cu124"
183-
example: False
184-
disable_sm_tag: True
185-
force_release: False

0 commit comments

Comments
 (0)