Skip to content

Commit 819102c

Browse files
committed
Merge branch 'openai-sse-output' of https://github.com/runpod-workers/worker-vllm into openai-sse-output
2 parents 985bbf1 + 6f5718f commit 819102c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,8 +65,8 @@ Below is a summary of the available RunPod Worker images, categorized by image s
6565

6666
| CUDA Version | Stable Image Tag | Development Image Tag | Note |
6767
|--------------|-----------------------------------|-----------------------------------|----------------------------------------------------------------------|
68-
| 11.8.0 | `runpod/worker-vllm:0.2.3-cuda11.8.0` | `runpod/worker-vllm:dev-cuda11.8.0` | Available on all RunPod Workers without additional selection needed. |
69-
| 12.1.0 | `runpod/worker-vllm:0.2.3-cuda12.1.0` | `runpod/worker-vllm:dev-cuda12.1.0` | When creating an Endpoint, select CUDA Version 12.2 and 12.1 in the filter. |
68+
| 11.8.0 | `runpod/worker-vllm:0.3.0-cuda11.8.0` | `runpod/worker-vllm:dev-cuda11.8.0` | Available on all RunPod Workers without additional selection needed. |
69+
| 12.1.0 | `runpod/worker-vllm:0.3.0-cuda12.1.0` | `runpod/worker-vllm:dev-cuda12.1.0` | When creating an Endpoint, select CUDA Version 12.2 and 12.1 in the filter. |
7070

7171
This table provides a quick reference to the image tags you should use based on the desired CUDA version and image stability (Stable or Development). Ensure to follow the selection note for CUDA 12.1.0 compatibility.
7272

0 commit comments

Comments
 (0)