vLLM is an inference and serving engine for large language models (LLMs). Prior to 0.22.0, an assert-based security check in vLLMs activation function loading allows any unauthenticated attacker to achieve arbitrary code execution on the server by publishing a malicious HuggingFace model, when vLLM runs in Python optimized mode (python -O or PYTHONOPTIMIZE=1). This vulnerability is fixed in 0.22.0.
The product constructs all or part of a code segment using externally-influenced input from an upstream component, but it does not neutralize or incorrectly neutralizes special elements that could modify the syntax or behavior of the intended code segment.
| Name | Vendor | Start Version | End Version |
|---|---|---|---|
| Vllm | Vllm | * | 0.22.0 (excluding) |
| Red Hat AI Inference Server 3.2 | RedHat | rhaiis/vllm-cuda-rhel9:1782951012 | * |
| Red Hat AI Inference Server 3.2 | RedHat | rhaiis/vllm-rocm-rhel9:1782951244 | * |
| Red Hat AI Inference Server 3.2 | RedHat | rhaiis/vllm-cuda-rhel9:1787860580 | * |
| Red Hat AI Inference Server 3.2 | RedHat | rhaiis/vllm-rocm-rhel9:1787884873 | * |
| Red Hat AI Inference Server 3.3 | RedHat | rhaiis/vllm-cuda-rhel9:1787161382 | * |
| Red Hat AI Inference Server 3.3 | RedHat | rhaiis/vllm-rocm-rhel9:1787161803 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cpu-rhel9:1787151769 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-spyre-rhel9:1787151840 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cuda-rhel9:1787151771 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-rocm-rhel9:1787151774 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-spyre-rhel9:1789681201 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cpu-rhel9:1789681128 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cuda-rhel9:1789681126 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-rocm-rhel9:1789681126 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cpu-rhel9:1790075793 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-spyre-rhel9:1790076141 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-cuda-rhel9:1790090131 | * |
| Red Hat AI Inference Server 3.4 | RedHat | rhaii/vllm-rocm-rhel9:1790109620 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/disk-image-cuda-rhel9:1788290314 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-aws-cuda-rhel9:1788273908 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-azure-cuda-rhel9:1788273909 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-azure-rocm-rhel9:1788273908 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-cuda-rhel9:1788260684 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-gcp-cuda-rhel9:1788273977 | * |
| Red Hat Enterprise Linux AI 3.3 | RedHat | rhelai3/bootc-rocm-rhel9:1788260620 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/disk-image-cuda-rhel9:1787310717 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-aws-cuda-rhel9:1787253912 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-azure-cuda-rhel9:1787253989 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-azure-rocm-rhel9:1787254059 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-cuda-rhel9:1787243961 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-gcp-cuda-rhel9:1787253774 | * |
| Red Hat Enterprise Linux AI 3.4 | RedHat | rhelai3/bootc-rocm-rhel9:1787244006 | * |