cuda-12.9
#6
by zhnagchenchne - opened
uv venv --python 3.12 --seed
source .venv/bin/activate
NVIDIA GPUs (CUDA)
uv pip install -U vllm --torch-backend=auto --extra-index-url https://wheels.vllm.ai/nightly
How to install vllm for CUDA 12.9?
Oh, the document states that the default setting is 12.9.