[Core] Offload CUDA graph + NCCL communicator memory in sleep mode#45623

aoshen02 wants to merge 1 commit into

vllm-project:mainvllm-project/vllm:mainfrom

aoshen02:offload-cudagraph-nccl-mainaoshen02/vllm:offload-cudagraph-nccl-mainCopy head branch name to clipboard