Skip to content

Fix multi-node KV offloading state desynchronization and JAX dispatch…#2983

Draft
amitkumar307d wants to merge 1 commit into
vllm-project:mainfrom
amitkumar307d:multinode-kv-offloading
Draft

Fix multi-node KV offloading state desynchronization and JAX dispatch…#2983
amitkumar307d wants to merge 1 commit into
vllm-project:mainfrom
amitkumar307d:multinode-kv-offloading

Commits