[KV Offload] Fix multi-node KV offloading state desynchronization and JAX dispatch…#2983

amitkumar307d wants to merge 2 commits into

vllm-project:mainvllm-project/tpu-inference:mainfrom

amitkumar307d:multinode-kv-offloadingamitkumar307d/tpu-inference:multinode-kv-offloadingCopy head branch name to clipboard