Add release_kv_cache() API#44890

andakai wants to merge 1 commit into

vllm-project:mainvllm-project/vllm:mainfrom

andakai:release-kv-cache-2andakai/vllm:release-kv-cache-2Copy head branch name to clipboard