[https://nvbugs/5658258][fix] Fix OOM with large number of LoRA adapters#12815

brb-nv merged 1 commit intoNVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

brb-nv:user/brb/many-lora-adaptersbrb-nv/TensorRT-LLM:user/brb/many-lora-adaptersCopy head branch name to clipboard