Skip to content

Fix create_completion capping all batch prompts to the shortest context's max_tokens#3867

Open
Chessing234 wants to merge 1 commit into
lm-sys:mainfrom
Chessing234:fix/completion-max-tokens-shared-across-prompts
Open

Fix create_completion capping all batch prompts to the shortest context's max_tokens#3867
Chessing234 wants to merge 1 commit into
lm-sys:mainfrom
Chessing234:fix/completion-max-tokens-shared-across-prompts