Skip to content

fix: prevent prefill starvation under high decode load#4532

Open
grimoire wants to merge 4 commits intoInternLM:mainfrom
grimoire:less-prefill-waiting
Open

fix: prevent prefill starvation under high decode load#4532
grimoire wants to merge 4 commits intoInternLM:mainfrom
grimoire:less-prefill-waiting

Commits

Commits on Apr 16, 2026