Merge upstream/main into vLLM-HUST#88
Merged
Merged
Conversation
…oject#46820) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
…#46753) Signed-off-by: Nick Hill <nickhill123@gmail.com>
…llm-project#46854) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com> Co-authored-by: Roger Wang <hey@rogerw.io>
…hat builds FA3 with torch stable API. (vllm-project#46644)
…tliers (vllm-project#46658) Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: chengvjiang <chengvjiang@tencent.com> Co-authored-by: chengvjiang <chengvjiang@tencent.com> Co-authored-by: youkaichao <youkaichao@gmail.com>
…ect#46409) Signed-off-by: Divakar Verma <divakar.verma@amd.com>
…#44551) Signed-off-by: jwzheng96 <jianweizheng@pku.edu.cn> Signed-off-by: JianweiZheng <32029023+jwzheng96@users.noreply.github.com> Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com> Signed-off-by: walterbm <walter.beller.morales@gmail.com> Co-authored-by: JianweiZheng <32029023+jwzheng96@users.noreply.github.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: walterbm <walter.beller.morales@gmail.com> Co-authored-by: Walter Beller-Morales <walterbm@users.noreply.github.com> Co-authored-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
… E2E Throughput improvement. (vllm-project#46862) Signed-off-by: yewentao256 <zhyanwentao@126.com>
…ct#46891) Signed-off-by: pei.zhang <pei.zhang@amd.com> Co-authored-by: Claude <noreply@anthropic.com>
…project#46905) Signed-off-by: Codex <codex@example.invalid> Co-authored-by: Codex <codex@example.invalid>
…nd implemented moe-backend selection (vllm-project#46184) Signed-off-by: Hongxia Yang <hongxia.yang@amd.com> Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: TJian <tunjian.tan@embeddedllm.com> Co-authored-by: Andreas Karatzas <akaratza@amd.com> Co-authored-by: Tan Pin Siang <tanpinsiang@gmail.com>
Signed-off-by: Fangzhou-Ai <fangzhouai@gmail.com> Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com> Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
…tale weight/scale interleave) (vllm-project#46915) Signed-off-by: wentian-byte <2990624738@qq.com>
…ject#46927) Signed-off-by: yewentao256 <zhyanwentao@126.com>
…roject#46818) Signed-off-by: shaojinjie.sjj <shaojinjiesjj@gmail.com> Co-authored-by: shaojinjie.sjj <shaojinjiesjj@gmail.com>
…oject#46782) Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
…for now (vllm-project#46928) Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: <> Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
…m-project#46886) Signed-off-by: Andreas Karatzas <akaratza@amd.com> Signed-off-by: Codex <codex@example.invalid> Co-authored-by: Codex <codex@example.invalid>
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn> Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn> Co-authored-by: Roger Wang <hey@rogerw.io>
…vllm-project#46974) Signed-off-by: Nick Hill <nickhill123@gmail.com>
…after function name (vllm-project#47311) Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Adam Baranowski <adam.baranowski@poolside.ai>
…t#47483) Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
…ate (vllm-project#47485) Signed-off-by: mgoin <mgoin64@gmail.com> Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
…g window (vllm-project#47217) Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com> Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
…er (vllm-project#44682) Co-authored-by: Bugen Zhao <i@bugenzhao.com> Signed-off-by: Ting Sun <suntcrick@gmail.com> Signed-off-by: Bugen Zhao <i@bugenzhao.com>
…OS (vllm-project#47289) Signed-off-by: reidliu41 <reid201711@gmail.com>
…oject#47405) Signed-off-by: zengxian <xiangdong.zeng@intel.com>
…mitive-level profiling (vllm-project#47467) Signed-off-by: Evgeny Parshutin <eugeny.parshutin@intel.com>
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Signed-off-by: Chris Leonard <chleonar@redhat.com>
…llm-project#46684) Co-authored-by: Bugen Zhao <i@bugenzhao.com> Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Merge upstream/main into the HUST fork so the local commit graph contains upstream commits directly instead of relying on continued cherry-pick/backport syncs. Preserve HUST local changes for Ascend host compatibility, Knorm routing, plugin pooling, KV cache scheduling, and shutdown behavior while resolving upstream conflicts. Co-authored-by: OpenAI Codex <codex@openai.com>
Anchor the HUST package version to the current upstream/main commit and derive the development distance from HUST-only commits. Co-authored-by: OpenAI Codex <codex@openai.com>
Member
Author
|
Version metadata update pushed.
|
Ascend Benchmark Result
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Merge upstream/main into the HUST vLLM fork so this fork's commit graph directly contains upstream commits, instead of continuing to rely only on cherry-pick/backport sync batches.
This resolution preserves HUST-local behavior around Ascend host compatibility, Knorm environment/configuration, plugin pooling/offline encode support, routing headers, engine shutdown handling, KV cache management, and selected worker/attention merge points.
Duplicate-work check
AI-assisted duplicate check was performed before opening this PR. Existing open sync PRs include #75, #82, and #87, but those are partial cherry-pick/batch syncs. This PR is materially different because it performs a direct merge of upstream/main into the fork branch so upstream commits become ancestors in the fork graph. No existing open PR was found for head branch sync/upstream-main-20260703.
Commands run:
gh pr list --repo vLLM-HUST/vllm-hust --state open --search "upstream sync main" --json number,title,headRefName,baseRefName,isDraft,url gh pr list --repo vLLM-HUST/vllm-hust --state open --head sync/upstream-main-20260703 --json number,title,url,baseRefName,isDraftValidation
Also ran a container import smoke with the paired vllm-ascend-hust upstream-merge checkout on PYTHONPATH; it loaded vllm and vllm_ascend from /workspace/upstream-sync-20260703 and imported the vLLM CLI successfully.
NPU generation smoke was not run because the host-managed service was active on NPU4-7, while the test constraint for this work was to use only NPU1. The service was not stopped or restarted.
AI assistance
AI assistance was used to resolve conflicts, run local validation, and prepare this PR. The human submitter should review every changed line and run the relevant full CI/NPU tests before merging.