Skip to content

[Misc]feat: adapt to vLLM main (0d4d334e...46a95815) - #245

Draft
Meihan-chen wants to merge 36 commits into
nv-action:mainfrom
Meihan-chen:main2main_auto_2026-05-18_16-58
Draft

[Misc]feat: adapt to vLLM main (0d4d334e...46a95815)#245
Meihan-chen wants to merge 36 commits into
nv-action:mainfrom
Meihan-chen:main2main_auto_2026-05-18_16-58

Conversation

@Meihan-chen

@Meihan-chen Meihan-chen commented May 18, 2026

Copy link
Copy Markdown
Collaborator

Main2Main Summary

Status: completed
Upstream range: 0d4d334eaa583b9c09aa4eb7538c22db99fd84b3..46a95815d344e43ebd6b4757632c55d03e90983a
Reached upstream commit: 46a95815d344e43ebd6b4757632c55d03e90983a
Steps: 8/8
CI suite: e2e-singlecard-light

Result

The target upstream commit 46a95815d344e43ebd6b4757632c55d03e90983a was fully reached. All 8 planned steps were verified through CI, committed with signed commits, and the vLLM commit reference was updated at each step. One code adaptation was required (step-5: token_arange_np dtype), while all other steps were commit reference updates only.

Completed Steps

Step Upstream range vllm-ascend commit CI result Summary
step-1 0d4d334..27b85d2 381281b passed InternS2Preview model, CPU/RISC-V attention, thinking_budget fix (commit reference only)
step-2 27b85d2..2676ab1 357abba passed Deprecated shim removal for get_tokenizer/resolve_hf_chat_template (commit reference only)
step-3 2676ab1..4b364f8 d8fbcbf passed LoRA maybe_get_oot_by_class, KV cache SWA optimization (commit reference only)
step-4 4b364f8..75fd68c 3777e1b passed Pooling offline API refactor (commit reference only)
step-5 75fd68c..0fe7550 a094d1c passed Added dtype=np.int32 to token_arange_np in eagle_proposer.py and tests
step-6 0fe7550..e0a45f1 c042924 passed RL IPC weight sync optimizations (commit reference only)
step-7 e0a45f1..fb5bd03 4d2d4ca passed kv_connector ordering fix, IR op priority to worker init (commit reference only)
step-8 fb5bd03..46a9581 c3e27b8 passed ROCm MLA FP8 ASM prefill (commit reference only)

Changes Made

  • Updated vLLM commit reference from 0d4d334eaa583b9c09aa4eb7538c22db99fd84b3 to 46a95815d344e43ebd6b4757632c55d03e90983a in:
    • docs/source/conf.py
    • .github/workflows/dockerfiles/Dockerfile.lint
    • .github/workflows/pr_test_full.yaml
    • .github/workflows/pr_test_light.yaml
  • Adapted vllm_ascend/spec_decode/eagle_proposer.py: Added dtype=np.int32 to token_arange_np for consistency with upstream SpecDecodeBaseProposer
  • Updated tests/ut/spec_decode/test_eagle_proposer.py: Updated test token_arange_np assignments to match dtype

CI Verification

  • Passed: All 8 steps (step-1 through step-8) with e2e-singlecard-light suite
  • Treated as env flakes: none
  • Last successful step: step-8 (target commit reached)

Follow-up

None required. All upstream changes absorbed successfully. The upgrade is complete and verified through CI.

Meihan-chen and others added 30 commits May 18, 2026 21:48
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <jcccx.cmh@gmail.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Signed-off-by: Meihan-chen <239345480+Meihan-chen@users.noreply.github.com>
Upstream changes absorbed:
- InternS2Preview model support (new model registry entry)
- CPU/RISC-V attention backend (no Ascend impact)
- Bug fix for thinking_budget_tracks_reqs condition in gpu_input_batch
- Speculative config handling for intern_s2_preview

vllm-ascend impact: No code changes required (no-op adapt).
Commit reference updated in conf.py and workflow files.

Signed-off-by: main2main-bot <main2main-bot@users.noreply.github.com>
Upstream changes absorbed:
- Removed deprecated shim for vllm.transformers_utils.tokenizer.get_tokenizer
- Removed deprecated shim for vllm.entrypoints.chat_utils.resolve_hf_chat_template

vllm-ascend impact: No code changes required (no-op adapt).
vllm-ascend doesn't import from the deprecated locations.
Commit reference updated in conf.py and workflow files.

Signed-off-by: main2main-bot <main2main-bot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/build documentation Improvements or additions to documentation merge-conflicts module:tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants