Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121#40082

Merged

pavanimajety merged 15 commits into

vllm-project:mainfrom

meena-at-work:integrate-flashinfer-b12x-moe

May 20, 2026

Commits on May 18, 2026

[SM120/121] Add FlashInfer b12x fused MoE backend

meena-at-work
and
claude
committed
[SM120/121] Add FlashInfer b12x FP4 GEMM backend

meena-at-work
and
claude
committed
[SM120/121] Address review comments on FlashInferCuteDSLSM12xExperts

meena-at-work
and
claude
committed
rename: flashinfer_cutedsl_sm12x -> flashinfer_b12x
meena-at-work
committed
[SM120/121] Switch FlashInferCuteDSLSM12xExperts to b12x_fused_moe (FlashInfer PR #3080)
meena-at-work
committed
pre-commit: fix ruff/formatting issues
meena-at-work
committed
pre-commit: fix ruff E501 and mypy union-attr errors
meena-at-work
committed
[SM12x] Address review comments: remove dead code, rename FlashInferB12xExperts
meena-at-work
committed
[SM12x] Move FlashInferB12xExperts into its own flashinfer_b12x_moe.py
meena-at-work
committed
test(b12x): wire w1/w2_sf_mma before kernel call in test_flashinfer_b12x_moe

meena-at-work
and
claude
committed
style: remove trailing blank lines in flashinfer_cutedsl_moe.py

meena-at-work
and
claude
committed
style: ruff format flashinfer_convert_sf_to_mma_layout calls in test

meena-at-work
and
claude
committed
refactor(b12x): remove FLASHINFER_CUTEDSL from unreachable assert

meena-at-work
and
claude
committed
fix(b12x): exclude b12x MoE and GEMM backends from auto-selection

meena-at-work
and
claude
committed
fix(b12x): accept FlashInfer 0.6.11 renamed Sm120 b12x kernel class
meena-at-work
committed