feat: MegaMOE adaptation for SM90#323

Open

qiushixiaoyu wants to merge 24 commits into

deepseek-ai:mainfrom

qiushixiaoyu:main

Commits on Jun 27, 2026

Support tvm-ffi interfaces

Fridge003
and
rainj-me
committed
Support Wheel Compilation
Fridge003
committed
Export the PDL utils of DeepGEMM (#34)

b8zhong
authored and
Fridge003
committed
Expose BF16 grouped GEMM wrappers

popsiclexu
authored and
Fridge003
committed
Setup tests for sgl-deep-gemm

Fridge003
and
b8zhong
committed
Sm90 mega moe on sgl dev (#36)

authored and
Fridge003
committed
Add Hopper mega moe test to runner (#46)
Fridge003
committed
chore: bump apache-tvm-ffi 0.1.9 -> 0.1.11 (#47)

MartinHua
authored and
Fridge003
committed
Add FP4 acts + MXF4 kind support and fused mega_moe_pre_dispatch kernel (#27)

authored and
Fridge003
committed
Add DG_USE_FP8_COMBINE: FP8 + per-row UE8M0 SF on the second a2a (combine path) (#28)

authored and
Fridge003
committed
Add tvm-ffi wrapper for w4a4 megamoe
Fridge003
committed

Commits on Jun 29, 2026

Rebase and fix
Fridge003
committed

Commits on Jun 30, 2026

Enable SM90 FP8 MegaMoE swapAB
yinding
committed
Fix SM90 FP8 MegaMoE swapAB synchronization
yinding
committed
Add SM90 FP8 MegaMoE pre-dispatch kernel
yinding
committed
Add SM90 mega-MoE pre-dispatch test
yinding
committed
Add SM90 FP4 MegaMoE implementation
yinding
committed
Avoid L1 N32 swapAB bucket for FP4 MegaMoE
yinding
committed
FP4 swapAB L1: align routing-weight fold order with non-swap path

yinding
and
claude
committed
Merge sgl-project/DeepGEMM PR #48: Enable SM90 FP8 MegaMoE swapAB
yinding
committed
Merge sgl-project/DeepGEMM PR #53: Add SM90 FP4 MegaMoE implementation
yinding
committed

Commits on Jul 1, 2026

Fix SM90 FP4 MegaMoE build against post-#364 signatures
yinding
committed

Commits on Jul 2, 2026

SM90 FP8 MegaMoE swapAB — accuracy issue & mitigation
yinding
committed

Commits on Jul 5, 2026

Tune SM90 MegaMoE decode heuristics for GLM5.2
yinding
committed