You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for releasing TileRT. We are evaluating low-latency GLM-5.2 serving on 8xB200 and wanted to ask whether GLM-5.2 support is on the roadmap, and if there is any tentative ETA or blocker list.
Context:
I saw the helpful response in GLM5.1 nvfp4 support #41 that GLM-5.1 NVFP4 support is not straightforward because unlocking the B200 NVFP4 tensor core path requires W4A4 / model-side support.
GLM-5.2 appears to differ from GLM-5.1 architecturally, including shared DSA-related weights, and public deployments have mentioned FP8 weights plus NVFP4 quantization for Blackwell.
We are mainly trying to understand whether TileRT could support GLM-5.2 decode on Blackwell, even if the first supported path is FP8 or requires a specific calibrated NVFP4/W4A4 checkpoint.
A few questions:
Is GLM-5.2 support planned for TileRT?
Would support require an official Z.ai W4A4/NVFP4 checkpoint, or could an FP8/NVFP4 conversion path be supported?
If it is planned, is there any rough ETA?
If community contributions are welcome, which pieces would be most useful: weight conversion, shared DSA handling, MoE routing, MTP/speculation support, benchmark harnesses, or something else?
We can help test on 8xB200 and share logs/benchmarks if useful.
Hi TileRT team,
Thanks for releasing TileRT. We are evaluating low-latency GLM-5.2 serving on 8xB200 and wanted to ask whether GLM-5.2 support is on the roadmap, and if there is any tentative ETA or blocker list.
Context:
A few questions:
We can help test on 8xB200 and share logs/benchmarks if useful.
Thanks again for the work on TileRT.