feat(holo-3.1): 256K long-context serving recipes (35B-A3B NVFP4 + 9B dense)#1

Draft

rsafier wants to merge 6 commits into

mainfrom

feat/holo-3.1-recipes

Commits on Jul 11, 2026

feat(holo-3.1): 256K long-context serving recipes (35B-A3B NVFP4 + 9B dense)
rsafier
committed
feat(holo-3.1): full proven prefill-accelerator config (5K+ tok/s)
rsafier
committed
fix(holo-3.1): ATLAS_GDN_FLASHINFER=0 for long-context correctness
rsafier
committed

Commits on Jul 12, 2026

feat(holo-3.1): FP8 (block-scaled) recipe — MUST NOT set ATLAS_FP8_SINGLE_SCALE
rsafier
committed
feat(holo-3.1): FP8 agentic recipe — per-row FP8 head (10/10 webserver_ok+followed_dir)
rsafier
committed
fix(holo-3.1 fp8 recipe): correct prefill claim — ~4-5K is NVFP4-only, not FP8
rsafier
committed