Add persistent dense-expert MoE path via spyre::moe_ffn - #2

Add persistent dense-expert MoE path via spyre::moe_ffn#2

ani300 wants to merge 14 commits into

gemma4-moe-designani300/hf-adapters:gemma4-moe-designfrom

gemma4-moe-persistent-moe-ffnani300/hf-adapters:gemma4-moe-persistent-moe-ffnCopy head branch name to clipboard