perf(decode): n>=4 tiled QKV + o_proj GEMV for NVFP4 batched decode (extract of #214 onto main)#266
Open
rsafier wants to merge 1 commit into
Open
perf(decode): n>=4 tiled QKV + o_proj GEMV for NVFP4 batched decode (extract of #214 onto main)#266rsafier wants to merge 1 commit into
rsafier wants to merge 1 commit into
