Neutralize zero-advantage samples to skip wasted forward compute#1901

Open

nanjiangwill wants to merge 8 commits into

mainfrom

filter-zero-reward

Commits on May 11, 2026

Filter zero-advantage samples; split rollout/train logging boundary

nanjiangwill
and
claude
committed
Merge branch 'main' into filter-zero-reward
zhuzilin
authored
Replace zero-advantage filter with in-place neutralization

nanjiangwill
and
claude
committed
Neutralize zero-advantage samples in convert_samples_to_train_data

nanjiangwill
and
claude
committed
Restore tests/plugin_contracts/test_plugin_runtime_hook_contracts.py to main

nanjiangwill
and
claude
committed
Drop redundant remove_sample assignment

nanjiangwill
and
claude
committed
Re-add sample.remove_sample = True as a defensive guard

nanjiangwill
and
claude
committed
Gate neutralization on advantage_estimator in {grpo, gspo}

nanjiangwill
and
claude
committed