[trainer, fully_async] feat: add streaming rollouter mode to the V1 PPO trainer#6868

Open

huaiyizhao wants to merge 7 commits into

verl-project:mainfrom

huaiyizhao:feat/v1-fully-async-streaming-rollouter

Commits on Jun 30, 2026

feat(v1): streaming fully_async PPO trainer with inlined feeder

huaiyizhao
and
claude
committed
feat(v1): opt-in rollout-level worker + session replay buffer + abnormal-rollout discard

huaiyizhao
and
claude
committed
test(v1): CPU integration tests for streaming replay buffers against real TQ

huaiyizhao
and
claude
committed
test(v1): CPU unit tests for the rollout-level agent-loop worker

huaiyizhao
and
claude
committed
chore(license): use Tencent copyright header for new fully_async files

huaiyizhao
and
claude
committed
feat(v1): per-step + per-sample timing profiling for the streaming trainer

huaiyizhao
and
claude
committed

Commits on Jul 1, 2026

fix(v1): guard replay-buffer metadata against the streaming feeder thread

huaiyizhao
and
claude
committed