feat(rl): gate-native async RL loop + flat Rollout contract#382

Merged

Hecate0821 merged 16 commits into

mainfrom

chengxi/rl-async-gate-v2

May 4, 2026

Commits on May 4, 2026

refactor(rl-async): unify gate to sample-level units; rename rollout_fn(row) -> rollout_fn(sample_prompt)

Hecate0821
and
claude
committed
fix(rl): TIS/drift average over active loss-mask positions only

Hecate0821
and
claude
committed
chore(rl-async): trim verbose comments in production code

Hecate0821
and
claude
committed
fix(rl-async): align staleness/entropy semantics + style guide pass

Hecate0821
and
claude
committed
docs(rl-async): drop two leftover row-cap docstring overstatements

Hecate0821
and
claude
committed
docs(skills/dev): add async-rl skill, trim in-tree READMEs to pointers

Hecate0821
and
claude
committed
docs(rl-async): mark recipe EXPERIMENTAL, repo-root cross-links

Hecate0821
and
claude
committed
docs(rl-async): acknowledge AReaL / slime / Miles prior art

Hecate0821
and
claude
committed
docs(rl-async): trim Config/RolloutSetup docstrings; add metrics tuning section

Hecate0821
and
claude
committed
docs(rl-async): clarify on-policy support; remove internal scenarios

Hecate0821
and
claude
committed
docs(rl-async): restore tested R=4/O=4 datapoint as a confirmation note

Hecate0821
and
claude
committed
docs(rl-async): tighten gate / per-sample / version-unit wording

Hecate0821
and
claude
committed