Skip to content
Merged
Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
99b0109
feat: add support for multiple active linear trajectory chains in gat…
zhanghuiyao Jun 23, 2026
47bb69a
feat: enhance GatewaySession to clamp remaining response budget to ze…
zhanghuiyao Jun 23, 2026
7ee715b
Refactor multiple chains support and clean up related code
zhanghuiyao Jun 24, 2026
da91566
feat: Add support for parallel session generation and CCH handling
zhanghuiyao Jun 24, 2026
6634f6d
fix: Update error handling in GatewaySession to raise HTTPException o…
zhanghuiyao Jun 25, 2026
589dde1
feat: add test_multiple_chains_claude_code_subagent_cch_prefix_match_…
zhanghuiyao Jul 1, 2026
88c3001
refactor: remove ignore_cch_for_prefix_hash flag from GatewaySession …
zhanghuiyao Jul 8, 2026
55f57ab
refactor: streamline chat template kwargs handling in MessageCodec an…
zhanghuiyao Jul 9, 2026
388718b
refactor: simplify boolean flag retrieval in build_gateway_manager an…
zhanghuiyao Jul 13, 2026
ffe3ea3
refactor: removing unused tests
zhanghuiyao Jul 13, 2026
49abf81
Refactor session management and remove parallel session generation flag
zhanghuiyao Jul 13, 2026
28deb35
Reject invalid response budgets and close exhausted sessions earlier
zhanghuiyao Jul 14, 2026
a2ab4bf
refactor: improve request handling and validation in MessageCodec and…
zhanghuiyao Jul 14, 2026
1ba3592
refactor: streamline logprobs handling in GatewaySession and related …
zhanghuiyao Jul 14, 2026
6d435c4
Simplify gateway chain state tracking and media handling
zhanghuiyao Jul 15, 2026
c46fa29
Refine GatewaySession generation and update tests
zhanghuiyao Jul 16, 2026
49383dc
Merge remote-tracking branch 'upstream/main' into gateway-multiple-ch…
zhanghuiyao Jul 16, 2026
9a45e71
Remove request-level chat template kwargs from gateway adapters
zhanghuiyao Jul 16, 2026
9f394fb
Update gateway tests for length materialization and tool-call prefixing
zhanghuiyao Jul 16, 2026
4b0f4f7
Normalize tool calls as dictionaries
zhanghuiyao Jul 17, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/source/start/agent_train.md
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,10 @@ Start with the script defaults, then tune these first:
- `actor_rollout_ref.rollout.agent.num_workers`: number of agent rollout workers per rollout process.
- `max_prompt_length`, `max_response_length`: context budget for the agent trajectory.
- `staleness_threshold`, `trigger_parameter_sync_step`, `require_batches`, `partial_rollout`: fully async scheduling and weight synchronization behavior.
- `actor_rollout_ref.rollout.custom.agent_framework.enable_parallel_session_generation` (default `False`): M2 opt-in for overlapping only backend generation. Gateway prepare and commit stay serial.

Gateway sessions keep multiple active linear chains by default for subagent, compaction, and retry-style flows. In M1, the final finalized trajectory remains the scoring target and its score is broadcast to all trajectories from that session.
With `enable_parallel_session_generation`, reward still uses the final finalized trajectory target plus final-broadcast semantics. Enable it only when sibling chains should share the same reward, such as best-of-N; do not use it for heterogeneous chains that need separate scoring.

For MoE or large models, also check tensor, pipeline, context, and expert parallelism settings such as `GEN_TP`, `TP`, `PP`, `CP`, and `EP` in `train_qwen3p5_moe.sh`.

Expand Down
Loading