[Tracking] Distributed dynamic filtering

[tdcmeehan]

Umbrella for upstreaming distributed dynamic filtering — coordinator-mediated runtime filters that prune splits/rows across exchange boundaries and at higher levels of metadata, where today's in-fragment Velox dynamic filter pushdown (enable_dynamic_filtering) cannot reach.

Design: RFC-0022. Feature request: #7428.

Already implemented and benchmarked on an internal fork; landing as small parts and disabled by default. TPC-DS SF1000 partitioned Iceberg: ~48% splits pruned, −9.5% wall time reduction.

PRs:

• feat(spi): Add DynamicFilter SPI for connector split pruning #27991
• feat(optimizer): Add coordinator-mediated DPP planner support #28028
• feat: Coordinator dynamic filter collection and merge service #28042
• feat: Dynamic filter transport (coordinator↔worker) and scheduler wiring #28044
• feat(iceberg): Consume dynamic filter for split/partition pruning #28060

[imsayari404]

Working on #28044 and #28060. I’ll be making both PRs ready for review.