Skip to content

Update velox-cudf from upstream main - #112

Open
bdice wants to merge 1010 commits into
rapidsai:velox-cudffrom
bdice:velox-update-2026-05-18
Open

Update velox-cudf from upstream main#112
bdice wants to merge 1010 commits into
rapidsai:velox-cudffrom
bdice:velox-update-2026-05-18

Conversation

@bdice

@bdice bdice commented May 19, 2026

Copy link
Copy Markdown

Summary

  • Merge facebookincubator/velox main into rapidsai/velox velox-cudf
  • Prefer upstream cuDF implementation, dependency, and setup-script changes during conflict resolution
  • Preserve RAPIDS CI runner customizations while updating Linux CI to split cuDF build and GPU test execution

DO NOT SQUASH-MERGE

Validation

  • pre-commit run --all-files
  • yamllint and action-validator passed for active workflows
  • CI will validate the RAPIDS runner split build/test flow

karthikeyann and others added 30 commits March 12, 2025 18:01
- West const
- header cleanup
- nodiscard
…shjoins

Adding more Join types to cudfHashJoin
karthikeyann and others added 22 commits September 1, 2025 00:10
cleanup after comparing with main
A copy of facebookincubator#14664

---------

Co-authored-by: Karthikeyan Natarajan <karthikeyann@users.noreply.github.com>
A copy of facebookincubator#14359
Large string support for importFromArrow is required for gluten, and
Presto to work with libcudf.

---------

Co-authored-by: Karthikeyan Natarajan <karthikeyann@users.noreply.github.com>
When running Query 22 with presto in single worker execution mode, we
see a CPU fallback for a `FilterProject` node that takes 60 ms out of a
390 ms query.

Depends on facebookincubator#51
A copy of Parquet connector refactor facebookincubator#50 merged with velox-cudf, conflicts
resolved.
A copy of facebookincubator#14294

---------

Co-authored-by: Muhammad Haseeb <14217455+mhaseeb123@users.noreply.github.com>
Co-authored-by: Devavret Makkar <dmakkar@nvidia.com>
Co-authored-by: Karthikeyan Natarajan <karthikeyann@users.noreply.github.com>
Co-authored-by: Devavret Makkar <devavret@users.noreply.github.com>
A copy of facebookincubator#14294
Depends on facebookincubator#49

---------

Co-authored-by: Muhammad Haseeb <14217455+mhaseeb123@users.noreply.github.com>
Co-authored-by: Karthikeyan Natarajan <karthikeyann@users.noreply.github.com>
Co-authored-by: Karthikeyan <6488848+karthikeyann@users.noreply.github.com>
Upgrade cudf to 25.10 (for nvcomp improvements)
Add dependency to setup scripts `libnvjitlink-devel-"$dashed"`
CI docker to install nvjitlink

---------

Co-authored-by: Karthikeyan Natarajan <karthikeyann@users.noreply.github.com>
@bdice
bdice requested review from a team, devavret, karthikeyann and mhaseeb123 as code owners May 19, 2026 18:14
@copy-pr-bot

copy-pr-bot Bot commented May 19, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@bdice

bdice commented May 21, 2026

Copy link
Copy Markdown
Author

/ok to test c7d0e59

@bdice

bdice commented Jun 3, 2026

Copy link
Copy Markdown
Author

We will need to get GPU tests passing before merging this. I am deprioritizing this work for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants