Skip to content

(feat) replaces write disposition with drop_data full refresh#4010

Draft
rudolfix wants to merge 15 commits into
develfrom
fix/3998-full-refresh-with-write-disposition-change
Draft

(feat) replaces write disposition with drop_data full refresh#4010
rudolfix wants to merge 15 commits into
develfrom
fix/3998-full-refresh-with-write-disposition-change

Conversation

@rudolfix
Copy link
Copy Markdown
Collaborator

Description

(ticket incoming)
fixes and tests drop_data refresh mode to replace outdated write_disposition replace method.
tests the outdated method and overall truncation behavior for replace write disposition (for resource/tables without data)

also fixes #3998

@blacksmith-sh
Copy link
Copy Markdown

blacksmith-sh Bot commented May 31, 2026

Found 6 test failures on Blacksmith runners:

Failures

Test View Logs
test_changing_write_disposition_with_refresh[drop_data-filesystem-parquet-delta-no-stag
ing-data]
View Logs
test_changing_write_disposition_with_refresh[drop_data-filesystem-parquet-iceberg-no-st
aging-data]
View Logs
test_changing_write_disposition_with_refresh[drop_resource-filesystem-parquet-delta-no-
staging-data]
View Logs
test_changing_write_disposition_with_refresh[drop_resource-filesystem-parquet-iceberg-n
o-staging-data]
View Logs
test_changing_write_disposition_with_refresh[drop_source-filesystem-parquet-delta-no-st
aging-data]
View Logs
test_changing_write_disposition_with_refresh[drop_source-filesystem-parquet-iceberg-no-
staging-data]
View Logs

Fix in Cursor

@cloudflare-workers-and-pages
Copy link
Copy Markdown

cloudflare-workers-and-pages Bot commented May 31, 2026

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
docs 2e92c56 Commit Preview URL

Branch Preview URL
Jun 02 2026, 07:19 PM

@rudolfix rudolfix self-assigned this Jun 1, 2026
@rudolfix rudolfix added the ci full Use to trigger CI on a PR for full load tests label Jun 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci full Use to trigger CI on a PR for full load tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Incremental load on BigQuery truncates destination table in case of no changed source data

1 participant