Skip to content

Allow attaching to ducklake without specifying data storage location#3945

Open
cbility wants to merge 1 commit into
dlt-hub:develfrom
cbility:fix/ducklake-allow-optional-data-path
Open

Allow attaching to ducklake without specifying data storage location#3945
cbility wants to merge 1 commit into
dlt-hub:develfrom
cbility:fix/ducklake-allow-optional-data-path

Conversation

@cbility
Copy link
Copy Markdown

@cbility cbility commented May 18, 2026

Description

Data storage location only has to be specified when creating a new ducklake, see https://ducklake.select/docs/stable/duckdb/usage/connecting. For existing ducklakes the storage location can be read from the catalog. Specifying the storage location in code also means that any change to the storage location in the catalog breaks the code.

This change removes the autogenerated data path that is inserted when a storage location is not supplied and changes the attach sql generation so that it can omit a data path if one is not supplied.

Amends existing tests so they work when storage is not specified and adds four new tests that test connecting to a ducklake without a data path for sqlite and postgres catalogs, creating a new ducklake and then attaching to it again without specifying a data path, and running dlt pipelines that create a new ducklake and then attach to it without specifying a data path.

Related Issues

Additional Context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Don't require setting data_path for existing DuckLake catalogs

1 participant