Skip to content

adjustments and fixes to derived table script#153

Open
sheridancbio wants to merge 1 commit into
rfc100-rcfrom
suggested-fixes-for-derived-tables
Open

adjustments and fixes to derived table script#153
sheridancbio wants to merge 1 commit into
rfc100-rcfrom
suggested-fixes-for-derived-tables

Conversation

@sheridancbio
Copy link
Copy Markdown
Contributor

A number of fixes / improvements here attempting to make this script usable in our production environment.

The script still is not running successfully from pipelines5 to the genie clickhouse databases (my test case) because of network connection problems apparently.

fixes:

  • added shbang
  • script used to "fail" but exit with no messages, no exception, and a success error code
  • added usage statement
  • renamed to be more intuitively meaningful: "rebuild_derived_tables.py"
  • added if __name__ == "__main__": logic so script can be directly runnable
  • dropped the default locating of clickhouse.sql in the PORTAL_HOME directory (which for us is set to /data/portal-cron - not where we would put clickhouse.sql)
  • added ability to set longer http timeout with CLICKHOUSE_REQUEST_TIMEOUT environment variable

@sheridancbio sheridancbio requested a review from jamesqo May 10, 2026 07:48
@sheridancbio sheridancbio added bug Something isn't working enhancement New feature or request labels May 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant