Skip to content
Open
Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
fdf9333
added dependency-update workflow template
Rimsha2535 Mar 19, 2026
67e8357
Add dependency-update workflow template and update tests
Rimsha2535 Apr 13, 2026
e764019
Merge branch 'main' into feature/dependency-update-workflow
Rimsha2535 Apr 13, 2026
c9c53e6
Apply review feedback for dependency update workflow
Rimsha2535 Apr 14, 2026
c05e242
Merge branch 'main' into feature/dependency-update-workflow
ArBridgeman Apr 15, 2026
cea77fd
Improve dependency update workflow, tests, and docs
Rimsha2535 Apr 20, 2026
9844688
Merge branch 'main' into feature/dependency-update-workflow
ArBridgeman Apr 29, 2026
454f20e
Merge branch 'main' into feature/dependency-update-workflow
ArBridgeman Apr 29, 2026
49145b9
Fix release:prepare test
ArBridgeman Apr 29, 2026
bf38243
Update PTB workflows to 7.0.0
ArBridgeman Apr 29, 2026
b59c5b5
Add Slack reporting hook
ArBridgeman May 4, 2026
85c89d2
Add entry to unreleased.md changelog
ArBridgeman May 4, 2026
a882d41
Update .github/workflows/dependency-update.yml
Rimsha2535 May 6, 2026
eec5503
Update .github/workflows/dependency-update.yml
Rimsha2535 May 6, 2026
4bb47a9
Update .github/workflows/dependency-update.yml
Rimsha2535 May 6, 2026
a4c95e3
Update .github/workflows/dependency-update.yml
Rimsha2535 May 6, 2026
8ec9d68
Update .github/workflows/dependency-update.yml
Rimsha2535 May 6, 2026
7ee7359
Merge branch 'main' into feature/dependency-update-workflow
Rimsha2535 May 6, 2026
9e18007
Add slack_hook
Rimsha2535 May 4, 2026
ee5f3ab
Resolve merge conflicts
Rimsha2535 May 6, 2026
6f64290
Copy dependency-update workflow changes to template
Rimsha2535 May 6, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
93 changes: 93 additions & 0 deletions .github/workflows/dependency-update.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,93 @@
name: Dependency Update
Comment thread
ArBridgeman marked this conversation as resolved.
Comment thread
Rimsha2535 marked this conversation as resolved.
Comment thread
ArBridgeman marked this conversation as resolved.

on:
schedule:
# Every Monday at 03:00 UTC
- cron: "0 3 * * 1"
workflow_dispatch:
workflow_call:

jobs:
dependency-update:
name: Dependency Update
runs-on: "ubuntu-24.04"
permissions:
contents: write
pull-requests: write

steps:
- name: Check out Repository
id: check-out-repository
uses: actions/checkout@v6
with:
fetch-depth: 0

- name: Set up Python & Poetry Environment
id: set-up-python-and-poetry-environment
uses: exasol/python-toolbox/.github/actions/python-environment@v6
with:
python-version: "3.10"
poetry-version: "2.3.0"

- name: Audit Dependencies
Comment thread
ckunki marked this conversation as resolved.
id: audit-dependencies
run: |
poetry run -- nox -s dependency:audit | tee vulnerabilities.json
Comment thread
ArBridgeman marked this conversation as resolved.
LENGTH=$(jq 'length' vulnerabilities.json)
echo "count=$LENGTH" >> "$GITHUB_OUTPUT"

- name: Update Dependencies
id: update-dependencies
if: steps.audit-dependencies.outputs.count > 0
Comment thread
ArBridgeman marked this conversation as resolved.
run: poetry update

- name: Check for poetry.lock Changes
id: check-for-poetry-lock-changes
if: steps.audit-dependencies.outputs.count > 0
run: |
if git diff --quiet -- poetry.lock; then
echo "changed=false" >> "$GITHUB_OUTPUT"
else
echo "changed=true" >> "$GITHUB_OUTPUT"
fi

- name: Configure git
id: configure-git
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true'
run: |
git config --global user.email "opensource@exasol.com"
git config --global user.name "Automatic Dependency Updater"

- name: Create branch
id: create-branch
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && github.ref == 'refs/heads/main'
run: |
branch_name="dependency-update/$(date "+%Y%m%d%H%M%S")"
Comment thread
Rimsha2535 marked this conversation as resolved.
Outdated
echo "Creating branch $branch_name"
git checkout -b "$branch_name"
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated

- name: Commit changes & push
Comment thread
Rimsha2535 marked this conversation as resolved.
Outdated
id: publish-branch
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && startsWith(github.ref, 'refs/heads/')
run: |
branch_name=$(git rev-parse --abbrev-ref HEAD)
git add poetry.lock
git commit --message "Update poetry.lock"
Comment thread
Rimsha2535 marked this conversation as resolved.
Outdated
git push --set-upstream origin "$branch_name"

- name: Create pull request
Comment thread
Rimsha2535 marked this conversation as resolved.
Outdated
id: create-pr
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && github.ref == 'refs/heads/main'
env:
GH_TOKEN: ${{ github.token }}
run: |-
BASE_BRANCH=$(gh repo view --json defaultBranchRef -q .defaultBranchRef.name)

gh pr create \
--base "$BASE_BRANCH" \
--title "Update poetry.lock" \
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated
--body "Automated dependency update for \`poetry.lock\`.

This PR was created by the dependency update workflow after running:
- \`poetry run -- nox -s dependency:audit\`
- \`poetry update\`"
Comment thread
ArBridgeman marked this conversation as resolved.
14 changes: 14 additions & 0 deletions doc/user_guide/features/github_workflows/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,9 @@ Workflows
- Pull request and monthly
- Executes the continuous integration suite by calling ``merge-gate.yml`` and
``report.yml``. See :ref:`ci_yml` for a graph of workflow calls.
* - ``dependency-update.yml``
- Weekly and manual
- Audits project dependencies for known vulnerabilities, updates them with Poetry when needed, and creates a pull request if ``poetry.lock`` changes.
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated
* - ``gh-pages.yml``
- Workflow call
- Builds the documentation and deploys it to GitHub Pages.
Expand Down Expand Up @@ -99,6 +102,17 @@ Workflows
CI Actions
----------

Dependency Update
^^^^^^^^^^^^^^^^^

The ``dependency-update.yml`` workflow helps keep project dependencies up to date.
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated

It can be triggered manually and is also scheduled to run weekly.

The workflow first audits dependencies for known vulnerabilities. If vulnerabilities
are detected, it updates the dependencies using Poetry. When ``poetry.lock`` changes,
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated
it creates a pull request with the update.
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated

.. _ci_yml:

Pull Request
Comment thread
ArBridgeman marked this conversation as resolved.
Expand Down
92 changes: 92 additions & 0 deletions exasol/toolbox/templates/github/workflows/dependency-update.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,92 @@
name: Dependency Update

on:
schedule:
# Every Monday at 03:00 UTC
- cron: "0 3 * * 1"
workflow_dispatch:
Comment thread
ArBridgeman marked this conversation as resolved.

jobs:
dependency-update:
name: Dependency Update
runs-on: "(( os_version ))"
permissions:
contents: write
pull-requests: write

steps:
- name: Check out Repository
id: check-out-repository
uses: actions/checkout@v6
with:
fetch-depth: 0

- name: Set up Python & Poetry Environment
id: set-up-python-and-poetry-environment
uses: exasol/python-toolbox/.github/actions/python-environment@v6
with:
python-version: "(( minimum_python_version ))"
poetry-version: "(( dependency_manager_version ))"

- name: Audit Dependencies
id: audit-dependencies
run: |
poetry run -- nox -s dependency:audit | tee vulnerabilities.json
LENGTH=$(jq 'length' vulnerabilities.json)
echo "count=$LENGTH" >> "$GITHUB_OUTPUT"

- name: Update Dependencies
id: update-dependencies
if: steps.audit-dependencies.outputs.count > 0
run: poetry update

- name: Check for poetry.lock Changes
id: check-for-poetry-lock-changes
if: steps.audit-dependencies.outputs.count > 0
run: |
if git diff --quiet -- poetry.lock; then
echo "changed=false" >> "$GITHUB_OUTPUT"
else
echo "changed=true" >> "$GITHUB_OUTPUT"
fi

- name: Configure git
id: configure-git
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true'
run: |
git config --global user.email "opensource@exasol.com"
git config --global user.name "Automatic Dependency Updater"

- name: Create branch
id: create-branch
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && github.ref == 'refs/heads/main'
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated
run: |
branch_name="dependency-update/$(date "+%Y%m%d%H%M%S")"
echo "Creating branch $branch_name"
git checkout -b "$branch_name"

- name: Commit changes & push
id: publish-branch
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && startsWith(github.ref, 'refs/heads/')
run: |
branch_name=$(git rev-parse --abbrev-ref HEAD)
git add poetry.lock
git commit --message "Update poetry.lock"
git push --set-upstream origin "$branch_name"

- name: Create pull request
id: create-pr
if: steps.check-for-poetry-lock-changes.outputs.changed == 'true' && github.ref == 'refs/heads/main'
env:
GH_TOKEN: ${{ github.token }}
run: |
BASE_BRANCH=$(gh repo view --json defaultBranchRef -q .defaultBranchRef.name)

gh pr create \
Comment thread
Rimsha2535 marked this conversation as resolved.
Outdated
--base "$BASE_BRANCH" \
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not needed

Suggested change
--base "$BASE_BRANCH" \

--title "Update poetry.lock" \
--body "Automated dependency update for \`poetry.lock\`.

This PR was created by the dependency update workflow after running:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not needed

Suggested change
This PR was created by the dependency update workflow after running:

- \`poetry run -- nox -s dependency:audit\`
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not needed

Suggested change
- \`poetry run -- nox -s dependency:audit\`

- \`poetry update\`"
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not needed

Suggested change
- \`poetry update\`"

2 changes: 1 addition & 1 deletion test/integration/project-template/nox_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -76,4 +76,4 @@ def test_install_github_workflows(self, poetry_path, run_command):
assert output.returncode == 0

file_list = run_command(["ls", ".github/workflows"]).stdout.splitlines()
assert len(file_list) == 13
assert len(file_list) == 14
Comment thread
Rimsha2535 marked this conversation as resolved.
24 changes: 17 additions & 7 deletions test/integration/tools/workflow_integration_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ def test_with_default(cli_runner):
"check-release-tag\n"
"checks\n"
"ci\n"
"dependency-update\n"
"gh-pages\n"
"matrix-all\n"
"matrix-exasol\n"
Expand All @@ -33,13 +34,20 @@ def test_with_columns(cli_runner):
result = cli_runner.invoke(CLI, ["list", "--columns"])

assert result.exit_code == 0
assert result.output == (
"build-and-publish cd check-release-tag checks ci "
"gh-pages\n"
"matrix-all matrix-exasol matrix-python merge-gate pr-merge "
"report \n"
"slow-checks \n"
)
assert "build-and-publish" in result.output
assert "cd" in result.output
assert "check-release-tag" in result.output
assert "checks" in result.output
assert "ci" in result.output
assert "dependency-update" in result.output
assert "gh-pages" in result.output
assert "matrix-all" in result.output
assert "matrix-exasol" in result.output
assert "matrix-python" in result.output
assert "merge-gate" in result.output
assert "pr-merge" in result.output
assert "report" in result.output
assert "slow-checks" in result.output
Comment thread
ArBridgeman marked this conversation as resolved.
Outdated


def test_show_workflow(cli_runner):
Expand All @@ -57,6 +65,7 @@ def test_show_workflow(cli_runner):
"check-release-tag",
"checks",
"ci",
"dependency-update",
"gh-pages",
"matrix-all",
"matrix-exasol",
Expand Down Expand Up @@ -92,6 +101,7 @@ def test_all_workflows(cli_runner, tmp_path):
"check-release-tag.yml",
"checks.yml",
"ci.yml",
"dependency-update.yml",
"gh-pages.yml",
"matrix-all.yml",
"matrix-exasol.yml",
Expand Down
2 changes: 1 addition & 1 deletion test/unit/nox/_workflow_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ class TestGenerateWorkflow:
@staticmethod
@pytest.mark.parametrize(
"nox_session_runner_posargs, expected_count",
[(ALL, 13), *[(key, 1) for key in WORKFLOW_TEMPLATE_OPTIONS.keys()]],
[(ALL, 14), *[(key, 1) for key in WORKFLOW_TEMPLATE_OPTIONS.keys()]],
indirect=["nox_session_runner_posargs"],
)
def test_works_as_expected(
Expand Down
3 changes: 3 additions & 0 deletions test/unit/tool_template_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ def test_retrieve_workflow_templates():
"check-release-tag": "check-release-tag.yml",
"checks": "checks.yml",
"ci": "ci.yml",
"dependency-update": "dependency-update.yml",
"gh-pages": "gh-pages.yml",
"matrix-all": "matrix-all.yml",
"matrix-exasol": "matrix-exasol.yml",
Expand Down Expand Up @@ -51,6 +52,7 @@ def test_retrieve_issue_templates():
"check-release-tag": "check-release-tag.yml",
"checks": "checks.yml",
"ci": "ci.yml",
"dependency-update": "dependency-update.yml",
"gh-pages": "gh-pages.yml",
"matrix-all": "matrix-all.yml",
"matrix-exasol": "matrix-exasol.yml",
Expand Down Expand Up @@ -106,6 +108,7 @@ def test_retrieve_templates(subpackage, expected):
"check-release-tag.yml",
"checks.yml",
"ci.yml",
"dependency-update.yml",
"gh-pages.yml",
"matrix-all.yml",
"matrix-exasol.yml",
Expand Down
1 change: 1 addition & 0 deletions test/unit/util/workflows/templates_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ def test_get_workflow_templates(project_config):
"check-release-tag",
"checks",
"ci",
"dependency-update",
"gh-pages",
"matrix-all",
"matrix-exasol",
Expand Down