Skip to content

⬆️ Upgrade dask from 2025.11.0 to 2026.7.1 - #9580

Draft
sanderegg wants to merge 3 commits into
ITISFoundation:masterfrom
sanderegg:maintenance/update-dask-2026
Draft

⬆️ Upgrade dask from 2025.11.0 to 2026.7.1#9580
sanderegg wants to merge 3 commits into
ITISFoundation:masterfrom
sanderegg:maintenance/update-dask-2026

Conversation

@sanderegg

@sanderegg sanderegg commented Aug 21, 2026

Copy link
Copy Markdown
Member

What do these changes do?

Important changes

Dask fixed shceduler info not returning all worker infos dask/distributed#9308

Highlights on updated libraries (only updated libraries are included)

  • #packages before ~ 14
  • #packages after ~ 10
# name before after upgrade count packages
1 blosc 1.11.3 1.11.4 3 dask-sidecar⬆️⬆️
director-v2⬆️
2 bokeh 3.8.1 3.10.0 minor 1 dask-sidecar⬆️
3 contourpy 1.3.3 🗑️ removed 1 dask-sidecar⬆️
4 dask 2025.11.0, 2026.3.0 2026.7.1 minor 7 autoscaling⬆️
clusters-keeper⬆️
dask-sidecar⬆️⬆️
dask-task-models-library🧪
director-v2⬆️🧪
5 distributed 2025.11.0, 2026.3.0 2026.7.1 minor 7 autoscaling⬆️
clusters-keeper⬆️
dask-sidecar⬆️⬆️
dask-task-models-library🧪
director-v2⬆️🧪
6 fsspec 2025.10.0, 2026.2.0 2026.7.0 minor 7 autoscaling⬆️
clusters-keeper⬆️
dask-sidecar⬆️⬆️
dask-task-models-library🧪
director-v2⬆️🧪
7 msgpack 1.1.2 1.2.1 minor 7 autoscaling⬆️
clusters-keeper⬆️
dask-sidecar⬆️⬆️
dask-task-models-library🧪
director-v2⬆️🧪
8 numpy 2.3.5 2.5.2 minor 4 dask-sidecar⬆️⬆️
director-v2⬆️🧪
9 pandas 2.3.3 🗑️ removed 1 dask-sidecar⬆️
10 psutil 7.1.3 7.2.2 minor 8 autoscaling⬆️🧪
clusters-keeper⬆️🧪
dask-sidecar⬆️⬆️
director-v2⬆️🧪
11 pytz 2025.2 🗑️ removed 1 dask-sidecar⬆️
12 s3fs 2025.10.0 2026.7.0 MAJOR 1 dask-sidecar⬆️
13 tornado 6.5.2, 6.5.5 6.5.8 7 autoscaling⬆️
clusters-keeper⬆️
dask-sidecar⬆️⬆️
dask-task-models-library🧪
director-v2⬆️🧪
14 urllib3 2.7.0 🗑️ removed 2 dask-sidecar⬆️
dask-task-models-library🧪

Legend:

  • ⬆️ base dependency (only services because packages are floating)
  • 🧪 test dependency
  • 🔧 tool dependency

Related issue/s

How to test

Dev-ops

@sanderegg sanderegg added this to the Kula Ring milestone Aug 21, 2026
@sanderegg sanderegg self-assigned this Aug 21, 2026
@sanderegg sanderegg added the t:maintenance Maintenance work; used to filter tasks for end-of-sprint reporting in Review (Agreed July 3, Retro) label Aug 21, 2026
@github-actions github-actions Bot added a:director-v2 issue related with the director-v2 service a:dask-service Any of the dask services: dask-scheduler/sidecar or worker a:autoscaling autoscaling service in simcore's stack a:resource-usage-tracker resource usage tracker service a:clusters-keeper dependencies Pull requests that update a dependency file labels Aug 21, 2026
@codecov

codecov Bot commented Aug 21, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.64%. Comparing base (19a5f9d) to head (e8d9c3d).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #9580      +/-   ##
==========================================
+ Coverage   82.54%   88.64%   +6.10%     
==========================================
  Files        1879     1306     -573     
  Lines       73544    51958   -21586     
  Branches      998      215     -783     
==========================================
- Hits        60705    46059   -14646     
+ Misses      12617     5835    -6782     
+ Partials      222       64     -158     
Flag Coverage Δ
integrationtests 62.73% <ø> (+2.23%) ⬆️
unittests 88.21% <ø> (+4.99%) ⬆️
Components Coverage Δ
pkg_aws_library ∅ <ø> (∅)
pkg_celery_library ∅ <ø> (∅)
pkg_dask_task_models_library 90.73% <ø> (ø)
pkg_models_library ∅ <ø> (∅)
pkg_notifications_library ∅ <ø> (∅)
pkg_postgres_database ∅ <ø> (∅)
pkg_service_integration ∅ <ø> (∅)
pkg_service_library ∅ <ø> (∅)
pkg_settings_library ∅ <ø> (∅)
pkg_simcore_sdk 86.42% <ø> (+11.08%) ⬆️
agent 93.90% <ø> (ø)
api_server 92.99% <ø> (ø)
autoscaling ∅ <ø> (∅)
catalog 92.47% <ø> (ø)
clusters_keeper 98.61% <ø> (ø)
dask_sidecar 93.38% <ø> (ø)
datcore_adapter 98.08% <ø> (ø)
director 79.17% <ø> (+0.15%) ⬆️
director_v2 ∅ <ø> (∅)
dynamic_scheduler 95.97% <ø> (ø)
dynamic_sidecar 88.43% <ø> (+15.79%) ⬆️
efs_guardian 89.40% <ø> (ø)
invitations 91.63% <ø> (ø)
payments 92.17% <ø> (ø)
resource_usage_tracker 91.63% <ø> (-0.11%) ⬇️
storage 87.84% <ø> (-0.16%) ⬇️
webclient ∅ <ø> (∅)
webserver 86.13% <ø> (+14.30%) ⬆️

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 19a5f9d...e8d9c3d. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@sonarqubecloud

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

a:autoscaling autoscaling service in simcore's stack a:clusters-keeper a:dask-service Any of the dask services: dask-scheduler/sidecar or worker a:director-v2 issue related with the director-v2 service a:resource-usage-tracker resource usage tracker service dependencies Pull requests that update a dependency file t:maintenance Maintenance work; used to filter tasks for end-of-sprint reporting in Review (Agreed July 3, Retro)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant