Skip to content

Parallelize docker image saves in pg_save_image#51

Draft
Copilot wants to merge 2 commits into
masterfrom
copilot/speedup-image-build-job
Draft

Parallelize docker image saves in pg_save_image#51
Copilot wants to merge 2 commits into
masterfrom
copilot/speedup-image-build-job

Conversation

Copy link
Copy Markdown

Copilot AI commented Mar 3, 2026

The pg_save_image target saved 5 Docker images sequentially via docker save | gzip, taking ~94s total — with wal-g/golang alone consuming ~44s.

Change

Run all docker save operations as concurrent background jobs within a single shell command:

# Before: sequential (~94s)
docker save ${IMAGE} | gzip -c > ${CACHE_FILE_DOCKER_PREFIX}
docker save wal-g/ubuntu:18.04 | gzip -c > ${CACHE_FILE_UBUNTU_18_04}
...

# After: parallel (~44s, bounded by slowest image)
docker save ${IMAGE} | gzip -c > ${CACHE_FILE_DOCKER_PREFIX} & \
    docker save wal-g/ubuntu:18.04 | gzip -c > ${CACHE_FILE_UBUNTU_18_04} & \
    ...
    wait

Expected savings: ~50s per run on the "Build images" job.

Original prompt

This section details on the original issue you should resolve

<issue_title>[FEATURE] speedup image build</issue_title>
<issue_description>### What feature would you like?

we need to speedup this job https://github.com/chipitsine/wal-g/actions/runs/22643325878/job/65624841607

Why is this feature useful?

No response</issue_description>

Comments on the Issue (you are @copilot in this section)


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

…uild

Co-authored-by: chipitsine <2217296+chipitsine@users.noreply.github.com>
Copilot AI changed the title [WIP] Improve job performance for image build Parallelize docker image saves in pg_save_image Mar 3, 2026
@chipitsine chipitsine force-pushed the master branch 2 times, most recently from 3633c51 to 81395bd Compare May 7, 2026 21:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] speedup image build

2 participants