feat: Endpoint Persistence using Network Volume (phase 2) - #31

Merged

deanq merged 108 commits into

mainfrom

deanq/ae-1092-volume-cache-sync

Oct 10, 2025

Commits on Aug 16, 2025

feat: add download acceleration infrastructure
deanq
committed
09ab3e1
feat: integrate download acceleration with dependency installer
deanq
committed
795c9e5
feat: add workspace acceleration support
deanq
committed
046eb58
test: add download acceleration test coverage
deanq
committed
45a65fe
chore: moved test-handler files to src/
deanq
committed
ce51390
feat: runtime uses aria2 for accelerated parallel downloads
deanq
committed
6c04de1
chore: update project structure and dependencies
deanq
committed
66eb286

Commits on Aug 19, 2025

Commits on Aug 20, 2025

refactor: disable Python package download acceleration
deanq
committed
cd56185
test: uv is no longer part of download accelerator
deanq
committed
d7c996d

Commits on Aug 21, 2025

feat: implement accelerate_downloads parameter logic in RemoteExecutor
deanq
committed
2ab93e3
feat: add pip fallback for Python dependencies when acceleration disabled
deanq
committed
b50a7bf
feat: enhance HF model caching with hf_transfer/hf_xet strategy
deanq
committed
440d00d
test: add comprehensive coverage for accelerate_downloads parameter
deanq
committed
0320e4d
test: update integration tests for new acceleration parameter
deanq
committed
034f770
chore: update dependencies and constants for download acceleration
deanq
committed
9531079
refactor: remove pip installation method from dependency installer
deanq
committed
d75d320
test: update unit tests to expect UV instead of pip
deanq
committed
227b33e
test: rename test file from pip to UV naming convention
deanq
committed
338a165
feat: implement parallel execution for accelerated downloads
deanq
committed
f88745d
feat: add async wrapper for HuggingFace model download acceleration
deanq
committed
f22e74d
test: update tests for parallel execution and async dependencies
deanq
committed
816fc75
test: comprehensive test coverage expansion and cleanup
deanq
committed
c9ad0d3
refactor: optimize HF acceleration to use native Hub features
deanq
committed
e31137a
chore: memory correction
deanq
committed
e1db417
feat: implement HuggingFace download acceleration strategies
deanq
committed
76ab9c0
feat: implement centralized log streaming system
deanq
committed
c269bcd
chore: these logs are for debug level
deanq
committed
04e5b54

Commits on Aug 22, 2025

chore: specs for Endpoint Persistence using Network Volume and CDR
deanq
committed
f1db33a
chore: local setup
deanq
committed
bb27ae3

Commits on Aug 29, 2025

Merge branch 'main' into deanq/ae-962-log-streaming
deanq
committed
f232a9c
fix: merge conflicts
deanq
committed
83b3293
chore: make update
deanq
committed
f9a068c
chore: these are debug lines
deanq
committed
692d8fc
chore: nala logs were too noisy
deanq
committed
ce2deae
chore: updated tetra-rp
deanq
committed
90e3b9a
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1092-tetra-volume-warm-cache
deanq
committed
a2f67d3
fix: duplicated lines due to bad merge conflict resolution
deanq
committed
e578007

Commits on Sep 14, 2025

Merge branch 'main' into deanq/ae-962-log-streaming
deanq
committed
7e7201e
chore: update uv.lock
deanq
committed
8091476

Commits on Sep 15, 2025

fix: test-handler was not exactly testing properly
deanq
committed
8c8f902

Commits on Sep 17, 2025

Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1165-bug-pytorchs-not-found
deanq
committed
47699d2
chore: use GPU build for smoke tests
deanq
committed
c6ac06d
fix: multi-stage build loses crucial built-in system Python
deanq
committed
cc92323
chore: updated to latest submodule state
deanq
committed
83787e7
fix: local/macos testing fails due to lack of apt-get or nala
deanq
committed
b99af9d
test: tests to confirm system Python access
deanq
committed
736c2eb
refactor: install_dependencies relies on uv and pip provisions
deanq
committed
0785310
chore: better debug logs for dependency_installer
deanq
committed
16f7a1b
feat: implement universal subprocess utility with automatic logging
deanq
committed
ee6595e

Commits on Sep 18, 2025

fix: use Docker detection for dependency installation method
deanq
committed
8c259c2
docs: update CLAUDE.md with universal subprocess utility documentation
deanq
committed
fcd51bd
chore: vscode config to point to src
deanq
committed
b980e51
chore: no need for a NALA_CHECK_CMD constant
deanq
committed
0bda8a1
build: update submodule
deanq
committed
177c3d2
chore: logs namespace is now just `tetra`
deanq
committed
d365f2a
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1165-bug-pytorchs-not-found
deanq
committed
8b2cf5f
docs: System Python Runtime Architecture
deanq
committed
b95451d
docs: Centralized Log Streaming System
deanq
committed
011890a
Merge branch 'main' into deanq/ae-1092-tetra-volume-warm-cache
deanq
committed
d1a6fa2
chore: update submodule
deanq
committed
22d80cf
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1092-tetra-volume-warm-cache
deanq
committed
55eac77
Merge branch 'deanq/ae-1165-bug-pytorchs-not-found' into deanq/ae-1092-tetra-volume-warm-cache
deanq
committed
a277bc0

Commits on Sep 22, 2025

Commits on Sep 23, 2025

refactor: reorganize test_*.json files into src/tests/ directory
deanq
committed
9ddb6d8

Commits on Sep 26, 2025

Commits on Sep 27, 2025

Merge branch 'deanq/ae-1092-tetra-volume-warm-cache' of https://github.com/runpod-workers/worker-tetra into deanq/ae-1092-tetra-volume-warm-cache
deanq
committed
1c4b046

Commits on Sep 28, 2025

build: consolidated local-execution-test and docker-pr into docker-test
deanq
committed
19498ff
build: make sure all of src/ is copied
deanq
committed
b0b3ec7

Commits on Sep 30, 2025

Commits on Oct 1, 2025

refactor: huggingface_accelerator -> huggingface_cache
deanq
committed
a01ae7e
refactor: completely removed workspace manager
deanq
committed
e95afb5
docs: updated docs with the latest refactors
deanq
committed
7a4093d
fix: set non-error debug log when cached for the first time
deanq
committed
7880b2b
fix: catch CacheNotFound instead
deanq
committed
4132da8
refactor: remove log acceleration summary
deanq
committed
7d9e82a

Commits on Oct 2, 2025

fix: make sure uv uses caching for downloaded artifacts
deanq
committed
2b1642e

Commits on Oct 4, 2025

refactor: cleanup, optimization, and simplified after many observations
deanq
committed
01e060f

Commits on Oct 6, 2025

fix: deleted duplicate code block

deanq
and
Copilot
authored
6a5d87d
chore: simplified happy path return
deanq
committed
c191b02
Merge branch 'deanq/ae-1092-tetra-volume-warm-cache' into deanq/ae-1092-volume-cache-sync
deanq
committed
9eb3875
docs: updated the docstring to reflect function's intent
deanq
committed
7e26412
fix: result.error not .stdout
deanq
committed
a74fa09
Merge branch 'main' into deanq/ae-1092-volume-cache-sync
deanq
committed
e2d2608
fix: bad merge
deanq
committed
239d96b

Commits on Oct 8, 2025

refactor: HuggingFace cache location set outside `/root/.cache` to exclude from volume sync
deanq
committed
580b9f3

Commits on Oct 9, 2025

build: tetra-rp submodule should be pinned
deanq
committed
18e3a53
build: correction
deanq
committed
fc465cb
build: `make update` also updates submodule
deanq
committed
1813263
chore: `make update` correction
deanq
committed
203756c

Commits on Oct 10, 2025