Skip to content
Merged
Show file tree
Hide file tree
Changes from 103 commits
Commits
Show all changes
108 commits
Select commit Hold shift + click to select a range
09ab3e1
feat: add download acceleration infrastructure
deanq Aug 16, 2025
795c9e5
feat: integrate download acceleration with dependency installer
deanq Aug 16, 2025
046eb58
feat: add workspace acceleration support
deanq Aug 16, 2025
45a65fe
test: add download acceleration test coverage
deanq Aug 16, 2025
ce51390
chore: moved test-handler files to src/
deanq Aug 16, 2025
6c04de1
feat: runtime uses aria2 for accelerated parallel downloads
deanq Aug 16, 2025
66eb286
chore: update project structure and dependencies
deanq Aug 16, 2025
1930b4b
chore: updated tetra-rp
deanq Aug 19, 2025
731fd56
build: local-execution-test use make test-handler
deanq Aug 19, 2025
e829140
chore: update CLAUDE.md
deanq Aug 19, 2025
104b2da
chore: move these values to constants.py for maintainability
deanq Aug 19, 2025
f8aa89a
feat: add system package acceleration with nala
deanq Aug 19, 2025
cd56185
refactor: disable Python package download acceleration
deanq Aug 20, 2025
d7c996d
test: uv is no longer part of download accelerator
deanq Aug 20, 2025
2ab93e3
feat: implement accelerate_downloads parameter logic in RemoteExecutor
deanq Aug 21, 2025
b50a7bf
feat: add pip fallback for Python dependencies when acceleration disa…
deanq Aug 21, 2025
440d00d
feat: enhance HF model caching with hf_transfer/hf_xet strategy
deanq Aug 21, 2025
0320e4d
test: add comprehensive coverage for accelerate_downloads parameter
deanq Aug 21, 2025
034f770
test: update integration tests for new acceleration parameter
deanq Aug 21, 2025
9531079
chore: update dependencies and constants for download acceleration
deanq Aug 21, 2025
d75d320
refactor: remove pip installation method from dependency installer
deanq Aug 21, 2025
227b33e
test: update unit tests to expect UV instead of pip
deanq Aug 21, 2025
338a165
test: rename test file from pip to UV naming convention
deanq Aug 21, 2025
f88745d
feat: implement parallel execution for accelerated downloads
deanq Aug 21, 2025
f22e74d
feat: add async wrapper for HuggingFace model download acceleration
deanq Aug 21, 2025
816fc75
test: update tests for parallel execution and async dependencies
deanq Aug 21, 2025
c9ad0d3
test: comprehensive test coverage expansion and cleanup
deanq Aug 21, 2025
e31137a
refactor: optimize HF acceleration to use native Hub features
deanq Aug 21, 2025
e1db417
chore: memory correction
deanq Aug 21, 2025
76ab9c0
feat: implement HuggingFace download acceleration strategies
deanq Aug 21, 2025
c269bcd
feat: implement centralized log streaming system
deanq Aug 21, 2025
04e5b54
chore: these logs are for debug level
deanq Aug 21, 2025
f1db33a
chore: specs for Endpoint Persistence using Network Volume and CDR
deanq Aug 22, 2025
bb27ae3
chore: local setup
deanq Aug 22, 2025
f232a9c
Merge branch 'main' into deanq/ae-962-log-streaming
deanq Aug 29, 2025
83b3293
fix: merge conflicts
deanq Aug 29, 2025
f9a068c
chore: make update
deanq Aug 29, 2025
692d8fc
chore: these are debug lines
deanq Aug 29, 2025
ce2deae
chore: nala logs were too noisy
deanq Aug 29, 2025
90e3b9a
chore: updated tetra-rp
deanq Aug 29, 2025
a2f67d3
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1092-tetra-vo…
deanq Aug 29, 2025
e578007
fix: duplicated lines due to bad merge conflict resolution
deanq Aug 29, 2025
7e7201e
Merge branch 'main' into deanq/ae-962-log-streaming
deanq Sep 14, 2025
8091476
chore: update uv.lock
deanq Sep 14, 2025
8c8f902
fix: test-handler was not exactly testing properly
deanq Sep 15, 2025
47699d2
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1165-bug-pyto…
deanq Sep 17, 2025
c6ac06d
chore: use GPU build for smoke tests
deanq Sep 17, 2025
cc92323
fix: multi-stage build loses crucial built-in system Python
deanq Sep 17, 2025
83787e7
chore: updated to latest submodule state
deanq Sep 17, 2025
b99af9d
fix: local/macos testing fails due to lack of apt-get or nala
deanq Sep 17, 2025
736c2eb
test: tests to confirm system Python access
deanq Sep 17, 2025
0785310
refactor: install_dependencies relies on uv and pip provisions
deanq Sep 17, 2025
16f7a1b
chore: better debug logs for dependency_installer
deanq Sep 17, 2025
ee6595e
feat: implement universal subprocess utility with automatic logging
deanq Sep 17, 2025
8c259c2
fix: use Docker detection for dependency installation method
deanq Sep 18, 2025
fcd51bd
docs: update CLAUDE.md with universal subprocess utility documentation
deanq Sep 18, 2025
b980e51
chore: vscode config to point to src
deanq Sep 18, 2025
0bda8a1
chore: no need for a NALA_CHECK_CMD constant
deanq Sep 18, 2025
177c3d2
build: update submodule
deanq Sep 18, 2025
d365f2a
chore: logs namespace is now just `tetra`
deanq Sep 18, 2025
8b2cf5f
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1165-bug-pyto…
deanq Sep 18, 2025
b95451d
docs: System Python Runtime Architecture
deanq Sep 18, 2025
011890a
docs: Centralized Log Streaming System
deanq Sep 18, 2025
d1a6fa2
Merge branch 'main' into deanq/ae-1092-tetra-volume-warm-cache
deanq Sep 18, 2025
22d80cf
chore: update submodule
deanq Sep 18, 2025
55eac77
Merge branch 'deanq/ae-962-log-streaming' into deanq/ae-1092-tetra-vo…
deanq Sep 18, 2025
a277bc0
Merge branch 'deanq/ae-1165-bug-pytorchs-not-found' into deanq/ae-109…
deanq Sep 18, 2025
f11b4dc
chore: update and cleanup
deanq Sep 22, 2025
e2fe764
fix: docker uses system's conda python; local uses uv
deanq Sep 22, 2025
c1c95c8
refactor: configurable `NAMESPACE` for logs; default: tetra
deanq Sep 22, 2025
df70047
refactor: no longer need to setup python paths in workspace
deanq Sep 22, 2025
d1a832c
Merge branch 'deanq/ae-1165-bug-pytorchs-not-found' into deanq/ae-109…
deanq Sep 22, 2025
9ddb6d8
refactor: reorganize test_*.json files into src/tests/ directory
deanq Sep 23, 2025
d4e1366
Merge branch 'main' into deanq/ae-1092-tetra-volume-warm-cache
deanq Sep 26, 2025
0a61a98
fix: incorrect merge
deanq Sep 26, 2025
90ebc63
chore: update version from release
deanq Sep 26, 2025
91d621b
chore: these tests were moved to src/tests/
deanq Sep 26, 2025
1c4b046
Merge branch 'deanq/ae-1092-tetra-volume-warm-cache' of https://githu…
deanq Sep 27, 2025
19498ff
build: consolidated local-execution-test and docker-pr into docker-test
deanq Sep 28, 2025
b0b3ec7
build: make sure all of src/ is copied
deanq Sep 28, 2025
168e4ef
refactor: removed the use of network volume as runtime workspaces
deanq Sep 30, 2025
54fe320
refactor: remove workspace_manager dependency from all modules
deanq Sep 30, 2025
a01ae7e
refactor: huggingface_accelerator -> huggingface_cache
deanq Oct 1, 2025
e95afb5
refactor: completely removed workspace manager
deanq Oct 1, 2025
7a4093d
docs: updated docs with the latest refactors
deanq Oct 1, 2025
7880b2b
fix: set non-error debug log when cached for the first time
deanq Oct 1, 2025
4132da8
fix: catch CacheNotFound instead
deanq Oct 1, 2025
7d9e82a
refactor: remove log acceleration summary
deanq Oct 1, 2025
2b1642e
fix: make sure uv uses caching for downloaded artifacts
deanq Oct 2, 2025
b28de41
feat: cache sync manager.sync_to_volume_async to tarball cache changes
deanq Oct 3, 2025
be75698
chore: rename sync_to_volume_async to sync_to_volume
deanq Oct 3, 2025
86f6063
feat: cache sync manager. hydrate_from_volume to hydrate container ca…
deanq Oct 3, 2025
ab63b88
fix: huggingface cache was only recognizing main branch
deanq Oct 3, 2025
01e060f
refactor: cleanup, optimization, and simplified after many observations
deanq Oct 4, 2025
6a5d87d
fix: deleted duplicate code block
deanq Oct 6, 2025
c191b02
chore: simplified happy path return
deanq Oct 6, 2025
9eb3875
Merge branch 'deanq/ae-1092-tetra-volume-warm-cache' into deanq/ae-10…
deanq Oct 6, 2025
7e26412
docs: updated the docstring to reflect function's intent
deanq Oct 6, 2025
a74fa09
fix: result.error not .stdout
deanq Oct 6, 2025
e2d2608
Merge branch 'main' into deanq/ae-1092-volume-cache-sync
deanq Oct 6, 2025
239d96b
fix: bad merge
deanq Oct 6, 2025
580b9f3
refactor: HuggingFace cache location set outside `/root/.cache` to ex…
deanq Oct 8, 2025
18e3a53
build: tetra-rp submodule should be pinned
deanq Oct 9, 2025
fc465cb
build: correction
deanq Oct 9, 2025
1813263
build: `make update` also updates submodule
deanq Oct 9, 2025
203756c
chore: `make update` correction
deanq Oct 9, 2025
e2f9dec
feat: debug line for current tarball size
deanq Oct 10, 2025
03068cd
feature: pre-installed build-essential and ensuring apt-get cache are…
deanq Oct 10, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

- name: Build CPU Docker image
Expand Down Expand Up @@ -183,7 +183,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

- name: Build and push GPU Docker image (main)
Expand Down Expand Up @@ -236,7 +236,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

- name: Build and push CPU Docker image (main)
Expand Down Expand Up @@ -299,7 +299,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

- name: Build and push GPU Docker image (prod)
Expand Down Expand Up @@ -362,7 +362,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

- name: Build and push CPU Docker image (prod)
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ jobs:
- name: Setup dependencies
run: |
uv sync
git submodule update --remote --rebase
git submodule update
cp tetra-rp/src/tetra_rp/protos/remote_execution.py .

- name: Build and push GPU Docker image
Expand Down
1 change: 1 addition & 0 deletions CLAUDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -146,6 +146,7 @@ git submodule update --remote --rebase # Update tetra-rp to latest
- `RUNPOD_ENDPOINT_ID`: Used for workspace isolation (automatically set by RunPod)
- `HF_HUB_ENABLE_HF_TRANSFER`: Set to "1" in Dockerfile to enable accelerated HuggingFace downloads
- `HF_TOKEN`: Optional authentication token for private/gated HuggingFace models
- `HF_HOME=/hf-cache`: HuggingFace cache location, set outside `/root/.cache` to exclude from volume sync
- `DEBIAN_FRONTEND=noninteractive`: Set during system package installation
- `UV_CACHE_DIR`: Package cache configuration
- `VIRTUAL_ENV`: Virtual environment path configuration
Expand Down
2 changes: 2 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@ WORKDIR /app

# Enable HuggingFace transfer acceleration
ENV HF_HUB_ENABLE_HF_TRANSFER=1
# Relocate HuggingFace cache outside /root/.cache to exclude from volume sync
ENV HF_HOME=/hf-cache

# Install system dependencies and uv
RUN apt-get update && apt-get install -y --no-install-recommends \
Expand Down
3 changes: 1 addition & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,7 @@ clean: # Remove build artifacts and cache files
find . -type f -name "*.pkl" -delete

setup: dev # Initialize project, sync deps, update submodules
git submodule init
git submodule update --remote --rebase
git submodule update --init --recursive
cp tetra-rp/src/tetra_rp/protos/remote_execution.py src/

build: # Build both GPU and CPU Docker images
Expand Down
2 changes: 1 addition & 1 deletion docs/System_Python_Runtime_Architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ graph TB
### System Installation Strategy
```python
# Docker environment
command = ["uv", "pip", "install", "--system", "--no-cache"] + packages
command = ["uv", "pip", "install", "--system"] + packages

# Local environment
command = ["uv", "pip", "install", "--python-preference=managed"] + packages
Expand Down
Loading
Loading