feat: Endpoint Persistence using Network Volume (phase 1)

[deanq]

Phase 1: Remove workspace runtimes from network volume. Simplify any download acceleration that is affected by this refactor. This should speed up any of our examples that have network volumes attached.

Phase 2: Implement the volume cache replicator (#31)

[jhcipar]

🤔 I think this would short circuit a cachce hit to main even if I had specified a different revision
Right now it doesn't matter I don't think because the only place this is called is w/o specifying a revision, but maybe a TODO so this doesn't get forgotten

[deanq]

Right. It won't matter soon because this entire module will be removed here after #31

[Copilot]

Pull Request Overview

This PR implements Phase 1 of endpoint persistence by removing the workspace runtime system from network volumes and simplifying download acceleration. The changes remove workspace-specific persistence (like virtual environments on network volumes) while maintaining HuggingFace model cache-ahead functionality through a simplified direct cache approach.

Key changes:

• Removed WorkspaceManager and all volume-based workspace isolation
• Replaced complex download acceleration strategies with simple HuggingFace cache-ahead
• Updated all executors to work without workspace dependencies

Reviewed Changes

Copilot reviewed 35 out of 51 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
tests/unit/test_workspace_manager.py	Complete removal of workspace manager tests
tests/unit/test_remote_executor.py	Removed workspace manager integration from executor tests
tests/unit/test_huggingface_cache.py	Added new tests for simplified HF cache-ahead functionality
tests/unit/test_hf_download_strategies.py	Removed complex download strategy tests
tests/unit/test_function_executor.py	Simplified function executor tests without workspace dependencies
tests/unit/test_dependency_installer.py	Removed workspace manager dependency from installer tests
tests/unit/test_class_executor.py	Simplified class executor tests without workspace dependencies
tests/integration/test_runpod_volume_integration.py	Removed volume workspace integration tests
tests/integration/test_python_path_integration.py	Removed Python path workspace integration tests
tests/integration/test_hf_strategy_integration.py	Removed HF download strategy integration tests
tests/integration/test_handler_integration.py	Updated integration tests for new HF cache-ahead system
tests/integration/test_download_acceleration_integration.py	Removed complex download acceleration integration tests
src/workspace_manager.py	Complete removal of workspace management system
src/test-handler.sh	Fixed test file path from test_.json to tests/test_.json
src/remote_executor.py	Removed workspace manager, simplified to use HuggingFaceCacheAhead directly
src/logger.py	Updated documentation to reflect new namespace
src/huggingface_cache.py	New simplified HF cache-ahead implementation
src/huggingface_accelerator.py	Removed complex HF acceleration system
src/hf_strategy_factory.py	Removed download strategy factory
src/hf_downloader_tetra.py	Removed Tetra download strategy
src/hf_downloader_native.py	Removed native download strategy
src/hf_download_strategy.py	Removed download strategy interface
src/function_executor.py	Simplified to remove workspace dependencies
src/download_accelerator.py	Removed complex download acceleration system
src/dependency_installer.py	Removed workspace manager dependency
src/constants.py	Simplified to remove workspace-related constants
src/class_executor.py	Simplified to remove workspace dependencies
src/base_executor.py	Removed base executor abstraction
docs/System_Python_Runtime_Architecture.md	Updated architecture diagrams
docs/Endpoint Persistence.md	Added new endpoint persistence documentation
docs/Centralized_Log_Streaming_System.md	Updated sequence diagram
Dockerfile-cpu	Fixed COPY command for src directory
Dockerfile	Added HF_HUB_ENABLE_HF_TRANSFER environment variable and fixed COPY command
CLAUDE.md	Updated documentation to reflect new architecture
.github/workflows/ci.yml	Streamlined CI workflow

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 35 out of 51 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (1)

src/remote_executor.py:258

• The code after the else block was removed but the same logic is duplicated below. This creates unreachable code as the function returns in the if block above.

        # All tasks succeeded
        return FunctionResponse(
            success=True,
            stdout=f"Parallel installation: {success_count}/{len(results)} tasks completed successfully\n"
            + "\n".join(stdout_parts),
        )

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 35 out of 51 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (1)

src/remote_executor.py:258

• Unreachable code detected. The else block at line 252 has been removed, but the code that follows is duplicated logic that will never be reached due to the return statement above it.

        # All tasks succeeded
        return FunctionResponse(
            success=True,
            stdout=f"Parallel installation: {success_count}/{len(results)} tasks completed successfully\n"
            + "\n".join(stdout_parts),
        )

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}