Skip to content

torch: reduce parallel build process #10174

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
smuzaffar merged 2 commits into from
Nov 5, 2025
Merged

torch: reduce parallel build process #10174

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f83abed
torch: reduce parallel build process
smuzaffar Nov 4, 2025
f8037ac
remobe duplicate env setup
smuzaffar Nov 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions torch-build-env.file
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,14 +18,17 @@ fi
export USE_CUDNN=OFF
%endif

export MAX_JOBS=%compiling_processes
MEM_GB=$(/usr/bin/free -g | awk '/^Mem:/{print $2}')
MAX_JOBS=$(( MEM_GB / 4 ))
if [ $MAX_JOBS -gt %{compiling_processes} ] ; then MAX_JOBS=%{compiling_processes}; fi
if [ $MAX_JOBS -lt 1 ]; then MAX_JOBS=1; fi
export MAX_JOBS
export GCC_ROOT=${GCC_ROOT}
export LibLZMA_ROOT=${XZ_ROOT}
export USE_SYSTEM_PSIMD=ON
export PSIMD_SOURCE_DIR=${PSIMD_ROOT}
export BUILD_CUSTOM_PROTOBUF=OFF
export USE_SYSTEM_EIGEN_INSTALL=ON
export USE_SYSTEM_PSIMD=ON
export USE_SYSTEM_FXDIV=ON
export USE_SYSTEM_PYBIND11=ON
export PYBIND11_SYSPATH=${PY3_PYBIND11_ROOT}
Expand All @@ -50,9 +53,7 @@ export USE_NUMA=ON
export NUMA_ROOT_DIR=${NUMACTL_ROOT}
export USE_NUMPY=OFF
export USE_OPENMP=ON
export USE_QNNPACK=OFF
export USE_VALGRIND=OFF
export USE_XNNPACK=OFF
export USE_MKLDNN=OFF
export USE_DISTRIBUTED=OFF
export USE_MPI=ON
Expand Down