Update gcc_pre-requisites and get py312 changes for gcc15 by akritkbehera · Pull Request #10338 · cms-sw/cmsdist

akritkbehera · 2026-02-11T13:51:06Z

No description provided.

cmsbuild · 2026-02-11T13:51:29Z

A new Pull Request was created by @akritkbehera for branch IB/CMSSW_16_1_X/g15.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2026-02-11T13:51:30Z

cms-bot internal usage

akritkbehera · 2026-02-11T13:54:43Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

cmsbuild · 2026-02-12T00:08:34Z

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51261/summary.html
COMMIT: f3683bc
CMSSW: CMSSW_16_1_X_2026-02-05-2300/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51261/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51261/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51261/git-merge-result

Failed Unit Tests

I found 5 errors in the following unit tests:

---> test TestFWCoreReflectionClassVersionUpdate had ERRORS
---> test TestIOPoolInputNoParentDictionary had ERRORS
---> test CudaGCCSupport had ERRORS
and more ...

Failed RelVals

+ echo 'ERROR : runTheMatrix returned non-zero exit code'
ERROR : runTheMatrix returned non-zero exit code
ERROR Running runTheMatrix for '-s -l 9.0,101.0,1306.0,10224.0,25202.0,250202.181'

Failed AddOn Tests

unknown

AddOnTest might have timed out: FAILED -  secs

* Update gettext version in autotools.spec Updated gettext version from 0.22 to 0.22.5 in autotools.spec. * Update bazel-absl.patch * Upgrade Bazel version to 6.5.0 Updated Bazel version from 5.3.0 to 6.5.0 and modified C++ options. * Updates from py312 branches * py312 changes

cmsbuild · 2026-02-12T10:43:26Z

Pull request #10338 was updated.

cmsbuild · 2026-02-12T10:46:38Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51282/summary.html
COMMIT: 0eec3a5
CMSSW: CMSSW_16_1_X_2026-02-05-2300/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51282/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

akritkbehera · 2026-02-12T10:51:38Z

test parameters:

full_cmssw = true

akritkbehera · 2026-02-12T10:51:51Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

cmsbuild · 2026-02-12T10:53:44Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51283/summary.html
COMMIT: 0eec3a5
CMSSW: CMSSW_16_1_X_2026-02-05-2300/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51283/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

cmsbuild · 2026-02-18T22:00:15Z

Pull request #10338 was updated.

akritkbehera · 2026-02-18T22:02:10Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

cmsbuild · 2026-02-19T07:37:27Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51422/summary.html
COMMIT: b6ef103
CMSSW: CMSSW_16_1_X_2026-02-18-1100/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51422/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51422/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51422/git-merge-result

Failed Build

I found compilation error when building:

Entering library rule at PhysicsTools/TensorFlow
>> Compiling  src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/gcc/15.2.1-c6197a2919ecf1f2d0282333cd56ba08/bin/c++ -c -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DTBB_USE_GLIBCXX_VERSION=150201 -DTBB_SUPPRESS_DEPRECATED_MESSAGES -DTBB_PREVIEW_RESUMABLE_TASKS=1 -DTBB_PREVIEW_TASK_GROUP_EXTENSIONS=1 -DBOOST_SPIRIT_THREADSAFE -DPHOENIX_THREADSAFE -DBOOST_MATH_DISABLE_STD_FPCLASSIFY -DBOOST_UUID_RANDOM_PROVIDER_FORCE_POSIX -DBOOST_MPL_IGNORE_PARENTHESES_WARNING -DCMSSW_GIT_HASH='CMSSW_16_1_X_2026-02-18-1100' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_16_1_X_2026-02-18-1100' -Isrc -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libpng/1.6.44-2a95899699d6c864ad858dbd54c155cb/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/pcre/8.43-ec84173c1428d60234cb787605f3df30/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/boost/1.80.0-eb43411874ec679e1bd776fa8241baf3/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/bz2lib/1.0.8-bd0b2b945cdb00a361d20f99a15294ae/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/giflib/5.2.1-c01028fcb79066fb8ccc0f217b8cc0ba/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libjpeg-turbo/3.0.4-716d83e69516d1481278955320b34a4b/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libuuid/2.40-a2c26098032eb5a804a4fb2daa5f93b8/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/protobuf/3.21.9-e5c4295af8e99be673c2a0ef1df5e0a3/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/lcg/root/6.36.09-e543454e147631d66d63fcc59bc49dc4/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/sqlite/3.48.0-3e020d9389275550f1728d7de29289e6/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tbb/v2022.3.0-8ad5bb472fa463bed6782b09189dc164/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/xz/5.6.4-038e4cccb945b7ddc800d411532d0a45/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/zlib/1.3.2-6e56413024edb1e56f4c52340d2ae0b0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include/eigen3 -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/md5/1.0.0-67dd8f37d96fe51775512dd54ca438a0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tinyxml2/6.2.0-a847dc50566f74411ca5cd85e734f91f/include -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++23 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DEIGEN_DONT_PARALLELIZE -DEIGEN_MAX_ALIGN_BYTES=64 -Wno-error=unused-variable -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC -MMD -MF tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/ES_TfGraphDefWrapper.cc.d src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc -o tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/ES_TfGraphDefWrapper.cc.o
In file included from src/PhysicsTools/TensorFlow/interface/TfGraphDefWrapper.h:4,
                 from src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc:1:
src/PhysicsTools/TensorFlow/interface/TensorFlow.h:11:10: fatal error: tensorflow/core/framework/tensor.h: No such file or directory
   11 | #include "tensorflow/core/framework/tensor.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from src/PhysicsTools/TensorFlow/interface/TfGraphDefWrapper.h:4,
                 from src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc:1:

Removed BuildRequires line for bazel, java-env, git, and patchelf.

cmsbuild · 2026-02-19T07:51:09Z

Pull request #10338 was updated.

Added 'bazel', 'java-env', and 'git' to the Requires and BuildRequires sections.

cmsbuild · 2026-02-19T07:52:13Z

Pull request #10338 was updated.

cmsbuild · 2026-02-19T07:57:23Z

Pull request #10338 was updated.

akritkbehera · 2026-02-19T09:05:14Z

So this error is because of py3-tensorflow not being available for some reason on where it should be.
installing the IBs locally and running scram info gives more detail which could be the reason of failure.

Singularity> scram tool info tensorflow-cc
Tool info as configured in location /build/akb/CMSSW_16_1_X_2026-02-16-1100
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Name : tensorflow-cc
Version : 2.17.0-489bede1f866ba9bbf60f897fffe1834
Revision : 1
++++++++++++++++++++

LIB=tensorflow_cc
USE=tensorflow-framework eigen libpng sqlite

Singularity> scram tool info tensorflow-includes
Tool info as configured in location /build/akb/CMSSW_16_1_X_2026-02-16-1100
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Name : tensorflow-includes
Version : 2.17.0-8f7640a2bbaeb11dbeaf6407ccada5f4
Revision : 1
++++++++++++++++++++

INCLUDE=/cvmfs/cms-ib.cern.ch/week1/el9_amd64_gcc15/external/py3-tensorflow/2.17.0-8f7640a2bbaeb11dbeaf6407ccada5f4/lib/python3.12/site-packages/tensorflow/include
TENSORFLOW_INCLUDES_BASE=/cvmfs/cms-ib.cern.ch/week1/el9_amd64_gcc15/external/py3-tensorflow/2.17.0-8f7640a2bbaeb11dbeaf6407ccada5f4

Singularity> ls /cvmfs/cms-ib.cern.ch/week1/el9_amd64_gcc15/external/py3-tensorflow/2.17.0-8f7640a2bbaeb11dbeaf6407ccada5f4
ls: cannot access '/cvmfs/cms-ib.cern.ch/week1/el9_amd64_gcc15/external/py3-tensorflow/2.17.0-8f7640a2bbaeb11dbeaf6407ccada5f4': No such file or directory

akritkbehera · 2026-02-19T10:17:03Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

smuzaffar · 2026-02-19T12:32:17Z

@@ -0,0 +1 @@
+Requires: py3-pbr


@akritkbehera , there is also ‎pip/pip/lockfile.file newly added file, I think that file is not needed

cmsbuild · 2026-02-19T15:15:37Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51427/summary.html
COMMIT: 44a493d
CMSSW: CMSSW_16_1_X_2026-02-18-1100/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51427/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51427/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51427/git-merge-result

Failed Build

I found compilation error when building:

Entering library rule at PhysicsTools/TensorFlow
>> Compiling  src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/gcc/15.2.1-c6197a2919ecf1f2d0282333cd56ba08/bin/c++ -c -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DTBB_USE_GLIBCXX_VERSION=150201 -DTBB_SUPPRESS_DEPRECATED_MESSAGES -DTBB_PREVIEW_RESUMABLE_TASKS=1 -DTBB_PREVIEW_TASK_GROUP_EXTENSIONS=1 -DBOOST_SPIRIT_THREADSAFE -DPHOENIX_THREADSAFE -DBOOST_MATH_DISABLE_STD_FPCLASSIFY -DBOOST_UUID_RANDOM_PROVIDER_FORCE_POSIX -DBOOST_MPL_IGNORE_PARENTHESES_WARNING -DCMSSW_GIT_HASH='CMSSW_16_1_X_2026-02-18-1100' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_16_1_X_2026-02-18-1100' -Isrc -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libpng/1.6.44-2a95899699d6c864ad858dbd54c155cb/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/pcre/8.43-ec84173c1428d60234cb787605f3df30/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/boost/1.80.0-eb43411874ec679e1bd776fa8241baf3/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/bz2lib/1.0.8-bd0b2b945cdb00a361d20f99a15294ae/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/giflib/5.2.1-c01028fcb79066fb8ccc0f217b8cc0ba/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libjpeg-turbo/3.0.4-716d83e69516d1481278955320b34a4b/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libuuid/2.40-a2c26098032eb5a804a4fb2daa5f93b8/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/protobuf/3.21.9-e5c4295af8e99be673c2a0ef1df5e0a3/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/lcg/root/6.36.09-e543454e147631d66d63fcc59bc49dc4/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/sqlite/3.48.0-3e020d9389275550f1728d7de29289e6/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tbb/v2022.3.0-8ad5bb472fa463bed6782b09189dc164/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/xz/5.6.4-038e4cccb945b7ddc800d411532d0a45/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/zlib/1.3.2-6e56413024edb1e56f4c52340d2ae0b0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include/eigen3 -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/md5/1.0.0-67dd8f37d96fe51775512dd54ca438a0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tinyxml2/6.2.0-a847dc50566f74411ca5cd85e734f91f/include -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++23 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DEIGEN_DONT_PARALLELIZE -DEIGEN_MAX_ALIGN_BYTES=64 -Wno-error=unused-variable -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC -MMD -MF tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/ES_TfGraphDefWrapper.cc.d src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc -o tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/ES_TfGraphDefWrapper.cc.o
In file included from src/PhysicsTools/TensorFlow/interface/TfGraphDefWrapper.h:4,
                 from src/PhysicsTools/TensorFlow/src/ES_TfGraphDefWrapper.cc:1:
src/PhysicsTools/TensorFlow/interface/TensorFlow.h:11:10: fatal error: tensorflow/core/framework/tensor.h: No such file or directory
   11 | #include "tensorflow/core/framework/tensor.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
>> Compiling  src/PhysicsTools/TensorFlow/src/TensorFlow.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/gcc/15.2.1-c6197a2919ecf1f2d0282333cd56ba08/bin/c++ -c -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DTBB_USE_GLIBCXX_VERSION=150201 -DTBB_SUPPRESS_DEPRECATED_MESSAGES -DTBB_PREVIEW_RESUMABLE_TASKS=1 -DTBB_PREVIEW_TASK_GROUP_EXTENSIONS=1 -DBOOST_SPIRIT_THREADSAFE -DPHOENIX_THREADSAFE -DBOOST_MATH_DISABLE_STD_FPCLASSIFY -DBOOST_UUID_RANDOM_PROVIDER_FORCE_POSIX -DBOOST_MPL_IGNORE_PARENTHESES_WARNING -DCMSSW_GIT_HASH='CMSSW_16_1_X_2026-02-18-1100' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_16_1_X_2026-02-18-1100' -Isrc -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libpng/1.6.44-2a95899699d6c864ad858dbd54c155cb/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/pcre/8.43-ec84173c1428d60234cb787605f3df30/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/boost/1.80.0-eb43411874ec679e1bd776fa8241baf3/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/bz2lib/1.0.8-bd0b2b945cdb00a361d20f99a15294ae/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/giflib/5.2.1-c01028fcb79066fb8ccc0f217b8cc0ba/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libjpeg-turbo/3.0.4-716d83e69516d1481278955320b34a4b/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/libuuid/2.40-a2c26098032eb5a804a4fb2daa5f93b8/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/protobuf/3.21.9-e5c4295af8e99be673c2a0ef1df5e0a3/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/lcg/root/6.36.09-e543454e147631d66d63fcc59bc49dc4/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/sqlite/3.48.0-3e020d9389275550f1728d7de29289e6/include -isystem/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tbb/v2022.3.0-8ad5bb472fa463bed6782b09189dc164/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/xz/5.6.4-038e4cccb945b7ddc800d411532d0a45/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/zlib/1.3.2-6e56413024edb1e56f4c52340d2ae0b0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-a6884aefdd89ab8d9aa40b22db8497ef/include/eigen3 -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/md5/1.0.0-67dd8f37d96fe51775512dd54ca438a0/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el9_amd64_gcc15/external/tinyxml2/6.2.0-a847dc50566f74411ca5cd85e734f91f/include -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++23 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DEIGEN_DONT_PARALLELIZE -DEIGEN_MAX_ALIGN_BYTES=64 -Wno-error=unused-variable -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC -MMD -MF tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/TensorFlow.cc.d src/PhysicsTools/TensorFlow/src/TensorFlow.cc -o tmp/el9_amd64_gcc15/src/PhysicsTools/TensorFlow/src/PhysicsToolsTensorFlow/TensorFlow.cc.o

akritkbehera · 2026-02-20T12:09:29Z

Caused due to

Singularity> scram tool info tensorflow
Tool info as configured in location /build/akb/IBs/CMSSW_16_1_X_2026-02-18-1100
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Name : tensorflow
Version : 2.17.0-f9d87b741e7a3db8d51c5253f8dbf5d1
Revision : 2
++++++++++++++++++++

INCLUDE=TENSORFLOW_BASE/include
KERAS_BACKEND=tensorflow
LIBDIR=TENSORFLOW_BASE/lib
SYSTEM_INCLUDE+=1
TENSORFLOW_BASE=TENSORFLOW_BASE
TF_CPP_MIN_LOG_LEVEL=3

TENSORFLOW_BASE was not populated even though the directory is present in cvmfs.

akritkbehera · 2026-02-20T12:11:16Z

 <tool name="@TOOL@" version="@TOOL_VERSION@" revision="2">
  <client>
-    <environment name="@TOOL_BASE@" default="@TOOL_ROOT@"/>
+    <environment name="@TOOL_BASE@" default="@TOOL_BASE@"/>


Ah ok this caused the issue.

cmsbuild · 2026-02-20T12:12:53Z

Pull request #10338 was updated.

cmsbuild · 2026-02-20T12:15:32Z

Pull request #10338 was updated.

akritkbehera · 2026-02-20T12:30:21Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

cmsbuild · 2026-02-20T13:01:10Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51469/summary.html
COMMIT: 693f5b2
CMSSW: CMSSW_16_1_X_2026-02-18-1100/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51469/install.sh to create a dev area with all the needed externals and cmssw changes.

akritkbehera · 2026-02-20T13:38:31Z

please test for CMSSW_16_1_X/el9_amd64_gcc15

cmsbuild · 2026-02-20T13:38:43Z

Pull request #10338 was updated.

cmsbuild · 2026-02-20T16:49:54Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51471/summary.html
COMMIT: 4adca29
CMSSW: CMSSW_16_1_X_2026-02-18-1100/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10338/51471/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51471/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6375db/51471/git-merge-result

Failed Unit Tests

I found 2 errors in the following unit tests:

---> test CudaGCCSupport had ERRORS
---> test testIntrusiveAllocMonitorOutput had ERRORS

Failed RelVals

312.0

----- Begin Fatal Exception 20-Feb-2026 17:27:10 CET-----------------------
An exception of category 'ExternalFailure' occurred while
   [0] Processing  begin Stream stream: 0
   [1] Calling method for module ExternalGeneratorFilter/'generator'
Exception Message:
Failed waiting for external process while setting up the process. Timed out after 300 seconds.
----- End Fatal Exception -------------------------------------------------

akritkbehera · 2026-02-23T06:24:24Z

The unit tests are also failing on gcc15 IBs. CMSSW_16_1_X_2026-02-20-1100/el9_amd64_gcc15 are not due to this.

akritkbehera · 2026-02-23T06:26:08Z

@smuzaffar We can get this merged.

smuzaffar · 2026-02-23T08:35:55Z

+externals

lets get this in GCC15 IBs. This makes GCC15 IBs to use Python 3.12 as default

cmsbuild · 2026-02-23T08:36:21Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_16_1_X/g15 IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @sextonkennedy, @ftenchini (and backports should be raised in the release meeting by the corresponding L2)

Update version numbers for dependencies in spec file

f3683bc

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels Feb 11, 2026

cmsbuild added tests-started and removed tests-pending labels Feb 11, 2026

cmsbuild added tests-rejected and removed tests-started labels Feb 12, 2026

akritkbehera changed the title ~~Update gcc_pre-requisites for gcc15~~ Update gcc_pre-requisites and get py312 changes for gcc15 Feb 12, 2026

cmsbuild added tests-pending and removed tests-rejected labels Feb 12, 2026

cmsbuild added tests-started and removed tests-pending labels Feb 12, 2026

cmsbuild added tests-rejected and removed tests-started labels Feb 12, 2026

cmsbuild added tests-started and removed tests-rejected labels Feb 12, 2026

cmsbuild added tests-rejected and removed tests-started labels Feb 12, 2026

zlib updates, lhapdf docs dropped, gmake reverted

b6ef103

Move BuildRequires from tensorflow-sources.file

f344a09

Removed BuildRequires line for bazel, java-env, git, and patchelf.

Update tensorflow-requires.file build dependencies

38c98a7

Added 'bazel', 'java-env', and 'git' to the Requires and BuildRequires sections.

Add py3-opt-einsum to requirements

44a493d

smuzaffar reviewed Feb 19, 2026

View reviewed changes

akritkbehera commented Feb 20, 2026

View reviewed changes

Fix environment variable reference in tensorflow.xml

40677e3

Delete pip/pip directory

693f5b2

Fix environment variable syntax in tensorflow.xml

4adca29

		@@ -0,0 +1 @@
		Requires: py3-pbr No newline at end of file

Conversation

akritkbehera commented Feb 11, 2026

Uh oh!

cmsbuild commented Feb 11, 2026

Uh oh!

cmsbuild commented Feb 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

akritkbehera commented Feb 11, 2026

Uh oh!

cmsbuild commented Feb 12, 2026

Failed Unit Tests

Failed RelVals

Failed AddOn Tests

Uh oh!

cmsbuild commented Feb 12, 2026

Uh oh!

cmsbuild commented Feb 12, 2026

Failed External Build

Uh oh!

akritkbehera commented Feb 12, 2026

Uh oh!

akritkbehera commented Feb 12, 2026

Uh oh!

cmsbuild commented Feb 12, 2026

Failed External Build

Uh oh!

cmsbuild commented Feb 18, 2026

Uh oh!

akritkbehera commented Feb 18, 2026

Uh oh!

cmsbuild commented Feb 19, 2026

Failed Build

Uh oh!

cmsbuild commented Feb 19, 2026

Uh oh!

cmsbuild commented Feb 19, 2026

Uh oh!

cmsbuild commented Feb 19, 2026

Uh oh!

akritkbehera commented Feb 19, 2026

Uh oh!

akritkbehera commented Feb 19, 2026

Uh oh!

smuzaffar Feb 19, 2026

Choose a reason for hiding this comment

Uh oh!

cmsbuild commented Feb 19, 2026

Failed Build

Uh oh!

akritkbehera commented Feb 20, 2026

Uh oh!

akritkbehera Feb 20, 2026

Choose a reason for hiding this comment

Uh oh!

cmsbuild commented Feb 20, 2026

Uh oh!

cmsbuild commented Feb 20, 2026

Uh oh!

akritkbehera commented Feb 20, 2026

Uh oh!

cmsbuild commented Feb 20, 2026

Uh oh!

akritkbehera commented Feb 20, 2026

Uh oh!

cmsbuild commented Feb 20, 2026

Uh oh!

cmsbuild commented Feb 20, 2026

Failed Unit Tests

Failed RelVals

Uh oh!

akritkbehera commented Feb 23, 2026

Uh oh!

akritkbehera commented Feb 23, 2026

Uh oh!

smuzaffar commented Feb 23, 2026

Uh oh!

cmsbuild commented Feb 23, 2026

Uh oh!

Reviewers

cmsbuild commented Feb 11, 2026 •

edited

Loading