Skip to content

Disable eigen debug for CUDA compilers too#10

Merged
smuzaffar merged 1 commit intocms/master/c1d637433e3b3f9012b226c2c9125c494b470ae6from
smuzaffar-patch-2
Feb 7, 2026
Merged

Disable eigen debug for CUDA compilers too#10
smuzaffar merged 1 commit intocms/master/c1d637433e3b3f9012b226c2c9125c494b470ae6from
smuzaffar-patch-2

Conversation

@smuzaffar
Copy link
Copy Markdown

@cmsbuild
Copy link
Copy Markdown

A new Pull Request was created by @smuzaffar for branch cms/master/c1d637433e3b3f9012b226c2c9125c494b470ae6.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Copy Markdown

cmsbuild commented Jan 29, 2026

cms-bot internal usage

@smuzaffar
Copy link
Copy Markdown
Author

test parameters:

  • enable = gpu
  • gpu = nvidia

@smuzaffar
Copy link
Copy Markdown
Author

please test for CMSSW_16_1_PY312_X

@cmsbuild
Copy link
Copy Markdown

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/50996/summary.html
COMMIT: d8967be
CMSSW: CMSSW_16_1_PY312_X_2026-01-28-2300/el8_amd64_gcc13
Additional Tests: GPU,NVIDIA_H100,NVIDIA_L40S
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-externals/eigen-git-mirror/10/50996/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/50996/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/50996/git-merge-result

Failed Build

I found compilation error when building:

  __attribute__((host)) __attribute__((device))
                 ^

Remark: The warnings can be suppressed with "-diag-suppress "

src/HeterogeneousCore/CUDAUtilities/test/eigenSoA_t.h(19): error: identifier "assert" is undefined
    assert(!isPowerOf2(0));
    ^

1 error detected in the compilation of "src/HeterogeneousCore/CUDAUtilities/test/eigenSoA_t.cu".
gmake: *** [tmp/el8_amd64_gcc13/src/HeterogeneousCore/CUDAUtilities/test/gpuEigenSoA_debug/eigenSoA_t.cu.o] Error 1


@smuzaffar
Copy link
Copy Markdown
Author

smuzaffar commented Jan 29, 2026

@fwyzard , for this warning [a] should we drop https://github.com/cms-externals/eigen-git-mirror/blob/cms/master/c1d637433e3b3f9012b226c2c9125c494b470ae6/Eigen/src/Core/util/IntegralConstant.h#L230 ?

With the change in this PR, now we get build error from https://github.com/cms-sw/cmssw/blob/master/HeterogeneousCore/CUDAUtilities/test/eigenSoA_t.h#L19-L22

src/HeterogeneousCore/CUDAUtilities/test/eigenSoA_t.h(19): error: identifier "assert" is undefined
    assert(!isPowerOf2(0));

[a]

/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-9f21ff0561c23386758e960abac68a54/include/eigen3/Eigen/src/Core/util/IntegralConstant.h(230): warning #1835-D: attribute "__host__" does not apply here
  __attribute__((host)) __attribute__((device))
                 ^

@smuzaffar smuzaffar changed the title Disable eigne debug for CUDA compilers too Disable eigen debug for CUDA compilers too Feb 2, 2026
@smuzaffar
Copy link
Copy Markdown
Author

please test with cms-sw/cmssw#49997 for CMSSW_16_1_PY312_X

@cmsbuild
Copy link
Copy Markdown

cmsbuild commented Feb 3, 2026

-1

Failed Tests: nvidia_h100UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51041/summary.html
COMMIT: d8967be
CMSSW: CMSSW_16_1_PY312_X_2026-02-01-2300/el8_amd64_gcc13
Additional Tests: GPU,NVIDIA_H100,NVIDIA_L40S
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-externals/eigen-git-mirror/10/51041/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

The workflows 2025.0010001, 2024.0050001, 2022.0030001 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

Summary:

  • You potentially added 206 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 10037 differences found in the comparisons
  • DQMHistoTests: Total files compared: 52
  • DQMHistoTests: Total histograms compared: 3974830
  • DQMHistoTests: Total failures: 13563
  • DQMHistoTests: Total nulls: 27
  • DQMHistoTests: Total successes: 3961220
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 14.444 KiB( 50 files compared)
  • DQMHistoSizes: changed ( 2025.0010001 ): 13.707 KiB Hcal/DigiRunHarvesting
  • DQMHistoSizes: changed ( 2025.0010001 ): 0.340 KiB RPC/DCSInfo
  • DQMHistoSizes: changed ( 2025.0010001 ): 0.304 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 2025.0010001 ): 0.094 KiB JetMET/SUSYDQM
  • Checked 222 log files, 193 edm output root files, 52 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Copy Markdown

cmsbuild commented Feb 6, 2026

Pull request #10 was updated.

@smuzaffar
Copy link
Copy Markdown
Author

please test with cms-sw/cmssw#49997 for CMSSW_16_1_PY312_X

@cmsbuild
Copy link
Copy Markdown

cmsbuild commented Feb 7, 2026

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51155/summary.html
COMMIT: 63c7197
CMSSW: CMSSW_16_1_PY312_X_2026-02-05-2300/el8_amd64_gcc13
Additional Tests: GPU,NVIDIA_H100,NVIDIA_L40S
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-externals/eigen-git-mirror/10/51155/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51155/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51155/git-merge-result

Failed Build

I found compilation error when building:

>> Building binary DataFormatscrossV4_t
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/gcc/13.4.0-6908cfdf803923e783448096ca4f0923/bin/c++ -O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -std=c++20 -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -Ofast -fno-reciprocal-math -mrecip=none -DEIGEN_DONT_PARALLELIZE -DEIGEN_MAX_ALIGN_BYTES=64 -Wno-error=unused-variable -DBOOST_DISABLE_ASSERTS -flto=auto -fipa-icf -flto-odr-type-merging -fno-fat-lto-objects -Wodr -fPIC  tmp/el8_amd64_gcc13/src/DataFormats/Math/test/DataFormatscrossV4_t/crossV4_t.cpp.o -Wl,-E -Wl,--hash-style=gnu -Wl,--as-needed -Wl,-z,noexecstack -L/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_16_1_PY312_X_2026-02-05-2300/biglib/el8_amd64_gcc13 -L/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_16_1_PY312_X_2026-02-05-2300/lib/el8_amd64_gcc13 -L/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_16_1_PY312_X_2026-02-05-2300/external/el8_amd64_gcc13/lib -L/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02927/el8_amd64_gcc13/cms/cmssw/CMSSW_16_1_PY312_X_2026-02-05-2300/biglib/el8_amd64_gcc13 -L/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02927/el8_amd64_gcc13/cms/cmssw/CMSSW_16_1_PY312_X_2026-02-05-2300/lib/el8_amd64_gcc13 -L/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_16_1_PY312_X_2026-02-05-2300/static/el8_amd64_gcc13 -L/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02927/el8_amd64_gcc13/cms/cmssw/CMSSW_16_1_PY312_X_2026-02-05-2300/static/el8_amd64_gcc13 -lDataFormatsMath -lDataFormatsCommon -lFWCoreMessageLogger -lDataFormatsProvenance -lFWCoreReflection -lFWCoreUtilities -lTreePlayer -lGraf3d -lPostscript -lGpad -lGraf -lHist -lMatrix -lGenVector -lMathMore -lTree -lNet -lThread -lMathCore -lRIO -lCore -lboost_thread -lboost_date_time -lpcre -lbz2 -lgsl -luuid -ltbb -llzma -lz -lcms-md5 -lopenblas -lcrypt -ldl -lrt -lstdc++fs -ltinyxml2 -o tmp/el8_amd64_gcc13/src/DataFormats/Math/test/DataFormatscrossV4_t/DataFormatscrossV4_t
Copying tmp/el8_amd64_gcc13/src/DataFormats/Math/test/DataFormatscrossV4_t/DataFormatscrossV4_t to productstore area:
>> Compiling  src/DataFormats/Math/test/simpleCholeskyTest.cu
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/cuda/12.9.1-96e6d9d4410db1787e35bbf38b300e4b/bin/nvcc -x cu -MMD -MF tmp/el8_amd64_gcc13/src/DataFormats/Math/test/simpleCholeskyTest/simpleCholeskyTest.cu.d -dc -DCMS_MICRO_ARCH='x86-64-v3' -DGNU_GCC -D_GNU_SOURCE -DTBB_USE_GLIBCXX_VERSION=130400 -DTBB_SUPPRESS_DEPRECATED_MESSAGES -DTBB_PREVIEW_RESUMABLE_TASKS=1 -DTBB_PREVIEW_TASK_GROUP_EXTENSIONS=1 -DBOOST_SPIRIT_THREADSAFE -DPHOENIX_THREADSAFE -DBOOST_MATH_DISABLE_STD_FPCLASSIFY -DBOOST_UUID_RANDOM_PROVIDER_FORCE_POSIX -DBOOST_MPL_IGNORE_PARENTHESES_WARNING -DCMSSW_GIT_HASH='CMSSW_16_1_PY312_X_2026-02-05-2300' -DPROJECT_NAME='CMSSW' -DPROJECT_VERSION='CMSSW_16_1_PY312_X_2026-02-05-2300' -Isrc -Ipoison -I/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02927/el8_amd64_gcc13/cms/cmssw/CMSSW_16_1_PY312_X_2026-02-05-2300/src -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/pcre/8.43-e4ba13e0d816b76532cd363e9fb52c64/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/boost/1.80.0-11091d828913ed577ebfe96b427ec4b4/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/bz2lib/1.0.8-f66d1732a1303a0af1c23d5709f597b8/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/gsl/2.6-9011a41928244b609ca4c22c439b3fef/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/libuuid/2.40-44267405779e2c2bc581a0a76d059a4e/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/lcg/root/6.36.07-f9c81c6e38f2a248aa45239f0d8bef58/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/tbb/v2022.3.0-c78d15835b74d202ab7fa9a9bc9b9e68/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/xz/5.6.4-0463ef784b5f1b2e4f4a4357519b4345/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/zlib/1.3.1-382698e88db78fcd71d4fe9424d877a2/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/cuda/12.9.1-96e6d9d4410db1787e35bbf38b300e4b/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-f05490af1a32ed82a2ccffeb8fd901a5/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-f05490af1a32ed82a2ccffeb8fd901a5/include/eigen3 -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/md5/1.0.0-26057075013e190e56dad37d35219376/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/OpenBLAS/0.3.27-da4a3c2bb8ae43f3913a4a44acdb1b50/include -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/tinyxml2/6.2.0-1767c818b668e34f28a76fcd3ffb7669/include --diag-suppress 20014 -std=c++20 -O3 --generate-line-info --source-in-ptx --display-error-number --expt-relaxed-constexpr --extended-lambda --static-global-template-stub=true --device-entity-has-hidden-visibility=true -gencode arch=compute_60,code=[sm_60,compute_60] -gencode arch=compute_70,code=[sm_70,compute_70] -gencode arch=compute_75,code=[sm_75,compute_75] -gencode arch=compute_80,code=[sm_80,compute_80] -gencode arch=compute_89,code=[sm_89,compute_89] -gencode arch=compute_90,code=[sm_90,compute_90] -Wno-deprecated-gpu-targets -diag-suppress=3012 -diag-suppress=3189 -Xcudafe --diag_suppress=esa_on_defaulted_function_ignored -Xcudafe --gnu_version=130400 --cudart shared -w --compiler-options '-O3 -pthread -pipe -Werror=main -Werror=pointer-arith -Werror=overlength-strings -Wno-vla -Werror=overflow -ftree-vectorize -Werror=array-bounds -Werror=format-contains-nul -Werror=type-limits -fvisibility-inlines-hidden -fno-math-errno --param vect-max-version-for-alias-checks=50 -Xassembler --compress-debug-sections -Wno-error=array-bounds -Warray-bounds -fuse-ld=bfd -march=x86-64-v3 -felide-constructors -fmessage-length=0 -Wall -Wno-non-template-friend -Wno-long-long -Wreturn-type -Wextra -Wpessimizing-move -Wclass-memaccess -Wno-cast-function-type -Wno-unused-but-set-parameter -Wno-ignored-qualifiers -Wno-unused-parameter -Wunused -Wparentheses -Werror=return-type -Werror=unused-value -Werror=unused-label -Werror=address -Werror=format -Werror=sign-compare -Werror=write-strings -Werror=delete-non-virtual-dtor -Werror=strict-aliasing -Werror=narrowing -Werror=unused-but-set-variable -Werror=reorder -Werror=unused-variable -Werror=conversion-null -Werror=return-local-addr -Wnon-virtual-dtor -Werror=switch -fdiagnostics-show-option -Wno-unused-local-typedefs -Wno-attributes -Wno-psabi -DEIGEN_DONT_PARALLELIZE -DEIGEN_MAX_ALIGN_BYTES=64 -Wno-error=unused-variable -DBOOST_DISABLE_ASSERTS -std=c++20 -fPIC ' src/DataFormats/Math/test/simpleCholeskyTest.cu -o tmp/el8_amd64_gcc13/src/DataFormats/Math/test/simpleCholeskyTest/simpleCholeskyTest.cu.o
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-f05490af1a32ed82a2ccffeb8fd901a5/include/eigen3/Eigen/src/LU/PartialPivLU.h(371): error: identifier "Eigen::fix<(int)-1> " is undefined in device code

/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-f05490af1a32ed82a2ccffeb8fd901a5/include/eigen3/Eigen/src/LU/PartialPivLU.h(380): error: identifier "Eigen::fix<(int)-1> " is undefined in device code

/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc13/external/eigen/c1d637433e3b3f9012b226c2c9125c494b470ae6-f05490af1a32ed82a2ccffeb8fd901a5/include/eigen3/Eigen/src/LU/PartialPivLU.h(380): error: identifier "Eigen::fix<(int)-1> " is undefined in device code



@smuzaffar
Copy link
Copy Markdown
Author

please test with cms-sw/cmssw#49997 for CMSSW_16_1_PY312_X

@smuzaffar
Copy link
Copy Markdown
Author

unit tests passed

@smuzaffar smuzaffar merged commit 2a2f8b5 into cms/master/c1d637433e3b3f9012b226c2c9125c494b470ae6 Feb 7, 2026
10 of 11 checks passed
smuzaffar added a commit to cms-sw/cmsdist that referenced this pull request Feb 7, 2026
@cmsbuild
Copy link
Copy Markdown

cmsbuild commented Feb 7, 2026

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51168/summary.html
COMMIT: d8967be
CMSSW: CMSSW_16_1_PY312_X_2026-02-06-2300/el8_amd64_gcc13
Additional Tests: GPU,NVIDIA_H100,NVIDIA_L40S
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-externals/eigen-git-mirror/10/51168/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51168/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7b65dc/51168/git-merge-result

Comparison Summary

Summary:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants