FastSim premixing workflows and matrix cleanup [14_0_X]

[kpedro88]

backport of #46007

[cmsbuild]

A new Pull Request was created by @kpedro88 for CMSSW_14_0_X.

It involves the following packages:

• Configuration/PyReleaseValidation (upgrade, pdmv)

@AdrianoDee, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @makortel, @missirol, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

• Backported from FastSim premixing workflows and matrix cleanup #46007

[cmsbuild]

cms-bot internal usage

[kpedro88]

test parameters:
workflow = 13461.97,13434.99
relvals_opt = --what cleanedupgrade,standard,highstats,pileup,generator,extendedgen,production,identity,ged,machine,premix,nano,gpu,2017,2026

[kpedro88]

please test

[cmsbuild]

+1

Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-538038/41540/summary.html
COMMIT: 4edb890
CMSSW: CMSSW_14_0_X_2024-09-16-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46008/41540/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 191 lines to the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 1412 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3398683
• DQMHistoTests: Total failures: 5116
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3393547
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 206 log files, 168 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[cmsbuild]

Pull request #46008 was updated. @AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please check and sign again.

[kpedro88]

please test

[kpedro88]

@cms-sw/upgrade-l2 please sign

[srimanob]

Kindly ping @cms-sw/upgrade-l2

[Moanwar]

+Upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @rappoccio, @mandrenguyen, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

[mandrenguyen]

hold
is this needed for 14_0_X at this point?

[cmsbuild]

Pull request has been put on hold by @mandrenguyen
They need to issue an unhold command to remove the hold state or L1 can unhold it for all

[kpedro88]

Yes, this is needed in 14_0_X:

1. This workflow in this release was used for the CDR profiling. It should be reproducible in the future without manually merging branches/PRs.
2. We anticipate possible Run 3 FastSim production in this release.

[antoniovilela]

unhold

[antoniovilela]

please test

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[cmsbuild]

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-538038/42669/summary.html
COMMIT: d616785
CMSSW: CMSSW_14_0_X_2024-11-07-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46008/42669/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 79 lines to the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 1433 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3401258
• DQMHistoTests: Total failures: 6811
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3394427
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 206 log files, 168 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[antoniovilela]

+1