Skip to content

Remove Run2 procModifier from Run3 ReMINI relval workflows and fix BTV MINIAOD DQM#48686

Merged
cmsbuild merged 2 commits intocms-sw:masterfrom
hqucms:dev/fix-miniaod-dqm-btv
Aug 20, 2025
Merged

Remove Run2 procModifier from Run3 ReMINI relval workflows and fix BTV MINIAOD DQM#48686
cmsbuild merged 2 commits intocms-sw:masterfrom
hqucms:dev/fix-miniaod-dqm-btv

Conversation

@hqucms
Copy link
Copy Markdown
Contributor

@hqucms hqucms commented Aug 6, 2025

PR description:

This PR removes the run2_miniAOD_UL_preSummer20 procModifier, which leaked into the Run3 ReMINI relval workflows (2500.2601,2500.2701) when cloning the relval steps from Run2_UL configs.

When fixing this, it revealed an outdated configuration in the BTV MINIAOD DQM, which by default includes the bTagSVDQM module that relies on pfSecondaryVertexTagInfos. However, with the removal of CSVv2 from MINIAOD, the pfSecondaryVertexTagInfos collection is no longer produced in the MINIAOD step, so the bTagSVDQM module would crash.

This problem has not been revealed so far because in bTagMiniDQM_cff.py, the miniAOD_skip_trackExtras (part of run2_miniAOD_UL_preSummer20) modifier was used to exclude the bTagSVDQM module. However, since the default MINIAOD no longer has pfSecondaryVertexTagInfos, the bTagSVDQM module should also be removed in the default configuration too.

PR validation:

Tested with runTheMatrix.py -w nano --ibeos -l 2500.2601,2500.2701.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

To be backported to 150X.

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Aug 6, 2025

cms-bot internal usage

@hqucms
Copy link
Copy Markdown
Contributor Author

hqucms commented Aug 6, 2025

enable nano

@hqucms
Copy link
Copy Markdown
Contributor Author

hqucms commented Aug 6, 2025

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Aug 6, 2025

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48686/45705

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Aug 6, 2025

A new Pull Request was created by @hqucms for master.

It involves the following packages:

  • Configuration/PyReleaseValidation (upgrade, pdmv)
  • DQMOffline/RecoB (dqm)

@AdrianoDee, @Moanwar, @antoniovagnerini, @ctarricone, @DickyChant, @miquork, @rseidita, @srimanob, @subirsarkar can you please review it and eventually sign? Thanks.
@AlexDeMoor, @Martin-Grunewald, @Ming-Yan, @Senphy, @andrzejnovak, @castaned, @fabiocos, @makortel, @missirol, @pavlo-kashko, @philippgadow, @rociovilar, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Aug 6, 2025

+1

Size: This PR adds an extra 68KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-cf45f3/47558/summary.html
COMMIT: a4b5f7c
CMSSW: CMSSW_15_1_X_2025-08-06-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/48686/47558/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 6 lines from the logs
  • Reco comparison results: 12 differences found in the comparisons
  • DQMHistoTests: Total files compared: 52
  • DQMHistoTests: Total histograms compared: 4304852
  • DQMHistoTests: Total failures: 56
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4304776
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: -62.751999999999974 KiB( 51 files compared)
  • DQMHistoSizes: changed ( 10224.0,... ): -1.696 KiB Btag/SV
  • Checked 223 log files, 194 edm output root files, 52 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

Summary:

  • You potentially added 453 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 208 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 89100
  • DQMHistoTests: Total failures: 171
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 88929
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 1739.5449999999996 KiB( 21 files compared)
  • DQMHistoSizes: changed ( 2500.0201,... ): 24.940 KiB Btag/TagInfo_pfParticleNetFromMiniAODAK4PuppiCentral_Inc
  • DQMHistoSizes: changed ( 2500.0201,... ): 24.940 KiB Btag/TagInfo_pfParticleNetFromMiniAODAK4PuppiForward_Inc
  • DQMHistoSizes: changed ( 2500.0201,... ): 24.790 KiB Btag/TagInfo_pfParticleNetFromMiniAODAK4PuppiCentral_B
  • DQMHistoSizes: changed ( 2500.0201,... ): 24.790 KiB Btag/TagInfo_pfParticleNetFromMiniAODAK4PuppiCentral_C
  • DQMHistoSizes: changed ( 2500.0201,... ): 24.790 KiB Btag/TagInfo_pfParticleNetFromMiniAODAK4PuppiCentral_L
  • DQMHistoSizes: changed ( 2500.0201,... ): 23.873 KiB Btag/TagInfo_pfUnifiedParticleTransformerAK4_Inc
  • DQMHistoSizes: changed ( 2500.0201,... ): 23.738 KiB Btag/TagInfo_pfUnifiedParticleTransformerAK4_B
  • DQMHistoSizes: changed ( 2500.0201,... ): 23.738 KiB Btag/TagInfo_pfUnifiedParticleTransformerAK4_C
  • DQMHistoSizes: changed ( 2500.0201,... ): 23.738 KiB Btag/TagInfo_pfUnifiedParticleTransformerAK4_L
  • DQMHistoSizes: changed ( 2500.0201,... ): 11.008 KiB Btag/TagInfo_pfDeepFlavour_Inc
  • DQMHistoSizes: changed ( 2500.0201 ): ...
  • Checked 134 log files, 80 edm output root files, 22 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.118 3.118 0.000 ( +0.0% ) 3.59 3.54 +1.3% 2.806 2.798
NANOmc106Xul17v2 2500.0002 3.177 3.177 0.000 ( +0.0% ) 3.36 3.32 +1.2% 3.253 3.251
NANOmc106Xul18v2 2500.0003 3.128 3.128 0.000 ( +0.0% ) 3.41 3.35 +1.8% 3.236 3.222
NANOdata106Xul16v2 2500.0101 1.560 1.560 0.000 ( +0.0% ) 5.90 5.85 +0.8% 2.745 2.761
NANOdata106Xul17v2 2500.0102 1.948 1.948 0.000 ( +0.0% ) 3.93 3.91 +0.6% 2.885 2.903
NANOdata106Xul18v2 2500.0103 1.914 1.914 0.000 ( +0.0% ) 4.69 4.53 +3.6% 2.835 2.873
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.62 1.51 +7.6% 2.637 2.651
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.53 1.41 +8.4% 2.630 2.651
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.55 1.43 +8.3% 2.595 2.605
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.27 1.15 +10.5% 2.771 2.801
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.26 1.13 +11.0% 2.726 2.748
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.41 1.36 +4.0% 2.640 2.694
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.25 1.13 +10.6% 2.747 2.758
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.18 1.12 +4.9% 2.735 2.751
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.12 4.03 +2.2% 3.184 3.180
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 6.12 6.00 +1.9% 2.821 2.824
ScoutingNANOdata130Xrun3 2500.1301 0.771 0.771 0.000 ( +0.0% ) 32.02 31.54 +1.5% 1.688 1.686
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.14 4.96 +3.7% 2.232 2.353
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 3.80 3.74 +1.4% 2.528 2.711
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 2.42 2.39 +1.4% 2.688 2.725
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 1.09 1.07 +2.6% 2.559 2.572
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 3.76 3.72 +1.0% 2.494 2.498
ScoutingNANOmc140X 2500.2207 1.486 1.486 0.000 ( +0.0% ) 14.84 14.33 +3.6% 1.967 2.020
ScoutingNANOwithPromptmc140X 2500.2208 4.474 4.474 0.000 ( +0.0% ) 3.19 3.17 +0.7% 2.883 2.943
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 7.60 7.36 +3.3% 2.475 2.565
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.63 5.48 +2.7% 2.988 2.993
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.56 3.60 -1.1% 2.913 2.942
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.40 1.35 +3.9% 2.766 2.785
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.62 5.59 +0.6% 2.904 2.992
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 28.97 28.09 +3.1% 1.541 1.633
ScoutingNANOwithPromptdata140Xrun3 2500.2308 2.783 2.783 0.000 ( +0.0% ) 4.82 4.77 +0.9% 3.158 3.162
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 7.42 6.71 +10.6% 1.936 1.937
muDPGNANO140Xrun3 2500.2402 10.331 10.331 0.000 ( +0.0% ) 1.62 1.56 +3.9% 1.733 1.735
muDPGNANOBkg140Xrun3 2500.2403 2.712 2.712 0.000 ( +0.0% ) 15.32 13.70 +11.9% 1.064 1.065
hcalDPGNANO140Xrun3 2500.2404 486.016 486.016 0.000 ( +0.0% ) 1.14 1.09 +4.9% 1.724 1.721
hcalDPGCalibNANO140Xrun3 2500.2405 826.413 826.413 0.000 ( +0.0% ) 1.53 1.44 +6.1% 1.710 1.702
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.67 1.59 +4.7% 1.818 1.821
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.33 1.33 -0.1% 3.095 3.154
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.26 1.10 +14.7% 2.659 2.909
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 16.48 16.33 +0.9% 2.767 2.773
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 29.09 30.77 -5.5% 2.266 2.281
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 20.16 20.23 -0.4% 2.570 2.581
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 13.48 12.03 +12.0% 2.447 2.643
EGMNANOmc150X 2500.3202 4.111 4.111 0.000 ( +0.0% ) 12.64 11.54 +9.6% 2.517 2.733
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 4.46 4.29 +3.9% 2.969 2.969
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.23 1.22 +0.7% 2.651 2.874
jmeNANOrePuppimc150X 2500.3205 6.763 6.763 0.000 ( +0.0% ) 1.19 1.17 +1.8% 3.202 3.212
lepTrackInfoNANOmc150X 2500.3206 3.721 3.721 0.000 ( +0.0% ) 12.29 13.13 -6.4% 2.677 2.678
ScoutingNANOmc150X 2500.3207 1.562 1.562 0.000 ( +0.0% ) 17.82 17.54 +1.6% 2.487 2.502
ScoutingNANOwithPromptmc150X 2500.3208 4.774 4.774 0.000 ( +0.0% ) 10.14 10.02 +1.1% 2.933 2.936
BPHNANOmc150X 2500.3209 4.109 4.109 0.000 ( +0.0% ) 15.79 15.94 -1.0% 2.644 2.663
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 23.04 22.09 +4.3% 2.401 2.403
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 20.10 20.06 +0.2% 2.290 2.476
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.41 5.29 +2.3% 2.438 2.682
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.51 1.53 -1.2% 2.390 2.422
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.33 1.34 -1.4% 2.617 2.643
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 21.72 21.61 +0.5% 2.220 2.272
ScoutingNANOdata150Xrun3 2500.3307 1.737 1.737 0.000 ( +0.0% ) 29.31 29.30 +0.1% 1.554 1.556
ScoutingNANOwithPromptdata150Xrun3 2500.3308 2.601 2.601 0.000 ( +0.0% ) 16.40 16.44 -0.3% 2.570 2.598
BPHNANOdata150Xrun3 2500.3309 2.604 2.604 0.000 ( +0.0% ) 30.93 31.66 -2.3% 2.516 2.545
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 26.85 28.01 -4.1% 1.911 1.940
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 26.64 28.29 -5.8% 1.570 1.579
DYToLL_M-50_13TeV_pythia8 2500.9101 14.345 14.345 0.000 ( +0.0% ) 8.08 8.13 -0.6% 1.102 1.103
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.132 0.132 0.000 ( +0.0% ) 2.61 3.88 -32.6% 0.852 0.851
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.53 2.57 -1.5% 0.854 0.857

@AdrianoDee
Copy link
Copy Markdown
Contributor

+pdmv

@antoniovagnerini
Copy link
Copy Markdown

+dqm

@Moanwar
Copy link
Copy Markdown
Contributor

Moanwar commented Aug 20, 2025

+Upgrade

@cmsbuild
Copy link
Copy Markdown
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @rappoccio, @mandrenguyen, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Copy Markdown
Contributor

+1

@cmsbuild cmsbuild merged commit 1ebb3d5 into cms-sw:master Aug 20, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants