Run DQM of Scouting in RelVals by silviodonato · Pull Request #49336 · cms-sw/cmssw

silviodonato · 2025-11-06T15:51:45Z

PR description:

DQM Offline for Scouting was added by #47235.
It was activated in PromptReco at T0 only for ScoutingPFMonitor by dmwm/T0#5053, specifically by adding @hltScouting to dqm_sequences in ProdOfflineConfiguration.py.
It would be useful to have these DQM plots also in RelVals and especially in AlCaVal, to monitor better the performance of HLT/Scouting objects.

Note: Scouting DQM requires scouting object to run (otherwise it will crash).

It looks like the easier thing is to add scouting DQM to the trigger DQM sequence, because we run HLT unprescaled in MC and in reHLT, and therefore there should be no crashes. However I still have to investigate about re-reco of non-scouting dataset.

PR validation:

I'm having some problems with the validation (#49331). I would like to check that all corner cases are covered (in particular I suspect that a re-reco of a non-scouting dataset might have problems)

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

To be clarified

cmsbuild · 2025-11-06T15:52:07Z

cms-bot internal usage

cmsbuild · 2025-11-06T15:53:35Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49336/46703

There are other open Pull requests which might conflict with changes you have proposed:
- File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Tau DQM miniAOD validation for DATA #44029, Update BTV offline DQM sequences #46838

silviodonato · 2025-11-06T16:19:13Z

@cmsbuild please test

cmsbuild · 2025-11-06T17:11:09Z

-1

Failed Tests: RelVals RelVals-INPUT
Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eabc73/49314/summary.html
COMMIT: c7f35fb
CMSSW: CMSSW_16_0_X_2025-11-06-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49336/49314/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed RelVals

2025.0000001

----- Begin Fatal Exception 06-Nov-2025 17:41:30 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 391668 lumi: 1 event: 93152 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

2024.0030001

----- Begin Fatal Exception 06-Nov-2025 17:39:35 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 380963 lumi: 1 event: 60022 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

2024.0010001

----- Begin Fatal Exception 06-Nov-2025 17:39:18 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 379416 lumi: 1 event: 508034 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

Failed RelVals-INPUT

138.5138.5_ExpressCollisions2021/step2_ExpressCollisions2021.log
1003.01003.0_RunMinBias2012A/step2_RunMinBias2012A.log
1040.01040.0_RunZeroBias2017F/step2_RunZeroBias2017F.log

Expand to see more relval errors ...

silviodonato · 2025-11-06T18:30:50Z

@cmsbuild please test

cmsbuild · 2025-11-06T18:32:35Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49336/46706

There are other open Pull requests which might conflict with changes you have proposed:
- File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Tau DQM miniAOD validation for DATA #44029, Update BTV offline DQM sequences #46838

cmsbuild · 2025-11-06T18:32:59Z

Pull request #49336 was updated.

cmsbuild · 2025-11-06T19:21:23Z

-1

Failed Tests: RelVals RelVals-INPUT
Size: This PR adds an extra 388KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eabc73/49318/summary.html
COMMIT: 58e0014
CMSSW: CMSSW_16_0_X_2025-11-06-1400/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49336/49318/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed RelVals

2025.0000001

----- Begin Fatal Exception 06-Nov-2025 19:51:36 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 391668 lumi: 1 event: 93152 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

2024.0030001

----- Begin Fatal Exception 06-Nov-2025 19:49:15 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 380963 lumi: 1 event: 60022 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

2024.0010001

----- Begin Fatal Exception 06-Nov-2025 19:48:49 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 379416 lumi: 1 event: 508034 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

Failed RelVals-INPUT

138.5138.5_ExpressCollisions2021/step2_ExpressCollisions2021.log
1003.01003.0_RunMinBias2012A/step2_RunMinBias2012A.log
1040.01040.0_RunZeroBias2017F/step2_RunZeroBias2017F.log

Expand to see more relval errors ...

cmsbuild · 2025-11-07T08:25:41Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49336/46714

There are other open Pull requests which might conflict with changes you have proposed:
- File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Tau DQM miniAOD validation for DATA #44029, Update BTV offline DQM sequences #46838

silviodonato · 2025-11-07T08:27:52Z

please test

cmsbuild · 2025-11-07T08:28:16Z

Pull request #49336 was updated.

cmsbuild · 2025-11-07T09:26:46Z

-1

Failed Tests: RelVals RelVals-INPUT
Size: This PR adds an extra 388KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eabc73/49327/summary.html
COMMIT: 2a34c24
CMSSW: CMSSW_16_0_X_2025-11-06-2300/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49336/49327/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed RelVals

2024.0030001

----- Begin Fatal Exception 07-Nov-2025 09:50:53 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 380963 lumi: 1 event: 60022 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

2024.0010001

----- Begin Fatal Exception 07-Nov-2025 09:50:22 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 379416 lumi: 1 event: 508034 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

1000.0

----- Begin Fatal Exception 07-Nov-2025 09:52:09 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing  Event run: 165121 lumi: 62 event: 23609118 stream: 0
   [1] Running path 'dqmoffline_11_step'
   [2] Prefetching for module ChainedJetCorrectorProducer/'dqmAk4PFScoutingL1FastL2L3ResidualCorrector'
   [3] Calling method for module L1FastjetCorrectorProducer/'ak4PFScoutingL1FastjetCorrector'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: double
Looking for module label: hltScoutingPFPacker
Looking for productInstanceName: rho

   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "TryToContinue = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

Failed RelVals-INPUT

138.5138.5_ExpressCollisions2021/step2_ExpressCollisions2021.log
1003.01003.0_RunMinBias2012A/step2_RunMinBias2012A.log
1040.01040.0_RunZeroBias2017F/step2_RunZeroBias2017F.log

Expand to see more relval errors ...

ajaychandrak2002-bit · 2025-11-07T20:02:51Z

i found the some errors functions in this program and please make a draft of it , and clear the bugs.

cmsbuild · 2025-11-10T08:42:44Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49336/46732

There are other open Pull requests which might conflict with changes you have proposed:
- File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Tau DQM miniAOD validation for DATA #44029, Update BTV offline DQM sequences #46838

cmsbuild · 2025-11-10T08:43:02Z

Pull request #49336 was updated.

silviodonato · 2025-11-10T09:03:36Z

Closed in favor of #49350

cmsbuild added this to the CMSSW_16_0_X milestone Nov 6, 2025

cmsbuild added dqm-pending pending-signatures tests-pending orp-pending code-checks-pending labels Nov 6, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Nov 6, 2025

cmsbuild added tests-started and removed tests-pending labels Nov 6, 2025

cmsbuild added tests-rejected and removed tests-started labels Nov 6, 2025

cmsbuild added hlt-pending tests-started code-checks-pending and removed tests-rejected code-checks-approved labels Nov 6, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Nov 6, 2025

cmsbuild added tests-rejected and removed tests-started tests-rejected labels Nov 6, 2025

cmsbuild added tests-pending code-checks-pending and removed code-checks-approved labels Nov 7, 2025

cmsbuild added tests-started code-checks-approved and removed tests-pending code-checks-pending labels Nov 7, 2025

cmsbuild added tests-rejected and removed tests-started labels Nov 7, 2025

cmsbuild added tests-pending code-checks-pending and removed tests-rejected code-checks-approved labels Nov 10, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Nov 10, 2025

silviodonato closed this Nov 10, 2025

silviodonato force-pushed the ScoutingDQMRelVals branch from 8b27d9a to 9bfeb16 Compare November 10, 2025 08:44

silviodonato mentioned this pull request Nov 10, 2025

Run Scouting DQM in RelVals (+ change in JME scouting DQM sequence) #49358

Merged

Conversation

silviodonato commented Nov 6, 2025

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Uh oh!

cmsbuild commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Nov 6, 2025

Uh oh!

silviodonato commented Nov 6, 2025

Uh oh!

cmsbuild commented Nov 6, 2025

Failed RelVals

Failed RelVals-INPUT

Uh oh!

silviodonato commented Nov 6, 2025

Uh oh!

cmsbuild commented Nov 6, 2025

Uh oh!

cmsbuild commented Nov 6, 2025

Uh oh!

cmsbuild commented Nov 6, 2025

Failed RelVals

Failed RelVals-INPUT

Uh oh!

cmsbuild commented Nov 7, 2025

Uh oh!

silviodonato commented Nov 7, 2025

Uh oh!

cmsbuild commented Nov 7, 2025

Uh oh!

cmsbuild commented Nov 7, 2025

Failed RelVals

Failed RelVals-INPUT

Uh oh!

ajaychandrak2002-bit commented Nov 7, 2025

Uh oh!

cmsbuild commented Nov 10, 2025

Uh oh!

cmsbuild commented Nov 10, 2025

Uh oh!

silviodonato commented Nov 10, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cmsbuild commented Nov 6, 2025 •

edited

Loading