Skip to content

TICL-barrel validation @ HLT#50588

Merged
cmsbuild merged 4 commits intocms-sw:masterfrom
bfonta:feature/hlt_ticl_barrel
Apr 18, 2026
Merged

TICL-barrel validation @ HLT#50588
cmsbuild merged 4 commits intocms-sw:masterfrom
bfonta:feature/hlt_ticl_barrel

Conversation

@bfonta
Copy link
Copy Markdown
Contributor

@bfonta bfonta commented Mar 30, 2026

PR description:

Enables the validation of TICL-barrel at HLT as introduced in #47859 for the offline reconstruction. Logically follows #48565. The HLT configuration is now using the same parameters as used for the offline clustering.
Results are stored under HLT/BarrelCalorimeters/BarrelValidator/.

Screenshot From 2026-03-30 16-19-51

This PR does not include a "validation of the validation": I checked if the plots were created and that most of them were not empty, but I did not try to assess the correctness of the results, nor did I attempted to optimize CLUE's configuration at HLT.

PR validation:

Tested with the 34434.77_TTbar_14TeV+Run4D121_NGTScouting workflow:

NEVENTS=100                                                                                                                                                                                                        
                                                                                                                                                                                                                   
cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n ${NEVENTS} --conditions auto:phase2_realistic_T35 --beamspot DBrealisticHLLHC --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry ExtendedRun4D121 --era \
Phase2C22I13M9 --relval 9000,100 --fileout file:step1.root                                                                                                                                                         
                                                                                                                                                                                                                   
cmsDriver.py step2  -s DIGI:pdigi_valid,L1TrackTrigger,L1,L1P2GT,DIGI2RAW,HLT:NGTScouting,VALIDATION:@hltValidation --conditions auto:phase2_realistic_T35 --datatier GEN-SIM-DIGI-RAW,DQMIO -n ${NEVENTS} --even\
tcontent FEVTDEBUGHLT,DQMIO --geometry ExtendedRun4D121 --era Phase2C22I13M9 --procModifiers ngtScouting,ticl_barrel --customise SLHCUpgradeSimulations/Configuration/aging.customise_aging_1000 --filein  file:st\
ep1.root  --fileout file:step2.root                                                                                                                                                                                
                                                                                                                                                                                                                   
cmsDriver.py step3  -s HARVESTING:@hltValidation --conditions auto:phase2_realistic_T35 --mc  --geometry ExtendedRun4D121 --scenario pp --filetype DQM --era Phase2C22I13M9 --procModifiers ngtScouting,ticl_barre\
l -n ${NEVENTS} --filein file:step2_inDQM.root --fileout file:step3.root 

Note: The configuration of CLUE at HLT was set to match the configuration currently in place for the offline reconstruction, since the configuration so far had not been verified. The configuration at HLT can be optimized at a later time. To give an example, the kappa value used for the HCAL led to the almost full absence of clusters in HCAL

@bfonta
Copy link
Copy Markdown
Contributor Author

bfonta commented Mar 30, 2026

type ngt

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Mar 30, 2026

cms-bot internal usage

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50588/48773

@cmsbuild
Copy link
Copy Markdown
Contributor

A new Pull Request was created by @bfonta for master.

It involves the following packages:

  • Configuration/Applications (operations)
  • Configuration/StandardSequences (operations)
  • DataFormats/ParticleFlowReco (reconstruction)
  • HLTrigger/Configuration (hlt)
  • HLTriggerOffline/Common (dqm)
  • SimCalorimetry/HGCalAssociatorProducers (simulation)
  • Validation/Configuration (dqm, simulation)
  • Validation/HGCalValidation (dqm)

@Martin-Grunewald, @Moanwar, @civanch, @cmsbuild, @ctarricone, @davidlange6, @fabiocos, @ftenchini, @gabrielmscampos, @jfernan2, @kpedro88, @mandrenguyen, @mdhildreth, @mmusich, @nothingface0, @rseidita, @srimanob can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @Martin-Grunewald, @SohamBhattacharya, @VinInn, @VourMa, @apsallid, @bsunanda, @cseez, @denizsun, @dgulhan, @elusian, @fabiocos, @felicepantaleo, @hatakeyamak, @lecriste, @lgray, @makortel, @missirol, @mmasciov, @mmusich, @mtosi, @pfs, @rovere, @salimcerci, @sameasy, @sethzenz, @slomeo, @vandreev11 this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50588/48774

@cmsbuild
Copy link
Copy Markdown
Contributor

Comment thread HLTrigger/Configuration/python/HLT_75e33/modules/hltBarrelLayerClusters_cfi.py Outdated
@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Mar 30, 2026

test parameters:

  • enable = hlt_p2_integration, hlt_p2_timing
  • workflows = ph2_hlt

Comment thread HLTriggerOffline/Common/python/HLTValidation_cff.py Outdated
@bfonta bfonta force-pushed the feature/hlt_ticl_barrel branch from e86618e to bbc374d Compare March 30, 2026 16:38
@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 10, 2026

@bfonta thanks for the updates, I have no further comments.
Before testing do you mind squashing the commits to reduce them to a mimimum ?
In particular it would be nice to remove this

Found files with invalid states:

HLTrigger/Configuration/python/HLT_75e33/modules/hltBarrelLayerClusters_cfi.py:
    Added: https://github.com/cms-sw/cmssw/commit/36dd40e6fce69e5161c268b2af6683e3719537b2
    Deleted: https://github.com/cms-sw/cmssw/commit/e5f5f3df070d2828ce7bd7dcef7fdc4eec329132

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50588/48951

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #50588 was updated. @Martin-Grunewald, @Moanwar, @civanch, @cmsbuild, @ctarricone, @gabrielmscampos, @jfernan2, @kpedro88, @mandrenguyen, @mdhildreth, @mmusich, @nothingface0, @rseidita, @srimanob can you please check and sign again.

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50588/48952

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #50588 was updated. @Martin-Grunewald, @Moanwar, @civanch, @cmsbuild, @ctarricone, @gabrielmscampos, @jfernan2, @kpedro88, @mandrenguyen, @mdhildreth, @mmusich, @nothingface0, @rseidita, @srimanob can you please check and sign again.

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 10, 2026

@cmsbuild, please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-234605/52612/summary.html
COMMIT: 4e7cb2c
CMSSW: CMSSW_17_0_X_2026-04-10-1100/el8_amd64_gcc13
Additional Tests: HLT_P2_INTEGRATION,HLT_P2_TIMING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/50588/52612/install.sh to create a dev area with all the needed externals and cmssw changes.

HLT P2 Timing: chart

Comparison Summary

Summary:

  • You potentially added 292 lines to the logs
  • Reco comparison results: 9 differences found in the comparisons
  • DQMHistoTests: Total files compared: 66
  • DQMHistoTests: Total histograms compared: 4563329
  • DQMHistoTests: Total failures: 65
  • DQMHistoTests: Total nulls: 3
  • DQMHistoTests: Total successes: 4563241
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 14500.471 KiB( 65 files compared)
  • DQMHistoSizes: changed ( 34434.0,... ): 0.020 KiB MessageLogger/Errors
  • DQMHistoSizes: changed ( 34434.0,... ): 0.020 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34496.0 ): 0.027 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34634.999 ): 0.031 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34434.758,... ): 7250.128 KiB HLT/BarrelCalorimeters
  • Checked 274 log files, 233 edm output root files, 66 DQM output files
  • TriggerResults: found differences in 18 / 64 workflows

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 13, 2026

+hlt

  • for bfonta@4e7cb2c
  • PR according to description and follow-up review.

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 13, 2026

@bfonta do you have a quick explanation on why in wf 34434.771 and 34434.758 there are tiny changes in HLT / HGCAL / HGCalValidator/ hltHgcalMergeLayerClusters / ClusterLevel ?

Copy link
Copy Markdown
Contributor

@mmusich mmusich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just in case there are more edits.

Comment thread HLTriggerOffline/Common/python/HLTValidation_cff.py Outdated
@bfonta
Copy link
Copy Markdown
Contributor Author

bfonta commented Apr 13, 2026

@mmusich I noticed that hltHgcalPrevalidation duplicated some of the modules that were already being used by the hltHgcalAssociatorsTask. I removed the duplication, still keeping the hltHgcalPrevalidation / hltBarrelPrevalidation structure, to ensure some symmetry between HGCal and Barrel sequences.
I've also removed some more superfluous InputTags.

It is still not clear why the small differences you point out occur.

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50588/48971

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #50588 was updated. @Moanwar, @civanch, @cmsbuild, @ctarricone, @gabrielmscampos, @jfernan2, @kpedro88, @mandrenguyen, @mdhildreth, @nothingface0, @rseidita, @srimanob can you please check and sign again.

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 13, 2026

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 28KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-234605/52633/summary.html
COMMIT: 87ef4db
CMSSW: CMSSW_17_0_X_2026-04-13-1100/el8_amd64_gcc13
Additional Tests: HLT_P2_INTEGRATION,HLT_P2_TIMING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/50588/52633/install.sh to create a dev area with all the needed externals and cmssw changes.

HLT P2 Timing: chart

Comparison Summary

Summary:

  • You potentially added 79 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 66
  • DQMHistoTests: Total histograms compared: 4568057
  • DQMHistoTests: Total failures: 7
  • DQMHistoTests: Total nulls: 3
  • DQMHistoTests: Total successes: 4568027
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 14500.471000000001 KiB( 65 files compared)
  • DQMHistoSizes: changed ( 34434.758,... ): 7250.128 KiB HLT/BarrelCalorimeters
  • DQMHistoSizes: changed ( 34434.0,... ): 0.020 KiB MessageLogger/Errors
  • DQMHistoSizes: changed ( 34434.0,... ): 0.020 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34496.0 ): 0.027 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34634.999 ): 0.031 KiB MessageLogger/Warnings
  • Checked 274 log files, 233 edm output root files, 66 DQM output files
  • TriggerResults: found differences in 18 / 64 workflows

@civanch
Copy link
Copy Markdown
Contributor

civanch commented Apr 15, 2026

+1

@gabrielmscampos
Copy link
Copy Markdown
Member

+hlt

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 15, 2026

+hlt

wrong signature area?

@gabrielmscampos
Copy link
Copy Markdown
Member

+hlt

wrong signature area?

HAHAHAHAHAHA yes, I don't know what was in my head.

@gabrielmscampos
Copy link
Copy Markdown
Member

+dqm

@Moanwar
Copy link
Copy Markdown
Contributor

Moanwar commented Apr 15, 2026

+1

@cmsbuild
Copy link
Copy Markdown
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @ftenchini, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented Apr 17, 2026

@mandrenguyen @ftenchini can we please merge this? Other PRs are in the queue.

@mandrenguyen
Copy link
Copy Markdown
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants