HLT development for 12_3_X + migration to 12_3_0_pre3 template

[missirol]

PR description:

Development of HLT menus for CMSSW_12_3_X.

Includes the migration of all HLT configurations to the 12_3_0_pre3 template, and the integration of the following JIRA tickets:

• CMSHLT-2205: [MUO] GEMs in L2-muon producers
• CMSHLT-2209: [TAU] new TAU paths for Run-3 startup
• CMSHLT-2213: [BPH] removal of HLTIterativeTrackingIteration1 sequence from BPH paths
• CMSHLT-2216: [BTV] update of BTagMu paths

PR validation:

TSG tests.

If this PR is a backport, please specify the original PR and why you need to backport that PR:

N/A

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36731/27829

• This PR adds an extra 808KB to repository

[cmsbuild]

A new Pull Request was created by @missirol (Marino Missiroli) for master.

It involves the following packages:

• HLTrigger/Configuration (hlt)

@cmsbuild, @missirol, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @silviodonato this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[missirol]

please test

[missirol]

The bot reports an error for relvals/input which looks unrelated to this PR (looks like a file-access issue for 1 wf).

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-78c238/21768/summary.html
COMMIT: b3403d1
CMSSW: CMSSW_12_3_X_2022-01-17-2300/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36731/21768/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

• 4.764.76_ZMuSkim2012D+ZMuSkim2012D+HLTDSKIM2+RECODR1reHLT2+HARVESTDR1reHLT/step2_ZMuSkim2012D+ZMuSkim2012D+HLTDSKIM2+RECODR1reHLT2+HARVESTDR1reHLT.log

Comparison Summary

Summary:

• No significant changes to the logs found
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 2 differences found in the comparisons
• DQMHistoTests: Total files compared: 43
• DQMHistoTests: Total histograms compared: 3441616
• DQMHistoTests: Total failures: 3012
• DQMHistoTests: Total nulls: 47
• DQMHistoTests: Total successes: 3438535
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: -4731.95 KiB( 42 files compared)
• DQMHistoSizes: changed ( 11634.0,... ): -746.899 KiB HLT/TAU
• DQMHistoSizes: changed ( 11634.0,... ): -35.174 KiB HLT/Objects
• DQMHistoSizes: changed ( 11634.0,... ): -6.586 KiB HLT/Filters
• DQMHistoSizes: changed ( 312.0 ): 0.004 KiB MessageLogger/Warnings
• Checked 181 log files, 42 edm output root files, 43 DQM output files
• TriggerResults: found differences in 6 / 42 workflows

[missirol]

Modulo the unrelated problem with wf 4.76, tests look okay and the comparisons appear consistent with the changes in the GRun menu.

The tests could be re-launched once the issue with wf 4.76 is solved.

[missirol]

+hlt

• differences in outputs of Run-3 wfs are compatible with changes in the HLT menus;
• the label tests-rejected is due to one unrelated problem with the inputs of wf 4.76 (if the latter is fixed, the tests could be restarted without resetting this signature; I sign because I do not anticipate changes to this PR).

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[Martin-Grunewald]

please test

[Martin-Grunewald]

please test

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36731/27877

• This PR adds an extra 1256KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File HLTrigger/Configuration/python/customizeHLTforCMSSW.py modified in PR(s): updates to customizeHLTforPatatrack to limit overwriting of HLT modules #36721

[cmsbuild]

Pull request #36731 was updated. @Martin-Grunewald, @missirol can you please check and sign again.

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-78c238/21840/summary.html
COMMIT: 29c1fe7
CMSSW: CMSSW_12_3_X_2022-01-19-2300/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36731/21840/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

• 4.764.76_ZMuSkim2012D+ZMuSkim2012D+HLTDSKIM2+RECODR1reHLT2+HARVESTDR1reHLT/step2_ZMuSkim2012D+ZMuSkim2012D+HLTDSKIM2+RECODR1reHLT2+HARVESTDR1reHLT.log

Comparison Summary

Summary:

• No significant changes to the logs found
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 10 differences found in the comparisons
• DQMHistoTests: Total files compared: 43
• DQMHistoTests: Total histograms compared: 3441614
• DQMHistoTests: Total failures: 3024
• DQMHistoTests: Total nulls: 46
• DQMHistoTests: Total successes: 3438522
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: -4731.954 KiB( 42 files compared)
• DQMHistoSizes: changed ( 11634.0,... ): -746.899 KiB HLT/TAU
• DQMHistoSizes: changed ( 11634.0,... ): -35.174 KiB HLT/Objects
• DQMHistoSizes: changed ( 11634.0,... ): -6.586 KiB HLT/Filters
• Checked 181 log files, 42 edm output root files, 43 DQM output files
• TriggerResults: found differences in 6 / 42 workflows

[Martin-Grunewald]

+1
Relvals-INPUT failure unrelated to this PR.

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[qliphy]

merge