Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configuration arguments for version and packing schema of covariance in DeepJetTag producer #43917

Merged
merged 1 commit into from
Feb 14, 2024

Conversation

mbluj
Copy link
Contributor

@mbluj mbluj commented Feb 8, 2024

PR description:

This PR adds configuration arguments for version and packing schema of covariance to DeepBoostedJetTagInfoProducer module.
Those are used in by the module when construction of hlt_features is enabled and when the features are constructed from reco::PFCandidates, i.e. when the module is run at HLT. In the current code those are hard-coded which causes issues when the HLT RECO and miniAOD steps are run together in one workflow as discussed in #43861 issue.

The implementation is just a technical change and do not change behavior of the module as default values of newly added configuration arguments are equal to values which were hard-coded.

PR validation:

Verified that newly added parameters do not change previously used values.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Foreseen backport to 14_0_X release series that will be used for 2024 operations.

…s for hlt_features constructed from reco::PFCandidates
@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2024

cms-bot internal usage

@mbluj mbluj changed the title Configuration arguments for version and packing schema of covariance version in DeepJetTag producer Configuration arguments for version and packing schema of covariance in DeepJetTag producer Feb 8, 2024
@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2024

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-43917/38768

  • This PR adds an extra 20KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2024

A new Pull Request was created by @mbluj for master.

It involves the following packages:

  • RecoBTag/FeatureTools (reconstruction)

@jfernan2, @cmsbuild, @mandrenguyen can you please review it and eventually sign? Thanks.
@demuller, @Ming-Yan, @AnnikaStein, @Senphy, @AlexDeMoor, @andrzejnovak, @emilbols, @missirol, @hqucms, @JyothsnaKomaragiri this is something you requested to watch as well.
@sextonkennedy, @antoniovilela, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@@ -826,7 +832,7 @@ void DeepBoostedJetTagInfoProducer::fillParticleFeatures(DeepBoostedJetFeatures
pv_ass.key());
candidate.setAssociationQuality(pat::PackedCandidate::PVAssociationQuality(
btagbtvdeep::vtx_ass_from_pfcand(*reco_cand, pv_ass_quality, pv_ass)));
candidate.setCovarianceVersion(0);
candidate.setCovarianceVersion(covarianceVersion_);
Copy link
Contributor

@mmusich mmusich Feb 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mmmh, this makes me realize that this was hard-coded for phase-0...
Shouldn't this be dealt with via era modifier as elsewhere in cmssw?

from Configuration.Eras.Modifier_phase1Pixel_cff import phase1Pixel
phase1Pixel.toModify(packedPFCandidates, covarianceVersion =1 )

from Configuration.Eras.Modifier_phase1Pixel_cff import phase1Pixel
phase1Pixel.toModify(lostTracks, covarianceVersion =1 )

EDIT: in any case that won't solve configuring at HLT which is independent of eras.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Exactly, it is HLT configuration which is not era dependent in the same sense as offline. I do not know if it was intention of developers of the module to use phase0 pixel setting - it is question to BTV people.
This development is to help dealing with those settings using configuration parameters (maybe it can be checked before 2024 data-taking if usage of 1 is fine) without need to modify hard-coded vales.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cms-sw/btv-pog-l2 can you clarify about the intention of the hardcoded phase-0 packing scheme for HLT?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apparently, this was a mistake by the original author. He mistook the default value in the producer of 0 as the default. It clearly should be handled as discussed above. I did a study on 70k jets, and the current generation of taggers is unaffected by this choice, we can change it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hi @SWuchterl

Apparently, this was a mistake by the original author. He mistook the default value in the producer of 0 as the default. It clearly should be handled as discussed above

thanks for cross-checking! Once this PR is accepted and the new configuration is parsed, can you ask your HLT L3s to open a JIRA ticket to CMSHLT in order to change the configuration in the HLT menu for 2024 (assuming you want to move to the packing scheme for phase-1) ?

@mandrenguyen
Copy link
Contributor

please test

@mmusich
Copy link
Contributor

mmusich commented Feb 12, 2024

@mbluj, given the feedback at #43917 (comment) I think we'll need a backport PR to CMSSW_14_0_X.

@mandrenguyen
Copy link
Contributor

type btv

@cmsbuild cmsbuild added the btv label Feb 12, 2024
@mbluj
Copy link
Contributor Author

mbluj commented Feb 12, 2024

@mbluj, given the feedback at #43917 (comment) I think we'll need a backport PR to CMSSW_14_0_X.

OK, I will do it quickly as it will be a verbatim backport.

@mmusich
Copy link
Contributor

mmusich commented Feb 13, 2024

are tests stuck here ? @smuzaffar

@smuzaffar
Copy link
Contributor

@mmusich , no idea why bot did not start the test job. I see that https://cmssdt.cern.ch/jenkins/job/ib-schedule-pr-tests/69914/console had properly triggered https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests but now I do not find any ref to this PR. Anyway, I have restarted the test job

@cmsbuild
Copy link
Contributor

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1ed9b2/37408/summary.html
COMMIT: 675fb27
CMSSW: CMSSW_14_1_X_2024-02-12-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/43917/37408/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

The relvals timed out after 4 hours.

Comparison Summary

Summary:

  • You potentially added 63 lines to the logs
  • Reco comparison results: 36 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3248554
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3248532
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 200 log files, 161 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor

mmusich commented Feb 13, 2024

urgent

@mmusich
Copy link
Contributor

mmusich commented Feb 13, 2024

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1ed9b2/37436/summary.html
COMMIT: 675fb27
CMSSW: CMSSW_14_1_X_2024-02-13-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/43917/37436/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 114 lines to the logs
  • Reco comparison results: 53 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3248554
  • DQMHistoTests: Total failures: 6
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3248526
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 200 log files, 161 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@antoniovilela
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants