Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix phase2 tracker association #18354

Merged
merged 4 commits into from
Apr 27, 2017

Conversation

abbiendi
Copy link
Contributor

This is a bugfix to the muon validation for Phase2 upgrade.

The standard muon validation was silently broken for Phase2 (since 81X, while it worked in 620_SLHCx), due to changes in the Tracker data formats. In particular the outer tracker hits were not associated at all in the TrackerHitAssociator, due to the missing format Phase2TrackerRecHit1D.
This bug was not spotted until now in the standard muon validation as no threshold was asked in the fraction of shared hits. By applying minimum thresholds as in the configuration of the New validation this became apparent.
The TrackerHitAssociator has been kindly updated by Bill Ford (@wmtford). It is also meant to be used for tracker hit validation.

This PR has been tested on SingleMuonPt100 RelVal (with Phase2 conditions 2023 D4T) generated in CMSSW_9_1_0_pre5.
The current validation (OldVal, soon to become obsolete) wrt to plain CMSSW_9_1_0_pre5 is at:
https://cmsdoc.cern.ch/cms/Physics/muon/CMSSW/Performance/RecoMuon/Validation/val/test_NewValidation_fix_Phase2TrackerAssociation/RelValSingleMuPt100Extended_UP2023D4T_noPU/OldVal-fix_Phase2TrackerAssociation_Vs_910pre5/

The comparison of the New validation with respect to the current one is obtained by applying this PR on top of the PR#18290, and is visible here:
https://cmsdoc.cern.ch/cms/Physics/muon/CMSSW/Performance/RecoMuon/Validation/val/test_NewValidation_fix_Phase2TrackerAssociation/RelValSingleMuPt100Extended_UP2023D4T_noPU/fix_Phase2TrackerAssociation-910pre5-NEWVal_Vs_OLDVal/

Comments:

or: https://cmsdoc.cern.ch/cms/Physics/muon/CMSSW/Performance/RecoMuon/Validation/val/test_NewValidation_fix_Phase2TrackerAssociation/RelValSingleMuPt100Extended_UP2023D4T_noPU/OldVal-fix_Phase2TrackerAssociation_Vs_910pre5/extractedGlobalMuons.pdf

This bugfix is needed (quite urgently) for muon performance studies for Phase2 TDRs.
@calabria @HuguesBrun @calderona

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @abbiendi for master.

It involves the following packages:

SimMuon/MCTruth
SimTracker/TrackerHitAssociation
Validation/RecoMuon

@civanch, @mdhildreth, @dmitrijus, @cmsbuild, @vanbesien, @davidlange6 can you please review it and eventually sign? Thanks.
@battibass, @makortel, @threus, @sdevissc, @GiacomoSguazzoni, @jhgoh, @VinInn, @calderona, @HuguesBrun, @rovere, @wmtford, @ebrondol, @trocino, @dgulhan, @rociovilar this is something you requested to watch as well.
@Muzaffar, @davidlange6, @smuzaffar you are the release manager for this.

cms-bot commands are listed here #13028

@abbiendi
Copy link
Contributor Author

Sorry: I wrote several times 910pre5 instead of 900pre5 for the release used to generate the RelVal sample ! Obviously also the legends in the plots are consistently wrong.
With this replacement everything should be correct (as far as I can say)

@civanch
Copy link
Contributor

civanch commented Apr 15, 2017

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 15, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/19194/console Started: 2017/04/15 11:57

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18354/19194/summary.html

Comparison Summary:

  • You potentially added 6 lines to the logs
  • Reco comparison results: 1636 differences found in the comparisons
  • DQMHistoTests: Total files compared: 23
  • DQMHistoTests: Total histograms compared: 1819408
  • DQMHistoTests: Total failures: 9178
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 1810057
  • DQMHistoTests: Total skipped: 173
  • DQMHistoTests: Total Missing objects: 0
  • Checked 94 log files, 14 edm output root files, 23 DQM output files

@civanch
Copy link
Contributor

civanch commented Apr 17, 2017

+1

@dmitrijus
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 24, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/19346/console Started: 2017/04/24 18:22

@abbiendi
Copy link
Contributor Author

sorry, I did not mean to trigger further tests right away: at the moment I have just removed a couple of commented lines in cfg files, so nothing will change. We have to wait for Bill ( @wmtford ) to reply on the proposals (by @kpedro88) before doing anything

@wmtford
Copy link
Contributor

wmtford commented Apr 24, 2017 via email

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18354/19346/summary.html

Comparison Summary:

  • You potentially added 31 lines to the logs
  • Reco comparison results: 1708 differences found in the comparisons
  • DQMHistoTests: Total files compared: 23
  • DQMHistoTests: Total histograms compared: 1780008
  • DQMHistoTests: Total failures: 6366
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 1773469
  • DQMHistoTests: Total skipped: 173
  • DQMHistoTests: Total Missing objects: 0
  • Checked 94 log files, 14 edm output root files, 23 DQM output files

@kpedro88
Copy link
Contributor

@wmtford it's acceptable to delay the modernization comments I made to a subsequent PR, given the overall state of the code.

For the cout statements, if you want to keep them, they should be made into LogDebug statements (which are thread-safe).

@dmitrijus
Copy link
Contributor

+1

@civanch
Copy link
Contributor

civanch commented Apr 27, 2017

+1

@abbiendi
Copy link
Contributor Author

@wmtford : I understand it is up to you to either transform the cout in LogDebug or remove them. I have the impression someone is waiting for this, isn;'t it ?
From my side I confirm that this PR is rather urgent for having performance plots for the upgrade TDRs.

@calabria
Copy link
Contributor

Hi all, what is still missing that prevents to integrate this PR? Please, consider this is essential for the muon perfomance studies and it is urgent for the Muon TDR. We can't further delay if the remaining issues concerns only few couts, we can fix them later.

@kpedro88
Copy link
Contributor

Fine, but in general it is not acceptable to delay responses to code review comments until merging is urgent.

@kpedro88
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @Muzaffar, @davidlange6, @smuzaffar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants