Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First attempt to fix DQM GUI urls in RelMon #27804

Merged
merged 1 commit into from
Aug 23, 2019

Conversation

jfernan2
Copy link
Contributor

@jfernan2 jfernan2 commented Aug 20, 2019

PR description:

This PR tries to fix issue #27800
Links points to root Everything workspace instead of dedicated folder to simplify

PR validation:

Tested locally

if this PR is a backport please specify the original PR:

No backport

@jfernan2
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-27804/11509

  • This PR adds an extra 24KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 20, 2019

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/2079/console Started: 2019/08/20 11:54

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @jfernan2 for master.

It involves the following packages:

Utilities/RelMon

@perrotta, @cmsbuild, @slava77 can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @wddgit this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@perrotta
Copy link
Contributor

I wonder why "Utilities/RelMon" is in the "reconstruction" category instead of "dqm": just a mistake or is there any reason behind?

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-50694a/2079/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2939508
  • DQMHistoTests: Total failures: 2
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2939165
  • DQMHistoTests: Total skipped: 341
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 142 log files, 14 edm output root files, 34 DQM output files

@slava77
Copy link
Contributor

slava77 commented Aug 22, 2019

@smuzaffar @mrodozov
this should technically be tested with the cms-bot
What is the right command to test with the bot using the updated relmon?

@mrodozov
Copy link
Contributor

@slava77 testing the python files could be generalize up to "if they compile" (and they does in this case) but for the "what they produce when run" I think a unit test will be required (if there is none, I don't know). Assuming there is no test the proper way to test it would be to ask @jfernan2 what was used to local test it, add it as a unit test and rerun. Apart from that, the python part just ... compiles. If it didn't the scram command would've failed.

@jfernan2
Copy link
Contributor Author

@mrodozov in my test I just made sure that the piece of python code I am modifying/introducing was working locally (with a print) as expected, producing the desired string for the url link. Not a real unit test.
Nevertheless, the code as it is now before this PR, it is just putting a plain link to the DQM RelVal GUI, which nobody is using since the actual ROOT files compared by RelMon are not loaded

@perrotta
Copy link
Contributor

@jfernan2 : I think that this code, and the whole "Utilities/RelMon" package, should belong to dqm rather than reconstruction. If you agree with it, I could just switch "Utilities/RelMon" to dqm in the categories map. Or alternatively, we can can at least share it if you think there are reasons for having it in reco that I am not aware of.
In the meanwhile, I'd just assign this PR to you

@perrotta
Copy link
Contributor

assign dqm

@cmsbuild
Copy link
Contributor

New categories assigned: dqm

@jfernan2,@andrius-k,@schneiml,@fioriNTU,@kmaeshima you have been requested to review this Pull request/Issue and eventually sign? Thanks

@slava77
Copy link
Contributor

slava77 commented Aug 22, 2019

@slava77 testing the python files could be generalize up to "if they compile" (and they does in this case) but for the "what they produce when run" I think a unit test will be required (if there is none, I don't know). Assuming there is no test the proper way to test it would be to ask @jfernan2 what was used to local test it, add it as a unit test and rerun. Apart from that, the python part just ... compiles. If it didn't the scram command would've failed.

Just to be sure, what I meant is that the code updated here is used by cms-bot in the run-pr-comparisons jobs
https://github.com/cms-sw/cms-bot/blob/ae1038f46919118a51636f6aeca3aff7dc6869f4/run-pr-comparisons#L71
My question was if there is a way to run the cms-bot comparisons on top of the build using this PR.

@jfernan2
Copy link
Contributor Author

@perrotta fine by us (DQM). I do not know why it is under reco umbrella (historical reasons?), I just learnt it was this way when creating this PR

@mrodozov
Copy link
Contributor

Not a real unit test

it's not exactly a unit test to test a "unit" but that's not unusual to test pieces like this when required. Example is this:
https://github.com/cms-sw/cmssw/tree/master/PhysicsTools/PythonAnalysis/test
which is full of scripts that are testing something. And we refer to it as "unit test" although they are not exactly unit tests

@perrotta
Copy link
Contributor

Thak you @jfernan2 : cms-bot PR cms-sw/cms-bot#1190 makes the switch

@perrotta
Copy link
Contributor

+1

  • (reco pass-through)

@jfernan2
Copy link
Contributor Author

jfernan2 commented Aug 23, 2019

I am sorry @mrodozov but I am not able to create a test file like you propose which mimics the RelMon environment.
@slava77 in the run-pr-comparison jobs by cms-bot, RelMon is running standalone so that DQM root files are not uploaded to any DQM GUI, except by the bin-by-bin comparison tool which actually uploads them to the development GUI for a real comparison, e.g
https://cmssdt.cern.ch/SDT/jenkins-artifacts/baseLineComparisons/CMSSW_11_0_X_2019-08-19-2300+50694a/33135/dqm-histo-comparison-summary.html

@jfernan2
Copy link
Contributor Author

+1
This PR is not breaking any RelMon functionality at all: it just replaces a general link to the DQM RelVal GUI by a dedicated url with the files involved in the comparison. In the worst case scenario, non-existing root files in GUI like RelMon standalone tests or malformed url, the link will still work pointing to the RelVal GUI as it was previously

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@kpedro88
Copy link
Contributor

+1

@fabiocos
Copy link
Contributor

fabiocos commented Sep 2, 2019

@jfernan2 @perrotta @slava77 we already discussed this point in the recent past, as far as I know RelMon is historically under the reconstruction umbrella because it was originally developed by @dpiparo working with @VinInn to monitor and study workflows and in particular RECO performances. But strictly speaking is more a DQM tool than a RECO one IMO

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants