Script to make HTML pages and PDF plots more user-friendly

[jpata]

We use the script https://github.com/jpata/cmssw/blob/pfvalidation/Validation/RecoParticleFlow/test/compare.py
to create A vs B type comparison plots from DQM*.root files.

I'm working on creating a more convenient command line interface for that script, something along the lines of

./test/compare.py --sample QCD:DQMfile1.root:DQMfile2.root:DQMfile3.root --sample QCDNoPU:DQMfile4.root:DQMfile5.root:DQMfile6.root --plots JetResponse:reso_dist_10_24:reso_dist_10_24_eta05:reso_dist_10_24_eta13

would compare 3 versions of the sample QCD (DQMFile[1-3].root) and 3 versions of the sample QCDNoPu (DQMFile[4-6].root) and plot the histograms reso_dist_10_24_eta05:reso_dist_10_24_eta13 from the folder JetResponse on a canvas reso_dist_10_24.

@hatakeyamak @juska would appreciate your thoughts.

[jpata]

@juska @hatakeyamak can you give a try if you find the plotting script interface usable by you? Attached is a DQM root file for testing.

DQM_V0001_R000000001__Global__CMSSW_X_Y_Z__RECO.root.zip

[hatakeyamak]

Hey, Thanks. I will try.

[juska]

I'm now able to run the code without any problems by simply following the instructions in README, thanks a lot Joosep for the update! (I'm only in the reco processing step for now though)

I am waiting to hear back from Chad for hearing what is the 'official' match definition. If the deltaR requirement was something else than 0.2, that's one important fix. The convention is that it is half the cone size (or radius parameter in case of anti-kT), so we should have it at 0.2 as we have R=0.4 jets.
I'm surprised though that despite having the much looser matching condition the number of jets ending up to the response histograms was rather low (IIRC) - this could have to do with the matching.

I'll get back to you later today. I'll fix the pfreso.py to take the files as input and to spit out another file for the compare.py to use, and I'll try to see if I can recreate my nanoAOD resolution result with the DQM code.

[juska]

Hi Joosep @jpata I still get the following error in the DQM step: [juska@lxplus104 tmp3]$ pwd /afs/cern.ch/user/j/juska/work/pfdev/CMSSW_9_4_11/src/Validation/RecoParticleFlow/tmp3 [juska@lxplus104 tmp3]$ ls QCD [juska@lxplus104 tmp3]$ sh $CMSSW_BASE/src/Validation/RecoParticleFlow/test/run_relval.sh QCD dqm 0 /afs/cern.ch/work/j/juska/pfdev/CMSSW_9_4_11/src/Validation/RecoParticleFlow/test/filelist_QCD.txt QCD DQM 0 Running step DQM ls: cannot access step3.*.*.root: No such file or directory step3 filenames for DQM: Cheers, Juska

…

On 1/25/19 2:43 AM, Joosep Pata wrote: @juska <https://github.com/juska> @hatakeyamak <https://github.com/hatakeyamak> can you give a try if you find the interface usable by you? Attached is a DQM root file for testing. DQM_V0001_R000000001__Global__CMSSW_X_Y_Z__RECO.root.zip <https://github.com/jpata/cmssw/files/2794318/DQM_V0001_R000000001__Global__CMSSW_X_Y_Z__RECO.root.zip> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#12 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AHKcoBUm5FPgJvnnqP8lA0djLBTpVA71ks5vGmE5gaJpZM4aR6Ad>.

[jpata]

Ah sorry, I had edited the script run_relval.sh script for the batch workflow but didn't test it with just the local workflow, which produces files with a slightly different name. Can you try again with 94722fd?

[jpata]

The comparison script now has the following default commandline interface

$ python test/compare.py --help
usage: compare.py [-h] -s SAMPLE [-p PLOTS] [--doResponsePlots]

optional arguments:
  -h, --help            show this help message and exit
  -s SAMPLE, --sample SAMPLE
                        DQM files to compare for a single sample, in the
                        format 'name:file1.root:file2.root:...:fileN.root'
  -p PLOTS, --plots PLOTS
                        Plots to put on a single canvas, in the format
                        'folder:name:plot1:plot2:...:plotN'
  --doResponsePlots     If enabled, do all jet response plots

and usage can be as simple as

$ python test/compare.py --sample FlatQCD:DQM1.root:DQM2.root--doResponsePlots

in order to produce the folder plots with HTML output.

I'm closing this issue, please make a new one in case you have additional suggestions or wishes how the plots should be called.