-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[New Commondata Format] Old Jets datasets #1886
Conversation
See #1813 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you very much! (and thank you as well for the very detailed report!). I've left some comments with some modifications. Some of them I've added locally to add the report with the plot (like the kinematics_override
key in CMS_1JET_8TEV
which might make the plot look differently to what you expected)
Please have a look at the plot and check whether everything looks as you expected:
https://vp.nnpdf.science/yWSiPUzmTfyZwHKQttJY-g==
(please add units for the different m12/pt)
As per the datasets themselves:
ATLAS_1JET_8TEV_R06
:- no variant: the t0 chi2 is different, which points to some difference in the treatment of MULT / ADD
- decorrelated: the covmats are quite different (shouldn't they be the same for
DEC
?) which obviously leads to a very different chi2
CMS_1JET_8TEV_PTY
: there is a difference of a factor of two between the computed chi2, the off-diagonal entries of the covmat is different. They are also different with thebugged
version which I expected would reproduce the old dataset (or maybe I should not expect the old one to be reproducible at all?)
For these two the results are completely equivalent (including t0 and everything)
ATLAS_2JET_7TEV_R06_M12Y
: I needed to use thebugged
variant (so I've added that todataset_names.yaml
CMS_2JET_7TEV_M12Y
plot_x: y | ||
figure_by: | ||
- p_T2 | ||
kinematic_coverage: [y, p_T2, sqrt_s] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You are missing plotting information for this one from PLOTTINGTYPE_JET
kinematics_override: jet_sqrt_scale
This should have been fixed now.
The covariance matrices are supposed to be quite different (see https://vp.nnpdf.science/5DpNBePRSne1TZ1Sfky6Kg==/#dataset-atlas_1jet_8tev_r06_dec-variant-decorrelated) and the chi2 too (old value ~ 0.7, new value = 2.6). |
This I find surprising and it is possibly a mistake. I had found a bug for this dataset that was changing the chi2, but not by a factor of 2. Did you compute the chi2 with the cuts applied? |
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
…F/nnpdf into 071223_mnc_old_jet_data_new
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
…F/nnpdf into 071223_mnc_old_jet_data_new
This PR converts the following datasets (and versions therein) into the new commondata format
A report comparing legacy vs New:
https://vp.nnpdf.science/BAIRR312QyuMF3hKa5-9HQ==