[Do not merge] testing comparison #1909

smuzaffar · 2023-01-09T14:05:34Z

No description provided.

cmsbuild · 2023-01-09T14:05:58Z

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

smuzaffar · 2023-01-09T14:06:29Z

please test

cmsbuild · 2023-01-09T17:50:53Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7c0a71/29844/summary.html
COMMIT: 0b378fd
CMSSW: CMSSW_13_0_X_2023-01-09-1100/el8_amd64_gcc11
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/1909/29844/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 32 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3555538
DQMHistoTests: Total failures: 1214
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3554302
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 211 log files, 162 edm output root files, 49 DQM output files
TriggerResults: no differences found

NANO Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 15
DQMHistoTests: Total histograms compared: 15414
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 15414
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 14 files compared)
Checked 31 log files, 14 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.31	2.209	2.209	0.000 ( +0.0% )	9.31	9.52	-2.2%	1.502	1.541
2500.311	2.329	2.329	0.000 ( +0.0% )	8.90	9.17	-3.0%	1.869	1.850
2500.312	2.284	2.284	0.000 ( +0.0% )	9.10	9.03	+0.8%	1.858	1.847
2500.33	1.096	1.096	0.000 ( +0.0% )	20.97	21.63	-3.0%	1.644	1.629
2500.331	1.396	1.396	0.000 ( +0.0% )	15.65	15.88	-1.4%	1.792	1.792
2500.332	1.328	1.328	0.000 ( +0.0% )	17.39	17.43	-0.3%	1.750	1.731
2500.4	2.097	2.097	0.000 ( +0.0% )	9.92	10.16	-2.3%	1.383	1.429
2500.401	2.164	2.164	0.000 ( +0.0% )	9.98	10.26	-2.7%	1.184	1.235
2500.5	1.668	1.668	0.000 ( +0.0% )	15.69	16.26	-3.5%	1.095	1.131
2500.501	1.729	1.729	0.000 ( +0.0% )	15.66	16.24	-3.6%	1.098	1.138
2500.51	1.071	1.071	0.000 ( +0.0% )	27.63	28.95	-4.6%	1.410	1.417
2500.511	1.137	1.137	0.000 ( +0.0% )	27.28	28.30	-3.6%	1.433	1.438
2500.6	2.006	2.006	0.000 ( +0.0% )	12.66	13.03	-2.8%	1.160	1.211
2500.601	2.076	2.076	0.000 ( +0.0% )	12.61	12.92	-2.4%	1.174	1.215

smuzaffar · 2023-01-09T21:46:26Z

please test

cmsbuild · 2023-01-10T01:26:24Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7c0a71/29864/summary.html
COMMIT: 0b378fd
CMSSW: CMSSW_13_0_X_2023-01-09-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/1909/29864/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 33 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3555538
DQMHistoTests: Total failures: 1197
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3554319
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 211 log files, 162 edm output root files, 49 DQM output files
TriggerResults: no differences found

smuzaffar · 2023-01-10T06:37:14Z

enable nano

smuzaffar · 2023-01-10T06:37:22Z

please test

cmsbuild · 2023-01-10T10:11:06Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7c0a71/29870/summary.html
COMMIT: 0b378fd
CMSSW: CMSSW_13_0_X_2023-01-09-2300/el8_amd64_gcc11
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/1909/29870/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3555538
DQMHistoTests: Total failures: 154
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3555362
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 211 log files, 162 edm output root files, 49 DQM output files
TriggerResults: no differences found

NANO Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 15
DQMHistoTests: Total histograms compared: 15414
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 15414
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 14 files compared)
Checked 31 log files, 14 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.31	2.209	2.209	0.000 ( +0.0% )	9.49	9.18	+3.4%	1.473	1.466
2500.311	2.329	2.329	0.000 ( +0.0% )	9.09	8.84	+2.8%	1.838	1.831
2500.312	2.284	2.284	0.000 ( +0.0% )	9.21	9.04	+1.8%	1.830	1.823
2500.33	1.096	1.096	0.000 ( +0.0% )	21.46	20.52	+4.6%	1.641	1.646
2500.331	1.396	1.396	0.000 ( +0.0% )	15.86	15.22	+4.2%	1.787	1.791
2500.332	1.328	1.328	0.000 ( +0.0% )	17.30	16.87	+2.6%	1.744	1.747
2500.4	2.097	2.097	0.000 ( +0.0% )	9.90	9.74	+1.6%	1.372	1.373
2500.401	2.164	2.164	0.000 ( +0.0% )	10.23	9.82	+4.1%	1.171	1.162
2500.5	1.668	1.668	0.000 ( +0.0% )	16.24	15.36	+5.7%	1.086	1.079
2500.501	1.729	1.729	0.000 ( +0.0% )	16.20	15.12	+7.2%	1.095	1.090
2500.51	1.071	1.071	0.000 ( +0.0% )	28.77	26.84	+7.2%	1.407	1.382
2500.511	1.137	1.137	0.000 ( +0.0% )	28.31	25.80	+9.7%	1.431	1.406
2500.6	2.006	2.006	0.000 ( +0.0% )	13.10	12.34	+6.1%	1.161	1.148
2500.601	2.076	2.076	0.000 ( +0.0% )	13.02	12.29	+5.9%	1.162	1.155

smuzaffar · 2023-01-10T13:26:24Z

please test

cmsbuild · 2023-01-10T17:23:13Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7c0a71/29880/summary.html
COMMIT: 0b378fd
CMSSW: CMSSW_13_0_X_2023-01-10-1100/el8_amd64_gcc11
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/1909/29880/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 5 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3555538
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3555513
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 211 log files, 162 edm output root files, 49 DQM output files
TriggerResults: no differences found

NANO Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 15
DQMHistoTests: Total histograms compared: 15414
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 15414
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 14 files compared)
Checked 31 log files, 14 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.31	2.209	2.209	0.000 ( +0.0% )	9.48	9.45	+0.4%	1.506	1.563
2500.311	2.329	2.329	0.000 ( +0.0% )	9.09	9.07	+0.2%	1.869	1.929
2500.312	2.284	2.284	0.000 ( +0.0% )	9.22	9.25	-0.3%	1.857	1.920
2500.33	1.096	1.096	0.000 ( +0.0% )	21.42	21.45	-0.1%	1.673	1.672
2500.331	1.396	1.396	0.000 ( +0.0% )	15.99	15.74	+1.6%	1.817	1.821
2500.332	1.328	1.328	0.000 ( +0.0% )	17.84	17.72	+0.6%	1.773	1.779
2500.4	2.097	2.097	0.000 ( +0.0% )	9.95	10.18	-2.3%	1.404	1.460
2500.401	2.164	2.164	0.000 ( +0.0% )	10.29	10.12	+1.7%	1.199	1.258
2500.5	1.668	1.668	0.000 ( +0.0% )	16.39	16.46	-0.4%	1.119	1.175
2500.501	1.729	1.729	0.000 ( +0.0% )	16.29	16.41	-0.7%	1.122	1.177
2500.51	1.071	1.071	0.000 ( +0.0% )	28.58	28.81	-0.8%	1.432	1.466
2500.511	1.137	1.137	0.000 ( +0.0% )	28.30	28.22	+0.3%	1.461	1.487
2500.6	2.006	2.006	0.000 ( +0.0% )	13.11	13.02	+0.7%	1.175	1.234
2500.601	2.076	2.076	0.000 ( +0.0% )	12.99	13.00	-0.1%	1.189	1.252

smuzaffar · 2023-01-11T06:36:49Z

please test

cmsbuild · 2023-01-11T10:31:49Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7c0a71/29905/summary.html
COMMIT: 0b378fd
CMSSW: CMSSW_13_0_X_2023-01-10-2300/el8_amd64_gcc11
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/1909/29905/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 13 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3555538
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3555507
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 211 log files, 162 edm output root files, 49 DQM output files
TriggerResults: no differences found

NANO Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 15
DQMHistoTests: Total histograms compared: 15414
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 15414
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 14 files compared)
Checked 31 log files, 14 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.31	2.209	2.209	0.000 ( +0.0% )	9.44	9.49	-0.5%	1.472	1.556
2500.311	2.329	2.329	0.000 ( +0.0% )	9.15	9.15	+0.1%	1.844	1.926
2500.312	2.284	2.284	0.000 ( +0.0% )	9.29	9.25	+0.4%	1.840	1.917
2500.33	1.096	1.096	0.000 ( +0.0% )	21.80	21.64	+0.7%	1.665	1.667
2500.331	1.396	1.396	0.000 ( +0.0% )	15.93	15.79	+0.8%	1.819	1.819
2500.332	1.328	1.328	0.000 ( +0.0% )	17.83	17.67	+0.9%	1.775	1.774
2500.4	2.097	2.097	0.000 ( +0.0% )	10.14	10.03	+1.1%	1.377	1.463
2500.401	2.164	2.164	0.000 ( +0.0% )	10.13	10.20	-0.7%	1.173	1.263
2500.5	1.668	1.668	0.000 ( +0.0% )	16.39	16.19	+1.2%	1.093	1.176
2500.501	1.729	1.729	0.000 ( +0.0% )	16.29	16.31	-0.1%	1.102	1.179
2500.51	1.071	1.071	0.000 ( +0.0% )	28.51	28.26	+0.9%	1.393	1.468
2500.511	1.137	1.137	0.000 ( +0.0% )	28.20	27.86	+1.2%	1.417	1.492
2500.6	2.006	2.006	0.000 ( +0.0% )	13.12	12.84	+2.2%	1.153	1.239
2500.601	2.076	2.076	0.000 ( +0.0% )	12.99	12.87	+0.9%	1.173	1.241

smuzaffar · 2023-01-18T15:30:49Z

please test for el8_ppc64le_gcc11

smuzaffar · 2023-01-18T15:48:15Z

please test with cms-sw/cmsdist#8254 for el8_ppc64le_gcc11

[Do not merge] testing comparison

0b378fd

cmsbuild added externals-pending orp-pending pending-signatures tests-pending labels Jan 9, 2023

cmsbuild added tests-started and removed tests-pending labels Jan 9, 2023

cmsbuild added tests-approved and removed tests-started labels Jan 9, 2023

cmsbuild added tests-started and removed tests-approved labels Jan 9, 2023

cmsbuild added tests-approved and removed tests-started labels Jan 10, 2023

cmsbuild added tests-started and removed tests-approved labels Jan 10, 2023

cmsbuild added tests-approved and removed tests-started labels Jan 10, 2023

cmsbuild added tests-started and removed tests-approved labels Jan 10, 2023

cmsbuild removed the tests-started label Jan 10, 2023

cmsbuild added the tests-approved label Jan 10, 2023

cmsbuild added tests-started and removed tests-approved labels Jan 11, 2023

cmsbuild added tests-approved and removed tests-started labels Jan 11, 2023

smuzaffar closed this Jan 11, 2023

smuzaffar deleted the smuzaffar-patch-1 branch January 11, 2023 14:00

smuzaffar restored the smuzaffar-patch-1 branch January 18, 2023 15:30

smuzaffar reopened this Jan 18, 2023

cmsbuild added the requires-external label Jan 18, 2023

smuzaffar closed this Jan 18, 2023

smuzaffar deleted the smuzaffar-patch-1 branch March 6, 2023 20:40

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Do not merge] testing comparison #1909

[Do not merge] testing comparison #1909

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 9, 2023

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 9, 2023

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 10, 2023

smuzaffar commented Jan 10, 2023

smuzaffar commented Jan 10, 2023

cmsbuild commented Jan 10, 2023

smuzaffar commented Jan 10, 2023

cmsbuild commented Jan 10, 2023

smuzaffar commented Jan 11, 2023

cmsbuild commented Jan 11, 2023

smuzaffar commented Jan 18, 2023

smuzaffar commented Jan 18, 2023

[Do not merge] testing comparison #1909

[Do not merge] testing comparison #1909

Conversation

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 9, 2023

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 9, 2023

Comparison Summary

NANO Comparison Summary

smuzaffar commented Jan 9, 2023

cmsbuild commented Jan 10, 2023

Comparison Summary

smuzaffar commented Jan 10, 2023

smuzaffar commented Jan 10, 2023

cmsbuild commented Jan 10, 2023

Comparison Summary

NANO Comparison Summary

smuzaffar commented Jan 10, 2023

cmsbuild commented Jan 10, 2023

Comparison Summary

NANO Comparison Summary

smuzaffar commented Jan 11, 2023

cmsbuild commented Jan 11, 2023

Comparison Summary

NANO Comparison Summary

smuzaffar commented Jan 18, 2023

smuzaffar commented Jan 18, 2023