Replay for Run 3 collisions

[francescobrivio]

Replay Request

Requestor
Francesco Brivio for AlCaDB

Describe the configuration

• Release: CMSSW_12_3_3_patch1
• Run: 346512,349840,350966
• GTs:
  • expressGlobalTag: 123X_dataRun3_Express_Candidate_2022_05_19_09_12_41
  • promptrecoGlobalTag: 123X_dataRun3_Prompt_Candidate_2022_05_19_09_16_57
  • alcap0GlobalTag: 123X_dataRun3_Prompt_Candidate_2022_05_19_09_16_57
• Additional changes:
  • Updates to the AlCaRecoMatrix for Run 3 collisions as detailed in AlCaRecoMatrix#COLLISIONS_2022 twiki
    • Added some new producers (all already tested in previous replays)
    • Removed some unused producers
    • Added AlCaPPS dataset with no producers (RAW dataset will be the only output)
  • Testing GT candidates for Run 3 collisions

Purpose of the test
This replay is to test the final configuration for Run 3 collision data taking.

T0 Operations cmsTalk thread
https://cms-talk.web.cern.ch/t/replay-for-testing-the-run-3-collisions-setup/10676

---

EDIT
As discussed at the Joint Ops meeting (gDoc here), the repacking step should still use CMSSW_12_3_3.

[francescobrivio]

test syntax please

[francescobrivio]

test syntax please

[francescobrivio]

run replay please

• new release is ready /cvmfs/cms.cern.ch/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_3_3_patch1

[cmsdmwmbot]

An replay is requested by francescobrivio. Waiting for available job slot.

[francescobrivio]

test syntax please

[francescobrivio]

As discussed at the Joint Ops meeting (gDoc here), I updated the replay to use CMSSW_12_3_3 for the repacking step in commit c050638 and for the previous releases in commit 03f3c41, in order to fix the bug introduced in cms-sw/cmssw#38017.

[francescobrivio]

test syntax please

[germanfgv]

run replay please

[cmsdmwmbot]

Replay testing PR 'Replay for Run 3 collisions'
An automatic replay has been requested by germanfgv.
Here is a brief description of the replay.
Deployment ID: 220520154051
Github PR: #4677
PR author: francescobrivio
Requestor: Francesco Brivio for AlCaDB
Injected runs: 346512,349840,350966
CMSSW release: CMSSW_12_3_3_patch1
Tier0 release: 3.0.4
ppScenario: ppEra_Run3
Tier0 Config: https://cmst0.web.cern.ch/CMST0/tier0/offline_config/ReplayOfflineConfiguration_047.php
Contatiner ID: 1
Jenkins Build: https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/460/
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-740

[cmsdmwmbot]

Replay testing PR 'Replay for Run 3 collisions'
An automatic replay has been requested by francescobrivio.
Here is a brief description of the replay.
Deployment ID:
Github PR: #4677
PR author: francescobrivio
Requestor: Francesco Brivio for AlCaDB
Injected runs: 346512,349840,350966
CMSSW release: CMSSW_12_3_3_patch1
Tier0 release: 3.0.4
ppScenario: ppEra_Run3
Tier0 Config: https://cmst0.web.cern.ch/CMST0/tier0/offline_config/ReplayOfflineConfiguration_047.php
Contatiner ID: 3
Jenkins Build: https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/459/
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-741

[cmsdmwmbot]

Monitoring for replay is closed.
Log Begins ====
Tier0_REPLAY v459 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay for Run 3 collisions
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-741
There is no fileset and job.
All filesets were closed.
There was NO paused job in the replay.
End.
Replay was succesfull.
End.

End Of Log ====

[cmsdmwmbot]

An replay is requested by germanfgv. Waiting for available job slot.

[francescobrivio]

test syntax please

[germanfgv]

run replay please

[cmsdmwmbot]

Replay testing PR 'Replay for Run 3 collisions'
An automatic replay has been requested by germanfgv.
Here is a brief description of the replay.
Deployment ID: 220524141838
Github PR: #4677
PR author: francescobrivio
Requestor: Francesco Brivio for AlCaDB
Injected runs: 346512,349840
CMSSW release: CMSSW_12_3_4_patch2
Tier0 release: 3.0.4
ppScenario: ppEra_Run3
Tier0 Config: https://cmst0.web.cern.ch/CMST0/tier0/offline_config/ReplayOfflineConfiguration_047.php
Contatiner ID: 1
Jenkins Build: https://cmssdt.cern.ch/dmwm-jenkins/job/DMWM-T0-PR-test-job/464/
Jira Issue : https://its.cern.ch/jira/browse/CMSTZDEV-743

[cmsdmwmbot]

Monitoring for replay is closed.
Log Begins ====
Tier0_REPLAY v464 DMWM-T0-PR-test-job on vocms047.cern.ch. Replay for Run 3 collisions
JIRA URL : https://its.cern.ch/jira/browse/CMSTZDEV-743
All repack workflows were processed.
All filesets were closed.
There was NO paused job in the replay.
End.
Replay was succesfull.
End.
Return 8001 : 1 job(s)
#Error message ====
INFO:root:CMSSW configured for GPU required: forbidden, with these settings: None
INFO:root:Executing CMSSW step
INFO:root:Runing SCRAM
INFO:root:Running PRE scripts
INFO:root: Invoking command:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH
/cvmfs/cms.cern.ch/COMP/slc7_amd64_gcc630/external/python3/3.8.2-comp/bin/python3 -m WMCore.WMRuntime.ScriptInvoke WMTaskSpace.cmsRun1 SetupCMSSWPset

INFO:root:RUNNING SCRAM SCRIPTS
INFO:root:Executing CMSSW. args: ['/bin/bash', '/srv/job/WMTaskSpace/cmsRun1/cmsRun1-main.sh', '', 'slc7_amd64_gcc10', 'scramv1', 'CMSSW', 'CMSSW_12_3_4_patch2', 'FrameworkJobReport.xml', 'cmsRun', 'PSet.py', '', '', '']
CRITICAL:root:Error running cmsRun
{'arguments': ['/bin/bash', '/srv/job/WMTaskSpace/cmsRun1/cmsRun1-main.sh', '', 'slc7_amd64_gcc10', 'scramv1', 'CMSSW', 'CMSSW_12_3_4_patch2', 'FrameworkJobReport.xml', 'cmsRun', 'PSet.py', '', '', '']}
CMSSW Return code: 8001

CRITICAL:root:Error message: An exception of category 'Incomplete configuration' occurred while
[0] Constructing the EventProcessor
[1] Constructing ESSource: class=PoolDBESSource label='GlobalTag'
Exception Message:
Valid site-local-config not found at /afs/cern.ch/cms/SITECONF/local/JobConfig/site-local-config.xml
CRITICAL:root:CMSDefaultHandler Diagnostic Handler invoked
WARNING:root:Exit code: 8001 has been already added to the job report
WARNING:root:Exit code: 8001 has been already added to the job report
WARNING:root:Exit code: 8001 has been already added to the job report
INFO:root:Steps.Executors.CMSSW.post called

#END====

End Of Log ====

[tvami]

@francescobrivio my understanding is that the content of this is included in #4678, so I think this PR can be closed.

[francescobrivio]

Changes included in #4678