`trackingOnly` relval matrix workflows looks messed up #36347

mmusich · 2021-12-03T11:40:55Z

In CMSSW_12_2_X_2021-11-29-2300 out of the 9 trackingOnly wfs available in the standard matrix:

135.13 TTbarFS_13_trackingOnlyValidation+HARVESTUP15FS_trackingOnly 
1325.1 TTbar_13+DIGIUP15+RECOUP15_trackingOnly+HARVESTUP15_trackingOnly 
1325.3 TTbar_13+DIGIUP15+RECOUP15_trackingOnlyLowPU+HARVESTUP15_trackingOnly 
2017.13 TTbarFS_13_trackingOnlyValidation_UP17+HARVESTUP17FS_trackingOnly 
2018.13 TTbarFS_13_trackingOnlyValidation_UP18+HARVESTUP18FS_trackingOnly 
10024.1 2017_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10024.3 2017_trackingOnlyRun2+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10824.1 2018_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
11634.1 2021_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi

$ runTheMatrix.py -nel 135.13,1325.1,1325.3,2017.13,2018.13,10024.1,10024.3,10824.1,11634.1
...

found a total of  921  workflows:
      of which the following 9 were selected:

135.13 TTbarFS_13_trackingOnlyValidation+HARVESTUP15FS_trackingOnly [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,RECO,VALIDATION:@trackingOnlyValidation -n 10 --conditions auto:run2_mc --beamspot Realistic25ns13TeV2016Collision --datatier GEN-SIM-DIGI-RECO,DQMIO --eventcontent FEVTDEBUGHLT,DQM --fast  --era Run2_2016 
                                           [2]: cmsDriver.py step2  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:run2_mc --fast  --mc  --era Run2_2016 --filetype DQM --scenario pp -n 100 

1325.1 TTbar_13+DIGIUP15+RECOUP15_trackingOnly+HARVESTUP15_trackingOnly [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:run2_mc --beamspot Realistic25ns13TeV2016Collision --datatier GEN-SIM --eventcontent FEVTDEBUG --era Run2_2016 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2016 --conditions auto:run2_mc --datatier GEN-SIM-DIGI-RAW-HLTDEBUG --eventcontent FEVTDEBUGHLT --era Run2_2016 -n 10
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:run2_mc -n 10 --datatier GEN-SIM-RECO,DQMIO --eventcontent RECOSIM,DQM --era Run2_2016
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:run2_mc --mc  --era Run2_2016 --filetype DQM -n 100 

1325.3 TTbar_13+DIGIUP15+RECOUP15_trackingOnlyLowPU+HARVESTUP15_trackingOnly [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:run2_mc --beamspot Realistic25ns13TeV2016Collision --datatier GEN-SIM --eventcontent FEVTDEBUG --era Run2_2016 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2016 --conditions auto:run2_mc --datatier GEN-SIM-DIGI-RAW-HLTDEBUG --eventcontent FEVTDEBUGHLT --era Run2_2016 -n 10
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:run2_mc -n 10 --datatier GEN-SIM-RECO,DQMIO --eventcontent RECOSIM,DQM --era Run2_2016_trackingLowPU
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:run2_mc --mc  --era Run2_2016 --filetype DQM -n 100 

2017.13 TTbarFS_13_trackingOnlyValidation_UP17+HARVESTUP17FS_trackingOnly [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,RECO,VALIDATION:@trackingOnlyValidation -n 10 --conditions auto:phase1_2017_realistic --beamspot Realistic25ns13TeVEarly2017Collision --datatier GEN-SIM-DIGI-RECO,DQMIO --eventcontent FEVTDEBUGHLT,DQM --fast  --era Run2_2017_FastSim 
                                           [2]: cmsDriver.py step2  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2017_realistic --fast  --mc  --era Run2_2017_FastSim --filetype DQM --scenario pp -n 100 

2018.13 TTbarFS_13_trackingOnlyValidation_UP18+HARVESTUP18FS_trackingOnly [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,RECO,VALIDATION:@trackingOnlyValidation -n 10 --conditions auto:phase1_2018_realistic --beamspot Realistic25ns13TeVEarly2018Collision --datatier GEN-SIM-DIGI-RECO,DQMIO --eventcontent FEVTDEBUGHLT,DQM --fast  --era Run2_2018_FastSim 
                                           [2]: cmsDriver.py step2  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2018_realistic --fast  --mc  --era Run2_2018_FastSim --filetype DQM --scenario pp -n 100 

10024.1 2017_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2017_realistic --beamspot Realistic25ns13TeVEarly2017Collision --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run2_2017 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2017 --conditions auto:phase1_2017_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run2_2017
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,L1Reco,RECO,RECOSIM,EI,PAT,VALIDATION:@standardValidationNoHLT+@miniAODValidation,DQM:@standardDQMFakeHLT+@miniAODDQM --conditions auto:phase1_2017_realistic --datatier GEN-SIM-RECO,MINIAODSIM,DQMIO -n 10 --eventcontent RECOSIM,MINIAODSIM,DQM --geometry DB:Extended --era Run2_2017
                                           [4]: cmsDriver.py step4  -s HARVESTING:@standardValidationNoHLT+@standardDQMFakeHLT+@miniAODValidation+@miniAODDQM --conditions auto:phase1_2017_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run2_2017 -n 100 

10024.3 2017_trackingOnlyRun2+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2017_realistic --beamspot Realistic25ns13TeVEarly2017Collision --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run2_2017 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2017 --conditions auto:phase1_2017_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run2_2017
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,L1Reco,RECO,RECOSIM,EI,PAT,VALIDATION:@standardValidationNoHLT+@miniAODValidation,DQM:@standardDQMFakeHLT+@miniAODDQM --conditions auto:phase1_2017_realistic --datatier GEN-SIM-RECO,MINIAODSIM,DQMIO -n 10 --eventcontent RECOSIM,MINIAODSIM,DQM --geometry DB:Extended --era Run2_2017
                                           [4]: cmsDriver.py step4  -s HARVESTING:@standardValidationNoHLT+@standardDQMFakeHLT+@miniAODValidation+@miniAODDQM --conditions auto:phase1_2017_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run2_2017 -n 100 

10824.1 2018_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2018_realistic --beamspot Realistic25ns13TeVEarly2018Collision --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run2_2018 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2018 --conditions auto:phase1_2018_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run2_2018
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,L1Reco,RECO,RECOSIM,EI,PAT,VALIDATION:@standardValidationNoHLT+@miniAODValidation,DQM:@standardDQMFakeHLT+@miniAODDQM --conditions auto:phase1_2018_realistic --datatier GEN-SIM-RECO,MINIAODSIM,DQMIO -n 10 --eventcontent RECOSIM,MINIAODSIM,DQM --geometry DB:Extended --era Run2_2018
                                           [4]: cmsDriver.py step4  -s HARVESTING:@standardValidationNoHLT+@standardDQMFakeHLT+@miniAODValidation+@miniAODDQM --conditions auto:phase1_2018_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run2_2018 -n 100 

11634.1 2021_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi [1]: cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2021_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,100 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2021_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3

10024.1, 10024.3, 10824.1 run RECO and not RECO:reconstruction_trackingOnly
11634.1 stops at RAW (??)

for what concerns the upgrade matrix:

 runTheMatrix.py --what upgrade --show | grep trackingOnly
10024.1 2017_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10024.3 2017_trackingOnlyRun2+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10034.1 2017_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10034.3 2017_trackingOnlyRun2+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10424.1 2017Design_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10424.3 2017Design_trackingOnlyRun2+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10434.1 2017Design_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10434.3 2017Design_trackingOnlyRun2+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10824.1 2018_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
10834.1 2018_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
11224.1 2018Design_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
11234.1 2018Design_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT 
11624.1 2021_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi 
11634.1 2021_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi 
12024.1 2021Design_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi 
12034.1 2021Design_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi 
12424.1 2023_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi 
12434.1 2023_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi 
12824.1 2024_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi 
12834.1 2024_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi 
23224.1 2026D49_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
23234.1 2026D49_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
28224.1 2026D60_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
28234.1 2026D60_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
31424.1 2026D68_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
31434.1 2026D68_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
32224.1 2026D70_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
32234.1 2026D70_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
34624.1 2026D76_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
34634.1 2026D76_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
35024.1 2026D77_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
35034.1 2026D77_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
35424.1 2026D78_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
35434.1 2026D78_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
35824.1 2026D79_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
35834.1 2026D79_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
36224.1 2026D80_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
36234.1 2026D80_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
36624.1 2026D81_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
36634.1 2026D81_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
37024.1 2026D82_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
37034.1 2026D82_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
37424.1 2026D83_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
37434.1 2026D83_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
37824.1 2026D84_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
37834.1 2026D84_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
38224.1 2026D85_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
38234.1 2026D85_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
38624.1 2026D86_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
38634.1 2026D86_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal 
39024.1 2026D87_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSimHLBeamSpot+DigiTrigger+RecoGlobal+HARVESTGlobal 
39034.1 2026D87_trackingOnly+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

10024.1, 10024.3, 10034.1, 10034.3, 10424.1, 10424.1,10434.1 ,10434.3, 10824.1, 10834.1, 11224.1, 11234.1 run RECO and not RECO:reconstruction_trackingOnly
11624.1, 11634.1 , 12024.1, 12034.1 , 12424.1 , 12434.1 , 12824.1 , 12834.1 stop at RAW (??)
phase-2 workflow look OK.

PLEASE FIX

The text was updated successfully, but these errors were encountered:

cmsbuild · 2021-12-03T11:41:11Z

A new Issue was created by @mmusich Marco Musich.

@Dr15Jones, @perrotta, @dpiparo, @makortel, @smuzaffar, @qliphy can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

mmusich · 2021-12-03T11:41:13Z

assign pdmv

cmsbuild · 2021-12-03T11:42:10Z

New categories assigned: pdmv

@bbilin,@wajidalikhan,@jordan-martins,@kskovpen you have been requested to review this Pull request/Issue and eventually sign? Thanks

slava77 · 2021-12-03T13:43:17Z

@mmusich
may I suggest to check if 12_2_0_pre2 worked OK.

@kpedro88 , it may be related to your recent PRs

mmusich · 2021-12-03T13:51:02Z

@slava77

may I suggest to check if 12_2_0_pre2 worked OK.

thanks. Indeed the 2021-like workflows look OK in CMSSW_12_2_0_pre2:

$ runTheMatrix.py --what upgrade -nel 11624.1,11634.1,12024.1,12034.1,12424.1,12434.1,12824.1,12834.1 
ignoring non-requested file relval_standard
ignoring non-requested file relval_highstats
ignoring non-requested file relval_pileup
ignoring non-requested file relval_generator
ignoring non-requested file relval_extendedgen
ignoring non-requested file relval_production
ignoring non-requested file relval_ged
processing relval_upgrade
ignoring non-requested file relval_cleanedupgrade
ignoring non-requested file relval_gpu
ignoring non-requested file relval_2017
ignoring non-requested file relval_2026
ignoring non-requested file relval_identity
ignoring non-requested file relval_machine
ignoring non-requested file relval_premix

found a total of  21000  workflows:
      of which the following 8 were selected:

11624.1 2021_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2021_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2021_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2021_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2021_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

11634.1 2021_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2021_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,100 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2021_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2021_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2021_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12024.1 2021Design_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2021_design --beamspot GaussSigmaZ4cm --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2021_design --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2021_design --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2021_design --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12034.1 2021Design_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2021_design --beamspot GaussSigmaZ4cm --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,100 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2021_design --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2021_design --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2021_design --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12424.1 2023_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2023_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2023_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2023_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2023_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12434.1 2023_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2023_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,100 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2023_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2023_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2023_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12824.1 2024_trackingOnly+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2024_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,50 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2024_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2024_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2024_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100 

12834.1 2024_trackingOnly+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST [1]: cmsDriver.py TTbar_14TeV_TuneCP5_cfi  -s GEN,SIM -n 10 --conditions auto:phase1_2024_realistic --beamspot Run3RoundOptics25ns13TeVLowSigmaZ --datatier GEN-SIM --eventcontent FEVTDEBUG --geometry DB:Extended --era Run3 --relval 9000,100 
                                           [2]: cmsDriver.py step2  -s DIGI:pdigi_valid,L1,DIGI2RAW,HLT:@relval2021 --conditions auto:phase1_2024_realistic --datatier GEN-SIM-DIGI-RAW -n 10 --eventcontent FEVTDEBUGHLT --geometry DB:Extended --era Run3
                                           [3]: cmsDriver.py step3  -s RAW2DIGI,RECO:reconstruction_trackingOnly,VALIDATION:@trackingOnlyValidation,DQM:@trackingOnlyDQM --conditions auto:phase1_2024_realistic --datatier GEN-SIM-RECO,DQMIO -n 10 --eventcontent RECOSIM,DQM --geometry DB:Extended --era Run3
                                           [4]: cmsDriver.py step4  -s HARVESTING:@trackingOnlyValidation+@trackingOnlyDQM --conditions auto:phase1_2024_realistic --mc  --geometry DB:Extended --scenario pp --filetype DQM --era Run3 -n 100

The Run2 ones still use RECO and not RECO:reconstruction_trackingOnly

perrotta · 2021-12-03T14:22:44Z

Looking in the IBs, the issue appears between CMSSW_12_2_X_2021-11-29-1100 and CMSSW_12_2_X_2021-11-29-2300

The following PRs were merged in between:
#36279 from fwyzard: Fix assert in prefixScan_t.cu
#36102 from jshlee: GEMGeometryAnalyzer - added first and last strip global position
#36120 from tvami: Add epsilon in comparison of probabilities in SiPixelRecHitQuality
#36272 from bsunanda: Run3-Sim96 Use ESGetToken in the SimWatcher classes of SimG4Core/PrintGeomInfo
#36243 from valsdav: PFID with DNNs - updated model trained on Run3Summer21
#36253 from quark2: Modification on r-phi distribution plots and fix on under/overflow bins in GEM onlineDQM (continued)
#36267 from arsahasransu: Add option for dimuon Delta R for HLTMuonDimuonL3Filter
#36260 from Sam-Harper: adjusting hltGetConfigution "minimal" event content to include the L1
#36167 from kpedro88: consistent implementation of nano step for Run 3
#36281 from dan131riley: Fix assertion comparisons found by gcc11
#36284 from Dr15Jones: Properly import from containers

A suspect being #36167, as Slava already suggested independently...

perrotta · 2021-12-03T14:26:52Z

... and by the way, it is not yet fixed in latest CMSSW_12_2_X_2021-12-03-1100

perrotta · 2021-12-03T15:01:47Z

On the practical side: we were supposed to start building 12_2_0_pre3 by this evening. Should we wait to solve this issue before that? Or none of those workflows is needed to produce the validation samples in pre3 (in which case we can even wait to fix it in time for the final 12_2_o in January)?
@mmusich @cms-sw/pdmv-l2 please let us know.

mmusich · 2021-12-03T15:07:55Z

@mmusich @cms-sw/pdmv-l2 please let us know.

even though the workflows are not used for relval production, it's very inconvenent for development.
If the schedule doesn't allow for @cms-sw/pdmv-l2 to find and deploy a fix I think we can tolerate it to be broken for sometime, though it would be better to fix ASAP.

kpedro88 · 2021-12-03T15:18:42Z

This is indeed another casualty of the Nano step changes for Run3; I will submit a fix today.

kpedro88 · 2021-12-03T17:00:20Z

see #36350

perrotta · 2021-12-06T09:05:42Z

@mmusich this is hopefully fixed by @kpedro88 with #36350 (entered in CMSSW_12_2_X_2021-12-05-2300, and based on which we have already started building CMSSW_12_2_0_pre3). Could you please check and confirm that all workflows look as expected by now, and close this issue if so?

mmusich · 2021-12-06T09:41:51Z

@perrotta here are my observations based on CMSSW_12_2_X_2021-12-05-2300:

the Run-3 workflows now are correctly set-up as they were in CMSSW_12_2_0_pre2 (tested with: runTheMatrix.py --what upgrade -nel 11624.1,11634.1,12024.1,12034.1,12424.1,12434.1,12824.1,12834.1)
the Phase-2 workflows are still correctly set-up (tested with: runTheMatrix.py --what upgrade -nel 11624.1,11634.1,12024.1,12034.1,12424.1,12434.1,12824.1,12834.123224.1,23234.1,28224.1,28234.1,31424.1,31434.1,32224.1,32234.1,34624.1,34634.1,35024.1,35034.1,35424.1,35434.1,35824.1,35834.1,36224.1,36234.1,36624.1,36634.1,37024.1,37034.1,37424.1,37434.1,37824.1,37834.1,38224.1,38234.1,38624.1,38634.1,39024.1,39034.1 )
the Run-2 workflows are still using -s RECO instead of -s RECO:reconstruction_trackingOnly (tested with: runTheMatrix.py --what upgrade -nel 10024.1,10024.3,10034.1,10034.3,10424.1,10424.1,10434.1,10434.3,10824.1,10834.1,11224.1,11234.1)

So even if the immediate concern regarding the development workflows for Run-3 and Phase-2 is settled, I prefer to let the issue open until also the last point is addressed.

perrotta · 2021-12-06T09:52:12Z

the Run-2 workflows are still using -s RECO instead of -s RECO:reconstruction_trackingOnly (tested with: runTheMatrix.py --what upgrade -nel 10024.1,10024.3,10034.1,10034.3,10424.1,10424.1,10434.1,10434.3,10824.1,10834.1,11224.1,11234.1)

So even if the immediate concern regarding the development workflows for Run-3 and Phase-2 is settled, I prefer to let the issue open until also the last point is addressed.

Sure, thank you @mmusich !
Good to pinpoint the remaining issue, to be left to the attention of @cms-sw/pdmv-l2

kpedro88 · 2021-12-06T18:59:49Z

see #36378

mmusich · 2021-12-13T09:49:19Z

@kpedro88
trying again in CMSSW_12_3_X_2021-12-12-0000 (which should contain #36378) I get:

$ runTheMatrix.py --what upgrade -nel 10024.1
ignoring non-requested file relval_standard
ignoring non-requested file relval_highstats
ignoring non-requested file relval_pileup
ignoring non-requested file relval_generator
ignoring non-requested file relval_extendedgen
ignoring non-requested file relval_production
ignoring non-requested file relval_ged
processing relval_upgrade
ERROR reading file: relval_upgrade 'HARVESTFakeHLT_trackingMkFit_2017'
Traceback (most recent call last):
  File "/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_3_X_2021-12-12-0000/bin/slc7_amd64_gcc900/runTheMatrix.py", line 598, in <module>
    ret = runSelected(opt)
  File "/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_3_X_2021-12-12-0000/bin/slc7_amd64_gcc900/runTheMatrix.py", line 23, in runSelected
    mrd.prepare(opt.useInput, opt.refRel, opt.fromScratch)
  File "/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_3_X_2021-12-12-0000/python/Configuration/PyReleaseValidation/MatrixReader.py", line 506, in prepare
    self.readMatrix(matrixFile, useInput, refRel, fromScratch)
  File "/cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc900/cms/cmssw/CMSSW_12_3_X_2021-12-12-0000/python/Configuration/PyReleaseValidation/MatrixReader.py", line 251, in readMatrix
    if self.relvalModule.steps[stepName] is None:
KeyError: 'HARVESTFakeHLT_trackingMkFit_2017'

EDIT :

if the --what upgrade is removed, the command executes fine.

kpedro88 · 2021-12-13T18:38:53Z

Sorry, this was just a mistake in the previous PR: see #36477

mmusich · 2022-02-10T13:33:15Z

Based on a recent test in CMSSW_12_3_X_2022-02-09-2300
I see:

the Run-3 workflows now are correctly set-up as they were in CMSSW_12_2_0_pre2 (tested with: runTheMatrix.py --what upgrade -nel 11624.1,11634.1,12024.1,12034.1,12424.1,12434.1,12824.1,12834.1)
the Phase-2 workflows are still correctly set-up (tested with: runTheMatrix.py --what upgrade -nel 11624.1,11634.1,12024.1,12034.1,12424.1,12434.1,12824.1,12834.123224.1,23234.1,28224.1,28234.1,31424.1,31434.1,32224.1,32234.1,34624.1,34634.1,35024.1,35034.1,35424.1,35434.1,35824.1,35834.1,36224.1,36234.1,36624.1,36634.1,37024.1,37034.1,37424.1,37434.1,37824.1,37834.1,38224.1,38234.1,38624.1,38634.1,39024.1,39034.1 )
the Run-2 workflows are correctly set up (tested with: runTheMatrix.py --what upgrade -nel 10024.1,10024.3,10034.1,10034.3,10424.1,10424.1,10434.1,10434.3,10824.1,10834.1,11224.1,11234.1)

so everything looks OK.

@cms-sw/pdmv-l2 you might want to sign, so that this can be closed.

kskovpen · 2022-02-11T08:32:34Z

+1

cmsbuild · 2022-02-11T08:32:53Z

This issue is fully signed and ready to be closed.

cmsbuild added the pending-assignment label Dec 3, 2021

cmsbuild added pdmv-pending pending-signatures and removed pending-assignment labels Dec 3, 2021

kpedro88 mentioned this issue Dec 3, 2021

More Nano step-related fixes for Run3/Phase2 workflows #36350

Merged

mmusich mentioned this issue Dec 13, 2021

handle FakeHLT steps in trackingOnly workflows #36378

Merged

kpedro88 mentioned this issue Dec 13, 2021

remove unused step from mkFit special workflow #36477

Merged

This was referenced Dec 15, 2021

Adding SiPixel on track charge and shape probs to MiniAOD content #36247

Closed

CMSSW profiling jobs failing for 12.3.X #36504

Closed

cmsbuild removed the pending-signatures label Feb 11, 2022

cmsbuild added fully-signed pdmv-approved and removed pdmv-pending labels Feb 11, 2022

mmusich closed this as completed Feb 11, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`trackingOnly` relval matrix workflows looks messed up #36347

`trackingOnly` relval matrix workflows looks messed up #36347

mmusich commented Dec 3, 2021 •

edited

Loading

cmsbuild commented Dec 3, 2021

mmusich commented Dec 3, 2021 •

edited

Loading

cmsbuild commented Dec 3, 2021

slava77 commented Dec 3, 2021

mmusich commented Dec 3, 2021

perrotta commented Dec 3, 2021 •

edited

Loading

perrotta commented Dec 3, 2021

perrotta commented Dec 3, 2021

mmusich commented Dec 3, 2021

kpedro88 commented Dec 3, 2021

kpedro88 commented Dec 3, 2021

perrotta commented Dec 6, 2021

mmusich commented Dec 6, 2021 •

edited

Loading

perrotta commented Dec 6, 2021

kpedro88 commented Dec 6, 2021

mmusich commented Dec 13, 2021 •

edited

Loading

kpedro88 commented Dec 13, 2021

mmusich commented Feb 10, 2022

kskovpen commented Feb 11, 2022

cmsbuild commented Feb 11, 2022

trackingOnly relval matrix workflows looks messed up #36347

trackingOnly relval matrix workflows looks messed up #36347

Comments

mmusich commented Dec 3, 2021 • edited Loading

PLEASE FIX

cmsbuild commented Dec 3, 2021

mmusich commented Dec 3, 2021 • edited Loading

cmsbuild commented Dec 3, 2021

slava77 commented Dec 3, 2021

mmusich commented Dec 3, 2021

perrotta commented Dec 3, 2021 • edited Loading

perrotta commented Dec 3, 2021

perrotta commented Dec 3, 2021

mmusich commented Dec 3, 2021

kpedro88 commented Dec 3, 2021

kpedro88 commented Dec 3, 2021

perrotta commented Dec 6, 2021

mmusich commented Dec 6, 2021 • edited Loading

perrotta commented Dec 6, 2021

kpedro88 commented Dec 6, 2021

mmusich commented Dec 13, 2021 • edited Loading

EDIT :

kpedro88 commented Dec 13, 2021

mmusich commented Feb 10, 2022

kskovpen commented Feb 11, 2022

cmsbuild commented Feb 11, 2022

`trackingOnly` relval matrix workflows looks messed up #36347

`trackingOnly` relval matrix workflows looks messed up #36347

mmusich commented Dec 3, 2021 •

edited

Loading

mmusich commented Dec 3, 2021 •

edited

Loading

perrotta commented Dec 3, 2021 •

edited

Loading

mmusich commented Dec 6, 2021 •

edited

Loading

mmusich commented Dec 13, 2021 •

edited

Loading