Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to get ES data using an invalid token in SiPixelPhase2DigiToClusterCUDA #36604

Closed
makortel opened this issue Dec 28, 2021 · 7 comments
Closed

Comments

@makortel
Copy link
Contributor

Workflow 39434.502 step 3 is failing on slc7_ppc64le_gcc11 since CMSSW_12_3_X_2021-12-23-2300

----- Begin Fatal Exception 24-Dec-2021 07:02:22 CET-----------------------
An exception of category 'InvalidESGetToken' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 2 stream: 0
   [1] Running path 'dqmoffline_step'
   [2] Prefetching for module PrimaryVertexMonitor/'pixelPVMonitor'
   [3] Prefetching for module PixelVertexProducer/'pixelVertices'
   [4] Prefetching for module PixelTrackProducer/'pixelTracks'
   [5] Prefetching for module CAHitQuadrupletEDProducer/'pixelTracksHitQuadruplets'
   [6] Prefetching for module HitPairEDProducer/'pixelTracksHitDoublets'
   [7] Prefetching for module SeedingLayersEDProducer/'pixelTracksSeedLayers'
   [8] Prefetching for module SiPixelRecHitFromCUDA/'siPixelRecHitsPreSplitting@cuda'
   [9] Prefetching for module SiPixelRecHitCUDA/'siPixelRecHitsPreSplittingCUDA'
   [10] Calling method for module SiPixelPhase2DigiToClusterCUDA/'siPixelClustersPreSplittingCUDA'
Exception Message:
Attempted to get data using an invalid token of type ESGetToken<TrackerGeometry,TrackerDigiGeometryRecord>.
Please call consumes to properly initialize the token.
----- End Fatal Exception -------------------------------------------------

https://cmssdt.cern.ch/SDT/cgi-bin/logreader/slc7_ppc64le_gcc11/CMSSW_12_3_X_2021-12-23-2300/pyRelValMatrixLogs/run/39434.502_TTbar_14TeV+2026D88_Patatrack_PixelOnlyGPU+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal/step3_TTbar_14TeV+2026D88_Patatrack_PixelOnlyGPU+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal.log#/

@makortel
Copy link
Contributor Author

assign reconstruction, heterogeneous

@cmsbuild
Copy link
Contributor

New categories assigned: heterogeneous,reconstruction

@slava77,@jpata,@fwyzard,@clacaputo,@makortel you have been requested to review this Pull request/Issue and eventually sign? Thanks

@cmsbuild
Copy link
Contributor

A new Issue was created by @makortel Matti Kortelainen.

@Dr15Jones, @perrotta, @dpiparo, @makortel, @smuzaffar, @qliphy can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

@makortel
Copy link
Contributor Author

I'm wondering why this is failing only in PowerPC IBs. Maybe the reason is that the PPC machine has GPUs

%MSG-i CUDAService:  (NoModuleName) 24-Dec-2021 07:00:45 CET pre-events
CUDA runtime version 11.4, driver version 11.4, NVIDIA driver version 440.33.01
CUDA device 0: Tesla P100-SXM2-16GB (sm_60)
CUDA device 1: Tesla P100-SXM2-16GB (sm_60)
CUDA device 2: Tesla P100-SXM2-16GB (sm_60)
CUDA device 3: Tesla P100-SXM2-16GB (sm_60)
%MSG

whereas for amd64 this workflow is not being tested in GPU_X IBs?

@makortel
Copy link
Contributor Author

FYI @cms-sw/trk-dpg-l2 @AdrianoDee

@mmusich
Copy link
Contributor

mmusich commented Jan 11, 2022

I think this can be closed, as it was solved by #36607, right?

@makortel
Copy link
Contributor Author

+heterogeneous

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants