Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[G4] Update geant4 to version 11.3.ref02 #9742

Open
wants to merge 1 commit into
base: IB/CMSSW_15_1_X/g4
Choose a base branch
from

Conversation

iarspider
Copy link
Contributor

No description provided.

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @iarspider for branch IB/CMSSW_15_1_X/g4.

@cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 11, 2025

cms-bot internal usage

@iarspider
Copy link
Contributor Author

please test for CMSSW_15_1_GEANT4_X

@iarspider
Copy link
Contributor Author

please test for CMSSW_15_1_G4VECGEOM_X

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-de1bbb/44908/summary.html
COMMIT: 9e6cd02
CMSSW: CMSSW_15_1_G4VECGEOM_X_2025-03-09-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9742/44908/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 11 errors in the following unit tests:

---> test trackerMaterialAnalysisPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS
---> test materialBudgetTrackerPlots had ERRORS
and more ...

RelVals

The relvals timed out after 4 hours.

AddOn Tests

  • unknown
AddOnTest might have timed out: FAILED -  secs

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-de1bbb/44909/summary.html
COMMIT: 9e6cd02
CMSSW: CMSSW_15_1_GEANT4_X_2025-03-09-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9742/44909/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 11 errors in the following unit tests:

---> test trackerMaterialAnalysisPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS
---> test materialBudgetTrackerPlots had ERRORS
and more ...

RelVals

The relvals timed out after 4 hours.

AddOn Tests

  • unknown
AddOnTest might have timed out: FAILED -  secs

@iarspider
Copy link
Contributor Author

iarspider commented Mar 11, 2025 via email

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-de1bbb/44929/summary.html
COMMIT: 9e6cd02
CMSSW: CMSSW_15_1_GEANT4_X_2025-03-09-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9742/44929/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 11 errors in the following unit tests:

---> test trackerMaterialAnalysisPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS
---> test materialBudgetTrackerPlots had ERRORS
and more ...

RelVals

The relvals timed out after 4 hours.

AddOn Tests

  • unknown
AddOnTest might have timed out: FAILED -  secs

@smuzaffar
Copy link
Contributor

@iarspider , can you try running any of these tests locally and see why they are hanging?

@iarspider
Copy link
Contributor Author

@civanch all unit tests (and relvals) failed due to timeout. I have started trackerMaterialAnalysisPlots locally and got these stacktraces using gdb:

Thread 4 (Thread 0x7fb25777f700 (LWP 3993008)):
#0  0x00007fb28ab32098 in nanosleep () from /lib64/libc.so.6
#1  0x00007fb25b693a6b in G4GeometryManager::UndertakeOptimisation() [clone .isra.0] () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#2  0x00007fb25b63f2c3 in G4RunManagerKernel::RunInitialization(bool) [clone .constprop.0] () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#3  0x00007fb25ac62c9d in RunManagerMTWorker::initializeG4(RunManagerMT*, edm::EventSetup const&) () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#4  0x00007fb25ac758da in omt::ThreadHandoff::Functor<OscarMTProducer::beginRun(edm::Run const&, edm::EventSetup const&)::{lambda()#1}>::execute() () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#5  0x00007fb25ac66f0a in omt::ThreadHandoff::threadLoop(void*) () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#6  0x00007fb28a28c1ca in start_thread () from /lib64/libpthread.so.0
#7  0x00007fb28aa638d3 in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7fb258678700 (LWP 3993007)):
#0  0x00007fb28a292371 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007fb25ac50913 in OscarMTMasterThread::OscarMTMasterThread(edm::ParameterSet const&)::{lambda()#1}::operator()() const () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#2  0x00007fb28aed8a73 in std::execute_native_thread_routine (__p=0x7fb261edff00) at ../../../../../libstdc++-v3/src/c++11/shared_ptr_base.h:82
#3  0x00007fb28a28c1ca in start_thread () from /lib64/libpthread.so.0
#4  0x00007fb28aa638d3 in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7fb261106700 (LWP 3993001)):
#0  0x00007fb28ab58534 in read () from /lib64/libc.so.6
#1  0x00007fb283254a8b in edm::service::InitRootHandlers::stacktraceHelperThread() () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/pluginFWCoreServicesPlugins.so
#2  0x00007fb28aed8a73 in std::execute_native_thread_routine (__p=0x7fb2647c2f60) at ../../../../../libstdc++-v3/src/c++11/shared_ptr_base.h:82
#3  0x00007fb28a28c1ca in start_thread () from /lib64/libpthread.so.0
#4  0x00007fb28aa638d3 in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7fb2894f7580 (LWP 3992991)):
#0  0x00007fb28a292371 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007fb25ac69273 in OscarMTProducer::beginRun(edm::Run const&, edm::EventSetup const&) () from /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/biglib/el8_amd64_gcc12/pluginSimulation.so
#2  0x00007fb28baa8c3d in edm::WorkerT<edm::stream::EDProducerAdaptorBase>::implDoStreamBegin(edm::StreamID, edm::RunTransitionInfo const&, edm::ModuleCallingContext const*) ()
   from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#3  0x00007fb28b9c5ba0 in edm::Worker::doWorkNoPrefetchingAsync<edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1> >(edm::WaitingTaskHolder, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::ServiceToken const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}::operator()() const () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#4  0x00007fb28b9cfdc3 in tbb::detail::d2::function_task<edm::Worker::doWorkNoPrefetchingAsync<edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1> >(edm::WaitingTaskHolder, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::ServiceToken const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}>::execute(tbb::detail::d1::execution_data&) ()
   from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#5  0x00007fb28b04a87b in tbb::detail::r1::task_dispatcher::local_wait_for_all<false, tbb::detail::r1::external_waiter> (waiter=..., t=0x7fb288bdab00, this=<optimized out>)
    at /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc12/external/gcc/12.3.1-40d504be6370b5a30e3947a6e575ca28/include/c++/12.3.1/bits/_small_object_pool.h:230
#6  tbb::detail::r1::task_dispatcher::local_wait_for_all<tbb::detail::r1::external_waiter> (waiter=..., waiter@entry=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>, t=<optimized out>, 
    t@entry=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>, this=<optimized out>) at /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el8_amd64_gcc12/external/tbb/v2022.0.0-10fdc07bd3d228f4c274203a8cd20b5c/build/src/tbb/semaphore.h:470
#7  tbb::detail::r1::task_dispatcher::execute_and_wait (t=<optimized out>, wait_ctx=..., w_ctx=...) at /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el8_amd64_gcc12/external/tbb/v2022.0.0-10fdc07bd3d228f4c274203a8cd20b5c/build/src/tbb/concurrent_monitor_mutex.h:168
#8  0x00007fb28b9a65bf in edm::FinalWaitingTask::wait() () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#9  0x00007fb28b9b4ba1 in edm::EventProcessor::processRuns() () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#10 0x00007fb28b9b5051 in edm::EventProcessor::runToCompletion() () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02880/el8_amd64_gcc12/cms/cmssw/CMSSW_15_1_GEANT4_X_2025-03-09-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#11 0x0000000000408556 in tbb::detail::d1::task_arena_function<main::{lambda()#1}::operator()() const::{lambda()#1}, void>::operator()() const ()
#12 0x00007fb28b038f71 in tbb::detail::r1::task_arena_impl::execute (ta=..., d=warning: RTTI symbol not found for class 'tbb::detail::d1::task_arena_function<main::{lambda()#1}::operator()() const::{lambda()#1}, void>'
...) at /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc12/external/gcc/12.3.1-40d504be6370b5a30e3947a6e575ca28/lib/gcc/x86_64-redhat-linux-gnu/12.3.1/include/gthr-default.h:821
#13 0x000000000040a283 in main::{lambda()#1}::operator()() const ()
#14 0x00000000004051b8 in main ()

Log file (after killing cmsRun process by hand):

===== Test "trackerMaterialAnalysisPlots" ====
+ VGEO_DIR=/build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/src/SimTracker/TrackerMaterialAnalysis/
+ TEST_DIR=.
+ cmsRun /build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/src/SimTracker/TrackerMaterialAnalysis//test/trackingMaterialProducer10GeVNeutrino_ForPhaseII.py nEvents=1000
/build/razumov/shift/CMSSW_15_1_GEANT4_X_2025-03-09-2300/src/SimTracker/TrackerMaterialAnalysis/test/genTrackerPlots.sh: line 6: 3992991 Killed                  cmsRun ${VGEO_DIR}/test/trackingMaterialProducer10GeVNeutrino_ForPhaseII.py nEvents=1000 > $TEST_DIR/producer.log 2>&1

---> test trackerMaterialAnalysisPlots had ERRORS
TestTime:2451
^^^^ End Test trackerMaterialAnalysisPlots ^^^^

@civanch
Copy link
Contributor

civanch commented Mar 12, 2025

@iarspider , thanks for the info. This is a new feature introduced by the geometry group, in past it was enabled by request. In this reference version they enable it by default. I have to think how to handle this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants