Build in Zeuthen #9

fiedl · 2022-09-09T09:29:48Z

Sync local and remote directories with mutagen
Build icetray in zeuthen
Test propagation in zeuthen

The text was updated successfully, but these errors were encountered:

fiedl · 2022-09-09T10:28:31Z

Sync folders with mutagen

[2022-09-09 11:34:31] fiedl@fiedl-mbp ~/icecube/icetray main 79f9588ad
▶ brew install mutagen-io/mutagen/mutage
▶ brew install mutagen-io/mutagen/mutagen-compose
▶ mutagen sync create --stage-mode=internal --name icetray-zeuthen ~/icecube/icetray fiedl@warp-zeuthen.desy.de:/afs/ifh.de/group/amanda/scratch/fiedl/icetray
▶ mutagen sync create --stage-mode=internal --name hole-ice-scripts-zeuthen ~/icecube/hole-ice-scripts fiedl@warp-zeuthen.desy.de:/afs/ifh.de/group/amanda/scratch/fiedl/hole-ice-scripts

Sync später beenden:

[2022-09-09 11:52:26] fiedl@fiedl-mbp ~/icecube/icetray main 79f9588ad
▶ mutagen sync terminate icetray-zeuthen
▶ mutagen sync terminate hole-ice-scripts-zeuthen

fiedl · 2022-09-09T11:20:00Z

Build icetray on zeuthen

[2022-09-09 13:14:46] fiedl@kepler00 /afs/ifh.de/group/amanda/scratch/fiedl/icetray-build
▶ source /cvmfs/icecube.opensciencegrid.org/py3-v4.2.1/setup.sh
▶ cmake -D CMAKE_BUILD_TYPE=Debug -D SYSTEM_PACKAGES=true ../icetray
-- + clsim
-- +-- Building with SSE extensions for x86/amd64/x86_64.
-- +-- python [symlinks]
-- +-- OpenCL not found, skipping support
-- +-- CUDA support disabled (CUDA >= 10 not found)

fiedl · 2022-09-09T12:12:08Z

https://icecube-spno.slack.com/archives/C02KQL9KN/p1662722634332219

[2022-09-09 13:14:46] fiedl@kepler00 /afs/ifh.de/group/amanda/scratch/fiedl/icetray-build
▶ /cvmfs/icecube.opensciencegrid.org/py3-v4.2.1/setup.sh
▶ module load cuda/11.6
▶ export OPENCL_VENDOR_PATH=/cvmfs/icecube.opensciencegrid.org/distrib/OpenCL_RHEL_7_x86_64
▶ cmake -D CMAKE_BUILD_TYPE=Debug -D SYSTEM_PACKAGES=true ../icetray
-- + clsim
-- +-- Building with SSE extensions for x86/amd64/x86_64.
-- +-- python [symlinks]
-- +-- Build clsim with OpenCL support
-- --- no tabulator (OpenCL  is too old)
-- +-- CUDA architectures: 35 37 52 61 75 80 86
-- +-- CUDA support (found CUDA 11.6.124)
-- +-- Geant4 support
-- +-- clsim-pybindings
-- +-- /cvmfs/icecube.opensciencegrid.org/py3-v4.1.0/../data/safeprimes_base32.gz data file exists, skipping download
-- +-- gmp support (make_safeprimes utility)

fiedl · 2022-09-09T12:29:20Z

Or, with a symlink to access everything from ~/icecube:

[2022-09-09 14:20:59] fiedl@kepler00 ~
▶ ln -s /afs/ifh.de/group/amanda/scratch/fiedl/icecube ~/icecube

[2022-09-09 14:22:36] fiedl@kepler00 ~/icecube
▶ mkdir icetray hole-ice-scripts

[2022-09-09 14:23:47] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync create --stage-mode=internal --name icetray-zeuthen ~/icecube/icetray fiedl@warp-zeuthen.desy.de:~/icecube/icetray
▶ mutagen sync create --stage-mode=internal --name hole-ice-scripts-zeuthen ~/icecube/hole-ice-scripts fiedl@warp-zeuthen.desy.de:~/icecube/hole-ice-scripts

[2022-09-09 14:28:48] fiedl@kepler00 ~/icecube/icetray-build
▶ /cvmfs/icecube.opensciencegrid.org/py3-v4.2.1/setup.sh
▶ module load cuda/11.6
▶ export OPENCL_VENDOR_PATH=/cvmfs/icecube.opensciencegrid.org/distrib/OpenCL_RHEL_7_x86_64
▶ cmake -D CMAKE_BUILD_TYPE=Debug -D SYSTEM_PACKAGES=true ../icetray
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
OPENCL_LIBRARIES

[2022-09-09 14:36:24] fiedl@kepler00 ~/icecube/icetray-build
▶ make -j 4
make: *** Keine Targets angegeben und keine »make«-Steuerdatei gefunden.  Schluss

fiedl · 2022-09-09T14:53:43Z

With the help of jvs, this is how icetray can be built in zeuthen:

Optional: Use scratch space for quota reasons

[2022-09-09 14:20:59] fiedl@kepler00 ~
▶ ln -s /afs/ifh.de/group/amanda/scratch/fiedl/icecube ~/icecube

Optional: Sync local dev machine with zeuthen

[2022-09-09 14:23:47] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync create --stage-mode=internal --name icetray-zeuthen ~/icecube/icetray fiedl@warp-zeuthen.desy.de:~/icecube/icetray
▶ mutagen sync create --stage-mode=internal --name hole-ice-scripts-zeuthen ~/icecube/hole-ice-scripts fiedl@warp-zeuthen.desy.de:~/icecube/hole-ice-scripts

For opencl support, we need a newer cmake version

[2022-09-09 16:28:48] fiedl@kepler00 ~/icecube
▶ wget -qO- https://github.com/Kitware/CMake/releases/download/v3.24.1/cmake-3.24.1.tar.gz | tar xz

[2022-09-09 16:30:43] fiedl@kepler00 ~/icecube/cmake-3.24.1
▶ cmake .
▶ make -j 8
▶ export PATH=~/icecube/cmake-3.24.1/bin:$PATH
▶ cmake --version
cmake version 3.24.1

Finally, build icetray

[2022-09-09 16:39:46] fiedl@kepler00 ~/icecube/icetray-build
▶ /cvmfs/icecube.opensciencegrid.org/py3-v4.2.1/setup.sh
▶ module load cuda/11.6
▶ export OPENCL_VENDOR_PATH=/cvmfs/icecube.opensciencegrid.org/distrib/OpenCL_RHEL_7_x86_64/etc/OpenCL/vendors
▶ cmake -D CMAKE_BUILD_TYPE=Debug -D SYSTEM_PACKAGES=true ../icetray
▶ make -j 8

fiedl · 2022-09-09T15:26:52Z

Test propagation script in zeuthen

[2022-09-09 17:24:37] fiedl@kepler00 ~/icecube/hole-ice-scripts
▶ ~/icecube/icetray-build/env-shell.sh
▶ scripts/generate_photons.py
Traceback (most recent call last):
  File "scripts/generate_photons.py", line 63, in <module>
    main()
  File "scripts/generate_photons.py", line 16, in main
    random_number_generator = phys_services.I3SPRNGRandomService(
AttributeError: module 'icecube.phys_services' has no attribute 'I3SPRNGRandomService'

fiedl · 2022-09-09T15:55:16Z

With this workaround (de2bdd3), the scripts can be executed:

[2022-09-09 17:50:55] fiedl@kepler00 ~/icecube/hole-ice-scripts
▶ ~/icecube/icetray-build/env-shell.sh
▶ scripts/generate_photons.py
▶ scripts/propagate_photons.py

Finally works 👍

#9

fiedl · 2022-09-10T12:34:59Z

Mutagen

I'm using mutagen to sync my local icetray source folder and my local script folder to the corresponding folders in zeuthen. Then I can work on the files locally, open files locally in steamshovel, but run scripts remotely in zeuthen.

With password-less ssh into zeuthen (#13), the mutagen commands should be:

Install mutagen

[2022-09-09 11:34:31] fiedl@fiedl-mbp ~/icecube/icetray main 79f9588ad
▶ brew install mutagen-io/mutagen/mutage
▶ brew install mutagen-io/mutagen/mutagen-compose

Create directory syncs

[2022-09-09 11:34:31] fiedl@fiedl-mbp ~/icecube/icetray main 79f9588ad
▶ kinit --renewable fiedl@IFH.DE
▶ mutagen sync create --stage-mode=internal --name icetray-zeuthen ~/icecube/icetray fiedl@ice-wgs-gpu.ifh.de:~/icecube/icetray
▶ mutagen sync create --stage-mode=internal --name hole-ice-scripts-zeuthen ~/icecube/hole-ice-scripts fiedl@ice-wgs-gpu.ifh.de:~/icecube/hole-ice-scripts

Check sync session

[2022-09-10 13:53:29] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync list

Resume sync sessions after network has been down

[2022-09-10 14:33:36] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync resume icetray-zeuthen hole-ice-scripts-zeuthen

Terminate sync sessions

[2022-09-10 14:33:36] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync terminate icetray-zeuthen hole-ice-scripts-zeuthen

#9 (comment)

fiedl · 2022-09-10T12:55:48Z

With --sync-mode=two-way-resolved, the local directory takes precedence in case of conflicts.

https://mutagen.io/documentation/synchronization

[2022-09-10 14:33:36] fiedl@fiedl-mbp ~/icecube
▶ mutagen sync create --stage-mode=internal --sync-mode=two-way-resolved --name hole-ice-scripts-zeuthen ~/icecube/hole-ice-scripts fiedl@ice-wgs-gpu.ifh.de:~/icecube/hole-ice-scripts
▶ mutagen sync create --stage-mode=internal --sync-mode=two-way-resolved --name icetray-zeuthen ~/icecube/icetray fiedl@ice-wgs-gpu.ifh.de:~/icecube/icetray

which gives the local directory on the dev machine precedence over the zeuthen directory in case of conflicts. #9 (comment) https://mutagen.io/documentation/synchronization

fiedl mentioned this issue Sep 9, 2022

AttributeError: module 'icecube.phys_services' has no attribute 'I3SPRNGRandomService' #10

Closed

fiedl closed this as completed Sep 9, 2022

This was referenced Sep 9, 2022

Script: Propagate Photons #4

Open

No matching OpenCL devices #11

Open

Photonen mit Richtung generieren #7

Closed

Fetch hole-ice kernel code from 2018 #12

Open

fiedl added a commit that referenced this issue Sep 10, 2022

Documenting build in zeuthen

c5195b2

#9

fiedl added a commit that referenced this issue Sep 10, 2022

documenting new ssh hosts for mutagen

7696c58

#9 (comment)

fiedl added a commit that referenced this issue Sep 10, 2022

documenting mutagen sync mode

60d7778

which gives the local directory on the dev machine precedence over the zeuthen directory in case of conflicts. #9 (comment) https://mutagen.io/documentation/synchronization

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Build in Zeuthen #9

Build in Zeuthen #9

fiedl commented Sep 9, 2022 •

edited

Loading

fiedl commented Sep 9, 2022 •

edited

Loading

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022 •

edited

Loading

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022

fiedl commented Sep 10, 2022

fiedl commented Sep 10, 2022

Build in Zeuthen #9

Build in Zeuthen #9

Comments

fiedl commented Sep 9, 2022 • edited Loading

fiedl commented Sep 9, 2022 • edited Loading

Sync folders with mutagen

fiedl commented Sep 9, 2022

Build icetray on zeuthen

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022 • edited Loading

fiedl commented Sep 9, 2022

fiedl commented Sep 9, 2022

Test propagation script in zeuthen

fiedl commented Sep 9, 2022

fiedl commented Sep 10, 2022

Mutagen

Install mutagen

Create directory syncs

Check sync session

Resume sync sessions after network has been down

Terminate sync sessions

fiedl commented Sep 10, 2022

fiedl commented Sep 9, 2022 •

edited

Loading

fiedl commented Sep 9, 2022 •

edited

Loading

fiedl commented Sep 9, 2022 •

edited

Loading