Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TSCC2 - Create pull request(s) to merge tscc/0.17.3/cpu and tscc/0.17.3/gpu into sdsc/spack repo #107

Open
mkandes opened this issue Sep 22, 2023 · 1 comment

Comments

@mkandes
Copy link
Member

mkandes commented Sep 22, 2023

@jerrypgreenberg has initially deployed the production Spack instances on TSCC2 --- tscc/0.17.3/cpu and tscc/0.17.3/gpu --- from a non-standard fork of the sdsc/spack repo: https://github.com/jerrypgreenberg/sdsc-tscc

[mkandes@login1 mkandes]$ cp -r /cm/shared/apps/spack/0.17.3/cpu/ ./
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/cpu/specs/gcc@10.2.0/nohup.out' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/cpu/specs/intel@19.1.1.217/intel-mpi@2019.10.317/nohup.out' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/gpu/specs/gcc@10.2.0/intel-mpi@2019.10.317/nohup.out' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/gpu/specs/gcc@8.5.0/intel-mpi@2019.10.317/nohup.out' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/gpu/specs/gcc@9.2.0/intel-mpi@2019.10.317/nohup.out' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/etc/spack/sdsc/tscc/0.17.3/gpu/specs/nohup.out' for reading: Permission denied


cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/opt/spack/linux-rocky9-broadwell/gcc-11.2.0/matlab-2022b-tjyunced33q37kefssh5bw7o55m6vv5i/sys/ros2/glnxa64/ros2/src/gmock_vendor/include/gmock/gmock-generated-matchers.h' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/opt/spack/linux-rocky9-broadwell/gcc-11.2.0/matlab-2022b-tjyunced33q37kefssh5bw7o55m6vv5i/toolbox/dsp/dsputilities/safeEval.m' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/opt/spack/linux-rocky9-broadwell/gcc-11.2.0/matlab-2022b-tjyunced33q37kefssh5bw7o55m6vv5i/resources/dsp/ja_JP/fspecs/hphbmin/convert2specword.xml' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/opt/spack/linux-rocky9-broadwell/gcc-11.2.0/matlab-2022b-tjyunced33q37kefssh5bw7o55m6vv5i/help/driving/csh/blocks/Simulink.SLDialogSource.SubSystem.Simulation_3D_Scene_Configuration.map' for reading: Permission denied
cp: cannot open '/cm/shared/apps/spack/0.17.3/cpu/opt/spack/linux-rocky9-broadwell/gcc-11.2.0/matlab-2022b-tjyunced33q37kefssh5bw7o55m6vv5i/help/dsp/csh/blocks/dspdialogkalmankalman_filter-id-isoutputeststate.html' for reading: Permission denied
[mkandes@login1 mkandes]$ 
[mkandes@login1 mkandes]$ 
[mkandes@login1 mkandes]$ ls
cpu  spack
[mkandes@login1 mkandes]$ cd cpu/
[mkandes@login1 cpu]$ ls
bin              COPYRIGHT  LICENSE-APACHE  opt             README.md    var
CHANGELOG.md     etc        LICENSE-MIT     pyproject.toml  SECURITY.md
CONTRIBUTING.md  lib        NOTICE          pytest.ini      share
[mkandes@login1 cpu]$ git log
commit c2a5096e36f5d730150883b66eb5a722dc05d585 (HEAD -> 0.17.3, origin/HEAD, origin/0.17.3)
Author: Jerry Greenberg <jpg@login1.tscc.sdsc.edu>
Date:   Fri Aug 25 12:52:25 2023 -0700

    restrich amber cuda arch's to 60 and 75

commit a92602179c65bfbff02bd6c000399376359e6ac6
Author: Jerry Greenberg <jpg@login1.tscc.sdsc.edu>
Date:   Tue Aug 22 18:52:29 2023 -0700

    added aspera-cli and awscli gpu install scripts

commit e9c3117747d843e1993b99b683814fab49c0545c
Author: Jerry Greenberg <jpg@login1.tscc.sdsc.edu>
Date:   Tue Aug 22 18:50:28 2023 -0700

    added aspera-cli and awscli cpu install scripts

commit 9bdb30fa11920d6f6192c7e7fa9f8dfab04a8a3b
Author: Jerry Greenberg <jpg@login1.cm.cluster>
Date:   Mon Jul 17 18:59:56 2023 -0700

[mkandes@login1 cpu]$ git remote -v
origin	https://github.com/jerrypgreenberg/sdsc-tscc (fetch)
origin	https://github.com/jerrypgreenberg/sdsc-tscc (push)
[mkandes@login1 cpu]$ pwd
/tscc/lustre/scratch/mkandes/cpu
[mkandes@login1 cpu]$

The task here was to sort out how to resync these deployed instances and the non-standard fork back with the offical sdsc/spack repo to track the changes made by @jerrypgreenberg during the deployment of the instances on TSCC2.

@mkandes
Copy link
Member Author

mkandes commented Sep 22, 2023

The following example PR by @tcooper

#92

was created with the following sequence of commands

~ ❯ cd tmp/git                                                                                                     ~/tmp/git ❯ mkdir jerry                                                                                            ~/tmp/git ❯ cd jerry                                                                                               

~/tmp/git/jerry ❯ git clone https://github.com/jerrypgreenberg/sdsc-tscc                                           Cloning into 'sdsc-tscc'...
remote: Enumerating objects: 408946, done.
remote: Counting objects: 100% (3860/3860), done.
remote: Compressing objects: 100% (395/395), done.
remote: Total 408946 (delta 3359), reused 3838 (delta 3346), pack-reused 405086
Receiving objects: 100% (408946/408946), 254.89 MiB | 37.01 MiB/s, done.
Resolving deltas: 100% (167018/167018), done.
Updating files: 100% (10759/10759), done.

~/tmp/git/jerry/spack 0.17.3 ❯ git remote -v                                                                   origin	https://github.com/jerrypgreenberg/sdsc-tscc (fetch)
origin	https://github.com/jerrypgreenberg/sdsc-tscc (push)

~/tmp/git/jerry/spack 0.17.3 ❯ git remote add upstream https://github.com/jerrypgreenberg/sdsc-tscc            
~/tmp/git/jerry/spack 0.17.3 ❯ git remote set-url origin git@github.com:tcooper/spack.git                      

~/tmp/git/jerry/spack 0.17.3 ❯ git push --force                                                                Enumerating objects: 8079, done.
Counting objects: 100% (8079/8079), done.
Delta compression using up to 16 threads
Compressing objects: 100% (879/879), done.
Writing objects: 100% (8071/8071), 48.65 MiB | 1.39 MiB/s, done.
Total 8071 (delta 6951), reused 8025 (delta 6938), pack-reused 0
remote: Resolving deltas: 100% (6951/6951), completed with 3 local objects.
remote: warning: See https://gh.io/lfs for more information.
remote: warning: File var/spack/repos/sdsc/packages/lammps/C_10_10.mesocnt is 82.67 MB; this is larger than GitHub's recommended maximum file size of 50.00 MB
remote: warning: GH001: Large files detected. You may want to try Git Large File Storage - https://git-lfs.github.com.
remote:
remote: Create a pull request for '0.17.3' on GitHub by visiting:
remote:      https://github.com/tcooper/spack/pull/new/0.17.3
remote:
To github.com:tcooper/spack.git
 * [new branch]            0.17.3 -> 0.17.3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant