Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cp in NCO mode of RUN_ENVIR. #694

Closed
aerorahul opened this issue Sep 9, 2022 · 13 comments
Closed

cp in NCO mode of RUN_ENVIR. #694

aerorahul opened this issue Sep 9, 2022 · 13 comments
Assignees

Comments

@aerorahul
Copy link
Contributor

#[[ $RUN_ENVIR = nco ]] && LINK="cp -rp"

This line needs to be uncommented when operating under NCO mode.
Please recut the tag ops-gfsv16.2.1

@GeorgeGayno-NOAA
Copy link
Collaborator

Should I keep the name of the tag the same or can I increment the number to 16.2.2?

@aerorahul
Copy link
Contributor Author

If you will create a new tag, let it be 16.3.0 since that's the current implementation.
@KateFriedman-NOAA please take note.

@GeorgeGayno-NOAA
Copy link
Collaborator

Updated at 8313030.

@aerorahul and @KateFriedman-NOAA Please check my branch. If correct, I will create a release tag.

@KateFriedman-NOAA
Copy link
Collaborator

Trying this update in a fresh checkout/build/link of the GFSv16.3.0 global-workflow package (with the hotfix/gfsv16.3.0 branch)...

@KateFriedman-NOAA
Copy link
Collaborator

@GeorgeGayno-NOAA Please also update the FIX_DIR paths to the special v16.3.0 fix set: ../fix_nco_gfsv16.3.0

Here is the full block in the global-workflow link script:

if [ $machine == "cray" ]; then
    FIX_DIR="/gpfs/hps3/emc/global/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16"
elif [ $machine = "dell" ]; then
    FIX_DIR="/gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16.3.0"
elif [ $machine = "wcoss2" ]; then
    FIX_DIR="/lfs/h2/emc/global/save/emc.global/FIX/fix_nco_gfsv16.3.0"
elif [ $machine = "hera" ]; then
    FIX_DIR="/scratch1/NCEPDEV/global/glopara/fix_nco_gfsv16.3.0"
elif [ $machine = "orion" ]; then
    FIX_DIR="/work/noaa/global/glopara/fix_nco_gfsv16.3.0"
fi

Apologies for not making sure you knew of this set earlier!

@GeorgeGayno-NOAA
Copy link
Collaborator

@GeorgeGayno-NOAA Please also update the FIX_DIR paths to the special v16.3.0 fix set: ../fix_nco_gfsv16.3.0

Here is the full block in the global-workflow link script:

if [ $machine == "cray" ]; then
    FIX_DIR="/gpfs/hps3/emc/global/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16"
elif [ $machine = "dell" ]; then
    FIX_DIR="/gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16.3.0"
elif [ $machine = "wcoss2" ]; then
    FIX_DIR="/lfs/h2/emc/global/save/emc.global/FIX/fix_nco_gfsv16.3.0"
elif [ $machine = "hera" ]; then
    FIX_DIR="/scratch1/NCEPDEV/global/glopara/fix_nco_gfsv16.3.0"
elif [ $machine = "orion" ]; then
    FIX_DIR="/work/noaa/global/glopara/fix_nco_gfsv16.3.0"
fi

Apologies for not making sure you knew of this set earlier!

No problem. I will also remove the references to our WCOSS1 system.

@GeorgeGayno-NOAA
Copy link
Collaborator

@GeorgeGayno-NOAA Please also update the FIX_DIR paths to the special v16.3.0 fix set: ../fix_nco_gfsv16.3.0
Here is the full block in the global-workflow link script:

if [ $machine == "cray" ]; then
    FIX_DIR="/gpfs/hps3/emc/global/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16"
elif [ $machine = "dell" ]; then
    FIX_DIR="/gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_nco_gfsv16.3.0"
elif [ $machine = "wcoss2" ]; then
    FIX_DIR="/lfs/h2/emc/global/save/emc.global/FIX/fix_nco_gfsv16.3.0"
elif [ $machine = "hera" ]; then
    FIX_DIR="/scratch1/NCEPDEV/global/glopara/fix_nco_gfsv16.3.0"
elif [ $machine = "orion" ]; then
    FIX_DIR="/work/noaa/global/glopara/fix_nco_gfsv16.3.0"
fi

Apologies for not making sure you knew of this set earlier!

No problem. I will also remove the references to our WCOSS1 system.

What about jet? Will these files be hosted there at some point?

GeorgeGayno-NOAA added a commit that referenced this issue Sep 12, 2022
@KateFriedman-NOAA
Copy link
Collaborator

Jet won't be supported for GFSv16. We will support Jet in GFSv17+. The developmental fix set for GFSv17+ is on Jet, so you can add it to your develop branch for supporting GFSv17+: /lfs4/HFIP/hfv3gfs/glopara/git/fv3gfs/fix

@GeorgeGayno-NOAA
Copy link
Collaborator

Successfully tested 34ff043 on Orion, Hera and Cactus.

@KateFriedman-NOAA go ahead and try it for yourself.

@KateFriedman-NOAA
Copy link
Collaborator

It works (thanks!) but need one more edit. Since this copy of fix for v16.3 is mostly symlinks to the prior v16 set (except for a few files that were modified for this implementation) both UFS_UTILS and global-workflow need to use the L flag with cp to copy the files through the symlinks and resolve them for NCO mode. Any file that isn't a symlink will be copied normally. This is the first implementation where we are using symlinks in the fix set, I overlooked this.

Please change this line to include L:

[[ $RUN_ENVIR = nco ]] && LINK="cp -rpL"

I tested the above change in my copy of UFS_UTILS hotfix branch, it worked. I am making the same update on the global-workflow side. Thanks!

GeorgeGayno-NOAA added a commit that referenced this issue Sep 12, 2022
@GeorgeGayno-NOAA
Copy link
Collaborator

It works (thanks!) but need one more edit. Since this copy of fix for v16.3 is mostly symlinks to the prior v16 set (except for a few files that were modified for this implementation) both UFS_UTILS and global-workflow need to use the L flag with cp to copy the files through the symlinks and resolve them for NCO mode. Any file that isn't a symlink will be copied normally. This is the first implementation where we are using symlinks in the fix set, I overlooked this.

Please change this line to include L:

[[ $RUN_ENVIR = nco ]] && LINK="cp -rpL"

I tested the above change in my copy of UFS_UTILS hotfix branch, it worked. I am making the same update on the global-workflow side. Thanks!

Done at cfc4ca4.

@KateFriedman-NOAA
Copy link
Collaborator

KateFriedman-NOAA commented Sep 12, 2022

Looks good! Feel free to merge and cut a new tag for v16.3.0 now, thanks! I'll update the UFS_UTILS tag name in global-workflow checkout script and the release notes once created.

@GeorgeGayno-NOAA
Copy link
Collaborator

Tag has been created. Closing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants